Skip to content
Snippets Groups Projects
Commit 36de7ad7 authored by Adrian Browne's avatar Adrian Browne
Browse files

Fix #1408: Replace int with TCoeff to fix zeroing out of coefficients.

parent 7abf654d
No related branches found
No related tags found
No related merge requests found
...@@ -265,7 +265,7 @@ void TrQuant::fwdLfnstNxN( TCoeff* src, TCoeff* dst, const uint32_t mode, const ...@@ -265,7 +265,7 @@ void TrQuant::fwdLfnstNxN( TCoeff* src, TCoeff* dst, const uint32_t mode, const
trMat += trSize; trMat += trSize;
} }
::memset( out, 0, ( trSize - zeroOutSize ) * sizeof( int ) ); ::memset( out, 0, ( trSize - zeroOutSize ) * sizeof( TCoeff ) );
} }
void TrQuant::invLfnstNxN( TCoeff* src, TCoeff* dst, const uint32_t mode, const uint32_t index, const uint32_t size, int zeroOutSize, const int maxLog2TrDynamicRange ) void TrQuant::invLfnstNxN( TCoeff* src, TCoeff* dst, const uint32_t mode, const uint32_t index, const uint32_t size, int zeroOutSize, const int maxLog2TrDynamicRange )
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment