Fix #1409: Don't scale 15/16 bit sequences to lower bit depths if... (!1916) · Merge requests · jvet / VVCSoftware_VTM

Adrian Browne requested to merge adybrowne/VVCSoftware_VTM:fix_ticket_1409 into master Oct 22, 2020

If JVET_R0351_HIGH_BIT_DEPTH_ENABLED is not set, INPUTBITDEPTH=16 and INTERNALBITDEPTH<16, a 16 bit Pel (signed) is used to read in values. This results in errors when the top bit is set.

15 bit corner case can occur due to rounding if value = 32767.

When JVET_R0351_HIGH_BIT_DEPTH_ENABLED is set a 32 bit Pel is used and the conversion is done correctly.

Fix #1409: Don't scale 15/16 bit sequences to lower bit depths if...

Merge request reports