• Brian Heng's avatar
    Fix for Ticket #311 Scaling List Bugs · 29305d37
    Brian Heng authored
      - Previous fix broke dependent  quantization for the non-scaling list case.
      - Negative shift values are no longer set to zero, so the shift is applied repeatedly to the fixed invQScale value (g_invQuantScales) during each loop.
DepQuant.cpp 66.5 KB