• Brian Heng's avatar
    Fix for Ticket #311 Scaling List Bugs · 29305d37
    Brian Heng authored
      - Previous fix broke dependent  quantization for the non-scaling list case.
      - Negative shift values are no longer set to zero, so the shift is applied repeatedly to the fixed invQScale value (g_invQuantScales) during each loop.
    29305d37
Name
Last commit
Last update
cfg Loading commit data...
cmake/CMakeBuild Loading commit data...
doc Loading commit data...
lldb Loading commit data...
source Loading commit data...
.clang-format Loading commit data...
.cproject Loading commit data...
.editorconfig Loading commit data...
.gitattributes Loading commit data...
.gitignore Loading commit data...
.project Loading commit data...
.pydevproject Loading commit data...
CMakeLists.txt Loading commit data...
COPYING Loading commit data...
Makefile Loading commit data...
README.md Loading commit data...