Skip to content
Snippets Groups Projects
Commit 540722a4 authored by zhenyu Dai's avatar zhenyu Dai
Browse files

issue70: bugfix for scaling factor derivation

parent b43265aa
No related branches found
No related tags found
No related merge requests found
......@@ -317,7 +317,7 @@ void EncNNFilterHOP::scaleFactorDerivation(Picture &pic, FilterParameters &prms,
int scale = int(((area_comp * crossMulti - sumOrgResi * sumCnnResi + area_comp * area_comp * stablizingFactor)
/ (area_comp * selfMulti - sumCnnResi * sumCnnResi + area_comp * area_comp * stablizingFactor))
* (1 << shift) + 0.5);
* (1 << log2ResidueScale) + 0.5);
scale = Clip3(Bot, Up, scale);
prms.sprm.scale[compID][prmId] = scale;
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment