Skip to content

Correct wrong cost value

Santiago de Luxán Hernández requested to merge deluxan/VVCSoftware_VTM:costVariableFix into master

In the current master, the tmpCostWithoutSplitFlags variable within xCheckRdCostIntrastores the value of tempCS->cost minus the cost necessary to code the split flags. tempCS->cost can be reset to MAX_DOUBLEif an lfnst pass obtains a zero CBF. However, right now tmpCostWithoutSplitFlagsis not updated when that happens. This MR corrects that error by setting tmpCostWithoutSplitFlagsto MAX_DOUBLE too if the zero-CBF condition is triggered for the lfnst passes.

Edited by Santiago de Luxán Hernández

Merge request reports