Skip to content

Suggested fix for issue #20

Sunmi Yoo requested to merge (removed):issue20_init_cost_array into master

m_modeCostStore is used without being initialized (or being exploited with the residue of the previous cost) by the encoding optimization code in line 1437, in IntraSearch.cpp. This code skips storing the cost of the current mode and it affects the candidate selection for the full RD when an LFNST index is larger than 0.

This merge request suggests to fix this issue by initializing m_modeCostStore[lfnstIdx][mode] with MAX_DOUBLE / 2.0.

Merge request reports

Loading