Skip to content

Fix: memory reduction: use actual CTU size instead of MAX_CU_SIZE in encoder

Fabrice URBAN requested to merge (removed):fix_max_cu_size into master

use actual CTU size instead of MAX_CU_SIZE for temporary data allocations in encoder:

  • temporary CS in EncCu
  • temporary CS in IntraSearch
  • REUSE_CU_RESULTS related data in EncModeCtrl

Results are bit-accurate. Memory reduction is about 2.8GB for 128x128 CU (RA Class B, C, D, E...), + all AI. (unfortunately, nothing for RA class A)

Edited by Fabrice URBAN

Merge request reports

Loading