Skip to content
Snippets Groups Projects
Commit 41141766 authored by Yun Li's avatar Yun Li
Browse files

Merge branch 'correct_quantizer_hop3' into 'VTM-11.0_nnvc'

Correct quantizer hop3

See merge request jvet-ahg-nnvc/VVCSoftware_VTM!218
parents 0e3e45ca fb4a6e70
No related branches found
No related tags found
No related merge requests found
......@@ -79,7 +79,7 @@ s += f" 50 {Q} 52 {Q} "
# building blocks
Q = 11
for i in range(24):
for i in range(31):
# conv internal quantization offset
s += f"{57+i*31} 0 "
s += f"{63+i*31} 0 "
......@@ -110,13 +110,13 @@ for i in range(24):
# final conv+bias
Q = 11
s += f" 800 {Q} 802 {Q} 806 {Q} 808 {Q}"
s += f" 1017 {Q} 1019 {Q} 1023 {Q} 1025 {Q}"
# leaky relu
s += f" 804 {Q} "
s += f" 1021 {Q} "
# conv internal quantization offset
s += " 801 0 807 0 "
s += " 1018 0 1024 0 "
parser = argparse.ArgumentParser(
prog="quantize SADL float model in in16 model",
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment