Skip to content
Snippets Groups Projects
Commit a450d488 authored by Franck Galpin's avatar Franck Galpin
Browse files

Update readme.md for create unified dataset (similar to stage 2)

parent 1ceeb71c
No related branches found
No related tags found
No related merge requests found
......@@ -388,12 +388,17 @@ It will generate a unique dataset for each dataset in ["stage3"]["encdec"]["path
#### 4a. Create an offline dataset with all batches
This step is similar to II-A-5a.
```sh
LIST="bvi bvi_valid tvd tvd_valid";
LIST="bvi tvd";
for DS in $LIST; do
python3 tools/create_unified_dataset.py --json_config training_scripts/NN_Filtering_HOP/config.json \
--nb_patches -1 --patch_size 128 --border_size 8 --input_dataset stage3/encdec_${DS} \
--components org_Y,org_U,org_V,pred_Y,pred_U,pred_V,rec_before_dbf_Y,rec_before_dbf_U,rec_before_dbf_V,bs_Y,bs_U,bs_V,qp_base,qp_slice,ipb_Y \
--output_location stage3/dataset
--output_location stage3/dataset/dataset_files/${DS}
python3 tools/create_unified_dataset.py --json_config training_scripts/NN_Filtering_HOP/config.json \
--nb_patches -1 --patch_size 128 --border_size 8 --input_dataset stage3/encdec_valid_${DS} \
--components org_Y,org_U,org_V,pred_Y,pred_U,pred_V,rec_before_dbf_Y,rec_before_dbf_U,rec_before_dbf_V,bs_Y,bs_U,bs_V,qp_base,qp_slice,ipb_Y \
--output_location stage3/dataset_valid/dataset_files/${DS}
done
```
**Note:** the directories in encdec can now be deleted if there is no need to regenerate an offline dataset.
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment