Skip to content
Snippets Groups Projects
Select Git revision
  • VTM-11.0_nnvc default protected
  • master
  • NNVC-9.1rc
  • NNVC-9.0rc1
  • NNVC-8.0
  • NNVC-8.0rc3
  • NNVC-8.0rc2
  • NNVC-7.1
  • NNVC-7.1rc2
  • NNVC-7.1rc
  • NNVC-7.0
  • NNVC-6.1
  • NNVC-6.0
  • NNVC-6.0rc1
  • NNVC-v5.1
  • NNVC-5.0
  • NNVC-4.0
  • NNVC-3.0
  • VTM-11.0_nnvc-3.0
  • NNVC-3.0rc1
  • NCS-1.0
  • NNVC-3.0wip2
22 results
Blame Permalink
Forked from jvet-ahg-nnvc / VVCSoftware_VTM
126 commits behind the upstream repository.
README.md 20.33 KiB

AhG 11 reference software for NNVC

This software package is the reference software for AhG11. The reference software includes both encoder and decoder functionality.

Reference software is useful in aiding users of a video coding standard to establish and test conformance and interoperability, and to educate users and demonstrate the capabilities of the standard. For these purposes, this software is provided as an aid for the study and implementation of Versatile Video Coding.

The software has been jointly developed by the ITU-T Video Coding Experts Group (VCEG, Question 6 of ITU-T Study Group 16) and the ISO/IEC Moving Picture Experts Group (MPEG, Working Group 11 of Subcommittee 29 of ISO/IEC Joint Technical Committee 1).

A software manual, which contains usage instructions, can be found in the "doc" subdirectory of this software package.

Content

The package contains the following components:

  • a base codec based on VTM-11.0_nnvc (VTM-11.0 + JVET-V0056 patch)
  • a data dumping feature at the decoder, activated with the macro NNVC_DUMP_DATA in TypeDef.h. Encoder log is also slightly changed in order to log some useful information
  • a data loading feature in python, compatible with the data dumped by the decoder
  • an inference feature based on SADL supporting both float and int16 model
  • a common api supporting input preparation and inference of NN-based models
  • two NN-based loop filter: default is the Low Operating Point (LOP). The second one is High Operating Point (HOP), available using the nn_based/HOP.cfg configuration file.
  • training scripts of the NN-based loop filter.

Build instructions

Submodule

The SADL sub module first need to be initialized the first time using, using the following commands:

git submodule init
git submodule update

The CMake tool is used to create platform-specific build files.

Although CMake may be able to generate 32-bit binaries, it is generally suggested to build 64-bit binaries. 32-bit binaries are not able to access more than 2GB of RAM, which will not be sufficient for coding larger image formats. Building in 32-bit environments is not tested and will not be supported.

Build instructions for plain CMake (suggested)

Note: A working CMake installation is required for building the software.

CMake generates configuration files for the compiler environment/development environment on each platform. The following is a list of examples for Windows (MS Visual Studio), macOS (Xcode) and Linux (make).

Open a command prompt on your system and change into the root directory of this project.

Create a build directory in the root directory:

mkdir build

Use one of the following CMake commands, based on your platform. Feel free to change the commands to satisfy your needs.

Windows Visual Studio 2015/17/19 64 Bit:

Use the proper generator string for generating Visual Studio files, e.g. for VS 2015:

cd build
cmake .. -G "Visual Studio 14 2015 Win64"

Then open the generated solution file in MS Visual Studio.

For VS 2017 use "Visual Studio 15 2017 Win64", for VS 2019 use "Visual Studio 16 2019".

Visual Studio 2019 also allows you to open the CMake directory directly. Choose "File->Open->CMake" for this option.

macOS Xcode:

For generating an Xcode workspace type:

cd build
cmake .. -G "Xcode"

Then open the generated work space in Xcode.

For generating Makefiles with optional non-default compilers, use the following commands:

cd build
cmake .. -DCMAKE_BUILD_TYPE=Release -DCMAKE_C_COMPILER=gcc-9 -DCMAKE_CXX_COMPILER=g++-9

In this example the brew installed GCC 9 is used for a release build.

Linux

For generating Linux Release Makefile:

cd build
cmake .. -DCMAKE_BUILD_TYPE=Release

For generating Linux Debug Makefile:

cd build
cmake .. -DCMAKE_BUILD_TYPE=Debug

When built in Unix-like environments, AVX2 is enabled by default for NN related code. Use the following commands to enable AVX512.

cd build
cmake .. -DCMAKE_BUILD_TYPE=Release -DNNLF_BUILD_WITH_AVX512=1

Then type

make -j

For more details, refer to the CMake documentation: https://cmake.org/cmake/help/latest/

Build instructions for make

Note: The build instructions in this section require the make tool and Python to be installed, which are part of usual Linux and macOS environments. See below for installation instruction for Python and GnuWin32 on Windows.

Open a command prompt on your system and change into the root directory of this project.

To use the default system compiler simply call:

make all

MSYS2 and MinGW (Windows)

Note: Build files for MSYS MinGW were added on request. The build platform is not regularily tested and can't be supported.

Open an MSYS MinGW 64-Bit terminal and change into the root directory of this project.

Call:

make all toolset=gcc

The following tools need to be installed for MSYS2 and MinGW:

Download CMake: http://www.cmake.org/ and install it.

Python and GnuWin32 are not mandatory, but they simplify the build process for the user.

python: https://www.python.org/downloads/release/python-371/

gnuwin32: https://sourceforge.net/projects/getgnuwin32/files/getgnuwin32/0.6.30/GetGnuWin32-0.6.3.exe/download

To use MinGW, install MSYS2: http://repo.msys2.org/distrib/msys2-x86_64-latest.exe