Page content last modified on 2023-09-13.

uvgVenctester

uvgVenctester is a comprehensive toolkit for video encoder performance testing. It currently native supports HEVC, VVC, VP9, and AV1 video formats. From these formats Kvazaar, x265, uvg266, VVenC, SVT-VP9, and SVT-AV1 encoders are supported. However, adding support for new formats and encoders is a trivial task and can be done in less than fifteen minutes.

For quality metrics uvgVenctester supports PSNR, SSIM, and VMAF. Which can be used to calculate the Bjøntegaard delta bitrate (BD-rate) and Bjøntegaard delta quality metric (BD-metric) values. Additional metrics can be added by implementing a simple interface.

Currently, uvgVenctester supports three distinct output formats: CSV, table, and figure. The CSV output is intended for further processing with other tools, such as R or Python. It includes over fifty different output types ranging from identifying information to numeric values. The table output offers a quick overview of the results. The figure output is intended for visual verification of the rate-distortion curve.

Please cite the following paper for any usage of uvgVenctester:

J. Sainio, A. Mercat, and J. Vanne, “uvgVenctester: open-source test automation framework for comprehensive video encoder benchmarking,” in Proc. ACM Multimedia Syst. Conf., Istanbul, Turkey, Sept.-Oct. 2021. [Tuni.fi] [PDF]

Youtube video presentation

Publications

J. Sainio, A. Mercat, and J. Vanne, “uvgVenctester: open-source test automation framework for comprehensive video encoder benchmarking,” in Proc. ACM Multimedia Syst. Conf., Istanbul, Turkey, Sept.-Oct. 2021. [Tuni.fi] [PDF]