Direct Optimisation of λ for HDR Content Adaptive Transcoding in AV1

Francois Pitie Vibhoothi; Angeliki Katsenou; Daniel Joseph Ringis; Yeping Su; Neil Birkbeck; Jessie Lin; Balu Adsumilli; Anil Kokaram

doi:10.1117/12.2632272

Direct Optimisation of λ for HDR Content Adaptive Transcoding in AV1

Francois Pitie Vibhoothi, Angeliki Katsenou, Daniel Joseph Ringis, Yeping Su, Neil Birkbeck, Jessie Lin, Balu Adsumilli, Anil Kokaram^*

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference Contribution (Conference Proceeding)

2 Citations (Scopus)

66 Downloads (Pure)

Abstract

Since the adoption of VP9 by Netflix in 2016, royalty-free coding standards continued to gain prominence through the activities of the AOMedia consortium. AV1, the latest open source standard, is now widely supported. In the early years after standardisation, HDR video tends to be under served in open source encoders for a variety of reasons including the relatively small amount of true HDR content being broadcast and the challenges in RD optimisation with that material. AV1 codec optimisation has been ongoing since 2020 including consideration of the computational load. In this paper, we explore the idea of direct optimisation of the Lagrangian $\lambda$ parameter used in the rate control of the encoders to estimate the optimal Rate-Distortion trade-off achievable for a High Dynamic Range signalled video clip. We show that by adjusting the Lagrange multiplier in the RD optimisation process on a frame-hierarchy basis, we are able to increase the Bjontegaard difference rate gains by more than 3.98$\times$ on average without visually affecting the quality.

Original language	English
Title of host publication	Applications of Digital Image Processing XLV
Subtitle of host publication	Applications of Digital Image Processing XLV
Editors	Andrew G. Tescher, Touradj Ebrahimi
Place of Publication	Washington
Publisher	Society of Photo-Optical Instrumentation Engineers (SPIE)
Number of pages	10
Volume	12226
ISBN (Electronic)	9781510654365
DOIs	https://doi.org/10.1117/12.2632272
Publication status	Published - 3 Oct 2022
Event	SPIE Optical Engineering + Applications - California, San Diego, United States Duration: 21 Aug 2022 → 26 Aug 2022

Publication series

Name	Proceedings of SPIE - The International Society for Optical Engineering
Volume	12226
ISSN (Print)	0277-786X
ISSN (Electronic)	1996-756X

Conference

Conference	SPIE Optical Engineering + Applications
Country/Territory	United States
City	San Diego
Period	21/08/22 → 26/08/22

Bibliographical note

Funding Information:
This project is funded under Disruptive Technology Innovation Fund, Enterprise Ireland, Grant No DT-2019-0068, and ADAPT-SFI Research Center, Ireland.

Publisher Copyright:
© 2022 SPIE.

Keywords

eess.IV
cs.MM
eess.SP

Access to Document

10.1117/12.2632272

Full-text PDF (final published version)
This is the final published version of the article (version of record). It first appeared online via SPIE at https://doi.org/10.1117/12.2632272 . Please refer to any applicable terms of use of the publisher.
Final published version, 5.88 MB

Handle.net

Persistent link

Cite this

Vibhoothi, F. P., Katsenou, A., Ringis, D. J., Su, Y., Birkbeck, N., Lin, J., Adsumilli, B., & Kokaram, A. (2022). Direct Optimisation of λ for HDR Content Adaptive Transcoding in AV1. In A. G. Tescher, & T. Ebrahimi (Eds.), Applications of Digital Image Processing XLV: Applications of Digital Image Processing XLV (Vol. 12226). Article 1222606 (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 12226). Society of Photo-Optical Instrumentation Engineers (SPIE). https://doi.org/10.1117/12.2632272

Vibhoothi, Francois Pitie ; Katsenou, Angeliki ; Ringis, Daniel Joseph et al. / Direct Optimisation of λ for HDR Content Adaptive Transcoding in AV1. Applications of Digital Image Processing XLV: Applications of Digital Image Processing XLV. editor / Andrew G. Tescher ; Touradj Ebrahimi. Vol. 12226 Washington : Society of Photo-Optical Instrumentation Engineers (SPIE), 2022. (Proceedings of SPIE - The International Society for Optical Engineering).

@inproceedings{5906638fdc004b81930774d68de9dd38,

title = "Direct Optimisation of λ for HDR Content Adaptive Transcoding in AV1",

abstract = "Since the adoption of VP9 by Netflix in 2016, royalty-free coding standards continued to gain prominence through the activities of the AOMedia consortium. AV1, the latest open source standard, is now widely supported. In the early years after standardisation, HDR video tends to be under served in open source encoders for a variety of reasons including the relatively small amount of true HDR content being broadcast and the challenges in RD optimisation with that material. AV1 codec optimisation has been ongoing since 2020 including consideration of the computational load. In this paper, we explore the idea of direct optimisation of the Lagrangian $\lambda$ parameter used in the rate control of the encoders to estimate the optimal Rate-Distortion trade-off achievable for a High Dynamic Range signalled video clip. We show that by adjusting the Lagrange multiplier in the RD optimisation process on a frame-hierarchy basis, we are able to increase the Bjontegaard difference rate gains by more than 3.98$\times$ on average without visually affecting the quality.",

keywords = "eess.IV, cs.MM, eess.SP",

author = "Vibhoothi, {Francois Pitie} and Angeliki Katsenou and Ringis, {Daniel Joseph} and Yeping Su and Neil Birkbeck and Jessie Lin and Balu Adsumilli and Anil Kokaram",

note = "Funding Information: This project is funded under Disruptive Technology Innovation Fund, Enterprise Ireland, Grant No DT-2019-0068, and ADAPT-SFI Research Center, Ireland. Publisher Copyright: {\textcopyright} 2022 SPIE.; SPIE Optical Engineering + Applications ; Conference date: 21-08-2022 Through 26-08-2022",

year = "2022",

month = oct,

day = "3",

doi = "10.1117/12.2632272",

language = "English",

volume = "12226",

series = "Proceedings of SPIE - The International Society for Optical Engineering",

publisher = "Society of Photo-Optical Instrumentation Engineers (SPIE)",

editor = "Tescher, {Andrew G.} and Touradj Ebrahimi",

booktitle = "Applications of Digital Image Processing XLV",

address = "United States",

}

Vibhoothi, FP, Katsenou, A, Ringis, DJ, Su, Y, Birkbeck, N, Lin, J, Adsumilli, B & Kokaram, A 2022, Direct Optimisation of λ for HDR Content Adaptive Transcoding in AV1. in AG Tescher & T Ebrahimi (eds), Applications of Digital Image Processing XLV: Applications of Digital Image Processing XLV. vol. 12226, 1222606, Proceedings of SPIE - The International Society for Optical Engineering, vol. 12226, Society of Photo-Optical Instrumentation Engineers (SPIE), Washington, SPIE Optical Engineering + Applications, San Diego, United States, 21/08/22. https://doi.org/10.1117/12.2632272

Direct Optimisation of λ for HDR Content Adaptive Transcoding in AV1. / Vibhoothi, Francois Pitie; Katsenou, Angeliki; Ringis, Daniel Joseph et al.
Applications of Digital Image Processing XLV: Applications of Digital Image Processing XLV. ed. / Andrew G. Tescher; Touradj Ebrahimi. Vol. 12226 Washington: Society of Photo-Optical Instrumentation Engineers (SPIE), 2022. 1222606 (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 12226).

Research output: Chapter in Book/Report/Conference proceeding › Conference Contribution (Conference Proceeding)

TY - GEN

T1 - Direct Optimisation of λ for HDR Content Adaptive Transcoding in AV1

AU - Vibhoothi, Francois Pitie

AU - Katsenou, Angeliki

AU - Ringis, Daniel Joseph

AU - Su, Yeping

AU - Birkbeck, Neil

AU - Lin, Jessie

AU - Adsumilli, Balu

AU - Kokaram, Anil

N1 - Funding Information: This project is funded under Disruptive Technology Innovation Fund, Enterprise Ireland, Grant No DT-2019-0068, and ADAPT-SFI Research Center, Ireland. Publisher Copyright: © 2022 SPIE.

PY - 2022/10/3

Y1 - 2022/10/3

N2 - Since the adoption of VP9 by Netflix in 2016, royalty-free coding standards continued to gain prominence through the activities of the AOMedia consortium. AV1, the latest open source standard, is now widely supported. In the early years after standardisation, HDR video tends to be under served in open source encoders for a variety of reasons including the relatively small amount of true HDR content being broadcast and the challenges in RD optimisation with that material. AV1 codec optimisation has been ongoing since 2020 including consideration of the computational load. In this paper, we explore the idea of direct optimisation of the Lagrangian $\lambda$ parameter used in the rate control of the encoders to estimate the optimal Rate-Distortion trade-off achievable for a High Dynamic Range signalled video clip. We show that by adjusting the Lagrange multiplier in the RD optimisation process on a frame-hierarchy basis, we are able to increase the Bjontegaard difference rate gains by more than 3.98$\times$ on average without visually affecting the quality.

AB - Since the adoption of VP9 by Netflix in 2016, royalty-free coding standards continued to gain prominence through the activities of the AOMedia consortium. AV1, the latest open source standard, is now widely supported. In the early years after standardisation, HDR video tends to be under served in open source encoders for a variety of reasons including the relatively small amount of true HDR content being broadcast and the challenges in RD optimisation with that material. AV1 codec optimisation has been ongoing since 2020 including consideration of the computational load. In this paper, we explore the idea of direct optimisation of the Lagrangian $\lambda$ parameter used in the rate control of the encoders to estimate the optimal Rate-Distortion trade-off achievable for a High Dynamic Range signalled video clip. We show that by adjusting the Lagrange multiplier in the RD optimisation process on a frame-hierarchy basis, we are able to increase the Bjontegaard difference rate gains by more than 3.98$\times$ on average without visually affecting the quality.

KW - eess.IV

KW - cs.MM

KW - eess.SP

U2 - 10.1117/12.2632272

DO - 10.1117/12.2632272

M3 - Conference Contribution (Conference Proceeding)

VL - 12226

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Applications of Digital Image Processing XLV

A2 - Tescher, Andrew G.

A2 - Ebrahimi, Touradj

PB - Society of Photo-Optical Instrumentation Engineers (SPIE)

CY - Washington

T2 - SPIE Optical Engineering + Applications

Y2 - 21 August 2022 through 26 August 2022

ER -

Vibhoothi FP, Katsenou A, Ringis DJ, Su Y, Birkbeck N, Lin J et al. Direct Optimisation of λ for HDR Content Adaptive Transcoding in AV1. In Tescher AG, Ebrahimi T, editors, Applications of Digital Image Processing XLV: Applications of Digital Image Processing XLV. Vol. 12226. Washington: Society of Photo-Optical Instrumentation Engineers (SPIE). 2022. 1222606. (Proceedings of SPIE - The International Society for Optical Engineering). doi: 10.1117/12.2632272

Direct Optimisation of λ for HDR Content Adaptive Transcoding in AV1

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Handle.net

Fingerprint

Cite this