GAN-based Effective Bit Depth Adaptation for Perceptual Video Compression

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

106 Downloads (Pure)

Abstract

Resolution and effective bit depth (EBD) adaptation have been recently utilised in video compression to improve coding efficiency. This type of approach dynamically reduces spatial/temporal resolutions and effective bit depth at the encoder and restores the original video formats during decoding. In this paper, a convolutional neural networks (CNN) based EBD adaptation method is presented for perceptual video compression, in which the employed CNN models are trained using a generative adversarial network (GAN), with perception-based loss functions. This method was integrated into the HEVC HM 16.20 reference software and fully evaluated on test sequences from the JVET Common Test Conditions using the Random Access configuration. The results show significant coding gains achieved on all test sequences with an overall bit rate saving of 24.8% (Bjøntegaard Delta measurement) based on a perceptual quality metric, VMAF.
Original languageEnglish
Title of host publicationIEEE International Conference on Multimedia & Expo (ICME)
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Publication statusAccepted/In press - 6 Mar 2020
EventIEEE ICME 2020 - London, United Kingdom
Duration: 6 Jul 202010 Jul 2020

Conference

ConferenceIEEE ICME 2020
CountryUnited Kingdom
CityLondon
Period6/07/2010/07/20

Fingerprint Dive into the research topics of 'GAN-based Effective Bit Depth Adaptation for Perceptual Video Compression'. Together they form a unique fingerprint.

  • Cite this

    Ma, D., Zhang, F., & Bull, D. (Accepted/In press). GAN-based Effective Bit Depth Adaptation for Perceptual Video Compression. In IEEE International Conference on Multimedia & Expo (ICME) Institute of Electrical and Electronics Engineers (IEEE).