TY - JOUR
T1 - Video Compression based on Spatio-Temporal Resolution Adaptation
AU - Afonso, Mariana
AU - Zhang, Aaron
AU - Bull, David
PY - 2019/1/1
Y1 - 2019/1/1
N2 - A Video Compression framework based on Spatio-Temporal Resolution Adaptation (ViSTRA) is proposed, which dynamically resamples the input video spatially and temporally during encoding, based on a quantisation-resolution decision, and reconstructs the full resolution video at the decoder. Temporal upsampling is performed using frame repetition, whereas a Convolutional Neural Network (CNN) superresolution model is employed for spatial resolution upsampling. ViSTRA has been integrated into the High Efficiency Video Coding (HEVC) reference software (HM 16.14). Experimental results verified via an international challenge show significant improvements, with BD-rate gains of 15% based on PSNR and an average MOS difference of 0.5 based on subjective visual quality tests.
AB - A Video Compression framework based on Spatio-Temporal Resolution Adaptation (ViSTRA) is proposed, which dynamically resamples the input video spatially and temporally during encoding, based on a quantisation-resolution decision, and reconstructs the full resolution video at the decoder. Temporal upsampling is performed using frame repetition, whereas a Convolutional Neural Network (CNN) superresolution model is employed for spatial resolution upsampling. ViSTRA has been integrated into the High Efficiency Video Coding (HEVC) reference software (HM 16.14). Experimental results verified via an international challenge show significant improvements, with BD-rate gains of 15% based on PSNR and an average MOS difference of 0.5 based on subjective visual quality tests.
KW - Video compression
KW - spatial resolution adaptation
KW - temporal resolution adaptation
KW - perceptual video compression
KW - CNN-based super-resolution
U2 - 10.1109/TCSVT.2018.2878952
DO - 10.1109/TCSVT.2018.2878952
M3 - Article (Academic Journal)
SN - 1051-8215
VL - 29
SP - 275
EP - 280
JO - IEEE Transactions on Circuits and Systems for Video Technology
JF - IEEE Transactions on Circuits and Systems for Video Technology
IS - 1
ER -