TY - GEN
T1 - Beyond Keypoint Coding
T2 - 2022 Data Compression Conference, DCC 2022
AU - Chen, Bolin
AU - Wang, Zhao
AU - Li, Binzhe
AU - Lin, Rongqun
AU - Wang, Shiqi
AU - Ye, Yan
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - We propose a talking face video compression framework by implicitly transforming the temporal evolution into compact feature representation. More specifically, the temporal evolution of faces, which is complex, non-linear and difficult to extrapolate, is modelled in an end-to-end inference framework based upon very compact features. This enables the high-quality rendering of the face videos, which benefits from the learning of dense motion map with compact feature representation. Therefore, the proposed framework can accommodate ultra-low bandwidth video communication and maintain the quality of the reconstructed videos. Experimental results demonstrate that compared with the state-of-the-art video coding standard Versatile Video Coding (VVC) as well as the latest generative compression scheme Face Video-to-Video Synthesis (Facevid2vid), the proposed scheme is superior in terms of both objective and subjective quality assessment methods.
AB - We propose a talking face video compression framework by implicitly transforming the temporal evolution into compact feature representation. More specifically, the temporal evolution of faces, which is complex, non-linear and difficult to extrapolate, is modelled in an end-to-end inference framework based upon very compact features. This enables the high-quality rendering of the face videos, which benefits from the learning of dense motion map with compact feature representation. Therefore, the proposed framework can accommodate ultra-low bandwidth video communication and maintain the quality of the reconstructed videos. Experimental results demonstrate that compared with the state-of-the-art video coding standard Versatile Video Coding (VVC) as well as the latest generative compression scheme Face Video-to-Video Synthesis (Facevid2vid), the proposed scheme is superior in terms of both objective and subjective quality assessment methods.
UR - https://www.scopus.com/pages/publications/85134361639
U2 - 10.1109/DCC52660.2022.00009
DO - 10.1109/DCC52660.2022.00009
M3 - 会议稿件
AN - SCOPUS:85134361639
T3 - Data Compression Conference Proceedings
SP - 13
EP - 22
BT - Proceedings - DCC 2022
A2 - Bilgin, Ali
A2 - Marcellin, Michael W.
A2 - Serra-Sagrista, Joan
A2 - Storer, James A.
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 22 March 2022 through 25 March 2022
ER -