TY - GEN
T1 - Enhanced Image Decoding via Edge-Preserving Generative Adversarial Networks
AU - Mao, Qi
AU - Wang, Shiqi
AU - Wang, Shanshe
AU - Zhang, Xinfeng
AU - Ma, Siwei
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/10/8
Y1 - 2018/10/8
N2 - Lossy image compression usually introduces undesired compression artifacts, such as blocking, ringing and blurry effect{###} S, especially in low bit rate coding scenarios. Although many algorithms have been proposed to reduce these compression artifacts, most of them are based on image local smoothness prior, which usually leads to over-smoothing around the areas with distinct structures, e.g., edges and textures. In this paper, we propose a novel framework to enhance the perceptual quality of decoded images by well preserving the edge structures and predicting visually pleasing textures. Firstly, we propose an edge-preserving generative adversarial network (EP-GAN) to achieve edge restoration and texture generation simultaneously. Then, we elaborately design an edge fidelity regularization term to guide our network, which jointly utilizes the signal fidelity, feature fidelity and adversarial constraint to reconstruct high quality decoded images. Experimental results demonstrate that the proposed EP-GAN is able to efficiently enhance decoded images at low bit rate and reconstruct more perceptually pleasing images with abundant textures and sharp edges.
AB - Lossy image compression usually introduces undesired compression artifacts, such as blocking, ringing and blurry effect{###} S, especially in low bit rate coding scenarios. Although many algorithms have been proposed to reduce these compression artifacts, most of them are based on image local smoothness prior, which usually leads to over-smoothing around the areas with distinct structures, e.g., edges and textures. In this paper, we propose a novel framework to enhance the perceptual quality of decoded images by well preserving the edge structures and predicting visually pleasing textures. Firstly, we propose an edge-preserving generative adversarial network (EP-GAN) to achieve edge restoration and texture generation simultaneously. Then, we elaborately design an edge fidelity regularization term to guide our network, which jointly utilizes the signal fidelity, feature fidelity and adversarial constraint to reconstruct high quality decoded images. Experimental results demonstrate that the proposed EP-GAN is able to efficiently enhance decoded images at low bit rate and reconstruct more perceptually pleasing images with abundant textures and sharp edges.
KW - Compression artifact reduction
KW - edge prior
KW - generative adversarial network (GAN)
KW - image restoration
KW - perceptual loss
UR - https://www.scopus.com/pages/publications/85061439990
U2 - 10.1109/ICME.2018.8486495
DO - 10.1109/ICME.2018.8486495
M3 - 会议稿件
AN - SCOPUS:85061439990
T3 - Proceedings - IEEE International Conference on Multimedia and Expo
BT - 2018 IEEE International Conference on Multimedia and Expo, ICME 2018
PB - IEEE Computer Society
T2 - 2018 IEEE International Conference on Multimedia and Expo, ICME 2018
Y2 - 23 July 2018 through 27 July 2018
ER -