TY - JOUR
T1 - Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment
AU - Chen, Baoliang
AU - Zhu, Hanwei
AU - Zhu, Lingyu
AU - Wang, Shiqi
AU - Kwong, Sam
N1 - Publisher Copyright:
© 1992-2012 IEEE.
PY - 2024
Y1 - 2024
N2 - The statistical regularities of natural images, referred to as natural scene statistics, play an important role in no-reference image quality assessment. However, it has been widely acknowledged that screen content images (SCIs), which are typically computer generated, do not hold such statistics. Here we make the first attempt to learn the statistics of SCIs, based upon which the quality of SCIs can be effectively determined. The underlying mechanism of the proposed approach is based upon the mild assumption that the SCIs, which are not physically acquired, still obey certain statistics that could be understood in a learning fashion. We empirically show that the statistics deviation could be effectively leveraged in quality assessment, and the proposed method is superior when evaluated in different settings. Extensive experimental results demonstrate the Deep Feature Statistics based SCI Quality Assessment (DFSS-IQA) model delivers promising performance compared with existing NR-IQA models and shows a high generalization capability in the cross-dataset settings. The implementation of our method is publicly available at https://github.com/Baoliang93/DFSS-IQA.
AB - The statistical regularities of natural images, referred to as natural scene statistics, play an important role in no-reference image quality assessment. However, it has been widely acknowledged that screen content images (SCIs), which are typically computer generated, do not hold such statistics. Here we make the first attempt to learn the statistics of SCIs, based upon which the quality of SCIs can be effectively determined. The underlying mechanism of the proposed approach is based upon the mild assumption that the SCIs, which are not physically acquired, still obey certain statistics that could be understood in a learning fashion. We empirically show that the statistics deviation could be effectively leveraged in quality assessment, and the proposed method is superior when evaluated in different settings. Extensive experimental results demonstrate the Deep Feature Statistics based SCI Quality Assessment (DFSS-IQA) model delivers promising performance compared with existing NR-IQA models and shows a high generalization capability in the cross-dataset settings. The implementation of our method is publicly available at https://github.com/Baoliang93/DFSS-IQA.
KW - distribution deviation
KW - Image quality assessment
KW - no-reference
KW - scene statistics
KW - screen content image
UR - https://www.scopus.com/pages/publications/85192179630
U2 - 10.1109/TIP.2024.3393754
DO - 10.1109/TIP.2024.3393754
M3 - 文章
C2 - 38691435
AN - SCOPUS:85192179630
SN - 1057-7149
VL - 33
SP - 3227
EP - 3241
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
ER -