Skip to main navigation Skip to search Skip to main content

No-reference Image Quality Assessment via Non-local Dependency Modeling

  • Shuvue Jia
  • , Baoliang Chen
  • , Dingquan Li
  • , Shiqi Wang*
  • *Corresponding author for this work
  • City University of Hong Kong
  • Peng Cheng Laboratory

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In this paper, we propose a no-reference image quality assessment method based on non-local features learned by a graph neural network (GNN). The proposed quality assessment framework is rooted in the view that the human visual system perceives image quality with long-dependency constructed among different regions, inspiring us to explore the non-local interactions in quality prediction. Instead of relying on convolutional neural network (CNN) based quality assessment methods that primarily focus on local field features, the GNN aiming for non-local quality perception facilitates modeling such long-dependency. In particular, we first adopt superpixel segmentation for the graph nodes construction. Subsequently, a spatial attention module is proposed to integrate the long- and short-range dependencies among the nodes of the whole image. The learned non-local features are finally combined with the local features extracted by the pre-trained CNN, achieving superior performance to the features utilized individually. Experimental results on intra-dataset and cross-dataset settings verify our proposed method's effectiveness and advanced generalization capability. Source codes are publicly accessible at https://github.com/SuperBruceJia/NLNet-IQA for scientific reproducible research.

Original languageEnglish
Title of host publication2022 IEEE 24th International Workshop on Multimedia Signal Processing, MMSP 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665471893
DOIs
StatePublished - 2022
Externally publishedYes
Event24th IEEE International Workshop on Multimedia Signal Processing, MMSP 2022 - Shanghai, China
Duration: 26 Sep 202228 Sep 2022

Publication series

Name2022 IEEE 24th International Workshop on Multimedia Signal Processing, MMSP 2022

Conference

Conference24th IEEE International Workshop on Multimedia Signal Processing, MMSP 2022
Country/TerritoryChina
CityShanghai
Period26/09/2228/09/22

Keywords

  • graph neural network
  • human visual system
  • No-reference image quality assessment
  • non-local modeling
  • superpixel

Fingerprint

Dive into the research topics of 'No-reference Image Quality Assessment via Non-local Dependency Modeling'. Together they form a unique fingerprint.

Cite this