Skip to main navigation Skip to search Skip to main content

Opinion-Unaware Blind Image Quality Assessment Using Multi-Scale Deep Feature Statistics

  • Zhangkai Ni
  • , Yue Liu
  • , Keyan Ding*
  • , Wenhan Yang
  • , Hanli Wang*
  • , Shiqi Wang
  • *Corresponding author for this work
  • Tongji University
  • City University of Hong Kong
  • ZJU-Hangzhou Global Scientific and Technological Innovation Center
  • Pengcheng Laboratory

Research output: Contribution to journalArticlepeer-review

Abstract

Deeplearning-based methods have significantly influenced the blind image quality assessment (BIQA) field, however, these methods often require training using large amounts of human rating data. In contrast, traditional knowledge-based methods are cost-effective for training but face challenges in effectively extracting features aligned with human visual perception. To bridge these gaps, we propose integrating deep features from pre-trained visual models with a statistical analysis model into a Multi-scale Deep Feature Statistics (MDFS) model for achieving opinion-unaware BIQA (OU-BIQA), thereby eliminating the reliance on human rating data and significantly improving training efficiency. Specifically, we extract patch-wise multi-scale features from pre-trained vision models, which are subsequently fitted into a multivariate Gaussian (MVG) model. The final quality score is determined by quantifying the distance between the MVG model derived from the test image and the benchmark MVG model derived from the high-quality image set. A comprehensive series of experiments conducted on various datasets show that our proposed model exhibits superior consistency with human visual perception compared to state-of-the-art BIQA models. Furthermore, it shows improved generalizability across diverse target-specific BIQA tasks.

Original languageEnglish
Pages (from-to)10211-10224
Number of pages14
JournalIEEE Transactions on Multimedia
Volume26
DOIs
StatePublished - 2024
Externally publishedYes

Keywords

  • Blind image quality assessment
  • feature statistics
  • multi-scale deep features
  • multivariate Gaussian fitting

Fingerprint

Dive into the research topics of 'Opinion-Unaware Blind Image Quality Assessment Using Multi-Scale Deep Feature Statistics'. Together they form a unique fingerprint.

Cite this