Skip to main navigation Skip to search Skip to main content

Mitigating Stereotypes in Text-to-Image Generation: A Novel Perspective of Selective Neural Suppression

  • Junlei Zhou
  • , Jiashi Gao
  • , Xinwei Guo
  • , Haiyan Wu
  • , Quanying Liu
  • , Xiangyu Zhao
  • , Hongxin Wei
  • , Xin Yao
  • , Xuetao Wei*
  • *Corresponding author for this work
  • Southern University of Science and Technology
  • University of Macau
  • City University of Hong Kong
  • Lingnan University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Text-to-Image (T2I) diffusion models exhibit concerning tendencies to generate harmful imagery that perpetuates social biases and stereotypes, posing significant ethical risks in real-world applications. While existing mitigation approaches predominantly employ black-box methodologies through dataset augmentation or constrained fine-tuning, they face critical limitations, including high data acquisition costs and potential exacerbation of stereotypes during model retraining. Inspired by neuroscience principles where neurological dysfunction often stems from aberrant neural activation patterns, we propose a novel framework, StereoClinic, targeting the root cause of stereotype generation through direct neural intervention. Our solution introduces two synergistic components: Diffusion Deep Taylor Decomposition (DDTD) for precisely localizing stereotype-related neurons via Layer-wise Relevance Propagation (LRP) attribution analysis, and Stereotype Neuron Suppression (SNS) implementing targeted activation damping to neutralize bias propagation. Through extensive empirical evaluations across multiple bias dimensions, we demonstrate that our method achieves significant stereotype mitigation without compromising image quality or requiring additional training data. This neuro-inspired approach establishes a new paradigm for model interpretability and ethical alignment in generative AI systems.

Original languageEnglish
Title of host publicationMM 2025 - Proceedings of the 33rd ACM International Conference on Multimedia, Co-Located with MM 2025
PublisherAssociation for Computing Machinery, Inc
Pages11453-11461
Number of pages9
ISBN (Electronic)9798400720352
DOIs
StatePublished - 27 Oct 2025
Externally publishedYes
Event33rd ACM International Conference on Multimedia, MM 2025 - Dublin, Ireland
Duration: 27 Oct 202531 Oct 2025

Publication series

NameMM 2025 - Proceedings of the 33rd ACM International Conference on Multimedia, Co-Located with MM 2025

Conference

Conference33rd ACM International Conference on Multimedia, MM 2025
Country/TerritoryIreland
CityDublin
Period27/10/2531/10/25

Keywords

  • diffusion models
  • neural suppression
  • stereotypes
  • text-to-image

Fingerprint

Dive into the research topics of 'Mitigating Stereotypes in Text-to-Image Generation: A Novel Perspective of Selective Neural Suppression'. Together they form a unique fingerprint.

Cite this