跳到主要导航 跳到搜索 跳到主要内容

Mitigating Stereotypes in Text-to-Image Generation: A Novel Perspective of Selective Neural Suppression

  • Junlei Zhou
  • , Jiashi Gao
  • , Xinwei Guo
  • , Haiyan Wu
  • , Quanying Liu
  • , Xiangyu Zhao
  • , Hongxin Wei
  • , Xin Yao
  • , Xuetao Wei*
  • *此作品的通讯作者
  • Southern University of Science and Technology
  • University of Macau
  • City University of Hong Kong
  • Lingnan University

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Text-to-Image (T2I) diffusion models exhibit concerning tendencies to generate harmful imagery that perpetuates social biases and stereotypes, posing significant ethical risks in real-world applications. While existing mitigation approaches predominantly employ black-box methodologies through dataset augmentation or constrained fine-tuning, they face critical limitations, including high data acquisition costs and potential exacerbation of stereotypes during model retraining. Inspired by neuroscience principles where neurological dysfunction often stems from aberrant neural activation patterns, we propose a novel framework, StereoClinic, targeting the root cause of stereotype generation through direct neural intervention. Our solution introduces two synergistic components: Diffusion Deep Taylor Decomposition (DDTD) for precisely localizing stereotype-related neurons via Layer-wise Relevance Propagation (LRP) attribution analysis, and Stereotype Neuron Suppression (SNS) implementing targeted activation damping to neutralize bias propagation. Through extensive empirical evaluations across multiple bias dimensions, we demonstrate that our method achieves significant stereotype mitigation without compromising image quality or requiring additional training data. This neuro-inspired approach establishes a new paradigm for model interpretability and ethical alignment in generative AI systems.

源语言英语
主期刊名MM 2025 - Proceedings of the 33rd ACM International Conference on Multimedia, Co-Located with MM 2025
出版商Association for Computing Machinery, Inc
11453-11461
页数9
ISBN(电子版)9798400720352
DOI
出版状态已出版 - 27 10月 2025
已对外发布
活动33rd ACM International Conference on Multimedia, MM 2025 - Dublin, 爱尔兰
期限: 27 10月 202531 10月 2025

出版系列

姓名MM 2025 - Proceedings of the 33rd ACM International Conference on Multimedia, Co-Located with MM 2025

会议

会议33rd ACM International Conference on Multimedia, MM 2025
国家/地区爱尔兰
Dublin
时期27/10/2531/10/25

学术指纹

探究 'Mitigating Stereotypes in Text-to-Image Generation: A Novel Perspective of Selective Neural Suppression' 的科研主题。它们共同构成独一无二的学术指纹。

引用此