跳到主要导航 跳到搜索 跳到主要内容

When Privacy Meets Recovery: The Overlooked Half of Surrogate-Driven Privacy Preservation for MLLM Editing

  • Siyuan Xu
  • , Yibing Liu*
  • , Peilin Chen
  • , Yung Hui Li
  • , Shiqi Wang
  • , Sam Kwong
  • *此作品的通讯作者
  • City University of Hong Kong
  • Hon Hai Research Institute
  • Lingnan University

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Privacy leakage in Multimodal Large Language Models (MLLMs) has long been an intractable problem. Existing studies, though effectively obscure private information in MLLMs, often overlook the evaluation of the authenticity and recovery quality of user privacy. To this end, this work uniquely focuses on the critical challenge of how to restore surrogate-driven protected data in diverse MLLM scenarios. We first bridge this research gap by contributing the SPPE (Surrogate Privacy Protected Editable) dataset, which includes a wide range of privacy categories and user instructions to simulate real MLLM applications. This dataset offers protected surrogates alongside their various MLLM-edited versions, thus enabling the direct assessment of privacy recovery quality. By formulating privacy recovery as a guided generation task conditioned on complementary multimodal signals, we further introduce a unified approach that reliably reconstructs private content while preserving the fidelity of MLLM-generated edits. The experiments on both SPPE and InstructPix2Pix further show that our approach generalizes well across diverse visual content and editing tasks, achieving a strong balance between privacy protection and MLLM usability.

源语言英语
主期刊名Proceedings of the AAAI Conference on Artificial Intelligence
编辑Sven Koenig, Chad Jenkins, Matthew E. Taylor
出版商Association for the Advancement of Artificial Intelligence
35958-35966
页数9
版本42
ISBN(印刷版)9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067, 9781577359067
DOI
出版状态已出版 - 2026
已对外发布
活动40th AAAI Conference on Artificial Intelligence, AAAI 2026 - Singapore, 新加坡
期限: 20 1月 202627 1月 2026

丛书

姓名Proceedings of the AAAI Conference on Artificial Intelligence
编号42
40
ISSN(印刷版)2159-5399
ISSN(电子版)2374-3468

会议

会议40th AAAI Conference on Artificial Intelligence, AAAI 2026
国家/地区新加坡
Singapore
时期20/01/2627/01/26

学术指纹

探究 'When Privacy Meets Recovery: The Overlooked Half of Surrogate-Driven Privacy Preservation for MLLM Editing' 的科研主题。它们共同构成独一无二的学术指纹。

引用此