Skip to main navigation Skip to search Skip to main content

Prompt Tuning as User Inherent Profile Inference Machine

  • Yusheng Lu
  • , Zhaocheng Du
  • , Xiangyang Li
  • , Pengyue Jia
  • , Yejing Wang
  • , Weiwen Liu
  • , Yichao Wang
  • , Huifeng Guo
  • , Ruiming Tang
  • , Zhenhua Dong
  • , Yongrui Duan*
  • , Xiangyu Zhao*
  • *Corresponding author for this work
  • Tongji University
  • City University of Hong Kong
  • Huawei Technologies Co., Ltd.
  • Shanghai Jiao Tong University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Large Language Models (LLMs) have exhibited significant promise in recommender systems by empowering user profiles with their extensive world knowledge and superior reasoning capabilities. However, LLMs face challenges like unstable instruction compliance, modality gaps, and high inference latency, leading to textual noise and limiting their effectiveness in recommender systems. To address these challenges, we propose UserIP-Tuning, which uses prompt-tuning to infer user profiles. It integrates the causal relationship between user profiles and behavior sequences into LLMs' prompts. It employs Expectation Maximization (EM) to infer the embedded latent profile, minimizing textual noise by fixing the prompt template. Furthermore, a profile quantization codebook bridges the modality gap by categorizing profile embeddings into collaborative IDs pre-stored for online deployment. This improves time efficiency and reduces memory usage. Experiments show that UserIP-Tuning outperforms state-of-the-art recommendation algorithms. An industry application confirms its effectiveness, robustness, and transferability. The presented solution has been deployed in Huawei AppGallery's Explore page since May 2025, serving 2 million daily active users, delivering significant improvements in real-world recommendation scenarios. The code is publicly available for replication at https://github.com/Applied-Machine-Learning-Lab/UserIP-Tuning.

Original languageEnglish
Title of host publicationCIKM 2025 - Proceedings of the 34th ACM International Conference on Information and Knowledge Management
PublisherAssociation for Computing Machinery, Inc
Pages5898-5906
Number of pages9
ISBN (Electronic)9798400720406
DOIs
StatePublished - 10 Nov 2025
Externally publishedYes
Event34th ACM International Conference on Information and Knowledge Management, CIKM 2025 - Seoul, Korea, Republic of
Duration: 10 Nov 202514 Nov 2025

Publication series

NameCIKM 2025 - Proceedings of the 34th ACM International Conference on Information and Knowledge Management

Conference

Conference34th ACM International Conference on Information and Knowledge Management, CIKM 2025
Country/TerritoryKorea, Republic of
CitySeoul
Period10/11/2514/11/25

Keywords

  • causal inferences
  • large language models
  • recommender systems
  • user profile modeling

Fingerprint

Dive into the research topics of 'Prompt Tuning as User Inherent Profile Inference Machine'. Together they form a unique fingerprint.

Cite this