Skip to main navigation Skip to search Skip to main content

LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendation

  • Yuhao Wang
  • , Yichao Wang
  • , Zichuan Fu
  • , Xiangyang Li
  • , Wanyu Wang
  • , Yuyang Ye
  • , Xiangyu Zhao*
  • , Huifeng Guo
  • , Ruiming Tang
  • *Corresponding author for this work
  • City University of Hong Kong
  • Huawei Technologies Co., Ltd.

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

As the demand for more personalized recommendation grows and a dramatic boom in commercial scenarios arises, the study on multi-scenario recommendation (MSR) has attracted much attention, which uses the data from all scenarios to simultaneously improve their recommendation performance. However, existing methods tend to integrate insufficient scenario knowledge and neglect learning personalized cross-scenario preferences, thus leading to sub-optimal performance. Meanwhile, though large language model (LLM) has shown great capability of reasoning and capturing semantic information, the high inference latency and high computation cost of tuning hinder its implementation in industrial recommender systems. To fill these gaps, we propose an LLM-enhanced paradigm LLM4MSR in this work. Specifically, we first leverage LLM to uncover multi-level knowledge from the designed scenario- and user-level prompt without fine-tuning the LLM, then adopt hierarchical meta networks to generate multi-level meta layers to explicitly improve the scenario-aware and personalized recommendation capability. Our experiments on KuaiSAR-small, KuaiSAR, and Amazon datasets validate significant advantages of LLM4MSR: (i) the effectiveness and compatibility with different multi-scenario backbone models, (ii) high efficiency and deployability on industrial recommender systems, and (iii) improved interpretability. The implemented code and data is available to ease reproduction.

Original languageEnglish
Title of host publicationCIKM 2024 - Proceedings of the 33rd ACM International Conference on Information and Knowledge Management
PublisherAssociation for Computing Machinery
Pages2472-2481
Number of pages10
ISBN (Electronic)9798400704369
DOIs
StatePublished - 21 Oct 2024
Externally publishedYes
Event33rd ACM International Conference on Information and Knowledge Management, CIKM 2024 - Boise, United States
Duration: 21 Oct 202425 Oct 2024

Publication series

NameInternational Conference on Information and Knowledge Management, Proceedings
ISSN (Print)2155-0751

Conference

Conference33rd ACM International Conference on Information and Knowledge Management, CIKM 2024
Country/TerritoryUnited States
CityBoise
Period21/10/2425/10/24

Keywords

  • click-through rate prediction
  • large language model
  • multi-domain
  • multi-scenario recommendation

Fingerprint

Dive into the research topics of 'LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendation'. Together they form a unique fingerprint.

Cite this