Scenario-Wise Rec: A Multi-Scenario Recommendation Benchmark

  • Xiaopeng Li*
  • , Jingtong Gao*
  • , Pengyue Jia
  • , Xiangyu Zhao*
  • , Yichao Wang
  • , Wanyu Wang
  • , Yejing Wang
  • , Yuhao Wang
  • , Huifeng Guo
  • , Ruiming Tang*
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Multi-Scenario Recommendation (MSR) tasks, referring to building a unified model to enhance performance across all recommendation scenarios, have recently gained considerable attention. However, current research in MSR faces two significant challenges that hinder the field's development: the absence of uniform procedures for multi-scenario dataset processing, thus hindering fair comparisons, and most models being closed-source, which complicates comparisons with current SOTA models. Consequently, we introduce our benchmark, Scenario-Wise Rec, which comprises six public datasets and twelve baseline models, along with a training and evaluation pipeline. We further validate Scenario-Wise Rec on an industrial advertising dataset, underscoring its robustness. We hope the benchmark will give researchers clear insights into prior work, enabling them to develop novel models and thereby fostering a collaborative research ecosystem in MSR. Our source code is publicly available (https://github.com/Applied-Machine-Learning-Lab/Scenario-Wise-Rec).

Original languageEnglish
Title of host publicationCIKM 2025 - Proceedings of the 34th ACM International Conference on Information and Knowledge Management
PublisherAssociation for Computing Machinery, Inc
Pages1685-1695
Number of pages11
ISBN (Electronic)9798400720406
DOIs
StatePublished - 10 Nov 2025
Externally publishedYes
Event34th ACM International Conference on Information and Knowledge Management, CIKM 2025 - Seoul, Korea, Republic of
Duration: 10 Nov 202514 Nov 2025

Publication series

NameCIKM 2025 - Proceedings of the 34th ACM International Conference on Information and Knowledge Management

Conference

Conference34th ACM International Conference on Information and Knowledge Management, CIKM 2025
Country/TerritoryKorea, Republic of
CitySeoul
Period10/11/2514/11/25

Keywords

  • ctr prediction
  • multi scenario recommendation
  • recommendation systems

Fingerprint

Dive into the research topics of 'Scenario-Wise Rec: A Multi-Scenario Recommendation Benchmark'. Together they form a unique fingerprint.

Cite this