Skip to main navigation Skip to search Skip to main content

Multi-Task Recommendations with Reinforcement Learning

  • Ziru Liu
  • , Jiejie Tian
  • , Qingpeng Cai*
  • , Xiangyu Zhao*
  • , Jingtong Gao
  • , Shuchang Liu
  • , Dayou Chen
  • , Tonghao He
  • , Dong Zheng
  • , Peng Jiang
  • , Kun Gai
  • *Corresponding author for this work
  • City University of Hong Kong
  • Kuaishou

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In recent years, Multi-task Learning (MTL) has yielded immense success in Recommender System (RS) applications [40]. However, current MTL-based recommendation models tend to disregard the session-wise patterns of user-item interactions because they are predominantly constructed based on item-wise datasets. Moreover, balancing multiple objectives has always been a challenge in this field, which is typically avoided via linear estimations in existing works. To address these issues, in this paper, we propose a Reinforcement Learning (RL) enhanced MTL framework, namely RMTL, to combine the losses of different recommendation tasks using dynamic weights. To be specific, the RMTL structure can address the two aforementioned issues by (i) constructing an MTL environment from session-wise interactions and (ii) training multi-task actor-critic network structure, which is compatible with most existing MTL-based recommendation models, and (iii) optimizing and fine-tuning the MTL loss function using the weights generated by critic networks. Experiments on two real-world public datasets demonstrate the effectiveness of RMTL with a higher AUC against state-of-the-art MTL-based recommendation models. Additionally, we evaluate and validate RMTL's compatibility and transferability across various MTL models.

Original languageEnglish
Title of host publicationACM Web Conference 2023 - Proceedings of the World Wide Web Conference, WWW 2023
PublisherAssociation for Computing Machinery, Inc
Pages1273-1282
Number of pages10
ISBN (Electronic)9781450394161
DOIs
StatePublished - 30 Apr 2023
Externally publishedYes
Event32nd ACM World Wide Web Conference, WWW 2023 - Austin, United States
Duration: 30 Apr 20234 May 2023

Publication series

NameACM Web Conference 2023 - Proceedings of the World Wide Web Conference, WWW 2023

Conference

Conference32nd ACM World Wide Web Conference, WWW 2023
Country/TerritoryUnited States
CityAustin
Period30/04/234/05/23

Keywords

  • Multi-task Learning
  • Recommendation
  • Reinforcement Learning

Fingerprint

Dive into the research topics of 'Multi-Task Recommendations with Reinforcement Learning'. Together they form a unique fingerprint.

Cite this