Multi-modal Recommendation with Joint Content and Interaction Augmentation

Multi-modal recommender systems have become indispensable in modern applications. Despite promising results, existing methods have two key limitations. First, in item characteristic modeling, they rely solely on the merchant's description and often neglect customer reviews, leading to biased item quality assessment. Second, in user preference modeling, they focus mainly on one-hop user-item interactions in the interaction graph, overlooking multi-hop interactions, which limits the understanding of user preferences. To address these issues, we propose a Joint Content and Interaction Augmented Framework (JCIAF) for multi-modal recommendation. Specifically, we leverage large language models to extract valuable insights from user reviews, integrating this with the merchant's description to form a more comprehensive textual representation of the item. This enriched description provides a balanced foundation for item characteristic modeling. Next, we enhance the user-item interaction graph with two additional interaction types: user-item-item (two-hop) and user-item-user-item (three-hop), which offer augmented views for more thorough user preference modeling. We apply a diffusion-based method across the three augmented graphs and introduce an online knowledge distillation mechanism to enable cross-graph learning. Extensive experiments on three real-world datasets demonstrate the effectiveness of our proposed method. The source code is accessible at https://github.com/jjlinnn/JClAF.git.