Recommender Systems in the Era of Large Language Models (LLMs)

Системы рекомендаций в эпоху больших языковых моделей (LLMs)
Qing Li, Wenqi Fan, Jiliang Tang, Jiatong Li, Yunqing Liu, Zihuai Zhao, Xiaowei Mei, Yiqi Wang, Zhen Wen, Fei Wang, Xiangyu Zhao
2024-04-22

LLM-empowered recommender systemsLLMs as feature encoderfine-tuningpre-trainingprompting
With the prosperity of e-commerce and web applications, Recommender Systems (RecSys) have become an indispensable and important component in our daily lives, providing personalized suggestions that cater to user preferences. While Deep Neural Networks (DNNs) have achieved significant advancements in enhancing recommender systems by modeling user-item interactions and incorporating their textual side information, these DNN-based methods still exhibit some limitations, such as difficulties in effectively understanding users' interests and capturing textual side information, inabilities in generalizing to various seen/unseen recommendation scenarios and reasoning on their predictions, etc. Meanwhile, the development of Large Language Models (LLMs), such as ChatGPT and GPT-4, has revolutionized the fields of Natural Language Processing (NLP) and Artificial Intelligence (AI), due to their remarkable abilities in fundamental responsibilities of language understanding and generation, as well as impressive generalization capabilities and reasoning skills. As a result, recent studies have actively attempted to harness the power of LLMs to enhance recommender systems. Given the rapid evolution of this research direction in recommender systems, there is a pressing need for a systematic overview that summarizes existing LLM-empowered recommender systems, so as to provide researchers and practitioners in relevant fields with an in-depth understanding. Therefore, in this survey, we conduct a comprehensive review of LLM-empowered recommender systems from various aspects including pre-training, fine-tuning, and prompting paradigms. More specifically, we first introduce the representative methods to harness the power of LLMs (as a feature encoder) for learning representations of users and items. Then, we systematically review the emerging advanced techniques of LLMs for enhancing recommender systems from three paradigms, namely pre-training, fine-tuning, and prompting. Finally, we comprehensively discuss the promising future directions in this emerging field.
1
A systematic survey is needed and provided to summarize existing LLM-empowered recommender methods and to discuss promising future directions in this emerging field.
2
DNN-based recommender systems struggle to effectively understand user interests, capture textual side information, generalize across seen/unseen scenarios, and provide reasoning for predictions.
3
LLM-empowered recommender research can be organized into three main technical paradigms: pre-training, fine-tuning, and prompting.
4
Large Language Models (LLMs) like ChatGPT and GPT-4 offer strong language understanding, generation, generalization, and reasoning abilities that can address DNN limitations in recommender systems.
5
Recent studies actively leverage LLMs to enhance recommender systems by using LLMs as feature encoders to learn user and item representations.

Recommender systems augmented by Large Language Models (LLM-empowered recommender systems)

Methods and techniques (pre-training, fine-tuning, prompting, and using LLMs as feature encoders) for enhancing user/item representation, generalization, reasoning, and recommendation performance

Publication Details
Publication Date
2024-04-22
Journal
Publisher
ISSN
Cited by
420
Access Type
Author Information
Authors
Qing Li
Wenqi Fan
Jiliang Tang
Jiatong Li
Yunqing Liu
Zihuai Zhao
Xiaowei Mei
Yiqi Wang
Zhen Wen
Fei Wang
Xiangyu Zhao
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%