Recommender Systems in the Era of Large Language Models (LLMs)
Системы рекомендаций в эпоху больших языковых моделей (LLMs)
2024-04-22
SCID: 54.1/eqhgjh9h
Discuss with AI
LLM-empowered recommender systemsLLMs as feature encoderfine-tuningpre-trainingprompting
Figures from the paper
Abstract (AI)
With the prosperity of e-commerce and web applications, Recommender Systems (RecSys) have become an indispensable and important component in our daily lives, providing personalized suggestions that cater to user preferences. While Deep Neural Networks (DNNs) have achieved significant advancements in enhancing recommender systems by modeling user-item interactions and incorporating their textual side information, these DNN-based methods still exhibit some limitations, such as difficulties in effectively understanding users' interests and capturing textual side information, inabilities in generalizing to various seen/unseen recommendation scenarios and reasoning on their predictions, etc. Meanwhile, the development of Large Language Models (LLMs), such as ChatGPT and GPT-4, has revolutionized the fields of Natural Language Processing (NLP) and Artificial Intelligence (AI), due to their remarkable abilities in fundamental responsibilities of language understanding and generation, as well as impressive generalization capabilities and reasoning skills. As a result, recent studies have actively attempted to harness the power of LLMs to enhance recommender systems. Given the rapid evolution of this research direction in recommender systems, there is a pressing need for a systematic overview that summarizes existing LLM-empowered recommender systems, so as to provide researchers and practitioners in relevant fields with an in-depth understanding. Therefore, in this survey, we conduct a comprehensive review of LLM-empowered recommender systems from various aspects including pre-training, fine-tuning, and prompting paradigms. More specifically, we first introduce the representative methods to harness the power of LLMs (as a feature encoder) for learning representations of users and items. Then, we systematically review the emerging advanced techniques of LLMs for enhancing recommender systems from three paradigms, namely pre-training, fine-tuning, and prompting. Finally, we comprehensively discuss the promising future directions in this emerging field.
Key Findings
1
A systematic survey is needed and provided to summarize existing LLM-empowered recommender methods and to discuss promising future directions in this emerging field.
2
DNN-based recommender systems struggle to effectively understand user interests, capture textual side information, generalize across seen/unseen scenarios, and provide reasoning for predictions.
3
LLM-empowered recommender research can be organized into three main technical paradigms: pre-training, fine-tuning, and prompting.
4
Large Language Models (LLMs) like ChatGPT and GPT-4 offer strong language understanding, generation, generalization, and reasoning abilities that can address DNN limitations in recommender systems.
5
Recent studies actively leverage LLMs to enhance recommender systems by using LLMs as feature encoders to learn user and item representations.
Research Object
Recommender systems augmented by Large Language Models (LLM-empowered recommender systems)
Research Subject
Methods and techniques (pre-training, fine-tuning, prompting, and using LLMs as feature encoders) for enhancing user/item representation, generalization, reasoning, and recommendation performance
Publication Details
Publication Date
2024-04-22
Journal
Publisher
ISSN
Cited by
420
Access Type
Author Information
Download PDF
Subscribe to digest