Is ChatGPT a Good Recommender? A Preliminary StudyConference: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management; October 21–25, 2023; Birmingham, United KingdomThe 1st workshop on recommendation with generative models, October 21–25, 2023, Birmingham, United KingdomCCS: Information systems Recommender systems
Junling Liu Note: Both authors contributed equally to this research. email: Affiliation: Alibaba Group , China , Chao Liu email: Affiliation: Ant Group , China , Peilin Zhou email: Affiliation: Hong Kong University of Science and Technology(Guangzhou) , China , Renjie Lv email: Affiliation: Ant Group , China , Kang Zhou email: Affiliation: Alibaba Group , China and Yan Zhang email: Affiliation: Alibaba Group , China
Abstract
Recommendation systems have witnessed significant advancements and have been widely used over the past decades. However, most traditional recommendation methods are task-specific and therefore lack efficient generalization ability. Recently, the emergence of ChatGPT has significantly advanced NLP tasks by enhancing the capabilities of conversational models. Nonetheless, the application of ChatGPT in the recommendation domain has not been thoroughly investigated. In this paper, we employ ChatGPT as a general-purpose recommendation model to explore its potential for transferring extensive linguistic and world knowledge acquired from large-scale corpora to recommendation scenarios. Specifically, we design a set of prompts and evaluate ChatGPT’s performance on five recommendation scenarios, including rating prediction, sequential recommendation, direct recommendation, explanation generation, and review summarization. Unlike traditional recommendation methods, we do not fine-tune ChatGPT during the entire evaluation process, relying only on the prompts themselves to convert recommendation tasks into natural language tasks. Further, we explore the use of few-shot prompting to inject inte
原文 arXiv:2304.10149;中英对照 + 大白话阅读 https://aha.fim.ai/paper/2304.10149v3