paper-with-me

홈 › Papers

Where to Move Next: Zero-shot Generalization of LLMs for Next POI Recommendation

2024-04-02 · Shanshan Feng, Haoming Lyu, Caishun Chen, Yew-Soon Ong

Next Point-of-interest (POI) recommendation provides valuable suggestions for users to explore their surrounding environment. Existing studies rely on building recommendation models from large-scale users' check-in data, which is task-specific and needs extensive computational resources. Recently, the pretrained large language models (LLMs) have achieved significant advancements in various NLP tasks and have also been investigated for recommendation scenarios. However, the generalization abilities of LLMs still are unexplored to address the next POI recommendations, where users' geographical movement patterns should be extracted. Although there are studies that leverage LLMs for next-item recommendations, they fail to consider the geographical influence and sequential transitions. Hence, they cannot effectively solve the next POI recommendation task. To this end, we design novel prompting strategies and conduct empirical studies to assess the capability of LLMs, e.g., ChatGPT, for predicting a user's next check-in. Specifically, we consider several essential factors in human movement behaviors, including user geographical preference, spatial distance, and sequential transitions, and formulate the recommendation task as a ranking problem. Through extensive experiments on two widely used real-world datasets, we derive several key findings. Empirical evaluations demonstrate that LLMs have promising zero-shot recommendation abilities and can provide accurate and reasonable predictions. We also reveal that LLMs cannot accurately comprehend geographical context information and are sensitive to the order of presentation of candidate POIs, which shows the limitations of LLMs and necessitates further research on robust human mobility reasoning mechanisms.

📄 PDF Abstract BibTeX arXiv:2404.01855

Code (1)

llmmove/llmmove 공식 구현

Tasks

Zero-shot Generalization

Similar Papers 제목 키워드 기반

Zero-Shot Generalization during Instruction Tuning: Insights from Similarity and Granularity

2024-06-17 · Bingxiang He, Ning Ding, Cheng Qian, Jia Deng 외

Understanding alignment techniques begins with comprehending zero-shot generalization brought by instruction tuning, but little of the mechanism has been understood. Existing work has largely been confined to the task le…

Continual LearningZero-shot Generalization

Zero-Shot Learning from scratch (ZFS): leveraging local compositional representations

2020-10-22 · Tristan Sylvain, Linda Petrini, R Devon Hjelm

Zero-shot classification is a generalization task where no instance from the target classes is seen during training. To allow for test-time transfer, each class is annotated with semantic information, commonly in the for…

General ClassificationRepresentation Learningzero-shot-classificationZero-Shot Learning

Zero-shot Cross-lingual Transfer is Under-specified Optimization

2022-07-12 · RepL4NLP (ACL) 2022 5 · Shijie Wu, Benjamin Van Durme, Mark Dredze

Pretrained multilingual encoders enable zero-shot cross-lingual transfer, but often produce unreliable models that exhibit high performance variance on the target language. We postulate that this high variance results fr…

Cross-Lingual TransferZero-Shot Cross-Lingual Transfer

InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning

2022-05-25 · Prakhar Gupta, Cathy Jiao, Yi-Ting Yeh, Shikib Mehri 외

Instruction tuning is an emergent paradigm in NLP wherein natural language instructions are leveraged with language models to induce zero-shot performance on unseen tasks. Instructions have been shown to enable good perf…

Dialogue EvaluationDialogue GenerationIntent DetectionNatural Language Understanding+2

AnyTOD: A Programmable Task-Oriented Dialog System

2022-12-20 · Jeffrey Zhao, Yuan Cao, Raghav Gupta, Harrison Lee 외

We propose AnyTOD, an end-to-end, zero-shot task-oriented dialog (TOD) system capable of handling unseen tasks without task-specific training. We view TOD as a program executed by a language model (LM), where program log…

BenchmarkingLanguage ModelingLanguage Modelling