paper-with-me

홈 › Papers

Evaluating the Effectiveness of Large Language Models in Representing and Understanding Movement Trajectories

2024-08-31 · Yuhan Ji, Song Gao

This research focuses on assessing the ability of AI foundation models in representing the trajectories of movements. We utilize one of the large language models (LLMs) (i.e., GPT-J) to encode the string format of trajectories and then evaluate the effectiveness of the LLM-based representation for trajectory data analysis. The experiments demonstrate that while the LLM-based embeddings can preserve certain trajectory distance metrics (i.e., the correlation coefficients exceed 0.74 between the Cosine distance derived from GPT-J embeddings and the Hausdorff and Dynamic Time Warping distances on raw trajectories), challenges remain in restoring numeric values and retrieving spatial neighbors in movement trajectory analytics. In addition, the LLMs can understand the spatiotemporal dependency contained in trajectories and have good accuracy in location prediction tasks. This research highlights the need for improvement in terms of capturing the nuances and complexities of the underlying geospatial data and integrating domain knowledge to support various GeoAI applications using LLMs.

📄 PDF Abstract BibTeX arXiv:2409.00335

Code (0)

등록된 구현이 없습니다.

Tasks

Dynamic Time Warping

Similar Papers 제목 키워드 기반

Evaluating the Effectiveness of Large Language Models in Representing Textual Descriptions of Geometry and Spatial Relations

2023-07-05 · Yuhan Ji, Song Gao

This research focuses on assessing the ability of large language models (LLMs) in representing geometries and their spatial relations. We utilize LLMs including GPT-2 and BERT to encode the well-known text (WKT) format o…

FlowLearn: Evaluating Large Vision-Language Models on Flowchart Understanding

2024-07-06 · Huitong Pan, Qi Zhang, Cornelia Caragea, Eduard Dragut 외

Flowcharts are graphical tools for representing complex concepts in concise visual representations. This paper introduces the FlowLearn dataset, a resource tailored to enhance the understanding of flowcharts. FlowLearn c…

Optical Character Recognition (OCR)Visual Question Answering (VQA)

On the Importance of Task Complexity in Evaluating LLM-Based Multi-Agent Systems

2025-10-05 · Bohan Tang, Huidong Liang, Keyue Jiang, Xiaowen Dong arxiv

Large language model multi-agent systems (LLM-MAS) offer a promising paradigm for harnessing collective intelligence to achieve more advanced forms of AI behaviour. While recent studies suggest that LLM-MAS can outperfor…

L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context

2024-09-13 · Pritika Rohera, Chaitrali Ginimav, Akanksha Salunke, Gayatri Sawant 외

Large Language Models (LLMs) have made significant progress in incorporating Indic languages within multilingual models. However, it is crucial to quantitatively assess whether these languages perform comparably to globa…

Question Answering

B4DL: A Benchmark for 4D LiDAR LLM in Spatio-Temporal Understanding

2025-08-07 · Changho Choi, Youngwoo Shin, Gyojin Han, Dong-Jae Lee 외 arxiv

Understanding dynamic outdoor environments requires capturing complex object interactions and their evolution over time. LiDAR-based 4D point clouds provide precise spatial geometry and rich temporal cues, making them id…

Point Clouds