paper-with-me

홈 › Papers

A Modular Multitask Reasoning Framework Integrating Spatio-temporal Models and LLMs

2025-06-25 · Kethmi Hirushini Hettige, Jiahao Ji, Cheng Long, Shili Xiang, Gao Cong, Jingyuan Wang

Spatio-temporal data mining plays a pivotal role in informed decision making across diverse domains. However, existing models are often restricted to narrow tasks, lacking the capacity for multi-task inference and complex long-form reasoning that require generation of in-depth, explanatory outputs. These limitations restrict their applicability to real-world, multi-faceted decision scenarios. In this work, we introduce STReason, a novel framework that integrates the reasoning strengths of large language models (LLMs) with the analytical capabilities of spatio-temporal models for multi-task inference and execution. Without requiring task-specific finetuning, STReason leverages in-context learning to decompose complex natural language queries into modular, interpretable programs, which are then systematically executed to generate both solutions and detailed rationales. To facilitate rigorous evaluation, we construct a new benchmark dataset and propose a unified evaluation framework with metrics specifically designed for long-form spatio-temporal reasoning. Experimental results show that STReason significantly outperforms advanced LLM baselines across all metrics, particularly excelling in complex, reasoning-intensive spatio-temporal scenarios. Human evaluations further validate STReason's credibility and practical utility, demonstrating its potential to reduce expert workload and broaden the applicability to real-world spatio-temporal tasks. We believe STReason provides a promising direction for developing more capable and generalizable spatio-temporal reasoning systems.

📄 PDF Abstract BibTeX arXiv:2506.20073

Code (0)

등록된 구현이 없습니다.

Tasks

In-Context LearningNatural Language Queries

Similar Papers 제목 키워드 기반

Multitask Pareto Optimization for Monotone Submodular Problems with Dynamic Constraints

2026-08-11 · Liam Wigney, Frank Neumann arxiv

Evolutionary multitasking is a recent approach that solves multiple related optimization problems within a single evolutionary run, rather than addressing each problem separately. We consider monotone submodular optimiza…

A Multiagent Framework for the Asynchronous and Collaborative Extension of Multitask ML Systems

2022-09-29 · Andrea Gesmundo

The traditional ML development methodology does not enable a large number of contributors, each with distinct objectives, to work collectively on the creation and extension of a shared intelligent system. Enabling such a…

Joint Spatio-Textual Reasoning for Answering Tourism Questions

2020-09-28 · Danish Contractor, Shashank Goel, Mausam, Parag Singla

Our goal is to answer real-world tourism questions that seek Points-of-Interest (POI) recommendations. Such questions express various kinds of spatial and non-spatial constraints, necessitating a combination of textual a…

Spatial Reasoning

Flexible Multitask Learning with Factorized Diffusion Policy

2025-12-26 · Chaoqi Liu, Haonan Chen, Sigmund H. Høeg, Shaoxiong Yao 외 arxiv

Multitask learning poses significant challenges due to the highly multimodal and diverse nature of robot action distributions. However, effectively fitting policies to these complex task distributions is often difficult,…

Reasoning over Video: Evaluating How MLLMs Extract, Integrate, and Reconstruct Spatiotemporal Evidence

2026-03-13 · Seunghwan Bang, Hwanjun Song arxiv

The growing interest in embodied agents increases the demand for spatiotemporal video understanding, yet existing benchmarks largely emphasize extractive reasoning, where answers can be explicitly presented within spatio…