paper-with-me

Papers

Time-R1: Towards Comprehensive Temporal Reasoning in LLMs

2025-05-16 · Zijia Liu, Peixuan Han, Haofei Yu, Haoru Li, Jiaxuan You

Large Language Models (LLMs) demonstrate impressive capabilities but lack robust temporal intelligence, struggling to integrate reasoning about the past with predictions and plausible generations of the future. Meanwhile, existing methods typically target isolated temporal skills, such as question answering about past events or basic forecasting, and exhibit poor generalization, particularly when dealing with events beyond their knowledge cutoff or requiring creative foresight. To address these limitations, we introduce \textit{Time-R1}, the first framework to endow a moderate-sized (3B-parameter) LLM with comprehensive temporal abilities: understanding, prediction, and creative generation. Our approach features a novel three-stage development path; the first two constitute a \textit{reinforcement learning (RL) curriculum} driven by a meticulously designed dynamic rule-based reward system. This framework progressively builds (1) foundational temporal understanding and logical event-time mappings from historical data, (2) future event prediction skills for events beyond its knowledge cutoff, and finally (3) enables remarkable generalization to creative future scenario generation without any fine-tuning. Strikingly, experiments demonstrate that Time-R1 outperforms models over 200 times larger, including the state-of-the-art 671B DeepSeek-R1, on highly challenging future event prediction and creative scenario generation benchmarks. This work provides strong evidence that thoughtfully engineered, progressive RL fine-tuning allows smaller, efficient models to achieve superior temporal performance, offering a practical and scalable path towards truly time-aware AI. To foster further research, we also release \textit{Time-Bench}, a large-scale multi-task temporal reasoning dataset derived from 10 years of news data, and our series of \textit{Time-R1} checkpoints.

📄 PDF Abstract BibTeX arXiv:2505.13508

Code (1)

ulab-uiuc/time-r1 공식 구현 pytorch

Tasks

Question AnsweringReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models

2023-11-29 · Zheng Chu, Jingchang Chen, Qianglong Chen, Weijiang Yu 외

Grasping the concept of time is a fundamental facet of human cognition, indispensable for truly comprehending the intricacies of the world. Previous studies typically focus on specific aspects of time, lacking a comprehe…

Back to the Future: Towards Explainable Temporal Reasoning with Large Language Models

2023-10-02 · Chenhan Yuan, Qianqian Xie, Jimin Huang, Sophia Ananiadou

Temporal reasoning is a crucial NLP task, providing a nuanced understanding of time-sensitive contexts within textual data. Although recent advancements in LLMs have demonstrated their potential in temporal reasoning, th…

AttributeInstruction FollowingPredictionRelation Extraction+1

MUSEG: Reinforcing Video Temporal Understanding via Timestamp-Aware Multi-Segment Grounding

2025-05-27 · Fuwen Luo, Shengfeng Lou, Chi Chen, Ziyue Wang 외

Video temporal understanding is crucial for multimodal large language models (MLLMs) to reason over events in videos. Despite recent advances in general video understanding, current MLLMs still struggle with fine-grained…

Reinforcement Learning (RL)Video Understanding

LexKairos: Benchmarking Legal Temporal Capabilities in LLMs

2026-08-10 · Chenyang Li, Zejia Feng, Yuqin Huang, Yuxiao Ye 외 arxiv

Large language models (LLMs) have demonstrated strong performance across a wide range of legal tasks. In legal practice, time is a critical concept that governs the validity of statutes, the progression of legal cases, a…

HEARTS: Benchmarking LLM Reasoning on Health Time Series

2026-02-25 · Sirui Li, Shuhan Xiao, Mihir Joshi, Ahmed Metwally 외 arxiv

The rise of large language models (LLMs) has shifted time series analysis from narrow analytics to general-purpose reasoning. Yet, existing benchmarks cover only a small set of health time series modalities and tasks, fa…

Time Series Analysis