LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applications
Large language models (LLMs) now support forecasting systems that combine language-based reasoning with temporal data, evidence retrieval, external tools, and iterative prediction. We investigate LLM-based forecasting agents, meaning systems in which a language model contributes to a scored prediction about a future or currently unobserved target. We organize architectures into three groups. Standalone LLM workflows operate on encoded time series or event context. Tool- and retrieval-augmented agents incorporate external evidence. Hybrid systems pair LLMs with statistical or foundation models. We then review training methods and evaluation protocols. We examine negative as well as positive evidence, including sensitivity to small input perturbations, ablations in which the LLM component does not improve accuracy, and benchmark gains that may reflect contamination instead of temporal reasoning. We cover applications in finance, weather, health, energy, and operations, and we summarize the benchmarks and datasets used for evaluation. The evidence indicates that measurement is a central limitation. Future work requires calibration under distribution shift, contamination-resistant live evaluation, explicit reporting of cost and accuracy together, and methods for handling feedback between deployed forecasts and the outcomes being forecast.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settings
For autonomous vehicles (AVs) to behave appropriately on roads populated by human-driven vehicles, they must be able to reason about the uncertain intentions and decisions of other drivers from rich perceptual informatio…
Autonomous VehiclesRobust Trajectory Forecasting for Multiple Intelligent Agents in Dynamic Scene
Trajectory forecasting, or trajectory prediction, of multiple interacting agents in dynamic scenes, is an important problem for many applications, such as robotic systems and autonomous driving. The problem is a great ch…
Autonomous DrivingPredictionTrajectory ForecastingTrajectory PredictionVectorized Representation Dreamer (VRD): Dreaming-Assisted Multi-Agent Motion-Forecasting
For an autonomous vehicle to plan a path in its environment, it must be able to accurately forecast the trajectory of all dynamic objects in its proximity. While many traditional methods encode observations in the scene …
Motion ForecastingRethinking Trajectory Forecasting Evaluation
Forecasting the behavior of other agents is an integral part of the modern robotic autonomy stack, especially in safety-critical scenarios with human-robot interaction, such as autonomous driving. In turn, there has been…
Autonomous DrivingDecision MakingTrajectory ForecastingBeyond Forecasting: The Belief-to-Trade Layer in Prediction-Market Agents
Forecasting future events has attracted growing attention as a testbed for general-purpose AI. A natural way to ground this evaluation is let the models trade in the prediction markets. Trading, however, requires more th…