paper-with-me

Papers

Optimizing Multi-Agent Weather Captioning via Text Gradient Descent: A Training-Free Approach with Consensus-Aware Gradient Fusion

2026-03-23 · Shixu Liu arxiv

Generating interpretable natural language captions from weather time series data remains a significant challenge at the intersection of meteorological science and natural language processing. While recent advances in Large Language Models (LLMs) have demonstrated remarkable capabilities in time series forecasting and analysis, existing approaches either produce numerical predictions without human-accessible explanations or generate generic descriptions lacking domain-specific depth. We introduce WeatherTGD, a training-free multi-agent framework that reinterprets collaborative caption refinement through the lens of Text Gradient Descent (TGD). Our system deploys three specialized LLM agents including a Statistical Analyst, a Physics Interpreter, and a Meteorology Expert that generate domain-specific textual gradients from weather time series observations. These gradients are aggregated through a novel Consensus-Aware Gradient Fusion mechanism that extracts common signals while preserving unique domain perspectives. The fused gradients then guide an iterative refinement process analogous to gradient descent, where each LLM-generated feedback signal updates the caption toward an optimal solution. Experiments on real-world meteorological datasets demonstrate that WeatherTGD achieves significant improvements in both LLM-based evaluation and human expert evaluation, substantially outperforming existing multi-agent baselines while maintaining computational efficiency through parallel agent execution.

📄 PDF Abstract BibTeX arXiv:2603.21673

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyTime Series Forecasting

Similar Papers 제목 키워드 기반

Spectral-Aware Text-to-Time Series Generation with Billion-Scale Multimodal Meteorological Data

2026-03-28 · Shijie Zhang arxiv

Text-to-time-series generation is particularly important in meteorology, where natural language offers intuitive control over complex, multi-scale atmospheric dynamics. Existing approaches are constrained by the lack of …

SynopticBench: Evaluating Vision-Language Models on Generating Weather Forecast Discussions of the Future

2026-04-07 · Timothy B. Higgins, Antonios Mamalakis, Chirag Agarwal arxiv

Recent advances in visual-language models (VLMs) have led to significant improvements in a plethora of complex multimodal tasks like image captioning, report generation, and visual perception. However, generating text fr…

Weather ForecastingImage CaptioningText Generation

New Encoder Learning for Captioning Heavy Rain Images via Semantic Visual Feature Matching

2021-05-28 · Chang-Hwan Son, Pung-Hwi Ye

Image captioning generates text that describes scenes from input images. It has been developed for high quality images taken in clear weather. However, in bad weather conditions, such as heavy rain, snow, and dense fog, …

DecoderImage CaptioningSentence

From Simple to Professional: A Combinatorial Controllable Image Captioning Agent

2024-12-15 · Xinran Wang, Muxi Diao, Baoteng Li, Haiwen Zhang 외

The Controllable Image Captioning Agent (CapAgent) is an innovative system designed to bridge the gap between user simplicity and professional-level outputs in image captioning tasks. CapAgent automatically transforms us…

Caption Generationcontrollable image captioningImage Captioningobject-detection+1

Carbon Footprint Reduction for Sustainable Data Centers in Real-Time

2024-03-21 · AAAI Conference on Artificial Intelligence 2024 3 · Soumyendu Sarkar, Avisek Naug, Ricardo Luna, Antonio Guillen 외

As machine learning workloads significantly increase energy consumption, sustainable data centers with low carbon emissions are becoming a top priority for governments and corporations worldwide. This requires a paradigm…

Multi-agent Reinforcement Learning