paper-with-me

홈 › Papers

Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments

2026-05-26 · Yuxin Chen, Xiaodong Cai, Junfeng Fang, Zhuowen Han, Yu Wang, Yaorui Shi, Yi Zhang, Qi Gu, Xunliang Cai, Xiang Wang, An Zhang, Tat-Seng Chua arxiv

Recent advances in large language models (LLMs) have facilitated the widespread deployment of LLMs as interactive agents capable of reasoning, planning, and tool use. Despite strong performance on existing benchmarks, such agents often exhibit notable degradation when deployed in real-world settings, where environments are inherently stochastic and imperfect. We argue that this discrepancy arises from a fundamental mismatch between idealized training settings and real-world interaction dynamics, where current paradigms rely on carefully curated task instructions and stable, well-controlled environments. To address this gap, we propose NoisyAgent, an agentic training framework that explicitly incorporates environmental imperfections into the agent learning process. We identify two major sources of interaction noise in real-world scenarios: user noise, which captures ambiguity and variability in user interaction, and tool noise, which reflects failures and anomalies in tool execution. We introduce such perturbations into the training pipeline by modifying user interaction patterns and simulating tool execution results within the training environment. To stabilize training while encouraging agents to handle increasingly challenging imperfections, noise is applied to only a subset of rollouts and progressively increased in difficulty as the model adapts to the current noise level. Extensive experiments demonstrate that our approach consistently improves agent robustness under noisy and dynamic environments. Our analysis reveals that training under noise conditions also yields performance gains on idealized benchmarks, suggesting that controlled exposure to environmental noise promotes more generalizable reasoning and decision-making behaviors. Our findings highlight the importance of modeling interaction imperfections for bridging the gap between agent training and real-world deployment.

📄 PDF Abstract BibTeX arXiv:2605.27209

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Distributed Maximum Consensus over Noisy Links

2024-03-27 · Ehsan Lari, Reza Arablouei, Naveen K. D. Venkategowda, Stefan Werner

We introduce a distributed algorithm, termed noise-robust distributed maximum consensus (RD-MC), for estimating the maximum value within a multi-agent network in the presence of noisy communication links. Our approach en…

Distributed Optimization

AgentNoiseBench: Benchmarking Robustness of Tool-Using LLM Agents Under Noisy Condition

2026-02-11 · Ruipeng Wang, Yuxin Chen, Yukai Wang, Chang Wu 외 arxiv

Recent advances in large language models have enabled LLM-based agents to achieve strong performance on a variety of benchmarks. However, their performance in real-world deployments often that observed on benchmark setti…

NoisyEQA: Benchmarking Embodied Question Answering Against Noisy Queries

2024-12-14 · Tao Wu, Chuhao Zhou, Yen Heng Wong, Lin Gu 외

The rapid advancement of Vision-Language Models (VLMs) has significantly advanced the development of Embodied Question Answering (EQA), enhancing agents' abilities in language understanding and reasoning within complex a…

BenchmarkingEmbodied Question AnsweringHallucinationQuestion Answering

Adaptive Robust Estimator for Multi-Agent Reinforcement Learning

2026-03-23 · Zhongyi Li, Wan Tian, Jingyu Chen, Kangyao Huang 외 arxiv

Multi-agent collaboration has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models, yet it suffers from interaction-level ambiguity that blurs generation, critique, and revisio…

Multi-agent Reinforcement LearningMathematical Reasoning

Enhancing Dialogue Speech Recognition with Robust Contextual Awareness via Noise Representation Learning

2024-08-12 · Wonjun Lee, San Kim, Gary Geunbae Lee

Recent dialogue systems rely on turn-based spoken interactions, requiring accurate Automatic Speech Recognition (ASR). Errors in ASR can significantly impact downstream dialogue tasks. To address this, using dialogue con…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderRepresentation Learning+2