paper-with-me

Papers Visual Grounding

“Visual Grounding” 태그가 달린 논문 1,131편 · 필터 해제

VepAgent: Bridging Causal-Transition via Tool-Augmented Reinforcement Learning for Video Event Prediction

2026-10-05 · Qiutong Chen, Yuchan Guo, Zhenlong Yuan, Haobo Yang 외 hf

Multimodal Large Language Models (MLLMs) have demonstrated remarkable potential in video understanding, yet their reliance on retrospective summarization and text-centric priors often limits their ability to bridge unobs…

Reinforcement LearningVisual Grounding

CoEvolve: Construct-to-Edit Visual Grounding with Bidirectional State Refinement

2026-10-01 · Dongwei Sun, Yujie Zhang, Bowen Yao, Pei Liu 외 arxiv

Visual grounding localizes an object described by language with a bounding box. Most multimodal grounding models compress target identification, spatial reasoning, and boundary estimation into one terminal prediction. Fr…

Spatial ReasoningVisual Grounding

MotorMind: Scaffolding General Vision Language Models for Zero-Shot Robot Manipulation

2026-09-29 · Bingxuan Li, Siqi Song, Yizhuo Wu, Jiarui Yao 외 hf

Vision-language-action (VLA) models have advanced robotic manipulation, but their zero-shot generalization in new tasks and environments remains limited, and their reliance on specialized training keeps them from benefit…

Zero-shot GeneralizationRobot ManipulationVisual Grounding

Beyond Selection: Token Parameterization for Extreme Visual Token Compression

2026-09-28 · Rui Zhong, Yu Li, Zheyu Yan, Cheng Zhuo hf

Visual-token compression is effective for improving the efficiency of vision-language models, but under extreme compression budgets, token pruning can break visual grounding while learned resamplers increase parameter co…

Visual Grounding

ViD: Vision-Dominant Gender Bias Mitigation for Large Vision-Language Models

2026-09-15 · Zhipeng Zhao, Zhaoqiang Wei, Peishun Liu, Youwei Zhao 외 arxiv

Gender bias in large vision-language models (LVLMs) undermines their fairness and reliability, compromising output trustworthiness. Current mitigation methods rely on training-phase adjustments or post-hoc calibration, b…

Visual GroundingImage CaptioningText Generation

What Do Hallucinations Reveal About Multimodal Reasoning? Diagnosing Visual Grounding Failures via Contrastive Decoding Probes

2026-09-15 · Zhipeng Zhao, Wenxu Wang, Peishun Liu, Ruichun Tang arxiv

When strong multimodal models are widely available, progress requires new scientific methodologies beyond benchmark scores---using models as instruments for understanding behavior. We address this by asking: can we use l…

Multimodal ReasoningVisual Grounding

SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigation

2026-09-15 · Zixiu Ding, Zilin Zhao, Yingjie He, Xinlang Kang 외 arxiv

Multimodal large language models (MLLMs) have made strong progress on visual question answering and image captioning, yet they still produce fluent claims about objects, attributes, or relations that are not grounded in …

Visual Question AnsweringReinforcement LearningVisual GroundingImage Captioning

Counterfactual Reasoning for Robust Visual Question Answering

2026-09-15 · Truong-Binh Duong, Thanh-Ngan Tran, Ngoc-Thao Nguyen, Bac Le arxiv

Modern Visual Question Answering (VQA) models often exploit spurious correlations in training data, leading to poor out-of-distribution (OOD) generalization due to language bias. Although counterfactual learning has show…

Visual Question AnsweringContrastive LearningVisual Grounding

Ambient @ EgoProactive 2026 : Proactive Egocentric Assistance with Visually Grounded Supervision

2026-09-10 · Logesh Kumar Umapathi hf

We present our submission to the EgoProactive track of the ECCV 2026 Wearable AI Challenge, which ranked first in the large-model division and second in the <=2B division. The task requires a wearable assistant to decide…

Visual Grounding

Where to Look Matters: Learning Influential Views for VLM-based 3D Visual Grounding

2026-09-04 · Tsung-Chih Chiang, Hsuan-Kung Yang, Jou-Min Liu, Ting-Ru Liu 외 arxiv

Recent zero-shot 3D visual grounding methods leverage vision-language models (VLMs) to localize objects in 3D scenes from natural language queries. However, these methods typically rely on heuristic rules to select which…

Natural Language QueriesVisual Grounding

On the Design Fundamentals of Pixel Text Representation Learning

2026-09-01 · Chaohao Yuan, Ruifeng Yuan, Zhuoxu Huang, Yu Rong 외 hf

Text-rich visual inputs require models that can read, retrieve, and compress language directly in pixel space, yet existing pixel-text encoders struggle with fixed resolution pretraining, visual shortcut learning, weak v…

Representation LearningVisual Grounding

Cost-efficient Active Learning for Referring Image Segmentation and Grounding

2026-08-31 · Junbeom Hong, Seonghoon Yu, Hyung Rok Jung, Sundong Kim 외 arxiv

Collecting natural-language referring expressions along with region annotations, such as masks or boxes, is a major bottleneck in visual grounding (VG), as annotators must write descriptions that distinguish target regio…

Image SegmentationVisual GroundingActive Learning

ScienceArena: Benchmarking LLMs on Latest Scientific Olympiad Competitions

2026-08-31 · Guangxiang Zhao, Qilong Shi, Xusen Xiao, Wenpu Liu 외 arxiv

Benchmark saturation and data contamination increasingly obscure genuine scientific reasoning in frontier LLMs. We introduce \textsc{ScienceArena}, an olympiad-style benchmark from thirteen public science competitions in…

Visual Grounding

VisER: Visual Evidence and Reliance for Object Hallucination Detection in LVLMs

2026-08-31 · Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie, Sarah Erfani arxiv

Object hallucination remains a persistent reliability issue in large vision-language models, where generated object mentions may sound plausible but lack visual grounding. Recent training-free detectors use internal sign…

Visual Grounding

SeqAlign3DVG: A Sequence-Aligned Benchmark and Voxel Reasoning Framework for 3D Visual Grounding

2026-08-31 · Yi Zhang, Yi Wang, Yueting Wu, Kaiyue Yang 외 arxiv

Image-based 3D visual grounding is critical for embodied agents, yet existing benchmarks suffer from loose text-observation alignment and neglect temporal ordering. We introduce SeqAlign3DVG, a novel benchmark dedicated …

Visual GroundingPoint Clouds

Semantic-Spatial Discriminability Enhancement for Generalized Visual Grounding

2026-08-31 · Kaiyan Lei, Xu-Yao Zhang arxiv

Generalized Visual Grounding (GVG) task aims to localize targets in an image based on referring expressions, extends the classical visual grounding paradigm by integrating multi-target and non-target scenarios. Previous …

Visual Grounding

Reactivating Test-Time Scaling for Plane Geometry Problem Solving

2026-08-31 · Xiaoqiang Kang, Shengen Wu, Maizhen Ning, Xiaobo Jin 외 arxiv

Plane geometry problem (PGP) solving has become a critical benchmark for multimodal reasoning because it requires accurate visual perception and precise multi-step symbolic deduction. Although test-time scaling (TTS) has…

Mathematical ReasoningMultimodal ReasoningVisual Grounding

GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulation

2026-08-27 · Yibo Qiu, Haoliang Ye, Shu'ang Sun, Zan Huang 외 arxiv

Pretrained vision-language-action (VLA) policies provide strong priors for robot manipulation, yet adapting them online to fine-grained biomedical tasks remains challenging. Task success often hinges on subtle, view-depe…

Robot ManipulationVisual Grounding

Mapping Written Words to Spoken Words in a Different Language Using Only Visual Grounding

2026-08-27 · Gabriel Pirlogeanu, Dan Oneata, Horia Cucu, Herman Kamper arxiv

In many low-resource settings, even just eliciting speech for data collection is difficult. One promising approach has been to ask speakers to describe images. But how do we build models from such visually grounded speec…

Visual GroundingImage CaptioningKeyword Spotting

When Seeing Is Not Enough: Benchmarking Interactive Visual Grounding in LVLMs

2026-08-25 · Zhengxiang Wang, Owen Rambow arxiv

Visual grounding is typically evaluated as a one-shot mapping from an informative referring expression to a visual target. This formulation misses a central property of real-world reference: initial referring expressions…

Referring ExpressionVisual Grounding
1–20 / 1,131 다음 →