paper-with-me

홈 › Papers

Towards Scalable Web Accessibility Audit with MLLMs as Copilots

2025-11-05 · Ming Gu, Ziwei Wang, Sicen Lai, Zirui Gao, Sheng Zhou, Jiajun Bu arxiv

Ensuring web accessibility is crucial for advancing social welfare, justice, and equality in digital spaces, yet the vast majority of website user interfaces remain non-compliant, due in part to the resource-intensive and unscalable nature of current auditing practices. While WCAG-EM offers a structured methodology for site-wise conformance evaluation, it involves great human efforts and lacks practical support for execution at scale. In this work, we present an auditing framework, AAA, which operationalizes WCAG-EM through a human-AI partnership model. AAA is anchored by two key innovations: GRASP, a graph-based multimodal sampling method that ensures representative page coverage via learned embeddings of visual, textual, and relational cues; and MaC, a multimodal large language model-based copilot that supports auditors through cross-modal reasoning and intelligent assistance in high-effort tasks. Together, these components enable scalable, end-to-end web accessibility auditing, empowering human auditors with AI-enhanced assistance for real-world impact. We further contribute four novel datasets designed for benchmarking core stages of the audit pipeline. Extensive experiments demonstrate the effectiveness of our methods, providing insights that small-scale language models can serve as capable experts when fine-tuned.

📄 PDF Abstract BibTeX arXiv:2511.03471

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ScreenAudit: Detecting Screen Reader Accessibility Errors in Mobile Apps Using Large Language Models

2025-04-02 · Mingyuan Zhong, Ruolin Chen, Xia Chen, James Fogarty 외

Many mobile apps are inaccessible, thereby excluding people from their potential benefits. Existing rule-based accessibility checkers aim to mitigate these failures by identifying errors early during development but are …

LATTICE: Evaluating Decision Support Utility of Crypto Agents

2026-04-29 · Aaron Chan, Tengfei Li, Tianyi Xiao, Angela Chen 외 arxiv

We introduce LATTICE, a benchmark for evaluating the decision support utility of crypto agents in realistic user-facing scenarios. Prior crypto agent benchmarks mainly focus on reasoning-based or outcome-based evaluation…

Who Gets Left Behind? Auditing Disability Inclusivity in Large Language Models

2025-08-31 · Deepika Dash, Yeshil Bangera, Mithil Bangera, Gouthami Vadithya 외 arxiv

Large Language Models (LLMs) are increasingly used for accessibility guidance, yet many disability groups remain underserved by their advice. To address this gap, we present taxonomy aligned benchmark1 of human validated…

From Coders to Critics: Empowering Students through Peer Assessment in the Age of AI Copilots

2025-05-28 · Santiago Berrezueta-Guzman, Stephan Krusche, Stefan Wagner

The rapid adoption of AI powered coding assistants like ChatGPT and other coding copilots is transforming programming education, raising questions about assessment practices, academic integrity, and skill development. As…

Fairness

VTPerception-R1: Enhancing Multimodal Reasoning via Explicit Visual and Textual Perceptual Grounding

2025-09-29 · Yizhuo Ding, Mingkang Chen, Zhibang Feng, Tong Xiao 외 arxiv

Multimodal large language models (MLLMs) often struggle to ground reasoning in perceptual evidence. We present a systematic study of perception strategies-explicit, implicit, visual, and textual-across four multimodal be…

Reinforcement LearningMultimodal Reasoning