paper-with-me

Papers

WebCompass: Towards Multimodal Web Coding Evaluation for Code Language Models

2026-04-20 · Xinping Lei, Xinyu Che, Junqi Xiong, Chenchen Zhang, Yukai Huang, Chenyu Zhou, Haoyang Huang, Minghao Liu, Letian Zhu, Hongyi Ye, Jinhua Hao, Ken Deng, Zizheng Zhan, Han Li, Dailin Li, Yifan Yao, Ming Sun, Zhaoxiang Zhang, Jiaheng Liu arxiv

Large language models are rapidly evolving into interactive coding agents capable of end-to-end web coding, yet existing benchmarks evaluate only narrow slices of this capability, typically text-conditioned generation with static-correctness metrics, leaving visual fidelity, interaction quality, and codebase-level reasoning largely unmeasured. We introduce WebCompass, a multimodal benchmark that provides unified lifecycle evaluation of web engineering capability. Recognizing that real-world web coding is an iterative cycle of generation, editing, and repair, WebCompass spans three input modalities (text, image, video) and three task types (generation, editing, repair), yielding seven task categories that mirror professional workflows. Through a multi-stage, human-in-the-loop pipeline, we curate instances covering 15 generation domains, 16 editing operation types, and 11 repair defect types, each annotated at Easy/Medium/Hard levels. For evaluation, we adopt a checklist-guided LLM-as-a-Judge protocol for editing and repair, and propose a novel Agent-as-a-Judge paradigm for generation that autonomously executes generated websites in a real browser, explores interactive behaviors via the Model Context Protocol (MCP), and iteratively synthesizes targeted test cases, closely approximating human acceptance testing. We evaluate representative closed-source and open-source models and observe that: (1) closed-source models remain substantially stronger and more balanced; (2) editing and repair exhibit distinct difficulty profiles, with repair preserving interactivity better but remaining execution-challenging; (3) aesthetics is the most persistent bottleneck, especially for open-source models; and (4) framework choice materially affects outcomes, with Vue consistently challenging while React and Vanilla/HTML perform more strongly depending on task type.

📄 PDF Abstract BibTeX arXiv:2604.18224

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

VisCodex: Unified Multimodal Code Generation via Merging Vision and Coding Models

2025-08-13 · Lingjie Jiang, Shaohan Huang, Xun Wu, Yixia Li 외 arxiv

Multimodal large language models (MLLMs) have significantly advanced the integration of visual and textual understanding. However, their ability to generate code from multimodal inputs remains limited. In this work, we i…

Code Generation

Steering Multimodal Large Language Models Decoding for Context-Aware Safety

2025-09-23 · Zheyuan Liu, Zhangchen Xu, Guangyao Dou, Xiangchi Yuan 외 arxiv

Multimodal Large Language Models (MLLMs) are increasingly deployed in real-world applications, yet their ability to make context-aware safety decisions remains limited. Existing methods often fail to balance oversensitiv…

Towards Human Cognition: Visual Context Guides Syntactic Priming in Fusion-Encoded Models

2025-02-24 · Bushi Xiao, Michael Bennie, Jayetri Bardhan, Daisy Zhe Wang

We introduced PRISMATIC, the first multimodal structural priming dataset, and proposed a reference-free evaluation metric that assesses priming effects without predefined target sentences. Using this metric, we construct…

MMSpec: Benchmarking Speculative Decoding for Vision-Language Models

2026-03-16 · Hui Shen, Xin Wang, Ping Zhang, Yunta Hsieh 외 arxiv

Vision-language models (VLMs) achieve strong performance on multimodal tasks but suffer from high inference latency due to large model sizes and long multimodal contexts. Speculative decoding has recently emerged as an e…

Efficiently Serving Large Multimodal Models Using EPD Disaggregation

2024-12-25 · Gursimran Singh, Xinglu Wang, Yifan Hu, Timothy Yu 외

Large Multimodal Models (LMMs) extend Large Language Models (LLMs) by handling diverse inputs such as images, audio, and video, but at the cost of adding a multimodal encoding stage that increases both computational and …