Papers GUI Element Detection
“GUI Element Detection” 태그가 달린 논문 5편 · 필터 해제
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning
The recent progress of large language model agents has opened new possibilities for automating tasks through graphical user interfaces (GUIs), especially in mobile environments where intelligent interaction can greatly e…
AI AgentDiversityGUI Element DetectionLarge Language ModelLeveraging Vision-Language Models for Visual Grounding and Analysis of Automotive UI
Modern automotive infotainment systems require intelligent and adaptive solutions to handle frequent User Interface (UI) updates and diverse design variations. We introduce a vision-language framework for understanding a…
4kDomain GeneralizationGUI Element DetectionVisual Grounding+1PixelWeb: The First Web GUI Dataset with Pixel-Wise Labels
Graphical User Interface (GUI) datasets are crucial for various downstream tasks. However, GUI datasets often generate annotation information through automatic labeling, which commonly results in inaccurate GUI element B…
GUI Element DetectionGUI Element Detection Using SOTA YOLO Deep Learning Models
Detection of Graphical User Interface (GUI) elements is a crucial task for automatic code generation from images and sketches, GUI testing, and GUI search. Recent studies have leveraged both old-fashioned and modern comp…
2D Object DetectionCode GenerationContour DetectionDeep Learning+5Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?
Detecting Graphical User Interface (GUI) elements in GUI images is a domain-specific object detection task. It supports many software engineering tasks, such as GUI animation and testing, GUI search and code generation. …
Code GenerationGUI Element Detectionobject-detectionObject Detection