paper-with-me

Papers

EffiPerception: an Efficient Framework for Various Perception Tasks

2024-03-18 · Xinhao Xiang, Simon Dräger, Jiawei Zhang

The accuracy-speed-memory trade-off is always the priority to consider for several computer vision perception tasks. Previous methods mainly focus on a single or small couple of these tasks, such as creating effective data augmentation, feature extractor, learning strategies, etc. These approaches, however, could be inherently task-specific: their proposed model's performance may depend on a specific perception task or a dataset. Targeting to explore common learning patterns and increasing the module robustness, we propose the EffiPerception framework. It could achieve great accuracy-speed performance with relatively low memory cost under several perception tasks: 2D Object Detection, 3D Object Detection, 2D Instance Segmentation, and 3D Point Cloud Segmentation. Overall, the framework consists of three parts: (1) Efficient Feature Extractors, which extract the input features for each modality. (2) Efficient Layers, plug-in plug-out layers that further process the feature representation, aggregating core learned information while pruning noisy proposals. (3) The EffiOptim, an 8-bit optimizer to further cut down the computational cost and facilitate performance stability. Extensive experiments on the KITTI, semantic-KITTI, and COCO datasets revealed that EffiPerception could show great accuracy-speed-memory overall performance increase within the four detection and segmentation tasks, in comparison to earlier, well-respected methods.

📄 PDF Abstract BibTeX arXiv:2403.12317

Code (0)

등록된 구현이 없습니다.

Tasks

2D Object Detection3D Object DetectionData AugmentationInstance Segmentationobject-detectionObject DetectionPoint Cloud SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

ZOPP: A Framework of Zero-shot Offboard Panoptic Perception for Autonomous Driving

2024-11-08 · Tao Ma, Hongbin Zhou, Qiusheng Huang, Xuemeng Yang 외

Offboard perception aims to automatically generate high-quality 3D labels for autonomous driving (AD) scenes. Existing offboard methods focus on 3D object detection with closed-set taxonomy and fail to match human-level …

3D Object DetectionAutonomous Drivingobject-detectionObject Detection+1

Towards Understanding Graphical Perception in Large Multimodal Models

2025-03-13 · Kai Zhang, Jianwei Yang, Jeevana Priya Inala, Chandan Singh 외

Despite the promising results of large multimodal models (LMMs) in complex vision-language tasks that require knowledge, reasoning, and perception abilities together, we surprisingly found that these models struggle with…

VipAct: Visual-Perception Enhancement via Specialized VLM Agent Collaboration and Tool-use

2024-10-21 · Zhehao Zhang, Ryan Rossi, Tong Yu, Franck Dernoncourt 외

While vision-language models (VLMs) have demonstrated remarkable performance across various tasks combining textual and visual information, they continue to struggle with fine-grained visual perception tasks that require…

Image CaptioningTask Planning

StructChart: On the Schema, Metric, and Augmentation for Visual Chart Understanding

2023-09-20 · Renqiu Xia, Haoyang Peng, Hancheng Ye, Mingsheng Li 외

Charts are common in literature across various scientific fields, conveying rich information easily accessible to readers. Current chart-related tasks focus on either chart perception that extracts information from the v…

Chart Question AnsweringChart UnderstandingLanguage ModellingLarge Language Model+2

Advancing Visual Large Language Model for Multi-granular Versatile Perception

2025-07-22 · Wentao Xiang, Haoxian Tan, Cong Wei, Yujie Zhong 외 arxiv

Perception is a fundamental task in the field of computer vision, encompassing a diverse set of subtasks that can be systematically categorized into four distinct groups based on two dimensions: prediction type and instr…

Referring Expression SegmentationPanoptic Segmentation