paper-with-me

홈 › Papers

Object Detectors in the Open Environment: Challenges, Solutions, and Outlook

2024-03-24 · Siyuan Liang, Wei Wang, Ruoyu Chen, Aishan Liu, Boxi Wu, Ee-Chien Chang, Xiaochun Cao, DaCheng Tao

With the emergence of foundation models, deep learning-based object detectors have shown practical usability in closed set scenarios. However, for real-world tasks, object detectors often operate in open environments, where crucial factors (e.g., data distribution, objective) that influence model learning are often changing. The dynamic and intricate nature of the open environment poses novel and formidable challenges to object detectors. Unfortunately, current research on object detectors in open environments lacks a comprehensive analysis of their distinctive characteristics, challenges, and corresponding solutions, which hinders their secure deployment in critical real-world scenarios. This paper aims to bridge this gap by conducting a comprehensive review and analysis of object detectors in open environments. We initially identified limitations of key structural components within the existing detection pipeline and propose the open environment object detector challenge framework that includes four quadrants (i.e., out-of-domain, out-of-category, robust learning, and incremental learning) based on the dimensions of the data / target changes. For each quadrant of challenges in the proposed framework, we present a detailed description and systematic analysis of the overarching goals and core difficulties, systematically review the corresponding solutions, and benchmark their performance over multiple widely adopted datasets. In addition, we engage in a discussion of open problems and potential avenues for future research. This paper aims to provide a fresh, comprehensive, and systematic understanding of the challenges and solutions associated with open-environment object detectors, thus catalyzing the development of more solid applications in real-world scenarios. A project related to this survey can be found at https://github.com/LiangSiyuan21/OEOD_Survey.

📄 PDF Abstract BibTeX arXiv:2403.16271

Code (1)

liangsiyuan21/oeod_survey 공식 구현 pytorch

Tasks

Incremental LearningObject

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

1st Place Solutions for Waymo Open Dataset Challenges -- 2D and 3D Tracking

2020-06-28 · Yu Wang, Sijia Chen, Li Huang, Runzhou Ge 외

This technical report presents the online and real-time 2D and 3D multi-object tracking (MOT) algorithms that reached the 1st places on both Waymo Open Dataset 2D tracking and 3D tracking challenges. An efficient and pra…

3D Multi-Object TrackingMulti-Object TrackingObject Tracking

Superpowering Open-Vocabulary Object Detectors for X-ray Vision

2025-03-21 · Pablo Garcia-Fernandez, Lorenzo Vaquero, Mingxuan Liu, Feng Xue 외

Open-vocabulary object detection (OvOD) is set to revolutionize security screening by enabling systems to recognize any item in X-ray scans. However, developing effective OvOD models for X-ray imaging presents unique cha…

object-detectionObject DetectionOpen-vocabulary object detectionOpen Vocabulary Object Detection

OW-OVD: Unified Open World and Open Vocabulary Object Detection

2025-01-01 · CVPR 2025 1 · Xing Xi, Yangyang Huang, Ronghua Luo, Yu Qiu

Open world perception expands traditional closed-set frameworks, which assume a predefined set of known categories, to encompass dynamic real-world environments. Open World Object Detection (OWOD) and Open Vocabulary…

AttributeIncremental Learningobject-detectionObject Detection+4

Addressing the Challenges of Open-World Object Detection

2023-03-27 · David Pershouse, Feras Dayoub, Dimity Miller, Niko Sünderhauf

We address the challenging problem of open world object detection (OWOD), where object detectors must identify objects from known classes while also identifying and continually learning to detect novel objects. Prior wor…

Objectobject-detectionObject DetectionOpen World Object Detection

Underwater Object Classification and Detection: first results and open challenges

2022-01-04 · Andre Jesus, Claudio Zito, Claudio Tortorici, Eloy Roura 외

This work reviews the problem of object detection in underwater environments. We analyse and quantify the shortcomings of conventional state-of-the-art (SOTA) algorithms in the computer vision community when applied to t…

ClassificationObjectobject-detectionObject Detection