All Beings Are Equal in Open Set Recognition
In open-set recognition (OSR), a promising strategy is exploiting pseudo-unknown data outside given $K$ known classes as an additional $K$+$1$-th class to explicitly model potential open space. However, treating unknown classes without distinction is unequal for them relative to known classes due to the category-agnostic and scale-agnostic of the unknowns. This inevitably not only disrupts the inherent distributions of unknown classes but also incurs both class-wise and instance-wise imbalances between known and unknown classes. Ideally, the OSR problem should model the whole class space as $K$+$\infty$, but enumerating all unknowns is impractical. Since the core of OSR is to effectively model the boundaries of known classes, this means just focusing on the unknowns nearing the boundaries of targeted known classes seems sufficient. Thus, as a compromise, we convert the open classes from infinite to $K$, with a novel concept Target-Aware Universum (TAU) and propose a simple yet effective framework Dual Contrastive Learning with Target-Aware Universum (DCTAU). In details, guided by the targeted known classes, TAU automatically expands the unknown classes from the previous $1$ to $K$, effectively alleviating the distribution disruption and the imbalance issues mentioned above. Then, a novel Dual Contrastive (DC) loss is designed, where all instances irrespective of known or TAU are considered as positives to contrast with their respective negatives. Experimental results indicate DCTAU sets a new state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
AllContrastive LearningOpen Set LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Online Visual Place Recognition via Saliency Re-identification
As an essential component of visual simultaneous localization and mapping (SLAM), place recognition is crucial for robot navigation and autonomous driving. Existing methods often formulate visual place recognition as fea…
Autonomous DrivingRobot NavigationSaliency DetectionSimultaneous Localization and Mapping+1Multi-Semantic Image Recognition Model and Evaluating Index for explaining the deep learning models
Although deep learning models are powerful among various applications, most deep learning models are still a black box, lacking verifiability and interpretability, which means the decision-making process that human being…
Decision MakingDeep Learningimage-classificationImage ClassificationHAPRec: Hybrid Activity and Plan Recognizer
Computer-based assistants have recently attracted much interest due to its applicability to ambient assisted living. Such assistants have to detect and recognize the high-level activities and goals performed by the assis…
Action RecognitionActivity RecognitionTextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Model
Existing scene text spotters are designed to locate and transcribe texts from images. However, it is challenging for a spotter to achieve precise detection and recognition of scene texts simultaneously. Inspired by the g…
Language ModelingLanguage ModellingOptical Character Recognition (OCR)Scene Recognition+2Interactive Open-Ended Learning for 3D Object Recognition
The thesis contributes in several important ways to the research area of 3D object category learning and recognition. To cope with the mentioned limitations, we look at human cognition, in particular at the fact that hum…
3D Object RecognitionObjectObject Recognition