Background Mixup Data Augmentation for Hand and Object-in-Contact Detection
Detecting the positions of human hands and objects-in-contact (hand-object detection) in each video frame is vital for understanding human activities from videos. For training an object detector, a method called Mixup, which overlays two training images to mitigate data bias, has been empirically shown to be effective for data augmentation. However, in hand-object detection, mixing two hand-manipulation images produces unintended biases, e.g., the concentration of hands and objects in a specific region degrades the ability of the hand-object detector to identify object boundaries. We propose a data-augmentation method called Background Mixup that leverages data-mixing regularization while reducing the unintended effects in hand-object detection. Instead of mixing two images where a hand and an object in contact appear, we mix a target training image with background images without hands and objects-in-contact extracted from external image sources, and use the mixed images for training the detector. Our experiments demonstrated that the proposed method can effectively reduce false positives and improve the performance of hand-object detection in both supervised and semi-supervised learning settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Contact DetectionData AugmentationObjectobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
BGM: Background Mixup for X-ray Prohibited Items Detection
Prohibited item detection is crucial for ensuring public safety, yet current X-ray image-based detection methods often lack comprehensive data-driven exploration. This paper introduces a novel data augmentation approach …
Data AugmentationImage AugmentationObject-aware Contrastive Learning for Debiased Scene Representation
Contrastive self-supervised learning has shown impressive results in learning visual representations from unlabeled images by enforcing invariance against different data augmentations. However, the learned representation…
Contrastive LearningObjectRepresentation LearningSelf-Supervised LearningAdversarial AutoMixup
Data mixing augmentation has been widely applied to improve the generalization ability of deep neural networks. Recently, offline data mixing augmentation, e.g. handcrafted and saliency information-based mixup, has been …
Classificationimage-classificationImage ClassificationSupervision Interpolation via LossMix: Generalizing Mixup for Object Detection and Beyond
The success of data mixing augmentations in image classification tasks has been well-received. However, these techniques cannot be readily applied to object detection due to challenges such as spatial misalignment, foreg…
Domain Adaptationimage-classificationImage ClassificationObject+3MixAugment & Mixup: Augmentation Methods for Facial Expression Recognition
Automatic Facial Expression Recognition (FER) has attracted increasing attention in the last 20 years since facial expressions play a central role in human communication. Most FER methodologies utilize Deep Neural Networ…
Data AugmentationFacial Expression RecognitionFacial Expression Recognition (FER)