Adversarial Semantic Data Augmentation for Human Pose Estimation
Human pose estimation is the task of localizing body keypoints from still images. The state-of-the-art methods suffer from insufficient examples of challenging cases such as symmetric appearance, heavy occlusion and nearby person. To enlarge the amounts of challenging cases, previous methods augmented images by cropping and pasting image patches with weak semantics, which leads to unrealistic appearance and limited diversity. We instead propose Semantic Data Augmentation (SDA), a method that augments images by pasting segmented body parts with various semantic granularity. Furthermore, we propose Adversarial Semantic Data Augmentation (ASDA), which exploits a generative network to dynamiclly predict tailored pasting configuration. Given off-the-shelf pose estimation network as discriminator, the generator seeks the most confusing transformation to increase the loss of the discriminator while the discriminator takes the generated sample as input and learns from it. The whole pipeline is optimized in an adversarial manner. State-of-the-art results are achieved on challenging benchmarks.
Code (1)
Tasks
Data AugmentationDiversityPose EstimationSimilar Papers 제목 키워드 기반
Adversarial Semantic Augmentation for Training Generative Adversarial Networks under Limited Data
Generative adversarial networks (GANs) have made remarkable achievements in synthesizing images in recent years. Typically, training GANs requires massive data, and the performance of GANs deteriorates significantly when…
Data AugmentationImproving the Transferability of Adversarial Samples by Path-Augmented Method
Deep neural networks have achieved unprecedented success on diverse vision tasks. However, they are vulnerable to adversarial noise that is imperceptible to humans. This phenomenon negatively affects their deployment in …
Data AugmentationImage AugmentationBERT is Robust! A Case Against Synonym-Based Adversarial Examples in Text Classification
In this work, we investigate the robustness of BERT using four word substitution-based attacks. We combine a human evaluation of individual word substitutions and a probabilistic analysis to show that between 96% and 99%…
Data Augmentationtext-classificationText ClassificationBenign Adversarial Attack: Tricking Models for Goodness
In spite of the successful application in many fields, machine learning models today suffer from notorious problems like vulnerability to adversarial examples. Beyond falling into the cat-and-mouse game between adversari…
Adversarial AttackAttributeBIG-bench Machine LearningData AugmentationSemantically Equivalent Adversarial Rules for Debugging NLP models
Complex machine learning models for NLP are often brittle, making different predictions for input instances that are extremely similar semantically. To automatically detect this behavior for individual instances, we pres…
Data AugmentationQuestion AnsweringReading ComprehensionSentiment Analysis+2