paper-with-me

홈 › Papers

Augmentation Pathways Network for Visual Recognition

2021-07-26 · Yalong Bai, Mohan Zhou, Wei zhang, BoWen Zhou, Tao Mei

Data augmentation is practically helpful for visual recognition, especially at the time of data scarcity. However, such success is only limited to quite a few light augmentations (e.g., random crop, flip). Heavy augmentations are either unstable or show adverse effects during training, owing to the big gap between the original and augmented images. This paper introduces a novel network design, noted as Augmentation Pathways (AP), to systematically stabilize training on a much wider range of augmentation policies. Notably, AP tames various heavy data augmentations and stably boosts performance without a careful selection among augmentation policies. Unlike traditional single pathway, augmented images are processed in different neural paths. The main pathway handles the light augmentations, while other pathways focus on the heavier augmentations. By interacting with multiple paths in a dependent manner, the backbone network robustly learns from shared visual patterns among augmentations, and suppresses the side effect of heavy augmentations at the same time. Furthermore, we extend AP to high-order versions for high-order scenarios, demonstrating its robustness and flexibility in practical usage. Experimental results on ImageNet demonstrate the compatibility and effectiveness on a much wider range of augmentations, while consuming fewer parameters and lower computational costs at inference time.

📄 PDF Abstract BibTeX arXiv:2107.11990

Code (1)

ap-conv/ap-net 공식 구현 pytorch

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

The functional specialization of visual cortex emerges from training parallel pathways with self-supervised predictive learning

2021-12-01 · NeurIPS 2021 12 · Shahab Bakhtiari, Patrick Mineault, Timothy Lillicrap, Christopher Pack 외

The visual system of mammals is comprised of parallel, hierarchical specialized pathways. Different pathways are specialized in so far as they use representations that are more suitable for supporting specific downstream…

Vision at A Glance: Interplay between Fine and Coarse Information Processing Pathways

2020-08-23 · Zilong Ji, Xiaolong Zou, Tiejun Huang, Si Wu

Object recognition is often viewed as a feedforward, bottom-up process in machine learning, but in real neural systems, object recognition is a complicated process which involves the interplay between two signal pathways…

Object Recognition

Cognitive Steering in Deep Neural Networks via Long-Range Modulatory Feedback Connections

2023-09-21 · NeurIPS 2023 11

Given the rich visual information available in each glance, humans can internally direct their visual attention to enhance goal-relevant information---a capacity often absent in standard vision models. Here we introduce…

A Dual-Stream Neural Network Explains the Functional Segregation of Dorsal and Ventral Visual Pathways in Human Brains

2023-09-21 · NeurIPS 2023 11

The human visual system uses two parallel pathways for spatial processing and object recognition. In contrast, computer vision systems tend to use a single feedforward pathway, rendering them less robust, adaptive, or ef…

Learning Temporally Invariant and Localizable Features via Data Augmentation for Video Recognition

2020-08-13 · Taeoh Kim, Hyeongmin Lee, MyeongAh Cho, Ho Seong Lee 외

Deep-Learning-based video recognition has shown promising improvements along with the development of large-scale datasets and spatiotemporal network architectures. In image recognition, learning spatially invariant featu…

Action RecognitionData AugmentationVideo Recognition