Domain Generalization Emerges from Dreaming

2023-02-02 · Hwan Heo, Youngjin Oh, Jaewon Lee, Hyunwoo J. Kim

Recent studies have proven that DNNs, unlike human vision, tend to exploit texture information rather than shape. Such texture bias is one of the factors for the poor generalization performance of DNNs. We observe that the texture bias negatively affects not only in-domain generalization but also out-of-distribution generalization, i.e., Domain Generalization. Motivated by the observation, we propose a new framework to reduce the texture bias of a model by a novel optimization-based data augmentation, dubbed Stylized Dream. Our framework utilizes adaptive instance normalization (AdaIN) to augment the style of an original image yet preserve the content. We then adopt a regularization loss to predict consistent outputs between Stylized Dream and original images, which encourages the model to learn shape-based representations. Extensive experiments show that the proposed method achieves state-of-the-art performance in out-of-distribution settings on public benchmark datasets: PACS, VLCS, OfficeHome, TerraIncognita, and DomainNet.

📄 PDF Abstract BibTeX arXiv:2302.00980

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation Domain GeneralizationOut-of-Distribution Generalization

Methods 이 논문이 사용한 방법론

Instance Normalization Instance Normalization (also known as contrast normalization) is a normalization layer where: $$ y_{tijk} = \frac{x_{tijk} - \mu_{ti}}{\sqrt{\sigma_{ti}^2 +…

Adaptive Instance Normalization 설명 없음

DreamingV2: Reinforcement Learning with Discrete World Models without Reconstruction

2022-03-01 · Masashi Okada, Tadahiro Taniguchi

The present paper proposes a novel reinforcement learning method with world models, DreamingV2, a collaborative extension of DreamerV2 and Dreaming. DreamerV2 is a cutting-edge model-based reinforcement learning from pix…

Contrastive Learning Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Fluent dreaming for language models

2024-01-24 · T. Ben Thompson, Zygimantas Straznickas, Michael Sklar

Feature visualization, also known as "dreaming", offers insights into vision models by optimizing the inputs to maximize a neuron's activation or other internal component. However, dreaming has not been successfully appl…

Adversarial Attack Language Modeling Language Modelling

Finding the DeepDream for Time Series: Activation Maximization for Univariate Time Series

2024-08-20 · Udo Schlegel, Daniel A. Keim, Tobias Sutter

Understanding how models process and interpret time series data remains a significant challenge in deep learning to enable applicability in safety-critical areas such as healthcare. In this paper, we introduce Sequence D…

Decision Making Time Series Time Series Classification

Multi-View Dreaming: Multi-View World Model with Contrastive Learning

2022-03-15 · Akira Kinose, Masashi Okada, Ryo Okumura, Tadahiro Taniguchi

In this paper, we propose Multi-View Dreaming, a novel reinforcement learning agent for integrated recognition and control from multi-view observations by extending Dreaming. Most current reinforcement learning method as…

Contrastive Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning Real-World Robot Policies by Dreaming

2018-05-20 · AJ Piergiovanni, Alan Wu, Michael S. Ryoo

Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)