paper-with-me

Papers

Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net

2018-07-25 · ECCV 2018 9 · Xingang Pan, Ping Luo, Jianping Shi, Xiaoou Tang

Convolutional neural networks (CNNs) have achieved great successes in many computer vision problems. Unlike existing works that designed CNN architectures to improve performance on a single task of a single domain and not generalizable, we present IBN-Net, a novel convolutional architecture, which remarkably enhances a CNN's modeling ability on one domain (e.g. Cityscapes) as well as its generalization capacity on another domain (e.g. GTA5) without finetuning. IBN-Net carefully integrates Instance Normalization (IN) and Batch Normalization (BN) as building blocks, and can be wrapped into many advanced deep networks to improve their performances. This work has three key contributions. (1) By delving into IN and BN, we disclose that IN learns features that are invariant to appearance changes, such as colors, styles, and virtuality/reality, while BN is essential for preserving content related information. (2) IBN-Net can be applied to many advanced deep architectures, such as DenseNet, ResNet, ResNeXt, and SENet, and consistently improve their performance without increasing computational cost. (3) When applying the trained networks to new domains, e.g. from GTA5 to Cityscapes, IBN-Net achieves comparable improvements as domain adaptation methods, even without using data from the target domain. With IBN-Net, we won the 1st place on the WAD 2018 Challenge Drivable Area track, with an mIoU of 86.18%.

📄 PDF Abstract BibTeX arXiv:1807.09441

Code (25)

XingangPan/IBN-Net 공식 구현 pytorch
2023-MindSpore-1/ms-code-214/tree/main/ibnnet mindspore
2023-MindSpore-4/Code-5/tree/main/ibnnet mindspore
Asthestarsfalll/IBNNet-MegEngine pytorch
DiegoArcelli/De-Stylization-Network pytorch
Mind23-2/MindCode-3/tree/main/ibnnet mindspore
Mind23-2/MindCode-52 mindspore
WangWenhao0716/DomainMix pytorch
Yang-Q-D/mindsporeCode/tree/master/ibnnet mindspore
alibaba/cluster-contrast pytorch
alibaba/cluster-contrast-reid pytorch
bupt-ai-cz/hhcl-reid pytorch
code-implementation1/Code4/tree/main/ibnnet mindspore
jihaoxuanye/MetaPRD pytorch
layumi/Person_reID_baseline_pytorch pytorch
leeBooMla/ICSR pytorch
leeboomla/calr pytorch
mindspore-ai/models/blob/master/research/cv/ibnnet mindspore
osmr/imgclsmob mxnet
theziqi/dccc pytorch
thuml/Transfer-Learning-Library pytorch
wangguangyuan/ClusterContrast pytorch
wangyuan249/Mymmt767 pytorch
yxgeee/MMT pytorch
yxgeee/SpCL pytorch

Tasks

All-day Semantic SegmentationDomain AdaptationDomain GeneralizationRobust Object DetectionVocal Bursts Valence Prediction

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Residual Connection 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…
Average Pooling 설명 없음
ResNeXt Block A ResNeXt Block is a type of residual block used as part of the ResNeXt CNN…

Similar Papers 제목 키워드 기반

BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language Models

2023-09-23 · Zican Dong, Tianyi Tang, Junyi Li, Wayne Xin Zhao 외

Large language models (LLMs) have achieved dramatic proficiency over NLP tasks with normal length. Recently, multiple studies have committed to extending the context length and enhancing the long text modeling capabiliti…

Code CompletionHallucinationLanguage ModelingLanguage Modelling+1

Absorptive capacities and economic growth in low and middle income economies

2021-09-23 · Muhammad Salar Khan

I extend the concept of absorptive capacity, used in the analysis of firms, to a framework applicable to the national level. First, employing confirmatory factor analyses on 47 variables, I build 13 composite factors cru…

This is a BERT. Now there are several of them. Can they generalize to novel words?

2020-11-01 · EMNLP (BlackboxNLP) 2020 11 · Coleman Haley

Recently, large-scale pre-trained neural network models such as BERT have achieved many state-of-the-art results in natural language processing. Recent work has explored the linguistic capacities of these models. However…

Metacognition and Uncertainty Communication in Humans and Large Language Models

2025-04-18 · Mark Steyvers, Megan A. K. Peters

Metacognition, the capacity to monitor and evaluate one's own knowledge and performance, is foundational to human decision-making, learning, and communication. As large language models (LLMs) become increasingly embedded…

Decision Making

Automatic Curriculum Learning For Deep RL: A Short Survey

2020-03-10 · Rémy Portelas, Cédric Colas, Lilian Weng, Katja Hofmann 외

Automatic Curriculum Learning (ACL) has become a cornerstone of recent successes in Deep Reinforcement Learning (DRL).These methods shape the learning trajectories of agents by challenging them with tasks adapted to thei…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1