paper-with-me

Papers

Quality Resilient Deep Neural Networks

2017-03-23 · Samuel Dodge, Lina Karam

We study deep neural networks for classification of images with quality distortions. We first show that networks fine-tuned on distorted data greatly outperform the original networks when tested on distorted data. However, fine-tuned networks perform poorly on quality distortions that they have not been trained for. We propose a mixture of experts ensemble method that is robust to different types of distortions. The "experts" in our model are trained on a particular type of distortion. The output of the model is a weighted sum of the expert models, where the weights are determined by a separate gating network. The gating network is trained to predict optimal weights for a particular distortion type and level. During testing, the network is blind to the distortion level and type, yet can still assign appropriate weights to the expert models. We additionally investigate weight sharing methods for the mixture model and show that improved performance can be achieved with a large reduction in the number of unique network parameters.

📄 PDF Abstract BibTeX arXiv:1703.08119

Code (0)

등록된 구현이 없습니다.

Tasks

Mixture-of-Experts

Similar Papers 제목 키워드 기반

Noise-Resilient Ensemble Learning using Evidence Accumulation Clustering

2021-10-18 · Gaëlle Candel, David Naccache

Ensemble Learning methods combine multiple algorithms performing the same task to build a group with superior quality. These systems are well adapted to the distributed setup, where each peer or machine of the network ho…

ClusteringEnsemble Learning

A Resilient Distributed Boosting Algorithm

2022-06-09 · Yuval Filmus, Idan Mehalel, Shay Moran

Given a learning task where the data is distributed among several parties, communication is one of the fundamental resources which the parties would like to minimize. We present a distributed boosting algorithm which is …

LEMMA

Object Detection based on OcSaFPN in Aerial Images with Noise

2020-12-18 · Chengyuan Li, Jun Liu, Hailong Hong, Wenju Mao 외

Taking the deep learning-based algorithms into account has become a crucial way to boost object detection performance in aerial images. While various neural network representations have been developed, previous works are…

AttributeDenoisingobject-detectionObject Detection

GRACE: Loss-Resilient Real-Time Video through Neural Codecs

2023-05-21 · Yihua Cheng, Ziyi Zhang, Hanchen Li, Anton Arapin 외

In real-time video communication, retransmitting lost packets over high-latency networks is not viable due to strict latency requirements. To counter packet losses without retransmission, two primary strategies are emplo…

Decoder

Enabling Resilient and Real-Time Network Operations in Space: A Novel Multi-Layer Satellite Networking Scheme

2022-12-07 · Peng Hu

Recently advanced low-Earth-orbit (LEO) satellite networks represented by large constellations and advanced payloads provide great promises for enabling high-quality Internet connectivity to any place on Earth. However, …