paper-with-me

홈 › Papers

Learning Deep Visual Object Models From Noisy Web Data: How to Make it Work

2017-02-28 · IEEE Xplore: 2017 12 · Nizar Massouh, Francesca Babiloni, Tatiana Tommasi, Jay Young, Nick Hawes, Barbara Caputo

Deep networks thrive when trained on large scale data collections. This has given ImageNet a central role in the development of deep architectures for visual object classification. However, ImageNet was created during a specific period in time, and as such it is prone to aging, as well as dataset bias issues. Moving beyond fixed training datasets will lead to more robust visual systems, especially when deployed on robots in new environments which must train on the objects they encounter there. To make this possible, it is important to break free from the need for manual annotators. Recent work has begun to investigate how to use the massive amount of images available on the Web in place of manual image annotations. We contribute to this research thread with two findings: (1) a study correlating a given level of noisily labels to the expected drop in accuracy, for two deep architectures, on two different types of noise, that clearly identifies GoogLeNet as a suitable architecture for learning from Web data; (2) a recipe for the creation of Web datasets with minimal noise and maximum visual variability, based on a visual and natural language processing concept expansion strategy. By combining these two results, we obtain a method for learning powerful deep object models automatically from the Web. We confirm the effectiveness of our approach through object categorization experiments using our Web-derived version of ImageNet on a popular robot vision benchmark database, and on a lifelong object discovery task on a mobile robot.

📄 PDF Abstract BibTeX arXiv:1702.08513

Code (1)

nizarmassouh/WebDB

Tasks

ObjectObject CategorizationObject Discovery

Methods 이 논문이 사용한 방법론

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Average Pooling 설명 없음
Local Response Normalization Local Response Normalization is a normalization layer that implements the idea of lateral inhibition. Lateral inhibition is a concept in neurobiology that refers to the…
Auxiliary Classifier Auxiliary Classifiers are type of architectural component that seek to improve the convergence of very deep networks. They are classifier heads we attach to layers before the…
Inception Module An Inception Module is an image model block that aims to approximate an optimal local sparse structure in a CNN. Put simply, it allows for us to use multiple types of filter…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Scene Graph Generation with External Knowledge and Image Reconstruction

2019-04-01 · CVPR 2019 6 · Jiuxiang Gu, Handong Zhao, Zhe Lin, Sheng Li 외

Scene graph generation has received growing attention with the advancements in image understanding tasks such as object detection, attributes and relationship prediction,~\etc. However, existing datasets are biased in te…

Graph GenerationImage ReconstructionObjectobject-detection+4

SAT: 2D Semantics Assisted Training for 3D Visual Grounding

2021-05-24 · ICCV 2021 10 · Zhengyuan Yang, Songyang Zhang, LiWei Wang, Jiebo Luo

3D visual grounding aims at grounding a natural language description about a 3D scene, usually represented in the form of 3D point clouds, to the targeted object region. Point clouds are sparse, noisy, and contain limite…

3D visual groundingObjectRepresentation LearningVisual Grounding

CochleaNet: A Robust Language-independent Audio-Visual Model for Speech Enhancement

2019-09-23 · Mandar Gogate, Kia Dashtipour, Ahsan Adeel, Amir Hussain

Noisy situations cause huge problems for suffers of hearing loss as hearing aids often make the signal more audible but do not always restore the intelligibility. In noisy settings, humans routinely exploit the audio-vis…

Speech Enhancement

PromptDet: Towards Open-vocabulary Detection using Uncurated Images

2022-03-30 · Chengjian Feng, Yujie Zhong, Zequn Jie, Xiangxiang Chu 외

The goal of this work is to establish a scalable pipeline for expanding an object detector towards novel/unseen categories, using zero manual annotations. To achieve that, we make the following four contributions: (i) in…

Language ModelingLanguage ModellingObjectPrompt Learning

CDE: Concept-Driven Exploration for Reinforcement Learning

2025-10-09 · Le Mao, Andrew H. Liu, Renos Zabounidis, Yanan Niu 외 arxiv

Intelligent exploration remains a critical challenge in reinforcement learning (RL), especially in visual control tasks. Unlike low-dimensional state-based RL, visual RL must extract task-relevant structure from raw pixe…

Reinforcement Learning