Label-Free Supervision of Neural Networks with Physics and Domain Knowledge
In many machine learning applications, labeled data is scarce and obtaining more labels is expensive. We introduce a new approach to supervising neural networks by specifying constraints that should hold over the output space, rather than direct examples of input-output pairs. These constraints are derived from prior domain knowledge, e.g., from known laws of physics. We demonstrate the effectiveness of this approach on real world and simulated computer vision tasks. We are able to train a convolutional neural network to detect and track objects without any labeled examples. Our approach can significantly reduce the need for labeled training data, but introduces new challenges for encoding prior knowledge into appropriate loss functions.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
DAM: Dual Active Learning with Multimodal Foundation Model for Source-Free Domain Adaptation
Source-free active domain adaptation (SFADA) enhances knowledge transfer from a source model to an unlabeled target domain using limited manual labels selected via active learning. While recent domain adaptation studies …
Source-Free Domain AdaptationActive LearningLabel-Free Distant Supervision for Relation Extraction via Knowledge Graph Embedding
Distant supervision is an effective method to generate large scale labeled data for relation extraction, which assumes that if a pair of entities appears in some relation of a Knowledge Graph (KG), all sentences containi…
Graph EmbeddingKnowledge Graph EmbeddingRelationRelation Extraction+2Learning Across Domains and Devices: Style-Driven Source-Free Domain Adaptation in Clustered Federated Learning
Federated Learning (FL) has recently emerged as a possible way to tackle the domain shift in real-world Semantic Segmentation (SS) without compromising the private nature of the collected data. However, most of the exist…
Autonomous DrivingDomain AdaptationFederated LearningSemantic Segmentation+1Zero-Annotation Object Detection with Web Knowledge Transfer
Object detection is one of the major problems in computer vision, and has been extensively studied. Most of the existing detection works rely on labor-intensive supervision, such as ground truth bounding boxes of objects…
Domain AdaptationObjectobject-detectionObject Detection+1Learning to Exploit Stability for 3D Scene Parsing
Human scene understanding uses a variety of visual and non-visual cues to perform inference on object types, poses, and relations. Physics is a rich and universal cue which we exploit to enhance scene understanding. We i…
Scene ParsingScene UnderstandingTranslation