Specification-Guided Data Aggregation for Semantically Aware Imitation Learning
Advancements in simulation and formal methods-guided environment sampling have enabled the rigorous evaluation of machine learning models in a number of safety-critical scenarios, such as autonomous driving. Application of these environment sampling techniques towards improving the learned models themselves has yet to be fully exploited. In this work, we introduce a novel method for improving imitation-learned models in a semantically aware fashion by leveraging specification-guided sampling techniques as a means of aggregating expert data in new environments. Specifically, we create a set of formal specifications as a means of partitioning the space of possible environments into semantically similar regions, and identify elements of this partition where our learned imitation behaves most differently from the expert. We then aggregate expert data on environments in these identified regions, leading to more accurate imitation of the expert's behavior semantics. We instantiate our approach in a series of experiments in the CARLA driving simulator, and demonstrate that our approach leads to models that are more accurate than those learned with other environment sampling methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingImitation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Human-Guided Fair Classification for Natural Language Processing
Text classifiers have promising applications in high-stake tasks such as resume screening and content moderation. These classifiers must be fair and avoid discriminatory decisions by being invariant to perturbations of s…
ClassificationFairnessStyle TransferSpecification-Aware Machine Translation and Evaluation for Purpose Alignment
In professional settings, translation is guided by communicative goals and client needs, often formalized as specifications. While existing evaluation frameworks acknowledge the importance of such specifications, these s…
Machine TranslationComparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment
The rapid advancement of generative models has led to a growing volume of AI-generated videos, making the automatic quality assessment of such videos increasingly important. Existing AI-generated content video quality as…
Video Quality AssessmentTVTA: Trajectory-Aware Viseme-Guided Temporal Aggregation for Event-Based Lip Reading
Event-based lip reading has recently emerged as a promising direction for visual speech recognition, benefiting from the high temporal resolution and motion sensitivity of event cameras. However, existing methods typical…
Visual Speech RecognitionLip ReadingImproving LLM Reasoning with Homophily-aware Structural and Semantic Text-Attributed Graph Compression
Large language models (LLMs) have demonstrated promising capabilities in Text-Attributed Graph (TAG) understanding. Recent studies typically focus on verbalizing the graph structures via handcrafted prompts, feeding the …