LABELMAKER: Automatic Semantic Label Generation from RGB-D Trajectories
Semantic annotations are indispensable to train or evaluate perception models, yet very costly to acquire. This work introduces a fully automated 2D/3D labeling framework that, without any human intervention, can generate labels for RGB-D scans at equal (or better) level of accuracy than comparable manually annotated datasets such as ScanNet. Our approach is based on an ensemble of state-of-the-art segmentation models and 3D lifting through neural rendering. We demonstrate the effectiveness of our LabelMaker pipeline by generating significantly better labels for the ScanNet datasets and automatically labelling the previously unlabeled ARKitScenes dataset. Code and models are available at https://labelmaker.org
Code (1)
Tasks
Neural RenderingSemantic SegmentationSimilar Papers 제목 키워드 기반
ARKit LabelMaker: A New Scale for Indoor 3D Scene Understanding
The performance of neural networks scales with both their size and the amount of data they have been trained on. This is shown in both language and image generation. However, this requires scaling-friendly network archit…
3D Semantic SegmentationImage GenerationScene UnderstandingSemantic SegmentationInterpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysis
We propose using automatically generated natural language definitions of contextualised word usages as interpretable word and word sense representations. Given a collection of usage examples for a target word, and the co…
Language ModelingLanguage ModellingSemantic SimilaritySemantic Textual Similarity+2Automatic Generation of a Lexical Resource to support Semantic Role Labeling in Portuguese
A Semantic Role-based Approach to Open-Domain Automatic Question Generation
We present a novel rule-based system for automatic generation of factual questions from sentences, using semantic role labeling (SRL) as the main form of text analysis. The system is capable of generating both wh-questio…
Dependency ParsingQuestion GenerationQuestion-GenerationReading Comprehension+1Reflection in the Dark: Exposing and Escaping the Black Box in Reflective Prompt Optimization
Automatic prompt optimization (APO) has emerged as a powerful paradigm for improving LLM performance without manual prompt engineering. Reflective APO methods such as GEPA iteratively refine prompts by diagnosing failure…
Prompt Engineering