Papers 3D dense captioning
“3D dense captioning” 태그가 달린 논문 33편 · 필터 해제
3D-Aware VLMs with Implicit and Explicit Geometries
Despite rapid progress, most existing vision-language models (VLMs) built from 2D visual inputs often struggle when handling various 3D tasks that require fine-grained spatial understanding and reasoning. To bridge this …
3D dense captioningSpatial ReasoningVisual GroundingPVCap: Towards Accurate 3D Dense Captioning via PseudoCap and VoxelCapNet
3D dense captioning, an emerging vision-language task, aims to generate descriptive sentences for each object in the 3D scene. Despite the impressive results achieved by previous methods, they suffer from two limitations…
3D dense captioningData AugmentationOcc-VLM: Occupancy Grounded Vision Language Model for Indoor Scene Understanding
Recently, vision-language models (VLMs) have made significant progress in 3D scene understanding, driving advances in applications such as embodied intelligence and robotic vision. However, existing approaches typically …
Visual Question Answering3D dense captioningScene UnderstandingPoint CloudsGAP-MLLM: Geometry-Aligned Pre-training for Activating 3D Spatial Perception in Multimodal Large Language Models
Multimodal Large Language Models (MLLMs) demonstrate exceptional semantic reasoning but struggle with 3D spatial perception when restricted to pure RGB inputs. Despite leveraging implicit geometric priors from 3D reconst…
Video Object Detection3D dense captioning3D ReconstructionVisual GroundingScenes as Tokens: Multi-Scale Normal Distributions Transform Tokenizer for General 3D Vision-Language Understanding
Recent advances in 3D vision-language models (VLMs) highlight a strong potential for 3D scene understanding and reasoning. However, effectively tokenizing 3D scenes into holistic scene tokens, and leveraging these tokens…
Visual Question Answering3D dense captioningScene UnderstandingPoint CloudsVid-LLM: A Compact Video-based 3D Multimodal LLM with Reconstruction-Reasoning Synergy
Recent developments in Multimodal Large Language Models (MLLMs) have significantly improved Vision-Language (VL) reasoning in 2D domains. However, extending these capabilities to 3D scene understanding remains a major ch…
3D dense captioningScene UnderstandingQuestion AnsweringVisual GroundingAdvancing 3D Scene Understanding with MV-ScanQA Multi-View Reasoning Evaluation and TripAlign Pre-training Dataset
The advancement of 3D vision-language (3D VL) learning is hindered by several limitations in existing 3D VL datasets: they rarely necessitate reasoning beyond a close range of objects in single viewpoint, and annotations…
3D dense captioningScene UnderstandingQuestion Answering3D CoCa: Contrastive Learners are 3D Captioners
3D captioning, which aims to describe the content of 3D scenes in natural language, remains highly challenging due to the inherent sparsity of point clouds and weak cross-modal alignment in existing methods. To address t…
3D dense captioningCaption Generationcross-modal alignmentDecoder+23D Spatial Understanding in MLLMs: Disambiguation and Evaluation
Multimodal Large Language Models (MLLMs) have made significant progress in tasks such as image captioning and question answering. However, while these models can generate realistic captions, they often struggle with prov…
3D dense captioning3D visual groundingDense CaptioningImage Captioning+53D Scene Graph Guided Vision-Language Pre-training
3D vision-language (VL) reasoning has gained significant attention due to its potential to bridge the 3D physical world with natural language descriptions. Existing approaches typically follow task-specific, highly speci…
3D dense captioning3D visual groundingContrastive LearningDense Captioning+2MARVEL-40M+: Multi-Level Visual Elaboration for High-Fidelity Text-to-3D Content Creation
Generating high-fidelity 3D content from text prompts remains a significant challenge in computer vision due to the limited size, diversity, and annotation depth of the existing datasets. To address this, we introduce MA…
3D dense captioning3D Object Captioning3D ReconstructionDiversity+2Hint-AD: Holistically Aligned Interpretability in End-to-End Autonomous Driving
End-to-end architectures in autonomous driving (AD) face a significant challenge in interpretability, impeding human-AI trust. Human-friendly natural language has been explored for tasks such as driving explanation and 3…
3D dense captioningAutonomous DrivingDense CaptioningSee It All: Contextualized Late Aggregation for 3D Dense Captioning
3D dense captioning is a task to localize objects in a 3D scene and generate descriptive sentences for each object. Recent approaches in 3D dense captioning have adopted transformer encoder-decoder frameworks from object…
3D dense captioningAllAttributeCaption Generation+6Bi-directional Contextual Attention for 3D Dense Captioning
3D dense captioning is a task involving the localization of objects and the generation of descriptions for each object in a 3D scene. Recent approaches have attempted to incorporate contextual information by modeling rel…
3D dense captioningAttributeCaption GenerationDense Captioning+1Complete 3d relationships extraction modality alignment network for 3d dense captioning
3D dense captioning aims to semantically describe each object detected in a 3D scene, which plays a significant role in 3D scene understanding. Previous works lack a complete definition of 3D spatial relationships and th…
3D dense captioning3D Object DetectionDense Captioningobject-detection+2Rethinking 3D Dense Caption and Visual Grounding in A Unified Framework through Prompt-based Localization
3D Visual Grounding (3DVG) and 3D Dense Captioning (3DDC) are two crucial tasks in various 3D applications, which require both shared and complementary information in localization and visual-language relationships. There…
3D dense captioning3D visual groundingDense CaptioningVisual GroundingTOD3Cap: Towards 3D Dense Captioning in Outdoor Scenes
3D dense captioning stands as a cornerstone in achieving a comprehensive understanding of 3D scenes through natural language. It has recently witnessed remarkable achievements, particularly in indoor settings. However, t…
3D dense captioningDense CaptioningA Comprehensive Survey of 3D Dense Captioning: Localizing and Describing Objects in 3D Scenes
Three-Dimensional (3D) dense captioning is an emerging vision-language bridging task that aims to generate multiple detailed and accurate descriptions for 3D scenes. It presents significant potential and challenges due t…
3D dense captioningDense CaptioningImage CaptioningLL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding Reasoning and Planning
Recent progress in Large Multimodal Models (LMM) has opened up great possibilities for various applications in the field of human-machine interactions. However developing LMMs that can comprehend reason and plan in c…
3D dense captioningDense CaptioningQuestion AnsweringLL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning
Recent advances in Large Multimodal Models (LMM) have made it possible for various applications in human-machine interactions. However, developing LMMs that can comprehend, reason, and plan in complex and diverse 3D envi…
3D dense captioningDense CaptioningQuestion Answering