paper-with-me

홈 › Papers

DA-RNN: Semantic Mapping with Data Associated Recurrent Neural Networks

2017-03-09 · Yu Xiang, Dieter Fox

3D scene understanding is important for robots to interact with the 3D world in a meaningful way. Most previous works on 3D scene understanding focus on recognizing geometrical or semantic properties of the scene independently. In this work, we introduce Data Associated Recurrent Neural Networks (DA-RNNs), a novel framework for joint 3D scene mapping and semantic labeling. DA-RNNs use a new recurrent neural network architecture for semantic labeling on RGB-D videos. The output of the network is integrated with mapping techniques such as KinectFusion in order to inject semantic information into the reconstructed 3D scene. Experiments conducted on a real world dataset and a synthetic dataset with RGB-D videos demonstrate the ability of our method in semantic 3D scene mapping.

📄 PDF Abstract BibTeX arXiv:1703.03098

Code (1)

hz-ants/DA-RNN tf

Tasks

Scene Understanding

Similar Papers 제목 키워드 기반

Recurrent-OctoMap: Learning State-based Map Refinement for Long-Term Semantic Mapping with 3D-Lidar Data

2018-07-02 · Li Sun, Zhi Yan, Anestis Zaganidis, Cheng Zhao 외

This paper presents a novel semantic mapping approach, Recurrent-OctoMap, learned from long-term 3D Lidar data. Most existing semantic mapping approaches focus on improving semantic understanding of single frames, rather…

LatentBKI: Open-Dictionary Continuous Mapping in Visual-Language Latent Spaces with Quantifiable Uncertainty

2024-10-15 · Joey Wilson, Ruihan Xu, Yile Sun, Parker Ewen 외

This paper introduces a novel probabilistic mapping algorithm, LatentBKI, which enables open-vocabulary mapping with quantifiable uncertainty. Traditionally, semantic mapping algorithms focus on a fixed set of semantic c…

Learning a Recurrent Visual Representation for Image Caption Generation

2014-11-20 · Xinlei Chen, C. Lawrence Zitnick

In this paper we explore the bi-directional mapping between images and their sentence-based descriptions. We propose learning this mapping using a recurrent neural network. Unlike previous approaches that map both senten…

Caption GenerationImage RetrievalRetrievalSentence+1

Ask the GRU: Multi-Task Learning for Deep Text Recommendations

2016-09-07 · Trapit Bansal, David Belanger, Andrew McCallum

In a variety of application domains the content to be recommended to users is associated with text. This includes research papers, movies with associated plot summaries, news articles, blog posts, etc. Recommendation app…

ArticlesCollaborative FilteringMulti-Task LearningTopic Models+1

An Online Semantic Mapping System for Extending and Enhancing Visual SLAM

2022-03-08 · Thorsten Hempel, Ayoub Al-Hamadi

We present a real-time semantic mapping approach for mobile vision systems with a 2D to 3D object detection pipeline and rapid data association for generated landmarks. Besides the semantic map enrichment the associated …

3D Object DetectionObjectobject-detectionObject Detection+3