Joint Detection, Tracking and Mapping by Semantic Bundle Adjustment
In this paper we propose a novel Semantic Bundle Adjustment framework whereby known rigid stationary objects are detected while tracking the camera and mapping the environment. The system builds on established tracking and mapping techniques to exploit incremental 3D reconstruction in order to validate hypotheses on the presence and pose of sought objects. Then, detected objects are explicitly taken into account for a global semantic optimization of both camera and object poses. Thus, unlike all systems proposed so far, our approach allows for solving jointly the detection and SLAM problems, so as to achieve object detection together with improved SLAM accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionObjectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAM
We propose SemGauss-SLAM, a dense semantic SLAM system utilizing 3D Gaussian representation, that enables accurate 3D semantic mapping, robust camera tracking, and high-quality rendering simultaneously. In this system, w…
Semantic SegmentationSemantic SLAMTwistSLAM: Constrained SLAM in Dynamic Environment
Classical visual simultaneous localization and mapping (SLAM) algorithms usually assume the environment to be rigid. This assumption limits the applicability of those algorithms as they are unable to accurately estimate …
Object TrackingPose EstimationSimultaneous Localization and MappingCombined tract segmentation and orientation mapping for bundle-specific tractography
While the major white matter tracts are of great interest to numerous studies in neuroscience and medicine, their manual dissection in larger cohorts from diffusion MRI tractograms is time-consuming, requires expert know…
ClusteringDiffusion MRINFL-BA: Improving Endoscopic SLAM with Near-Field Light Bundle Adjustment
Simultaneous Localization And Mapping (SLAM) from a monocular endoscopy video can enable autonomous navigation, guidance to unsurveyed regions, and 3D visualizations, which can significantly improve endoscopy experience …
3DGSAutonomous NavigationSimultaneous Localization and MappingSemi-Dense 3D Semantic Mapping from Monocular SLAM
The bundle of geometry and appearance in computer vision has proven to be a promising solution for robots across a wide variety of applications. Stereo cameras and RGB-D sensors are widely used to realise fast 3D reconst…
3D ReconstructionSemantic Segmentation