paper-with-me

홈 › Papers

3D Ground Truth Reconstruction from Multi-Camera Annotations Using UKF

2025-11-18 · Linh Van Ma, Unse Fatima, Tepy Sokun Chriv, Haroon Imran, Moongu Jeon arxiv

Accurate 3D ground truth estimation is critical for applications such as autonomous navigation, surveillance, and robotics. This paper introduces a novel method that uses an Unscented Kalman Filter (UKF) to fuse 2D bounding box or pose keypoint ground truth annotations from multiple calibrated cameras into accurate 3D ground truth. By leveraging human-annotated ground-truth 2D, our proposed method, a multi-camera single-object tracking algorithm, transforms 2D image coordinates into robust 3D world coordinates through homography-based projection and UKF-based fusion. Our proposed algorithm processes multi-view data to estimate object positions and shapes while effectively handling challenges such as occlusion. We evaluate our method on the CMC, Wildtrack, and Panoptic datasets, demonstrating high accuracy in 3D localization compared to the available 3D ground truth. Unlike existing approaches that provide only ground-plane information, our method also outputs the full 3D shape of each object. Additionally, the algorithm offers a scalable and fully automatic solution for multi-camera systems using only 2D image annotations.

📄 PDF Abstract BibTeX arXiv:2511.17609

Code (0)

등록된 구현이 없습니다.

Tasks

Object Tracking

Similar Papers 제목 키워드 기반

Object Reprojection Error (ORE): Camera pose benchmarks from lightweight tracking annotations

2023-09-26 · NeurIPS 2023 11

3D spatial understanding is highly valuable in the context of semantic modeling of environments, agents, and their relationships. Semantic modeling approaches employed on monocular video often ingest outputs from off-th…

Syn4D: A Multiview Synthetic 4D Dataset

2026-05-06 · Zeren Jiang, Yushi Lan, Yihang Luo, Yufan Deng 외 arxiv

Dense 3D reconstruction and tracking of dynamic scenes from monocular video remains an important open challenge in computer vision. Progress in this area has been constrained by the scarcity of high-quality datasets with…

Scene Understanding3D ReconstructionPose EstimationPoint Tracking

Shape and Viewpoint without Keypoints

2020-07-21 · ECCV 2020 8 · Shubham Goel, Angjoo Kanazawa, Jitendra Malik

We present a learning framework that learns to recover the 3D shape, pose and texture from a single image, trained on an image collection without any ground truth 3D shape, multi-view, camera viewpoints or keypoint super…

MonoNeRF: Learning Generalizable NeRFs from Monocular Videos without Camera Pose

2022-10-13 · Yang Fu, Ishan Misra, Xiaolong Wang

We propose a generalizable neural radiance fields - MonoNeRF, that can be trained on large-scale monocular videos of moving in static scenes without any ground-truth annotations of depth and camera poses. MonoNeRF follow…

Camera Pose EstimationDecoderDepth EstimationDisentanglement+3

NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotations

2023-09-26 · NeurIPS 2023 11

Recent advances in neural reconstruction enable high-quality 3D object reconstruction from casually captured image collections. Current techniques mostly analyze their progress on relatively simple image collections wher…