paper-with-me

홈 › Papers

PICCOLO: Point Cloud-Centric Omnidirectional Localization

2021-08-14 · ICCV 2021 10 · Junho Kim, Changwoon Choi, Hojun Jang, Young Min Kim

We present PICCOLO, a simple and efficient algorithm for omnidirectional localization. Given a colored point cloud and a 360 panorama image of a scene, our objective is to recover the camera pose at which the panorama image is taken. Our pipeline works in an off-the-shelf manner with a single image given as a query and does not require any training of neural networks or collecting ground-truth poses of images. Instead, we match each point cloud color to the holistic view of the panorama image with gradient-descent optimization to find the camera pose. Our loss function, called sampling loss, is point cloud-centric, evaluated at the projected location of every point in the point cloud. In contrast, conventional photometric loss is image-centric, comparing colors at each pixel location. With a simple change in the compared entities, sampling loss effectively overcomes the severe visual distortion of omnidirectional images, and enjoys the global context of the 360 view to handle challenging scenarios for visual localization. PICCOLO outperforms existing omnidirectional localization algorithms in both accuracy and stability when evaluated in various environments. Code is available at \url{https://github.com/82magnolia/panoramic-localization/}.

📄 PDF Abstract BibTeX arXiv:2108.06545

Code (2)

82magnolia/panoramic-localization 공식 구현 pytorch
82magnolia/piccolo 공식 구현 pytorch

Tasks

Visual Localization

Similar Papers 제목 키워드 기반

Egocentric Action-aware Inertial Localization in Point Clouds

2025-05-20 · Mingfang Zhang, Ryo Yonetani, Yifei HUANG, Liangyang Ouyang 외

This paper presents a novel inertial localization framework named Egocentric Action-aware Inertial Localization (EAIL), which leverages egocentric action cues from head-mounted IMU signals to localize the target individu…

Action Recognition

Efficient Privacy-Preserving Visual Localization Using 3D Ray Clouds

2024-01-01 · CVPR 2024 1 · Heejoon Moon, Chunghwan Lee, Je Hyeong Hong

The recent success in revealing scene details from sparse 3D point clouds obtained via structure-from-motion has raised significant privacy concerns in visual localization. One prominent approach for mitigating this …

Camera LocalizationPose EstimationPrivacy PreservingVisual Localization

Beyond Localization: A Comprehensive Diagnosis of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Images

2026-05-12 · Yuangong Chen, Wai Keung Wong, Jiaxing Li, Ioannis Patras 외 arxiv

Multimodal Large Language Models (MLLMs) show strong visual perception, yet remain limited in reasoning about space under changing viewpoints. We study this challenge as Perspective-Conditioned Spatial Reasoning (PCSR) i…

Spatial ReasoningObject Counting

EgoNN: Egocentric Neural Network for Point Cloud Based 6DoF Relocalization at the City Scale

2021-10-24 · Jacek Komorowski, Monika Wysoczanska, Tomasz Trzcinski

The paper presents a deep neural network-based method for global and local descriptors extraction from a point cloud acquired by a rotating 3D LiDAR. The descriptors can be used for two-stage 6DoF relocalization. First, …

Position

Piccolo2: General Text Embedding with Multi-task Hybrid Loss Training

2024-05-11 · Junqin Huang, Zhongjie Hu, Zihao Jing, Mengya Gao 외

In this report, we introduce Piccolo2, an embedding model that surpasses other models in the comprehensive evaluation over 6 tasks on CMTEB benchmark, setting a new state-of-the-art. Piccolo2 primarily leverages an effic…