paper-with-me

Papers

Joint Localization and Planning using Diffusion

2024-09-26 · L. Lao Beyer, S. Karaman

Diffusion models have been successfully applied to robotics problems such as manipulation and vehicle path planning. In this work, we explore their application to end-to-end navigation -- including both perception and planning -- by considering the problem of jointly performing global localization and path planning in known but arbitrary 2D environments. In particular, we introduce a diffusion model which produces collision-free paths in a global reference frame given an egocentric LIDAR scan, an arbitrary map, and a desired goal position. To this end, we implement diffusion in the space of paths in SE(2), and describe how to condition the denoising process on both obstacles and sensor observations. In our evaluation, we show that the proposed conditioning techniques enable generalization to realistic maps of considerably different appearance than the training environment, demonstrate our model's ability to accurately describe ambiguous solutions, and run extensive simulation experiments showcasing our model's use as a real-time, end-to-end localization and planning stack.

📄 PDF Abstract BibTeX arXiv:2409.17995

Code (0)

등록된 구현이 없습니다.

Tasks

Denoising

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

J-LAW: Joint Localization and Actionable World Modeling via Coupled Latent Factor Graphs

2026-06-27 · Guanqun Cao, Liang Chen arxiv

Classical SLAM estimates metric poses and a geometric map but produces no actionable predictive model for planning. Action-conditioned world models learn compact latent dynamics for planning but ignore global metric cons…

UniTeD: Unified Temporal Diffusion for Joint Perception and Planning in Autonomous Driving

2026-06-24 · Bo Zhao, Xinting Zhao, Naifan Li, Erkang Cheng 외 arxiv

Diffusion models have shown strong potential for multi-modal planning in end-to-end autonomous driving. However, most existing methods confine diffusion to the planning module, conditioning on fixed outputs from separate…

Autonomous Driving

Deep Multi-Task Learning for Joint Localization, Perception, and Prediction

2021-01-17 · CVPR 2021 1 · John Phillips, Julieta Martinez, Ioan Andrei Bârsan, Sergio Casas 외

Over the last few years, we have witnessed tremendous progress on many subtasks of autonomous driving, including perception, motion forecasting, and motion planning. However, these systems often assume that the car is ac…

Autonomous DrivingMotion ForecastingMotion PlanningMulti-Task Learning

DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization

2025-08-03 · Siran Peng, Haoyuan Zhang, Li Gao, Tianshuo Zhang 외 arxiv

The rapid evolution of deepfake technologies demands robust and reliable face forgery detection algorithms. While determining whether an image has been manipulated remains essential, the ability to precisely localize for…

Planning as In-Painting: A Diffusion-Based Embodied Task Planning Framework for Environments under Uncertainty

2023-12-02 · Cheng-Fu Yang, Haoyang Xu, Te-Lin Wu, Xiaofeng Gao 외

Task planning for embodied AI has been one of the most challenging problems where the community does not meet a consensus in terms of formulation. In this paper, we aim to tackle this problem with a unified framework con…

DenoisingTask PlanningVision-Language Navigation