LUDO: Low-Latency Understanding of Deformable Objects using Point Cloud Occupancy Functions
Accurately determining the shape of objects and the location of their internal structures within deformable objects is crucial for medical tasks that require precise targeting, such as robotic biopsies. We introduce LUDO, a method for accurate low-latency understanding of deformable objects. LUDO reconstructs objects in their deformed state, including their internal structures, from a single-view point cloud observation in under 30 ms using occupancy networks. LUDO provides uncertainty estimates for its predictions. Additionally, it provides explainability by highlighting key features in its input observations. Both uncertainty and explainability are important for safety-critical applications such as surgical interventions. We demonstrate LUDO's abilities for autonomous targeting of internal regions of interest (ROIs) in deformable objects. We evaluate LUDO in real-world robotic experiments, achieving a success rate of 98.9% for puncturing various ROIs inside deformable objects. LUDO demonstrates the potential to interact with deformable objects without the need for deformable registration methods.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Ludo management system project report
OpenGL is a library for doing computer graphics.By using it, we can create interactive applications which render high-quality color images composed of 3D geometric objects and images. OpenGL is window and operating syste…
ManagementLudo management system project report.
OpenGL is a library for doing computer graphics.By using it, we can create interactive applications which render high-quality color images composed of 3D geometric objects and images. OpenGL is window and operating syste…
Management3D Understanding of Deformable Linear Objects: Datasets and Transferability Benchmark
Deformable linear objects are vastly represented in our everyday lives. It is often challenging even for humans to visually understand them, as the same object can be entangled so that it appears completely different. Ex…
ObjectAGAR: Attention Graph-RNN for Adaptative Motion Prediction of Point Clouds of Deformable Objects
This paper focuses on motion prediction for point cloud sequences in the challenging case of deformable 3D objects, such as human body motion. First, we investigate the challenges caused by deformable shapes and complex …
Action Recognitionmotion predictionLUDOBENCH: Evaluating LLM Behavioural Decision-Making Through Spot-Based Board Game Scenarios in Ludo
We introduce LudoBench, a benchmark for evaluating LLM strategic reasoning in Ludo, a stochastic multi-agent board game whose dice mechanics, piece capture, safe-square navigation, and home-path progression introduce mea…