paper-with-me

Papers

Event-based Motion-Robust Accurate Shape Estimation for Mixed Reflectance Scenes

2023-11-16 · Aniket Dashpute, Jiazhang Wang, James Taylor, Oliver Cossairt, Ashok Veeraraghavan, Florian Willomitzer

Event-based structured light systems have recently been introduced as an exciting alternative to conventional frame-based triangulation systems for the 3D measurements of diffuse surfaces. Important benefits include the fast capture speed and the high dynamic range provided by the event camera - albeit at the cost of lower data quality. So far, both low-accuracy event-based and high-accuracy frame-based 3D imaging systems are tailored to a specific surface type, such as diffuse or specular, and can not be used for a broader class of object surfaces ("mixed reflectance scenes"). In this work, we present a novel event-based structured light system that enables fast 3D imaging of mixed reflectance scenes with high accuracy. On the captured events, we use epipolar constraints that intrinsically enable decomposing the measured reflections into diffuse, two-bounce specular, and other multi-bounce reflections. The diffuse surfaces in the scene are reconstructed using triangulation. Then, the reconstructed diffuse scene parts are leveraged as a "display" to evaluate the specular scene parts via deflectometry. This novel procedure allows us to use the entire scene as a virtual screen, using only a scanning laser and an event camera. The resulting system achieves fast and motion-robust (14Hz) reconstructions of mixed reflectance scenes with < 600 ${\mu}m$ depth error. Moreover, we introduce an "ultrafast" capture mode (250Hz) for the 3D measurement of diffuse scenes.

📄 PDF Abstract BibTeX arXiv:2311.09652

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

EventHPE: Event-based 3D Human Pose and Shape Estimation

2021-08-15 · ICCV 2021 10 · Shihao Zou, Chuan Guo, Xinxin Zuo, Sen Wang 외

Event camera is an emerging imaging sensor for capturing dynamics of moving objects as events, which motivates our work in estimating 3D human pose and shape from the event signals. Events, on the other hand, have their …

3D human pose and shape estimationOptical Flow Estimation

Event-based Egocentric Human Pose Estimation in Dynamic Environment

2025-05-28 · Wataru Ikeda, Masashi Hatano, Ryosei Hara, Mariko Isogawa

Estimating human pose using a front-facing egocentric camera is essential for applications such as sports motion analysis, VR/AR, and AI for wearable devices. However, many existing methods rely on RGB cameras and do not…

Head Pose EstimationMotion SegmentationPose Estimation

Asynchronous Blob Tracker for Event Cameras

2023-07-20 · Ziwei Wang, Timothy Molloy, Pieter van Goor, Robert Mahony

Event-based cameras are popular for tracking fast-moving objects due to their high temporal resolution, low latency, and high dynamic range. In this paper, we propose a novel algorithm for tracking event blobs using raw …

Autonomous DrivingCollision Avoidance

SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation

2026-03-10 · Milo Carroll, Tianhu Peng, Lingfan Bao, Chengxu Zhou 외 arxiv

Distilling humanoid locomotion control from offline datasets into deployable policies remains a challenge, as existing methods rely on privileged full-body states that require complex and often unreliable state estimatio…

VIBE: Video Inference for Human Body Pose and Shape Estimation

2019-12-11 · CVPR 2020 6 · Muhammed Kocabas, Nikos Athanasiou, Michael J. Black

Human motion is fundamental to understanding behavior. Despite progress on single-image 3D pose and shape estimation, existing video-based state-of-the-art methods fail to produce accurate and natural motion sequences du…

3D Human Pose Estimation3D Pose Estimation3D Shape ReconstructionMonocular 3D Human Pose Estimation+1