Close the Sim2real Gap via Physically-based Structured Light Synthetic Data Simulation
Despite the substantial progress in deep learning, its adoption in industrial robotics projects remains limited, primarily due to challenges in data acquisition and labeling. Previous sim2real approaches using domain randomization require extensive scene and model optimization. To address these issues, we introduce an innovative physically-based structured light simulation system, generating both RGB and physically realistic depth images, surpassing previous dataset generation tools. We create an RGBD dataset tailored for robotic industrial grasping scenarios and evaluate it across various tasks, including object detection, instance segmentation, and embedding sim2real visual perception in industrial robotic grasping. By reducing the sim2real gap and enhancing deep learning training, we facilitate the application of deep learning models in industrial settings. Project details are available at https://baikaixinpublic.github.io/structured light 3D synthesizer/.
Code (0)
등록된 구현이 없습니다.
Tasks
Dataset GenerationDeep LearningInstance SegmentationModel Optimizationobject-detectionObject DetectionRobotic GraspingSemantic SegmentationSimilar Papers 제목 키워드 기반
Blazer: Laser Scanning Simulation using Physically Based Rendering
Line laser scanners are a sub-type of structured light 3D scanners that are relatively common devices to find within the industrial setting, typically in the context of assembly, process control, and welding. Despite its…
Robust Single-shot Structured Light 3D Imaging via Neural Feature Decoding
We consider the problem of active 3D imaging using single-shot structured light systems, which are widely employed in commercial 3D sensing devices such as Apple Face ID and Intel RealSense. Traditional structured light …
Monocular Depth EstimationSynFog: A Photo-realistic Synthetic Fog Dataset based on End-to-end Imaging Simulation for Advancing Real-World Defogging in Autonomous Driving
To advance research in learning-based defogging algorithms, various synthetic fog datasets have been developed. However, existing datasets created using the Atmospheric Scattering Model (ASM) or real-time rendering engin…
Autonomous DrivingPI-Light: Physics-Inspired Diffusion for Full-Image Relighting
Full-image relighting remains a challenging problem due to the difficulty of collecting large-scale structured paired data, the difficulty of maintaining physical plausibility, and the limited generalizability imposed by…
Image RelightingImage EditingPhysically Disentangled Intra- and Inter-Domain Adaptation for Varicolored Haze Removal
Learning-based image dehazing methods have achieved marvelous progress during the past few years. On one hand, most approaches heavily rely on synthetic data and may face difficulties to generalize well in real scene…
Domain AdaptationImage Dehazing