Sim2Real Instance-Level Style Transfer for 6D Pose Estimation
In recent years, synthetic data has been widely used in the training of 6D pose estimation networks, in part because it automatically provides perfect annotation at low cost. However, there are still non-trivial domain gaps, such as differences in textures/materials, between synthetic and real data. These gaps have a measurable impact on performance. To solve this problem, we introduce a simulation to reality (sim2real) instance-level style transfer for 6D pose estimation network training. Our approach transfers the style of target objects individually, from synthetic to real, without human intervention. This improves the quality of synthetic data for training pose estimation networks. We also propose a complete pipeline from data collection to the training of a pose estimation network and conduct extensive evaluation on a real-world robotic platform. Our evaluation shows significant improvement achieved by our method in both pose estimation performance and the realism of images adapted by the style transfer.
Code (0)
등록된 구현이 없습니다.
Tasks
6D Pose EstimationPose EstimationStyle TransferSimilar Papers 제목 키워드 기반
SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer
Recent advancements in neural representations, such as Neural Radiance Fields and 3D Gaussian Splatting, have increased interest in applying style transfer to 3D scenes. While existing methods can transfer style patterns…
Style TransferA Method for Arbitrary Instance Style Transfer
The ability to synthesize style and content of different images to form a visually coherent image holds great promise in various applications such as stylistic painting, design prototyping, image editing, and augmented r…
Style TransferReStyle3D: Scene-Level Appearance Transfer with Semantic Correspondences
We introduce ReStyle3D, a novel framework for scene-level appearance transfer from a single style image to a real-world scene represented by multiple views. The method combines explicit semantic correspondences with mult…
Appearance TransferSETTP: Style Extraction and Tunable Inference via Dual-level Transferable Prompt Learning
Text style transfer, an important research direction in natural language processing, aims to adapt the text to various preferences but often faces challenges with limited resources. In this work, we introduce a novel met…
Prompt LearningStyle TransferText Style TransferUniversal Photorealistic Style Transfer: A Lightweight and Adaptive Approach
Photorealistic style transfer aims to apply stylization while preserving the realism and structure of input content. However, existing methods often encounter challenges such as color tone distortions, dependency on pair…
GPUStyle TransferSuper-ResolutionVideo Style Transfer