paper-with-me

Papers

S3D: Sketch-Driven 3D Model Generation

2025-05-07 · Hail Song, Wonsik Shin, Naeun Lee, Soomin Chung, Nojun Kwak, Woontack Woo

Generating high-quality 3D models from 2D sketches is a challenging task due to the inherent ambiguity and sparsity of sketch data. In this paper, we present S3D, a novel framework that converts simple hand-drawn sketches into detailed 3D models. Our method utilizes a U-Net-based encoder-decoder architecture to convert sketches into face segmentation masks, which are then used to generate a 3D representation that can be rendered from novel views. To ensure robust consistency between the sketch domain and the 3D output, we introduce a novel style-alignment loss that aligns the U-Net bottleneck features with the initial encoder outputs of the 3D generation module, significantly enhancing reconstruction fidelity. To further enhance the network's robustness, we apply augmentation techniques to the sketch dataset. This streamlined framework demonstrates the effectiveness of S3D in generating high-quality 3D models from sketch inputs. The source code for this project is publicly available at https://github.com/hailsong/S3D.

📄 PDF Abstract BibTeX arXiv:2505.04185

Code (1)

hailsong/s3d 공식 구현 pytorch

Tasks

3D GenerationDecodermodel

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

SketchAgent: Language-Driven Sequential Sketch Generation

2024-11-26 · CVPR 2025 1 · Yael Vinker, Tamar Rott Shaham, Kristine Zheng, Alex Zhao 외

Sketching serves as a versatile tool for externalizing ideas, enabling rapid exploration and visual communication that spans various disciplines. While artificial systems have driven substantial advances in content creat…

Vector Graphics

SketchFaceGS: Real-Time Sketch-Driven Face Editing and Generation with Gaussian Splatting

2026-04-21 · Bo Li, Jiahao Kang, Yubo Ma, Feng-Lin Liu 외 arxiv

3D Gaussian representations have emerged as a powerful paradigm for digital head modeling, achieving photorealistic quality with real-time rendering. However, intuitive and interactive creation or editing of 3D Gaussian …

VidSketch: Hand-drawn Sketch-Driven Video Generation with Diffusion Control

2025-02-03 · Lifan Jiang, Shuang Chen, Boxi Wu, Xiaotong Guan 외

With the advancement of generative artificial intelligence, previous studies have achieved the task of generating aesthetic images from hand-drawn sketches, fulfilling the public's needs for drawing. However, these metho…

Video Generation

DrawVideo: Generating Long Video from Storyboard Keyframe Sketches

2026-05-22 · Chuanzhi Xu, Huiqi Liang, Bang Shi, Huiming Zhang 외 arxiv

Long video generation requires high-fidelity synthesis, coherent narrative structure, and user control over extended time spans. Existing text-to-video methods often rely on a single long prompt, limiting control over po…

Video Generation

Sketch2MinSurf: Vision-Language Guided Generation of Editable Minimal Surfaces from Hand-Drawn Sketches

2026-05-20 · Wenda Wang, Anqi Liu, Junqi Yang, Lei He 외 arxiv

Converting hand-drawn sketches into structured 3D geometries remains challenging due to the difficulty of representing non-Euclidean surfaces and maintaining topological consistency. Existing generative models such as GA…