paper-with-me

Papers

FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Models

2024-11-05 · Zhanwei Zhang, Shizhao Sun, Wenxiao Wang, Deng Cai, Jiang Bian

Recently, there is a growing interest in creating computer-aided design (CAD) models based on user intent, known as controllable CAD generation. Existing work offers limited controllability and needs separate models for different types of control, reducing efficiency and practicality. To achieve controllable generation across all CAD construction hierarchies, such as sketch-extrusion, extrusion, sketch, face, loop and curve, we propose FlexCAD, a unified model by fine-tuning large language models (LLMs). First, to enhance comprehension by LLMs, we represent a CAD model as a structured text by abstracting each hierarchy as a sequence of text tokens. Second, to address various controllable generation tasks in a unified model, we introduce a hierarchy-aware masking strategy. Specifically, during training, we mask a hierarchy-aware field in the CAD text with a mask token. This field, composed of a sequence of tokens, can be set flexibly to represent various hierarchies. Subsequently, we ask LLMs to predict this masked field. During inference, the user intent is converted into a CAD text with a mask token replacing the part the user wants to modify, which is then fed into FlexCAD to generate new CAD models. Comprehensive experiments on public dataset demonstrate the effectiveness of FlexCAD in both generation quality and controllability. Code will be available at https://github.com/microsoft/FlexCAD.

📄 PDF Abstract BibTeX arXiv:2411.05823

Code (1)

microsoft/flexcad 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

UniGP: Taming Diffusion Transformer for Prior-Preserved Unified Generation and Perception

2026-06-29 · Qin Guo, Hao Luo, Dongxu Yue, Weixuan Jin 외 arxiv

Recent advances in diffusion models have shown impressive performance in controllable image generation and dense prediction tasks. However, existing approaches typically treat diffusion-based controllable generation and …

Image Generation

LiDARDraft: Generating LiDAR Point Cloud from Versatile Inputs

2025-12-23 · Haiyun Wei, Fan Lu, Yunwei Zhu, Zehan Zheng 외 arxiv

Generating realistic and diverse LiDAR point clouds is crucial for autonomous driving simulation. Although previous methods achieve LiDAR point cloud generation from user inputs, they struggle to attain high-quality resu…

Point Cloud GenerationAutonomous DrivingPoint Clouds

MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation

2023-02-16 · Omer Bar-Tal, Lior Yariv, Yaron Lipman, Tali Dekel

Recent advances in text-to-image generation with diffusion models present transformative capabilities in image quality. However, user controllability of the generated image, and fast adaptation to new tasks still remains…

Image GenerationText to Image GenerationText-to-Image Generation

FoleyGenEx: Unified Video-to-Audio Generation with Multi-Modal Control, Temporal Alignment, and Semantic Precision

2026-06-12 · Shiyao Wang, Xijuan Zeng, Hui Wang, Shiwan Zhao 외 arxiv

We present FoleyGenEx, a unified video-to-audio (VTA) framework integrating multi-modal control, frame-level temporal alignment, and fine-grained semantics, enabling synchronized, versatile audio synthesis for diverse ta…

Data AugmentationAudio Generation

Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraining

2024-08-05 · Dongyang Liu, Shitian Zhao, Le Zhuo, Weifeng Lin 외

We present Lumina-mGPT, a family of multimodal autoregressive models capable of various vision and language tasks, particularly excelling in generating flexible photorealistic images from text descriptions. By initializi…

DecoderDepth EstimationImage GenerationQuestion Answering+3