paper-with-me

Papers

CAD-Tokenizer: Towards Text-based CAD Prototyping via Modality-Specific Tokenization

2025-09-25 · Ruiyu Wang, Shizhao Sun, Weijian Ma, Jiang Bian arxiv

Computer-Aided Design (CAD) is a foundational component of industrial prototyping, where models are defined not by raw coordinates but by construction sequences such as sketches and extrusions. This sequential structure enables both efficient prototype initialization and subsequent editing. Text-guided CAD prototyping, which unifies Text-to-CAD generation and CAD editing, has the potential to streamline the entire design pipeline. However, prior work has not explored this setting, largely because standard large language model (LLM) tokenizers decompose CAD sequences into natural-language word pieces, failing to capture primitive-level CAD semantics and hindering attention modules from modeling geometric structure. We conjecture that a multimodal tokenization strategy, aligned with CAD's primitive and structural nature, can provide more effective representations. To this end, we propose CAD-Tokenizer, a framework that represents CAD data with modality-specific tokens using a sequence-based VQ-VAE with primitive-level pooling and constrained decoding. This design produces compact, primitive-aware representations that align with CAD's structural nature. Applied to unified text-guided CAD prototyping, CAD-Tokenizer significantly improves instruction following and generation quality, achieving better quantitative and qualitative performance over both general-purpose LLMs and task-specific baselines.

📄 PDF Abstract BibTeX arXiv:2509.21150

Code (0)

등록된 구현이 없습니다.

Tasks

Instruction Following

Similar Papers 제목 키워드 기반

NeuroRVQ: Multi-Scale Biosignal Tokenization for Generative Foundation Models

2025-10-15 · Konstantinos Barmpas, Na Lee, Dimitrios Chalatsis, William Raftery 외 arxiv

Biosignals such as electroencephalography (EEG), electrocardiography (ECG), and electromyography (EMG) encode physiological activity across multiple temporal and spectral scales, yielding representations that are rich bu…

Multimodal Medical Code Tokenizer

2025-02-06 · Xiaorui Su, Shvat Messica, Yepeng Huang, Ruth Johnson 외

Foundation models trained on patient electronic health records (EHRs) require tokenizing medical data into sequences of discrete vocabulary items. Existing tokenizers treat medical codes from EHRs as isolated textual tok…

KL3M Tokenizers: A Family of Domain-Specific and Character-Level Tokenizers for Legal, Financial, and Preprocessing Applications

2025-03-21 · Michael J Bommarito, Daniel Martin Katz, Jillian Bommarito

We present the KL3M tokenizers, a family of specialized tokenizers for legal, financial, and governmental text. Despite established work on tokenization, specialized tokenizers for professional domains remain understudie…

16k4k8kOptical Character Recognition (OCR)

Qtok: A Comprehensive Framework for Evaluating Multilingual Tokenizer Quality in Large Language Models

2024-10-16 · Iaroslav Chelombitko, Egor Safronov, Aleksey Komissarov

In the development of Large Language Models (LLMs), considerable attention has been given to the quality of training datasets. However, the role of tokenizers in the LLM training pipeline, particularly for multilingual m…

Sub-Character Tokenization for Chinese Pretrained Language Models

2021-06-01 · Chenglei Si, Zhengyan Zhang, Yingfa Chen, Fanchao Qi 외

Tokenization is fundamental to pretrained language models (PLMs). Existing tokenization methods for Chinese PLMs typically treat each character as an indivisible token. However, they ignore the unique feature of the Chin…

Chinese Word SegmentationComputational EfficiencyLanguage ModellingTransliteration