paper-with-me

홈 › Papers

Text-to-CAD Retrieval: a Strong Baseline

2026-05-07 · Honghu Pan, Zibo Du, Daxiang Liu, Chengliang Liu, Xiaoling Luo arxiv

Text-based retrieval of Computer-Aided Design (CAD) models is a critical yet underexplored task for the reuse of legacy industrial designs. Existing CAD repositories are typically searched using filenames or directories, which limits the efficiency, scalability, and accuracy of design retrieval. In this paper, we formally introduce text-to-CAD retrieval as a new cross-modal retrieval task, aiming to retrieve semantically relevant CAD models from large-scale databases given natural language queries. Leveraging paired text-CAD annotations from the Text2CAD dataset, we establish a practical benchmark for this task. To achieve text-based retrieval, we propose a unified framework that learns multi-modal CAD embeddings from both procedural sequences and geometric point clouds. Specifically, a sequence encoder captures the construction logic of CAD models, while a point encoder extracts explicit geometric features. A text encoder is used to learn semantic representations of textual queries. During training, we introduce a novel feature decoder that reconstructs masked sequence features via cross-attention with text and point features, encouraging implicit multi-modal alignment. At inference time, we remove this auxiliary decoder to enable efficient retrieval using concatenated sequence-point features. Our framework serves as a strong baseline for text-to-CAD retrieval and lays the foundation for downstream CAD generation paradigms, such as retrieval-augmented generation. The source code will be released.

📄 PDF Abstract BibTeX arXiv:2605.05572

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language QueriesCross-Modal RetrievalPoint Clouds

Similar Papers 제목 키워드 기반

ConceptFormer: Learning Adaptive Latent Concepts for Query-Document Alignment in Visual Document Retrieval

2026-08-16 · Peng Chunyi, Xu Zhipeng, Yan Yukun, Liu Zhenghao 외 hf

Visual document retrieval is a critical component of multimodal retrieval-augmented generation, aiming to identify query-relevant pages from document collections where evidence is distributed across text, layout, charts,…

Representation LearningText Retrieval

Learning text-to-video retrieval from image captioning

2024-04-26 · Lucas Ventura, Cordelia Schmid, Gül Varol

We describe a protocol to study text-to-video retrieval training with unlabeled videos, where we assume (i) no access to labels for any videos, i.e., no access to the set of ground-truth captions, but (ii) access to labe…

Image CaptioningImage RetrievalRetrievalText to Video Retrieval+2

Establishing Strong Baselines for TripClick Health Retrieval

2022-01-02 · Sebastian Hofstätter, Sophia Althammer, Mete Sertkan, Allan Hanbury

We present strong Transformer-based re-ranking and dense retrieval baselines for the recently released TripClick health ad-hoc retrieval collection. We improve the - originally too noisy - training data with a simple neg…

Re-RankingRetrieval

Exploiting Semantic Role Contextualized Video Features for Multi-Instance Text-Video Retrieval EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022

2022-06-29 · Burak Satar, Hongyuan Zhu, Hanwang Zhang, Joo Hwee Lim

In this report, we present our approach for EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022. We first parse sentences into semantic roles corresponding to verbs and nouns; then utilize self-attentions to exploi…

Multi-Instance RetrievalRetrievalSemantic SimilaritySemantic Textual Similarity+2

CORAL: Adaptive Retrieval Loop for Culturally-Aligned Multilingual RAG

2026-04-28 · Nayeon Lee, Jiwoo Song, Byeongcheol Kang arxiv

Multilingual retrieval-augmented generation (mRAG) is often implemented within a fixed retrieval space, typically via query or document translation or multilingual embedding vector representations. However, this approach…