paper-with-me

홈 › Papers

Query2CAD: Generating CAD models using natural language queries

2024-05-31 · Akshay Badagabettu, Sai Sravan Yarlagadda, Amir Barati Farimani

Computer Aided Design (CAD) engineers typically do not achieve their best prototypes in a single attempt. Instead, they iterate and refine their designs to achieve an optimal solution through multiple revisions. This traditional approach, though effective, is time-consuming and relies heavily on the expertise of skilled engineers. To address these challenges, we introduce Query2CAD, a novel framework to generate CAD designs. The framework uses a large language model to generate executable CAD macros. Additionally, Query2CAD refines the generation of the CAD model with the help of its self-refinement loops. Query2CAD operates without supervised data or additional training, using the LLM as both a generator and a refiner. The refiner leverages feedback generated by the BLIP2 model, and to address false negatives, we have incorporated human-in-the-loop feedback into our system. Additionally, we have developed a dataset that encompasses most operations used in CAD model designing and have evaluated our framework using this dataset. Our findings reveal that when we used GPT-4 Turbo as our language model, the architecture achieved a success rate of 53.6\% on the first attempt. With subsequent refinements, the success rate increased by 23.1\%. In particular, the most significant improvement in the success rate was observed with the first iteration of the refinement. With subsequent refinements, the accuracy of the correct designs did not improve significantly. We have open-sourced our data, model, and code (github.com/akshay140601/Query2CAD).

📄 PDF Abstract BibTeX arXiv:2406.00144

Code (1)

akshay140601/query2cad 공식 구현

Tasks

Language ModelingLanguage ModellingLarge Language ModelNatural Language Queries

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Text-to-OverpassQL: A Natural Language Interface for Complex Geodata Querying of OpenStreetMap

2023-08-30 · Michael Staniek, Raphael Schumann, Maike Züfle, Stefan Riezler

We present Text-to-OverpassQL, a task designed to facilitate a natural language interface for querying geodata from OpenStreetMap (OSM). The Overpass Query Language (OverpassQL) allows users to formulate complex database…

Prompting Large Language Models to Reformulate Queries for Moment Localization

2023-06-06 · Wenfeng Yan, Shaoxiang Chen, Zuxuan Wu, Yu-Gang Jiang

The task of moment localization is to localize a temporal moment in an untrimmed video for a given natural language query. Since untrimmed video contains highly redundant contents, the quality of the query is crucial for…

Moment QueriesNatural Language Queries

MK-SQuIT: Synthesizing Questions using Iterative Template-filling

2020-11-04 · Benjamin A. Spiegel, Vincent Cheong, James E. Kaplan, Anthony Sanchez

The aim of this work is to create a framework for synthetically generating question/query pairs with as little human input as possible. These datasets can be used to train machine translation systems to convert natural l…

Dataset GenerationMachine Translation

NL2KQL: From Natural Language to Kusto Query

2024-04-03 · Xinye Tang, Amir H. Abdi, Jeremias Eichelbaum, Mahan Das 외

Data is growing rapidly in volume and complexity. Proficiency in database query languages is pivotal for crafting effective queries. As coding assistants become more prevalent, there is significant opportunity to enhance…

BenchmarkingNatural Language Queriesvalid

Chatting with Logs: An exploratory study on Finetuning LLMs for LogQL

2024-12-04 · Vishwanath Seshagiri, Siddharth Balyan, Vaastav Anand, Kaustubh Dhole 외

Logging is a critical function in modern distributed applications, but the lack of standardization in log query languages and formats creates significant challenges. Developers currently must write ad hoc queries in plat…