paper-with-me

홈 › Papers

Large Language Models for Design Structure Matrix Optimization

2025-06-11 · Shuo Jiang, Min Xie, Jianxi Luo

In complex engineering systems, the interdependencies among components or development activities are often modeled and analyzed using Design Structure Matrix (DSM). Reorganizing elements within a DSM to minimize feedback loops and enhance modularity or process efficiency constitutes a challenging combinatorial optimization (CO) problem in engineering design and operations. As problem sizes increase and dependency networks become more intricate, traditional optimization methods that solely use mathematical heuristics often fail to capture the contextual nuances and struggle to deliver effective solutions. In this study, we explore the potential of Large Language Models (LLMs) for helping solve such CO problems by leveraging their capabilities for advanced reasoning and contextual understanding. We propose a novel LLM-based framework that integrates network topology with contextual domain knowledge for iterative optimization of DSM element sequencing - a common CO problem. Experiments on various DSM cases show that our method consistently achieves faster convergence and superior solution quality compared to both stochastic and deterministic baselines. Notably, we find that incorporating contextual domain knowledge significantly enhances optimization performance regardless of the chosen LLM backbone. These findings highlight the potential of LLMs to solve complex engineering CO problems by combining semantic and mathematical reasoning. This approach paves the way towards a new paradigm in LLM-based engineering design optimization.

📄 PDF Abstract BibTeX arXiv:2506.09749

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial OptimizationMathematical Reasoning

Similar Papers 제목 키워드 기반

Optimizing Token Usage on Large Language Model Conversations Using the Design Structure Matrix

2024-10-01 · Ramon Maria Garcia Alarcia, Alessandro Golkar

As Large Language Models become ubiquitous in many sectors and tasks, there is a need to reduce token usage, overcoming challenges such as short context windows, limited output sizes, and costs associated with token inta…

Language ModelingLanguage ModellingLarge Language Model

Design Structure Matrix Modularization with Large Language Models

2026-04-30 · Shuo Jiang, Jianxi Luo arxiv

Design Structure Matrix (DSM) modularization, the task of partitioning system elements into cohesive modules, is a fundamental combinatorial challenge in engineering design. Traditional methods treat modularization as a …

KOALA++: Efficient Kalman-Based Optimization of Neural Networks with Gradient-Covariance Products

2025-06-04 · Zixuan Xia, Aram Davtyan, Paolo Favaro

We propose KOALA++, a scalable Kalman-based optimization algorithm that explicitly models structured gradient uncertainty in neural network training. Unlike second-order methods, which rely on expensive second order grad…

image-classificationImage ClassificationLanguage ModelingLanguage Modelling+1

Large Language Models for Combinatorial Optimization of Design Structure Matrix

2024-11-19 · Shuo Jiang, Min Xie, Jianxi Luo

Combinatorial optimization (CO) is essential for improving efficiency and performance in engineering applications. As complexity increases with larger problem sizes and more intricate dependencies, identifying the optima…

Combinatorial OptimizationMathematical Reasoning

Navigating LLM Valley: From AdamW to Memory-Efficient and Matrix-Based Optimizers

2026-05-09 · Aditya Ranganath arxiv

Training large language models requires optimization algorithms that are not only statistically effective, but also computationally and memory efficient at extreme scale. Although Adam remains the dominant optimizer for …