paper-with-me

Papers

Pre-Trained Large Language Models for Industrial Control

2023-08-06 · Lei Song, Chuheng Zhang, Li Zhao, Jiang Bian

For industrial control, developing high-performance controllers with few samples and low technical debt is appealing. Foundation models, possessing rich prior knowledge obtained from pre-training with Internet-scale corpus, have the potential to be a good controller with proper prompts. In this paper, we take HVAC (Heating, Ventilation, and Air Conditioning) building control as an example to examine the ability of GPT-4 (one of the first-tier foundation models) as the controller. To control HVAC, we wrap the task as a language game by providing text including a short description for the task, several selected demonstrations, and the current observation to GPT-4 on each step and execute the actions responded by GPT-4. We conduct series of experiments to answer the following questions: 1)~How well can GPT-4 control HVAC? 2)~How well can GPT-4 generalize to different scenarios for HVAC control? 3) How different parts of the text context affect the performance? In general, we found GPT-4 achieves the performance comparable to RL methods with few samples and low technical debt, indicating the potential of directly applying foundation models to industrial control tasks.

📄 PDF Abstract BibTeX arXiv:2308.03028

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Validate and Enable Machine Learning in Industrial AI

2020-10-30 · Hongbo Zou, Guangjing Chen, Pengtao Xie, Sean Chen 외

Industrial Artificial Intelligence (Industrial AI) is an emerging concept which refers to the application of artificial intelligence to industry. Industrial AI promises more efficient future industrial control systems. H…

BIG-bench Machine Learning

AI-Powered Immersive Assistance for Interactive Task Execution in Industrial Environments

2024-07-12 · Tomislav Duricic, Peter Müllner, Nicole Weidinger, Neven ElSayed 외

Many industrial sectors rely on well-trained employees that are able to operate complex machinery. In this work, we demonstrate an AI-powered immersive assistance system that supports users in performing complex tasks in…

Language ModelingLanguage ModellingLarge Language ModelSpeech-to-Text

AnomalyPainter: Vision-Language-Diffusion Synergy for Zero-Shot Realistic and Diverse Industrial Anomaly Synthesis

2025-03-10 · Zhangyu Lai, Yilin Lu, Xinyang Li, Jianghang Lin 외

While existing anomaly synthesis methods have made remarkable progress, achieving both realism and diversity in synthesis remains a major obstacle. To address this, we propose AnomalyPainter, a zero-shot framework that b…

DiversityGeneral Knowledge

Control Industrial Automation System with Large Language Model Agents

2024-09-26 · Yuchen Xia, Nasser Jazdi, Jize Zhang, Chaitanya Shah 외

Traditional industrial automation systems require specialized expertise to operate and complex reprogramming to adapt to new processes. Large language models offer the intelligence to make them more flexible and easier t…

Language ModelingLanguage ModellingLarge Language Model

Software Model Evolution with Large Language Models: Experiments on Simulated, Public, and Industrial Datasets

2024-06-25 · Christof Tinnes, Alisa Welter, Sven Apel

Modeling structure and behavior of software systems plays a crucial role in the industrial practice of software engineering. As with other software engineering artifacts, software models are subject to evolution. Support…

RetrievalRetrieval-augmented Generation