paper-with-me

홈 › Papers

Quo Vadis ChatGPT? From Large Language Models to Large Knowledge Models

2024-05-29 · Venkat Venkatasubramanian, Arijit Chakraborty

The startling success of ChatGPT and other large language models (LLMs) using transformer-based generative neural network architecture in applications such as natural language processing and image synthesis has many researchers excited about potential opportunities in process systems engineering (PSE). The almost human-like performance of LLMs in these areas is indeed very impressive, surprising, and a major breakthrough. Their capabilities are very useful in certain tasks, such as writing first drafts of documents, code writing assistance, text summarization, etc. However, their success is limited in highly scientific domains as they cannot yet reason, plan, or explain due to their lack of in-depth domain knowledge. This is a problem in domains such as chemical engineering as they are governed by fundamental laws of physics and chemistry (and biology), constitutive relations, and highly technical knowledge about materials, processes, and systems. Although purely data-driven machine learning has its immediate uses, the long-term success of AI in scientific and engineering domains would depend on developing hybrid AI systems that use first principles and technical knowledge effectively. We call these hybrid AI systems Large Knowledge Models (LKMs), as they will not be limited to only NLP-based techniques or NLP-like applications. In this paper, we discuss the challenges and opportunities in developing such systems in chemical engineering.

📄 PDF Abstract BibTeX arXiv:2405.19561

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationText Summarization

Similar Papers 제목 키워드 기반

ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models

2023-03-29 · Ning Bian, Xianpei Han, Le Sun, Hongyu Lin 외

Large language models (LLMs) have made significant progress in NLP. However, their ability to memorize, represent, and leverage commonsense knowledge has been a well-known pain point. In this paper, we specifically focus…

Instruction Following

Künstliche Intelligenz, quo vadis?

2021-04-21 · Ulrike Barthelmeß, Ulrich Furbach

This paper outlines the state of the art in AI. It then describes basic machine learning and knowledge processing techniques. Based on this, some possibilities and limitations of future AI developments are discussed.

BIG-bench Machine Learning

Comparative Analysis of CHATGPT and the evolution of language models

2023-03-28 · Oluwatosin Ogundare, Gustavo Quiros Araya

Interest in Large Language Models (LLMs) has increased drastically since the emergence of ChatGPT and the outstanding positive societal response to the ease with which it performs tasks in Natural Language Processing (NL…

Machine TranslationQuestion AnsweringText Generation

Opportunities and challenges of ChatGPT for design knowledge management

2023-04-06 · Xin Hu, Yu Tian, Keisuke Nagato, Masayuki Nakao 외

Recent advancements in Natural Language Processing have opened up new possibilities for the development of large language models like ChatGPT, which can facilitate knowledge management in the design process by providing …

Management

In-Context Learning for Knowledge Base Question Answering for Unmanned Systems based on Large Language Models

2023-11-06 · Yunlong Chen, Yaming Zhang, Jianfei Yu, Li Yang 외

Knowledge Base Question Answering (KBQA) aims to answer factoid questions based on knowledge bases. However, generating the most appropriate knowledge base query code based on Natural Language Questions (NLQ) poses a sig…

In-Context LearningKnowledge Base Question AnsweringProper NounQuestion Answering