paper-with-me

홈 › Papers

IoT-LLM: Enhancing Real-World IoT Task Reasoning with Large Language Models

2024-10-03 · Tuo An, Yunjiao Zhou, Han Zou, Jianfei Yang

Large Language Models (LLMs) excel in textual and visual tasks but often produce outputs that defy physical laws when dealing with physical-world reasoning tasks. Inspired by human cognition, where perception is fundamental to reasoning, we explore augmenting LLMs with enhanced perception abilities using Internet of Things (IoT) sensor data and pertinent knowledge for IoT-sensory task reasoning in the physical world. In this work, we systematically study LLMs' capability to address real-world IoT-sensory tasks by augmenting their perception and knowledge base, and then propose a unified framework, IoT-LLM, to enhance such capability. In IoT-LLM, we customize three steps for LLMs: preprocessing IoT data into formats amenable to LLMs, expanding their understanding via IoT-oriented retrieval-augmented generation based on in-context learning and activating their commonsense knowledge through chain-of-thought prompting and specialized role definitions. We design a new benchmark comprising five real-world tasks with varying data types and reasoning complexities to evaluate the performance of IoT-LLM. Experimental results on six LLMs reveal that IoT-LLM significantly improves the performance of IoT-sensory task reasoning of LLMs, with models like GPT-4o-mini showing a 49.4% average improvement over previous methods.

📄 PDF Abstract BibTeX arXiv:2410.02429

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingIn-Context LearningRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Enhancing LLMs' Clinical Reasoning with Real-World Data from a Nationwide Sepsis Registry

2025-05-05 · Junu Kim, Chaeeun Shim, Sungjin Park, Su Yeon Lee 외

Although large language models (LLMs) have demonstrated impressive reasoning capabilities across general domains, their effectiveness in real-world clinical practice remains limited. This is likely due to their insuffici…

Semantic Self-Consistency: Enhancing Language Model Reasoning via Semantic Weighting

2024-10-10 · Tim Knappe, Ryan Li, Ayush Chauhan, Kaylee Chhua 외

While large language models (LLMs) have rapidly improved their performance on a broad number of tasks, they still often fall short on reasoning tasks. As LLMs become more integrated in diverse real-world tasks, advancing…

Language ModelingLanguage Modelling

DianJin-R1: Evaluating and Enhancing Financial Reasoning in Large Language Models

2025-04-22 · Jie Zhu, Qian Chen, Huaixia Dou, Junhui Li 외

Effective reasoning remains a core challenge for large language models (LLMs) in the financial domain, where tasks often require domain-specific knowledge, precise numerical calculations, and strict adherence to complian…

Math

Reasoning in Large Language Models: A Geometric Perspective

2024-07-02 · Romain Cosentino, Sarath Shekkizhar

The advancement of large language models (LLMs) for real-world applications hinges critically on enhancing their reasoning capabilities. In this work, we explore the reasoning abilities of large language models (LLMs) th…

Position: Empowering Time Series Reasoning with Multimodal LLMs

2025-02-03 · Yaxuan Kong, Yiyuan Yang, Shiyu Wang, Chenghao Liu 외

Understanding time series data is crucial for multiple real-world applications. While large language models (LLMs) show promise in time series tasks, current approaches often rely on numerical data alone, overlooking the…

Decision MakingMultimodal ReasoningPositionTime Series+1