paper-with-me

Papers

LLaSA: A Multimodal LLM for Human Activity Analysis Through Wearable and Smartphone Sensors

2024-06-20 · Sheikh Asif Imran, Mohammad Nur Hossain Khan, Subrata Biswas, Bashima Islam

Wearables generate rich motion data, yet current systems only classify what happened - failing to support natural questions about why it happened or what it means. We introduce LLaSA (Large Language and Sensor Assistant), a compact 13B model that enables ask-anything, open-ended question answering grounded in raw IMU data. LLaSA supports conversational, context-aware reasoning - explaining the causes of sensor-detected behaviors and answering free-form questions in real-world scenarios. It is tuned for scientific accuracy, coherence, and response reliability. To advance this new task of sensor-based QA, we release three large-scale datasets: SensorCaps, OpenSQA, and Tune-OpenSQA. Together, these resources define a new benchmark for sensor-language models. LLaSA consistently produces interpretable, causal answers and outperforms commercial LLMs across both public and real-world settings. Our code repository and datasets can be found at https://github.com/BASHLab/LLaSA.

📄 PDF Abstract BibTeX arXiv:2406.14498

Code (1)

bashlab/llasa 공식 구현 pytorch

Tasks

16kInstruction FollowingLarge Language ModelMultimodal Large Language ModelNatural QuestionsOpen-Ended Question AnsweringQuestion Answering

Methods 이 논문이 사용한 방법론

{Dispute@FaQ-s}How to file a dispute with Expedia? How to file a dispute with Expedia? To file a complaint against Expedia, first try contacting their customer service directly. You can reach them by phone at…
Attention 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

LLaSA: Large Language and E-Commerce Shopping Assistant

2024-08-04 · Shuo Zhang, Boci Peng, Xinping Zhao, Boren Hu 외

The e-commerce platform has evolved rapidly due to its widespread popularity and convenience. Developing an e-commerce shopping assistant for customers is crucial to aiding them in quickly finding desired products and re…

Inference OptimizationSpecificity

Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesis

2025-02-06 · Zhen Ye, Xinfa Zhu, Chi-Min Chan, Xinsheng Wang 외

Recent advances in text-based large language models (LLMs), particularly in the GPT series and the o1 model, have demonstrated the effectiveness of scaling both training-time and inference-time compute. However, current …

Speech Synthesis

LLaSA: Large Language and Structured Data Assistant

2024-11-16 · Yao Xu, Shizhu He, Zeng Xiangrong, Jiabei Chen 외

Structured data, such as tables, graphs, and databases, play a critical role in plentiful NLP tasks such as question answering and dialogue system. Recently, inspired by Vision-Language Models, Graph Neutral Networks (GN…

Hypergraph representationsQuestion AnsweringSelf-Supervised Learning

Multimodal neural networks better explain multivoxel patterns in the hippocampus

2021-12-11 · NeurIPS Workshop SVRHM 2021 12 · Bhavin Choksi, Milad Mozafari, Rufin VanRullen, Leila Reddy

The human hippocampus possesses "concept cells", neurons that fire when presented with stimuli belonging to a specific concept, regardless of the modality. Recently, similar concept cells were discovered in a multimodal …

Hippocampus

CMD-HAR: Cross-Modal Disentanglement for Wearable Human Activity Recognition

2025-03-27 · Hanyu Liu, SiYao Li, Ying Yu, Yixuan Jiang 외

Human Activity Recognition (HAR) is a fundamental technology for numerous human - centered intelligent applications. Although deep learning methods have been utilized to accelerate feature extraction, issues such as mult…

Activity RecognitionDisentanglementHuman Activity Recognition