paper-with-me

홈 › Papers

Beyond Empirical Windowing: An Attention-Based Approach for Trust Prediction in Autonomous Vehicles

2023-12-15 · Minxue Niu, Zhaobo Zheng, Kumar Akash, Teruhisa Misu

Humans' internal states play a key role in human-machine interaction, leading to the rise of human state estimation as a prominent field. Compared to swift state changes such as surprise and irritation, modeling gradual states like trust and satisfaction are further challenged by label sparsity: long time-series signals are usually associated with a single label, making it difficult to identify the critical span of state shifts. Windowing has been one widely-used technique to enable localized analysis of long time-series data. However, the performance of downstream models can be sensitive to the window size, and determining the optimal window size demands domain expertise and extensive search. To address this challenge, we propose a Selective Windowing Attention Network (SWAN), which employs window prompts and masked attention transformation to enable the selection of attended intervals with flexible lengths. We evaluate SWAN on the task of trust prediction on a new multimodal driving simulation dataset. Experiments show that SWAN significantly outperforms an existing empirical window selection baseline and neural network baselines including CNN-LSTM and Transformer. Furthermore, it shows robustness across a wide span of windowing ranges, compared to the traditional windowing approach.

📄 PDF Abstract BibTeX arXiv:2312.10209

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesState EstimationTime Series

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Windowed-MTP: Removing the Full-Context Draft-KV Tax at Million-Token Context

2026-07-23 · Alagappan Valliappan arxiv

Speculative decoding accelerates autoregressive generation by having a cheap draft propose tokens that a target verifies in parallel. Frontier models increasingly ship a built-in Multi-Token-Prediction (MTP/NEXTN) draft …

Windowing Models for Abstractive Summarization of Long Texts

2020-04-07 · Leon Schüller, Florian Wilhelm, Nico Kreiling, Goran Glavaš

Neural summarization models suffer from the fixed-size input limitation: if text length surpasses the model's maximal number of input tokens, some document content (possibly summary-relevant) gets truncated Independently…

Abstractive Text SummarizationDecoder

Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyond

2025-03-10 · Qiongxiu Li, Xiaoyu Luo, Yiyi Chen, Johannes Bjerva

The role of memorization in machine learning (ML) has garnered significant attention, particularly as modern models are empirically observed to memorize fragments of training data. Previous theoretical analyses, such as …

AttributeFairnessMemorization

The impact of adaptive guards for 5G and beyond

2019-02-15

The next generation communication systems are evolving towards an increased flexibility in different aspects. Enhanced flexibility is the key in order to address diverse requirements. This paper presents the significance…

Scheduling

Capturing AI's Attention: Physics of Repetition, Hallucination, Bias and Beyond

2025-04-06 · Frank Yingjie Huo, Neil F. Johnson

We derive a first-principles physics theory of the AI engine at the heart of LLMs' 'magic' (e.g. ChatGPT, Claude): the basic Attention head. The theory allows a quantitative analysis of outstanding AI challenges such as …

Hallucination