paper-with-me

홈 › Papers

A Random Attention Model

2019-08-29

This paper illustrates how one can deduce preference from observed choices when attention is not only limited but also random. In contrast to earlier approaches, we introduce a Random Attention Model (RAM) where we abstain from any particular attention formation, and instead consider a large class of nonparametric random attention rules. Our model imposes one intuitive condition, termed Monotonic Attention, which captures the idea that each consideration set competes for the decision-maker's attention. We then develop revealed preference theory within RAM and obtain precise testable implications for observable choice probabilities. Based on these theoretical findings, we propose econometric methods for identification, estimation, and inference of the decision maker's preferences. To illustrate the applicability of our results and their concrete empirical content in specific settings, we also develop revealed preference theory and accompanying econometric methods under additional nonparametric assumptions on the consideration set for binary choice problems. Finally, we provide general purpose software implementation of our estimation and inference results, and showcase their performance using simulations.

📄 PDF Abstract BibTeX arXiv:1712.03448

Code (1)

mdcattaneo/replication-CMMS_2020_JPE 공식 구현

Tasks

model

Similar Papers 제목 키워드 기반

Attention and Self-Attention in Random Forests

2022-07-09 · Lev V. Utkin, Andrei V. Konstantinov

New models of random forests jointly using the attention and self-attention mechanisms are proposed for solving the regression problem. The models can be regarded as extensions of the attention-based random forest whose …

regression

How Particle-System Random Batch Methods Enhance Graph Transformer: Memory Efficiency and Parallel Computing Strategy

2025-11-08 · Hanwen Liu, Yixuan Ma, Shi Jin, Yuguang Wang arxiv

Attention mechanism is a significant part of Transformer models. It helps extract features from embedded vectors by adding global information and its expressivity has been proved to be powerful. Nevertheless, the quadrat…

Linear Complexity Randomized Self-attention Mechanism

2022-04-10 · Lin Zheng, Chong Wang, Lingpeng Kong

Recently, random feature attentions (RFAs) are proposed to approximate the softmax attention in linear time and space complexity by linearizing the exponential kernel. In this paper, we first propose a novel perspective …

Random Attention and Unobserved Reference Alternatives

2024-07-01 · Varun Bansal

In this paper, I develop and characterize a random attention model with unobserved reference alternatives. The decision-maker pays attention to different subsets of the available set of alternatives randomly. The referen…

What can a Single Attention Layer Learn? A Study Through the Random Features Lens

2023-07-21 · NeurIPS 2023 11

Attention layers -- which map a sequence of inputs to a sequence of outputs -- are core building blocks of the Transformer architecture which has achieved significant breakthroughs in modern artificial intelligence. This…