paper-with-me

홈 › Papers

TransFlower: An Explainable Transformer-Based Model with Flow-to-Flow Attention for Commuting Flow Prediction

2024-02-23 · Yan Luo, Zhuoyue Wan, Yuzhong Chen, Gengchen Mai, Fu-Lai Chung, Kent Larson

Understanding the link between urban planning and commuting flows is crucial for guiding urban development and policymaking. This research, bridging computer science and urban studies, addresses the challenge of integrating these fields with their distinct focuses. Traditional urban studies methods, like the gravity and radiation models, often underperform in complex scenarios due to their limited handling of multiple variables and reliance on overly simplistic and unrealistic assumptions, such as spatial isotropy. While deep learning models offer improved accuracy, their black-box nature poses a trade-off between performance and explainability -- both vital for analyzing complex societal phenomena like commuting flows. To address this, we introduce TransFlower, an explainable, transformer-based model employing flow-to-flow attention to predict urban commuting patterns. It features a geospatial encoder with an anisotropy-aware relative location encoder for nuanced flow representation. Following this, the transformer-based flow predictor enhances this by leveraging attention mechanisms to efficiently capture flow interactions. Our model outperforms existing methods by up to 30.8% Common Part of Commuters, offering insights into mobility dynamics crucial for urban planning and policy decisions.

📄 PDF Abstract BibTeX arXiv:2402.15398

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Gravity Gravity is a kinematic approach to optimization based on gradients.

Similar Papers 제목 키워드 기반

Transflower: probabilistic autoregressive dance generation with multimodal attention

2021-06-25 · Guillermo Valle-Pérez, Gustav Eje Henter, Jonas Beskow, André Holzapfel 외

Dance requires skillful composition of complex movements that follow rhythmic, tonal and timbral features of music. Formally, generating dance conditioned on a piece of music can be expressed as a problem of modelling a …

Temporal Fusion Transformers for Streamflow Prediction: Value of Combining Attention with Recurrence

2023-05-21 · Sinan Rasiya Koya, Tirthankar Roy

Over the past few decades, the hydrology community has witnessed notable advancements in streamflow prediction, particularly with the introduction of cutting-edge machine-learning algorithms. Recurrent neural networks, e…

Prediction

Explainable Techniques for Analyzing Flow Cytometry Cell Transformers

2023-07-27 · Florian Kowarsch, Lisa Weijler, Florian Kleber, Matthias Wödlinger 외

Explainability for Deep Learning Models is especially important for clinical applications, where decisions of automated systems have far-reaching consequences. While various post-hoc explainable methods, such as attentio…

Binary Classification

Multidomain transformer-based deep learning for early detection of network intrusion

2023-09-03 · Jinxin Liu, Murat Simsek, Michele Nogueira, Burak Kantarci

Timely response of Network Intrusion Detection Systems (NIDS) is constrained by the flow generation process which requires accumulation of network packets. This paper introduces Multivariate Time Series (MTS) early detec…

Intrusion DetectionNetwork Intrusion DetectionTime Series

Flowformer: Linearizing Transformers with Conservation Flows

2022-02-13 · Haixu Wu, Jialong Wu, Jiehui Xu, Jianmin Wang 외

Transformers based on the attention mechanism have achieved impressive success in various areas. However, the attention mechanism has a quadratic complexity, significantly impeding Transformers from dealing with numerous…

D4RLOffline RLTime SeriesTime Series Analysis