GaAN

2000년 도입 · 논문 2편에서 사용

Gated Attention Networks (GaAN) is a new architecture for learning on graphs. Unlike the traditional multi-head attention mechanism, which equally consumes all attention heads, GaAN uses a convolutional sub-network to control each attention head’s importance. Image credit: GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs

출처: GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs

소개 논문: GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs