paper-with-me

Papers

Geometric Scattering Attention Networks

2020-10-28 · Yimeng Min, Frederik Wenkel, Guy Wolf

Geometric scattering has recently gained recognition in graph representation learning, and recent work has shown that integrating scattering features in graph convolution networks (GCNs) can alleviate the typical oversmoothing of features in node representation learning. However, scattering often relies on handcrafted design, requiring careful selection of frequency bands via a cascade of wavelet transforms, as well as an effective weight sharing scheme to combine low- and band-pass information. Here, we introduce a new attention-based architecture to produce adaptive task-driven node representations by implicitly learning node-wise weights for combining multiple scattering and GCN channels in the network. We show the resulting geometric scattering attention network (GSAN) outperforms previous networks in semi-supervised node classification, while also enabling a spectral study of extracted information by examining node-wise attention weights.

📄 PDF Abstract BibTeX arXiv:2010.15010

Code (1)

dms-net/Attention-based-Scattering pytorch

Tasks

Graph Representation LearningNode ClassificationRepresentation Learning

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

ProtSCAPE: Mapping the landscape of protein conformations in molecular dynamics

2024-10-27 · Siddharth Viswanath, Dhananjay Bhaskar, David R. Johnson, Joao Felipe Rocha 외

Understanding the dynamic nature of protein structures is essential for comprehending their biological functions. While significant progress has been made in predicting static folded structures, modeling protein motions …

Geometric Wavelet Scattering Networks on Compact Riemannian Manifolds

2019-05-24 · Michael Perlmutter, Feng Gao, Guy Wolf, Matthew Hirn

The Euclidean scattering transform was introduced nearly a decade ago to improve the mathematical understanding of convolutional neural networks. Inspired by recent interest in geometric deep learning, which aims to gene…

Translation

Geometric Scattering on Manifolds

2018-12-15 · Michael Perlmutter, Guy Wolf, Matthew Hirn

The Euclidean scattering transform was introduced nearly a decade ago to improve the mathematical understanding of the success of convolutional neural networks (ConvNets) in image data analysis and other tasks. Inspired …

Translation

Is-NeRF: In-scattering Neural Radiance Field for Blurred Images

2025-08-19 · Nan Luo, Chenglin Ye, Jiaxu Li, Gang Liu 외 arxiv

Neural Radiance Fields (NeRF) has gained significant attention for its prominent implicit 3D representation and realistic novel view synthesis capabilities. Available works unexceptionally employ straight-line volume ren…

Novel View Synthesis

Uncovering the Folding Landscape of RNA Secondary Structure with Deep Graph Embeddings

2020-06-12 · Egbert Castro, Andrew Benz, Alexander Tong, Guy Wolf 외

Biomolecular graph analysis has recently gained much attention in the emerging field of geometric deep learning. Here we focus on organizing biomolecular graphs in ways that expose meaningful relations and variations bet…