paper-with-me

Papers

Spherical CNNs on Unstructured Grids

2019-01-07 · ICLR 2019 5 · Chiyu "Max" Jiang, Jingwei Huang, Karthik Kashinath, Prabhat, Philip Marcus, Matthias Niessner

We present an efficient convolution kernel for Convolutional Neural Networks (CNNs) on unstructured grids using parameterized differential operators while focusing on spherical signals such as panorama images or planetary signals. To this end, we replace conventional convolution kernels with linear combinations of differential operators that are weighted by learnable parameters. Differential operators can be efficiently estimated on unstructured grids using one-ring neighbors, and learnable parameters can be optimized through standard back-propagation. As a result, we obtain extremely efficient neural networks that match or outperform state-of-the-art network architectures in terms of performance but with a significantly lower number of network parameters. We evaluate our algorithm in an extensive series of experiments on a variety of computer vision and climate science tasks, including shape classification, climate pattern segmentation, and omnidirectional image semantic segmentation. Overall, we present (1) a novel CNN approach on unstructured grids using parameterized differential operators for spherical signals, and (2) we show that our unique kernel parameterization allows our model to achieve the same or higher accuracy with significantly fewer network parameters.

📄 PDF Abstract BibTeX arXiv:1901.02039

Code (1)

maxjiang93/ugscnn 공식 구현 pytorch

Tasks

Semantic Segmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Spherical Transformer: Adapting Spherical Signal to CNNs

2021-01-11 · Yuqi Liu, Yin Wang, Haikuan Du, Shen Cai

Convolutional neural networks (CNNs) have been widely used in various vision tasks, e.g. image classification, semantic segmentation, etc. Unfortunately, standard 2D CNNs are not well suited for spherical signals such as…

3D Object ClassificationGeneral Classificationimage-classificationImage Classification+1

Unified Spherical Frontend: Learning Rotation-Equivariant Representations of Spherical Images from Any Camera

2025-11-22 · Mukai Yu, Mosam Dabhi, Liuyue Xie, Sebastian Scherer 외 arxiv

Modern perception increasingly relies on fisheye, panoramic, and other wide field-of-view (FoV) cameras, yet most pipelines still apply planar CNNs designed for pinhole imagery on 2D grids, where pixel-space neighborhood…

Zero-shot Generalization

Rotation Equivariant Graph Convolutional Network for Spherical Image Classification

2020-06-01 · CVPR 2020 6 · Qin Yang, Chenglin Li, Wenrui Dai, Junni Zou 외

Convolutional neural networks (CNNs) designed for low-dimensional regular grids will unfortunately lead to non-optimal solutions for analyzing spherical images, due to their different geometrical properties from planar i…

ClassificationGeneral Classificationgraph constructionimage-classification+1

GMLS-Nets: A framework for learning from unstructured data

2019-09-07 · Nathaniel Trask, Ravi G. Patel, Ben J. Gross, Paul J. Atzberger

Data fields sampled on irregularly spaced points arise in many applications in the sciences and engineering. For regular grids, Convolutional Neural Networks (CNNs) have been successfully used to gaining benefits from we…

PDO-eS2CNNs: Partial Differential Operator Based Equivariant Spherical CNNs

2021-04-08 · Zhengyang Shen, Tiancheng Shen, Zhouchen Lin, Jinwen Ma

Spherical signals exist in many applications, e.g., planetary data, LiDAR scans and digitalization of 3D objects, calling for models that can process spherical data effectively. It does not perform well when simply proje…

Translation