paper-with-me

홈 › Papers

SelectionConv: Convolutional Neural Networks for Non-rectilinear Image Data

2022-07-18 · David Hart, Michael Whitney, Bryan Morse

Convolutional Neural Networks have revolutionized vision applications. There are image domains and representations, however, that cannot be handled by standard CNNs (e.g., spherical images, superpixels). Such data are usually processed using networks and algorithms specialized for each type. In this work, we show that it may not always be necessary to use specialized neural networks to operate on such spaces. Instead, we introduce a new structured graph convolution operator that can copy 2D convolution weights, transferring the capabilities of already trained traditional CNNs to our new graph network. This network can then operate on any data that can be represented as a positional graph. By converting non-rectilinear data to a graph, we can apply these convolutions on these irregular image domains without requiring training on large domain-specific datasets. Results of transferring pre-trained image networks for segmentation, stylization, and depth prediction are demonstrated for a variety of such data forms.

📄 PDF Abstract BibTeX arXiv:2207.08979

Code (1)

davidmhart/SelectionConv 공식 구현 pytorch

Tasks

Depth EstimationDepth PredictionSuperpixels

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Interpolated SelectionConv for Spherical Images and Surfaces

2022-10-18 · David Hart, Michael Whitney, Bryan Morse

We present a new and general framework for convolutional neural network operations on spherical (or omnidirectional) images. Our approach represents the surface as a graph of connected points that doesn't rely on a parti…

Semantic SegmentationStyle Transfer

3D Object Detection from a Single Fisheye Image Without a Single Fisheye Training Image

2020-03-08 · Elad Plaut, Erez Ben Yaacov, Bat El Shlomo

Existing monocular 3D object detection methods have been demonstrated on rectilinear perspective images and fail in images with alternative projections such as those acquired by fisheye cameras. Previous works on object …

2D Object Detection3D Object DetectionMonocular 3D Object DetectionObject+2

On Retrospective k-space Subsampling schemes For Deep MRI Reconstruction

2023-01-20 · George Yiasemis, Clara I. Sánchez, Jan-Jakob Sonke, Jonas Teuwen

Acquiring fully-sampled MRI $k$-space data is time-consuming, and collecting accelerated data can reduce the acquisition time. Employing 2D Cartesian-rectilinear subsampling schemes is a conventional approach for acceler…

MRI Reconstruction

Artwork painting identification method for panorama based on adaptive rectilinear projection and optimized ASIFT

2019-07-28 · Multimedia Tools and Applications 2019 7 · Dayou, Jiang; Jongweon, Kim

In the paper, the authors present an artwork painting identification method for panorama based on adaptive rectilinear projection and optimized ASIFT (Affine Scale-Invariant Feature Transform). Firstly, the authors use t…

Image Enhancement

HEAL-ViT: Vision Transformers on a spherical mesh for medium-range weather forecasting

2024-02-14 · Vivek Ramavajjala

In recent years, a variety of ML architectures and techniques have seen success in producing skillful medium range weather forecasts. In particular, Vision Transformer (ViT)-based models (e.g. Pangu-Weather, FuXi) have s…

Weather Forecasting