paper-with-me

홈 › Papers

Polar Transformer Networks

2017-09-06 · ICLR 2018 1 · Carlos Esteves, Christine Allen-Blanchette, Xiaowei Zhou, Kostas Daniilidis

Convolutional neural networks (CNNs) are inherently equivariant to translation. Efforts to embed other forms of equivariance have concentrated solely on rotation. We expand the notion of equivariance in CNNs through the Polar Transformer Network (PTN). PTN combines ideas from the Spatial Transformer Network (STN) and canonical coordinate representations. The result is a network invariant to translation and equivariant to both rotation and scale. PTN is trained end-to-end and composed of three distinct stages: a polar origin predictor, the newly introduced polar transformer module and a classifier. PTN achieves state-of-the-art on rotated MNIST and the newly introduced SIM2MNIST dataset, an MNIST variation obtained by adding clutter and perturbing digits with translation, rotation and scaling. The ideas of PTN are extensible to 3D which we demonstrate through the Cylindrical Transformer Network.

📄 PDF Abstract BibTeX arXiv:1709.01889

Code (1)

daniilidis-group/polar-transformer-networks 공식 구현 tf

Tasks

Rotated MNISTTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Universal Polarization Transformations: Spatial programming of polarization scattering matrices using a deep learning-designed diffractive polarization transformer

2023-04-12 · Yuhang Li, Jingxi Li, Yifan Zhao, Tianyi Gan 외

We demonstrate universal polarization transformers based on an engineered diffractive volume, which can synthesize a large set of arbitrarily-selected, complex-valued polarization scattering matrices between the polariza…

Nested Construction of Polar Codes via Transformers

2024-01-30 · Sravan Kumar Ankireddy, S Ashwin Hebbar, Heping Wan, Joonyoung Cho 외

Tailoring polar code construction for decoding algorithms beyond successive cancellation has remained a topic of significant interest in the field. However, despite the inherent nested structure of polar codes, the use o…

PolarFormer: Multi-camera 3D Object Detection with Polar Transformer

2022-06-30 · Yanqin Jiang, Li Zhang, Zhenwei Miao, Xiatian Zhu 외

3D object detection in autonomous driving aims to reason "what" and "where" the objects of interest present in a 3D world. Following the conventional wisdom of previous 2D object detection, existing methods often adopt t…

2D Object Detection3D Object DetectionAutonomous DrivingObject+5

The Transformer as a Polar State Estimator

2026-05-10 · Peter Racioppo arxiv

We show that the core components of the Transformer---attention, residual connections, and normalization---arise naturally from a single geometric state estimation problem. Modeling the latent state in polar coordinates …

Video Frame Interpolation for Polarization via Swin-Transformer

2024-06-17 · Feng Huang, Xin Zhang, YiXuan Xu, Xuesong Wang 외

Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. Due to the selective transmission of light by polarized filters, longer expo…

Video Frame Interpolation