REViT: Roto-reflection Equivariant Convolutional Vision Transformer
In this paper, we propose a discrete roto-reflection group equivariant vision transformer with convolutional attention. Roto-reflection equivariant networks preserve the rotational, flip and positional symmetry in feature maps, making them useful for tasks where orientation of the inputs is relevant to the model outputs. In image classification and object detection, most of the studies on roto-reflection equivariant models have focused on using convolutional neural networks rather than vision transformers. In this paper, we examine the challenges involved in achieving equivariance in vision transformers, and we propose a simpler way to implement a discretized roto-reflection group equivariant vision transformer. The experimental results demonstrate that our approach outperforms the existing approaches for developing discrete roto-reflection group equivariant neural networks for image classification.
Code (0)
등록된 구현이 없습니다.
Tasks
Image ClassificationObject DetectionSimilar Papers 제목 키워드 기반
Reflection and Rotation Symmetry Detection via Equivariant Learning
The inherent challenge of detecting symmetries stems from arbitrary orientations of symmetry patterns; a reflection symmetry mirrors itself against an axis with a specific orientation while a rotation symmetry matches it…
Symmetry DetectionWater Reflection Detection Using Symmetric Attention
Reflections of water pose a significant challenge for computer vision systems, as standard deep learning models frequently confuse objects with their mirror images, producing spurious false positives and negatives in tas…
Semantic SegmentationScene UnderstandingObject DetectionGeometrical aspects of lattice gauge equivariant convolutional neural networks
Lattice gauge equivariant convolutional neural networks (L-CNNs) are a framework for convolutional neural networks that can be applied to non-Abelian lattice gauge theories without violating gauge symmetry. We demonstrat…
Deeply Supervised Rotation Equivariant Network for Lesion Segmentation in Dermoscopy Images
Automatic lesion segmentation in dermoscopy images is an essential step for computer-aided diagnosis of melanoma. The dermoscopy images exhibits rotational and reflectional symmetry, however, this geometric property has …
Lesion SegmentationSegmentationSkin Lesion SegmentationImproved Vessel Segmentation with Symmetric Rotation-Equivariant U-Net
Automated segmentation plays a pivotal role in medical image analysis and computer-assisted interventions. Despite the promising performance of existing methods based on convolutional neural networks (CNNs), they neglect…
Medical Image AnalysisSegmentation