paper-with-me

Papers

BOE-ViT: Boosting Orientation Estimation with Equivariance in Self-Supervised 3D Subtomogram Alignment

2025-01-01 · CVPR 2025 1 · Runmin Jiang, Jackson Daggett, Shriya Pingulkar, Yizhou Zhao, Priyanshu Dhingra, Daniel Brown, Qifeng Wu, Xiangrui Zeng, Xingjian Li, Min Xu

Subtomogram alignment is a critical task in cryo-electron tomography (cryo-ET) analysis, essential for achieving high-resolution reconstructions of macromolecular complexes. However, learning effective positional representations remains challenging due to limited labels and high noise levels inherent in cryo-ET data. In this work, we address this challenge by proposing a self-supervised learning approach that leverages intrinsic geometric transformations as implicit supervisory signals, enabling robust representation learning despite data scarcity. We introduce BOE-ViT, the first Vision Transformer (ViT) framework for 3D subtomogram alignment. Recognizing that traditional ViTs lack equivariance and are therefore suboptimal for orientation estimation, we enhance the model with two innovative modules that introduce equivariance include 1) the Polyshift module for improved shift estimation and 2) Multi-Axis Rotation Encoding (MARE) for enhanced rotation estimation. Experimental results demonstrate that BOE-ViT significantly outperforms state-of-the-art methods. Notably, at SNR 0.01 dataset, our approach achieves a 77.3% reduction in rotation estimation error and a 62.5% reduction in translation estimation error, effectively overcoming the challenges in cryo-ET subtomogram alignment.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Electron TomographyRepresentation LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Learning to Orient Surfaces by Self-supervised Spherical CNNs

2020-11-06 · NeurIPS 2020 12 · Riccardo Spezialetti, Federico Stella, Marlon Marcon, Luciano Silva 외

Defining and reliably finding a canonical orientation for 3D surfaces is key to many Computer Vision and Robotics applications. This task is commonly addressed by handcrafted algorithms exploiting geometric cues deemed a…

RIO: Rotation-equivariance supervised learning of robust inertial odometry

2021-11-23 · CVPR 2022 1 · Caifa Zhou, Xiya Cao, Dandan Zeng, Yongliang Wang

This paper introduces rotation-equivariance as a self-supervisor to train inertial odometry models. We demonstrate that the self-supervised scheme provides a powerful supervisory signal at training phase as well as at in…

Land cover mapping at very high resolution with rotation equivariant CNNs: towards small yet accurate models

2018-03-16 · Diego Marcos, Michele Volpi, Benjamin Kellenberger, Devis Tuia

In remote sensing images, the absolute orientation of objects is arbitrary. Depending on an object's orientation and on a sensor's flight path, objects of the same semantic class can be observed in different orientations…

What My Motion tells me about Your Pose: A Self-Supervised Monocular 3D Vehicle Detector

2020-07-29 · Cédric Picron, Punarjay Chakravarty, Tom Roussel, Tinne Tuytelaars

The estimation of the orientation of an observed vehicle relative to an Autonomous Vehicle (AV) from monocular camera data is an important building block in estimating its 6 DoF pose. Current Deep Learning based solution…

Autonomous VehiclesDomain AdaptationMonocular Visual Odometryvehicle detection+1

Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariance

2023-02-28 · Xueyi Liu, Ji Zhang, Ruizhen Hu, Haibin Huang 외

Category-level articulated object pose estimation aims to estimate a hierarchy of articulation-aware object poses of an unseen articulated object from a known category. To reduce the heavy annotations needed for supervis…

DisentanglementObjectPose Estimation