Semi-supervised Learning of Galaxy Morphology using Equivariant Transformer Variational Autoencoders

2020-11-17 · Mizu Nishikawa-Toomey, Lewis Smith, Yarin Gal

The growth in the number of galaxy images is much faster than the speed at which these galaxies can be labelled by humans. However, by leveraging the information present in the ever growing set of unlabelled images, semi-supervised learning could be an effective way of reducing the required labelling and increasing classification accuracy. We develop a Variational Autoencoder (VAE) with Equivariant Transformer layers with a classifier network from the latent space. We show that this novel architecture leads to improvements in accuracy when used for the galaxy morphology classification task on the Galaxy Zoo data set. In addition we show that pre-training the classifier network as part of the VAE using the unlabelled data leads to higher accuracy with fewer labels compared to exiting approaches. This novel VAE has the potential to automate galaxy morphology classification with reduced human labelling efforts.

📄 PDF Abstract BibTeX arXiv:2011.08714

Code (0)

등록된 구현이 없습니다.

Tasks

Classification General ClassificationMorphology classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Multi-Head Attention 설명 없음

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Residual Connection 설명 없음

E(2) Equivariant Neural Networks for Robust Galaxy Morphology Classification

2023-11-02 · Sneh Pandya, Purvik Patel, Franc O, Jonathan Blazek

We propose the use of group convolutional neural network architectures (GCNNs) equivariant to the 2D Euclidean group, $E(2)$, for the task of galaxy morphology classification by utilizing symmetries of the data present i…

Inductive Bias Morphology classification

Morphological classification of astronomical images with limited labelling

2021-04-27 · Andrey Soroka, Alex Meshcheryakov, Sergey Gerasimov

The task of morphological classification is complex for simple parameterization, but important for research in the galaxy evolution field. Future galaxy surveys (e.g. EUCLID) will collect data about more than a $10^9$ ga…

Active Learning Astronomy Binary Classification Classification+2

AstroCLIP: A Cross-Modal Foundation Model for Galaxies

2023-10-04 · Liam Parker, Francois Lanusse, Siavash Golkar, Leopoldo Sarra 외

We present AstroCLIP, a single, versatile model that can embed both galaxy images and spectra into a shared, physically meaningful latent space. These embeddings can then be used - without any model fine-tuning - for a v…

Contrastive Learning model Morphology classification Photometric Redshift Estimation+3

Can semi-supervised learning reduce the amount of manual labelling required for effective radio galaxy morphology classification?

2021-11-08 · Inigo V. Slijepcevic, Anna M. M. Scaife

In this work, we examine the robustness of state-of-the-art semi-supervised learning (SSL) algorithms when applied to morphological classification in modern radio astronomy. We test whether SSL can achieve performance co…

Astronomy Morphology classification

Re-envisioning Euclid Galaxy Morphology: Identifying and Interpreting Features with Sparse Autoencoders

2025-10-27 · John F. Wu, Michael Walmsley arxiv

Sparse Autoencoders (SAEs) can efficiently identify candidate monosemantic features from pretrained neural networks for galaxy morphology. We demonstrate this on Euclid Q1 images using both supervised (Zoobot) and new se…

Image Reconstruction