Prion-ViT: Prions-Inspired Vision Transformers for Temperature prediction with Specklegrams

2024-11-06 · Abhishek Sebastian, Pragna R, Sonaa Rajagopal, Muralikrishnan Mani

Fiber Specklegram Sensors (FSS) are vital for environmental monitoring due to their high temperature sensitivity, but their complex data poses challenges for predictive models. This study introduces Prion-ViT, a prion-inspired Vision Transformer model, inspired by biological prion memory mechanisms, to improve long-term dependency modeling and temperature prediction accuracy using FSS data. Prion-ViT leverages a persistent memory state to retain and propagate key features across layers, reducing mean absolute error (MAE) to 0.71$^\circ$C and outperforming models like ResNet, Inception Net V2, and Standard Vision Transformers. This paper also discusses Explainable AI (XAI) techniques, providing a perspective on specklegrams through attention and saliency maps, which highlight key regions contributing to predictions

📄 PDF Abstract BibTeX arXiv:2411.05836

Code (0)

등록된 구현이 없습니다.

Tasks

Temperature Prediction Using Specklegrams

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Kaiming Initialization 설명 없음

Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Eco-evolutionary tradeoffs in the dynamics of prion strain competition

2022-07-05 · Saul Acevedo, Alexander J. Stewart

Prion and prion-like molecules are a type of self replicating aggregate protein that have been implicated in a variety of neurodegenerative diseases. Over recent decades the molecular dynamics of prions have been charact…

Epidemiology

HeMiTo-dynamics: a characterisation of mammalian prion toxicity using non-dimensionalisation, linear stability and perturbation analyses

2024-05-16 · Johannes G. Borgqvist, Christoffer Gretarsson Alexandersen

Prion-like proteins play crucial parts in biological processes in organisms ranging from yeast to humans. For instance, many neurodegenerative diseases are believed to be caused by the production of prion-like proteins i…

Learning of signaling networks: molecular mechanisms

2020-01-31 · Péter Csermely, Nina Kunsic, Péter Mendik, Márk Kerestély 외

Molecular processes of neuronal learning have been well-described. However, learning mechanisms of non-neuronal cells have not been fully understood at the molecular level. Here, we discuss molecular mechanisms of cellul…

Drug Design

PrionNER: A Named Entity Recognition Dataset for Prion Disease Biomedical Literature

2026-05-27 · An Dao, Nhan Ly, Thao Tran, Yuji Matsumoto 외 arxiv

Prion diseases are rare, rapidly progressive, and fatal neurodegenerative disorders that remain difficult to diagnose, particularly in their early stages because of nonspecific clinical presentations. However, to our kno…

Information Extraction

Fine-tuning Vision Transformers for the Prediction of State Variables in Ising Models

2021-09-28 · Onur Kara, Arijit Sehanobish, Hector H Corzo

Transformers are state-of-the-art deep learning models that are composed of stacked attention and point-wise, fully connected layers designed for handling sequential data. Transformers are not only ubiquitous throughout …