paper-with-me

Papers

MSA Transformer

2021-02-13 · Roshan Rao, Jason Liu, Robert Verkuil, Joshua Meier, John F. Canny, Pieter Abbeel, Tom Sercu, Alexander Rives

Unsupervised protein language models trained across millions of diverse sequences learn structure and function of proteins. Protein language models studied to date have been trained to perform inference from individual sequences. The longstanding approach in computational biology has been to make inferences from a family of evolutionarily related sequences by fitting a model to each family independently. In this work we combine the two paradigms. We introduce a protein language model which takes as input a set of sequences in the form of a multiple sequence alignment. The model interleaves row and column attention across the input sequences and is trained with a variant of the masked language modeling objective across many protein families. The performance of the model surpasses current state-of-the-art unsupervised structure learning methods by a wide margin, with far greater parameter efficiency than prior state-of-the-art protein language models.

📄 PDF Abstract BibTeX

Code (1)

The-AI-Summer/self-attention-cv pytorch

Tasks

Language ModelingLanguage ModellingMasked Language ModelingMultiple Sequence AlignmentProtein Language Model

Similar Papers 제목 키워드 기반

Efficient Visual Transformer by Learnable Token Merging

2024-07-21 · Yancheng Wang, Yingzhen Yang

Self-attention and transformers have been widely used in deep learning. Recent efforts have been devoted to incorporating transformer blocks into different neural architectures, including those with convolutions, leading…

Gaze Estimation using Transformer

2021-05-30 · Yihua Cheng, Feng Lu

Recent work has proven the effectiveness of transformers in many computer vision tasks. However, the performance of transformers in gaze estimation is still unexplored. In this paper, we employ transformers and assess th…

Gaze Estimation

Compact Vision Transformer by Reduction of Kernel Complexity

2025-07-17 · Yancheng Wang, Yingzhen Yang arxiv

Self-attention and transformer architectures have become foundational components in modern deep learning. Recent efforts have integrated transformer blocks into compact neural architectures for computer vision, giving ri…

Transformer-VQ: Linear-Time Transformers via Vector Quantization

2023-09-28 · Lucas D. Lingle

We introduce Transformer-VQ, a decoder-only transformer computing softmax-based dense self-attention in linear time. Transformer-VQ's efficient attention is enabled by vector-quantized keys and a novel caching mechanism.…

8kDecoderQuantization

PyramidTNT: Improved Transformer-in-Transformer Baselines with Pyramid Architecture

2022-01-04 · Kai Han, Jianyuan Guo, Yehui Tang, Yunhe Wang

Transformer networks have achieved great progress for computer vision tasks. Transformer-in-Transformer (TNT) architecture utilizes inner transformer and outer transformer to extract both local and global representations…