paper-with-me

Papers

Multi-Task Learning with Loop Specific Attention for CDR Structure Prediction

2023-06-22 · Eleni Giovanoudi, Dimitrios Rafailidis

The Complementarity Determining Region (CDR) structure prediction of loops in antibody engineering has gained a lot of attraction by researchers. When designing antibodies, a main challenge is to predict the CDR structure of the H3 loop. Compared with the other CDR loops, that is the H1 and H2 loops, the CDR structure of the H3 loop is more challenging due to its varying length and flexible structure. In this paper, we propose a Multi-task learning model with Loop Specific Attention, namely MLSA. In particular, to the best of our knowledge we are the first to jointly learn the three CDR loops, via a novel multi-task learning strategy. In addition, to account for the structural and functional similarities and differences of the three CDR loops, we propose a loop specific attention mechanism to control the influence of each CDR loop on the training of MLSA. Our experimental evaluation on widely used benchmark data shows that the proposed MLSA method significantly reduces the prediction error of the CDR structure of the H3 loop, by at least 19%, when compared with other baseline strategies. Finally, for reproduction purposes we make the implementation of MLSA publicly available at https://anonymous.4open.science/r/MLSA-2442/.

📄 PDF Abstract BibTeX arXiv:2306.13045

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task Learning

Similar Papers 제목 키워드 기반

ReLoop: "Seeing Twice and Thinking Backwards" via Closed-loop Training to Mitigate Hallucinations in Multimodal understanding

2025-07-07 · Jianjiang Yang, Ziyan Huang, Yanshu Li

While Multimodal Large Language Models (MLLMs) have achieved remarkable progress in open-ended visual question answering, they remain vulnerable to hallucinations. These are outputs that contradict or misrepresent input …

HallucinationQuestion AnsweringVisual Question Answering

Looped Latent Attention: Cross-Loop KV Compression for Looped Transformers

2026-07-16 · James O' Neill, Fergal Reid arxiv

Looped, weight-tied Transformers reduce parameters by reusing a block, but decoding still stores a separate K/V cache for every recurrence step. We show that this loop-indexed cache is highly structured. For a fixed toke…

Negative Inner-Loop Learning Rates Learn Universal Features

2022-03-18 · Tom Starshak

Model Agnostic Meta-Learning (MAML) consists of two optimization loops: the outer loop learns a meta-initialization of model parameters that is shared across tasks, and the inner loop task-specific adaptation step. A var…

Meta-Learning

OneDrive: Unified Multi-Paradigm Driving with Vision-Language-Action Models

2026-04-20 · Yiwei Zhang, Xuesong Chen, Jin Gao, Hanshi Wang 외 arxiv

Vision-Language Models(VLMs) excel at autoregressive text generation, yet end-to-end autonomous driving requires multi-task learning with structured outputs and heterogeneous decoding behaviors, such as autoregressive la…

Multi-Task LearningTrajectory PlanningAutonomous DrivingObject Detection

LT2: Linear-Time Looped Transformers

2026-05-20 · Chunyuan Deng, Yizhe Zhang, Rui-Jie Zhu, Yuanyuan Xu 외 arxiv

Looped Transformers (LT) have emerged as a powerful architecture by iterating their layers multiple times before decoding the final token. However, pairing them with full attention retains quadratic complexity, making th…