paper-with-me

Papers

Bridging Large Language Models and Single-Cell Transcriptomics in Dissecting Selective Motor Neuron Vulnerability

2025-05-12 · Douglas Jiang, Zilin Dai, Luxuan Zhang, Qiyi Yu, Haoqi Sun, Feng Tian

Understanding cell identity and function through single-cell level sequencing data remains a key challenge in computational biology. We present a novel framework that leverages gene-specific textual annotations from the NCBI Gene database to generate biologically contextualized cell embeddings. For each cell in a single-cell RNA sequencing (scRNA-seq) dataset, we rank genes by expression level, retrieve their NCBI Gene descriptions, and transform these descriptions into vector embedding representations using large language models (LLMs). The models used include OpenAI text-embedding-ada-002, text-embedding-3-small, and text-embedding-3-large (Jan 2024), as well as domain-specific models BioBERT and SciBERT. Embeddings are computed via an expression-weighted average across the top N most highly expressed genes in each cell, providing a compact, semantically rich representation. This multimodal strategy bridges structured biological data with state-of-the-art language modeling, enabling more interpretable downstream applications such as cell-type clustering, cell vulnerability dissection, and trajectory inference.

📄 PDF Abstract BibTeX arXiv:2505.07896

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling

Similar Papers 제목 키워드 기반

Language-Enhanced Representation Learning for Single-Cell Transcriptomics

2025-03-12 · Yaorui Shi, Jiaqi Yang, Changhao Nai, Sihang Li 외

Single-cell RNA sequencing (scRNA-seq) offers detailed insights into cellular heterogeneity. Recent advancements leverage single-cell large language models (scLLMs) for effective representation learning. These models foc…

Language ModelingLanguage ModellingRepresentation Learning

CASPER: Cross-modal Alignment of Spatial and single-cell Profiles for Expression Recovery

2025-11-19 · Amit Kumar, Maninder Kaur, Raghvendra Mall, Sukrit Gupta arxiv

Spatial Transcriptomics enables mapping of gene expression within its native tissue context, but current platforms measure only a limited set of genes due to experimental constraints and excessive costs. To overcome this…

Gene Incremental Learning for Single-Cell Transcriptomics

2025-11-14 · Jiaxin Qi, Yan Cui, Jianqiang Huang, Gaogang Xie arxiv

Classes, as fundamental elements of Computer Vision, have been extensively studied within incremental learning frameworks. In contrast, tokens, which play essential roles in many research fields, exhibit similar characte…

Class Incremental Learning

Graph Neural Networks as a Substitute for Transformers in Single-Cell Transcriptomics

2025-07-05 · Jiaxin Qi, Yan Cui, Jinli Ou, Jianqiang Huang 외 arxiv

Graph Neural Networks (GNNs) and Transformers share significant similarities in their encoding strategies for interacting with features from nodes of interest, where Transformers use query-key scores and GNNs use edges. …

A Systematic Overview of Single-Cell Transcriptomics Databases, their Use cases, and Limitations

2024-04-15 · Mahnoor N. Gondal, Saad Ur Rehman Shah, Arul M. Chinnaiyan, Marcin Cieslik

Rapid advancements in high-throughput single-cell RNA-seq (scRNA-seq) technologies and experimental protocols have led to the generation of vast amounts of genomic data that populates several online databases and reposit…