paper-with-me

홈 › Papers

Hyperbolic Genome Embeddings

2025-07-29 · Raiyan R. Khan, Philippe Chlenski, Itsik Pe'er arxiv

Current approaches to genomic sequence modeling often struggle to align the inductive biases of machine learning models with the evolutionarily-informed structure of biological systems. To this end, we formulate a novel application of hyperbolic CNNs that exploits this structure, enabling more expressive DNA sequence representations. Our strategy circumvents the need for explicit phylogenetic mapping while discerning key properties of sequences pertaining to core functional and regulatory behavior. Across 37 out of 42 genome interpretation benchmark datasets, our hyperbolic models outperform their Euclidean equivalents. Notably, our approach even surpasses state-of-the-art performance on seven GUE benchmark datasets, consistently outperforming many DNA language models while using orders of magnitude fewer parameters and avoiding pretraining. Our results include a novel set of benchmark datasets--the Transposable Elements Benchmark--which explores a major but understudied component of the genome with deep evolutionary significance. We further motivate our work by exploring how our hyperbolic models recognize genomic signal under various data-generating conditions and by constructing an empirical method for interpreting the hyperbolicity of dataset embeddings. Throughout these assessments, we find persistent evidence highlighting the potential of our hyperbolic framework as a robust paradigm for genome representation learning. Our code and benchmark datasets are available at https://github.com/rrkhan/HGE.

📄 PDF Abstract BibTeX arXiv:2507.21648

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Skip-gram word embeddings in hyperbolic space

2018-08-30 · Matthias Leimeister, Benjamin J. Wilson

Recent work has demonstrated that embeddings of tree-like graphs in hyperbolic space surpass their Euclidean counterparts in performance by a large margin. Inspired by these results and scale-free structure in the word c…

Learning Word EmbeddingsWord EmbeddingsWord Similarity

Complex Hyperbolic Knowledge Graph Embeddings with Fast Fourier Transform

2022-11-07 · Huiru Xiao, Xin Liu, Yangqiu Song, Ginny Y. Wong 외

The choice of geometric space for knowledge graph (KG) embeddings can have significant effects on the performance of KG completion tasks. The hyperbolic geometry has been shown to capture the hierarchical patterns due to…

Knowledge Graph Embeddings

Low-rank approximations of hyperbolic embeddings

2019-03-18 · Pratik Jawanpuria, Mayank Meghwanshi, Bamdev Mishra

The hyperbolic manifold is a smooth manifold of negative constant curvature. While the hyperbolic manifold is well-studied in the literature, it has gained interest in the machine learning and natural language processing…

Hyperbolic vs Euclidean Embeddings in Few-Shot Learning: Two Sides of the Same Coin

2023-09-18 · Gabriel Moreira, Manuel Marques, João Paulo Costeira, Alexander Hauptmann

Recent research in representation learning has shown that hierarchical data lends itself to low-dimensional and highly informative representations in hyperbolic space. However, even if hyperbolic embeddings have gathered…

Few-Shot LearningRepresentation Learning

Balanced Hyperbolic Embeddings Are Natural Out-of-Distribution Detectors

2025-06-11 · Tejaswi Kasarla, Max van Spengler, Pascal Mettes

Out-of-distribution recognition forms an important and well-studied problem in deep learning, with the goal to filter out samples that do not belong to the distribution on which a network has been trained. The conclusion…

Out-of-Distribution Generalization