GPTON: Generative Pre-trained Transformers enhanced with Ontology Narration for accurate annotation of biological data

2024-10-12 · Rongbin Li, Wenbo Chen, Jinbo Li, Hanwen Xing, Hua Xu, Zhao Li, W. Jim Zheng

By leveraging GPT-4 for ontology narration, we developed GPTON to infuse structured knowledge into LLMs through verbalized ontology terms, achieving accurate text and ontology annotations for over 68% of gene sets in the top five predictions. Manual evaluations confirm GPTON's robustness, highlighting its potential to harness LLMs and structured knowledge to significantly advance biomedical research beyond gene set annotation.

📄 PDF Abstract BibTeX arXiv:2410.10899

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Adam 설명 없음

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Residual Connection 설명 없음

Position-Wise Feed-Forward Layer 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Ontology Enhanced Claim Detection

2024-02-19 · Zehra Melce Hüsünbeyi, Tatjana Scheffler

We propose an ontology enhanced model for sentence based claim detection. We fused ontology embeddings from a knowledge base with BERT sentence embeddings to perform claim detection for the ClaimBuster and the NewsClaims…

Sentence Sentence Embeddings Word Embeddings

Towards Ontology-Enhanced Representation Learning for Large Language Models

2024-05-30 · Francesco Ronzano, Jay Nanavati

Taking advantage of the widespread use of ontologies to organise and harmonize knowledge across several distinct domains, this paper proposes a novel approach to improve an embedding-Large Language Model (embedding-LLM) …

Contrastive Learning Language Modeling Language Modelling Large Language Model+1

OntoZSL: Ontology-enhanced Zero-shot Learning

2021-02-15 · Yuxia Geng, Jiaoyan Chen, Zhuo Chen, Jeff Z. Pan 외

Zero-shot Learning (ZSL), which aims to predict for those classes that have never appeared in the training data, has arisen hot research interests. The key of implementing ZSL is to leverage the prior knowledge of classe…

image-classification Image Classification Knowledge Graph Completion Word Embeddings+1

Copy-Enhanced Heterogeneous Information Learning for Dialogue State Tracking

2019-08-21 · Qingbin Liu, Shizhu He, Kang Liu, Shengping Liu 외

Dialogue state tracking (DST) is an essential component in task-oriented dialogue systems, which estimates user goals at every dialogue turn. However, most previous approaches usually suffer from the following problems. …

Decoder Dialogue State Tracking Task-Oriented Dialogue Systems

Towards Semantic Integration of Opinions: Unified Opinion Concepts Ontology and Extraction Task

2025-05-24 · Gaurav Negi, Dhairya Dalal, Omnia Zayed, Paul Buitelaar

This paper introduces the Unified Opinion Concepts (UOC) ontology to integrate opinions within their semantic context. The UOC ontology bridges the gap between the semantic representation of opinion across different form…