Learning Disentangled Representations of Texts with Application to Biomedical Abstracts
We propose a method for learning disentangled representations of texts that code for distinct and complementary aspects, with the aim of affording efficient model transfer and interpretability. To induce disentangled embeddings, we propose an adversarial objective based on the (dis)similarity between triplets of documents with respect to specific aspects. Our motivating application is embedding biomedical abstracts describing clinical trials in a manner that disentangles the populations, interventions, and outcomes in a given trial. We show that our method learns representations that encode these clinically salient aspects, and that these can be effectively used to perform aspect-specific retrieval. We demonstrate that the approach generalizes beyond our motivating application in experiments on two multi-aspect review corpora.
Code (1)
Tasks
RetrievalSimilar Papers 제목 키워드 기반
BALI: Enhancing Biomedical Language Representations through Knowledge Graph and Language Model Alignment
In recent years, there has been substantial progress in using pretrained Language Models (LMs) on a range of tasks aimed at improving the understanding of biomedical texts. Nonetheless, existing biomedical LLMs show limi…
Knowledge GraphsCondensedly: comprehending article contents through condensed texts
Summary: Abstracts in biomedical articles can provide a quick overview of the articles but detailed information cannot be obtained without reading full-text contents. Full-text articles certainly generate more informatio…
ArticlesDrug and Disease Interpretation Learning with Biomedical Entity Representation Transformer
Concept normalization in free-form texts is a crucial step in every text-mining pipeline. Neural architectures based on Bidirectional Encoder Representations from Transformers (BERT) have achieved state-of-the-art result…
Drug DiscoveryMetric LearningTransfer LearningTripletApplying Citizen Science to Gene, Drug, Disease Relationship Extraction from Biomedical Abstracts
Biomedical literature is growing at a rate that outpaces our ability to harness the knowledge contained therein. In order to mine valuable inferences from the large volume of literature, many researchers have turned to i…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)LIMSI @ WMT 2020
This paper describes LIMSI’s submissions to the translation shared tasks at WMT’20. This year we have focused our efforts on the biomedical translation task, developing a resource-heavy system for the translation of medi…
Domain AdaptationTranslation