paper-with-me

Papers

Using Ontologies To Improve Performance In Massively Multi-label Prediction Models

2019-05-28 · Ethan Steinberg, Peter J. Liu

Massively multi-label prediction/classification problems arise in environments like health-care or biology where very precise predictions are useful. One challenge with massively multi-label problems is that there is often a long-tailed frequency distribution for the labels, which results in few positive examples for the rare labels. We propose a solution to this problem by modifying the output layer of a neural network to create a Bayesian network of sigmoids which takes advantage of ontology relationships between the labels to help share information between the rare and the more common labels. We apply this method to the two massively multi-label tasks of disease prediction (ICD-9 codes) and protein function prediction (Gene Ontology terms) and obtain significant improvements in per-label AUROC and average precision for less common labels.

📄 PDF Abstract BibTeX arXiv:1905.12126

Code (0)

등록된 구현이 없습니다.

Tasks

Disease PredictionGeneral ClassificationPredictionProtein Function Prediction

Similar Papers 제목 키워드 기반

Using Ontologies To Improve Performance In Massively Multi-label Prediction

2019-05-01 · ICLR 2019 5 · Ethan Steinberg, Peter J. Liu

Massively multi-label prediction/classification problems arise in environments like health-care or biology where it is useful to make very precise predictions. One challenge with massively multi-label problems is that th…

Disease PredictionGeneral ClassificationPredictionProtein Function Prediction

M2D2: A Massively Multi-domain Language Modeling Dataset

2022-10-13 · Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer

We present M2D2, a fine-grained, massively multi-domain corpus for studying domain adaptation in language models (LMs). M2D2 consists of 8.5B tokens and spans 145 domains extracted from Wikipedia and Semantic Scholar. Us…

Domain AdaptationDomain GeneralizationLanguage ModelingLanguage Modelling

A Review of Multilingualism in and for Ontologies

2022-10-06 · Frances Gillis-Webber, C. Maria Keet

The Multilingual Semantic Web has been in focus for over a decade. Multilingualism in Linked Data and RDF has shown substantial adoption, but this is unclear for ontologies since the last review 15 years ago. One of the …

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation

2019-09-01 · Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan 외

The recently proposed massively multilingual neural machine translation (NMT) system has been shown to be capable of translating over 100 languages to and from English within a single model. Its improved translation perf…

Cross-Lingual TransferMachine TranslationNMTTransfer Learning+1

Pseudo-Labeling for Massively Multilingual Speech Recognition

2021-10-30 · Loren Lugosch, Tatiana Likhomanenko, Gabriel Synnaeve, Ronan Collobert

Semi-supervised learning through pseudo-labeling has become a staple of state-of-the-art monolingual speech recognition systems. In this work, we extend pseudo-labeling to massively multilingual speech recognition with 6…

speech-recognitionSpeech Recognition