NERdME: a Named Entity Recognition Dataset for Indexing Research Artifacts in Code Repositories
Existing scholarly information extraction (SIE) datasets focus on scientific papers and overlook implementation-level details in code repositories. README files describe datasets, source code, and other implementation-level artifacts, however, their free-form Markdown offers little semantic structure, making automatic information extraction difficult. To address this gap, NERdME is introduced: 200 manually annotated README files with over 10,000 labeled spans and 10 entity types. Baseline results using large language models and fine-tuned transformers show clear differences between paperlevel and implementation-level entities, indicating the value of extending SIE benchmarks with entity types available in README files. A downstream entity-linking experiment was conducted to demonstrate that entities derived from READMEs can support artifact discovery and metadata integration.
Code (0)
등록된 구현이 없습니다.
Tasks
Information ExtractionSimilar Papers 제목 키워드 기반
Chemical Identification and Indexing in PubMed Articles via BERT and Text-to-Text Approaches
The Biocreative VII Track-2 challenge consists of named entity recognition, entity-linking (or entity-normalization), and topic indexing tasks -- with entities and topics limited to chemicals for this challenge. Named en…
ArticlesChemical IndexingEntity LinkingMetric Learning+5Named Entity Recognition with Extremely Limited Data
Traditional information retrieval treats named entity recognition as a pre-indexing corpus annotation task, allowing entity tags to be indexed and used during search. Named entity taggers themselves are typically trained…
Information Retrievalnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2The overview of the NLM-Chem BioCreative VII track: full-text chemical identification and indexing in PubMed articles
The BioCreative NLM-Chem track calls for a community effort to fine-tune automated recognition of chemical names in biomedical literature. Chemical names are one of the most searched biomedical entities in PubMed and – a…
ArticlesChemical Entity RecognitionChemical IndexingEntity Linking+3A Deep Learning-Based System for PharmaCoNER
The Biological Text Mining Unit at BSC and CNIO organized the first shared task on chemical {\&} drug mention recognition from Spanish medical texts called PharmaCoNER (Pharmacological Substances, Compounds and proteins …
Deep LearningGeneral Classificationnamed-entity-recognitionNamed Entity Recognition+2HIVE-4-MAT: Advancing the Ontology Infrastructure for Materials Science
Introduces HIVE-4-MAT - Helping Interdisciplinary Vocabulary Engineering for Materials Science, an automatic linked data ontology application. Covers contextual background for materials science, shared ontology infrastru…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Relation+1