Biomedical NER for the Enterprise with Distillated BERN2 and the Kazu Framework
In order to assist the drug discovery/development process, pharmaceutical companies often apply biomedical NER and linking techniques over internal and public corpora. Decades of study of the field of BioNLP has produced a plethora of algorithms, systems and datasets. However, our experience has been that no single open source system meets all the requirements of a modern pharmaceutical company. In this work, we describe these requirements according to our experience of the industry, and present Kazu, a highly extensible, scalable open source framework designed to support BioNLP for the pharmaceutical sector. Kazu is a built around a computationally efficient version of the BERN2 NER model (TinyBERN2), and subsequently wraps several other BioNLP technologies into one coherent system. KAZU framework is open-sourced: https://github.com/AstraZeneca/KAZU
Code (1)
Tasks
Drug DiscoveryNERSimilar Papers 제목 키워드 기반
BERN2: an advanced neural biomedical named entity recognition and normalization tool
In biomedical natural language processing, named entity recognition (NER) and named entity normalization (NEN) are key tasks that enable the automatic extraction of biomedical entities (e.g. diseases and drugs) from the …
graph constructionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1A Neural Named Entity Recognition and Multi-Type Normalization Tool for Biomedical Text Mining
The amount of biomedical literature is vast and growing quickly, and accurate text mining techniques could help researchers to efficiently extract useful information from the literature. However, existing named entity re…
ArticlesInformation Retrievalnamed-entity-recognitionNamed Entity Recognition+3Cybernaut: Towards Reliable Web Automation
The emergence of AI-driven web automation through Large Language Models (LLMs) offers unprecedented opportunities for optimizing digital workflows. However, deploying such systems within industry's real-world environment…
Katib: A Distributed General AutoML Platform on Kubernetes
Automatic Machine Learning (AutoML) is a powerful mechanism to design and tune models. We present Katib, a scalable Kubernetes-native general AutoML platform that can support a range of AutoML algorithms including both h…
AutoMLHyperparameter OptimizationManagementNeural Architecture SearchTowards Carbon-Aware Container Orchestration: Predicting Workload Energy Consumption with Federated Learning
The growing reliance on large-scale data centers to run resource-intensive workloads has significantly increased the global carbon footprint, underscoring the need for sustainable computing solutions. While container orc…
Federated Learning