Domain Adaptation of SRL Systems for Biological Processes
Domain adaptation remains one of the most challenging aspects in the wide-spread use of Semantic Role Labeling (SRL) systems. Current state-of-the-art methods are typically trained on large-scale datasets, but their performances do not directly transfer to low-resource domain-specific settings. In this paper, we propose two approaches for domain adaptation in the biological domain that involves pre-training LSTM-CRF based on existing large-scale datasets and adapting it for a low-resource corpus of biological processes. Our first approach defines a mapping between the source labels and the target labels, and the other approach modifies the final CRF layer in sequence-labeling neural network architecture. We perform our experiments on ProcessBank dataset which contains less than 200 paragraphs on biological processes. We improve over the previous state-of-the-art system on this dataset by 21 F1 points. We also show that, by incorporating event-event relationship in ProcessBank, we are able to achieve an additional 2.6 F1 gain, giving us possible insights into how to improve SRL systems for biological process using richer annotations.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSemantic Role LabelingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Probabilistic Measures for Biological Adaptation and Resilience
This paper introduces a novel approach to quantifying ecological resilience in biological systems, particularly focusing on noisy systems responding to episodic disturbances with sudden adaptations. Incorporating concept…
Neurobiology and Changing Ecosystems: toward understanding the impact of anthropogenic influences on neurons and circuits
Rapid anthropogenic environmental changes, including those due to habitat contamination, degradation, and climate change, have far-reaching effects on biological systems that may outpace animals' adaptive responses (Radc…
Domain adaptation in small-scale and heterogeneous biological datasets
Machine learning techniques are steadily becoming more important in modern biology, and are used to build predictive models, discover patterns, and investigate biological problems. However, models trained on one dataset …
Domain AdaptationTransfer LearningBenchmarking Domain Adaptation for Chemical Processes on the Tennessee Eastman Process
In system monitoring, automatic fault diagnosis seeks to infer the systems' state based on sensor readings, e.g., through machine learning models. In this context, it is of key importance that, based on historical data, …
BenchmarkingDomain AdaptationFault DiagnosisMulti-Source Unsupervised Domain Adaptation+1Mixtures of Neural Cellular Automata: A Stochastic Framework for Growth Modelling and Self-Organization
Neural Cellular Automata (NCAs) are a promising new approach to model self-organizing processes, with potential applications in life science. However, their deterministic nature limits their ability to capture the stocha…
Image SegmentationSemantic Segmentation