It Takes Two Flints to Make a Fire: Multitask Learning of Neural Relation and Explanation Classifiers
We propose an explainable approach for relation extraction that mitigates the tension between generalization and explainability by jointly training for the two goals. Our approach uses a multi-task learning architecture, which jointly trains a classifier for relation extraction, and a sequence model that labels words in the context of the relation that explain the decisions of the relation classifier. We also convert the model outputs to rules to bring global explanations to this approach. This sequence model is trained using a hybrid strategy: supervised, when supervision from pre-existing patterns is available, and semi-supervised otherwise. In the latter situation, we treat the sequence model's labels as latent variables, and learn the best assignment that maximizes the performance of the relation classifier. We evaluate the proposed approach on the two datasets and show that the sequence model provides labels that serve as accurate explanations for the relation classifier's decisions, and, importantly, that the joint training generally improves the performance of the relation classifier. We also evaluate the performance of the generated rules and show that the new rules are great add-on to the manual rules and bring the rule-based system much closer to the neural models.
Code (1)
Tasks
Multi-Task LearningRelationRelation ExtractionSimilar Papers 제목 키워드 기반
Robust Burned Area Delineation through Multitask Learning
In recent years, wildfires have posed a significant challenge due to their increasing frequency and severity. For this reason, accurate delineation of burned areas is crucial for environmental monitoring and post-fire as…
Burned Area DelineationLand Cover ClassificationSegmentationSemantic SegmentationHigh-Resolution Remote Sensing Bitemporal Image Change Detection Based on Feature Interaction and Multitask Learning
With the development of remote sensing technology, high-resolution (HR) remote sensing optical images have gradually become the main source of change detection data. Albeit, the change detection for HR remote sensing ima…
Change DetectionDomain AdaptationDense Forecasting of Wildfire Smoke Particulate Matter Using Sparsity Invariant Convolutional Neural Networks
Accurate forecasts of fine particulate matter (PM 2.5) from wildfire smoke are crucial to safeguarding cardiopulmonary public health. Existing forecasting systems are trained on sparse and inaccurate ground truths, and d…
Intermediate-layer output Regularization for Attention-based Speech Recognition with Shared Decoder
Intermediate layer output (ILO) regularization by means of multitask training on encoder side has been shown to be an effective approach to yielding improved results on a wide range of end-to-end ASR frameworks. In this …
Decoderspeech-recognitionSpeech RecognitionMitigating Greenhouse Gas Emissions Through Generative Adversarial Networks Based Wildfire Prediction
Over the past decade, the number of wildfire has increased significantly around the world, especially in the State of California. The high-level concentration of greenhouse gas (GHG) emitted by wildfires aggravates globa…
Data AugmentationGenerative Adversarial NetworkPrediction