paper-with-me

Papers

PyKale: Knowledge-Aware Machine Learning from Multiple Sources in Python

2021-06-17 · Haiping Lu, Xianyuan Liu, Robert Turner, Peizhen Bai, Raivo E Koot, Shuo Zhou, Mustafa Chasmai, Lawrence Schobs

Machine learning is a general-purpose technology holding promises for many interdisciplinary research problems. However, significant barriers exist in crossing disciplinary boundaries when most machine learning tools are developed in different areas separately. We present Pykale - a Python library for knowledge-aware machine learning on graphs, images, texts, and videos to enable and accelerate interdisciplinary research. We formulate new green machine learning guidelines based on standard software engineering practices and propose a novel pipeline-based application programming interface (API). PyKale focuses on leveraging knowledge from multiple sources for accurate and interpretable prediction, thus supporting multimodal learning and transfer learning (particularly domain adaptation) with latest deep learning and dimensionality reduction models. We build PyKale on PyTorch and leverage the rich PyTorch ecosystem. Our pipeline-based API design enforces standardization and minimalism, embracing green machine learning concepts via reducing repetitions and redundancy, reusing existing resources, and recycling learning models across areas. We demonstrate its interdisciplinary nature via examples in bioinformatics, knowledge graph, image/video recognition, and medical imaging.

📄 PDF Abstract BibTeX arXiv:2106.09756

Code (1)

pykale/pykale 공식 구현 pytorch

Tasks

BIG-bench Machine LearningDimensionality ReductionDomain AdaptationTransfer LearningVideo Recognition

Similar Papers 제목 키워드 기반

KSAM: Infusing Multi-Source Knowledge into Dialogue Generation via Knowledge Source Aware Multi-Head Decoding

2022-05-01 · Findings (ACL) 2022 5 · Sixing Wu, Ying Li, Dawei Zhang, Zhonghai Wu

Knowledge-enhanced methods have bridged the gap between human beings and machines in generating dialogue responses. However, most previous works solely seek knowledge from a single source, and thus they often fail to obt…

DecoderDialogue GenerationDiversity

Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources

2020-11-05 · COLING 2020 8 · Qianglong Chen, Feng Ji, Haiqing Chen, Yin Zhang

In order to facilitate natural language understanding, the key is to engage commonsense or background knowledge. However, how to engage commonsense effectively in question answering systems is still under exploration in …

Language ModelingLanguage ModellingNatural Language UnderstandingQuestion Answering+1

Team PyKale (xy9) Submission to the EPIC-Kitchens 2021 Unsupervised Domain Adaptation Challenge for Action Recognition

2021-06-22 · Xianyuan Liu, Raivo Koot, Shuo Zhou, Tao Lei 외

This report describes the technical details of our submission to the EPIC-Kitchens 2021 Unsupervised Domain Adaptation Challenge for Action Recognition. The EPIC-Kitchens dataset is more difficult than other video domain…

Action RecognitionDomain AdaptationUnsupervised Domain Adaptation

Confidence-Aware Multi-Teacher Knowledge Distillation

2021-12-30 · Hailin Zhang, Defang Chen, Can Wang

Knowledge distillation is initially introduced to utilize additional supervision from a single teacher model for the student model training. To boost the student performance, some recent variants attempt to exploit diver…

Knowledge DistillationTransfer Learning

Prior Knowledge Integration for Neural Machine Translation using Posterior Regularization

2018-11-02 · ACL 2017 7 · Jiacheng Zhang, Yang Liu, Huanbo Luan, Jingfang Xu 외

Although neural machine translation has made significant progress recently, how to integrate multiple overlapping, arbitrary prior knowledge sources remains a challenge. In this work, we propose to use posterior regulari…

Machine TranslationTranslation