Bootstrapping Generators from Noisy Data
A core step in statistical data-to-text generation concerns learning correspondences between structured data representations (e.g., facts in a database) and associated texts. In this paper we aim to bootstrap generators from large scale datasets where the data (e.g., DBPedia facts) and related texts (e.g., Wikipedia abstracts) are loosely aligned. We tackle this challenging task by introducing a special-purpose content selection mechanism. We use multi-instance learning to automatically discover correspondences between data and text pairs and show how these can be used to enhance the content signal while training an encoder-decoder architecture. Experimental results demonstrate that models trained with content-specific objectives improve upon a vanilla encoder-decoder which solely relies on soft attention.
Code (1)
Tasks
Data-to-Text GenerationDecoderText GenerationSimilar Papers 제목 키워드 기반
Bootstrapping Cognitive Agents with a Large Language Model
Large language models contain noisy general knowledge of the world, yet are hard to train or fine-tune. On the other hand cognitive architectures have excellent interpretability and are flexible to update but require a l…
General KnowledgeLanguage ModelingLanguage ModellingLarge Language ModelBLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
Vision-Language Pre-training (VLP) has advanced the performance for many vision-language tasks. However, most existing pre-trained models only excel in either understanding-based tasks or generation-based tasks. Furtherm…
Image CaptioningImage-text matchingImage-text RetrievalOpen Vocabulary Attribute Detection+4Hand Keypoint Detection in Single Images using Multiview Bootstrapping
We present an approach that uses a multi-camera system to train fine-grained detectors for keypoints that are prone to occlusion, such as the joints of a hand. We call this procedure multiview bootstrapping: first, an in…
Keypoint DetectionA Comparison of Character Neural Language Model and Bootstrapping for Language Identification in Multilingual Noisy Texts
This paper seeks to examine the effect of including background knowledge in the form of character pre-trained neural language model (LM), and data bootstrapping to overcome the problem of unbalanced limited resources. As…
Language IdentificationLanguage ModelingLanguage ModellingMulti-Task LearningImproving GANs for Speech Enhancement
Generative adversarial networks (GAN) have recently been shown to be efficient for speech enhancement. However, most, if not all, existing speech enhancement GANs (SEGAN) make use of a single generator to perform one-sta…
Speech Enhancement