Extracting Structured Scholarly Information from the Machine Translation Literature
Understanding the experimental results of a scientific paper is crucial to understanding its contribution and to comparing it with related work. We introduce a structured, queryable representation for experimental results and a baseline system that automatically populates this representation. The representation can answer compositional questions such as: {`}Which are the best published results reported on the NIST 09 Chinese to English dataset?{''} and {`}What are the most important methods for speeding up phrase-based decoding?{''} Answering such questions usually involves lengthy literature surveys. Current machine reading for academic papers does not usually consider the actual experiments, but mostly focuses on understanding abstracts. We describe annotation work to create an initial hscientific paper; experimental results representationi corpus. The corpus is composed of 67 papers which were manually annotated with a structured representation of experimental results by domain experts. Additionally, we present a baseline algorithm that characterizes the difficulty of the inference task.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationReading ComprehensionTranslationSimilar Papers 제목 키워드 기반
Understanding and representing the semantics of large structured documents
Understanding large, structured documents like scholarly articles, requests for proposals or business reports is a complex and difficult task. It involves discovering a document's overall purpose and subject(s), understa…
ArticlesMORTY: Structured Summarization for Targeted Information Extraction from Scholarly Articles
Information extraction from scholarly articles is a challenging task due to the sizable document length and implicit information hidden in text, figures, and citations. Scholarly information extraction has various applic…
ArticlesManagementnamed-entity-recognitionNamed Entity Recognition+2May I take your order? A Neural Model for Extracting Structured Information from Conversations
In this paper we tackle a unique and important problem of extracting a structured order from the conversation a customer has with an order taker at a restaurant. This is motivated by an actual system under development to…
Machine TranslationTranslationNew Methods for Metadata Extraction from Scientific Literature
Within the past few decades we have witnessed digital revolution, which moved scholarly communication to electronic media and also resulted in a substantial increase in its volume. Nowadays keeping track with the latest …
ArticlesNLPContributions: An Annotation Scheme for Machine Reading of Scholarly Contributions in Natural Language Processing Literature
We describe an annotation initiative to capture the scholarly contributions in natural language processing (NLP) articles, particularly, for the articles that discuss machine learning (ML) approaches for various informat…
ArticlesMachine Translationnamed-entity-recognitionNamed Entity Recognition+6