Imitation learning for structured prediction in natural language processing
Imitation learning is a learning paradigm originally developed to learn robotic controllers from demonstrations by humans, e.g. autonomous flight from pilot demonstrations. Recently, algorithms for structured prediction were proposed under this paradigm and have been applied successfully to a number of tasks including syntactic dependency parsing, information extraction, coreference resolution, dynamic feature selection, semantic parsing and natural language generation. Key advantages are the ability to handle large output search spaces and to learn with non-decomposable loss functions. Our aim in this tutorial is to have a unified presentation of the various imitation algorithms for structure prediction, and show how they can be applied to a variety of NLP tasks.All material associated with the tutorial will be made available through https://sheffieldnlp.github.io/ImitationLearningTutorialEACL2017/.
Code (0)
등록된 구현이 없습니다.
Tasks
coreference-resolutionCoreference ResolutionDependency Parsingfeature selectionImitation LearningSemantic ParsingStructured PredictionText GenerationSimilar Papers 제목 키워드 기반
DeepSPIN: Deep Structured Prediction for Natural Language Processing
DeepSPIN is a research project funded by the European Research Council (ERC) whose goal is to develop new neural structured prediction methods, models, and algorithms for improving the quality, interpretability, and data…
Machine TranslationPredictionStructured PredictionTranslationProceedings of the 2nd Workshop on Structured Prediction for Natural Language Processing
Gray-box inference for structured Gaussian process models
We develop an automated variational inference method for Bayesian structured prediction problems with Gaussian process (GP) priors and linear-chain likelihoods. Our approach does not need to know the details of the struc…
Stochastic OptimizationStructured PredictionVariational InferenceA Survey of Active Learning for Natural Language Processing
In this work, we provide a survey of active learning (AL) for its applications in natural language processing (NLP). In addition to a fine-grained categorization of query strategies, we also investigate several other imp…
Active LearningStructured PredictionSurveyImitation learning for language generation from unaligned data
Natural language generation (NLG) is the task of generating natural language from a meaning representation. Current rule-based approaches require domain-specific and manually constructed linguistic resources, while most …
Imitation LearningStructured PredictionText Generation