Training for Fast Sequential Prediction Using Dynamic Feature Selection
We present paired learning and inference algorithms for significantly reducing computation and increasing speed of the vector dot products in the classifiers that are at the heart of many NLP components. This is accomplished by partitioning the features into a sequence of templates which are ordered such that high confidence can often be reached using only a small fraction of all features. Parameter estimation is arranged to maximize accuracy and early confidence in this sequence. We present experiments in left-to-right part-of-speech tagging on WSJ, demonstrating that we can preserve accuracy above 97% with over a five-fold reduction in run-time.
Code (0)
등록된 구현이 없습니다.
Tasks
feature selectionparameter estimationPart-Of-Speech TaggingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Aircraft Engines Remaining Useful Life Prediction with an Improved Online Sequential Extreme Learning Machine
The efficient data investigation for fast and accurate remaining useful life prediction of aircraft engines can be considered as a very important task for maintenance operations. In this context, the key issue is how an …
Lightning Fast Caching-based Parallel Denoising Prediction for Accelerating Talking Head Generation
Diffusion-based talking head models generate high-quality, photorealistic videos but suffer from slow inference, limiting practical applications. Existing acceleration methods for general diffusion models fail to exploit…
Talking Head GenerationTeaching Molecular Dynamics to a Non-Autoregressive Ionic Transport Predictor
Unlike most static material properties widely studied in the machine learning literature, ionic transport properties are inherently dynamic, making their fast and accurate prediction from static atomic structures challen…
Deep Sequential Context Networks for Action Prediction
This paper proposes efficient and powerful deep networks for action prediction from partially observed videos containing temporally incomplete action executions. Different from after-the-fact action recognition, action p…
Action RecognitionPredictionTemporal Action LocalizationFast Classification with Sequential Feature Selection in Test Phase
This paper introduces a novel approach to active feature acquisition for classification, which is the task of sequentially selecting the most informative subset of features to achieve optimal prediction performance durin…
Classificationfeature selection