An Algebra for Feature Extraction
Though feature extraction is a necessary first step in statistical NLP, it is often seen as a mere preprocessing step. Yet, it can dominate computation time, both during training, and especially at deployment. In this paper, we formalize feature extraction from an algebraic perspective. Our formalization allows us to define a message passing algorithm that can restructure feature templates to be more computationally efficient. We show via experiments on text chunking and relation extraction that this restructuring does indeed speed up feature extraction in practice by reducing redundant computation.
Code (0)
등록된 구현이 없습니다.
Tasks
ChunkingRelation ExtractionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Algebraic Fitting for Multiple Circle Primitives Extraction from Raw Point Clouds
The shape of circle is one of fundamental geometric primitives of man-made engineering objects. Thus, extraction of circles from scanned point clouds is a quite important task in 3D geometry data processing. However, exi…
3D geometryRecognition of feature curves on 3D shapes using an algebraic approach to Hough transforms
Feature curves are largely adopted to highlight shape features, such as sharp lines, or to divide surfaces into meaningful segments, like convex or concave regions. Extracting these curves is not sufficient to convey pro…
Syntax-semantics interface: an algebraic model
We extend our formulation of Merge and Minimalism in terms of Hopf algebras to an algebraic model of a syntactic-semantic interface. We show that methods adopted in the formulation of renormalization (extraction of meani…
modelWYSIWYE: An Algebra for Expressing Spatial and Textual Rules for Visual Information Extraction
The visual layout of a webpage can provide valuable clues for certain types of Information Extraction (IE) tasks. In traditional rule based IE frameworks, these layout cues are mapped to rules that operate on the HTML so…
Feature-Based Lie Group Transformer for Real-World Applications
The main goal of representation learning is to acquire meaningful representations from real-world sensory inputs without supervision. Representation learning explains some aspects of human development. Various neural net…
ObjectObject RecognitionRepresentation LearningSemantic Segmentation+1