Concept Tagging for Natural Language Understanding: Two Decadelong Algorithm Development
Concept tagging is a type of structured learning needed for natural language understanding (NLU) systems. In this task, meaning labels from a domain ontology are assigned to word sequences. In this paper, we review the algorithms developed over the last twenty five years. We perform a comparative evaluation of generative, discriminative and deep learning methods on two public datasets. We report on the statistical variability performance measurements. The third contribution is the release of a repository of the algorithms, datasets and recipes for NLU evaluation.
Code (1)
Tasks
Natural Language UnderstandingVocal Bursts Valence PredictionSimilar Papers 제목 키워드 기반
Knowledge Tagging with Large Language Model based Multi-Agent System
Knowledge tagging for questions is vital in modern intelligent educational applications, including learning progress diagnosis, practice question recommendations, and course content organization. Traditionally, these ann…
Language ModelingLanguage ModellingLarge Language ModelMathÉtiquetage ou génération de séquences pour la compréhension automatique du langage en contexte d’interaction? (Sequence tagging or sequence generation for Natural Language Understanding ?)
La tâche de compréhension automatique du langage en contexte d’interaction (NLU pour Natural Language Understanding) est souvent réduite à la détection d’intentions et de concepts sur des corpus mono-domaines annotés ave…
Natural Language UnderstandingAutomate Knowledge Concept Tagging on Math Questions with LLMs
Knowledge concept tagging for questions plays a crucial role in contemporary intelligent educational applications, including learning progress diagnosis, practice question recommendations, and course content organization…
Few-Shot LearningMathEnhancing Slot Tagging with Intent Features for Task Oriented Natural Language Understanding using BERT
Recent joint intent detection and slot tagging models have seen improved performance when compared to individual models. In many real-world datasets, the slot labels and values have a strong correlation with their intent…
Intent DetectionNatural Language UnderstandingEvaluating the Impact of Phrase Recognition on Concept Tagging
We have developed DBpedia Spotlight, a flexible concept tagging system that is able to annotate entities, topics and other terms in natural language text. The system starts by recognizing phrases to annotate in the input…
Entity LinkingNamed Entity Recognition (NER)Word Sense Disambiguation