A Human Subject Study of Named Entity Recognition (NER) in Conversational Music Recommendation Queries
We conducted a human subject study of named entity recognition on a noisy corpus of conversational music recommendation queries, with many irregular and novel named entities. We evaluated the human NER linguistic behaviour in these challenging conditions and compared it with the most common NER systems nowadays, fine-tuned transformers. Our goal was to learn about the task to guide the design of better evaluation methods and NER algorithms. The results showed that NER in our context was quite hard for both human and algorithms under a strict evaluation schema; humans had higher precision, while the model higher recall because of entity exposure especially during pre-training; and entity types had different error patterns (e.g. frequent typing errors for artists). The released corpus goes beyond predefined frames of interaction and can support future work in conversational music recommendation.
Code (1)
Tasks
Music Recommendationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERSimilar Papers 제목 키워드 기반
Named Entity Recognition with Extremely Limited Data
Traditional information retrieval treats named entity recognition as a pre-indexing corpus annotation task, allowing entity tags to be indexed and used during search. Named entity taggers themselves are typically trained…
Information Retrievalnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2Named Entity Recognition in COVID-19 tweets with Entity Knowledge Augmentation
The COVID-19 pandemic causes severe social and economic disruption around the world, raising various subjects that are discussed over social media. Identifying pandemic-related named entities as expressed on social media…
Turkish Named Entity Recognition: A Survey and Comparative Analysis
Named entity recognition is a challenging task that has been widely studied in English. Although there are some efforts for named entity recognition in Turkish language, the reported results are limited to particular dat…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)SurveyRoBERTa-based Traditional Chinese Medicine Named Entity Recognition Model
In this study, a named entity recognition was constructed and applied to the identification of Chinese medicine names and disease names. The results can be further used in a human-machine dialogue system to provide peopl…
Articlesnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Latvian and Lithuanian Named Entity Recognition with TildeNER
In this paper the author presents TildeNER ― an open source freely available named entity recognition toolkit and the first multi-class named entity recognition system for Latvian and Lithuanian languages. The system i…
Machine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)