paper-with-me

홈 › Papers

Towards a Standardized, Fine-grained Manual Annotation Protocol for Verbal Fluency Data

2020-12-01 · COLING (LAW) 2020 12 · Gabriel McKee, Joël Macoir, Lydia Gagnon, Pascale Tremblay

We propose a new method for annotating verbal fluency data, which allows the reliable detection of the age-related decline of lexical access capacity. The main innovation is that annotators should inferentially assess the intention of the speaker when producing a word form during a verbal fluency test. Our method correlates probable speaker inten-tions such as “intended as a valid answer” or “intended as a meta-comment” with lin-guistic features such as word intensity (e.g. reduced intensity suggests private speech) and syntactic integration. The annotation scheme can be implemented with high reliabil-ity, and minimal linguistic training. When fluency data are annotated using this scheme, a relation between fluency and age emerges; this is in contrast to a strict implementation of the traditional method of annotating verbal fluency data, which has no way of deal-ing with score-confounding phenomena because it force-groups all verbal fluency pro-ductions –regardless of speaker intention— into one of three taxonomic groups (i.e. val-id answers, perseverations, and intrusions). The traditional lack of fine-grained annota-tion units is especially problematic when analyzing the qualitatively distinct fluency da-ta of older participants and may cause studies to miss the relation between lexical access capacity and age.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

valid

Similar Papers 제목 키워드 기반

Tomato Multi-Angle Multi-Pose Dataset for Fine-Grained Phenotyping

2025-07-15 · Yujie Zhang, Sabine Struckmeyer, Andreas Kolb, Sven Reichardt

Observer bias and inconsistencies in traditional plant phenotyping methods limit the accuracy and reproducibility of fine-grained plant analysis. To overcome these challenges, we developed TomatoMAP, a comprehensive data…

Instance Segmentationobject-detectionObject DetectionPlant Phenotyping+1

Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability,Reproducibility, and Practicality

2024-06-13 · Tianle Zhang, Langtian Ma, Yuchen Yan, Yuchen Zhang 외

Recent text-to-video (T2V) technology advancements, as demonstrated by models such as Gen2, Pika, and Sora, have significantly broadened its applicability and popularity. Despite these strides, evaluating these models po…

ThreatCore: A Benchmark for Explicit and Implicit Threat Detection

2026-05-11 · Davide Bruni, Carlo Bardazzi, Maurizio Tesconi arxiv

Threat detection in Natural Language Processing lacks consistent definitions and standardized benchmarks, and is often conflated with broader phenomena such as toxicity, hate speech, or offensive language. In this work, …

Semantic Role Labeling

NordFKB: a fine-grained benchmark dataset for geospatial AI in Norway

2025-12-10 · Sander Riisøen Jyhne, Aditya Gupta, Ben Worsley, Marianne Andersen 외 arxiv

We present NordFKB, a fine-grained benchmark dataset for geospatial AI in Norway, derived from the authoritative, highly accurate, national Felles KartdataBase (FKB). The dataset contains high-resolution orthophotos pair…

Semantic SegmentationObject Detection

RatSeizure: A Benchmark and Saliency-Context Transformer for Rat Seizure Localization

2026-03-25 · Ting Yu Tsai, An Yu, Lucy Lee, Felix X. -F. Ye 외 arxiv

Animal models, particularly rats, play a critical role in seizure research for studying epileptogenesis and treatment response. However, progress is limited by the lack of datasets with precise temporal annotations and s…

Temporal Action Localization