paper-with-me

Papers

Enhancing Augmentative and Alternative Communication with Card Prediction and Colourful Semantics

2024-05-24 · Jayr Pereira, Francisco Rodrigues, Jaylton Pereira, Cleber Zanchettin, Robson Fidalgo

This paper presents an approach to enhancing Augmentative and Alternative Communication (AAC) systems by integrating Colourful Semantics (CS) with transformer-based language models specifically tailored for Brazilian Portuguese. We introduce an adapted BERT model, BERTptCS, which incorporates the CS framework for improved prediction of communication cards. The primary aim is to enhance the accuracy and contextual relevance of communication card predictions, which are essential in AAC systems for individuals with complex communication needs (CCN). We compared BERTptCS with a baseline model, BERTptAAC, which lacks CS integration. Our results demonstrate that BERTptCS significantly outperforms BERTptAAC in various metrics, including top-k accuracy, Mean Reciprocal Rank (MRR), and Entropy@K. Integrating CS into the language model improves prediction accuracy and offers a more intuitive and contextual understanding of user inputs, facilitating more effective communication.

📄 PDF Abstract BibTeX arXiv:2405.15896

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
WordPiece 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음

Similar Papers 제목 키워드 기반

Adapting Large Language Models for Character-based Augmentative and Alternative Communication

2025-01-17 · Dylan Gaines, Keith Vertanen

Users of Augmentative and Alternative Communication (AAC) may write letter-by-letter via an interface that uses a character language model. However, most state-of-the-art large pretrained language models predict subword …

Domain AdaptationLanguage ModelingLanguage ModellingLarge Language Model+1

Compositional Language Modeling for Icon-Based Augmentative and Alternative Communication

2018-07-01 · WS 2018 7 · Shiran Dudy, Steven Bedrick

Icon-based communication systems are widely used in the field of Augmentative and Alternative Communication. Typically, icon-based systems have lagged behind word- and character-based systems in terms of predictive typin…

Language ModelingLanguage ModellingSpoken Language Understanding

Predictive Authoring for Brazilian Portuguese Augmentative and Alternative Communication

2023-08-18 · Jayr Pereira, Rodrigo Nogueira, Cleber Zanchettin, Robson Fidalgo

Individuals with complex communication needs (CCN) often rely on augmentative and alternative communication (AAC) systems to have conversations and communique their wants. Such systems allow message authoring by arrangin…

PredictionSentence

Lexicon for Natural Language Generation in Spanish Adapted to Alternative and Augmentative Communication

2017-09-01 · WS 2017 9 · Silvia Garc{\'\i}a-M{\'e}ndez, Milagros Fern{\'a}ndez-Gavilanes, Enrique Costa-Montenegro, Jonathan Juncal-Mart{\'\i}nez 외
Speech RecognitionSpeech SynthesisText Generation

PicTalky: Augmentative and Alternative Communication Software for Language Developmental Disabilities

2021-09-27 · Chanjun Park, Yoonna Jang, Seolhwa Lee, Jaehyung Seo 외

Augmentative and alternative communication (AAC) is a practical means of communication for people with language disabilities. In this study, we propose PicTalky, which is an AI-based AAC system that helps children with l…