Interpreting Audiograms with Multi-stage Neural Networks
Audiograms are a particular type of line charts representing individuals' hearing level at various frequencies. They are used by audiologists to diagnose hearing loss, and further select and tune appropriate hearing aids for customers. There have been several projects such as Autoaudio that aim to accelerate this process through means of machine learning. But all existing models at their best can only detect audiograms in images and classify them into general categories. They are unable to extract hearing level information from detected audiograms by interpreting the marks, axis, and lines. To address this issue, we propose a Multi-stage Audiogram Interpretation Network (MAIN) that directly reads hearing level data from photos of audiograms. We also established Open Audiogram, an open dataset of audiogram images with annotations of marks and axes on which we trained and evaluated our proposed model. Experiments show that our model is feasible and reliable.
Code (1)
Similar Papers 제목 키워드 기반
No Audiogram: Leveraging Existing Scores for Personalized Speech Intelligibility Prediction
Personalized speech intelligibility prediction is challenging. Previous approaches have mainly relied on audiograms, which are inherently limited in accuracy as they only capture a listener's hearing threshold for pure t…
Predictionspeech-recognitionSpeech RecognitionRefine-IQA: Multi-Stage Reinforcement Finetuning for Perceptual Image Quality Assessment
Reinforcement fine-tuning (RFT) is a proliferating paradigm for LMM training. Analogous to high-level reasoning tasks, RFT is similarly applicable to low-level vision domains, including image quality assessment (IQA). Ex…
Image Quality AssessmentAudiogram Digitization Tool for Audiological Reports
A number of private and public insurers compensate workers whose hearing loss can be directly attributed to excessive exposure to noise in the workplace. The claim assessment process is typically lengthy and requires sig…
High Fidelity Text-to-Speech Via Discrete Tokens Using Token Transducer and Group Masked Language Model
We propose a novel two-stage text-to-speech (TTS) framework with two types of discrete tokens, i.e., semantic and acoustic tokens, for high-fidelity speech synthesis. It features two core components: the Interpreting mod…
Computational EfficiencyLanguage ModelingLanguage ModellingSpeech Synthesis+2Causal Reasoning through Two Layers of Cognition for Improving Generalization in Visual Question Answering
Generalization in Visual Question Answering (VQA) requires models to answer questions about images with contexts beyond the training distribution. Existing attempts primarily refine unimodal aspects, overlooking enhancem…
Answer GenerationQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)