Dr. Tongue: Sign-Oriented Multi-label Detection for Remote Tongue Diagnosis
Tongue diagnosis is a vital tool in Western and Traditional Chinese Medicine, providing key insights into a patient's health by analyzing tongue attributes. The COVID-19 pandemic has heightened the need for accurate remote medical assessments, emphasizing the importance of precise tongue attribute recognition via telehealth. To address this, we propose a Sign-Oriented multi-label Attributes Detection framework. Our approach begins with an adaptive tongue feature extraction module that standardizes tongue images and mitigates environmental factors. This is followed by a Sign-oriented Network (SignNet) that identifies specific tongue attributes, emulating the diagnostic process of experienced practitioners and enabling comprehensive health evaluations. To validate our methodology, we developed an extensive tongue image dataset specifically designed for telemedicine. Unlike existing datasets, ours is tailored for remote diagnosis, with a comprehensive set of attribute labels. This dataset will be openly available, providing a valuable resource for research. Initial tests have shown improved accuracy in detecting various tongue attributes, highlighting our framework's potential as an essential tool for remote medical assessments.
Code (1)
Tasks
AttributeDiagnosticMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Weakly Supervised Object Detection for Automatic Tooth-marked Tongue Recognition
Tongue diagnosis in Traditional Chinese Medicine (TCM) is a crucial diagnostic method that can reflect an individual's health status. Traditional methods for identifying tooth-marked tongues are subjective and inconsiste…
DiagnosticMultiple Instance Learningobject-detectionObject Detection+1Predicting tongue motion in unlabeled ultrasound videos using convolutional LSTM neural network
A challenge in speech production research is to predict future tongue movements based on a short period of past tongue movements. This study tackles speaker-dependent tongue motion prediction problem in unlabeled ultraso…
motion predictionTongueSAM: An Universal Tongue Segmentation Model Based on SAM with Zero-Shot
Tongue segmentation serves as the primary step in automated TCM tongue diagnosis, which plays a significant role in the diagnostic results. Currently, numerous deep learning based methods have achieved promising results.…
DiagnosticInteractive Segmentationobject-detectionObject Detection+3Tongue contour extraction from ultrasound images based on deep neural network
Studying tongue motion during speech using ultrasound is a standard procedure, but automatic ultrasound image labelling remains a challenge, as standard tongue shape extraction methods typically require human interventio…
A Deep Learning Approach to Tongue Detection for Pediatric Population
Children with severe disabilities and complex communication needs face limitations in the usage of access technology (AT) devices. Conventional ATs (e.g., mechanical switches) can be insufficient for nonverbal children a…
ClassificationDeep LearningGeneral ClassificationGesture Recognition