Weakly Supervised Object Detection for Automatic Tooth-marked Tongue Recognition
Tongue diagnosis in Traditional Chinese Medicine (TCM) is a crucial diagnostic method that can reflect an individual's health status. Traditional methods for identifying tooth-marked tongues are subjective and inconsistent because they rely on practitioner experience. We propose a novel fully automated Weakly Supervised method using Vision transformer and Multiple instance learning WSVM for tongue extraction and tooth-marked tongue recognition. Our approach first accurately detects and extracts the tongue region from clinical images, removing any irrelevant background information. Then, we implement an end-to-end weakly supervised object detection method. We utilize Vision Transformer (ViT) to process tongue images in patches and employ multiple instance loss to identify tooth-marked regions with only image-level annotations. WSVM achieves high accuracy in tooth-marked tongue classification, and visualization experiments demonstrate its effectiveness in pinpointing these regions. This automated approach enhances the objectivity and accuracy of tooth-marked tongue diagnosis. It provides significant clinical value by assisting TCM practitioners in making precise diagnoses and treatment recommendations. Code is available at https://github.com/yc-zh/WSVM.
Code (1)
Tasks
DiagnosticMultiple Instance Learningobject-detectionObject DetectionWeakly Supervised Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
When 3D Partial Points Meets SAM: Tooth Point Cloud Segmentation with Sparse Labels
Tooth point cloud segmentation is a fundamental task in many orthodontic applications. Current research mainly focuses on fully supervised learning which demands expensive and tedious manual point-wise annotation. Althou…
Point Cloud SegmentationRepresentation LearningYou Reap What You Sow: Using Videos to Generate High Precision Object Proposals for Weakly-Supervised Object Detection
We propose a novel way of using videos to obtain high precision object proposals for weakly-supervised object detection. Existing weakly-supervised detection approaches use off-the-shelf proposal methods like edge boxes…
Objectobject-detectionObject DetectionRegion Proposal+1Track and Transfer: Watching Videos to Simulate Strong Human Supervision for Weakly-Supervised Object Detection
The status quo approach to training object detectors requires expensive bounding box annotations. Our framework takes a markedly different direction: we transfer tracked object boxes from weakly-labeled videos to weakly-…
Objectobject-detectionObject DetectionWeakly Supervised Object DetectionWeakly Supervised Object Detection in Artworks
We propose a method for the weakly supervised detection of objects in paintings. At training time, only image-level annotations are needed. This, combined with the efficiency of our multiple-instance learning method, ena…
Multiple Instance LearningObjectobject-detectionObject Detection+1Weakly Supervised Image Annotation and Segmentation with Objects and Attributes
We propose to model complex visual scenes using a non-parametric Bayesian model learned from weakly labelled images abundant on media sharing sites such as Flickr. Given weak image-level annotations of objects and attrib…
AttributeObjectobject-detectionObject Detection+3