paper-with-me

Papers

Masked Video Modeling with Correlation-aware Contrastive Learning for Breast Cancer Diagnosis in Ultrasound

2022-08-21 · Zehui Lin, Ruobing Huang, Dong Ni, Jiayi Wu, Baoming Luo

Breast cancer is one of the leading causes of cancer deaths in women. As the primary output of breast screening, breast ultrasound (US) video contains exclusive dynamic information for cancer diagnosis. However, training models for video analysis is non-trivial as it requires a voluminous dataset which is also expensive to annotate. Furthermore, the diagnosis of breast lesion faces unique challenges such as inter-class similarity and intra-class variation. In this paper, we propose a pioneering approach that directly utilizes US videos in computer-aided breast cancer diagnosis. It leverages masked video modeling as pretraining to reduce reliance on dataset size and detailed annotations. Moreover, a correlation-aware contrastive loss is developed to facilitate the identifying of the internal and external relationship between benign and malignant lesions. Experimental results show that our proposed approach achieved promising classification performance and can outperform other state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2208.09881

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive Learning

Similar Papers 제목 키워드 기반

Understanding Self-Supervised Pretraining with Part-Aware Representation Learning

2023-01-27 · Jie Zhu, Jiyang Qi, Mingyu Ding, Xiaokang Chen 외

In this paper, we are interested in understanding self-supervised pretraining through studying the capability that self-supervised representation pretraining methods learn part-aware representations. The study is mainly …

Contrastive LearningObjectRepresentation Learning

CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising

2021-12-14 · Jianjie Luo, Yehao Li, Yingwei Pan, Ting Yao 외

BERT-type structure has led to the revolution of vision-language pre-training and the achievement of state-of-the-art results on numerous vision-language downstream tasks. Existing solutions dominantly capitalize on the …

Cross-Modal RetrievalDecoderDenoisingLanguage Modeling+6

Counterfactual Cross-modality Reasoning for Weakly Supervised Video Moment Localization

2023-08-10 · Zezhong Lv, Bing Su, Ji-Rong Wen

Video moment localization aims to retrieve the target segment of an untrimmed video according to the natural language query. Weakly supervised methods gains attention recently, as the precise temporal location of the tar…

Contrastive Learningcounterfactual

Less is More: Decoder-Free Masked Modeling for Efficient Skeleton Representation Learning

2026-03-11 · Jeonghyeok Do, Yun Chen, Geunhyuk Youk, Munchurl Kim arxiv

The landscape of skeleton-based action representation learning has evolved from Contrastive Learning (CL) to Masked Auto-Encoder (MAE) architectures. However, each paradigm faces inherent limitations: CL often overlooks …

Representation LearningContrastive Learning

SyncLipMAE: Contrastive Masked Pretraining for Audio-Visual Talking-Face Representation

2025-10-11 · Zeyu Ling, Xiaodong Gu, Jiangnan Tang, Changqing Zou arxiv

We introduce SyncLipMAE, a self-supervised pretraining framework for talking-face video that learns synchronization-aware and transferable facial dynamics from unlabeled audio-visual streams. Our approach couples masked …

Visual Speech RecognitionAction Recognition