paper-with-me

Papers

Contrastive Self-Supervised Learning for Spatio-Temporal Analysis of Lung Ultrasound Videos

2023-10-14 · Li Chen, Jonathan Rubin, Jiahong Ouyang, Naveen Balaraju, Shubham Patil, Courosh Mehanian, Sourabh Kulhare, Rachel Millin, Kenton W Gregory, Cynthia R Gregory, Meihua Zhu, David O Kessler, Laurie Malia, Almaz Dessie, Joni Rabiner, Di Coneybeare, Bo Shopsin, Andrew Hersh, Cristian Madar, Jeffrey Shupp, Laura S Johnson, Jacob Avila, Kristin Dwyer, Peter Weimersheimer, Balasundar Raju, Jochen Kruecker, Alvin Chen

Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art contrastive learning SSL methods to 2D+time medical ultrasound video data by introducing a modified encoder and augmentation method capable of learning meaningful spatio-temporal representations, without requiring constraints on the input data. We evaluate our method on the challenging clinical task of identifying lung consolidations (an important pathological feature) in ultrasound videos. Using a multi-center dataset of over 27k lung ultrasound videos acquired from over 500 patients, we show that our method can significantly improve performance on downstream localization and classification of lung consolidation. Comparisons against baseline models trained without SSL show that the proposed methods are particularly advantageous when the size of labeled training data is limited (e.g., as little as 5% of the training set).

📄 PDF Abstract BibTeX arXiv:2310.10689

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Spatio-temporal Contrastive Domain Adaptation for Action Recognition

2021-06-19 · CVPR 2021 1 · Xiaolin Song, Sicheng Zhao, Jingyu Yang, Huanjing Yue 외

Unsupervised domain adaptation (UDA) for human action recognition is a practical and challenging problem. Compared with image-based UDA, video-based UDA is comprehensive to bridge the domain shift on both spatial rep…

Action RecognitionContrastive LearningDomain AdaptationSelf-Supervised Learning+2

Contrastive Spatio-Temporal Pretext Learning for Self-supervised Video Representation

2021-12-16 · Yujia Zhang, Lai-Man Po, Xuyuan Xu, Mengyang Liu 외

Spatio-temporal representation learning is critical for video self-supervised representation. Recent approaches mainly use contrastive learning and pretext tasks. However, these approaches learn representation by discrim…

Contrastive LearningRepresentation LearningVideo Understanding

The Impact of Spatiotemporal Augmentations on Self-Supervised Audiovisual Representation Learning

2021-10-13 · Haider Al-Tahan, Yalda Mohsenzadeh

Contrastive learning of auditory and visual perception has been extremely successful when investigated individually. However, there are still major questions on how we could integrate principles learned from both domains…

Contrastive LearningRepresentation LearningSelf-Supervised Learning

CHAIN: Exploring Global-Local Spatio-Temporal Information for Improved Self-Supervised Video Hashing

2023-10-29 · Rukai Wei, Yu Liu, Jingkuan Song, Heng Cui 외

Compressing videos into binary codes can improve retrieval speed and reduce storage overhead. However, learning accurate hash codes for video retrieval can be challenging due to high local redundancy and complex global d…

Contrastive LearningRetrievalVideo Retrieval

Pretrained Encoders are All You Need

2021-06-09 · ICML Workshop URL 2021 7 · Mina Khan, P Srivatsa, Advait Rane, Shriram Chenniappa 외

Data-efficiency and generalization are key challenges in deep learning and deep reinforcement learning as many models are trained on large-scale, domain-specific, and expensive-to-label datasets. Self-supervised models t…

AllContrastive LearningDeep Reinforcement Learningreinforcement-learning+2