paper-with-me

Papers

Fine-Grained Self-Supervised Learning with Jigsaw Puzzles for Medical Image Classification

2023-08-10 · Wongi Park, Jongbin Ryu

Classifying fine-grained lesions is challenging due to minor and subtle differences in medical images. This is because learning features of fine-grained lesions with highly minor differences is very difficult in training deep neural networks. Therefore, in this paper, we introduce Fine-Grained Self-Supervised Learning(FG-SSL) method for classifying subtle lesions in medical images. The proposed method progressively learns the model through hierarchical block such that the cross-correlation between the fine-grained Jigsaw puzzle and regularized original images is close to the identity matrix. We also apply hierarchical block for progressive fine-grained learning, which extracts different information in each step, to supervised learning for discovering subtle differences. Our method does not require an asymmetric model, nor does a negative sampling strategy, and is not sensitive to batch size. We evaluate the proposed fine-grained self-supervised learning method on comprehensive experiments using various medical image recognition datasets. In our experiments, the proposed method performs favorably compared to existing state-of-the-art approaches on the widely-used ISIC2018, APTOS2019, and ISIC2017 datasets.

📄 PDF Abstract BibTeX arXiv:2308.05770

Code (1)

kalelpark/FG-SSL 공식 구현 pytorch

Tasks

image-classificationImage ClassificationMedical Image ClassificationSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Jigsaw Jigsaw is a self-supervision approach that relies on jigsaw-like puzzles as the pretext task in order to learn image representations.

Similar Papers 제목 키워드 기반

Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw Puzzles

2022-07-20 · Guodong Wang, Yunhong Wang, Jie Qin, Dongming Zhang 외

Video Anomaly Detection (VAD) is an important topic in computer vision. Motivated by the recent advances in self-supervised learning, this paper addresses VAD by solving an intuitive yet challenging pretext task, i.e., s…

Anomaly DetectionSelf-Supervised LearningVideo Anomaly Detection

Jigsaw-ViT: Learning Jigsaw Puzzles in Vision Transformer

2022-07-25 · Yingyi Chen, Xi Shen, Yahui Liu, Qinghua Tao 외

The success of Vision Transformer (ViT) in various computer vision tasks has promoted the ever-increasing prevalence of this convolution-free network. The fact that ViT works on image patches makes it potentially relevan…

ClassificationDomain Generalizationimage-classificationImage Classification+2

Learning Image Representations by Completing Damaged Jigsaw Puzzles

2018-02-06 · Dahun Kim, Donghyeon Cho, Donggeun Yoo, In So Kweon

In this paper, we explore methods of complicating self-supervised tasks for representation learning. That is, we do severe damage to data and encourage a network to recover them. First, we complicate each of three powerf…

ColorizationRepresentation LearningSemantic SegmentationTransfer Learning

Self-Supervised Video Representation Learning with Constrained Spatiotemporal Jigsaw

2021-01-01 · Yuqi Huo, Mingyu Ding, Haoyu Lu, Zhiwu Lu 외

This paper proposes a novel pretext task for self-supervised video representation learning by exploiting spatiotemporal continuity in videos. It is motivated by the fact that videos are spatiotemporal by nature and a rep…

Representation Learning

Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzles

2025-05-29 · Zifu Wang, Junyi Zhu, Bo Tang, Zhiyu Li 외

The application of rule-based reinforcement learning (RL) to multimodal large language models (MLLMs) introduces unique challenges and potential deviations from findings in text-only domains, particularly for perception-…

Reinforcement Learning (RL)