Recent Advancements in Self-Supervised Paradigms for Visual Feature Representation
We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human annotation. To avoid the cost of labeling data, self-supervised methods were proposed to make use of largely available unlabeled data. This study conducts a comprehensive and insightful survey and analysis of recent developments in the self-supervised paradigm for feature representation. In this paper, we investigate the factors affecting the usefulness of self-supervision under different settings. We present some of the key insights concerning two different approaches in self-supervision, generative and contrastive methods. We also investigate the limitations of supervised adversarial training and how self-supervision can help overcome those limitations. We then move on to discuss the limitations and challenges in effectively using self-supervision for visual tasks. Finally, we highlight some open problems and point out future research directions.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Review on Visual-SLAM: Advancements from Geometric Modelling to Learning-based Semantic Scene Understanding
Simultaneous Localisation and Mapping (SLAM) is one of the fundamental problems in autonomous mobile robots where a robot needs to reconstruct a previously unseen environment while simultaneously localising itself with r…
Scene UnderstandingDisCont: Self-Supervised Visual Attribute Disentanglement using Context Vectors
Disentangling the underlying feature attributes within an image with no prior supervision is a challenging task. Models that can disentangle attributes well provide greater interpretability and control. In this paper, we…
AttributeContrastive LearningDisentanglementA Survey on MLLM-based Visually Rich Document Understanding: Methods, Challenges, and Emerging Trends
Visually-Rich Document Understanding (VRDU) has emerged as a critical field, driven by the need to automatically process documents containing complex visual, textual, and layout information. Recently, Multimodal Large La…
document understandingOptical Character RecognitionOptical Character Recognition (OCR)Imagined Speech and Visual Imagery as Intuitive Paradigms for Brain-Computer Interfaces
Brain-computer interfaces (BCIs) have shown promise in enabling communication for individuals with motor impairments. Recent advancements like brain-to-speech technology aim to reconstruct speech from neural activity. Ho…
Brain Computer InterfaceEEGFunctional ConnectivityProMerge: Prompt and Merge for Unsupervised Instance Segmentation
Unsupervised instance segmentation aims to segment distinct object instances in an image without relying on human-labeled data. This field has recently seen significant advancements, partly due to the strong local corres…
Instance SegmentationSemantic SegmentationUnsupervised Instance Segmentation