paper-with-me

홈 › Papers

Recent Advancements in Self-Supervised Paradigms for Visual Feature Representation

2021-11-03 · Mrinal Anand, Aditya Garg

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human annotation. To avoid the cost of labeling data, self-supervised methods were proposed to make use of largely available unlabeled data. This study conducts a comprehensive and insightful survey and analysis of recent developments in the self-supervised paradigm for feature representation. In this paper, we investigate the factors affecting the usefulness of self-supervision under different settings. We present some of the key insights concerning two different approaches in self-supervision, generative and contrastive methods. We also investigate the limitations of supervised adversarial training and how self-supervision can help overcome those limitations. We then move on to discuss the limitations and challenges in effectively using self-supervision for visual tasks. Finally, we highlight some open problems and point out future research directions.

📄 PDF Abstract BibTeX arXiv:2111.02042

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Review on Visual-SLAM: Advancements from Geometric Modelling to Learning-based Semantic Scene Understanding

2022-09-12 · Tin Lai

Simultaneous Localisation and Mapping (SLAM) is one of the fundamental problems in autonomous mobile robots where a robot needs to reconstruct a previously unseen environment while simultaneously localising itself with r…

Scene Understanding

DisCont: Self-Supervised Visual Attribute Disentanglement using Context Vectors

2020-06-10 · Sarthak Bhagat, Vishaal Udandarao, Shagun Uppal

Disentangling the underlying feature attributes within an image with no prior supervision is a challenging task. Models that can disentangle attributes well provide greater interpretability and control. In this paper, we…

AttributeContrastive LearningDisentanglement

A Survey on MLLM-based Visually Rich Document Understanding: Methods, Challenges, and Emerging Trends

2025-07-14 · Yihao Ding, Siwen Luo, Yue Dai, Yanbei Jiang 외

Visually-Rich Document Understanding (VRDU) has emerged as a critical field, driven by the need to automatically process documents containing complex visual, textual, and layout information. Recently, Multimodal Large La…

document understandingOptical Character RecognitionOptical Character Recognition (OCR)

Imagined Speech and Visual Imagery as Intuitive Paradigms for Brain-Computer Interfaces

2024-11-14 · Seo-Hyun Lee, Ji-Ha Park, Deok-Seon Kim

Brain-computer interfaces (BCIs) have shown promise in enabling communication for individuals with motor impairments. Recent advancements like brain-to-speech technology aim to reconstruct speech from neural activity. Ho…

Brain Computer InterfaceEEGFunctional Connectivity

ProMerge: Prompt and Merge for Unsupervised Instance Segmentation

2024-09-27 · Dylan Li, Gyungin Shin

Unsupervised instance segmentation aims to segment distinct object instances in an image without relying on human-labeled data. This field has recently seen significant advancements, partly due to the strong local corres…

Instance SegmentationSemantic SegmentationUnsupervised Instance Segmentation