Unsupervised Learning Layers for Video Analysis
This paper presents two unsupervised learning layers (UL layers) for label-free video analysis: one for fully connected layers, and the other for convolutional ones. The proposed UL layers can play two roles: they can be the cost function layer for providing global training signal; meanwhile they can be added to any regular neural network layers for providing local training signals and combined with the training signals backpropagated from upper layers for extracting both slow and fast changing features at layers of different depths. Therefore, the UL layers can be used in either pure unsupervised or semi-supervised settings. Both a closed-form solution and an online learning algorithm for two UL layers are provided. Experiments with unlabeled synthetic and real-world videos demonstrated that the neural networks equipped with UL layers and trained with the proposed online learning algorithm can extract shape and motion information from video sequences of moving objects. The experiments demonstrated the potential applications of UL layers and online learning algorithm to head orientation estimation and moving object localization.
Code (0)
등록된 구현이 없습니다.
Tasks
Object LocalizationSimilar Papers 제목 키워드 기반
Unsupervised Microscopy Video Denoising
In this paper, we introduce a novel unsupervised network to denoise microscopy videos featured by image sequences captured by a fixed location microscopy camera. Specifically, we propose a DeepTemporal Interpolation meth…
DenoisingVideo Denoising"Double-DIP": Unsupervised Image Decomposition via Coupled Deep-Image-Priors
Many seemingly unrelated computer vision tasks can be viewed as a special case of image decomposition into separate layers. For example, image segmentation (separation into foreground and background layers); transparent …
Image DehazingImage SegmentationSemantic SegmentationTransparency Separation+1"Double-DIP": Unsupervised Image Decomposition via Coupled Deep-Image-Priors
Many seemingly unrelated computer vision tasks can be viewed as a special case of image decomposition into separate layers. For example, image segmentation (separation into foreground and background layers); transparent…
Image DehazingImage SegmentationSemantic SegmentationTransparency Separation+1Contrastive Learning for Sports Video: Unsupervised Player Classification
We address the problem of unsupervised classification of players in a team sport according to their team affiliation, when jersey colours and design are not known a priori. We adopt a contrastive learning approach in whi…
ClassificationContrastive LearningGeneral ClassificationUnsupervised Video Interpolation by Learning Multilayered 2.5D Motion Fields
The problem of video frame interpolation is to increase the temporal resolution of a low frame-rate video, by interpolating novel frames between existing temporally sparse frames. This paper presents a self-supervised ap…
Video Frame Interpolation