Unsupervised learning with sparse space-and-time autoencoders
We use spatially-sparse two, three and four dimensional convolutional autoencoder networks to model sparse structures in 2D space, 3D space, and 3+1=4 dimensional space-time. We evaluate the resulting latent spaces by testing their usefulness for downstream tasks. Applications are to handwriting recognition in 2D, segmentation for parts in 3D objects, segmentation for objects in 3D scenes, and body-part segmentation for 4D wire-frame models generated from motion capture data.
Code (1)
Tasks
Handwriting RecognitionSegmentationSimilar Papers 제목 키워드 기반
Winner-Take-All Autoencoders
In this paper, we propose a winner-take-all method for learning hierarchical sparse representations in an unsupervised fashion. We first introduce fully-connected winner-take-all autoencoders which use mini-batch statist…
AllDistance Invariant Sparse Autoencoder for Wireless Signal Strength Mapping
Wireless signal strength based localization can enable robust localization for robots using inexpensive sensors. For this, a location-to-signal-strength map has to be learned for each access point in the environment. Due…
Data CompressionBag-of-Vectors Autoencoders for Unsupervised Conditional Text Generation
Text autoencoders are often used for unsupervised conditional text generation by applying mappings in the latent space to change attributes to the desired values. Recently, Mai et al. (2020) proposed Emb2Emb, a method to…
Conditional Text GenerationSentence SummarizationText GenerationDo Sparse Autoencoders Learn Meaningful Concept Hierarchies?
Sparse autoencoders (SAEs) have become an important tool for unsupervised concept discovery in large models. To make the resulting feature spaces more interpretable and manageable, recent approaches have begun imposing h…
AI Discovering a Coordinate System of Chemical Elements: Dual Representation by Variational Autoencoders
The periodic table is a fundamental representation of chemical elements that plays essential theoretical and practical roles. The research article discusses the experiences of unsupervised training of neural networks to …