paper-with-me

Papers

Recurrent Complex-Weighted Autoencoders for Unsupervised Object Discovery

2024-05-27 · Anand Gopalakrishnan, Aleksandar Stanić, Jürgen Schmidhuber, Michael Curtis Mozer

Current state-of-the-art synchrony-based models encode object bindings with complex-valued activations and compute with real-valued weights in feedforward architectures. We argue for the computational advantages of a recurrent architecture with complex-valued weights. We propose a fully convolutional autoencoder, SynCx, that performs iterative constraint satisfaction: at each iteration, a hidden layer bottleneck encodes statistically regular configurations of features in particular phase relationships; over iterations, local constraints propagate and the model converges to a globally consistent configuration of phase assignments. Binding is achieved simply by the matrix-vector product operation between complex-valued weights and activations, without the need for additional mechanisms that have been incorporated into current synchrony-based models. SynCx outperforms or is strongly competitive with current models for unsupervised object discovery. SynCx also avoids certain systematic grouping errors of current models, such as the inability to separate similarly colored objects without additional supervision.

📄 PDF Abstract BibTeX arXiv:2405.17283

Code (1)

agopal42/syncx 공식 구현 pytorch

Tasks

ObjectObject Discovery

Similar Papers 제목 키워드 기반

Source-Agnostic Gravitational-Wave Detection with Recurrent Autoencoders

2021-07-27 · Eric A. Moreno, Jean-Roch Vlimant, Maria Spiropulu, Bartlomiej Borzyszkowski 외

We present an application of anomaly detection techniques based on deep recurrent autoencoders to the problem of detecting gravitational wave signals in laser interferometers. Trained on noise data, this class of algorit…

Anomaly DetectionGravitational Wave Detection

Exploiting Spatio-Temporal Structure with Recurrent Winner-Take-All Networks

2016-10-31 · Eder Santana, Matthew Emigh, Pablo Zegers, Jose C. Principe

We propose a convolutional recurrent neural network, with Winner-Take-All dropout for high dimensional unsupervised feature learning in multi-dimensional time series. We apply the proposedmethod for object recognition wi…

AllObject RecognitionTime SeriesTime Series Analysis

ODDObjects: A Framework for Multiclass Unsupervised Anomaly Detection on Masked Objects

2021-04-26 · Ricky Ma

This paper presents a novel framework for unsupervised anomaly detection on masked objects called ODDObjects, which stands for Out-of-Distribution Detection on Objects. ODDObjects is designed to detect anomalies of vario…

Anomaly DetectionImage ReconstructionObject RecognitionOut-of-Distribution Detection+1

Unsupervised Boosting-based Autoencoder Ensembles for Outlier Detection

2019-10-22 · Hamed Sarvari, Carlotta Domeniconi, Bardh Prenkaj, Giovanni Stilo

Autoencoders, as a dimensionality reduction technique, have been recently applied to outlier detection. However, neural networks are known to be vulnerable to overfitting, and therefore have limited potential in the unsu…

Dimensionality ReductionDiversityOutlier Detection

Unsupervised Anomaly Detection in Process-Complex Industrial Time Series: A Real-World Case Study

2026-04-15 · Sergej Krasnikov, Lukas Meitz, Samineh Bagheri, Michael Heider 외 arxiv

Industrial time-series data from real production environments exhibits substantially higher complexity than commonly used benchmark datasets, primarily due to heterogeneous, multi-stage operational processes. As a result…

Unsupervised Anomaly Detection