paper-with-me

홈 › Papers

DiffSDA: Unsupervised Diffusion Sequential Disentanglement Across Modalities

2025-10-07 · Hedi Zisling, Ilan Naiman, Nimrod Berman, Supasorn Suwajanakorn, Omri Azencot arxiv

Unsupervised representation learning, particularly sequential disentanglement, aims to separate static and dynamic factors of variation in data without relying on labels. This remains a challenging problem, as existing approaches based on variational autoencoders and generative adversarial networks often rely on multiple loss terms, complicating the optimization process. Furthermore, sequential disentanglement methods face challenges when applied to real-world data, and there is currently no established evaluation protocol for assessing their performance in such settings. Recently, diffusion models have emerged as state-of-the-art generative models, but no theoretical formalization exists for their application to sequential disentanglement. In this work, we introduce the Diffusion Sequential Disentanglement Autoencoder (DiffSDA), a novel, modal-agnostic framework effective across diverse real-world data modalities, including time series, video, and audio. DiffSDA leverages a new probabilistic modeling, latent diffusion, and efficient samplers, while incorporating a challenging evaluation protocol for rigorous testing. Our experiments on diverse real-world benchmarks demonstrate that DiffSDA outperforms recent state-of-the-art methods in sequential disentanglement.

📄 PDF Abstract BibTeX arXiv:2510.05717

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Towards Robust Unsupervised Disentanglement of Sequential Data -- A Case Study Using Music Audio

2022-05-12 · Yin-Jyun Luo, Sebastian Ewert, Simon Dixon

Disentangled sequential autoencoders (DSAEs) represent a class of probabilistic graphical models that describes an observed sequence with dynamic latent variables and a static latent variable. The former encode informati…

Data AugmentationDisentanglementInductive Bias

S3VAE: Self-Supervised Sequential VAE for Representation Disentanglement and Data Generation

2020-05-23 · CVPR 2020 6 · Yizhe Zhu, Martin Renqiang Min, Asim Kadav, Hans Peter Graf

We propose a sequential variational autoencoder to learn disentangled representations of sequential data (e.g., videos and audios) under self-supervision. Specifically, we exploit the benefits of some readily accessible …

Disentanglement

DiViD: Disentangled Video Diffusion for Static-Dynamic Factorization

2025-07-18 · Marzieh Gheisari, Auguste Genovesio arxiv

Unsupervised disentanglement of static appearance and dynamic motion in video remains a fundamental challenge, often hindered by information leakage and blurry reconstructions in existing VAE- and GAN-based approaches. W…

Closed-Loop Unsupervised Representation Disentanglement with $β$-VAE Distillation and Diffusion Probabilistic Feedback

2024-02-04 · Xin Jin, Bohan Li, Baao Xie, Wenyao Zhang 외

Representation disentanglement may help AI fundamentally understand the real world and thus benefit both discrimination and generation tasks. It currently has at least three unresolved core issues: (i) heavy reliance on …

DisentanglementImage Manipulation

Multifactor Sequential Disentanglement via Structured Koopman Autoencoders

2023-03-30 · Nimrod Berman, Ilan Naiman, Omri Azencot

Disentangling complex data to its latent factors of variation is a fundamental task in representation learning. Existing work on sequential disentanglement mostly provides two factor representations, i.e., it separates t…

DisentanglementInductive BiasRepresentation Learning