paper-with-me

Papers

Diffusion Nets

2015-06-25 · Gal Mishne, Uri Shaham, Alexander Cloninger, Israel Cohen

Non-linear manifold learning enables high-dimensional data analysis, but requires out-of-sample-extension methods to process new data points. In this paper, we propose a manifold learning algorithm based on deep learning to create an encoder, which maps a high-dimensional dataset and its low-dimensional embedding, and a decoder, which takes the embedded data back to the high-dimensional space. Stacking the encoder and decoder together constructs an autoencoder, which we term a diffusion net, that performs out-of-sample-extension as well as outlier detection. We introduce new neural net constraints for the encoder, which preserves the local geometry of the points, and we prove rates of convergence for the encoder. Also, our approach is efficient in both computational complexity and memory requirements, as opposed to previous methods that require storage of all training points in both the high-dimensional and the low-dimensional spaces to calculate the out-of-sample-extension and the pre-image.

📄 PDF Abstract BibTeX arXiv:1506.07840

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderOutlier Detection

Similar Papers 제목 키워드 기반

Improved generalization with deep neural operators for engineering systems: Path towards digital twin

2023-01-17 · Kazuma Kobayashi, James Daniell, Syed Bahauddin Alam

Neural Operator Networks (ONets) represent a novel advancement in machine learning algorithms, offering a robust and generalizable alternative for approximating partial differential equations (PDEs) solutions. Unlike tra…

Operator learning

Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model

2024-04-15 · Han Lin, Jaemin Cho, Abhay Zala, Mohit Bansal

ControlNets are widely used for adding spatial control to text-to-image diffusion models with different conditions, such as depth maps, scribbles/sketches, and human poses. However, when it comes to controllable video ge…

GPUImage GenerationStyle TransferVideo Editing+2

U-Nets as Belief Propagation: Efficient Classification, Denoising, and Diffusion in Generative Hierarchical Models

2024-04-29 · Song Mei

U-Nets are among the most widely used architectures in computer vision, renowned for their exceptional performance in applications such as image segmentation, denoising, and diffusion modeling. However, a theoretical exp…

DecoderDenoisingImage SegmentationSemantic Segmentation

Accelerated replica exchange stochastic gradient Langevin diffusion enhanced Bayesian DeepONet for solving noisy parametric PDEs

2021-11-03 · Guang Lin, Christian Moya, Zecheng Zhang

The Deep Operator Networks~(DeepONet) is a fundamentally different class of neural networks that we train to approximate nonlinear operators, including the solution operator of parametric partial differential equations (…

A Unified Framework for U-Net Design and Analysis

2023-05-31 · NeurIPS 2023 11 · Christopher Williams, Fabian Falck, George Deligiannidis, Chris Holmes 외

U-Nets are a go-to, state-of-the-art neural architecture across numerous tasks for continuous signals on a square such as images and Partial Differential Equations (PDE), however their design and architecture is understu…

DecoderImage SegmentationSemantic Segmentation