Soft Autoencoder and Its Wavelet Adaptation Interpretation
Recently, deep learning becomes the main focus of machine learning research and has greatly impacted many important fields. However, deep learning is criticized for lack of interpretability. As a successful unsupervised model in deep learning, the autoencoder embraces a wide spectrum of applications, yet it suffers from the model opaqueness as well. In this paper, we propose a new type of convolutional autoencoders, termed as Soft Autoencoder (Soft-AE), in which the activation functions of encoding layers are implemented with adaptable soft-thresholding units while decoding layers are realized with linear units. Consequently, Soft-AE can be naturally interpreted as a learned cascaded wavelet shrinkage system. Our denoising experiments demonstrate that Soft-AE not only is interpretable but also offers a competitive performance relative to its counterparts. Furthermore, we propose a generalized linear unit (GenLU) to make an autoencoder more adaptive in nonlinearly filtering images and data, such as denoising and deblurring.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringDeep LearningDenoisingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Wavelet Design in a Learning Framework
Wavelets have proven to be highly successful in several signal and image processing applications. Wavelet design has been an active field of research for over two decades, with the problem often being approached from an …
WaveletAE: A Wavelet-enhanced Autoencoder for Wind Turbine Blade Icing Detection
Wind power, as an alternative to burning fossil fuels, is abundant and inexhaustible. To fully utilize wind power, wind farms are usually located in areas of high altitude and facing serious ice conditions, which can lea…
Anomaly DetectionGeneral ClassificationTime SeriesTime Series Analysis+2A Novel Unsupervised Graph Wavelet Autoencoder for Mechanical System Fault Detection
Reliable fault detection is an essential requirement for safe and efficient operation of complex mechanical systems in various industrial applications. Despite the abundance of existing approaches and the maturity of the…
Fault DetectionGraph Neural NetworkMultidimensional Wavelets for Scalable Image Decomposition: Orbital Wavelets
Wavelets are closely related to the Schr\"odinger's wave functions and the interpretation of Born. Similarly to the appearance of atomic orbital, it is proposed to combine anti-symmetric wavelets into orbital wavelets. T…
Wavelet-based Variational Autoencoders for High-Resolution Image Generation
Variational Autoencoders (VAEs) are powerful generative models capable of learning compact latent representations. However, conventional VAEs often generate relatively blurry images due to their assumption of an isotropi…
Image Generation