paper-with-me

Papers

Datacube segmentation via Deep Spectral Clustering

2024-01-31 · Alessandro Bombini, Fernando García-Avello Bofías, Caterina Bracci, Michele Ginolfi, Chiara Ruberto

Extended Vision techniques are ubiquitous in physics. However, the data cubes steaming from such analysis often pose a challenge in their interpretation, due to the intrinsic difficulty in discerning the relevant information from the spectra composing the data cube. Furthermore, the huge dimensionality of data cube spectra poses a complex task in its statistical interpretation; nevertheless, this complexity contains a massive amount of statistical information that can be exploited in an unsupervised manner to outline some essential properties of the case study at hand, e.g.~it is possible to obtain an image segmentation via (deep) clustering of data-cube's spectra, performed in a suitably defined low-dimensional embedding space. To tackle this topic, we explore the possibility of applying unsupervised clustering methods in encoded space, i.e. perform deep clustering on the spectral properties of datacube pixels. A statistical dimensional reduction is performed by an ad hoc trained (Variational) AutoEncoder, in charge of mapping spectra into lower dimensional metric spaces, while the clustering process is performed by a (learnable) iterative K-Means clustering algorithm. We apply this technique to two different use cases, of different physical origins: a set of Macro mapping X-Ray Fluorescence (MA-XRF) synthetic data on pictorial artworks, and a dataset of simulated astrophysical observations.

📄 PDF Abstract BibTeX arXiv:2401.17695

Code (1)

icsc-spoke2-repo/fastextendedvision-deepcluster 공식 구현 pytorch

Tasks

ClusteringDeep ClusteringImage SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
k-Means Clustering k-Means Clustering is a clustering algorithm that divides a training set into $k$ different clusters of examples that are near each other. It works by initializing $k$…
HOC 설명 없음

Similar Papers 제목 키워드 기반

Compressive Hyperspectral Imaging with Side Information

2015-02-22 · Xin Yuan, Tsung-Han Tsai, Ruoyu Zhu, Patrick Llull 외

A blind compressive sensing algorithm is proposed to reconstruct hyperspectral images from spectrally-compressed measurements.The wavelength-dependent data are coded and then superposed, mapping the three-dimensional hyp…

Compressive Sensing

Fast Edge-Aware Occlusion Detection in the Context of Multispectral Camera Arrays

2024-08-26 · Frank Sippel, Jürgen Seiler, André Kaup

Multispectral imaging is very beneficial in diverse applications, like healthcare and agriculture, since it can capture absorption bands of molecules in different spectral areas. A promising approach for multispectral sn…

Disparity EstimationImage RegistrationSSIM

Band-wise Hyperspectral Image Pansharpening using CNN Model Propagation

2023-11-11 · Giuseppe Guarino, Matteo Ciotola, Gemine Vivone, Giuseppe Scarpa

Hyperspectral pansharpening is receiving a growing interest since the last few years as testified by a large number of research papers and challenges. It consists in a pixel-level fusion between a lower-resolution hypers…

Deep LearningPansharpening

Image Segmentation Based on Multiscale Fast Spectral Clustering

2018-12-12 · Chongyang Zhang, Guofeng Zhu, Minxin Chen, Hong Chen 외

In recent years, spectral clustering has become one of the most popular clustering algorithms for image segmentation. However, it has restricted applicability to large-scale images due to its high computational complexit…

ClusteringImage SegmentationSemantic SegmentationSuperpixels+1

Robust path-based spectral clustering

2018-01-01 · Hong Chang, Dit-yan Yeung

Spectral clustering and path-based clustering are two recently developed clustering approaches that have delivered impressive results in a number of challenging clustering tasks. However, they are not robust enough again…

ClusteringImage SegmentationSegmentationSemantic Segmentation