Bessel Equivariant Networks for Inversion of Transmission Effects in Multi-Mode Optical Fibres
We develop a new type of model for solving the task of inverting the transmission effects of multi-mode optical fibres through the construction of an $\mathrm{SO}^{+}(2,1)$-equivariant neural network. This model takes advantage of the of the azimuthal correlations known to exist in fibre speckle patterns and naturally accounts for the difference in spatial arrangement between input and speckle patterns. In addition, we use a second post-processing network to remove circular artifacts, fill gaps, and sharpen the images, which is required due to the nature of optical fibre transmission. This two stage approach allows for the inspection of the predicted images produced by the more robust physically motivated equivariant model, which could be useful in a safety-critical application, or by the output of both models, which produces high quality images. Further, this model can scale to previously unachievable resolutions of imaging with multi-mode optical fibres and is demonstrated on $256 \times 256$ pixel images. This is a result of improving the trainable parameter requirement from $\mathcal{O}(N^4)$ to $\mathcal{O}(m)$, where $N$ is pixel size and $m$ is number of fibre modes. Finally, this model generalises to new images, outside of the set of training data classes, better than previous models.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Efficient 3D affinely equivariant CNNs with adaptive fusion of augmented spherical Fourier-Bessel bases
Filter-decomposition-based group equivariant convolutional neural networks (CNNs) have shown promising stability and data efficiency for 3D image feature extraction. However, these networks, which rely on parameter shari…
Image SegmentationMedical Image SegmentationOrgan SegmentationSegmentation+1SO(2) and O(2) Equivariance in Image Recognition with Bessel-Convolutional Neural Networks
For many years, it has been shown how much exploiting equivariances can be beneficial when solving image analysis tasks. For example, the superiority of convolutional neural networks (CNNs) compared to dense networks mai…
TranslationOptimization and Characterization of Near-Field Beams with Uniform Linear Arrays
In this paper, we consider near-field beams that can mitigate signal attenuation and blockage effects using a uniform linear array (ULA). In particular, closed-form expressions for phase distributions in a ULA are derive…
Privacy from Symmetry: Orthogonally Equivariant Transformers for LLM Inference
Running large language models locally is often impractical, pushing inference on sensitive text to third-party providers. Split inference partially mitigates this by keeping tokens on the client and sending only hidden r…
Deep, complex, invertible networks for inversion of transmission effects in multimode optical fibres
We use complex-weighted, deep networks to invert the effects of multimode optical fibre distortion of a coherent input image. We generated experimental data based on collections of optical fibre responses to greyscale in…