paper-with-me

홈 › Papers

Efficient data transport over multimode light-pipes with Megapixel images using differentiable ray tracing and Machine-learning

2023-01-16 · Joowon Lim, Jannes Gladrow, Douglas Kelly, Greg O'Shea, Govert Verkes, Ioan Stefanovici, Sebastian Nowozin, Benn Thomsen

Retrieving images transmitted through multi-mode fibers is of growing interest, thanks to their ability to confine and transport light efficiently in a compact system. Here, we demonstrate machine-learning-based decoding of large-scale digital images (pages), maximizing page capacity for optical storage applications. Using a millimeter-sized square cross-section waveguide, we image an 8-bit spatial light modulator, presenting data as a matrix of symbols. Normally, decoders will incur a prohibitive O(n^2) computational scaling to decode n symbols in spatially scrambled data. However, by combining a digital twin of the setup with a U-Net, we can retrieve up to 66 kB using efficient convolutional operations only. We compare trainable ray-tracing-based with eigenmode-based twins and show the former to be superior thanks to its ability to overcome the simulation-to-experiment gap by adjusting to optical imperfections. We train the pipeline end-to-end using a differentiable mutual-information estimator based on the von-Mises distribution, generally applicable to phase-coding channels.

📄 PDF Abstract BibTeX arXiv:2301.06496

Code (0)

등록된 구현이 없습니다.

Tasks

Image RetrievalRetrievalVocal Bursts Intensity Prediction

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

A Low-cost Through-metal Communication System for Sensors in Metallic Pipes

2023-04-14 · Hongzhi Guo, Marlin Prince, Javionn Ramsey, Jarvis Turner 외

Metallic pipes and other containers are widely used to store and transport toxic gases and liquids. Various sensors have been designed to monitor the environment inside metallic pipes and containers, such as pressure, li…

Light Propagation Prediction through Multimode Optical Fibers with a Deep Neural Network

2018-12-06 · Pengfei Fan, Liang Deng, Lei Su

This work demonstrates a computational method for predicting the light propagation through a single multimode fiber using a deep neural network. The experiment for gathering training and testing data is performed with a …

SSIM

A Hermetic, Transparent Soft Growing Vine Robot System for Pipe Inspection

2025-10-30 · William E. Heap, Yimeng Qin, Kai Hammond, Anish Bayya 외 arxiv

Rehabilitation of aging pipes requires accurate condition assessment and mapping far into the pipe interiors. Soft growing vine robot systems are particularly promising for navigating confined, sinuous paths such as in p…

Automatic Analysis of Sewer Pipes Based on Unrolled Monocular Fisheye Images

2019-12-11 · Johannes Künzel, Thomas Werner, Ronja Möller, Peter Eisert 외

The task of detecting and classifying damages in sewer pipes offers an important application area for computer vision algorithms. This paper describes a system, which is capable of accomplishing this task solely based on…

MNT-TNN: Spatiotemporal Traffic Data Imputation via Compact Multimode Nonlinear Transform-based Tensor Nuclear Norm

2025-03-29 · Yihang Lu, Mahwish Yousaf, Xianwei Meng, Enhong Chen

Imputation of random or non-random missing data is a long-standing research topic and a crucial application for Intelligent Transportation Systems (ITS). However, with the advent of modern communication technologies such…

ImputationMissing ValuesTraffic Data Imputation