paper-with-me

홈 › Papers

Synthetic white balancing for intra-operative hyperspectral imaging

2023-07-24 · Anisha Bahl, Conor C. Horgan, Mirek Janatka, Oscar J. MacCormac, Philip Noonan, Yijing Xie, Jianrong Qiu, Nicola Cavalcanti, Philipp Fürnstahl, Michael Ebner, Mads S. Bergholt, Jonathan Shapey, Tom Vercauteren

Hyperspectral imaging shows promise for surgical applications to non-invasively provide spatially-resolved, spectral information. For calibration purposes, a white reference image of a highly-reflective Lambertian surface should be obtained under the same imaging conditions. Standard white references are not sterilizable, and so are unsuitable for surgical environments. We demonstrate the necessity for in situ white references and address this by proposing a novel, sterile, synthetic reference construction algorithm. The use of references obtained at different distances and lighting conditions to the subject were examined. Spectral and color reconstructions were compared with standard measurements qualitatively and quantitatively, using $\Delta E$ and normalised RMSE respectively. The algorithm forms a composite image from a video of a standard sterile ruler, whose imperfect reflectivity is compensated for. The reference is modelled as the product of independent spatial and spectral components, and a scalar factor accounting for gain, exposure, and light intensity. Evaluation of synthetic references against ideal but non-sterile references is performed using the same metrics alongside pixel-by-pixel errors. Finally, intraoperative integration is assessed though cadaveric experiments. Improper white balancing leads to increases in all quantitative and qualitative errors. Synthetic references achieve median pixel-by-pixel errors lower than 6.5% and produce similar reconstructions and errors to an ideal reference. The algorithm integrated well into surgical workflow, achieving median pixel-by-pixel errors of 4.77%, while maintaining good spectral and color reconstruction.

📄 PDF Abstract BibTeX arXiv:2307.12791

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Endoscopic Depth Measurement and Super-Spectral-Resolution Imaging

2017-06-19 · Jianyu Lin, Neil T. Clancy, Yang Hu, Ji Qi 외

Intra-operative measurements of tissue shape and multi/ hyperspectral information have the potential to provide surgical guidance and decision making support. We report an optical probe based system to combine sparse hyp…

Decision MakingOptical Flow Estimation

Spatial gradient consistency for unsupervised learning of hyperspectral demosaicking: Application to surgical imaging

2023-02-21 · Peichao Li, Muhammad Asad, Conor Horgan, Oscar MacCormac 외

Hyperspectral imaging has the potential to improve intraoperative decision making if tissue characterisation is performed in real-time and with high-resolution. Hyperspectral snapshot mosaic sensors offer a promising app…

Decision MakingDemosaicking

Probe-based Rapid Hybrid Hyperspectral and Tissue Surface Imaging Aided by Fully Convolutional Networks

2016-06-15 · Jianyu Lin, Neil T. Clancy, Xueqing Sun, Ji Qi 외

Tissue surface shape and reflectance spectra provide rich intra-operative information useful in surgical guidance. We propose a hybrid system which displays an endoscopic image with a fast joint inspection of tissue surf…

GPU

A self-supervised and adversarial approach to hyperspectral demosaicking and RGB reconstruction in surgical imaging

2024-07-27 · Peichao Li, Oscar MacCormac, Jonathan Shapey, Tom Vercauteren

Hyperspectral imaging holds promises in surgical imaging by offering biological tissue differentiation capabilities with detailed information that is invisible to the naked eye. For intra-operative guidance, real-time sp…

Demosaicking

Intraoperative perfusion assessment by continuous, low-latency hyperspectral light-field imaging: development, methodology, and clinical application

2025-04-15 · Stefan Kray, Andreas Schmid, Eric L. Wisotzky, Moritz Gerlich 외

Accurate assessment of tissue perfusion is crucial in visceral surgery, especially during anastomosis. Currently, subjective visual judgment is commonly employed in clinical settings. Hyperspectral imaging (HSI) offers a…