Speckle-free self-supervised learning for scalable imaging through scattering media with unseen condition changes

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network Misc.: Speckle / Characterization / Metrology Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Zicheng Huang, Mengyang Shi, Jiahui Ma, Zhishun Guo, Yesheng Gao and Xingzhao Liu
Abstract:

Recently, deep learning (DL) methods have been extensively developed for imaging through scattering media. However, most learning methods rely on training with pairs of target-speckle data and lack integration with the physical imaging process. Here, we report a speckle-free self-supervised learning method that could be applied for scalable imaging through unknown random diffusers with unseen condition changes. Unlike traditional learning-based methods, our approach optimizes speckle reconstruction by leveraging the physical process of scattering imaging instead of fitting to “speckle-label” pairs. Our method models the scattered light field across potential scattering conditions to generate speckle patterns and extracts their correlation properties for model training and optimization. This eliminates the need for any pre-collected speckle patterns during network training. Our speckle-free method exhibits high reconstruction performance for imaging in unseen scattering conditions. We validate its performance across 440 unseen scattering conditions, including plane displacements, rotations, and combinations. Our method outperforms physics-informed learning approaches regarding reconstruction performance, consistency, and generalization ability in scalable imaging scenarios. This approach addresses the challenges of model generalization and extensive data collection for training, demonstrating its feasibility and superiority for imaging through unknown scattering media in novel scenarios.

Open Access

Publication: Optics Express
Issue/Year: Opt. Express 32, 44123-44147 (2024)
DOI: 10.1364/OE.539573
Link: https://doi.org/10.1364/OE.539573

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Erkhembaatar Dashdavaa, Erdenebayar Bayarsaikhan, Munkh-Uchral Erdenebat, Jae-Yeol Cha, Jae-Won Lee, Jin-Hyeok Seo, Hyeon-Su Jeong, Min-Seok Kim, Ji-Sub Park, and Hak-Rin Kim

Dynamic eyebox expansion in holographic near-eye displays via active switching quarter-waveplate geometric phase prisms

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Tianlong Man, Yuwen Zhang, Yuchen Wu, Zhiqing Zhang, Hongqiang Zhou, Liyun Zhong, and Yuhong Wan

Three-dimensional neural network driving self-interference digital holography enables high-fidelity, non-scanning volumetric fluorescence microscopy

Applications: Beam Shaping / Beam Steering,Deep Learning / Neuronal Network,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yuwei Jiang, Wenyu Yang, Yongxin Zhu, and Zunkai Huang

High-Quality Phase-Only Holography via Frequency-Domain Hybrid Encoding and Multi-Scale Complex Attention

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chuncheng Zhang, Zhaoxuan Hu, Tianting Zhong, Haofan Huang, Ji Liang, Yu Wang, Tingting Liu, Zheyi Yao, Qian Chen, Puxiang Lai, and Xiubao Sui

Unlocking high-frequency speckle details via relative frequency learning for robust imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hyunmin Ban, Wenbin Zhou, Xiangyu Meng, and Yifan Evan Peng

Multi-color compressive hologram synthesis with learned wave propagation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shiva Shankar Mutupuri, MD. Haider Ansari, Satish Anamalamudi, Ravi Kumar, Shashi Prabhakar, and Salla Gangi Reddy

Higher-Order Spatial Mode Detection Leveraging Deep Learning on Random Optical Patterns

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenqi Ma, Fan Yang, Xiuquan Li, Haiyan Wang, and Guijun Hu

Modeling and performance analysis for few-mode free-space optical communication reception based on optical-domain coherent beam combining

Applications: Optical Communication,Telecom / Optical Switching / WSS,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:J. Arriaga Hernández, B. Cuevas Otahola, A. Diaz Nayotl, A. Jaramillo Núñez, A. Pérez Villegas, O. Valenzuela b

Machine learning K-means algorithm applied to wavefront sensing in Bi-Ronchi/Hartmann tests with SLM

Applications: Deep Learning / Neuronal Network
ERIS PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Guillaume Noetinger, Tim Tuuva, Romain Fleury

Tutorial: A practical guide to the alignment of defocused spatial light modulators for fast diffractive neural networks

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adam J. Vallance, Aleksandr Boldin, Ultan J. Daly, and Martin P.J. Lavery

Structured light probe for turbulent media

Applications: Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yaping Tian, Yuhan Zhou, Shiyi Lu, Liming Zhu, Khian-Hooi Chew, Rui-Pin Chen

Mueller matrix-based deep neural network for adaptive reconstruction of orthogonal polarization components of a vector beam transmitted through a highly scattering medium

Applications: Deep Learning / Neuronal Network,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:Ruidong Li, Caihua Zhang, Kejian Zhu, Zheng Huang, Conghe Wang, Shukai Wu, and Hongwei Chen

Implementation of fully connected layers in optical convolutional neural networks for pre-sensor computing

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Atefeh Akbarpour, Adad Yepiz, Benjamin Perez-Garcia, J. A. Alvarez-Chavez, Herman L. Offerhaus & Raul I. Hernandez-Aranda

Partially coherent Mathieu–Gauss beams

Applications: Beam Shaping / Beam Steering,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
HES / HEO 6001 Spatial Light Modulators
Authors:Yining Hao, Yang Peng, Tianshun Zhang, and Wen Chen

High-quality photon-limited imaging through dynamic and complex scattering media with a single-photon detector

Applications: Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ruitao Wu, Juncheng Fang, Rui Pan, Rongyi Lin, Kaiyuan Li, Ting Lei, Luping Du, Xiaocong Yuan

Physical Interpretation of Diffractive Optical Networks for High-Dimensional Vortex Mode Sorting

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ivan B. Djordjevic and Ignacio A. Rojas

SLM steering-based covert communication over strong atmospheric turbulence channels

Applications: Beam Shaping / Beam Steering,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ping Wang, Meiling Zhou, Runze Li, Tong Peng, Yuan Zhou, Dan Dan, Junwei Min, Cuiping Yao, and Baoli Yao

Non-invasive fluorescence imaging through scattering media via variance-guided wavefront shaping and convex optimization-based deconvolution

Applications: Beam Shaping / Beam Steering,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
ERIS Spatial Light Modulators
Authors:Ying Zhao, Hao Wang, Dan Li, Ping Yan, and Qirong Xiao

In-situ forward sparse training of large-scale optical neural networks

Applications: Deep Learning / Neuronal Network,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jun Zeng, Ruyi Li, Zhao Zhang, Dong Xu, Bernhard J. Hoenders, Fei Wang, Haiyun Wang, Yangjian Cai, and Hui Zhang

Partially coherent persistent hollow beams enabled by cross-phase modulation

Applications: Higher Order Modes / Optical Vortex / OAM,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qian Zhang, Yu Miao, Jiali Sun, Yuan Sui, Stefan Rothe, and Juergen W. Czarske

Digital design of mode decomposition systems for multimode fibers using physics-informed neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chenliang Chang, Chenzhou Zhao, Bo Dai, Qi Wang, Dawei Zhang, Songlin Zhuang, and Chao Ping Chen

Memory-Reduced Convolutional Neural Network for Fast Phase Hologram Generation

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ziang Xiao, Yuhan Gong, Pengxiang Wang, Yixun Huang, Mian Wu, Lin Wu, Chao Yang, Bertrand Kibler, Arnaud Mussot, Jin Tao, and Gang Xu

Enhancement of Free-Space Optical Communication with Structured Frequency Combs

Applications: Beam Shaping / Beam Steering,Higher Order Modes / Optical Vortex / OAM,Optical Communication,Telecom / Optical Switching / WSS,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Chuxuan Huang, Yue Huang, and Manhua Liu

NeuHolo: non-interferometric quantitative single-shot holographic imaging for 3D metrology using neural fields

Applications: Deep Learning / Neuronal Network,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Likai Cheng, Jianming Gao, Banlian Xu, Leihong Zhang, and Dawei Zhang

Computational ghost imaging of atmospheric turbulence based on a single variable convolution kernel

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing