Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media

PLUTO / PLUTO-2 Spatial Light Modulators
Imaging/ Image Processing Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Yunzhe Li and Yujia Xue and Lei Tian
Abstract:

“Imaging through scattering is an important yet challenging problem. Tremendous progress has been made by exploiting the deterministic input–output “transmission matrix” for a fixed medium. However, this “one-to-one” mapping is highly susceptible to speckle decorrelations – small perturbations to the scattering medium lead to model errors and severe degradation of the imaging performance. Our goal here is to develop a new framework that is highly scalable to both medium perturbations and measurement requirement. To do so, we propose a statistical “one-to-all” deep learning (DL) technique that encapsulates a wide range of statistical variations for the model to be resilient to speckle decorrelations. Specifically, we develop a convolutional neural network (CNN) that is able to learn the statistical information contained in the speckle intensity patterns captured on a set of diffusers having the same macroscopic parameter. We then show for the first time, to the best of our knowledge, that the trained CNN is able to generalize and make high-quality object predictions through an entirely different set of diffusers of the same class. Our work paves the way to a highly scalable DL approach for imaging through scattering media.”

Open Access

Publication: Optica
Issue/Year: Optica Volume 5, Issue 10 pp. 1181-1190 (2018)
DOI: 10.1364/OPTICA.5.001181
Link: https://doi.org/10.1364/OPTICA.5.001181

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adolphe Ndagijimana, Iñigo Ederra and Miguel Heredia Conde

Single-Pixel Compressive Terahertz 3D Imaging

Applications: Complex Modulation,Imaging/ Image Processing
LETO / LETO-3 Spatial Light Modulators
Authors:Augusto Arias, Susanna P. Clement, Pablo Artal and Siegfried Wahl

Chromatic imaging properties of myopia control spectacle lenses

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen

Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Microscopy,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenjun Yi, Shuyue Zhu, Meicheng Fu, Nan Gu, Junli Qi, Siyu Liu, Mengjun Zhu, Ping Wang, Xin Chen, Yi Zhang, Hongyu Zhang, Yao Xu, Junyi Du, Peng Xiong, Zhaohua Dong, Luobing Dong, Qiong Liu and Xiujian Li

Relay-projection microscopic telescopy

Applications: Imaging/ Image Processing,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Allarakha Shikder, Naveen K. Nishchal

Image encryption using arbitrary modes of Hermite-Gaussian beams

Applications: Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jawahar Prabhakar Desai, Vijayakumar Anand and Joseph Rosen

Multiple Incoherent Deconvolutions for Improving the Image Resolution of Diffraction-Limited Imaging Systems

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhiyuan Ye, Chen-Xin Ding, Jilun Zhao, Wanting Hou, Xue-Jiao Men, Yi Cui, Hong-Chao Liu, Hai-Bo Wang and Jun Xiong

Vortex memory effect of light for scattering-assisted massive data transmission

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
LC-R 720 Spatial Light Modulators
Authors:Xuan Liu, Rupak Bhakta, Emily Kryvorutsky and Yuanwei Zhang

Imaging cells and nanoparticles using modulated optically computed phase microscopy

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhenting Yan, Huiling Huang, Yili Chen, Hanfei Lin, Ebraheem Farea, Xingzhao Hua and Jun Han

Scattering imaging of moving targets based on recurrent neural networks: a fusion of temporal and phase information

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
LC 2002 Spatial Light Modulators
Authors:Jyoti Bikash Mohapatra, Naveen K. Nishchal and Jyothish Monikantan

Object Recognition in Foggy and Hazy Conditions Using Dark Channel Prior-Based Fringe-Adjusted Joint Transform Correlator

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Sara Aissati, Tianlun Zou, Sabyasachi Goswami, Len Zheleznyak, Susana Marcos

Visual Quality and Accommodation With Novel Optical Designs for Myopia Control

Applications: Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Mengyang Shi, Jiahui Ma, Zhishun Guo, Yesheng Gao and Xingzhao Liu

Speckle-free self-supervised learning for scalable imaging through scattering media with unseen condition changes

Applications: Deep Learning / Neuronal Network,Misc.: Speckle / Characterization / Metrology,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:R. Gottschalk, A. Lindinger

Interference patterns of two-photon excited fluorescence by spatial beam shaping

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xu-Zhen Gao, Qing-Lu Li, Tian-Fei Zhao, Ya-Ning Kong, Guo-Dong Tan and Yue Pan

Flexible focal array engineering with a binary array vector optical field

Applications: Beam Shaping / Beam Steering,Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Haofan Huang, Qi Zhao, Huanhao Li, Yuandong Zheng, Zhipeng Yu, Tianting Zhong, Shengfu Cheng, Chi Man Woo, Yi Gao, Honglin Liu, Yuanjin Zheng, Jie Tian, Puxiang Lai

DeepSLM: Speckle-Licensed Modulation via Deep Adversarial Learning for Authorized Optical Encryption and Decryption

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yuxin Lu, Wenjing Zhao, Aiping Zhai, Nuo Liu and Dong Wang

Single-pixel phase imaging via a complex-valued Zernike basis

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Fatima Khanom, Nawal Mohamed, Ivan Lopushenko, Anton Sdobnov, Alexander Doronin, Alexander Bykov, Edik Rafailov & Igor Meglinski

Twists through turbidity: propagation of light carrying orbital angular momentum through a complex scattering medium

Applications: Higher Order Modes / Optical Vortex / OAM,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Igor Meglinski, Ivan Lopushenko, Anton Sdobnov and Alexander Bykov

Phase preservation of orbital angular momentum of light in multiple scattering environment

Applications: Higher Order Modes / Optical Vortex / OAM,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Minghao Wang, Dejun Zhang, Wenke Liang, and Wen Guo

Deep learning-based general beam synthesis for atmospheric propagation

Applications: Deep Learning / Neuronal Network,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jixiang Wang, Xin Xu, Hong Ye, Xin Zhang, and Guohua Shi

Efficient generation of high-contrast Bessel light sheets: a flexible method for improved imaging

Applications: Beam Shaping / Beam Steering,Bessel-/ Airy Beam Generation,Imaging/ Image Processing,Microscopy
LC 2012 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiaosheng Li, Yifei Chen, Tianyun Liu, Bo Wu & Qinnan Zhang

Single-pixel Fresnel incoherent correlation holography compressed imaging using a Trumpet network

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kyriakos Skarsoulis, Konstantinos Makris, Christophe Moser, and Demetri Psaltis

Ptychographic imaging with a fiber endoscope via wavelength scanning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shile Yang, Yuecheng Shen, Jiawei Luo, Zhengyang Wang, Daixuan Wu, Jiaming Liang, Zhiling Zhang, Dalong Qi, Yunhua Yao, Lianzhong Deng, Bin Zhang, Zhenrong Sun, and Shian Zhang

Neural network enabled fringe projection through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ethan Tseng, Grace Kuo, Seung-Hwan Baek, Nathan Matsuda, Andrew Maimone, Florian Schiffers, Praneeth Chakravarthula, Qiang Fu, Wolfgang Heidrich, Douglas Lanman & Felix Heide

Neural étendue expander for ultra-wide-angle high-fidelity holographic display

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing