Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media

PLUTO / PLUTO-2 Spatial Light Modulators
Imaging/ Image Processing Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Yunzhe Li and Yujia Xue and Lei Tian
Abstract:

“Imaging through scattering is an important yet challenging problem. Tremendous progress has been made by exploiting the deterministic input–output “transmission matrix” for a fixed medium. However, this “one-to-one” mapping is highly susceptible to speckle decorrelations – small perturbations to the scattering medium lead to model errors and severe degradation of the imaging performance. Our goal here is to develop a new framework that is highly scalable to both medium perturbations and measurement requirement. To do so, we propose a statistical “one-to-all” deep learning (DL) technique that encapsulates a wide range of statistical variations for the model to be resilient to speckle decorrelations. Specifically, we develop a convolutional neural network (CNN) that is able to learn the statistical information contained in the speckle intensity patterns captured on a set of diffusers having the same macroscopic parameter. We then show for the first time, to the best of our knowledge, that the trained CNN is able to generalize and make high-quality object predictions through an entirely different set of diffusers of the same class. Our work paves the way to a highly scalable DL approach for imaging through scattering media.”

Open Access

Publication: Optica
Issue/Year: Optica Volume 5, Issue 10 pp. 1181-1190 (2018)
DOI: 10.1364/OPTICA.5.001181
Link: https://doi.org/10.1364/OPTICA.5.001181

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ethan Tseng, Grace Kuo, Seung-Hwan Baek, Nathan Matsuda, Andrew Maimone, Florian Schiffers, Praneeth Chakravarthula, Qiang Fu, Wolfgang Heidrich, Douglas Lanman & Felix Heide

Neural étendue expander for ultra-wide-angle high-fidelity holographic display

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Siyuan Wang, Zonglin Guo, Yu Zhao, Yanbo Pei, Hongyan Shi, Jingbo Zhang, Jian Wang

Deep field-of-view and passive tomography based on Airy light field

Applications: Bessel-/ Airy Beam Generation,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Xiong, Xiangchao Zhang, Xinyang Ma, Leheng Li, Zhanghao Ni, and Xiangqian Jiang

Adaptive coded phase mask design and high-quality image reconstruction for interference-less coded aperture correlation holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Patrick Cameron, Baptiste Courme, Daniele Faccio, Hugo Defienne

Tutorial: Shaping the Spatial Correlations of Entangled Photon Pairs

Applications: Beam Shaping / Beam Steering,Imaging/ Image Processing,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiuru He, Pengwei Zhang, Jianpo Su, Junqiao Wang, Yongzhi Tian, Yongsheng Hu, and Fengying Ma

Edge enhancement in three-dimensional vortex imaging based on FINCH by Bessel-like spiral phase modulation

Applications: Imaging/ Image Processing
LETO / LETO-3 Spatial Light Modulators
Authors:Wenxue Zhang, Yuhong Wan, Tianlong Man, Hongqiang Zhou

Computational incoherent edge enhancement imaging based on self-interference digital holography

Applications: Imaging/ Image Processing
LC 2012 Spatial Light Modulators
Authors:Matsuda, Naoki; Tanida, Jun; Naruse, Makoto; Horisaki, Ryoichi

Noninvasive holographic imaging through dynamically scattering media

Applications: Turbid-/ Opaque Media /Multi Scattering
HES / HEO 6001 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Ziyu Gu, Mengyang Shi, Yesheng Gao, and Xingzhao Liu

OP-FCNN: an optronic fully convolutional neural network for imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Dejin Zhang, Wei Sheng, Yaoyao Shi, and Youwen Liu

Imaging objects hidden inside the strongly scattering media based on bidirectional ghost imaging

Applications: Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheyu Wu, Ran Gao, Sitong Zhou, Fei Wang, Zhipei Li, Huan Chang, Dong Guo, Xiangjun Xin, Qi Zhang, Feng Tian, Qiang Wu

Robust Super-Resolution Image Transmission Based on a Ring Core Fiber with Orbital Angular Momentum

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chané Moodley and Andrew Forbes

All-digital quantum ghost imaging: tutorial

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kumar, Rahul, Naveen K. Nishchal, and Ayman Alfalou

Improving the False Alarm Capability of the Extended Maximum Average Correlation Height Filter

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhang, Yantong, Huiling Huang, Feibin Wu, Jun Han, Yi Yang, and Ruyi Li

Imaging through a Scattering Medium under Different Intensities of Ambient Light Interference

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:León Schweickhardt , Dirk Stöbener und Andreas Fischer

Specklebasierte Charakterisierung anisotroper Oberflächen

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nitin Dubey, Ravi Kumar, Joseph Rosen

Multi-wavelength imaging with extended depth of field using coded apertures and radial quartic phase functions

Applications: Imaging/ Image Processing
LC 2012 Spatial Light Modulators
Authors:Weng, Xiaojing / Feng, Ji / Perry, Altai / Vuong, Luat T.

Non-Line-of-Sight Full-Stokes Polarimetric Imaging with Solution-Processed Metagratings and Shallow Neural Networks

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Polarization Generation
GAEA / GAEA-2 Spatial Light Modulators
Authors:Tilmon, Brevin; Sun, Zhanghao; Koppal, Sanjeev; Wu, Yicheng; Evangelidis, Georgios; Zahreddine, Ramzi; Krishnan, Guru; Ma, Sizhuo & Wang, Jian

Energy-Efficient Adaptive 3D Sensing

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Chaohui; Xin, Jun; Li, Yanan; Lu, Xiao-Ming

Measuring small displacements of an optical point source with digital holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LC 2012 Spatial Light Modulators
Authors:Tsukada, Takumi / Watanabe, Wataru

Central wavelength estimation in spectral imaging behind a diffuser via deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Liang, Hanpeng; Li, Ti-Jian; Luo, Jiawei; Zhao, Jiayu; Wang, Jian; Wu, Daixuan; Luo, Zhi-Chao; Shen, Yuecheng

Optical focusing inside scattering media with iterative time-reversed ultrasonically encoded near-infrared light

Applications: Adaptive Optics / Wavefront Control,Turbid-/ Opaque Media /Multi Scattering
LETO / LETO-3 Spatial Light Modulators
Authors:Ritika Malik and Kedar Khare

Single-shot extended field of view imaging using point spread function engineering

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han, Tongyu; Peng, Tong; Li, Runze; Wang, Kaige; Sun, Dan & Yao, Baoli

Extending the Imaging Depth of Field through Scattering Media by Wavefront Shaping of Non-Diffraction Beams

Applications: Bessel-/ Airy Beam Generation,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Dongxu; Zhang, Lu; Zhang, Hongzhi; Zhang, Guoquan

Ghost images with controllable visibility and spatial resolution

Applications: Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
Discontinued Devices LC-R 720 Spatial Light Modulators
Authors:Xuan Liu, Yuwei Liu, Shupei Yu, and Yuanwei Zhang

Complex optically computed phase microscopy for label-free sub-cellular imaging

Applications: Imaging/ Image Processing,Microscopy,Phase Measurement / Phase Retrieval