Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media

PLUTO / PLUTO-2 Spatial Light Modulators
Imaging/ Image Processing Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Yunzhe Li and Yujia Xue and Lei Tian
Abstract:

“Imaging through scattering is an important yet challenging problem. Tremendous progress has been made by exploiting the deterministic input–output “transmission matrix” for a fixed medium. However, this “one-to-one” mapping is highly susceptible to speckle decorrelations – small perturbations to the scattering medium lead to model errors and severe degradation of the imaging performance. Our goal here is to develop a new framework that is highly scalable to both medium perturbations and measurement requirement. To do so, we propose a statistical “one-to-all” deep learning (DL) technique that encapsulates a wide range of statistical variations for the model to be resilient to speckle decorrelations. Specifically, we develop a convolutional neural network (CNN) that is able to learn the statistical information contained in the speckle intensity patterns captured on a set of diffusers having the same macroscopic parameter. We then show for the first time, to the best of our knowledge, that the trained CNN is able to generalize and make high-quality object predictions through an entirely different set of diffusers of the same class. Our work paves the way to a highly scalable DL approach for imaging through scattering media.”

Open Access

Publication: Optica
Issue/Year: Optica Volume 5, Issue 10 pp. 1181-1190 (2018)
DOI: 10.1364/OPTICA.5.001181
Link: https://doi.org/10.1364/OPTICA.5.001181

Related Papers

LC 2012 Spatial Light Modulators
Authors:Weng, Xiaojing / Feng, Ji / Perry, Altai / Vuong, Luat T.

Non-Line-of-Sight Full-Stokes Polarimetric Imaging with Solution-Processed Metagratings and Shallow Neural Networks

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Polarization Generation
GAEA Spatial Light Modulators
Authors:Tilmon, Brevin; Sun, Zhanghao; Koppal, Sanjeev; Wu, Yicheng; Evangelidis, Georgios; Zahreddine, Ramzi; Krishnan, Guru; Ma, Sizhuo & Wang, Jian

Energy-Efficient Adaptive 3D Sensing

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Chaohui; Xin, Jun; Li, Yanan; Lu, Xiao-Ming

Measuring small displacements of an optical point source with digital holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LC 2012 Spatial Light Modulators
Authors:Tsukada, Takumi / Watanabe, Wataru

Central wavelength estimation in spectral imaging behind a diffuser via deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Liang, Hanpeng; Li, Ti-Jian; Luo, Jiawei; Zhao, Jiayu; Wang, Jian; Wu, Daixuan; Luo, Zhi-Chao; Shen, Yuecheng

Optical focusing inside scattering media with iterative time-reversed ultrasonically encoded near-infrared light

Applications: Adaptive Optics / Wavefront Control,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han, Tongyu; Peng, Tong; Li, Runze; Wang, Kaige; Sun, Dan & Yao, Baoli

Extending the Imaging Depth of Field through Scattering Media by Wavefront Shaping of Non-Diffraction Beams

Applications: Bessel-/ Airy Beam Generation,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Dongxu; Zhang, Lu; Zhang, Hongzhi; Zhang, Guoquan

Ghost images with controllable visibility and spatial resolution

Applications: Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ye, Zhiyuan; Hou, Wanting; Zhao, Jilun; Wang, Hai-Bo & Xiong, Jun

Computational holographic ghost diffraction

Applications: Imaging/ Image Processing,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yudaev, Andrey; Kiselev, Alexander; Shashkova, Inna; Tavrov, Alexander; Lipatov, Alexander & Korablev, Oleg

Wavefront Sensing by a Common-Path Interferometer for Wavefront Correction in Phase and Amplitude by a Liquid Crystal Spatial Light Modulator Aiming the Exoplanet Direct Imaging

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing,Phase Measurement / Phase Retrieval
LC 2012 Spatial Light Modulators
Authors:Neto, Jose Reinaldo da Cunha Santos Aroso Vieira da Silva; Nakamura, Tomoya; Makihara, Yasushi & Yagi, Yasushi

Extended Depth-of-Field Lensless Imaging using an Optimized Radial Mask

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kürekci, Şahin

Optical classification and reconstruction through multimode fibers

Applications: Deep Learning / Neuronal Network,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rowe, Connor M. L.; Cortes, Luis Romero; de Chatellus, Hugues Guillet; Seghilani, Mohamed & Azana, Jose

Generalized Talbot Self-Healing of Periodic Images

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Reda, Francesco; Salvatore, Marcella; Borbone, Fabio; Maddalena, Pasqualino; Ambrosio, Antonio & Oscurato, Stefano Luigi

Varifocal diffractive lenses for multi-depth microscope imaging

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing,Lithography
Spatial Light Modulators
Authors:Cheremkhin, Pavel; Evtikhiev, Nikolay; Krasnov, Vitaly; Ryabcev, Ilya; Shifrina, Anna & Starikov, Rostislav

Lensless Optical Encryption of Multilevel Digital Data Containers Using Spatially Incoherent Illumination

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Li, Haoran; Wu, Xiaoyan; Liu, Guodong; Vinu, R. V.; Wang, Xiaoyan; Chen, Ziyang & Pu, Jixiong

Generation of controllable spectrum in multiple positions from speckle patterns

Applications: Turbid-/ Opaque Media /Multi Scattering
LC-R 720 Spatial Light Modulators
Authors:Liu, Xuan; Wan, Zhaoxiong; Zhang, Yuanwei & Liu, Yuwei

Optically computed phase microscopy for quantitative dynamic imaging of label-free cells and nanoparticles

Applications: Imaging/ Image Processing,Microscopy
LC 2012 Spatial Light Modulators
Authors:Lai, Xuetian; Li, Qiongyao; Chen, Ziyang; Shao, Xiaopeng & Pu, Jixiong

Reconstructing images of two adjacent objects passing through scattering medium via deep learning

Applications: Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Bulbul, Angika; Hai, Nathaniel & Rosen, Joseph

Coded aperture correlation holography (COACH) with a superior lateral resolution of FINCH and axial resolution of conventional direct imaging systems

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hou, Hong-Yun; Zhao, Ya-Nan; Han, Jia-Cheng; Cui, Sheng-Wei; Cao, De-Zhong; Liu, Hong-Chao; Zhang, Su-Heng & Liang, Bao-Lai

Complex-amplitude single-pixel imaging using coherent structured illumination

Applications: Imaging/ Image Processing,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chang, Chen; Wu, Guohua; Yang, Dongyue; Yin, Longfei & Luo, Bin

Clustering-based CLEAN algorithm in ghost imaging with sparse spatial frequencies

Applications: Imaging/ Image Processing
GAEA Spatial Light Modulators
Authors:Chlipała, Maksymilian; a; Kozacki, Tomasz; Yeom, Han-Ju; Martinez-Carranza, Juan; Rafał; Kukołowicz; Kim, Jinwoong; Yang, Jong-Heon; Choi, Ji Hun; Pi, Jae-Eun & Hwang, Chi-Sun

Wide angle holographic video projection display

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ren, Jinhan & Han, Kyu Young

25D microscopy with polarization independent SLM for enhanced detection efficiency and aberration correction

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing,Microscopy
GAEA Spatial Light Modulators
Authors:Li, Shikang; Ni, Baohua; Feng, Xue; Cui, Kaiyu; Liu, Fang; Zhang, Wei & Huang, Yidong

All-optical image identification with programmable matrix transformation

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Cheng, Zhongtao & Wang, Lihong V.

Focusing light into scattering media with ultrasound-induced field perturbation

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing