Displacement-agnostic coherent imaging through scatter with an interpretable deep neural network

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network Misc.: Speckle / Characterization / Metrology Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Li, Yunzhe; Cheng, Shiyi; Xue, Yujia & Tian, Lei
Abstract:

“Coherent imaging through scatter is a challenging task. Both model-based and data-driven approaches have been explored to solve the inverse scattering problem. In our previous work, we have shown that a deep learning approach can make high-quality and highly generalizable predictions through unseen diffusers. Here, we propose a new deep neural network model that is agnostic to a broader class of perturbations including scatterer change, displacements, and system defocus up to 10× depth of field. In addition, we develop a new analysis framework for interpreting the mechanism of our deep learning model and visualizing its generalizability based on an unsupervised dimension reduction technique. We show that our model can unmix the scattering-specific information and extract the object-specific information and achieve generalization under different scattering conditions. Our work paves the way to a robust and interpretable deep learning approach to imaging through scattering media.”

Open Access

Publication: Optics Express
Issue/Year: Optics Express, Volume 29; Number 2; Pages 2244; 2021
DOI: 10.1364/oe.411291
Link: https://doi.org/10.1364/oe.411291

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adrián Garmendía-Martínez, Francisco M. Muñoz-Pérez, Walter D. Furlan, Vicente Ferrando & Juan A. Monsoriu

Bifocal diffractive lenses based on the aperiodic Kolakoski sequence

Applications: Adaptive Optics / Wavefront Control,Misc.: Speckle / Characterization / Metrology
LC 2012 Spatial Light Modulators
Authors:Pedro J. Aguilera-Rojas, Karin Alfaro-Bittner, Marcel G. Clerc, Manuel Díaz-Zúñiga, Amaru Moya, David Pinto-Ramos & René G. Rojas

Nonlinear wave propagation in a bistable optical chain with nonreciprocal coupling

Applications: Misc.: Speckle / Characterization / Metrology
LC 2012 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiaosheng Li, Yifei Chen, Tianyun Liu, Bo Wu & Qinnan Zhang

Single-pixel Fresnel incoherent correlation holography compressed imaging using a Trumpet network

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LETO / LETO-3 Spatial Light Modulators
Authors:Yan Liu, Jianwei Qin, Yanbing Liu, Yuanan Liu, Xun Liu, Fangwei Ye, and Wei Li

Optical Fourier convolutional neural network with high efficiency in image classification

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kyriakos Skarsoulis, Konstantinos Makris, Christophe Moser, and Demetri Psaltis

Ptychographic imaging with a fiber endoscope via wavelength scanning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shile Yang, Yuecheng Shen, Jiawei Luo, Zhengyang Wang, Daixuan Wu, Jiaming Liang, Zhiling Zhang, Dalong Qi, Yunhua Yao, Lianzhong Deng, Bin Zhang, Zhenrong Sun, and Shian Zhang

Neural network enabled fringe projection through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Siyu Gao, Xiaoyun Liu, Yonghao Chen, Jinyang Jiang, Ying Liu, Tengfei Chai and Yueqiu Jiang

Oceanic turbulence parameters recognition based on convolutional neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Optical Communication
LETO / LETO-3 Spatial Light Modulators
Authors:Manu Gopakumar, Gun-Yeal Lee, Suyeon Choi, Brian Chao, Yifan Peng, Jonghyun Kim & Gordon Wetzstein

Full-colour 3D holographic augmented-reality displays with metasurface waveguides

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network
GAEA / GAEA-2 Spatial Light Modulators
Authors:Xiaofei Li, Xin Liu, Quanying Wu, Jun Zeng, Yangjian Cai, Sergey A. Ponomarenko, Chunhao Liang

Prime number factorization with light beams carrying orbital angular momentum

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Xiong, Xiangchao Zhang, Xinyang Ma, Leheng Li, Zhanghao Ni, and Xiangqian Jiang

Adaptive coded phase mask design and high-quality image reconstruction for interference-less coded aperture correlation holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
HES / HEO 6001 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Omri Wengrowicz, Alex Bronstein, and Oren Cohen

Unsupervised physics-informed deep learning-based reconstruction for time-resolved imaging by multiplexed ptychography

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pan, Tuqiang / Ye, Jianwei / Liu, Haotian / Zhang, Fan / Xu, Pengbai / Xu, Ou / Xu, Yi / Qin, Yuwen

Non-orthogonal optical multiplexing empowered by deep learning

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Communication
GAEA / GAEA-2 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Fang, Xinyuan / Hu, Xiaonan / Li, Baoli / Su, Hang / Cheng, Ke / Luan, Haitao / Gu, Min

Orbital angular momentum-mediated machine learning for high-accuracy mode-feature encoding

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zejian Ren, Xu Yan, Kai Wen, Huijin Chen, Elnur Hajiyev, Chengdong He, Gyu-Boong Jo

Creation of a tweezer array for cold atoms utilizing a generative neural network

Applications: Deep Learning / Neuronal Network,Optical Trapping /-Tweezers
LC 2012 Spatial Light Modulators
Authors:Matsuda, Naoki; Tanida, Jun; Naruse, Makoto; Horisaki, Ryoichi

Noninvasive holographic imaging through dynamically scattering media

Applications: Turbid-/ Opaque Media /Multi Scattering
HES / HEO 6001 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Ziyu Gu, Mengyang Shi, Yesheng Gao, and Xingzhao Liu

OP-FCNN: an optronic fully convolutional neural network for imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Dejin Zhang, Wei Sheng, Yaoyao Shi, and Youwen Liu

Imaging objects hidden inside the strongly scattering media based on bidirectional ghost imaging

Applications: Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Grace Kuo , Florian Schiffers , Douglas Lanman , Oliver Cossairt , Nathan Matsuda

Multisource Holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheyu Wu, Ran Gao, Sitong Zhou, Fei Wang, Zhipei Li, Huan Chang, Dong Guo, Xiangjun Xin, Qi Zhang, Feng Tian, Qiang Wu

Robust Super-Resolution Image Transmission Based on a Ring Core Fiber with Orbital Angular Momentum

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Sitong Huang, Jian Wang, Daixuan Wu, Yin Huang, and Yuecheng Shen

Projecting colorful images through scattering media via deep learning

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Emory L. Jenkins and Derek J. Burrell

Improved active-tracking performance through Hadamard speckle contrast reduction

Applications: Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingwei Liu, Jing Chen, Bingsen Qiu, Yongtian Wang, and Juan Liu

DCPNet: a dual-channel parallel deep neural network for high quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rafael Barros, Subhajit Bej, Markus Hiekkamäki, Marco Ornigotti, Robert Fickler

High-order aberrations of vortex constellations

Applications: Higher Order Modes / Optical Vortex / OAM,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jia-Qi Lü, Tian-Yu Cheng, Ji-Xiang Guo, Jin-Song Li, Yulei Wang, Zhiwei Lu

Robust measurement of angular velocity based on rotational Doppler effect in misaligned illumination

Applications: Beam Shaping / Beam Steering,Higher Order Modes / Optical Vortex / OAM,Misc.: Speckle / Characterization / Metrology