Displacement-agnostic coherent imaging through scatter with an interpretable deep neural network

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network Misc.: Speckle / Characterization / Metrology Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Li, Yunzhe; Cheng, Shiyi; Xue, Yujia & Tian, Lei
Abstract:

“Coherent imaging through scatter is a challenging task. Both model-based and data-driven approaches have been explored to solve the inverse scattering problem. In our previous work, we have shown that a deep learning approach can make high-quality and highly generalizable predictions through unseen diffusers. Here, we propose a new deep neural network model that is agnostic to a broader class of perturbations including scatterer change, displacements, and system defocus up to 10× depth of field. In addition, we develop a new analysis framework for interpreting the mechanism of our deep learning model and visualizing its generalizability based on an unsupervised dimension reduction technique. We show that our model can unmix the scattering-specific information and extract the object-specific information and achieve generalization under different scattering conditions. Our work paves the way to a robust and interpretable deep learning approach to imaging through scattering media.”

Open Access

Open Access

Publication: Optics Express
Issue/Year: Optics Express, Volume 29; Number 2; Pages 2244; 2021
DOI: 10.1364/oe.411291
Link: https://doi.org/10.1364/oe.411291

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Harsh Vardhan, Aswathi K Sivarajan, Sakshi Choudhar, Salla Gangi Reddy, and Ravi Kumar

Mode-Dependent Statistical Characteristics of Speckle Patterns From Structured Light Beams

Applications: Misc.: Speckle / Characterization / Metrology
LUNA PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hanlong Chen, Çağatay Işıl, Che-Yung Shen, Shiqi Chen, Tianyi Gan, Mona Jarrahi, and Aydogan Ozcan

Super-resolution image projection over an extended depth of field using a diffractive decoder

Applications: Deep Learning / Neuronal Network,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Guang-Ze Li, Yuhan Zhou, Lu-Hong Zhang, Ning-Chen Cao, Xiao-Bo Hu, Khian-Hooi Chew, and Rui-Pin Chen

Flexible polarization-multiplexing manipulation through a highly scattering medium for high-resolution arbitrary-polarization vector light field generation

Applications: Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu Liu, Peng Su, Jianhua Huang, Huifang Lin, Pengfei Wang, and Feng Huang

Focusing light through turbid and thick scattering media via a hybrid genetic neural network algorithm

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yanqiu Hu, Zihe Zhang, Tao Zhang, Lanqing Jia, Xiao Zhang, Zhujun Wan, Leixin Meng, Kai Wei, and Liangjia Zong

Achieving high diffraction efficiency in LCoS-SLMs via neural-network-based precise fringe-field compensation

Applications: Deep Learning / Neuronal Network,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Erkhembaatar Dashdavaa, Erdenebayar Bayarsaikhan, Munkh-Uchral Erdenebat, Jae-Yeol Cha, Jae-Won Lee, Jin-Hyeok Seo, Hyeon-Su Jeong, Min-Seok Kim, Ji-Sub Park, and Hak-Rin Kim

Dynamic eyebox expansion in holographic near-eye displays via active switching quarter-waveplate geometric phase prisms

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Tianlong Man, Yuwen Zhang, Yuchen Wu, Zhiqing Zhang, Hongqiang Zhou, Liyun Zhong, and Yuhong Wan

Three-dimensional neural network driving self-interference digital holography enables high-fidelity, non-scanning volumetric fluorescence microscopy

Applications: Beam Shaping / Beam Steering,Deep Learning / Neuronal Network,Microscopy
GAEA / GAEA-2 / GAEA-C PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Alessandro Cerioni, Samuele Trezzi, Paolo Pozzi, Gianluca Valentini, Giulio Cerullo, Marco Astarita, Andrea Bassi, Anna Cesaratto, and Tommaso Ongarello

Zero-order diffraction suppression in full field-of-view computer-generated holography: a closed-loop interferometric approach

Applications: Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yuwei Jiang, Wenyu Yang, Yongxin Zhu, and Zunkai Huang

High-Quality Phase-Only Holography via Frequency-Domain Hybrid Encoding and Multi-Scale Complex Attention

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chuncheng Zhang, Zhaoxuan Hu, Tianting Zhong, Haofan Huang, Ji Liang, Yu Wang, Tingting Liu, Zheyi Yao, Qian Chen, Puxiang Lai, and Xiubao Sui

Unlocking high-frequency speckle details via relative frequency learning for robust imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hyunmin Ban, Wenbin Zhou, Xiangyu Meng, and Yifan Evan Peng

Multi-color compressive hologram synthesis with learned wave propagation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shiva Shankar Mutupuri, MD. Haider Ansari, Satish Anamalamudi, Ravi Kumar, Shashi Prabhakar, and Salla Gangi Reddy

Higher-Order Spatial Mode Detection Leveraging Deep Learning on Random Optical Patterns

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
LUNA Spatial Light Modulators
Authors:Antoni J. Wojcik, Dilawer Singh, Ayan Rakshit, Hannah J. Joyce, and Timothy D. Wilkinson

Fourier-plane wavefront and SLM aberration characterization via iterative scanning of beam deflector segments

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenqi Ma, Fan Yang, Xiuquan Li, Haiyan Wang, and Guijun Hu

Modeling and performance analysis for few-mode free-space optical communication reception based on optical-domain coherent beam combining

Applications: Optical Communication,Telecom / Optical Switching / WSS,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:J. Arriaga Hernández, B. Cuevas Otahola, A. Diaz Nayotl, A. Jaramillo Núñez, A. Pérez Villegas, O. Valenzuela b

Machine learning K-means algorithm applied to wavefront sensing in Bi-Ronchi/Hartmann tests with SLM

Applications: Deep Learning / Neuronal Network
ERIS PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Guillaume Noetinger, Tim Tuuva, Romain Fleury

Tutorial: A practical guide to the alignment of defocused spatial light modulators for fast diffractive neural networks

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adam J. Vallance, Aleksandr Boldin, Ultan J. Daly, and Martin P.J. Lavery

Structured light probe for turbulent media

Applications: Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yaping Tian, Yuhan Zhou, Shiyi Lu, Liming Zhu, Khian-Hooi Chew, Rui-Pin Chen

Mueller matrix-based deep neural network for adaptive reconstruction of orthogonal polarization components of a vector beam transmitted through a highly scattering medium

Applications: Deep Learning / Neuronal Network,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi Zhao, Zhiyuan Wang, Zhipeng Yu, Tianting Zhong, Haoran Li, Shengfu Cheng, Haofan Huang, Chi Man Woo, Huanhao Li, and Puxiang Lai

Speckle Transformer: direct classification through scattering media with limited information

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:Ruidong Li, Caihua Zhang, Kejian Zhu, Zheng Huang, Conghe Wang, Shukai Wu, and Hongwei Chen

Implementation of fully connected layers in optical convolutional neural networks for pre-sensor computing

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Atefeh Akbarpour, Adad Yepiz, Benjamin Perez-Garcia, J. A. Alvarez-Chavez, Herman L. Offerhaus & Raul I. Hernandez-Aranda

Partially coherent Mathieu–Gauss beams

Applications: Beam Shaping / Beam Steering,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
HES / HEO 6001 Spatial Light Modulators
Authors:Yining Hao, Yang Peng, Tianshun Zhang, and Wen Chen

High-quality photon-limited imaging through dynamic and complex scattering media with a single-photon detector

Applications: Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ruitao Wu, Juncheng Fang, Rui Pan, Rongyi Lin, Kaiyuan Li, Ting Lei, Luping Du, Xiaocong Yuan

Physical Interpretation of Diffractive Optical Networks for High-Dimensional Vortex Mode Sorting

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ivan B. Djordjevic and Ignacio A. Rojas

SLM steering-based covert communication over strong atmospheric turbulence channels

Applications: Beam Shaping / Beam Steering,Optical Communication,Turbid-/ Opaque Media /Multi Scattering