Neural network enabled fringe projection through scattering media

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Shile Yang, Yuecheng Shen, Jiawei Luo, Zhengyang Wang, Daixuan Wu, Jiaming Liang, Zhiling Zhang, Dalong Qi, Yunhua Yao, Lianzhong Deng, Bin Zhang, Zhenrong Sun, and Shian Zhang
Abstract:

The projection of fringes plays an essential role in many applications, such as fringe projection profilometry and structured illumination microscopy. However, these capabilities are significantly constrained in environments affected by optical scattering. Although recent developments in wavefront shaping have effectively generated high-fidelity focal points and relatively simple structured images amidst scattering, the ability to project fringes that cover half of the projection area has not yet been achieved. To address this limitation, this study presents a fringe projector enabled by a neural network, capable of projecting fringes with variable periodicities and orientation angles through scattering media. We tested this projector on two types of scattering media: ground glass diffusers and multimode fibers. For these scattering media, the average Pearson’s correlation coefficients between the projected fringes and their designed configurations are 86.9% and 79.7%, respectively. These results demonstrate the effectiveness of the proposed neural network enabled fringe projector. This advancement is expected to broaden the scope of fringe-based imaging techniques, making it feasible to employ them in conditions previously hindered by scattering effects.

Open Access

Publication: Optics Express
Issue/Year: Opt. Express 32, 21269-21280 (2024)
DOI: 10.1364/OE.527431
Link: https://doi.org/10.1364/OE.527431

Related Papers

LUNA PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hanlong Chen, Çağatay Işıl, Che-Yung Shen, Shiqi Chen, Tianyi Gan, Mona Jarrahi, and Aydogan Ozcan

Super-resolution image projection over an extended depth of field using a diffractive decoder

Applications: Deep Learning / Neuronal Network,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Erkhembaatar Dashdavaa, Erdenebayar Bayarsaikhan, Munkh-Uchral Erdenebat, Jae-Yeol Cha, Jae-Won Lee, Jin-Hyeok Seo, Hyeon-Su Jeong, Min-Seok Kim, Ji-Sub Park, and Hak-Rin Kim

Dynamic eyebox expansion in holographic near-eye displays via active switching quarter-waveplate geometric phase prisms

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Tianlong Man, Yuwen Zhang, Yuchen Wu, Zhiqing Zhang, Hongqiang Zhou, Liyun Zhong, and Yuhong Wan

Three-dimensional neural network driving self-interference digital holography enables high-fidelity, non-scanning volumetric fluorescence microscopy

Applications: Beam Shaping / Beam Steering,Deep Learning / Neuronal Network,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yuwei Jiang, Wenyu Yang, Yongxin Zhu, and Zunkai Huang

High-Quality Phase-Only Holography via Frequency-Domain Hybrid Encoding and Multi-Scale Complex Attention

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chuncheng Zhang, Zhaoxuan Hu, Tianting Zhong, Haofan Huang, Ji Liang, Yu Wang, Tingting Liu, Zheyi Yao, Qian Chen, Puxiang Lai, and Xiubao Sui

Unlocking high-frequency speckle details via relative frequency learning for robust imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hyunmin Ban, Wenbin Zhou, Xiangyu Meng, and Yifan Evan Peng

Multi-color compressive hologram synthesis with learned wave propagation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shiva Shankar Mutupuri, MD. Haider Ansari, Satish Anamalamudi, Ravi Kumar, Shashi Prabhakar, and Salla Gangi Reddy

Higher-Order Spatial Mode Detection Leveraging Deep Learning on Random Optical Patterns

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenqi Ma, Fan Yang, Xiuquan Li, Haiyan Wang, and Guijun Hu

Modeling and performance analysis for few-mode free-space optical communication reception based on optical-domain coherent beam combining

Applications: Optical Communication,Telecom / Optical Switching / WSS,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:J. Arriaga Hernández, B. Cuevas Otahola, A. Diaz Nayotl, A. Jaramillo Núñez, A. Pérez Villegas, O. Valenzuela b

Machine learning K-means algorithm applied to wavefront sensing in Bi-Ronchi/Hartmann tests with SLM

Applications: Deep Learning / Neuronal Network
ERIS PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Guillaume Noetinger, Tim Tuuva, Romain Fleury

Tutorial: A practical guide to the alignment of defocused spatial light modulators for fast diffractive neural networks

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adam J. Vallance, Aleksandr Boldin, Ultan J. Daly, and Martin P.J. Lavery

Structured light probe for turbulent media

Applications: Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yaping Tian, Yuhan Zhou, Shiyi Lu, Liming Zhu, Khian-Hooi Chew, Rui-Pin Chen

Mueller matrix-based deep neural network for adaptive reconstruction of orthogonal polarization components of a vector beam transmitted through a highly scattering medium

Applications: Deep Learning / Neuronal Network,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi Zhao, Zhiyuan Wang, Zhipeng Yu, Tianting Zhong, Haoran Li, Shengfu Cheng, Haofan Huang, Chi Man Woo, Huanhao Li, and Puxiang Lai

Speckle Transformer: direct classification through scattering media with limited information

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:Ruidong Li, Caihua Zhang, Kejian Zhu, Zheng Huang, Conghe Wang, Shukai Wu, and Hongwei Chen

Implementation of fully connected layers in optical convolutional neural networks for pre-sensor computing

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Atefeh Akbarpour, Adad Yepiz, Benjamin Perez-Garcia, J. A. Alvarez-Chavez, Herman L. Offerhaus & Raul I. Hernandez-Aranda

Partially coherent Mathieu–Gauss beams

Applications: Beam Shaping / Beam Steering,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
HES / HEO 6001 Spatial Light Modulators
Authors:Yining Hao, Yang Peng, Tianshun Zhang, and Wen Chen

High-quality photon-limited imaging through dynamic and complex scattering media with a single-photon detector

Applications: Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ruitao Wu, Juncheng Fang, Rui Pan, Rongyi Lin, Kaiyuan Li, Ting Lei, Luping Du, Xiaocong Yuan

Physical Interpretation of Diffractive Optical Networks for High-Dimensional Vortex Mode Sorting

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ivan B. Djordjevic and Ignacio A. Rojas

SLM steering-based covert communication over strong atmospheric turbulence channels

Applications: Beam Shaping / Beam Steering,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ping Wang, Meiling Zhou, Runze Li, Tong Peng, Yuan Zhou, Dan Dan, Junwei Min, Cuiping Yao, and Baoli Yao

Non-invasive fluorescence imaging through scattering media via variance-guided wavefront shaping and convex optimization-based deconvolution

Applications: Beam Shaping / Beam Steering,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
ERIS Spatial Light Modulators
Authors:Ying Zhao, Hao Wang, Dan Li, Ping Yan, and Qirong Xiao

In-situ forward sparse training of large-scale optical neural networks

Applications: Deep Learning / Neuronal Network,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jun Zeng, Ruyi Li, Zhao Zhang, Dong Xu, Bernhard J. Hoenders, Fei Wang, Haiyun Wang, Yangjian Cai, and Hui Zhang

Partially coherent persistent hollow beams enabled by cross-phase modulation

Applications: Higher Order Modes / Optical Vortex / OAM,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qian Zhang, Yu Miao, Jiali Sun, Yuan Sui, Stefan Rothe, and Juergen W. Czarske

Digital design of mode decomposition systems for multimode fibers using physics-informed neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chenliang Chang, Chenzhou Zhao, Bo Dai, Qi Wang, Dawei Zhang, Songlin Zhuang, and Chao Ping Chen

Memory-Reduced Convolutional Neural Network for Fast Phase Hologram Generation

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ziang Xiao, Yuhan Gong, Pengxiang Wang, Yixun Huang, Mian Wu, Lin Wu, Chao Yang, Bertrand Kibler, Arnaud Mussot, Jin Tao, and Gang Xu

Enhancement of Free-Space Optical Communication with Structured Frequency Combs

Applications: Beam Shaping / Beam Steering,Higher Order Modes / Optical Vortex / OAM,Optical Communication,Telecom / Optical Switching / WSS,Turbid-/ Opaque Media /Multi Scattering