Projecting colorful images through scattering media via deep learning

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network
Published on:
Authors: Sitong Huang, Jian Wang, Daixuan Wu, Yin Huang, and Yuecheng Shen
Abstract:

The existence of scatterers in the optical path has been the major obstacle that prohibits one from projecting images through solid walls, turbid water, clouds, and fog. Recent developments in wavefront shaping and neural networks demonstrate effective compensation for scattering effects, showing the promise to project clear images against strong scattering. However, previous studies were mainly restricted to projecting greyscale images using monochromatic light, mainly due to the increased complexity of simultaneously controlling multiple wavelengths. In this work, we fill this blank by developing a projector network, which enables the projection of colorful images through scattering media with three primary colors. To validate the performance of the projector network, we experimentally demonstrated projecting colorful images obtained from the MINST dataset through two stacked diffusers. Quantitatively, the averaged intensity Pearson’s correlation coefficient for 1,000 test colorful images reaches about 90.6%, indicating the superiority of the developed network. We anticipate that the projector network can be beneficial to a variety of display applications in scattering environments.

Open Access

Publication: Optics Express
Issue/Year: Opt. Express 31, 36745-36753 (2023)
DOI: 10.1364/OE.504156
Link: https://doi.org/10.1364/OE.504156

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zejian Ren, Xu Yan, Kai Wen, Huijin Chen, Elnur Hajiyev, Chengdong He, Gyu-Boong Jo

Creation of a tweezer array for cold atoms utilizing a generative neural network

Applications: Deep Learning / Neuronal Network,Optical Trapping /-Tweezers
HES / HEO 6001 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Ziyu Gu, Mengyang Shi, Yesheng Gao, and Xingzhao Liu

OP-FCNN: an optronic fully convolutional neural network for imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Grace Kuo , Florian Schiffers , Douglas Lanman , Oliver Cossairt , Nathan Matsuda

Multisource Holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheyu Wu, Ran Gao, Sitong Zhou, Fei Wang, Zhipei Li, Huan Chang, Dong Guo, Xiangjun Xin, Qi Zhang, Feng Tian, Qiang Wu

Robust Super-Resolution Image Transmission Based on a Ring Core Fiber with Orbital Angular Momentum

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingwei Liu, Jing Chen, Bingsen Qiu, Yongtian Wang, and Juan Liu

DCPNet: a dual-channel parallel deep neural network for high quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Marshall B. Lindsay, Scott D. Kovaleski, Andy G. Varner, Charlie T. Veal, Derek T. Anderson, Stanton R. Price, and Steven R. Price

End-to-end physics-informed deep neural network optimization of sub-Nyquist lenses

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jianan Feng, Hang Chen, Dahai Yang, Junbo Hao, Jie Lin, and Peng Jin

Multi-wavelength diffractive neural network with the weighting method

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhang, Yantong, Huiling Huang, Feibin Wu, Jun Han, Yi Yang, and Ruyi Li

Imaging through a Scattering Medium under Different Intensities of Ambient Light Interference

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiangcheng Zhao, Chuanbiao Bai, Zhiguo Zhang and Qingchuan Zhang

Deep learning-based method for analyzing the optically trapped sperm rotation

Applications: Deep Learning / Neuronal Network,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ruibo Shang, Mikaela A. O’Brien, Fei Wang, Guohai Situ & Geoffrey P. Luke

Approximating the uncertainty of deep learning reconstruction predictions in single-pixel imaging

Applications: Deep Learning / Neuronal Network
GAEA Spatial Light Modulators
Authors:Ninghe Liu, Zhengzhong Huang, Zehao He, and Liangcai Cao

DGE-CNN: 2D-to-3D holographic display based on a depth gradient extracting module and ZCNN network

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhu, Jialong / Zou, Fucheng / Wang, Le / Lu, Xiaodong / Zhao, Shengmei

Multiplexing Perfect Optical Vortex for Holographic Data Storage

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
LC 2012 Spatial Light Modulators
Authors:Weng, Xiaojing / Feng, Ji / Perry, Altai / Vuong, Luat T.

Non-Line-of-Sight Full-Stokes Polarimetric Imaging with Solution-Processed Metagratings and Shallow Neural Networks

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheng, Huadong / Peng, Junchang / Wang, Zhen / xinghua Shui / yu yingjie / Xia, Xinxing

Diffraction model-driven neural network trained using hybrid domain loss for real-time and high-quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LC 2012 Spatial Light Modulators
Authors:Tsukada, Takumi / Watanabe, Wataru

Central wavelength estimation in spectral imaging behind a diffuser via deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wang, Jian; Zhong, Guangchao; Wu, Daixuan; Huang, Sitong; Luo, Zhi-Chao & Shen, Yuecheng

Multimode fiber-based greyscale image projector enabled by neural networks with high generalization ability

Applications: Deep Learning / Neuronal Network
GAEA Spatial Light Modulators
Authors:Dong, Zhenxing; Xu, Chao; Ling, Yuye; Li, Yan & Su, Yikai

Fourier-inspired neural module for real-time and high-fidelity computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jia, Qi; Zhang, Yanxia; Shi, Bojian; Li, Hang; Li, Xiaoxin; Feng, Rui; Sun, Fangkui; Cao, Yongyin; Wang, Jian; Qiu, Cheng-Wei & Ding, Weiqiang

Simultaneously sorting vector vortex beams of 120 modes

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kürekci, Şahin

Optical classification and reconstruction through multimode fibers

Applications: Deep Learning / Neuronal Network,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shui, Xinghua; Zheng, Huadong; Xia, Xinxing; Yang, Furong; Wang, Weisen & Yu, Yingjie

Diffraction model-informed neural network for unsupervised layer-based computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Li, Yunzhe; Cheng, Shiyi; Xue, Yujia & Tian, Lei

Displacement-agnostic coherent imaging through scatter with an interpretable deep neural network

Applications: Deep Learning / Neuronal Network,Misc.: Speckle / Characterization / Metrology,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nehme, Elias; Freedman, Daniel; Gordon, Racheli; Ferdman, Boris; Weiss, Lucien E.; Alalouf, Onit; Orange, Reut; Michaeli, Tomer & Shechtman, Yoav

DeepSTORM3D: dense three dimensional localization microscopy and point spread function design by deep learning

Applications: Deep Learning / Neuronal Network,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Omri Wengrowicz, Or Peleg, Tom Zahavy, Barry Loevsky, and Oren Cohen

Deep neural networks in single-shot ptychography

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing