Complex-valued generative adversarial network for real-time and high-quality computer-generated holography

LETO / LETO-3 Spatial Light Modulators
Deep Learning / Neuronal Network Digital-/ Computer Holography/ CGH
Published on:
Authors: Haifeng Qin, Chao Han, Xuan Shi, Tao Gu and Kangsheng Sun
Abstract:

Real-time generation of high-quality phase-only hologram (POH) is a critical challenge in holographic display. Deep learning-based computer-generated holography (CGH) offers innovative solutions to this challenging problem. In this paper, a complex-valued generative adversarial network (CV-GAN) is proposed for the real-time generation of high-quality POHs. Firstly, a complex-valued U-shaped network (U-Net) is designed as the generator of CV-GAN, which is able to process complex-valued data directly, thereby improving the learning efficiency of the network. Secondly, a complex-valued sub-pixel convolution up-sampling strategy is proposed and an adversarial learning mechanism is established to enhance the fitting ability of the network. Finally, the band-limited angular spectrum method is embedded into the neural network, allowing the CV-GAN to be trained in an unsupervised manner. The proposed algorithm generates high-quality 1920 × 1072 resolution POHs with an average peak-signal-to-noise ratio (PSNR) of 33.68 dB and an average structural similarity index measure (SSIM) of 0.95 at a speed of 51.63 frames per second (FPS) on the DF2K validation dataset. Both numerical reconstructions and optical experiments demonstrate that CV-GAN exhibits excellent fitting ability and lightweight network architecture, capable of generating high-quality POHs efficiently.

Open Access

Publication: Optics Express
Issue/Year: Opt. Express 32, 44437-44451 (2024)
DOI: 10.1364/OE.543792
Link: https://doi.org/10.1364/OE.543792

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen

Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Microscopy,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiukun Liao, Shijie Zhang, Yongtian Wang and Juan Liu

High-quality real-time 3D holographic display for real-world scenes based on the optimized layered angular spectrum method

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval
LETO / LETO-3 Spatial Light Modulators
Authors:Siteng Li, Fei Wang, Zhenfeng Fu, Yaoming Bian and Guohai Situ

Dynamic quantitative phase imaging using deep spatial-temporal prior

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Bahadır Utku Kesgin and Uğur Teğin

Photonic neural networks at the edge of spatiotemporal chaos in multimode fibers

Applications: Deep Learning / Neuronal Network
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenxing Dong, Yuye Ling, Yan Li and Yikai Su

Motion Hologram: Jointly optimized hologram generation and motion planning for photorealistic 3D displays via reinforcement learning

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Riku Watanabe, Seok Kang and Yuji Sakamoto

Binocular holographic display with a wide viewing zone using eye-tracking and multiple reconstruction lights

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LC-R 2500 Spatial Light Modulators
Authors:Jianyi Li, Qingfeng Liu, Liying Tan, Jing Ma and Nanxing Chen

Enhanced Neural Architecture for Real-Time Deep Learning Wavefront Sensing

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:P. Parkprom, N. Chattrapiban and N. Thaicharoen

Aberration correction of optical dipole-traps array utilizing phase-modulated holographic technique

Applications: Digital-/ Computer Holography/ CGH,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi Jia, Bojian Shi, Yanxia Zhang, Hang Li, Xiaoxin Li, Rui Feng, Fangkui Sun, Yongyin Cao, Jian Wang, Cheng-Wei Qiu, Min Gu and Weiqiang Ding

Partially coherent diffractive optical neural network

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jan Marx, Malte Seefeldt, Damian Haske, Christian Lutz, Ralf Hellmann, Cemal Esen, Andreas Ostendorf

Holographic freeform micro hole processing using Bessel beams

Applications: Bessel-/ Airy Beam Generation,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhenting Yan, Huiling Huang, Yili Chen, Hanfei Lin, Ebraheem Farea, Xingzhao Hua and Jun Han

Scattering imaging of moving targets based on recurrent neural networks: a fusion of temporal and phase information

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
LC 2002 Spatial Light Modulators
Authors:Jyoti Bikash Mohapatra, Naveen K. Nishchal and Jyothish Monikantan

Object Recognition in Foggy and Hazy Conditions Using Dark Channel Prior-Based Fringe-Adjusted Joint Transform Correlator

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiwei Fang, Huadong Zheng, Xinxing Xia, Junchang Peng, Tengfei Zhang, Xingyu Lin and Yingjie Yu

Diffraction model-driven neural network with semi-supervised training strategy for real-world 3D holographic photography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Mengyang Shi, Jiahui Ma, Zhishun Guo, Yesheng Gao and Xingzhao Liu

Speckle-free self-supervised learning for scalable imaging through scattering media with unseen condition changes

Applications: Deep Learning / Neuronal Network,Misc.: Speckle / Characterization / Metrology,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 Spatial Light Modulators
Authors:Juan Martinez-Carranza, Jose Martinez-Carranza, Tomasz Kozacki

Efficient point cloud occlusion method for ultra wide-angle computer-generated holograms

Applications: Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Xian Ding, Chenliang Chang, Bo Dai, Qi Wang, Dawei Zhang and Songlin Zhuang

Real-time holographic 3D display using Split–Lohmann Fresnel computer-generated hologram (SL-FCGH)

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Yiran Wei, Yiyun Chen, Mi Zhou, Mu Ku Chen, Shuming Jiao, Qinghua Song, Xiao-Ping Zhang and Zihan Geng

Speckle-free holography with a diffraction-aware global perceptual model

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wei Liu, Chuanfu Tu, Yawen Liu and Zhiwei Ye

Orbital angular momentum superimposed mode recognition based on multi-label image classification

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pin Wang, Fan Wang, Yaping Zhang, Bing Zhang and Ting-Chung Poon

Improved rapid algorithm for continuous shading based on the fully analytical polygon-based method

Applications: Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Eunbi Lee, Youngjin Jo, Seung-Woo Nam, Minseok Chae, Chen Chun, Youngjin Kim, Yoonchan Jeong and Byoungho Lee

Speckle reduced holographic display system with a jointly optimized rotating phase mask

Applications: Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Haofan Huang, Qi Zhao, Huanhao Li, Yuandong Zheng, Zhipeng Yu, Tianting Zhong, Shengfu Cheng, Chi Man Woo, Yi Gao, Honglin Liu, Yuanjin Zheng, Jie Tian, Puxiang Lai

DeepSLM: Speckle-Licensed Modulation via Deep Adversarial Learning for Authorized Optical Encryption and Decryption

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yiwen Zhang, Si-Ao Li, Xiaoyan Wang, Yongxiong Ren, Zihan Geng, Fei Yang, Zhongqi Pan, and Yang Yue

Wedge angle and orientation recognition of multi-opening objects using an attention-based CNN model

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi-Hang Liang, Zi-Le Zhang, Xu-Kai Wang, Ya-Nan Zhao, and Su-Heng Zhang

Single-pixel complex-amplitude imaging based on untrained complex-valued convolutional neural network

Applications: Deep Learning / Neuronal Network,Pulse Application / -Shaping
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Minghao Wang, Dejun Zhang, Wenke Liang, and Wen Guo

Deep learning-based general beam synthesis for atmospheric propagation

Applications: Deep Learning / Neuronal Network,Optical Communication,Turbid-/ Opaque Media /Multi Scattering