Complex-valued generative adversarial network for real-time and high-quality computer-generated holography

LETO / LETO-3 Spatial Light Modulators
Deep Learning / Neuronal Network Digital-/ Computer Holography/ CGH
Published on:
Authors: Haifeng Qin, Chao Han, Xuan Shi, Tao Gu and Kangsheng Sun
Abstract:

Real-time generation of high-quality phase-only hologram (POH) is a critical challenge in holographic display. Deep learning-based computer-generated holography (CGH) offers innovative solutions to this challenging problem. In this paper, a complex-valued generative adversarial network (CV-GAN) is proposed for the real-time generation of high-quality POHs. Firstly, a complex-valued U-shaped network (U-Net) is designed as the generator of CV-GAN, which is able to process complex-valued data directly, thereby improving the learning efficiency of the network. Secondly, a complex-valued sub-pixel convolution up-sampling strategy is proposed and an adversarial learning mechanism is established to enhance the fitting ability of the network. Finally, the band-limited angular spectrum method is embedded into the neural network, allowing the CV-GAN to be trained in an unsupervised manner. The proposed algorithm generates high-quality 1920 × 1072 resolution POHs with an average peak-signal-to-noise ratio (PSNR) of 33.68 dB and an average structural similarity index measure (SSIM) of 0.95 at a speed of 51.63 frames per second (FPS) on the DF2K validation dataset. Both numerical reconstructions and optical experiments demonstrate that CV-GAN exhibits excellent fitting ability and lightweight network architecture, capable of generating high-quality POHs efficiently.

Open Access

Publication: Optics Express
Issue/Year: Opt. Express 32, 44437-44451 (2024)
DOI: 10.1364/OE.543792
Link: https://doi.org/10.1364/OE.543792

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Hangyu Zhang, Chenzhe Jiang, Leihong Zhang, and Dawei Zhang

Computational ghost imaging for atmospheric turbulence using model-driven and data-driven deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 Spatial Light Modulators
Authors:Kyosik Min, Myeong-Ho Choi, and Jae-Hyeung Park

Quality enhancement of computer-generated hologram without contents-dependent optimization by considering aberrations in the optical system

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Imaging/ Image Processing
LC-R 720 Spatial Light Modulators
Authors:Don Bonifacio, Laterriean M. Minaya, Xuemei Chen, Yuanwei Zhang, and Xuan Liu

Phase-augmented deep learning for cell segmentation in wrapped quantitative phase images

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngbin Na and Do-Kyeong Ko

Tailoring orbital angular momentum entanglement through inverse design based on gradient descent

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Computing / Quantum Optics
GAEA / GAEA-2 Spatial Light Modulators
Authors:Tobias Wilm, Reinhold Fiess, and Ulrich Seger

In-situ automotive camera calibration using holographic resolution targets

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Materials Processing / Optical Fabrication,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nima Asoudegi and Mo Mojahedi

Orbital Angular Momentum Holography Using Neural Network and Camera in the Loop

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication
LUNA Spatial Light Modulators
Authors:Xiangrui Duan and Zichun Le

Inter-layer edge supplementation in computer-generated multi-depth 3D holograms

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngrok Kim, Dong-Woo Seo, Chihyun In and Sung-Wook Min

Phase-assisted camera-in-the-loop hologram optimization with Fourier aperture function constraint

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Carlos Vargas-Castrillón, Alejandro Velez-Zea, and John Fredy Barrera-Ramírez

Intensity equivalence between free-space propagation and a single-lens processor: application to adjustable magnification in hologram reconstruction

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
GAEA / GAEA-2 Spatial Light Modulators
Authors:Maksymilian Chlipala, Maria-Luisa Cruz, Juan Martinez-Carranza, Moncy Idicula, Rafal Kukolowicz, and Tomasz Kozacki

Wide-angle color holographic near eye display with full bandwidth frequency multiplexing

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ning Xu, Dalong Qi, Long Cheng, Zhen Pan, Chengyu Zhou, Wenzhang Lin, Hongmei Ma, Yunhua Yao, Yuecheng Shen, Lianzhong Deng, Zhenrong Sun, and Shian Zhang

Sparse point spread function-based multi-image optical encryption

Applications: Digital-/ Computer Holography/ CGH,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kenneth Chen, Anzhou Wen, Yunxiang Zhang, Praneeth Chakravarthula and Qi Sun

View synthesis for 3D computer-generated holograms using deep neural fields

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Reza Esmaeilzadeh, Jamasp Jhabvala, Lucas Schlenger, Mathijs van der Meer, Eric Boillat, Cyril Cayron, Amir Mohammad Jamili, Junfeng Xiao, and Roland E. Logé

Toward Architected Microstructures Using Advanced Laser Beam Shaping in Laser Powder Bed Fusion of Ti-6Al-4V

Applications: Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
LUNA Spatial Light Modulators
Authors:Sascha Fricke, Susana Castillo, Martin Eisemann, and Marcus Magnor

Real-Time Rendering Framework for Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Juan Sebastián Ramírez-Quintero, Andres Osorno-Quiroz, Walter Torres-Sepúlveda and Alejandro Mira-Agudelo

Experimental wavefront sensing techniques based on deep learning models using a Hartmann-Shack sensor for visual optics applications

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
GAEA / GAEA-2 Spatial Light Modulators
Authors:Yuki Takemura, Hirohito Nishi, Kyoji Matsushima

Denisyuk-type wavefront printer and its computational correction of aberration in optical system

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenqi Xu, Junmin Leng, Ping Dai and Chao Wang

DSCCNet for high-quality 4K computer-generated holograms

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen

Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Microscopy,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiukun Liao, Shijie Zhang, Yongtian Wang and Juan Liu

High-quality real-time 3D holographic display for real-world scenes based on the optimized layered angular spectrum method

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiajia Wu, Xinkuo Li, Ke Sun, Kai Gao, Chenduan Chen, Jianrong Qiu and Dezhi Tan

Tight Focusing Holographic Network Enables 3D Real Time and Accurate Light Field Modulation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
LETO / LETO-3 Spatial Light Modulators
Authors:Siteng Li, Fei Wang, Zhenfeng Fu, Yaoming Bian and Guohai Situ

Dynamic quantitative phase imaging using deep spatial-temporal prior

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Bahadır Utku Kesgin and Uğur Teğin

Photonic neural networks at the edge of spatiotemporal chaos in multimode fibers

Applications: Deep Learning / Neuronal Network
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenxing Dong, Yuye Ling, Yan Li and Yikai Su

Motion Hologram: Jointly optimized hologram generation and motion planning for photorealistic 3D displays via reinforcement learning

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Riku Watanabe, Seok Kang and Yuji Sakamoto

Binocular holographic display with a wide viewing zone using eye-tracking and multiple reconstruction lights

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH