Fourier-inspired neural module for real-time and high-fidelity computer-generated holography

GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Deep Learning / Neuronal Network Digital-/ Computer Holography/ CGH
Published on:
Authors: Dong, Zhenxing; Xu, Chao; Ling, Yuye; Li, Yan & Su, Yikai
Abstract:
“Learning-based computer-generated holography (CGH) algorithms appear as novel alternatives to generate phase-only holograms. However, most existing learning-based approaches underperform their iterative peers regarding display quality. Here, we recognize that current convolutional neural networks have difficulty learning cross-domain tasks due to the limited receptive field. In order to overcome this limitation, we propose a Fourier-inspired neural module, which can be easily integrated into various CGH frameworks and significantly enhance the quality of reconstructed images. By explicitly leveraging Fourier transforms within the neural network architecture, the mesoscopic information within the phase-only hologram can be more handily extracted. Both simulation and experiment were performed to showcase its capability. By incorporating it into U-Net and HoloNet, the peak signal-to-noise ratio of reconstructed images is measured at 29.16 dB and 33.50 dB during the simulation, which is 4.97 dB and 1.52 dB higher than those by the baseline U-Net and HoloNet, respectively. Similar trends are observed in the experimental results. We also experimentally demonstrated that U-Net and HoloNet with the proposed module can generate a monochromatic 1080p hologram in 0.015 s and 0.020 s, respectively.”

Restricted Access

Publication: Optics Letters
Issue/Year: Optics Letters, Volume 48; Number 3; Pages 759; 2023
DOI: 10.1364/ol.477630
Link: https://doi.org/10.1364/ol.477630

Related Papers

ERIS Spatial Light Modulators
Authors:Ying Zhao, Hao Wang, Dan Li, Ping Yan, and Qirong Xiao

In-situ forward sparse training of large-scale optical neural networks

Applications: Deep Learning / Neuronal Network,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qian Zhang, Yu Miao, Jiali Sun, Yuan Sui, Stefan Rothe, and Juergen W. Czarske

Digital design of mode decomposition systems for multimode fibers using physics-informed neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chenliang Chang, Chenzhou Zhao, Bo Dai, Qi Wang, Dawei Zhang, Songlin Zhuang, and Chao Ping Chen

Memory-Reduced Convolutional Neural Network for Fast Phase Hologram Generation

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Chuxuan Huang, Yue Huang, and Manhua Liu

NeuHolo: non-interferometric quantitative single-shot holographic imaging for 3D metrology using neural fields

Applications: Deep Learning / Neuronal Network,Phase Measurement / Phase Retrieval
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yuta Goto, Satoshi Shinada, Atsushi Okamoto, Naoya Wada, and Hideaki Furukawa

Compact-size and high mode-scalability spatial-mode multiplexer using multiplexed volume holograms

Applications: Digital-/ Computer Holography/ CGH,Optical Communication,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Likai Cheng, Jianming Gao, Banlian Xu, Leihong Zhang, and Dawei Zhang

Computational ghost imaging of atmospheric turbulence based on a single variable convolution kernel

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Suyeon Choi, Changwon Jang, Douglas Lanman & Gordon Wetzstein

Synthetic aperture waveguide holography for compact mixed-reality displays with large étendue

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xing Li, Dan Dan, Siarhei Zavatski, Wenyu Gao, Qiang Zhang, Yuan Zhou, Jia Qian, Yanlong Yang, Xianghua Yu, Shaohui Yan, Xiaohao Xu, Olivier J. F. Martin, and Baoli Yao

Optical tweeze-sectioning microscopy for 3D imaging and manipulation of suspended cells

Applications: Digital-/ Computer Holography/ CGH,Microscopy,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Hangyu Zhang, Chenzhe Jiang, Leihong Zhang, and Dawei Zhang

Computational ghost imaging for atmospheric turbulence using model-driven and data-driven deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Kyosik Min, Myeong-Ho Choi, and Jae-Hyeung Park

Quality enhancement of computer-generated hologram without contents-dependent optimization by considering aberrations in the optical system

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Imaging/ Image Processing
LC-R 720 Spatial Light Modulators
Authors:Don Bonifacio, Laterriean M. Minaya, Xuemei Chen, Yuanwei Zhang, and Xuan Liu

Phase-augmented deep learning for cell segmentation in wrapped quantitative phase images

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngbin Na and Do-Kyeong Ko

Tailoring orbital angular momentum entanglement through inverse design based on gradient descent

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Computing / Quantum Optics
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Tobias Wilm, Reinhold Fiess, and Ulrich Seger

In-situ automotive camera calibration using holographic resolution targets

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Materials Processing / Optical Fabrication,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nima Asoudegi and Mo Mojahedi

Orbital Angular Momentum Holography Using Neural Network and Camera in the Loop

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication
LUNA Spatial Light Modulators
Authors:Xiangrui Duan and Zichun Le

Inter-layer edge supplementation in computer-generated multi-depth 3D holograms

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngrok Kim, Dong-Woo Seo, Chihyun In and Sung-Wook Min

Phase-assisted camera-in-the-loop hologram optimization with Fourier aperture function constraint

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Carlos Vargas-Castrillón, Alejandro Velez-Zea, and John Fredy Barrera-Ramírez

Intensity equivalence between free-space propagation and a single-lens processor: application to adjustable magnification in hologram reconstruction

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Maksymilian Chlipala, Maria-Luisa Cruz, Juan Martinez-Carranza, Moncy Idicula, Rafal Kukolowicz, and Tomasz Kozacki

Wide-angle color holographic near eye display with full bandwidth frequency multiplexing

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ning Xu, Dalong Qi, Long Cheng, Zhen Pan, Chengyu Zhou, Wenzhang Lin, Hongmei Ma, Yunhua Yao, Yuecheng Shen, Lianzhong Deng, Zhenrong Sun, and Shian Zhang

Sparse point spread function-based multi-image optical encryption

Applications: Digital-/ Computer Holography/ CGH,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kenneth Chen, Anzhou Wen, Yunxiang Zhang, Praneeth Chakravarthula and Qi Sun

View synthesis for 3D computer-generated holograms using deep neural fields

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Reza Esmaeilzadeh, Jamasp Jhabvala, Lucas Schlenger, Mathijs van der Meer, Eric Boillat, Cyril Cayron, Amir Mohammad Jamili, Junfeng Xiao, and Roland E. Logé

Toward Architected Microstructures Using Advanced Laser Beam Shaping in Laser Powder Bed Fusion of Ti-6Al-4V

Applications: Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
LUNA Spatial Light Modulators
Authors:Sascha Fricke, Susana Castillo, Martin Eisemann, and Marcus Magnor

Real-Time Rendering Framework for Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Juan Sebastián Ramírez-Quintero, Andres Osorno-Quiroz, Walter Torres-Sepúlveda and Alejandro Mira-Agudelo

Experimental wavefront sensing techniques based on deep learning models using a Hartmann-Shack sensor for visual optics applications

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yuki Takemura, Hirohito Nishi, Kyoji Matsushima

Denisyuk-type wavefront printer and its computational correction of aberration in optical system

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH