Fourier-inspired neural module for real-time and high-fidelity computer-generated holography

GAEA Spatial Light Modulators
Deep Learning / Neuronal Network Digital-/ Computer Holography/ CGH
Published on:
Authors: Dong, Zhenxing; Xu, Chao; Ling, Yuye; Li, Yan & Su, Yikai
Abstract:
“Learning-based computer-generated holography (CGH) algorithms appear as novel alternatives to generate phase-only holograms. However, most existing learning-based approaches underperform their iterative peers regarding display quality. Here, we recognize that current convolutional neural networks have difficulty learning cross-domain tasks due to the limited receptive field. In order to overcome this limitation, we propose a Fourier-inspired neural module, which can be easily integrated into various CGH frameworks and significantly enhance the quality of reconstructed images. By explicitly leveraging Fourier transforms within the neural network architecture, the mesoscopic information within the phase-only hologram can be more handily extracted. Both simulation and experiment were performed to showcase its capability. By incorporating it into U-Net and HoloNet, the peak signal-to-noise ratio of reconstructed images is measured at 29.16 dB and 33.50 dB during the simulation, which is 4.97 dB and 1.52 dB higher than those by the baseline U-Net and HoloNet, respectively. Similar trends are observed in the experimental results. We also experimentally demonstrated that U-Net and HoloNet with the proposed module can generate a monochromatic 1080p hologram in 0.015 s and 0.020 s, respectively.”

Restricted Access

Publication: Optics Letters
Issue/Year: Optics Letters, Volume 48; Number 3; Pages 759; 2023
DOI: 10.1364/ol.477630
Link: https://doi.org/10.1364/ol.477630

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiangcheng Zhao, Chuanbiao Bai, Zhiguo Zhang and Qingchuan Zhang

Deep learning-based method for analyzing the optically trapped sperm rotation

Applications: Deep Learning / Neuronal Network,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhu, Jialong / Zou, Fucheng / Wang, Le / Lu, Xiaodong / Zhao, Shengmei

Multiplexing Perfect Optical Vortex for Holographic Data Storage

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
LC 2012 Spatial Light Modulators
Authors:Weng, Xiaojing / Feng, Ji / Perry, Altai / Vuong, Luat T.

Non-Line-of-Sight Full-Stokes Polarimetric Imaging with Solution-Processed Metagratings and Shallow Neural Networks

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Polarization Generation
GAEA Spatial Light Modulators
Authors:Tilmon, Brevin; Sun, Zhanghao; Koppal, Sanjeev; Wu, Yicheng; Evangelidis, Georgios; Zahreddine, Ramzi; Krishnan, Guru; Ma, Sizhuo & Wang, Jian

Energy-Efficient Adaptive 3D Sensing

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheng, Huadong / Peng, Junchang / Wang, Zhen / xinghua Shui / yu yingjie / Xia, Xinxing

Diffraction model-driven neural network trained using hybrid domain loss for real-time and high-quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Chaohui; Xin, Jun; Li, Yanan; Lu, Xiao-Ming

Measuring small displacements of an optical point source with digital holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LC 2012 Spatial Light Modulators
Authors:Tsukada, Takumi / Watanabe, Wataru

Central wavelength estimation in spectral imaging behind a diffuser via deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pan, Shu; Wang, Li; Ma, Yuanzheng; Zhang, Guangyu; Liu, Rui; Zhang, Tao; Xiong, Kedi; Chen, Siyu; Zhang, Jian; Li, Wende; Yang, Sihua

Photoacoustic-enabled automatic vascular navigation: accurate and naked-eye real-time visualization of deep-seated vessels

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Zhehai; Hu, Guoqing; Zhao, Shuang; Li, Huiyu; Zhang, Fan

Holographic Optical Tweezers That Use an Improved Gerchberg–Saxton Algorithm

Applications: Digital-/ Computer Holography/ CGH,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Fusco, Sandra; Oscurato, Stefano Luigi; Salvatore, Marcella; Reda, Francesco; Moujdi, Sara; Oliveira, Michael De; Ambrosio, Antonio; Centore, Roberto & Borbone, Fabio

Efficient High-Refractive-Index Azobenzene Dendrimers Based on a Hierarchical Supramolecular Approach

Applications: Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
LETO / LETO-3 Spatial Light Modulators
Authors:Khuderchuluun, Anar; Dashdavaa, Erkhembaatar; Rupali, Shindae; Kwon, Ki-Chul; Kang, Hoonjong; Lee, Kwon-Yeon & Kim, Nam

Color optimization of a full-color holographic stereogram printing system using a single SLM based on iterative exposure control

Applications: Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wang, Jian; Zhong, Guangchao; Wu, Daixuan; Huang, Sitong; Luo, Zhi-Chao & Shen, Yuecheng

Multimode fiber-based greyscale image projector enabled by neural networks with high generalization ability

Applications: Deep Learning / Neuronal Network
GAEA Spatial Light Modulators
Authors:Gao, Yunhui & Cao, Liangcai

Pixel super-resolution quantitative phase imaging based on modulation diversity

Applications: Digital-/ Computer Holography/ CGH,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jia, Qi; Zhang, Yanxia; Shi, Bojian; Li, Hang; Li, Xiaoxin; Feng, Rui; Sun, Fangkui; Cao, Yongyin; Wang, Jian; Qiu, Cheng-Wei & Ding, Weiqiang

Simultaneously sorting vector vortex beams of 120 modes

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kürekci, Şahin

Optical classification and reconstruction through multimode fibers

Applications: Deep Learning / Neuronal Network,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Falldorf, Claas; Rukin, Ilja; Müller, André F.; Kroker, Stefanie & Bergmann, Ralf. B.

Functional pixels: a pathway towards true holographic displays using today’s display technology

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shui, Xinghua; Zheng, Huadong; Xia, Xinxing; Yang, Furong; Wang, Weisen & Yu, Yingjie

Diffraction model-informed neural network for unsupervised layer-based computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Benedicto, David; Collados, María Victoria; Martín, Juan C.; Jesus Atencia; Mendoza-Yero, Omel & Vallés, Juan A.

Contribution to the Improvement of the Correlation Filter Method for Modal Analysis with a Spatial Light Modulator

Applications: Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Abdelazeem, Rania M. & Agour, Mostafa

Color Holographic Visualization of an Abnormal Retina: A Training Guide

Applications: Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Jonghyun Kim, Manu Gopakumar, Suyeon Choi, Yifan Peng, Ward Lopes and Gordon Wetzstein

Holographic Glasses for Virtual Reality

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Kim, Dongyeon; Nam, Seung-Woo; Lee, Byounghyo; Seo, Jong-Mo & Lee, Byoungho

Accommodative holography: improving accommodation response for perceptually realistic holographic displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LUNA Spatial Light Modulators
Authors:Benedicto, David; Collados, M. Victoria; Martín, Juan C.; Jesú s Atencia & Vallés, Juan A.

Coupled two-core integrated waveguides modal analysis

Applications: Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Gao, Yunhui; Yang, Feng & Cao, Liangcai

Pixel Super-Resolution Phase Retrieval for Lensless On-Chip Microscopy via Accelerated Wirtinger Flow

Applications: Digital-/ Computer Holography/ CGH,Phase Measurement / Phase Retrieval
LETO / LETO-3 Spatial Light Modulators
Authors:Chakravarthula, Praneeth; Tseng, Ethan; Fuchs, Henry & Heide, Felix

Hogel-free Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH