Propagation-adaptive 4K computer-generated holography using physics-constrained spatial and Fourier neural operator

GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
AR/VR/MR / Holographic Display Deep Learning / Neuronal Network Digital-/ Computer Holography/ CGH
Published on:
Authors: Ninghe Liu, Kexuan Liu, Yixin Yang, Yifan Peng, and Liangcai Cao
Abstract:

Computer-generated holography (CGH) offers a promising method to create true-to-life reconstructions of objects. While recent advances in deep learning-based CGH algorithms have significantly improved the tradeoff between algorithm runtime and image quality, most existing models are restricted to a fixed propagation distance, limiting their adaptability in practical applications. Here, we present a deep learning-based algorithmic CGH solver that achieves propagation-adaptive CGH synthesis using a spatial and Fourier neural operator (SFO-solver). Grounded in two physical insights of optical diffraction, specifically its global information flow and the circular symmetry, SFO-solver encodes both target intensity and propagation distance as network inputs with enhanced physical interpretability. The method enables high-speed 4 K CGH synthesis at 0.16 seconds per frame, delivering an average PSNR of 39.25 dB across a 30 mm depth range. We experimentally demonstrate various-depth 2D holographic projection and an adjustable multi-plane 3D display without requiring hardware modifications. SFO-solver showcases significant improvements in the flexibility of deep learning-based CGH synthesis and provides a scalable foundation to fulfill broader user-oriented requirements such as dynamic refocusing and interactive holographic display.

Open Access

Publication: Nature Communications
Issue/Year: Nat Commun 16, 7761 (2025)
DOI: 10.1038/s41467-025-62997-z
Link: https://doi.org/10.1038/s41467-025-62997-z

Related Papers

LC 2012 Spatial Light Modulators
Authors:Minwook Kim, Chansuk Park, Chulmin Oh, KyeoReh Lee, Herve Hugonnet, and YongKeun Park

Video-rate wavefront capture and replay via single-shot reference-free measurement: toward holographic telepresence

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LUNA PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hanlong Chen, Çağatay Işıl, Che-Yung Shen, Shiqi Chen, Tianyi Gan, Mona Jarrahi, and Aydogan Ozcan

Super-resolution image projection over an extended depth of field using a diffractive decoder

Applications: Deep Learning / Neuronal Network,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu Liu, Peng Su, Jianhua Huang, Huifang Lin, Pengfei Wang, and Feng Huang

Focusing light through turbid and thick scattering media via a hybrid genetic neural network algorithm

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yanqiu Hu, Zihe Zhang, Tao Zhang, Lanqing Jia, Xiao Zhang, Zhujun Wan, Leixin Meng, Kai Wei, and Liangjia Zong

Achieving high diffraction efficiency in LCoS-SLMs via neural-network-based precise fringe-field compensation

Applications: Deep Learning / Neuronal Network,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hyunmin Ban, Wenbin Zhou, and Yifan Peng

Towards Edge Holography via Implicit Neural Representation and Compression

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Erkhembaatar Dashdavaa, Erdenebayar Bayarsaikhan, Munkh-Uchral Erdenebat, Jae-Yeol Cha, Jae-Won Lee, Jin-Hyeok Seo, Hyeon-Su Jeong, Min-Seok Kim, Ji-Sub Park, and Hak-Rin Kim

Dynamic eyebox expansion in holographic near-eye displays via active switching quarter-waveplate geometric phase prisms

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Tianlong Man, Yuwen Zhang, Yuchen Wu, Zhiqing Zhang, Hongqiang Zhou, Liyun Zhong, and Yuhong Wan

Three-dimensional neural network driving self-interference digital holography enables high-fidelity, non-scanning volumetric fluorescence microscopy

Applications: Beam Shaping / Beam Steering,Deep Learning / Neuronal Network,Microscopy
GAEA / GAEA-2 / GAEA-C PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Alessandro Cerioni, Samuele Trezzi, Paolo Pozzi, Gianluca Valentini, Giulio Cerullo, Marco Astarita, Andrea Bassi, Anna Cesaratto, and Tommaso Ongarello

Zero-order diffraction suppression in full field-of-view computer-generated holography: a closed-loop interferometric approach

Applications: Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adrián Garmendía-Martínez, Francisco M. Muñoz Pérez, Juan C. Castro Palacio, Walter D. Furlan, Vicente Ferrando, and Juan A. Monsoriu

Focusing performance of Fibonacci tiling-based zone plates

Applications: Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yuwei Jiang, Wenyu Yang, Yongxin Zhu, and Zunkai Huang

High-Quality Phase-Only Holography via Frequency-Domain Hybrid Encoding and Multi-Scale Complex Attention

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chuncheng Zhang, Zhaoxuan Hu, Tianting Zhong, Haofan Huang, Ji Liang, Yu Wang, Tingting Liu, Zheyi Yao, Qian Chen, Puxiang Lai, and Xiubao Sui

Unlocking high-frequency speckle details via relative frequency learning for robust imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hyunmin Ban, Wenbin Zhou, Xiangyu Meng, and Yifan Evan Peng

Multi-color compressive hologram synthesis with learned wave propagation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shiva Shankar Mutupuri, MD. Haider Ansari, Satish Anamalamudi, Ravi Kumar, Shashi Prabhakar, and Salla Gangi Reddy

Higher-Order Spatial Mode Detection Leveraging Deep Learning on Random Optical Patterns

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:J. Arriaga Hernández, B. Cuevas Otahola, A. Diaz Nayotl, A. Jaramillo Núñez, A. Pérez Villegas, O. Valenzuela b

Machine learning K-means algorithm applied to wavefront sensing in Bi-Ronchi/Hartmann tests with SLM

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ning Xu, Dalong Qi, Long Cheng, Zhen Pan, Wenzhang Lin, Chengyu Zhou, Hongmei Ma, Yunhua Yao, Yuecheng Shen, Lianzhong Deng, Zhenrong Sun, and Shian Zhang

Compressive incoherent digital holography for high-fidelity 3D imaging

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:C. Hainaut, K. Ouahrouche, A. Rancon, G. Patera, C. Ouarkoub, M. Le Parquier, P. Suret, A. Amo

Bidimensional measurements of photon statistics within a multimodal temporal framework

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Pulse Application / -Shaping
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han Chen, Fan Wang, Zhonghao Wang, Pin Wang, Yongwei Yao, Bing Zhang, Yaping Zhang, and Ting-Chung Poon

Unified analytical framework for continuous shading and texture rendering in polygon-based computer-generated holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
ERIS PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Guillaume Noetinger, Tim Tuuva, Romain Fleury

Tutorial: A practical guide to the alignment of defocused spatial light modulators for fast diffractive neural networks

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yaping Tian, Yuhan Zhou, Shiyi Lu, Liming Zhu, Khian-Hooi Chew, Rui-Pin Chen

Mueller matrix-based deep neural network for adaptive reconstruction of orthogonal polarization components of a vector beam transmitted through a highly scattering medium

Applications: Deep Learning / Neuronal Network,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhihao Zhou, Jing Han, Zhuang Zhao, Haotian Yu, and Dongliang Zheng

Large depth range DH-PSF with high peak confinement invariance

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Peng Yi, Zhipeng Wang, Lan Jiang, Xiaowei Li, Yang Liu, Taoyong Li, Andong Wang, Zhi Wang, Xiangyu Zhang, Ji Huang, Qunshuo Wei, Jiafang Li, and Lingling Huang

Reconfigurable holographic patterns for optical security multiplexing fabricated by 3D spatially modulated femtosecond pulses

Applications: Digital-/ Computer Holography/ CGH,Optical Computing / Quantum Optics
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yiqi Ye, Hang Su, Yuetian Jia,, Baoli Li, Min Gu and Xinyuan Fang

High-capacity multiview display with large viewing angle via orbital angular momentum-encoded nanograting arrays

Applications: AR/VR/MR / Holographic Display,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi Zhao, Zhiyuan Wang, Zhipeng Yu, Tianting Zhong, Haoran Li, Shengfu Cheng, Haofan Huang, Chi Man Woo, Huanhao Li, and Puxiang Lai

Speckle Transformer: direct classification through scattering media with limited information

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:Ruidong Li, Caihua Zhang, Kejian Zhu, Zheng Huang, Conghe Wang, Shukai Wu, and Hongwei Chen

Implementation of fully connected layers in optical convolutional neural networks for pre-sensor computing

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics