Multi-color compressive hologram synthesis with learned wave propagation

PLUTO / PLUTO-2 Spatial Light Modulators
AR/VR/MR / Holographic Display Deep Learning / Neuronal Network Digital-/ Computer Holography/ CGH
Published on:
Authors: Hyunmin Ban, Wenbin Zhou, Xiangyu Meng, and Yifan Evan Peng
Abstract:

Holographic displays are a promising technology for delivering immersive, true 3D visualization in virtual and augmented reality applications. However, generating high-fidelity phase-only holograms remains challenging, especially with the demand for efficient compression to handle the substantial data inherent in high-resolution holographic streaming. Existing techniques often struggle to balance the trade-off between optical display quality and compression efficiency, and jointly optimizing these aspects is still in its infancy. This work presents a learning-empowered multi-color hologram compression scheme that utilizes a pre-trained, camera-calibrated wave propagation model, especially for unfiltered holographic display configurations with compact form factors. In particular, the inter-color processing leverages the inherent redundancy across color channels, allowing for efficient compression. By incorporating the learned camera-calibrated wave propagation model into our training process, we can achieve superior optical display quality and compression rates. Experiments demonstrate that our method realizes a reduction in bits per pixel (bpp) of 44% to 74% over representative baselines at the same quality level. We envision the proposed compressive hologram synthesis scheme establishing a new benchmark for high-fidelity holographic reconstruction at lower bitrates, marking a significant advance towards the deployment of holography-empowered visual media systems.

Open Access

Publication: Computational Visual Media
Issue/Year: Comput. Vis. Media (2026)
DOI: 10.26599/CVM.2025.9450497
Link: https://doi.org/10.26599/CVM.2025.9450497

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Erkhembaatar Dashdavaa, Erdenebayar Bayarsaikhan, Munkh-Uchral Erdenebat, Jae-Yeol Cha, Jae-Won Lee, Jin-Hyeok Seo, Hyeon-Su Jeong, Min-Seok Kim, Ji-Sub Park, and Hak-Rin Kim

Dynamic eyebox expansion in holographic near-eye displays via active switching quarter-waveplate geometric phase prisms

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Tianlong Man, Yuwen Zhang, Yuchen Wu, Zhiqing Zhang, Hongqiang Zhou, Liyun Zhong, and Yuhong Wan

Three-dimensional neural network driving self-interference digital holography enables high-fidelity, non-scanning volumetric fluorescence microscopy

Applications: Beam Shaping / Beam Steering,Deep Learning / Neuronal Network,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adrián Garmendía-Martínez, Francisco M. Muñoz Pérez, Juan C. Castro Palacio, Walter D. Furlan, Vicente Ferrando, and Juan A. Monsoriu

Focusing performance of Fibonacci tiling-based zone plates

Applications: Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yuwei Jiang, Wenyu Yang, Yongxin Zhu, and Zunkai Huang

High-Quality Phase-Only Holography via Frequency-Domain Hybrid Encoding and Multi-Scale Complex Attention

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chuncheng Zhang, Zhaoxuan Hu, Tianting Zhong, Haofan Huang, Ji Liang, Yu Wang, Tingting Liu, Zheyi Yao, Qian Chen, Puxiang Lai, and Xiubao Sui

Unlocking high-frequency speckle details via relative frequency learning for robust imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shiva Shankar Mutupuri, MD. Haider Ansari, Satish Anamalamudi, Ravi Kumar, Shashi Prabhakar, and Salla Gangi Reddy

Higher-Order Spatial Mode Detection Leveraging Deep Learning on Random Optical Patterns

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:J. Arriaga Hernández, B. Cuevas Otahola, A. Diaz Nayotl, A. Jaramillo Núñez, A. Pérez Villegas, O. Valenzuela b

Machine learning K-means algorithm applied to wavefront sensing in Bi-Ronchi/Hartmann tests with SLM

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ning Xu, Dalong Qi, Long Cheng, Zhen Pan, Wenzhang Lin, Chengyu Zhou, Hongmei Ma, Yunhua Yao, Yuecheng Shen, Lianzhong Deng, Zhenrong Sun, and Shian Zhang

Compressive incoherent digital holography for high-fidelity 3D imaging

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:C. Hainaut, K. Ouahrouche, A. Rancon, G. Patera, C. Ouarkoub, M. Le Parquier, P. Suret, A. Amo

Bidimensional measurements of photon statistics within a multimodal temporal framework

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Pulse Application / -Shaping
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han Chen, Fan Wang, Zhonghao Wang, Pin Wang, Yongwei Yao, Bing Zhang, Yaping Zhang, and Ting-Chung Poon

Unified analytical framework for continuous shading and texture rendering in polygon-based computer-generated holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
ERIS PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Guillaume Noetinger, Tim Tuuva, Romain Fleury

Tutorial: A practical guide to the alignment of defocused spatial light modulators for fast diffractive neural networks

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yaping Tian, Yuhan Zhou, Shiyi Lu, Liming Zhu, Khian-Hooi Chew, Rui-Pin Chen

Mueller matrix-based deep neural network for adaptive reconstruction of orthogonal polarization components of a vector beam transmitted through a highly scattering medium

Applications: Deep Learning / Neuronal Network,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhihao Zhou, Jing Han, Zhuang Zhao, Haotian Yu, and Dongliang Zheng

Large depth range DH-PSF with high peak confinement invariance

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Peng Yi, Zhipeng Wang, Lan Jiang, Xiaowei Li, Yang Liu, Taoyong Li, Andong Wang, Zhi Wang, Xiangyu Zhang, Ji Huang, Qunshuo Wei, Jiafang Li, and Lingling Huang

Reconfigurable holographic patterns for optical security multiplexing fabricated by 3D spatially modulated femtosecond pulses

Applications: Digital-/ Computer Holography/ CGH,Optical Computing / Quantum Optics
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yiqi Ye, Hang Su, Yuetian Jia,, Baoli Li, Min Gu and Xinyuan Fang

High-capacity multiview display with large viewing angle via orbital angular momentum-encoded nanograting arrays

Applications: AR/VR/MR / Holographic Display,Higher Order Modes / Optical Vortex / OAM
LC 2012 Spatial Light Modulators
Authors:Ruidong Li, Caihua Zhang, Kejian Zhu, Zheng Huang, Conghe Wang, Shukai Wu, and Hongwei Chen

Implementation of fully connected layers in optical convolutional neural networks for pre-sensor computing

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ruitao Wu, Juncheng Fang, Rui Pan, Rongyi Lin, Kaiyuan Li, Ting Lei, Luping Du, Xiaocong Yuan

Physical Interpretation of Diffractive Optical Networks for High-Dimensional Vortex Mode Sorting

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
ERIS Spatial Light Modulators
Authors:Ying Zhao, Hao Wang, Dan Li, Ping Yan, and Qirong Xiao

In-situ forward sparse training of large-scale optical neural networks

Applications: Deep Learning / Neuronal Network,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qian Zhang, Yu Miao, Jiali Sun, Yuan Sui, Stefan Rothe, and Juergen W. Czarske

Digital design of mode decomposition systems for multimode fibers using physics-informed neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chenliang Chang, Chenzhou Zhao, Bo Dai, Qi Wang, Dawei Zhang, Songlin Zhuang, and Chao Ping Chen

Memory-Reduced Convolutional Neural Network for Fast Phase Hologram Generation

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Chuxuan Huang, Yue Huang, and Manhua Liu

NeuHolo: non-interferometric quantitative single-shot holographic imaging for 3D metrology using neural fields

Applications: Deep Learning / Neuronal Network,Phase Measurement / Phase Retrieval
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yuta Goto, Satoshi Shinada, Atsushi Okamoto, Naoya Wada, and Hideaki Furukawa

Compact-size and high mode-scalability spatial-mode multiplexer using multiplexed volume holograms

Applications: Digital-/ Computer Holography/ CGH,Optical Communication,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Likai Cheng, Jianming Gao, Banlian Xu, Leihong Zhang, and Dawei Zhang

Computational ghost imaging of atmospheric turbulence based on a single variable convolution kernel

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Ninghe Liu, Kexuan Liu, Yixin Yang, Yifan Peng, and Liangcai Cao

Propagation-adaptive 4K computer-generated holography using physics-constrained spatial and Fourier neural operator

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH