DGE-CNN: 2D-to-3D holographic display based on a depth gradient extracting module and ZCNN network

GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
AR/VR/MR / Holographic Display Deep Learning / Neuronal Network
Published on:
Authors: Ninghe Liu, Zhengzhong Huang, Zehao He, and Liangcai Cao
Abstract:

Holography is a crucial technique for the ultimate three-dimensional (3D) display, because it renders all optical cues from the human visual system. However, the shortage of 3D contents strictly restricts the extensive application of holographic 3D displays. In this paper, a 2D-to-3D-display system by deep learning-based monocular depth estimation is proposed. By feeding a single RGB image of a 3D scene into our designed DGE-CNN network, a corresponding display-oriented 3D depth map can be accurately generated for layer-based computer-generated holography. With simple parameter adjustment, our system can adapt the distance range of holographic display according to specific requirements. The high-quality and flexible holographic 3D display can be achieved based on a single RGB image without 3D rendering devices, permitting potential human-display interactive applications such as remote education, navigation, and medical treatment.

Open Access

Open Access

Publication: Optics Express
Issue/Year: Opt. Express 31, 23867-23876 (2023)
DOI: 10.1364/OE.489639
Link: https://doi.org/10.1364/OE.489639

Related Papers

LC 2012 Spatial Light Modulators
Authors:Minwook Kim, Chansuk Park, Chulmin Oh, KyeoReh Lee, Herve Hugonnet, and YongKeun Park

Video-rate wavefront capture and replay via single-shot reference-free measurement: toward holographic telepresence

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LUNA PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hanlong Chen, Çağatay Işıl, Che-Yung Shen, Shiqi Chen, Tianyi Gan, Mona Jarrahi, and Aydogan Ozcan

Super-resolution image projection over an extended depth of field using a diffractive decoder

Applications: Deep Learning / Neuronal Network,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu Liu, Peng Su, Jianhua Huang, Huifang Lin, Pengfei Wang, and Feng Huang

Focusing light through turbid and thick scattering media via a hybrid genetic neural network algorithm

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yanqiu Hu, Zihe Zhang, Tao Zhang, Lanqing Jia, Xiao Zhang, Zhujun Wan, Leixin Meng, Kai Wei, and Liangjia Zong

Achieving high diffraction efficiency in LCoS-SLMs via neural-network-based precise fringe-field compensation

Applications: Deep Learning / Neuronal Network,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hyunmin Ban, Wenbin Zhou, and Yifan Peng

Towards Edge Holography via Implicit Neural Representation and Compression

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Erkhembaatar Dashdavaa, Erdenebayar Bayarsaikhan, Munkh-Uchral Erdenebat, Jae-Yeol Cha, Jae-Won Lee, Jin-Hyeok Seo, Hyeon-Su Jeong, Min-Seok Kim, Ji-Sub Park, and Hak-Rin Kim

Dynamic eyebox expansion in holographic near-eye displays via active switching quarter-waveplate geometric phase prisms

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Tianlong Man, Yuwen Zhang, Yuchen Wu, Zhiqing Zhang, Hongqiang Zhou, Liyun Zhong, and Yuhong Wan

Three-dimensional neural network driving self-interference digital holography enables high-fidelity, non-scanning volumetric fluorescence microscopy

Applications: Beam Shaping / Beam Steering,Deep Learning / Neuronal Network,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yuwei Jiang, Wenyu Yang, Yongxin Zhu, and Zunkai Huang

High-Quality Phase-Only Holography via Frequency-Domain Hybrid Encoding and Multi-Scale Complex Attention

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chuncheng Zhang, Zhaoxuan Hu, Tianting Zhong, Haofan Huang, Ji Liang, Yu Wang, Tingting Liu, Zheyi Yao, Qian Chen, Puxiang Lai, and Xiubao Sui

Unlocking high-frequency speckle details via relative frequency learning for robust imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hyunmin Ban, Wenbin Zhou, Xiangyu Meng, and Yifan Evan Peng

Multi-color compressive hologram synthesis with learned wave propagation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shiva Shankar Mutupuri, MD. Haider Ansari, Satish Anamalamudi, Ravi Kumar, Shashi Prabhakar, and Salla Gangi Reddy

Higher-Order Spatial Mode Detection Leveraging Deep Learning on Random Optical Patterns

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
LUNA Spatial Light Modulators
Authors:Antoni J. Wojcik, Dilawer Singh, Ayan Rakshit, Hannah J. Joyce, and Timothy D. Wilkinson

Fourier-plane wavefront and SLM aberration characterization via iterative scanning of beam deflector segments

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
LC 2012 Spatial Light Modulators
Authors:J. Arriaga Hernández, B. Cuevas Otahola, A. Diaz Nayotl, A. Jaramillo Núñez, A. Pérez Villegas, O. Valenzuela b

Machine learning K-means algorithm applied to wavefront sensing in Bi-Ronchi/Hartmann tests with SLM

Applications: Deep Learning / Neuronal Network
ERIS PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Guillaume Noetinger, Tim Tuuva, Romain Fleury

Tutorial: A practical guide to the alignment of defocused spatial light modulators for fast diffractive neural networks

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yaping Tian, Yuhan Zhou, Shiyi Lu, Liming Zhu, Khian-Hooi Chew, Rui-Pin Chen

Mueller matrix-based deep neural network for adaptive reconstruction of orthogonal polarization components of a vector beam transmitted through a highly scattering medium

Applications: Deep Learning / Neuronal Network,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yiqi Ye, Hang Su, Yuetian Jia,, Baoli Li, Min Gu and Xinyuan Fang

High-capacity multiview display with large viewing angle via orbital angular momentum-encoded nanograting arrays

Applications: AR/VR/MR / Holographic Display,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi Zhao, Zhiyuan Wang, Zhipeng Yu, Tianting Zhong, Haoran Li, Shengfu Cheng, Haofan Huang, Chi Man Woo, Huanhao Li, and Puxiang Lai

Speckle Transformer: direct classification through scattering media with limited information

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:Ruidong Li, Caihua Zhang, Kejian Zhu, Zheng Huang, Conghe Wang, Shukai Wu, and Hongwei Chen

Implementation of fully connected layers in optical convolutional neural networks for pre-sensor computing

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ruitao Wu, Juncheng Fang, Rui Pan, Rongyi Lin, Kaiyuan Li, Ting Lei, Luping Du, Xiaocong Yuan

Physical Interpretation of Diffractive Optical Networks for High-Dimensional Vortex Mode Sorting

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
ERIS Spatial Light Modulators
Authors:Ying Zhao, Hao Wang, Dan Li, Ping Yan, and Qirong Xiao

In-situ forward sparse training of large-scale optical neural networks

Applications: Deep Learning / Neuronal Network,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qian Zhang, Yu Miao, Jiali Sun, Yuan Sui, Stefan Rothe, and Juergen W. Czarske

Digital design of mode decomposition systems for multimode fibers using physics-informed neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chenliang Chang, Chenzhou Zhao, Bo Dai, Qi Wang, Dawei Zhang, Songlin Zhuang, and Chao Ping Chen

Memory-Reduced Convolutional Neural Network for Fast Phase Hologram Generation

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Chuxuan Huang, Yue Huang, and Manhua Liu

NeuHolo: non-interferometric quantitative single-shot holographic imaging for 3D metrology using neural fields

Applications: Deep Learning / Neuronal Network,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Likai Cheng, Jianming Gao, Banlian Xu, Leihong Zhang, and Dawei Zhang

Computational ghost imaging of atmospheric turbulence based on a single variable convolution kernel

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing