Near-eye light field holographic rendering with spherical waves for wide field of view interactive 3D computer graphics

GAEA / GAEA-2 Spatial Light Modulators
AR/VR/MR / Holographic Display Digital-/ Computer Holography/ CGH
Published on:
Authors: Liang Shi and Fu-Chung Huang and Ward Lopes and Wojciech Matusik and David Luebke
Abstract:

“Holograms display a 3D image in high resolution and allow viewers to focus freely as if looking through a virtual window, yet computer generated holography (CGH) hasn’t delivered the same visual quality under plane wave illumination and due to heavy computational cost. Light field displays have been popular due to their capability to provide continuous focus cues. However, light field displays must trade off between spatial and angular resolution, and do not model diffraction._x000D_
_x000D_
We present a light field-based CGH rendering pipeline allowing for reproduction of high-definition 3D scenes with continuous depth and support of intra-pupil view-dependent occlusion. Our rendering accurately accounts for diffraction and supports various types of reference illuminations for hologram. We avoid under- and over-sampling and geometric clipping effects seen in previous work. We also demonstrate an implementation of light field rendering plus the Fresnel diffraction integral based CGH calculation which is orders of magnitude faster than the state of the art [Zhang et al. 2015], achieving interactive volumetric 3D graphics._x000D_
_x000D_
To verify our computational results, we build a see-through, near-eye, color CGH display prototype which enables co-modulation of both amplitude and phase. We show that our rendering accurately models the spherical illumination introduced by the eye piece and produces the desired 3D imagery at the designated depth. We also analyze aliasing, theoretical resolution limits, depth of field, and other design trade-offs for near-eye CGH.”

Open Access

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, Vol. 36, No. 6, Article 236. (November 2017)
DOI: 10.1145/3130800.3130832
Link: https://doi.org/10.1145/3130800.3130832

Related Papers

GAEA / GAEA-2 Spatial Light Modulators
Authors:Yuki Takemura, Hirohito Nishi, Kyoji Matsushima

Denisyuk-type wavefront printer and its computational correction of aberration in optical system

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenqi Xu, Junmin Leng, Ping Dai and Chao Wang

DSCCNet for high-quality 4K computer-generated holograms

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen

Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Microscopy,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiukun Liao, Shijie Zhang, Yongtian Wang and Juan Liu

High-quality real-time 3D holographic display for real-world scenes based on the optimized layered angular spectrum method

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiajia Wu, Xinkuo Li, Ke Sun, Kai Gao, Chenduan Chen, Jianrong Qiu and Dezhi Tan

Tight Focusing Holographic Network Enables 3D Real Time and Accurate Light Field Modulation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenxing Dong, Yuye Ling, Yan Li and Yikai Su

Motion Hologram: Jointly optimized hologram generation and motion planning for photorealistic 3D displays via reinforcement learning

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Riku Watanabe, Seok Kang and Yuji Sakamoto

Binocular holographic display with a wide viewing zone using eye-tracking and multiple reconstruction lights

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LC 2012 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youjia Gu and Yasuhiro Takaki

See-through characteristics of a holographic contact lens display and design consideration for a spatial light modulator

Applications: AR/VR/MR / Holographic Display
GAEA / GAEA-2 Spatial Light Modulators
Authors:Kanno Tomoki, Ichihashi Yasuyuki, Kakue Takashi, Wakunami Koki, Oi Ryutaro, Shimobaba Tomoyoshi and Ito Tomoyoshi

Projection-Type Holographic Display With Observation Area Expanded Using Time-Division Reproduced Light Generation System

Applications: AR/VR/MR / Holographic Display
LUNA Spatial Light Modulators
Authors:Natsu Kikuchi, Seok Kang and Yuji Sakamoto

Head-mounted projector with a wide visual-field and three degrees of freedom in electro-holography

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:P. Parkprom, N. Chattrapiban and N. Thaicharoen

Aberration correction of optical dipole-traps array utilizing phase-modulated holographic technique

Applications: Digital-/ Computer Holography/ CGH,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jan Marx, Malte Seefeldt, Damian Haske, Christian Lutz, Ralf Hellmann, Cemal Esen, Andreas Ostendorf

Holographic freeform micro hole processing using Bessel beams

Applications: Bessel-/ Airy Beam Generation,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
LC 2002 Spatial Light Modulators
Authors:Jyoti Bikash Mohapatra, Naveen K. Nishchal and Jyothish Monikantan

Object Recognition in Foggy and Hazy Conditions Using Dark Channel Prior-Based Fringe-Adjusted Joint Transform Correlator

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiwei Fang, Huadong Zheng, Xinxing Xia, Junchang Peng, Tengfei Zhang, Xingyu Lin and Yingjie Yu

Diffraction model-driven neural network with semi-supervised training strategy for real-world 3D holographic photography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Haifeng Qin, Chao Han, Xuan Shi, Tao Gu and Kangsheng Sun

Complex-valued generative adversarial network for real-time and high-quality computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Juan Martinez-Carranza, Jose Martinez-Carranza, Tomasz Kozacki

Efficient point cloud occlusion method for ultra wide-angle computer-generated holograms

Applications: Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Xian Ding, Chenliang Chang, Bo Dai, Qi Wang, Dawei Zhang and Songlin Zhuang

Real-time holographic 3D display using Split–Lohmann Fresnel computer-generated hologram (SL-FCGH)

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Yiran Wei, Yiyun Chen, Mi Zhou, Mu Ku Chen, Shuming Jiao, Qinghua Song, Xiao-Ping Zhang and Zihan Geng

Speckle-free holography with a diffraction-aware global perceptual model

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wei Liu, Chuanfu Tu, Yawen Liu and Zhiwei Ye

Orbital angular momentum superimposed mode recognition based on multi-label image classification

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pin Wang, Fan Wang, Yaping Zhang, Bing Zhang and Ting-Chung Poon

Improved rapid algorithm for continuous shading based on the fully analytical polygon-based method

Applications: Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Eunbi Lee, Youngjin Jo, Seung-Woo Nam, Minseok Chae, Chen Chun, Youngjin Kim, Yoonchan Jeong and Byoungho Lee

Speckle reduced holographic display system with a jointly optimized rotating phase mask

Applications: Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology
LC 2012 Spatial Light Modulators
Authors:Moritsugu Sakamoto, Riku Tobita, Kohei Noda, Masato Suzuki, Tomoyuki Sasaki, Nobuhiro Kawatsuki, and Hiroshi Ono

Aerial display system using hybrid geometric phase lens with both polarization diffraction and imaging functions

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH,Phase Measurement / Phase Retrieval
GAEA / GAEA-2 Spatial Light Modulators
Authors:Ekaterina A. Savchenkova, Andrey S. Ovchinnikov, Vladislav G. Rodin, Rostislav S. Starikov, Nikolay N. Evtikhiev, Pavel A. Cheremkhin

Adaptive non-iterative histogram-based hologram quantization

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LC 2012 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiaosheng Li, Yifei Chen, Tianyun Liu, Bo Wu & Qinnan Zhang

Single-pixel Fresnel incoherent correlation holography compressed imaging using a Trumpet network

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing