Near-eye light field holographic rendering with spherical waves for wide field of view interactive 3D computer graphics

GAEA Spatial Light Modulators
AR/VR/MR / Holographic Display Digital-/ Computer Holography/ CGH
Published on:
Authors: Liang Shi and Fu-Chung Huang and Ward Lopes and Wojciech Matusik and David Luebke
Abstract:

“Holograms display a 3D image in high resolution and allow viewers to focus freely as if looking through a virtual window, yet computer generated holography (CGH) hasn’t delivered the same visual quality under plane wave illumination and due to heavy computational cost. Light field displays have been popular due to their capability to provide continuous focus cues. However, light field displays must trade off between spatial and angular resolution, and do not model diffraction._x000D_
_x000D_
We present a light field-based CGH rendering pipeline allowing for reproduction of high-definition 3D scenes with continuous depth and support of intra-pupil view-dependent occlusion. Our rendering accurately accounts for diffraction and supports various types of reference illuminations for hologram. We avoid under- and over-sampling and geometric clipping effects seen in previous work. We also demonstrate an implementation of light field rendering plus the Fresnel diffraction integral based CGH calculation which is orders of magnitude faster than the state of the art [Zhang et al. 2015], achieving interactive volumetric 3D graphics._x000D_
_x000D_
To verify our computational results, we build a see-through, near-eye, color CGH display prototype which enables co-modulation of both amplitude and phase. We show that our rendering accurately models the spherical illumination introduced by the eye piece and produces the desired 3D imagery at the designated depth. We also analyze aliasing, theoretical resolution limits, depth of field, and other design trade-offs for near-eye CGH.”

Open Access

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, Vol. 36, No. 6, Article 236. (November 2017)
DOI: 10.1145/3130800.3130832
Link: https://doi.org/10.1145/3130800.3130832

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhu, Jialong / Zou, Fucheng / Wang, Le / Lu, Xiaodong / Zhao, Shengmei

Multiplexing Perfect Optical Vortex for Holographic Data Storage

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
GAEA Spatial Light Modulators
Authors:Chlipala, Maksymilian / Martinez-Carranza, Juan / Idicula, Moncy Sajeev / Kukołowicz, Rafał / Kozacki, Tomasz

Eyebox expansion with accurate hologram generation for wide-angle holographic near-eye display

Applications: AR/VR/MR / Holographic Display
GAEA Spatial Light Modulators
Authors:Tilmon, Brevin; Sun, Zhanghao; Koppal, Sanjeev; Wu, Yicheng; Evangelidis, Georgios; Zahreddine, Ramzi; Krishnan, Guru; Ma, Sizhuo & Wang, Jian

Energy-Efficient Adaptive 3D Sensing

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheng, Huadong / Peng, Junchang / Wang, Zhen / xinghua Shui / yu yingjie / Xia, Xinxing

Diffraction model-driven neural network trained using hybrid domain loss for real-time and high-quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Chaohui; Xin, Jun; Li, Yanan; Lu, Xiao-Ming

Measuring small displacements of an optical point source with digital holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pan, Shu; Wang, Li; Ma, Yuanzheng; Zhang, Guangyu; Liu, Rui; Zhang, Tao; Xiong, Kedi; Chen, Siyu; Zhang, Jian; Li, Wende; Yang, Sihua

Photoacoustic-enabled automatic vascular navigation: accurate and naked-eye real-time visualization of deep-seated vessels

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Zhehai; Hu, Guoqing; Zhao, Shuang; Li, Huiyu; Zhang, Fan

Holographic Optical Tweezers That Use an Improved Gerchberg–Saxton Algorithm

Applications: Digital-/ Computer Holography/ CGH,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Fusco, Sandra; Oscurato, Stefano Luigi; Salvatore, Marcella; Reda, Francesco; Moujdi, Sara; Oliveira, Michael De; Ambrosio, Antonio; Centore, Roberto & Borbone, Fabio

Efficient High-Refractive-Index Azobenzene Dendrimers Based on a Hierarchical Supramolecular Approach

Applications: Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
LETO / LETO-3 Spatial Light Modulators
Authors:Khuderchuluun, Anar; Dashdavaa, Erkhembaatar; Rupali, Shindae; Kwon, Ki-Chul; Kang, Hoonjong; Lee, Kwon-Yeon & Kim, Nam

Color optimization of a full-color holographic stereogram printing system using a single SLM based on iterative exposure control

Applications: Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Quan, Jiale; Yan, Binbin; Sang, Xinzhu; Zhong, Chongli; Li, Hui; Qin, Xiujuan; Xiao, Rui; Sun, Zhi; Dong, Yu & Zhang, Huming

Multi-Depth Computer-Generated Hologram Based on Stochastic Gradient Descent Algorithm with Weighted Complex Loss Function and Masked Diffraction

Applications: AR/VR/MR / Holographic Display
GAEA Spatial Light Modulators
Authors:Dong, Zhenxing; Xu, Chao; Ling, Yuye; Li, Yan & Su, Yikai

Fourier-inspired neural module for real-time and high-fidelity computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Gao, Yunhui & Cao, Liangcai

Pixel super-resolution quantitative phase imaging based on modulation diversity

Applications: Digital-/ Computer Holography/ CGH,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Falldorf, Claas; Rukin, Ilja; Müller, André F.; Kroker, Stefanie & Bergmann, Ralf. B.

Functional pixels: a pathway towards true holographic displays using today’s display technology

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shui, Xinghua; Zheng, Huadong; Xia, Xinxing; Yang, Furong; Wang, Weisen & Yu, Yingjie

Diffraction model-informed neural network for unsupervised layer-based computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qin, Xiujuan; Sang, Xinzhu; Li, Hui; Yu, Chongxiu; Xiao, Rui; Zhong, Chongli; Sun, Zhi; Dong, Yu & Yan, Binbin

Binocular holographic display based on the holographic optical element

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Benedicto, David; Collados, María Victoria; Martín, Juan C.; Jesus Atencia; Mendoza-Yero, Omel & Vallés, Juan A.

Contribution to the Improvement of the Correlation Filter Method for Modal Analysis with a Spatial Light Modulator

Applications: Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Abdelazeem, Rania M. & Agour, Mostafa

Color Holographic Visualization of an Abnormal Retina: A Training Guide

Applications: Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Jonghyun Kim, Manu Gopakumar, Suyeon Choi, Yifan Peng, Ward Lopes and Gordon Wetzstein

Holographic Glasses for Virtual Reality

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Kim, Dongyeon; Nam, Seung-Woo; Lee, Byounghyo; Seo, Jong-Mo & Lee, Byoungho

Accommodative holography: improving accommodation response for perceptually realistic holographic displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LUNA Spatial Light Modulators
Authors:Benedicto, David; Collados, M. Victoria; Martín, Juan C.; Jesú s Atencia & Vallés, Juan A.

Coupled two-core integrated waveguides modal analysis

Applications: Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Gao, Yunhui; Yang, Feng & Cao, Liangcai

Pixel Super-Resolution Phase Retrieval for Lensless On-Chip Microscopy via Accelerated Wirtinger Flow

Applications: Digital-/ Computer Holography/ CGH,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Reda, Francesco; Salvatore, Marcella; Borbone, Fabio; Maddalena, Pasqualino; Ambrosio, Antonio & Oscurato, Stefano Luigi

Varifocal diffractive lenses for multi-depth microscope imaging

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing,Lithography
LETO / LETO-3 Spatial Light Modulators
Authors:Chakravarthula, Praneeth; Tseng, Ethan; Fuchs, Henry & Heide, Felix

Hogel-free Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Dou, Jiazhen; Dong, Chen; Dai, Siqing; Mi, Jingyu; Luo, Xiangyuan; Di, Jianglei; Zhang, Jiwei & Zhao, Jianlin

High-resolution surface plasmon resonance holographic microscopy based on symmetrical excitation

Applications: Digital-/ Computer Holography/ CGH,Microscopy