Near-eye light field holographic rendering with spherical waves for wide field of view interactive 3D computer graphics

GAEA / GAEA-2 Spatial Light Modulators
AR/VR/MR / Holographic Display Digital-/ Computer Holography/ CGH
Published on:
Authors: Liang Shi and Fu-Chung Huang and Ward Lopes and Wojciech Matusik and David Luebke
Abstract:

“Holograms display a 3D image in high resolution and allow viewers to focus freely as if looking through a virtual window, yet computer generated holography (CGH) hasn’t delivered the same visual quality under plane wave illumination and due to heavy computational cost. Light field displays have been popular due to their capability to provide continuous focus cues. However, light field displays must trade off between spatial and angular resolution, and do not model diffraction._x000D_
_x000D_
We present a light field-based CGH rendering pipeline allowing for reproduction of high-definition 3D scenes with continuous depth and support of intra-pupil view-dependent occlusion. Our rendering accurately accounts for diffraction and supports various types of reference illuminations for hologram. We avoid under- and over-sampling and geometric clipping effects seen in previous work. We also demonstrate an implementation of light field rendering plus the Fresnel diffraction integral based CGH calculation which is orders of magnitude faster than the state of the art [Zhang et al. 2015], achieving interactive volumetric 3D graphics._x000D_
_x000D_
To verify our computational results, we build a see-through, near-eye, color CGH display prototype which enables co-modulation of both amplitude and phase. We show that our rendering accurately models the spherical illumination introduced by the eye piece and produces the desired 3D imagery at the designated depth. We also analyze aliasing, theoretical resolution limits, depth of field, and other design trade-offs for near-eye CGH.”

Open Access

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, Vol. 36, No. 6, Article 236. (November 2017)
DOI: 10.1145/3130800.3130832
Link: https://doi.org/10.1145/3130800.3130832

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ethan Tseng, Grace Kuo, Seung-Hwan Baek, Nathan Matsuda, Andrew Maimone, Florian Schiffers, Praneeth Chakravarthula, Qiang Fu, Wolfgang Heidrich, Douglas Lanman & Felix Heide

Neural étendue expander for ultra-wide-angle high-fidelity holographic display

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing
GAEA / GAEA-2 Spatial Light Modulators
Authors:Xiaofei Li, Xin Liu, Quanying Wu, Jun Zeng, Yangjian Cai, Sergey A. Ponomarenko, Chunhao Liang

Prime number factorization with light beams carrying orbital angular momentum

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
GAEA / GAEA-2 Spatial Light Modulators
Authors:Rafal Kukolowicz, Tomasz Kozacki, Maksymilian Chlipala, Moncy Sajeev Idicula, Juan Martinez-Carranza, Weronika Finke, and Izabela Gerej

Digital holographic content manipulation for wide-angle holographic near-eye displays

Applications: AR/VR/MR / Holographic Display
LETO / LETO-3 Spatial Light Modulators
Authors:Chenliang Chang, Xian Ding, Di Wang, Zhizhou Ren, Bo Dai, Qi Wang, Songlin Zhuang, Dawei Zhang

Split Lohmann computer holography: fast generation of 3D hologram in single-step diffraction calculation

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Xiong, Xiangchao Zhang, Xinyang Ma, Leheng Li, Zhanghao Ni, and Xiangqian Jiang

Adaptive coded phase mask design and high-quality image reconstruction for interference-less coded aperture correlation holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LETO / LETO-3 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Myeong-Ho Choi, Kwang-Soo Shin, Jae-Hyeung Park

Foveated holographic near-eye display with geometric phase lens and camera feedback

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Claudio Conci, Laura Sironi, Emanuela Jacchetti, Davide Panzeri, Donato Inverso, Rebeca Martínez Vázquez, Roberto Osellame, Maddalena Collini, Giulio Cerullo, Giuseppe Chirico, Manuela Teresa Raimondi

In vivo label-free tissue histology through a microstructured imaging window

Applications: Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Koray Kavaklı , Liang Shi , Hakan Urey , Wojciech Matusik , Kaan Akşit

Multi-color Holograms Improve Brightness in Holographic Displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Eric Markley , Nathan Matsuda , Florian Schiffers , Oliver Cossairt , Grace Kuo

Simultaneous Color Computer Generated Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Grace Kuo , Florian Schiffers , Douglas Lanman , Oliver Cossairt , Nathan Matsuda

Multisource Holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors: Seung-Woo Nam , Youngjin Kim , Dongyeon Kim , Yoonchan Jeong

Depolarized Holography with Polarization-Multiplexing Metasurface

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Li, Yuan Tao, Jiawen Li, Dongdong Jin, Chen Xin, Shengyun Ji, Chaowei Wang, Yachao Zhang, Yanlei Hu, Dong Wu, Li Zhang, Jiaru Chu

Rapid fabrication of reconfigurable helical microswimmers with environmentally adaptive locomotion

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingwei Liu, Jing Chen, Bingsen Qiu, Yongtian Wang, and Juan Liu

DCPNet: a dual-channel parallel deep neural network for high quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yunping Qiu, Zisheng Wang, Zhe Weng, Zhi-Cheng Ren, Xi-Lin Wang, Jianping Ding, and Hui-Tian Wang

Single-shot measurement of the Jones matrix for anisotropic media using four-channel digital polarization holography

Applications: Digital-/ Computer Holography/ CGH,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: U. Ruiz and T. Cerda

Polarization sensitive security system

Applications: Digital-/ Computer Holography/ CGH,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xinxing Xia, Weisen Wang, Frank Guan, Furong Yang, Xinghua Shui, Huadong Zheng, Yingjie Yu, and Yifan Peng

Exploring angular-steering illumination-based eyebox expansion for holographic displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Huadong Zheng, Zhen Wang, Junchang Peng, Xinxing Xia, Yingjie Yu

Multiplane full-color phase-only holograms generation based on iterative algorithm with a modified amplitude constraint

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Andreas Georgiou, Jia Jia, Charlie Hewitt, Changwon Jang, Jacob Hadnett-Hunter, Jinsoo Jeong, Joel Kollin

A holographic near-eye display with glass form factor and spectacle-free operation

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LUNA Spatial Light Modulators
Authors:Michael Flachhuber, Johannes Scheuchenpflug, Thomas Hilbert, Norbert Danz, Peter Schreiber, Leo M. Wilhelm, Markus Metz, Jean-Christope Olaya, Tobias Reusch

MaMeK: a wide-angle dynamic holographic projection system for human-vehicle communication

Applications: Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Yingsi Qin, Wei-Yu Chen, Matthew O’Toole, Aswin C. Sankaranarayanan

Split-Lohmann Multifocal Displays

Applications: AR/VR/MR / Holographic Display,Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chen Xin, Zhongguo Ren, Leran Zhang, Liang Yang, Dawei Wang, Yanlei Hu, Jiawen Li, Jiaru Chu, Li Zhang & Dong Wu

Light-triggered multi-joint microactuator fabricated by two-in-one femtosecond laser writing

Applications: Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingyang Fu, Yaping Zhang, Bing Zhang, Wenlong Qin, Xianfeng Gu, and Ting-Chung Poon

Efficient rendering by parallelogram-approximation for full analytical polygon-based computer-generated holography using planar texture mapping

Applications: Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Ninghe Liu, Zhengzhong Huang, Zehao He, and Liangcai Cao

DGE-CNN: 2D-to-3D holographic display based on a depth gradient extracting module and ZCNN network

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhu, Jialong / Zou, Fucheng / Wang, Le / Lu, Xiaodong / Zhao, Shengmei

Multiplexing Perfect Optical Vortex for Holographic Data Storage

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM