Holographic near-eye displays for virtual and augmented reality

PLUTO / PLUTO-2 Spatial Light Modulators
AR/VR/MR / Holographic Display
Published on:
Authors: Maimone, Andrew and Georgiou, Andreas and Kollin, Joel S
Abstract:

“We present novel designs for virtual and augmented reality near-eye displays based on phase-only holographic projection. Our approach is built on the principles of Fresnel holography and double phase amplitude encoding with additional hardware, phase correction factors, and spatial light modulator encodings to achieve full color, high contrast and low noise holograms with high resolution and true per-pixel focal control. We provide a GPU-accelerated implementation of all holographic computation that integrates with the standard graphics pipeline and enables real-time (≥90 Hz) calculation directly or through eye tracked approximations. A unified focus, aberration correction, and vision correction model, along with a user calibration process, accounts for any optical defects between the light source and retina. We use this optical correction ability not only to x minor aberrations but to enable truly compact, eyeglasses-like displays with wide elds of view (80◦) that would be inaccessible through conventional means. All functionality is evaluated across a series of hardware prototypes; we discuss remaining challenges to incorporate all features into a single device.”

Restricted Access

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, Vol. 36, No. 4, Article 85. (July 2017)
DOI: 10.1145/3072959.3073624
Link: https://doi.org/10.1145/3072959.3073624

Related Papers

GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenqi Xu, Junmin Leng, Ping Dai and Chao Wang

DSCCNet for high-quality 4K computer-generated holograms

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiukun Liao, Shijie Zhang, Yongtian Wang and Juan Liu

High-quality real-time 3D holographic display for real-world scenes based on the optimized layered angular spectrum method

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiajia Wu, Xinkuo Li, Ke Sun, Kai Gao, Chenduan Chen, Jianrong Qiu and Dezhi Tan

Tight Focusing Holographic Network Enables 3D Real Time and Accurate Light Field Modulation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenxing Dong, Yuye Ling, Yan Li and Yikai Su

Motion Hologram: Jointly optimized hologram generation and motion planning for photorealistic 3D displays via reinforcement learning

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Riku Watanabe, Seok Kang and Yuji Sakamoto

Binocular holographic display with a wide viewing zone using eye-tracking and multiple reconstruction lights

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LC 2012 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youjia Gu and Yasuhiro Takaki

See-through characteristics of a holographic contact lens display and design consideration for a spatial light modulator

Applications: AR/VR/MR / Holographic Display
GAEA / GAEA-2 Spatial Light Modulators
Authors:Kanno Tomoki, Ichihashi Yasuyuki, Kakue Takashi, Wakunami Koki, Oi Ryutaro, Shimobaba Tomoyoshi and Ito Tomoyoshi

Projection-Type Holographic Display With Observation Area Expanded Using Time-Division Reproduced Light Generation System

Applications: AR/VR/MR / Holographic Display
LUNA Spatial Light Modulators
Authors:Natsu Kikuchi, Seok Kang and Yuji Sakamoto

Head-mounted projector with a wide visual-field and three degrees of freedom in electro-holography

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiwei Fang, Huadong Zheng, Xinxing Xia, Junchang Peng, Tengfei Zhang, Xingyu Lin and Yingjie Yu

Diffraction model-driven neural network with semi-supervised training strategy for real-world 3D holographic photography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Xian Ding, Chenliang Chang, Bo Dai, Qi Wang, Dawei Zhang and Songlin Zhuang

Real-time holographic 3D display using Split–Lohmann Fresnel computer-generated hologram (SL-FCGH)

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Yiran Wei, Yiyun Chen, Mi Zhou, Mu Ku Chen, Shuming Jiao, Qinghua Song, Xiao-Ping Zhang and Zihan Geng

Speckle-free holography with a diffraction-aware global perceptual model

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LC 2012 Spatial Light Modulators
Authors:Moritsugu Sakamoto, Riku Tobita, Kohei Noda, Masato Suzuki, Tomoyuki Sasaki, Nobuhiro Kawatsuki, and Hiroshi Ono

Aerial display system using hybrid geometric phase lens with both polarization diffraction and imaging functions

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH,Phase Measurement / Phase Retrieval
LETO / LETO-3 Spatial Light Modulators
Authors: Lukas T. Hiller, Jörg Wallaschek

Lensless projection of automotive light distributions using an advanced printer for volume holographic optical elements

Applications: Adaptive Optics / Wavefront Control,AR/VR/MR / Holographic Display
LETO / LETO-3 Spatial Light Modulators
Authors:Manu Gopakumar, Gun-Yeal Lee, Suyeon Choi, Brian Chao, Yifan Peng, Jonghyun Kim & Gordon Wetzstein

Full-colour 3D holographic augmented-reality displays with metasurface waveguides

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ethan Tseng, Grace Kuo, Seung-Hwan Baek, Nathan Matsuda, Andrew Maimone, Florian Schiffers, Praneeth Chakravarthula, Qiang Fu, Wolfgang Heidrich, Douglas Lanman & Felix Heide

Neural étendue expander for ultra-wide-angle high-fidelity holographic display

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing
GAEA / GAEA-2 Spatial Light Modulators
Authors:Rafal Kukolowicz, Tomasz Kozacki, Maksymilian Chlipala, Moncy Sajeev Idicula, Juan Martinez-Carranza, Weronika Finke, and Izabela Gerej

Digital holographic content manipulation for wide-angle holographic near-eye displays

Applications: AR/VR/MR / Holographic Display
LETO / LETO-3 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Myeong-Ho Choi, Kwang-Soo Shin, Jae-Hyeung Park

Foveated holographic near-eye display with geometric phase lens and camera feedback

Applications: AR/VR/MR / Holographic Display
GAEA / GAEA-2 Spatial Light Modulators
Authors:Riku Watanabe and Yuji Sakamoto

Enlargement of the viewing zone and size of a reconstructed image in electro-holography using multiple reconstruction lights by eye-tracking

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Koray Kavaklı , Liang Shi , Hakan Urey , Wojciech Matusik , Kaan Akşit

Multi-color Holograms Improve Brightness in Holographic Displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Eric Markley , Nathan Matsuda , Florian Schiffers , Oliver Cossairt , Grace Kuo

Simultaneous Color Computer Generated Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Grace Kuo , Florian Schiffers , Douglas Lanman , Oliver Cossairt , Nathan Matsuda

Multisource Holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors: Seung-Woo Nam , Youngjin Kim , Dongyeon Kim , Yoonchan Jeong

Depolarized Holography with Polarization-Multiplexing Metasurface

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingwei Liu, Jing Chen, Bingsen Qiu, Yongtian Wang, and Juan Liu

DCPNet: a dual-channel parallel deep neural network for high quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xinxing Xia, Weisen Wang, Frank Guan, Furong Yang, Xinghua Shui, Huadong Zheng, Yingjie Yu, and Yifan Peng

Exploring angular-steering illumination-based eyebox expansion for holographic displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH