Holographic near-eye displays for virtual and augmented reality

PLUTO / PLUTO-2 Spatial Light Modulators
AR/VR/MR / Holographic Display
Published on:
Authors: Maimone, Andrew and Georgiou, Andreas and Kollin, Joel S
Abstract:

“We present novel designs for virtual and augmented reality near-eye displays based on phase-only holographic projection. Our approach is built on the principles of Fresnel holography and double phase amplitude encoding with additional hardware, phase correction factors, and spatial light modulator encodings to achieve full color, high contrast and low noise holograms with high resolution and true per-pixel focal control. We provide a GPU-accelerated implementation of all holographic computation that integrates with the standard graphics pipeline and enables real-time (≥90 Hz) calculation directly or through eye tracked approximations. A unified focus, aberration correction, and vision correction model, along with a user calibration process, accounts for any optical defects between the light source and retina. We use this optical correction ability not only to x minor aberrations but to enable truly compact, eyeglasses-like displays with wide elds of view (80◦) that would be inaccessible through conventional means. All functionality is evaluated across a series of hardware prototypes; we discuss remaining challenges to incorporate all features into a single device.”

Restricted Access

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, Vol. 36, No. 4, Article 85. (July 2017)
DOI: 10.1145/3072959.3073624
Link: https://doi.org/10.1145/3072959.3073624

Related Papers

GAEA Spatial Light Modulators
Authors:Chlipala, Maksymilian / Martinez-Carranza, Juan / Idicula, Moncy Sajeev / Kukołowicz, Rafał / Kozacki, Tomasz

Eyebox expansion with accurate hologram generation for wide-angle holographic near-eye display

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheng, Huadong / Peng, Junchang / Wang, Zhen / xinghua Shui / yu yingjie / Xia, Xinxing

Diffraction model-driven neural network trained using hybrid domain loss for real-time and high-quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pan, Shu; Wang, Li; Ma, Yuanzheng; Zhang, Guangyu; Liu, Rui; Zhang, Tao; Xiong, Kedi; Chen, Siyu; Zhang, Jian; Li, Wende; Yang, Sihua

Photoacoustic-enabled automatic vascular navigation: accurate and naked-eye real-time visualization of deep-seated vessels

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Quan, Jiale; Yan, Binbin; Sang, Xinzhu; Zhong, Chongli; Li, Hui; Qin, Xiujuan; Xiao, Rui; Sun, Zhi; Dong, Yu & Zhang, Huming

Multi-Depth Computer-Generated Hologram Based on Stochastic Gradient Descent Algorithm with Weighted Complex Loss Function and Masked Diffraction

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qin, Xiujuan; Sang, Xinzhu; Li, Hui; Yu, Chongxiu; Xiao, Rui; Zhong, Chongli; Sun, Zhi; Dong, Yu & Yan, Binbin

Binocular holographic display based on the holographic optical element

Applications: AR/VR/MR / Holographic Display
LETO / LETO-3 Spatial Light Modulators
Authors:Jonghyun Kim, Manu Gopakumar, Suyeon Choi, Yifan Peng, Ward Lopes and Gordon Wetzstein

Holographic Glasses for Virtual Reality

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Kim, Dongyeon; Nam, Seung-Woo; Lee, Byounghyo; Seo, Jong-Mo & Lee, Byoungho

Accommodative holography: improving accommodation response for perceptually realistic holographic displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Reda, Francesco; Salvatore, Marcella; Borbone, Fabio; Maddalena, Pasqualino; Ambrosio, Antonio & Oscurato, Stefano Luigi

Varifocal diffractive lenses for multi-depth microscope imaging

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing,Lithography
LETO / LETO-3 Spatial Light Modulators
Authors:Chakravarthula, Praneeth; Tseng, Ethan; Fuchs, Henry & Heide, Felix

Hogel-free Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhang, Yaping; Fan, Houxin; Wang, Fan; Gu, Xianfeng; Qian, Xiaofan & Poon, Ting-Chung

Polygon-based computer-generated holography: a review of fundamentals and recent progress

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Sun, Xiuhui; Mu, Xingyu; Xu, Cheng; Pang, Hui; Deng, Qiling; Zhang, Ke; Jiang, Haibo; Du, Jinglei; Yin, Shaoyun & Du, Chunlei

Dual-task convolutional neural network based on the combination of the U-Net and a diffraction propagation model for phase hologram design with suppressed speckle noise

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Jędrzej Szpygiel, Maksymilian Chlipała, Rafał Kukołowicz, Moncy Idicula, Tomasz Kozacki

Distortion correction for wide angle holographic projector

Applications: Adaptive Optics / Wavefront Control,AR/VR/MR / Holographic Display
GAEA Spatial Light Modulators
Authors:Rafał Kukołowicz; Chlipala, Maksymilian; Martinez-Carranza, Juan; Idicula, Moncy Sajeev & Kozacki, Tomasz

Fast 3D Content Update for Wide-Angle Holographic Near-Eye Display

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Choi, Suyeon; Gopakumar, Manu; Peng, Yifan; Kim, Jonghyun & Wetzstein, Gordon

Neural 3D holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Gopakumar, Manu; Kim, Jonghyun; Choi, Suyeon; Peng, Yifan & Wetzstein, Gordon

Unfiltered holography: optimizing high diffraction orders without optical filtering for compact holographic displays

Applications: Adaptive Optics / Wavefront Control,AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Joanna Starobrat, Szymon Fiderkiewicz, Andrzej Kołodziejczyk, Maciej Sypek, Romuald Beck, Krystian Pavłov, Mateusz Słowikowski, Adam Kowalczyk, Jarosław Suszek, Michał Makowski

Suppression of spurious image duplicates in Fourier holograms by pixel apodization of a spatial light modulator

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Cao, Hongkun; Jin, Xin; Ai, Lingyu & Kim, Eun-Soo

Faster generation of holographic video of 3-D scenes with a Fourier spectrum-based NLUT method

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhao, Zijie; Duan, Junyi & Liu, Juan

Speckle reduction in holographic display with partially spatial coherent illumination

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Wang, Fan; Shimobaba, Tomoyoshi; Zhang, Yaping; Kakue, Takashi & Ito, Tomoyoshi

Acceleration of polygon-based computer-generated holograms using look-up tables and reduction of the table size via principal component analysis

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Chlipała, Maksymilian; a; Kozacki, Tomasz; Yeom, Han-Ju; Martinez-Carranza, Juan; Rafał; Kukołowicz; Kim, Jinwoong; Yang, Jong-Heon; Choi, Ji Hun; Pi, Jae-Eun & Hwang, Chi-Sun

Wide angle holographic video projection display

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
GAEA Spatial Light Modulators
Authors:Yasuki, Daiki; Shimobaba, Tomoyoshi; Makowski, Michal; Suszek, Jaroslaw; Kakue, Takashi & Ito, Tomoyoshi

Hologram computation using the radial point spread function

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Peng, Yifan; Choi, Suyeon; Kim, Jonghyun & Wetzstein, Gordon

Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chang, Chenliang; Zhu, Dongchen; Li, Jiamao; Wang, Di; Xia, Jun & Zhang, Xiaolin

Fast calculation of computer generated hologram based on single Fourier transform for holographic three-dimensional display

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Kim, Dongyeon; Nam, Seung-Woo; Bang, Kiseung; Lee, Byounghyo; Lee, Seungjae; Jeong, Youngmo; Seo, Jongmo & Lee, Byoungho

Vision-correcting Holographic Display: Evaluation of Aberration Correcting Hologram

Applications: Adaptive Optics / Wavefront Control,AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH