Foveated near-eye display using computational holography

GAEA Spatial Light Modulators
AR/VR/MR / Holographic Display
Published on:
Authors: Cem, Ali; Hedili, M. Kivanc; Ulusoy, Erdem & Urey, Hakan
Abstract:

“Holographic display is the only technology that can offer true 3D with all the required depth cues. Holographic head-worn displays (HWD) can provide continuous depth planes with the correct stereoscopic disparity for a comfortable 3D experience. Existing HWD approaches have small field-of-view (FOV) and small exit pupil size, which are limited by the spatial light modulator (SLM). Conventional holographic HWDs are limited to about 20° × 11° FOV using a 4 K SLM panel and have fixed FOV. We present a new optical architecture that can overcome those limitations and substantially extend the FOV supported by the SLM. Our architecture, which does not contain any moving parts, automatically follows the gaze of the viewer’s pupil. Moreover, it mimics human vision by providing varying resolution across the FOV resulting in better utilization of the available space-bandwidth product of the SLM. We propose a system that can provide 28° × 28° instantaneous FOV within an extended FOV (the field of view that is covered by steering the instantaneous FOV in space) of 60° × 40° using a 4 K SLM, effectively providing a total enhancement of > 3 × in instantaneous FOV area, > 10 × in extended FOV area and the space-bandwidth product. We demonstrated 20° × 20° instantaneous FOV and 40° × 20° extended FOV in the experiments.”

Open Access

Publication: Scientific Reports
Issue/Year: Scientific Reports, Volume 10; Number 1; 2020
DOI: 10.1038/s41598-020-71986-9
Link: https://doi.org/10.1038/s41598-020-71986-9

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Huadong Zheng, Zhen Wang, Junchang Peng, Xinxing Xia, Yingjie Yu

Multiplane full-color phase-only holograms generation based on iterative algorithm with a modified amplitude constraint

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Andreas Georgiou, Jia Jia, Charlie Hewitt, Changwon Jang, Jacob Hadnett-Hunter, Jinsoo Jeong, Joel Kollin

A holographic near-eye display with glass form factor and spectacle-free operation

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Yingsi Qin, Wei-Yu Chen, Matthew O’Toole, Aswin C. Sankaranarayanan

Split-Lohmann Multifocal Displays

Applications: AR/VR/MR / Holographic Display,Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Ninghe Liu, Zhengzhong Huang, Zehao He, and Liangcai Cao

DGE-CNN: 2D-to-3D holographic display based on a depth gradient extracting module and ZCNN network

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network
GAEA Spatial Light Modulators
Authors:Chlipala, Maksymilian / Martinez-Carranza, Juan / Idicula, Moncy Sajeev / Kukołowicz, Rafał / Kozacki, Tomasz

Eyebox expansion with accurate hologram generation for wide-angle holographic near-eye display

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheng, Huadong / Peng, Junchang / Wang, Zhen / xinghua Shui / yu yingjie / Xia, Xinxing

Diffraction model-driven neural network trained using hybrid domain loss for real-time and high-quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pan, Shu; Wang, Li; Ma, Yuanzheng; Zhang, Guangyu; Liu, Rui; Zhang, Tao; Xiong, Kedi; Chen, Siyu; Zhang, Jian; Li, Wende; Yang, Sihua

Photoacoustic-enabled automatic vascular navigation: accurate and naked-eye real-time visualization of deep-seated vessels

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Quan, Jiale; Yan, Binbin; Sang, Xinzhu; Zhong, Chongli; Li, Hui; Qin, Xiujuan; Xiao, Rui; Sun, Zhi; Dong, Yu & Zhang, Huming

Multi-Depth Computer-Generated Hologram Based on Stochastic Gradient Descent Algorithm with Weighted Complex Loss Function and Masked Diffraction

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qin, Xiujuan; Sang, Xinzhu; Li, Hui; Yu, Chongxiu; Xiao, Rui; Zhong, Chongli; Sun, Zhi; Dong, Yu & Yan, Binbin

Binocular holographic display based on the holographic optical element

Applications: AR/VR/MR / Holographic Display
LETO / LETO-3 Spatial Light Modulators
Authors:Jonghyun Kim, Manu Gopakumar, Suyeon Choi, Yifan Peng, Ward Lopes and Gordon Wetzstein

Holographic Glasses for Virtual Reality

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Kim, Dongyeon; Nam, Seung-Woo; Lee, Byounghyo; Seo, Jong-Mo & Lee, Byoungho

Accommodative holography: improving accommodation response for perceptually realistic holographic displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Reda, Francesco; Salvatore, Marcella; Borbone, Fabio; Maddalena, Pasqualino; Ambrosio, Antonio & Oscurato, Stefano Luigi

Varifocal diffractive lenses for multi-depth microscope imaging

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing,Lithography
LETO / LETO-3 Spatial Light Modulators
Authors:Chakravarthula, Praneeth; Tseng, Ethan; Fuchs, Henry & Heide, Felix

Hogel-free Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhang, Yaping; Fan, Houxin; Wang, Fan; Gu, Xianfeng; Qian, Xiaofan & Poon, Ting-Chung

Polygon-based computer-generated holography: a review of fundamentals and recent progress

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Sun, Xiuhui; Mu, Xingyu; Xu, Cheng; Pang, Hui; Deng, Qiling; Zhang, Ke; Jiang, Haibo; Du, Jinglei; Yin, Shaoyun & Du, Chunlei

Dual-task convolutional neural network based on the combination of the U-Net and a diffraction propagation model for phase hologram design with suppressed speckle noise

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Jędrzej Szpygiel, Maksymilian Chlipała, Rafał Kukołowicz, Moncy Idicula, Tomasz Kozacki

Distortion correction for wide angle holographic projector

Applications: Adaptive Optics / Wavefront Control,AR/VR/MR / Holographic Display
GAEA Spatial Light Modulators
Authors:Rafał Kukołowicz; Chlipala, Maksymilian; Martinez-Carranza, Juan; Idicula, Moncy Sajeev & Kozacki, Tomasz

Fast 3D Content Update for Wide-Angle Holographic Near-Eye Display

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Choi, Suyeon; Gopakumar, Manu; Peng, Yifan; Kim, Jonghyun & Wetzstein, Gordon

Neural 3D holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Gopakumar, Manu; Kim, Jonghyun; Choi, Suyeon; Peng, Yifan & Wetzstein, Gordon

Unfiltered holography: optimizing high diffraction orders without optical filtering for compact holographic displays

Applications: Adaptive Optics / Wavefront Control,AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Joanna Starobrat, Szymon Fiderkiewicz, Andrzej Kołodziejczyk, Maciej Sypek, Romuald Beck, Krystian Pavłov, Mateusz Słowikowski, Adam Kowalczyk, Jarosław Suszek, Michał Makowski

Suppression of spurious image duplicates in Fourier holograms by pixel apodization of a spatial light modulator

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Cao, Hongkun; Jin, Xin; Ai, Lingyu & Kim, Eun-Soo

Faster generation of holographic video of 3-D scenes with a Fourier spectrum-based NLUT method

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhao, Zijie; Duan, Junyi & Liu, Juan

Speckle reduction in holographic display with partially spatial coherent illumination

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Wang, Fan; Shimobaba, Tomoyoshi; Zhang, Yaping; Kakue, Takashi & Ito, Tomoyoshi

Acceleration of polygon-based computer-generated holograms using look-up tables and reduction of the table size via principal component analysis

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Chlipała, Maksymilian; a; Kozacki, Tomasz; Yeom, Han-Ju; Martinez-Carranza, Juan; Rafał; Kukołowicz; Kim, Jinwoong; Yang, Jong-Heon; Choi, Ji Hun; Pi, Jae-Eun & Hwang, Chi-Sun

Wide angle holographic video projection display

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing