Holographic Glasses for Virtual Reality

Author(s):

JONGHYUN KIM, NVIDIA, USA and Stanford University, USA
MANU GOPAKUMAR, SUYEON CHOI, AND YIFAN PENG, Stanford University, USA
WARD LOPES, NVIDIA, USA
GORDON WETZSTEIN, Stanford University, USA

Abstract:

“We resent Holographic Glasses, a holographic near-eye display system with an eyeglasses-like form factor for virtual reality. Holographic Glasses are composed of a pupil-replicating waveguide,
a spatial light modulator, and a geometric phase lens to create holographic images in a lightweight
and thin form factor. The proposed design can deliver full-color 3D holographic images using an optical stack of 2.5 mm thickness. A novel pupil-high-order gradient descent algorithm is presented for the correct phase calculation with the user’s varying pupil size. We implement benchtop and wearable prototypes for testing. Our binocular wearable prototype supports 3D focus cues and provides a diagonal field of view of 22.8? with a 2.3 mm static eye box and additional capabilities of dynamic eye box with beam steering, while weighing only 60 g excluding the driving board.”

Link to Publications Page

Publication: Association for Computing Machinery
Issue/Year: Association for Computing Machinery, 2022

Accommodative holography: improving accommodation response for perceptually realistic holographic displays

Author(s):

Kim, Dongyeon; Nam, Seung-Woo; Lee, Byounghyo; Seo, Jong-Mo & Lee, Byoungho

Abstract:

“Holographic displays have gained unprecedented attention as next-generation virtual and augmented reality applications with recent achievements in the realization of a high-contrast image through computer-generated holograms (CGHs). However, these holograms show a high energy concentration in a limited angular spectrum, whereas the holograms with uniformly distributed angular spectrum suffer from a severe speckle noise in the reconstructed images. In this study, we claim that these two physical phenomena attributed to the existing CGHs significantly limit the support of accommodation cues, which is known as one of the biggest advantages of holographic displays. To support the statement, we analyze and evaluate various CGH algorithms with contrast gradients – a change of contrast over the change of the focal diopter of the eye – simulated based on the optical configuration of the display system and human visual perception models. We first introduce two approaches to improve monocular accommodation response in holographic viewing experience; optical and computational approaches to provide holographic images with sufficient contrast gradients. We design and conduct user experiments with our prototype of holographic near-eye displays, validating the deficient support of accommodation cues in the existing CGH algorithms and demonstrating the feasibility of the proposed solutions with significant improvements on accommodative gains.”

Link to Publications Page

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, Volume 41; Number 4; Pages 1–15; 2022
DOI: 10.1145/3528223.3530147

Hogel-free Holography

Author(s):

Chakravarthula, Praneeth; Tseng, Ethan; Fuchs, Henry & Heide, Felix

Abstract:

“Holography is a promising avenue for high-quality displays without requiring bulky, complex optical systems. While recent work has demonstrated accurate hologram generation of 2D scenes, high-quality holographic projections of 3D scenes has been out of reach until now. Existing multiplane 3D holography approaches fail to model wavefronts in the presence of partial occlusion while holographic stereogram methods have to make a fundamental trade of between spatial and angular resolution. In addition, existing 3D holographic display methods rely on heuristic encoding of complex amplitude into phase-only pixels which results in holograms with severe artifacts. Fundamental limitations of the input representation, wavefront modeling, and optimization methods prohibit artifact-free 3D holographic projections in today’s displays. To lift these limitations, we introduce hogel-free holography which optimizes for true 3D holograms, supporting both depth- and view- dependent efects for the irst time. Our approach overcomes the fundamental spatio-angular resolution trade-of typical to stereogram approaches. Moreover, it avoids heuristic encoding schemes to achieve high image idelity over a 3D volume. We validate that the proposed method achieves 10 dB PSNR improvement on simulated holographic reconstructions. We also validate our approach on an experimental prototype with accurate parallax and depth focus efects”

Link to Publications Page

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, 2022
DOI: 10.1145/3516428

Scalability of all-optical neural networks based on spatial light modulators

Author(s):

Ying Zuo, Zhao Yujun, You-Chiuan Chen, Shengwang Du & Liu, Junwei

Abstract:

“Optical implementation of artificial neural networks has been attracting great attention due to its potential in parallel computation at speed of light. Although all-optical deep neural networks (AODNNs) with a few neurons have been experimentally demonstrated with acceptable errors re- cently, the feasibility of large scale AODNNs remains unknown because error might accumulate inevitably with increasing number of neurons and connections. Here, we demonstrate a scalable AODNN with programmable linear operations and tunable nonlinear activation functions. We ver- ify its scalability by measuring and analyzing errors propagating from a single neuron to the entire network. The feasibility of AODNNs is further confirmed by recognizing handwritten digits and fashions respectively.”

Link to Publications Page

Publication: Physical Review Applied
Issue/Year: Physical Review Applied, 2021
DOI: https://doi.org/10.1103/PhysRevApplied.15.054034

Neural 3D holography

Author(s):

Choi, Suyeon; Gopakumar, Manu; Peng, Yifan; Kim, Jonghyun & Wetzstein, Gordon

Abstract:

“Holographic near-eye displays promise unprecedented capabilities for virtual and augmented reality (VR/AR) systems. The image quality achieved by current holographic displays, however, is limited by the wave propagation models used to simulate the physical optics. We propose a neural network-parameterized plane-to-multiplane wave propagation model that closes the gap between physics and simulation. Our model is automatically trained using camera feedback and it outperforms related techniques in 2D plane-to-plane settings by a large margin. Moreover, it is the first network-parameterized model to naturally extend to 3D settings, enabling high-quality 3D computer-generated holography using a novel phase regularization strategy of the complex-valued wave field. The efficacy of our approach is demonstrated through extensive experimental evaluation with both VR and optical see-through AR display prototypes.”

Link to Publications Page

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, Volume 40; Number 6; Pages 1–12; 2021
DOI: 10.1145/3478513.3480542

Metamachines of pluripotent colloids

Author(s):

Aubret, Antoine; Martinet, Quentin & Palacci, Jeremie

Abstract:

“Machines enabled the Industrial Revolution and are central to modern technological progress: A machine’s parts transmit forces, motion, and energy to one another in a predetermined manner. Today’s engineering frontier, building artificial micromachines that emulate the biological machinery of living organisms, requires faithful assembly and energy consumption at the microscale. Here, we demonstrate the programmable assembly of active particles into autonomous metamachines using optical templates. Metamachines, or machines made of machines, are stable, mobile and autonomous architectures, whose dynamics stems from the geometry. We use the interplay between anisotropic force generation of the active colloids with the control of their orientation by local geometry. This allows autonomous reprogramming of active particles of the metamachines to achieve multiple functions. It permits the modular assembly of metamachines by fusion, reconfiguration of metamachines and, we anticipate, a shift in focus of self-assembly towards active matter and reprogrammable materials.”

Link to Publications Page

Publication: Nature Communications
Issue/Year: Nature Communications, Volume 12; Number 1; 2021
DOI: 10.1038/s41467-021-26699-6

Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration

Author(s):

Peng, Yifan; Choi, Suyeon; Kim, Jonghyun & Wetzstein, Gordon

Abstract:

“Computer-generated holography (CGH) holds transformative potential for a wide range of applications, including direct-view, virtual and augmented reality, and automotive display systems. While research on holographic displays has recently made impressive progress, image quality and eye safety of holographic displays are fundamentally limited by the speckle introduced by coherent light sources. Here, we develop an approach to CGH using partially coherent sources. For this purpose, we devise a wave propagation model for partially coherent light that is demonstrated in conjunction with a camera-in-the-loop calibration strategy. We evaluate this algorithm using light-emitting diodes (LEDs) and superluminescent LEDs (SLEDs) and demonstrate improved speckle characteristics of the resulting holograms compared with coherent lasers. SLEDs in particular are demonstrated to be promising light sources for holographic display applications, because of their potential to generate sharp and high-contrast two-dimensional (2D) and 3D images that are bright, eye safe, and almost free of speckle.”

Link to Publications Page

Publication: Science Advances
Issue/Year: Science Advances, Volume 7; Number 46; 2021
DOI: 10.1126/sciadv.abg5040

Realization and measurement of Airy transform of Gaussian vortex beams

Author(s):

Zhou, Lu; Zhou, Tong; Wang, Fei; Li, Xia; Chen, Ruipin; Zhou, Yimin & Zhou, Guoquan

Abstract:

“Airy transformation is a useful technique to modulate amplitude and phase of a light beam, which has important applications in particle trapping/manipulation, optical communications and optical imaging. However, most of the studies only focused on the Airy transform of Gaussian beams and other vortex-free beams in the past. In this paper, the Airy transform of Gaussian vortex beams, which are the most common vortex beams, is investigated. A universal analytical expression of the Gaussian vortex beams with topological charge (TC) m passing through an Airy transform optical system is derived. We carry out a detailed study on the output beams’ characteristics after the Airy transform of the Gaussian vortex beams with m = ± 1 and ± 2. The analytical expressions for the centroid, the beam spot size, the divergence angle and the beam propagation factor of the output beams are derived. The effects of the Airy control parameters and the TC on the normalized intensity distribution, the phase distribution, the centroid, the beam spot size and the beam propagation factor of the output beams are investigated both theoretically and experimentally. The experimental results agree reasonably well with the theoretical results which illustrate the properties of Airy transform of the Gaussian vortex beams.”

Link to Publications Page

Publication: Optics and Laser Technology
Issue/Year: Optics and Laser Technology, Volume 143; Pages 107334; 2021
DOI: 10.1016/j.optlastec.2021.107334

Unfiltered holography: optimizing high diffraction orders without optical filtering for compact holographic displays

Author(s):

Gopakumar, Manu; Kim, Jonghyun; Choi, Suyeon; Peng, Yifan & Wetzstein, Gordon

Abstract:

“Computer-generated holography suffers from high diffraction orders (HDOs) created from pixelated spatial light modulators, which must be optically filtered using bulky optics. Here, we develop an algorithmic framework for optimizing HDOs without optical filtering to enable compact holographic displays. We devise a wave propagation model of HDOs and use it to optimize phase patterns, which allows HDOs to contribute to forming the image instead of creating artifacts. The proposed method significantly outperforms previous algorithms in an unfiltered holographic display prototype.”

Link to Publications Page

Publication: Optics Letters
Issue/Year: Optics Letters, Volume 46; Number 23; Pages 5822; 2021
DOI: 10.1364/ol.442851

Experimental investigation in Airy transform of Gaussian beams with optical vortex

Author(s):

Xu, Yi-Qing; Li, Xia; Zhou, Lu; Zhou, Yi-Min; Wang, Fei & Zhou, Guo-Quan

Abstract:

“The Airy transform was first introduced for a Gaussian beam, and the output beam is an Airy beam. When the Gaussian beam is extended to the Gaussian beam with optical vortex, what kind of output beam will be achieved by executing the Airy transformation. Therefore, the experimental research on Airy transformation of a Gaussian beam with optical vortex is carried out, including the generation of Gaussian beams with optical vortex, the realization of Airy transform, and the related measurements of the output beams. The phase pattern is indirect measured and is recovered from the intensity pattern which is the interference result of a plane wave and the output beam. The experimental measurement results of the light intensity and the phase patterns of transformed Gaussian beams with the optical vortex are consistent with the corresponding numerical simulation results.

Based on the first and the second moments of light intensity, the centroid and the beam size are measured. According to the hyperbolic law of the beam width along the axial propagation distance, the propagation factor of the output beam is measured. The influences of the Airy coefficients and the topological charge on the intensity pattern, the phase pattern, the centroid, the beam size, and the propagation factor of transformed Gaussian beams with optical vortex are experimentally investigated, respectively. The intensity pattern, the phase pattern, the centroid, the beam size, and the propagation factor of a transformed Gaussian beam with optical vortex are also compared with those of the corresponding transformed Gaussian vortex beam. This experiment fully proves the effect of the optical vortex on the Airy transformation of Gaussian beams. Meanwhile, this study offers an optional method to generate Airy-like beams from Gaussian beams with optical vortex, which is beneficial to the applications of Gaussian beams with optical vortex.”

Link to Publications Page

Publication: Results in Physics
Issue/Year: Results in Physics, Volume 28; Pages 104588; 2021
DOI: 10.1016/j.rinp.2021.104588
1 2 3