Neural 3D holography

Author(s):

Choi, Suyeon; Gopakumar, Manu; Peng, Yifan; Kim, Jonghyun & Wetzstein, Gordon

Abstract:

“Holographic near-eye displays promise unprecedented capabilities for virtual and augmented reality (VR/AR) systems. The image quality achieved by current holographic displays, however, is limited by the wave propagation models used to simulate the physical optics. We propose a neural network-parameterized plane-to-multiplane wave propagation model that closes the gap between physics and simulation. Our model is automatically trained using camera feedback and it outperforms related techniques in 2D plane-to-plane settings by a large margin. Moreover, it is the first network-parameterized model to naturally extend to 3D settings, enabling high-quality 3D computer-generated holography using a novel phase regularization strategy of the complex-valued wave field. The efficacy of our approach is demonstrated through extensive experimental evaluation with both VR and optical see-through AR display prototypes.”

Link to Publications Page

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, Volume 40; Number 6; Pages 1–12; 2021
DOI: 10.1145/3478513.3480542

Fast 3D Content Update for Wide-Angle Holographic Near-Eye Display

Author(s):

Rafał Kukołowicz; Chlipala, Maksymilian; Martinez-Carranza, Juan; Idicula, Moncy Sajeev & Kozacki, Tomasz

Abstract:

“Near-eye holographic displays are the holy grail of wear-on 3D display devices because they are intended to project realistic wide-angle virtual scenes with parameters matching human vision. One of the key features of a realistic perspective is the ability to move freely around the virtual scene. This can be achieved by addressing the display with wide-angle computer-generated holograms (CGHs) that enable continuous viewpoint change. However, to the best of our knowledge there is no technique able to generate these types of content. Thus, in this work we propose an accurate and non-paraxial hologram update method for wide-angle CGHs that supports continuous viewpoint change around the scene. This method is based on the assumption that with a small change in perspective, two consecutive holograms share overlapping data. This enables reusing the corresponding part of the information from the previous view, eliminating the need to generate an entirely new hologram. Holographic information for the next viewpoint is calculated in two steps: first, a tool approximating the Angular Spectrum Propagation is proposed to generate the hologram data from previous viewpoint; and second, the efficient Phase Added Stereogram algorithm is utilized for generating the missing hologram content. This methodology offers fast and accurate calculations at the same time. Numerical and optical experiments are carried out to support the results of the proposed method.”

Link to Publications Page

Publication: Applied Sciences
Issue/Year: Applied Sciences, Volume 12; Number 1; Pages 293; 2021
DOI: 10.3390/app12010293

Distortion correction for wide angle holographic projector

Author(s):

Jędrzej Szpygiel, Maksymilian Chlipała, Rafał Kukołowicz, Moncy Idicula, Tomasz Kozacki

Abstract:

“This letter presents a distortion correction method enabling a distortion minimized, large size image in a wide angle holographic projector. The technique applies numerical predistortion of an input image used for hologram generation. It is based on estimation of distortion coefficients by comparing optically a reconstructed point test chart with the original one. Obtained experimental results prove that the technique allows reconstruction of high-quality image.”

Link to Publications Page

Publication: Photonics Letters of Poland
Issue/Year: Photonics Letters of Poland, Volume 13; Number 4; Pages 79; 2021
DOI: 10.4302/plp.v13i4.1125

Faster generation of holographic video of 3-D scenes with a Fourier spectrum-based NLUT method

Author(s):

Cao, Hongkun; Jin, Xin; Ai, Lingyu & Kim, Eun-Soo

Abstract:

“In this article, a new type of Fourier spectrum-based novel look-up table (FS-NLUT) method is proposed for the faster generation of holographic video of three-dimensional (3-D) scenes. This proposed FS-NLUT method consists of principal frequency spectrums (PFSs) which are much smaller in size than the principal fringe patterns (PFPs) found in the conventional NLUT-based methods. This difference in size allows for the number of basic algebraic operations in the hologram generation process to be reduced significantly. In addition, the fully one-dimensional (1-D) calculation framework of the proposed method also allows for a significant reduction of overall hologram calculation time. In the experiments, the total number of basic algebraic operations needed for the proposed FS-NLUT method were found to be reduced by 81.23% when compared with that of the conventional 1-D NLUT method. In addition, the hologram calculation times of the proposed method, when implemented in the CPU and the GPU, were also found to be 60% and 66% faster than that of the conventional 1-D NLUT method, respectively. It was also confirmed that the proposed method implemented with two GPUs can generate a holographic video of a test 3-D scene in real-time (>24f/s).”

Link to Publications Page

Publication: Optics Express
Issue/Year: Optics Express, Volume 29; Number 24; Pages 39738; 2021
DOI: 10.1364/oe.442267

Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration

Author(s):

Peng, Yifan; Choi, Suyeon; Kim, Jonghyun & Wetzstein, Gordon

Abstract:

“Computer-generated holography (CGH) holds transformative potential for a wide range of applications, including direct-view, virtual and augmented reality, and automotive display systems. While research on holographic displays has recently made impressive progress, image quality and eye safety of holographic displays are fundamentally limited by the speckle introduced by coherent light sources. Here, we develop an approach to CGH using partially coherent sources. For this purpose, we devise a wave propagation model for partially coherent light that is demonstrated in conjunction with a camera-in-the-loop calibration strategy. We evaluate this algorithm using light-emitting diodes (LEDs) and superluminescent LEDs (SLEDs) and demonstrate improved speckle characteristics of the resulting holograms compared with coherent lasers. SLEDs in particular are demonstrated to be promising light sources for holographic display applications, because of their potential to generate sharp and high-contrast two-dimensional (2D) and 3D images that are bright, eye safe, and almost free of speckle.”

Link to Publications Page

Publication: Science Advances
Issue/Year: Science Advances, Volume 7; Number 46; 2021
DOI: 10.1126/sciadv.abg5040

Acceleration of polygon-based computer-generated holograms using look-up tables and reduction of the table size via principal component analysis

Author(s):

Wang, Fan; Shimobaba, Tomoyoshi; Zhang, Yaping; Kakue, Takashi & Ito, Tomoyoshi

Abstract:

“In this study, we first analyze the fully analytical frequency spectrum solving method based on three-dimensional affine transform. Thus, we establish a new method for combining look-up tables (LUTs) with polygon holography. The proposed method was implemented and proved to be accelerated about twice compared to the existing methods. In addition, principal component analysis was used to compress the LUTs, effectively reducing the required memory without artifacts. Finally, we calculated very complex objects on a graphics processing unit using the proposed method, and the calculation speed was higher than that of existing polygon-based methods.”

Link to Publications Page

Publication: Optics Express
Issue/Year: Optics Express, Volume 29; Number 22; Pages 35442; 2021
DOI: 10.1364/oe.435966

Fast calculation of computer generated hologram based on single Fourier transform for holographic three-dimensional display

Author(s):

Chang, Chenliang; Zhu, Dongchen; Li, Jiamao; Wang, Di; Xia, Jun & Zhang, Xiaolin

Abstract:

“We present an efficient method for the fast calculation of computer generated hologram (CGH). The 3D object is split into sub-layers according to its depth information. A 2D all-in-focus image is generated by sequential tiling all the layers in one plane. A Fourier hologram that contains all the information of 3D object is calculated from the fast Fourier transform (FFT) of the reassembled 2D image. By multiplying a pre-calculated multifocal off-axis digital phase mask (DPM) to the Fourier hologram, the content of each layer is axially relocated to different depth in the Fourier transform optical system to reconstruct the 3D object. The computation speed of the proposed method is greatly improved with only single FFT calculation process. Both of simulation and experimental results proves the validation of the proposed method.”

Link to Publications Page

Publication: Displays
Issue/Year: Displays, Volume 69; Pages 102064; 2021
DOI: 10.1016/j.displa.2021.102064

Wide angle holographic video projection display

Author(s):

Chlipała, Maksymilian; a; Kozacki, Tomasz; Yeom, Han-Ju; Martinez-Carranza, Juan; Rafał; Kukołowicz; Kim, Jinwoong; Yang, Jong-Heon; Choi, Ji Hun; Pi, Jae-Eun & Hwang, Chi-Sun

Abstract:

“Holographic projection displays provide high diffraction efficiency. However, they have a limited projection angle. This work proposes a holographic projection display with a wide angle, which gives an image of size 306mm×161mm at 700 mm and reduced speckle noise. The solution uses single Fourier lens imaging with a frequency filter and hologram generation utilizing complex coding and nonparaxial diffraction. The experiment was performed with a 4K phase-only spatial light modulator (SLM) to prove the high efficiency of the developed numerical tools. Optical reconstruction shows high resolution and high image quality achieved from a single frame. Hence, displaying video at a full frame rate of the SLM is possible.”

Link to Publications Page

Publication: Optics Letters
Issue/Year: Optics Letters, Volume 46; Number 19; Pages 4956; 2021
DOI: 10.1364/ol.430275

Hologram computation using the radial point spread function

Author(s):

Yasuki, Daiki; Shimobaba, Tomoyoshi; Makowski, Michal; Suszek, Jaroslaw; Kakue, Takashi & Ito, Tomoyoshi

Abstract:

“Holograms are computed by superimposing point spread functions (PSFs), which represent the distribution of light on the hologram plane. The computational cost and the spatial bandwidth product required to generate holograms are significant; therefore, it is challenging to compute high-resolution holograms at the rates required for videos. Among the possible displays, fixed-eye-position holographic displays, such as holographic head-mounted displays, reduce the spatial bandwidth product by fixing eye positions while satisfying almost all human depth cues. In eye-fixed holograms, by calculating a part distribution of the entire PSF, we observe reconstructed images that maintain the image quality and the depth of focus almost as high as those generated by the entire PSF. In this study, we accelerate the calculation of eye-fixed holograms by engineering the PSFs. We propose cross and radial PSFs, and we determine that, out of the two, the radial PSFs have a better image quality. By combining the look-up table method and the wavefront-recording plane method with radial PSFs, we show that the proposed method can rapidly compute holograms.”

Link to Publications Page

Publication: Applied Optics
Issue/Year: Applied Optics, Volume 60; Number 28; Pages 8829; 2021
DOI: 10.1364/ao.437777

Holographic near-eye display based on complex amplitude modulation with band-limited zone plates

Author(s):

Chen, Yun; Hua, Minjie; Zhang, Tianshun; Zhou, Mingxin; Wu, Jianhong & Zou, Wenlong

Abstract:

“A holographic near-eye display (NED) system based on complex amplitude modulation (CAM) with band-limited zone plates is proposed. The whole system mainly consists of a phase-only spatial light modulator (SLM), an Abbe-Porter filter system, an eyepiece, and an image combiner. The point source method based on band limited zone plates is used to accurately control the bandwidth of the target complex amplitude. The effects of intensity modulation coefficient γ in the frequency-filtering method on the intensity and the quality of reconstructed images are analyzed, which provide a judgment basis for selecting the appropriate value of γ. We also derive the expressions of the field of view (FOV) and exit pupil of the NED system. Since the holographic image is magnified in two steps in this system, the large FOV can be obtained. The optical experimental results show that the proposed system can provide a dynamic holographic three-dimensional (3D) augmented reality (AR) display with a 23.5°horizontal FOV.”

Link to Publications Page

Publication: Optics Express
Issue/Year: Optics Express, Volume 29; Number 14; Pages 22749; 2021
DOI: 10.1364/oe.431032
1 2 3 5