Accommodative holography: improving accommodation response for perceptually realistic holographic displays

Author(s):

Kim, Dongyeon; Nam, Seung-Woo; Lee, Byounghyo; Seo, Jong-Mo & Lee, Byoungho

Abstract:

“Holographic displays have gained unprecedented attention as next-generation virtual and augmented reality applications with recent achievements in the realization of a high-contrast image through computer-generated holograms (CGHs). However, these holograms show a high energy concentration in a limited angular spectrum, whereas the holograms with uniformly distributed angular spectrum suffer from a severe speckle noise in the reconstructed images. In this study, we claim that these two physical phenomena attributed to the existing CGHs significantly limit the support of accommodation cues, which is known as one of the biggest advantages of holographic displays. To support the statement, we analyze and evaluate various CGH algorithms with contrast gradients – a change of contrast over the change of the focal diopter of the eye – simulated based on the optical configuration of the display system and human visual perception models. We first introduce two approaches to improve monocular accommodation response in holographic viewing experience; optical and computational approaches to provide holographic images with sufficient contrast gradients. We design and conduct user experiments with our prototype of holographic near-eye displays, validating the deficient support of accommodation cues in the existing CGH algorithms and demonstrating the feasibility of the proposed solutions with significant improvements on accommodative gains.”

Link to Publications Page

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, Volume 41; Number 4; Pages 1–15; 2022
DOI: 10.1145/3528223.3530147

Speckle reduction in holographic display with partially spatial coherent illumination

Author(s):

Zhao, Zijie; Duan, Junyi & Liu, Juan

Abstract:

“A method of holographic reconstruction under partially spatial coherent illumination with different degree of coherence is proposed to suppress speckle noise based on theoretical analysis. The core factor of speckle reduction based on partially spatial coherent light is convolution operation in CGH reconstruction process. Numerical simulations and optical experiments are both performed to verify the proposed theory. The results reconstructed by proposed and traditional method are compared, and the speckle contrasts can be reduced to 0.05 and 0.08 at most in Fresnel and Fraunhofer zone respectively. The image quality is obviously improved. This method can provide further applications for three-dimensional holographic display, beam shaping and coherence degree modulation techniques.”

Link to Publications Page

Publication: Optics Communications
Issue/Year: Optics Communications, Volume 507; Pages 127604; 2022
DOI: 10.1016/j.optcom.2021.127604

Hogel-free Holography

Author(s):

Chakravarthula, Praneeth; Tseng, Ethan; Fuchs, Henry & Heide, Felix

Abstract:

“Holography is a promising avenue for high-quality displays without requiring bulky, complex optical systems. While recent work has demonstrated accurate hologram generation of 2D scenes, high-quality holographic projections of 3D scenes has been out of reach until now. Existing multiplane 3D holography approaches fail to model wavefronts in the presence of partial occlusion while holographic stereogram methods have to make a fundamental trade of between spatial and angular resolution. In addition, existing 3D holographic display methods rely on heuristic encoding of complex amplitude into phase-only pixels which results in holograms with severe artifacts. Fundamental limitations of the input representation, wavefront modeling, and optimization methods prohibit artifact-free 3D holographic projections in today’s displays. To lift these limitations, we introduce hogel-free holography which optimizes for true 3D holograms, supporting both depth- and view- dependent efects for the irst time. Our approach overcomes the fundamental spatio-angular resolution trade-of typical to stereogram approaches. Moreover, it avoids heuristic encoding schemes to achieve high image idelity over a 3D volume. We validate that the proposed method achieves 10 dB PSNR improvement on simulated holographic reconstructions. We also validate our approach on an experimental prototype with accurate parallax and depth focus efects”

Link to Publications Page

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, 2022
DOI: 10.1145/3516428

Dual-task convolutional neural network based on the combination of the U-Net and a diffraction propagation model for phase hologram design with suppressed speckle noise

Author(s):

Sun, Xiuhui; Mu, Xingyu; Xu, Cheng; Pang, Hui; Deng, Qiling; Zhang, Ke; Jiang, Haibo; Du, Jinglei; Yin, Shaoyun & Du, Chunlei

Abstract:

“In this paper, a dual-task convolutional neural network based on the combination of the U-Net and a diffraction propagation model is proposed for the design of phase holograms to suppress speckle noise of the reconstructed images. By introducing a Fresnel transmission layer, based on angular spectrum diffraction theory, as the diffraction propagation model and incorporating it into U-Net as the output layer, the proposed neural network model can describe the actual physical process of holographic imaging, and the distributions of both the light amplitude and phase can be generated. Afterwards, by respectively using the Pearson correlation coefficient (PCC) as the loss function to modulate the distribution of the amplitude, and a proposed target-weighted standard deviation (TWSD) as the loss function to limit the randomness and arbitrariness of the reconstructed phase distribution, the dual tasks of the amplitude reconstruction and phase smoothing are jointly solved, and thus the phase hologram that can produce high quality image without speckle is obtained. Both simulations and optical experiments are carried out to confirm the feasibility and effectiveness of the proposed method. Furthermore, the depth of field (DOF) of the image using the proposed method is much larger than that of using the traditional Gerchberg-Saxton (GS) algorithm due to the smoothness of the reconstructed phase distribution, which is also verified in the experiments. This study provides a new phase hologram design approach and shows the potential of neural networks in the field of the holographic imaging and more.”

Link to Publications Page

Publication: Optics Express
Issue/Year: Optics Express, Volume 30; Number 2; Pages 2646; 2022
DOI: 10.1364/oe.440956

Polygon-based computer-generated holography: a review of fundamentals and recent progress [Invited]

Author(s):

Zhang, Yaping; Fan, Houxin; Wang, Fan; Gu, Xianfeng; Qian, Xiaofan & Poon, Ting-Chung

Abstract:

“In this review paper, we first provide comprehensive tutorials on two classical methods of polygon-based computer-generated holography: the traditional method (also called the fast-Fourier-transform-based method) and the analytical method. Indeed, other modern polygon-based methods build on the idea of the two methods. We will then present some selective methods with recent developments and progress and compare their computational reconstructions in terms of calculation speed and image quality, among other things. Finally, we discuss and propose a fast analytical method called the fast 3D affine transformation method, and based on the method, we present a numerical reconstruction of a computer-generated hologram (CGH) of a 3D surface consisting of 49,272 processed polygons of the face of a real person without the use of graphic processing units; to the best of our knowledge, this represents a state-of-the-art numerical result in polygon-based computed-generated holography. Finally, we also show optical reconstructions of such a CGH and another CGH of the Stanford bunny of 59,996 polygons with 31,724 processed polygons after back-face culling. We hope that this paper will bring out some of the essence of polygon-based computer-generated holography and provide some insights for future research.”

Link to Publications Page

Publication: Applied Optics
Issue/Year: Applied Optics, Volume 61; Number 5; Pages B363; 2022
DOI: 10.1364/ao.444973

Lensless Optical Encryption of Multilevel Digital Data Containers Using Spatially Incoherent Illumination

Author(s):

Cheremkhin, Pavel; Evtikhiev, Nikolay; Krasnov, Vitaly; Ryabcev, Ilya; Shifrina, Anna & Starikov, Rostislav

Abstract:

“The necessity of the correction of errors emerging during the optical encryption process ledto the extensive use of data containers such as QR codes. However, due to specifics of optical encryp-tion, QR codes are not very well suited for the task, which results in low error correction capabilitiesin optical experiments mainly due to easily breakable QR code’s service elements and byte datastructure. In this paper, we present optical implementation of information optical encryption systemutilizing new multilevel customizable digital data containers with high data density. The results ofoptical experiments demonstrate efficient error correction capabilities of the new data container.”

Link to Publications Page

Publication: Applied Sciences
Issue/Year: Applied Sciences, Volume 12; Number 1; Pages 406; 2021
DOI: 10.3390/app12010406

Neural 3D holography

Author(s):

Choi, Suyeon; Gopakumar, Manu; Peng, Yifan; Kim, Jonghyun & Wetzstein, Gordon

Abstract:

“Holographic near-eye displays promise unprecedented capabilities for virtual and augmented reality (VR/AR) systems. The image quality achieved by current holographic displays, however, is limited by the wave propagation models used to simulate the physical optics. We propose a neural network-parameterized plane-to-multiplane wave propagation model that closes the gap between physics and simulation. Our model is automatically trained using camera feedback and it outperforms related techniques in 2D plane-to-plane settings by a large margin. Moreover, it is the first network-parameterized model to naturally extend to 3D settings, enabling high-quality 3D computer-generated holography using a novel phase regularization strategy of the complex-valued wave field. The efficacy of our approach is demonstrated through extensive experimental evaluation with both VR and optical see-through AR display prototypes.”

Link to Publications Page

Publication: ACM Transactions on Graphics
Issue/Year: ACM Transactions on Graphics, Volume 40; Number 6; Pages 1–12; 2021
DOI: 10.1145/3478513.3480542

Fast 3D Content Update for Wide-Angle Holographic Near-Eye Display

Author(s):

Rafał Kukołowicz; Chlipala, Maksymilian; Martinez-Carranza, Juan; Idicula, Moncy Sajeev & Kozacki, Tomasz

Abstract:

“Near-eye holographic displays are the holy grail of wear-on 3D display devices because they are intended to project realistic wide-angle virtual scenes with parameters matching human vision. One of the key features of a realistic perspective is the ability to move freely around the virtual scene. This can be achieved by addressing the display with wide-angle computer-generated holograms (CGHs) that enable continuous viewpoint change. However, to the best of our knowledge there is no technique able to generate these types of content. Thus, in this work we propose an accurate and non-paraxial hologram update method for wide-angle CGHs that supports continuous viewpoint change around the scene. This method is based on the assumption that with a small change in perspective, two consecutive holograms share overlapping data. This enables reusing the corresponding part of the information from the previous view, eliminating the need to generate an entirely new hologram. Holographic information for the next viewpoint is calculated in two steps: first, a tool approximating the Angular Spectrum Propagation is proposed to generate the hologram data from previous viewpoint; and second, the efficient Phase Added Stereogram algorithm is utilized for generating the missing hologram content. This methodology offers fast and accurate calculations at the same time. Numerical and optical experiments are carried out to support the results of the proposed method.”

Link to Publications Page

Publication: Applied Sciences
Issue/Year: Applied Sciences, Volume 12; Number 1; Pages 293; 2021
DOI: 10.3390/app12010293

Unfiltered holography: optimizing high diffraction orders without optical filtering for compact holographic displays

Author(s):

Gopakumar, Manu; Kim, Jonghyun; Choi, Suyeon; Peng, Yifan & Wetzstein, Gordon

Abstract:

“Computer-generated holography suffers from high diffraction orders (HDOs) created from pixelated spatial light modulators, which must be optically filtered using bulky optics. Here, we develop an algorithmic framework for optimizing HDOs without optical filtering to enable compact holographic displays. We devise a wave propagation model of HDOs and use it to optimize phase patterns, which allows HDOs to contribute to forming the image instead of creating artifacts. The proposed method significantly outperforms previous algorithms in an unfiltered holographic display prototype.”

Link to Publications Page

Publication: Optics Letters
Issue/Year: Optics Letters, Volume 46; Number 23; Pages 5822; 2021
DOI: 10.1364/ol.442851

Faster generation of holographic video of 3-D scenes with a Fourier spectrum-based NLUT method

Author(s):

Cao, Hongkun; Jin, Xin; Ai, Lingyu & Kim, Eun-Soo

Abstract:

“In this article, a new type of Fourier spectrum-based novel look-up table (FS-NLUT) method is proposed for the faster generation of holographic video of three-dimensional (3-D) scenes. This proposed FS-NLUT method consists of principal frequency spectrums (PFSs) which are much smaller in size than the principal fringe patterns (PFPs) found in the conventional NLUT-based methods. This difference in size allows for the number of basic algebraic operations in the hologram generation process to be reduced significantly. In addition, the fully one-dimensional (1-D) calculation framework of the proposed method also allows for a significant reduction of overall hologram calculation time. In the experiments, the total number of basic algebraic operations needed for the proposed FS-NLUT method were found to be reduced by 81.23% when compared with that of the conventional 1-D NLUT method. In addition, the hologram calculation times of the proposed method, when implemented in the CPU and the GPU, were also found to be 60% and 66% faster than that of the conventional 1-D NLUT method, respectively. It was also confirmed that the proposed method implemented with two GPUs can generate a holographic video of a test 3-D scene in real-time (>24f/s).”

Link to Publications Page

Publication: Optics Express
Issue/Year: Optics Express, Volume 29; Number 24; Pages 39738; 2021
DOI: 10.1364/oe.442267
1 2 3 … 14