Simplified digital content generation based on an inverse-directed propagation algorithm for holographic stereogram printing

Author(s):

Khuderchuluun, Anar; Piao, Yan-Ling; Erdenebat, Munkh-Uchral; Dashdavaa, Erkhembaatar; Lee, Moung Hee; Jeon, Seok-Hee & Kim, Nam

Abstract:

“Holographic stereogram (HS) printing requires extensive memory capacity and long computation time during perspective acquisition and implementation of the pixel re-arrangement algorithm. Hogels contain very weak depth information of the object. We propose a HS printing system that uses simplified digital content generation based on the inverse-directed propagation (IDP) algorithm for hogel generation. Specifically, the IDP algorithm generates an array of hogels using a simple process that acquires the full three-dimensional (3D) information of the object, including parallax, depth, color, and shading, via a computer-generated integral imaging technique. This technique requires a short computation time and is capable of accounting for occlusion and accommodation effects of the object points via the IDP algorithm. Parallel computing is utilized to produce a high-resolution hologram based on the properties of independent hogels. To demonstrate the proposed approach, optical experiments are conducted in which the natural 3D visualizations of real and virtual objects are printed on holographic material. Experimental results demonstrate the simplified computation involved in content generation using the proposed IDP-based HS printing system and the improved image quality of the holograms.”

Link to Publications Page

Publication: Applied Optics
Issue/Year: Applied Optics, Volume 60; Number 14; Pages 4235; 2021
DOI: 10.1364/ao.423205

Real-time sub-wavelength imaging of surface waves with nonlinear near-field optical microscopy

Author(s):

Frischwasser, Kobi; Cohen, Kobi; Kher-Alden, Jakob; Dolev, Shimon; Tsesses, Shai & Bartal, Guy

Abstract:

“Imaging evanescent waves is of crucial importance for sub-wavelength-scale investigation of various phenomena. However, frequently used techniques for near-field imaging require either a strong perturbation of the field, long acquisition times or complex electron-based tools. Here, we introduce nonlinear near-field optical microscopy (NNOM), which is capable of real-time evanescent wave imaging by nonlinear wave mixing while using only standard optical components. As a proof-of-concept, we present non-perturbative, single-shot mapping of evanescent plasmonic patterns, utilizing the nonlinearity of the host metal, and monitor in real time the externally controlled changes to the patterns. We further demonstrate the ability to extract the full field information—the amplitude and phase of all electric-field components—in a polarization-sensitive, spin-selective manner. This simple and highly tunable technique could be extended to deep sub-wavelength imaging of polaritons in two-dimensional materials or other nanophotonic guided modes, for swift photonic device characterization and optimized light−matter interactions.”

Link to Publications Page

Publication: Nature Photonics
Issue/Year: Nature Photonics, Volume 15; Number 6; Pages 442–448; 2021
DOI: 10.1038/s41566-021-00782-2

Aberration-free digital holographic phase imaging using the derivative-based principal component analysis

Author(s):

Lai, Xiaomin; Xiao, Sheng; Xu, Chen; Fan, Shanhui & Wei, Kaihua

Abstract:

“Significance: Digital holographic microscopy is widely used to get the quantitative phase information of transparent cells.

Aim: However, the sample phase is superimposed with aberrations. To quantify the phase information, aberrations need to be fully compensated.

Approach: We propose a technique to obtain aberration-free phase imaging, using the derivative-based principal component analysis (dPCA).

Results: With dPCA, almost all aberrations can be extracted and compensated without requirements on background segmentation, making it efficient and convenient.

Conclusions: It solves the problem that the conventional principal component analysis (PCA) algorithm cannot compensate the common but intricate higher order cross-term aberrations, such as astigmatism and coma. Moreover, the dPCA strategy proposed here is not only suitable for aberration compensation but also applicable for other cases where there exist cross-terms that cannot be analyzed with the PCA algorithm.”

Link to Publications Page

Publication: Journal of Biomedical Optics
Issue/Year: Journal of Biomedical Optics, Volume 26; Number 04; 2021
DOI: 10.1117/1.jbo.26.4.046501

SLM Simulation and MonteCarlo Path Tracing for Computer-Generated Holograms

Author(s):

Magallón, Juan; Blesa, Alfonso & Serón, Francisco

Abstract:

“Computer holography is a growing research field that must pay attention to two main issues concerning computing effort: the visualization of a 3D virtual scene with photo-realistic quality and the bottleneck related to hologram digitizalition and visualization limits. This work shows a computational approach based on a Monte Carlo path-tracing algorithm, which accounts for both geometrical and physical phenomena involved in hologram generation, and, therefore, makes a feasible estimation of computing time costs. As these holograms also require yet unavailable visualization devices, their behavior needs to be simulated by computer techniques.”

Link to Publications Page

Publication: SN Computer Science
Issue/Year: SN Computer Science, Volume 2; Number 3; 2021
DOI: 10.1007/s42979-021-00632-6

A generalized iterative projection framework for pixel-super-resolved holographic imaging

Author(s):

Gao, Yunhui & Cao, Liangcai

Abstract:

“Lensless holographic imaging is challenged by the twin-image artifact due to the missing phase and the aliasing effect due to the undersampled measurement. Therefore, phase retrieval and pixel super-resolution (PSR) techniques serve as the essential ingredients for high-fidelity holographic imaging. In this work, we combine the two in a unified framework by formulating the PSR phase retrieval as a non-convex feasibility problem. An adaptive smoothing strategy for escaping local minima is introduced. Numerical and experimental results are presented and discussed. The proposed framework can be generalized to various physical settings, and is compatible with the state-of-the-art iterative projection algorithms.”

Link to Publications Page

Publication:
Issue/Year: , 2021
DOI: 10.1117/12.2577198

Holographic contact lens display that provides focusable images for eyes

Author(s):

Sano, Junpei & Takaki, Yasuhiro

Abstract:

“In this paper, we propose a holographic image generation technique for contact lens displays. The proposed technique employs a phase-only spatial light modulator (SLM), a holographic optical element (HOE) backlight, and a polarizer. The proposed holographic technique can generate 3D images apart from the contact lens displays. Therefore, the eyes can focus on the 3D images while simultaneously observing the real scene through the phase-only SLM and the HOE backlight, which provides see-through capability. A bench-top experimental system was constructed to verify the far-distance image generation capability and see-through function.”

Link to Publications Page

Publication: Optics Express
Issue/Year: Optics Express, Volume 29; Number 7; Pages 10568; 2021
DOI: 10.1364/oe.419604

Towards real-time photorealistic 3D holography with deep neural networks

Author(s):

Shi, Liang; Li, Beichen; Kim, Changil; Kellnhofer, Petr & Matusik, Wojciech

Abstract:

“The ability to present three-dimensional (3D) scenes with continuous depth sensation has a profound impact on virtual and augmented reality, human–computer interaction, education and training. Computer-generated holography (CGH) enables high-spatio-angular-resolution 3D projection via numerical simulation of diffraction and interference1. Yet, existing physically based methods fail to produce holograms with both per-pixel focal control and accurate occlusion. The computationally taxing Fresnel diffraction simulation further places an explicit trade-off between image quality and runtime, making dynamic holography impractical. Here we demonstrate a deep-learning-based CGH pipeline capable of synthesizing a photorealistic colour 3D hologram from a single RGB-depth image in real time. Our convolutional neural network (CNN) is extremely memory efficient (below 620 kilobytes) and runs at 60 hertz for a resolution of 1,920 × 1,080 pixels on a single consumer-grade graphics processing unit. Leveraging low-power on-device artificial intelligence acceleration chips, our CNN also runs interactively on mobile (iPhone 11 Pro at 1.1 hertz) and edge (Google Edge TPU at 2.0 hertz) devices, promising real-time performance in future-generation virtual and augmented-reality mobile headsets. We enable this pipeline by introducing a large-scale CGH dataset (MIT-CGH-4K) with 4,000 pairs of RGB-depth images and corresponding 3D holograms. Our CNN is trained with differentiable wave-based loss functions and physically approximates Fresnel diffraction. With an anti-aliasing phase-only encoding method, we experimentally demonstrate speckle-free, natural-looking, high-resolution 3D holograms. Our learning-based approach and the Fresnel hologram dataset will help to unlock the full potential of holography and enable applications in metasurface design, optical and acoustic tweezer-based microscopic manipulation, holographic microscopy and single-exposure volumetric 3D printing.”

Link to Publications Page

Publication: Nature
Issue/Year: Nature, Volume 591; Number 7849; Pages 234–239; 2021
DOI: 10.1038/s41586-020-03152-0

3D reconstruction of weakly scattering objects from 2D intensity-only measurements using the Wolf transform

Author(s):

Ayoub, Ahmed B.; Lim, Joowon; Antoine, Elizabeth E. & Psaltis, Demetri

Abstract:

“A new approach to optical diffraction tomography (ODT) based on intensity measurements is presented. By applying the Wolf transform directly to intensity measurements, we observed unexpected behavior in the 3D reconstruction of the sample. Such a reconstruction does not explicitly represent a quantitative measure of the refractive index of the sample; however, it contains interesting qualitative information. This 3D reconstruction exhibits edge enhancement and contrast enhancement for nanostructures compared with the conventional 3D refractive index reconstruction and thus could be used to localize nanoparticles such as lipids inside a biological sample.”

Link to Publications Page

Publication: Optics Express
Issue/Year: Optics Express, Volume 29; Number 3; Pages 3976; 2021
DOI: 10.1364/oe.414543

Depth-of-field engineering in coded aperture imaging

Author(s):

Rai, Mani Ratnam & Rosen, Joseph

Abstract:

“Extending the depth-of-field (DOF) of an optical imaging system without effecting the other imaging properties has been an important topic of research for a long time. In this work, we propose a new general technique of engineering the DOF of an imaging system beyond just a simple extension of the DOF. Engineering the DOF means in this study that the inherent DOF can be extended to one, or to several, separated different intervals of DOF, with controlled start and end points. Practically, because of the DOF engineering, entire objects in certain separated different input subvolumes are imaged with the same sharpness as if these objects are all in focus. Furthermore, the images from different subvolumes can be laterally shifted, each subvolume in a different shift, relative to their positions in the object space. By doing so, mutual hiding of images can be avoided. The proposed technique is introduced into a system of coded aperture imaging. In other words, the light from the object space is modulated by a coded aperture and recorded into the computer in which the desired image is reconstructed from the recorded pattern. The DOF engineering is done by designing the coded aperture composed of three diffractive elements. One element is a quadratic phase function dictating the start point of the in-focus axial interval and the second element is a quartic phase function which dictates the end point of this interval. Quasi-random coded phase mask is the third element, which enables the digital reconstruction. Multiplexing several sets of diffractive elements, each with different set of phase coefficients, can yield various axial reconstruction curves. The entire diffractive elements are displayed on a spatial light modulator such that real-time DOF engineering is enabled according to the user needs in the course of the observation. Experimental verifications of the proposed system with several examples of DOF engineering are presented, where the entire imaging of the observed scene is done by single camera shot.”

Link to Publications Page

Publication: Optics Express
Issue/Year: Optics Express, Volume 29; Number 2; Pages 1634; 2021
DOI: 10.1364/oe.412744

Partial aperture imaging system based on sparse point spread holograms and nonlinear cross-correlations

Author(s):

Bulbul, Angika & Rosen, Joseph

Abstract:

“Partial aperture imaging system (PAIS) is a recently developed concept in which the traditional disc-shaped aperture is replaced by an aperture with a much smaller area and yet its imaging capabilities are comparable to the full aperture systems. Recently PAIS was demonstrated as an indirect incoherent digital three-dimensional imaging technique. Later it was successfully implemented in the study of the synthetic marginal aperture with revolving telescopes (SMART) to provide superresolution with subaperture area that was less than one percent of the area of the full synthetic disc-shaped aperture. In the study of SMART, the concept of PAIS was tested by placing eight coded phase reflectors along the boundary of the full synthetic aperture. In the current study, various improvements of PAIS are tested and its performance is compared with the other equivalent systems. Among the structural changes, we test ring-shaped eight coded phase subapertures with the same area as of the previous circular subapertures, distributed along the boundary of the full disc-shaped aperture. Another change in the current system is the use of coded phase mask with a point response of a sparse dot pattern. The third change is in the reconstruction process in which a nonlinear correlation with optimal parameters is implemented. With the improved image quality, the modified-PAIS can save weight and cost of imaging devices in general and of space telescopes in particular. Experimental results with reflective objects show that the concept of coded aperture extends the limits of classical imaging”

Link to Publications Page

Publication: Scientific Reports
Issue/Year: Scientific Reports, Volume 10; Number 1; 2020
DOI: 10.1038/s41598-020-77912-3
1 2 3 4 5 … 9