An interactive holographic projection system that uses a hand-drawn interface with a consumer CPU

PLUTO / PLUTO-2 Spatial Light Modulators
AR/VR/MR / Holographic Display Digital-/ Computer Holography/ CGH
Published on:
Authors: Nishitsuji, Takashi; Kakue, Takashi; Blinder, David; Shimobaba, Tomoyoshi & Ito, Tomoyoshi
Abstract:

“Holography is a promising technology for photo-realistic three-dimensional (3D) displays because of its ability to replay the light reflected from an object using a spatial light modulator (SLM). However, the enormous computational requirements for calculating computer-generated holograms (CGHs)—which are displayed on an SLM as a diffraction pattern—are a significant problem for practical uses (e.g., for interactive 3D displays for remote navigation systems). Here, we demonstrate an interactive 3D display system using electro-holography that can operate with a consumer’s CPU. The proposed system integrates an efficient and fast CGH computation algorithm for line-drawn 3D objects with inter-frame differencing, so that the trajectory of a line-drawn object that is handwritten on a drawing tablet can be played back interactively using only the CPU. In this system, we used an SLM with 1,920 × 1,080 pixels and a pixel pitch of 8 μm × 8 μm, a drawing tablet as an interface, and an Intel Core i9–9900K 3.60 GHz CPU. Numerical and optical experiments using a dataset of handwritten inputs show that the proposed system is capable of reproducing handwritten 3D images in real time with sufficient interactivity and image quality.”

Open Access

Publication: Scientific Reports
Issue/Year: Scientific Reports, Volume 11; Number 1; 2021
DOI: 10.1038/s41598-020-78902-1
Link: https://doi.org/10.1038/s41598-020-78902-1

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ning Xu, Dalong Qi, Long Cheng, Zhen Pan, Wenzhang Lin, Chengyu Zhou, Hongmei Ma, Yunhua Yao, Yuecheng Shen, Lianzhong Deng, Zhenrong Sun, and Shian Zhang

Compressive incoherent digital holography for high-fidelity 3D imaging

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:C. Hainaut, K. Ouahrouche, A. Rancon, G. Patera, C. Ouarkoub, M. Le Parquier, P. Suret, A. Amo

Bidimensional measurements of photon statistics within a multimodal temporal framework

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Pulse Application / -Shaping
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han Chen, Fan Wang, Zhonghao Wang, Pin Wang, Yongwei Yao, Bing Zhang, Yaping Zhang, and Ting-Chung Poon

Unified analytical framework for continuous shading and texture rendering in polygon-based computer-generated holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhihao Zhou, Jing Han, Zhuang Zhao, Haotian Yu, and Dongliang Zheng

Large depth range DH-PSF with high peak confinement invariance

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yiqi Ye, Hang Su, Yuetian Jia,, Baoli Li, Min Gu and Xinyuan Fang

High-capacity multiview display with large viewing angle via orbital angular momentum-encoded nanograting arrays

Applications: AR/VR/MR / Holographic Display,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chenliang Chang, Chenzhou Zhao, Bo Dai, Qi Wang, Dawei Zhang, Songlin Zhuang, and Chao Ping Chen

Memory-Reduced Convolutional Neural Network for Fast Phase Hologram Generation

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yuta Goto, Satoshi Shinada, Atsushi Okamoto, Naoya Wada, and Hideaki Furukawa

Compact-size and high mode-scalability spatial-mode multiplexer using multiplexed volume holograms

Applications: Digital-/ Computer Holography/ CGH,Optical Communication,Telecom / Optical Switching / WSS
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Ninghe Liu, Kexuan Liu, Yixin Yang, Yifan Peng, and Liangcai Cao

Propagation-adaptive 4K computer-generated holography using physics-constrained spatial and Fourier neural operator

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Bilal Moussa Fares, Hyun-su Kim, Peter Schelkens, and David Blinder

Sparse point cloud computer-generated holography with the Gabor transform

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Suyeon Choi, Changwon Jang, Douglas Lanman & Gordon Wetzstein

Synthetic aperture waveguide holography for compact mixed-reality displays with large étendue

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xing Li, Dan Dan, Siarhei Zavatski, Wenyu Gao, Qiang Zhang, Yuan Zhou, Jia Qian, Yanlong Yang, Xianghua Yu, Shaohui Yan, Xiaohao Xu, Olivier J. F. Martin, and Baoli Yao

Optical tweeze-sectioning microscopy for 3D imaging and manipulation of suspended cells

Applications: Digital-/ Computer Holography/ CGH,Microscopy,Optical Trapping /-Tweezers
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Kyosik Min, Myeong-Ho Choi, and Jae-Hyeung Park

Quality enhancement of computer-generated hologram without contents-dependent optimization by considering aberrations in the optical system

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Imaging/ Image Processing
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Tobias Wilm, Reinhold Fiess, and Ulrich Seger

In-situ automotive camera calibration using holographic resolution targets

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Materials Processing / Optical Fabrication,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Leyla Kabuli, Oliver Cossairt, Florian Schiffers, Nathan Matsuda, and Grace Kuo

High contrast holography through dual modulation

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LUNA Spatial Light Modulators
Authors:Xiangrui Duan and Zichun Le

Inter-layer edge supplementation in computer-generated multi-depth 3D holograms

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngrok Kim, Dong-Woo Seo, Chihyun In and Sung-Wook Min

Phase-assisted camera-in-the-loop hologram optimization with Fourier aperture function constraint

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Carlos Vargas-Castrillón, Alejandro Velez-Zea, and John Fredy Barrera-Ramírez

Intensity equivalence between free-space propagation and a single-lens processor: application to adjustable magnification in hologram reconstruction

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Maksymilian Chlipala, Maria-Luisa Cruz, Juan Martinez-Carranza, Moncy Idicula, Rafal Kukolowicz, and Tomasz Kozacki

Wide-angle color holographic near eye display with full bandwidth frequency multiplexing

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ning Xu, Dalong Qi, Long Cheng, Zhen Pan, Chengyu Zhou, Wenzhang Lin, Hongmei Ma, Yunhua Yao, Yuecheng Shen, Lianzhong Deng, Zhenrong Sun, and Shian Zhang

Sparse point spread function-based multi-image optical encryption

Applications: Digital-/ Computer Holography/ CGH,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kenneth Chen, Anzhou Wen, Yunxiang Zhang, Praneeth Chakravarthula and Qi Sun

View synthesis for 3D computer-generated holograms using deep neural fields

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Reza Esmaeilzadeh, Jamasp Jhabvala, Lucas Schlenger, Mathijs van der Meer, Eric Boillat, Cyril Cayron, Amir Mohammad Jamili, Junfeng Xiao, and Roland E. Logé

Toward Architected Microstructures Using Advanced Laser Beam Shaping in Laser Powder Bed Fusion of Ti-6Al-4V

Applications: Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
LUNA Spatial Light Modulators
Authors:Sascha Fricke, Susana Castillo, Martin Eisemann, and Marcus Magnor

Real-Time Rendering Framework for Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Alfonso Blesa and Francisco J. Serón

Advancement of the DRPE Encryption Algorithm for Phase CGHs by Random Pixel Shuffling

Applications: Digital-/ Computer Holography/ CGH,Optical Communication,Optical Computing / Quantum Optics
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yuki Takemura, Hirohito Nishi, Kyoji Matsushima

Denisyuk-type wavefront printer and its computational correction of aberration in optical system

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH