Interactive Holographic Display Based on Finger Gestures.

PLUTO / PLUTO-2 Spatial Light Modulators
AR/VR/MR / Holographic Display
Published on:
Authors: Yamada, Shota and Kakue, Takashi and Shimobaba, Tomoyoshi and Ito, Tomoyoshi
Abstract:

“In this paper, we demonstrate an interactive, finger-sensitive system which enables an observer to intuitively handle electro-holographic images in real time. In this system, a motion sensor detects finger gestures (swiping and pinching) and translates them into the rotation and enlargement/reduction of the holographic image, respectively. By parallelising the hologram calculation using a graphics processing unit, we realised the interactive handling of the holographic image in real time. In a demonstration of the system, we used a Leap Motion sensor and a phase modulation-type spatial light modulator with 1,920 × 1,080 pixels and a pixel pitch of 8.0 µm × 8.0 µm. The constructed interactive finger-sensitive system was able to rotate a holographic image composed of 4,096 point light sources using a swiping gesture and enlarge or reduce it using a pinching gesture in real time. The average calculation speed was 27.6 ms per hologram. Finally, we extended the constructed system to a full-colour reconstruction system that generates a more realistic three-dimensional image. The extended system successfully allowed the handling of a full-colour holographic image composed of 1,709 point light sources with a calculation speed of 22.6 ms per hologram.”

Open Access

Publication: Scientific Reports
Issue/Year: Scientific Reports, volume 8, Article number: 2010 (2018)
DOI: 10.1038/s41598-018-20454-6
Link: https://doi.org/10.1038/s41598-018-20454-6

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ethan Tseng, Grace Kuo, Seung-Hwan Baek, Nathan Matsuda, Andrew Maimone, Florian Schiffers, Praneeth Chakravarthula, Qiang Fu, Wolfgang Heidrich, Douglas Lanman & Felix Heide

Neural étendue expander for ultra-wide-angle high-fidelity holographic display

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing
GAEA / GAEA-2 Spatial Light Modulators
Authors:Rafal Kukolowicz, Tomasz Kozacki, Maksymilian Chlipala, Moncy Sajeev Idicula, Juan Martinez-Carranza, Weronika Finke, and Izabela Gerej

Digital holographic content manipulation for wide-angle holographic near-eye displays

Applications: AR/VR/MR / Holographic Display
LETO / LETO-3 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Myeong-Ho Choi, Kwang-Soo Shin, Jae-Hyeung Park

Foveated holographic near-eye display with geometric phase lens and camera feedback

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Koray Kavaklı , Liang Shi , Hakan Urey , Wojciech Matusik , Kaan Akşit

Multi-color Holograms Improve Brightness in Holographic Displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Eric Markley , Nathan Matsuda , Florian Schiffers , Oliver Cossairt , Grace Kuo

Simultaneous Color Computer Generated Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Grace Kuo , Florian Schiffers , Douglas Lanman , Oliver Cossairt , Nathan Matsuda

Multisource Holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors: Seung-Woo Nam , Youngjin Kim , Dongyeon Kim , Yoonchan Jeong

Depolarized Holography with Polarization-Multiplexing Metasurface

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingwei Liu, Jing Chen, Bingsen Qiu, Yongtian Wang, and Juan Liu

DCPNet: a dual-channel parallel deep neural network for high quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xinxing Xia, Weisen Wang, Frank Guan, Furong Yang, Xinghua Shui, Huadong Zheng, Yingjie Yu, and Yifan Peng

Exploring angular-steering illumination-based eyebox expansion for holographic displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Huadong Zheng, Zhen Wang, Junchang Peng, Xinxing Xia, Yingjie Yu

Multiplane full-color phase-only holograms generation based on iterative algorithm with a modified amplitude constraint

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Andreas Georgiou, Jia Jia, Charlie Hewitt, Changwon Jang, Jacob Hadnett-Hunter, Jinsoo Jeong, Joel Kollin

A holographic near-eye display with glass form factor and spectacle-free operation

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Yingsi Qin, Wei-Yu Chen, Matthew O’Toole, Aswin C. Sankaranarayanan

Split-Lohmann Multifocal Displays

Applications: AR/VR/MR / Holographic Display,Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Ninghe Liu, Zhengzhong Huang, Zehao He, and Liangcai Cao

DGE-CNN: 2D-to-3D holographic display based on a depth gradient extracting module and ZCNN network

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network
GAEA / GAEA-2 Spatial Light Modulators
Authors:Chlipala, Maksymilian / Martinez-Carranza, Juan / Idicula, Moncy Sajeev / Kukołowicz, Rafał / Kozacki, Tomasz

Eyebox expansion with accurate hologram generation for wide-angle holographic near-eye display

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheng, Huadong / Peng, Junchang / Wang, Zhen / xinghua Shui / yu yingjie / Xia, Xinxing

Diffraction model-driven neural network trained using hybrid domain loss for real-time and high-quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pan, Shu; Wang, Li; Ma, Yuanzheng; Zhang, Guangyu; Liu, Rui; Zhang, Tao; Xiong, Kedi; Chen, Siyu; Zhang, Jian; Li, Wende; Yang, Sihua

Photoacoustic-enabled automatic vascular navigation: accurate and naked-eye real-time visualization of deep-seated vessels

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Quan, Jiale; Yan, Binbin; Sang, Xinzhu; Zhong, Chongli; Li, Hui; Qin, Xiujuan; Xiao, Rui; Sun, Zhi; Dong, Yu & Zhang, Huming

Multi-Depth Computer-Generated Hologram Based on Stochastic Gradient Descent Algorithm with Weighted Complex Loss Function and Masked Diffraction

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qin, Xiujuan; Sang, Xinzhu; Li, Hui; Yu, Chongxiu; Xiao, Rui; Zhong, Chongli; Sun, Zhi; Dong, Yu & Yan, Binbin

Binocular holographic display based on the holographic optical element

Applications: AR/VR/MR / Holographic Display
LETO / LETO-3 Spatial Light Modulators
Authors:Jonghyun Kim, Manu Gopakumar, Suyeon Choi, Yifan Peng, Ward Lopes and Gordon Wetzstein

Holographic Glasses for Virtual Reality

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Kim, Dongyeon; Nam, Seung-Woo; Lee, Byounghyo; Seo, Jong-Mo & Lee, Byoungho

Accommodative holography: improving accommodation response for perceptually realistic holographic displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Reda, Francesco; Salvatore, Marcella; Borbone, Fabio; Maddalena, Pasqualino; Ambrosio, Antonio & Oscurato, Stefano Luigi

Varifocal diffractive lenses for multi-depth microscope imaging

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing,Lithography
LETO / LETO-3 Spatial Light Modulators
Authors:Chakravarthula, Praneeth; Tseng, Ethan; Fuchs, Henry & Heide, Felix

Hogel-free Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhang, Yaping; Fan, Houxin; Wang, Fan; Gu, Xianfeng; Qian, Xiaofan & Poon, Ting-Chung

Polygon-based computer-generated holography: a review of fundamentals and recent progress

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Sun, Xiuhui; Mu, Xingyu; Xu, Cheng; Pang, Hui; Deng, Qiling; Zhang, Ke; Jiang, Haibo; Du, Jinglei; Yin, Shaoyun & Du, Chunlei

Dual-task convolutional neural network based on the combination of the U-Net and a diffraction propagation model for phase hologram design with suppressed speckle noise

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH