Speckle-free holography with a diffraction-aware global perceptual model

LETO / LETO-3 Spatial Light Modulators
AR/VR/MR / Holographic Display Deep Learning / Neuronal Network Digital-/ Computer Holography/ CGH
Published on:
Authors: Yiran Wei, Yiyun Chen, Mi Zhou, Mu Ku Chen, Shuming Jiao, Qinghua Song, Xiao-Ping Zhang and Zihan Geng
Abstract:

Computer-generated holography (CGH) based on neural networks has been actively investigated in recent years, and convolutional neural networks (CNNs) are frequently adopted. A convolutional kernel captures local dependencies between neighboring pixels. However, in CGH, each pixel on the hologram influences all the image pixels on the observation plane, thus requiring a network capable of learning long-distance dependencies. To tackle this problem, we propose a CGH model called Holomer. Its single-layer perceptual field is 43 times larger than that of a widely used 3×3 convolutional kernel, thanks to the embedding-based feature dimensionality reduction and multi-head sliding-window self-attention mechanisms. In addition, we propose a metric to measure the networks’ learning ability of the inverse diffraction process. In the simulation, our method demonstrated noteworthy performance on the DIV2K dataset at a resolution of 1920×1024, achieving a PSNR and an SSIM of 35.59 dB and 0.93, respectively. The optical experiments reveal that our results have excellent image details and no observable background speckle noise. This work paves the path of high-quality hologram generation.

Open Access

Publication: Photonics Research
Issue/Year: Photon. Res. 12, 2418-2423 (2024)
DOI: 10.1364/PRJ.523650
Link: https://doi.org/10.1364/PRJ.523650

Related Papers

LC 2012 Spatial Light Modulators
Authors:J. Arriaga Hernández, B. Cuevas Otahola, A. Diaz Nayotl, A. Jaramillo Núñez, A. Pérez Villegas, O. Valenzuela b

Machine learning K-means algorithm applied to wavefront sensing in Bi-Ronchi/Hartmann tests with SLM

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ning Xu, Dalong Qi, Long Cheng, Zhen Pan, Wenzhang Lin, Chengyu Zhou, Hongmei Ma, Yunhua Yao, Yuecheng Shen, Lianzhong Deng, Zhenrong Sun, and Shian Zhang

Compressive incoherent digital holography for high-fidelity 3D imaging

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:C. Hainaut, K. Ouahrouche, A. Rancon, G. Patera, C. Ouarkoub, M. Le Parquier, P. Suret, A. Amo

Bidimensional measurements of photon statistics within a multimodal temporal framework

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Pulse Application / -Shaping
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han Chen, Fan Wang, Zhonghao Wang, Pin Wang, Yongwei Yao, Bing Zhang, Yaping Zhang, and Ting-Chung Poon

Unified analytical framework for continuous shading and texture rendering in polygon-based computer-generated holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
ERIS PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Guillaume Noetinger, Tim Tuuva, Romain Fleury

Tutorial: A practical guide to the alignment of defocused spatial light modulators for fast diffractive neural networks

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yaping Tian, Yuhan Zhou, Shiyi Lu, Liming Zhu, Khian-Hooi Chew, Rui-Pin Chen

Mueller matrix-based deep neural network for adaptive reconstruction of orthogonal polarization components of a vector beam transmitted through a highly scattering medium

Applications: Deep Learning / Neuronal Network,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhihao Zhou, Jing Han, Zhuang Zhao, Haotian Yu, and Dongliang Zheng

Large depth range DH-PSF with high peak confinement invariance

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yiqi Ye, Hang Su, Yuetian Jia,, Baoli Li, Min Gu and Xinyuan Fang

High-capacity multiview display with large viewing angle via orbital angular momentum-encoded nanograting arrays

Applications: AR/VR/MR / Holographic Display,Higher Order Modes / Optical Vortex / OAM
LC 2012 Spatial Light Modulators
Authors:Ruidong Li, Caihua Zhang, Kejian Zhu, Zheng Huang, Conghe Wang, Shukai Wu, and Hongwei Chen

Implementation of fully connected layers in optical convolutional neural networks for pre-sensor computing

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ruitao Wu, Juncheng Fang, Rui Pan, Rongyi Lin, Kaiyuan Li, Ting Lei, Luping Du, Xiaocong Yuan

Physical Interpretation of Diffractive Optical Networks for High-Dimensional Vortex Mode Sorting

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
ERIS Spatial Light Modulators
Authors:Ying Zhao, Hao Wang, Dan Li, Ping Yan, and Qirong Xiao

In-situ forward sparse training of large-scale optical neural networks

Applications: Deep Learning / Neuronal Network,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qian Zhang, Yu Miao, Jiali Sun, Yuan Sui, Stefan Rothe, and Juergen W. Czarske

Digital design of mode decomposition systems for multimode fibers using physics-informed neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chenliang Chang, Chenzhou Zhao, Bo Dai, Qi Wang, Dawei Zhang, Songlin Zhuang, and Chao Ping Chen

Memory-Reduced Convolutional Neural Network for Fast Phase Hologram Generation

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Chuxuan Huang, Yue Huang, and Manhua Liu

NeuHolo: non-interferometric quantitative single-shot holographic imaging for 3D metrology using neural fields

Applications: Deep Learning / Neuronal Network,Phase Measurement / Phase Retrieval
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yuta Goto, Satoshi Shinada, Atsushi Okamoto, Naoya Wada, and Hideaki Furukawa

Compact-size and high mode-scalability spatial-mode multiplexer using multiplexed volume holograms

Applications: Digital-/ Computer Holography/ CGH,Optical Communication,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Likai Cheng, Jianming Gao, Banlian Xu, Leihong Zhang, and Dawei Zhang

Computational ghost imaging of atmospheric turbulence based on a single variable convolution kernel

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Bilal Moussa Fares, Hyun-su Kim, Peter Schelkens, and David Blinder

Sparse point cloud computer-generated holography with the Gabor transform

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Suyeon Choi, Changwon Jang, Douglas Lanman & Gordon Wetzstein

Synthetic aperture waveguide holography for compact mixed-reality displays with large étendue

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xing Li, Dan Dan, Siarhei Zavatski, Wenyu Gao, Qiang Zhang, Yuan Zhou, Jia Qian, Yanlong Yang, Xianghua Yu, Shaohui Yan, Xiaohao Xu, Olivier J. F. Martin, and Baoli Yao

Optical tweeze-sectioning microscopy for 3D imaging and manipulation of suspended cells

Applications: Digital-/ Computer Holography/ CGH,Microscopy,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Hangyu Zhang, Chenzhe Jiang, Leihong Zhang, and Dawei Zhang

Computational ghost imaging for atmospheric turbulence using model-driven and data-driven deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Kyosik Min, Myeong-Ho Choi, and Jae-Hyeung Park

Quality enhancement of computer-generated hologram without contents-dependent optimization by considering aberrations in the optical system

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Imaging/ Image Processing
LC-R 720 Spatial Light Modulators
Authors:Don Bonifacio, Laterriean M. Minaya, Xuemei Chen, Yuanwei Zhang, and Xuan Liu

Phase-augmented deep learning for cell segmentation in wrapped quantitative phase images

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngbin Na and Do-Kyeong Ko

Tailoring orbital angular momentum entanglement through inverse design based on gradient descent

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Computing / Quantum Optics
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Tobias Wilm, Reinhold Fiess, and Ulrich Seger

In-situ automotive camera calibration using holographic resolution targets

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Materials Processing / Optical Fabrication,Misc.: Speckle / Characterization / Metrology