Approximating the uncertainty of deep learning reconstruction predictions in single-pixel imaging

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network
Published on:
Authors: Ruibo Shang, Mikaela A. O’Brien, Fei Wang, Guohai Situ & Geoffrey P. Luke
Abstract:

Single-pixel imaging (SPI) has the advantages of high-speed acquisition over a broad wavelength range and system compactness. Deep learning (DL) is a powerful tool that can achieve higher image quality than conventional reconstruction approaches. Here, we propose a Bayesian convolutional neural network (BCNN) to approximate the uncertainty of the DL predictions in SPI. Each pixel in the predicted image represents a probability distribution rather than an image intensity value, indicating the uncertainty of the prediction. We show that the BCNN uncertainty predictions are correlated to the reconstruction errors. When the BCNN is trained and used in practical applications where the ground truths are unknown, the level of the predicted uncertainty can help to determine whether system, data, or network adjustments are needed. Overall, the proposed BCNN can provide a reliable tool to indicate the confidence levels of DL predictions as well as the quality of the model and dataset for many applications of SPI.

Open Access

Publication: Communications Engineering
Issue/Year: Commun Eng 2, 53 (2023).
DOI: 10.1038/s44172-023-00103-1
Link: https://doi.org/10.1038/s44172-023-00103-1

Related Papers

LC-R 2500 Spatial Light Modulators
Authors:Jianyi Li, Qingfeng Liu, Liying Tan, Jing Ma and Nanxing Chen

Enhanced Neural Architecture for Real-Time Deep Learning Wavefront Sensing

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi Jia, Bojian Shi, Yanxia Zhang, Hang Li, Xiaoxin Li, Rui Feng, Fangkui Sun, Yongyin Cao, Jian Wang, Cheng-Wei Qiu, Min Gu and Weiqiang Ding

Partially coherent diffractive optical neural network

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhenting Yan, Huiling Huang, Yili Chen, Hanfei Lin, Ebraheem Farea, Xingzhao Hua and Jun Han

Scattering imaging of moving targets based on recurrent neural networks: a fusion of temporal and phase information

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiwei Fang, Huadong Zheng, Xinxing Xia, Junchang Peng, Tengfei Zhang, Xingyu Lin and Yingjie Yu

Diffraction model-driven neural network with semi-supervised training strategy for real-world 3D holographic photography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Haifeng Qin, Chao Han, Xuan Shi, Tao Gu and Kangsheng Sun

Complex-valued generative adversarial network for real-time and high-quality computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Mengyang Shi, Jiahui Ma, Zhishun Guo, Yesheng Gao and Xingzhao Liu

Speckle-free self-supervised learning for scalable imaging through scattering media with unseen condition changes

Applications: Deep Learning / Neuronal Network,Misc.: Speckle / Characterization / Metrology,Turbid-/ Opaque Media /Multi Scattering
LETO / LETO-3 Spatial Light Modulators
Authors:Yiran Wei, Yiyun Chen, Mi Zhou, Mu Ku Chen, Shuming Jiao, Qinghua Song, Xiao-Ping Zhang and Zihan Geng

Speckle-free holography with a diffraction-aware global perceptual model

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wei Liu, Chuanfu Tu, Yawen Liu and Zhiwei Ye

Orbital angular momentum superimposed mode recognition based on multi-label image classification

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Haofan Huang, Qi Zhao, Huanhao Li, Yuandong Zheng, Zhipeng Yu, Tianting Zhong, Shengfu Cheng, Chi Man Woo, Yi Gao, Honglin Liu, Yuanjin Zheng, Jie Tian, Puxiang Lai

DeepSLM: Speckle-Licensed Modulation via Deep Adversarial Learning for Authorized Optical Encryption and Decryption

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yiwen Zhang, Si-Ao Li, Xiaoyan Wang, Yongxiong Ren, Zihan Geng, Fei Yang, Zhongqi Pan, and Yang Yue

Wedge angle and orientation recognition of multi-opening objects using an attention-based CNN model

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi-Hang Liang, Zi-Le Zhang, Xu-Kai Wang, Ya-Nan Zhao, and Su-Heng Zhang

Single-pixel complex-amplitude imaging based on untrained complex-valued convolutional neural network

Applications: Deep Learning / Neuronal Network,Pulse Application / -Shaping
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Minghao Wang, Dejun Zhang, Wenke Liang, and Wen Guo

Deep learning-based general beam synthesis for atmospheric propagation

Applications: Deep Learning / Neuronal Network,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 Spatial Light Modulators
Authors:Ekaterina A. Savchenkova, Andrey S. Ovchinnikov, Vladislav G. Rodin, Rostislav S. Starikov, Nikolay N. Evtikhiev, Pavel A. Cheremkhin

Adaptive non-iterative histogram-based hologram quantization

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LC 2012 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiaosheng Li, Yifei Chen, Tianyun Liu, Bo Wu & Qinnan Zhang

Single-pixel Fresnel incoherent correlation holography compressed imaging using a Trumpet network

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LETO / LETO-3 Spatial Light Modulators
Authors:Yan Liu, Jianwei Qin, Yanbing Liu, Yuanan Liu, Xun Liu, Fangwei Ye, and Wei Li

Optical Fourier convolutional neural network with high efficiency in image classification

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kyriakos Skarsoulis, Konstantinos Makris, Christophe Moser, and Demetri Psaltis

Ptychographic imaging with a fiber endoscope via wavelength scanning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shile Yang, Yuecheng Shen, Jiawei Luo, Zhengyang Wang, Daixuan Wu, Jiaming Liang, Zhiling Zhang, Dalong Qi, Yunhua Yao, Lianzhong Deng, Bin Zhang, Zhenrong Sun, and Shian Zhang

Neural network enabled fringe projection through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Siyu Gao, Xiaoyun Liu, Yonghao Chen, Jinyang Jiang, Ying Liu, Tengfei Chai and Yueqiu Jiang

Oceanic turbulence parameters recognition based on convolutional neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Optical Communication
LETO / LETO-3 Spatial Light Modulators
Authors:Manu Gopakumar, Gun-Yeal Lee, Suyeon Choi, Brian Chao, Yifan Peng, Jonghyun Kim & Gordon Wetzstein

Full-colour 3D holographic augmented-reality displays with metasurface waveguides

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network
GAEA / GAEA-2 Spatial Light Modulators
Authors:Xiaofei Li, Xin Liu, Quanying Wu, Jun Zeng, Yangjian Cai, Sergey A. Ponomarenko, Chunhao Liang

Prime number factorization with light beams carrying orbital angular momentum

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Xiong, Xiangchao Zhang, Xinyang Ma, Leheng Li, Zhanghao Ni, and Xiangqian Jiang

Adaptive coded phase mask design and high-quality image reconstruction for interference-less coded aperture correlation holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
HES / HEO 6001 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Omri Wengrowicz, Alex Bronstein, and Oren Cohen

Unsupervised physics-informed deep learning-based reconstruction for time-resolved imaging by multiplexed ptychography

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pan, Tuqiang / Ye, Jianwei / Liu, Haotian / Zhang, Fan / Xu, Pengbai / Xu, Ou / Xu, Yi / Qin, Yuwen

Non-orthogonal optical multiplexing empowered by deep learning

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Communication
GAEA / GAEA-2 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Fang, Xinyuan / Hu, Xiaonan / Li, Baoli / Su, Hang / Cheng, Ke / Luan, Haitao / Gu, Min

Orbital angular momentum-mediated machine learning for high-accuracy mode-feature encoding

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM