Non-Line-of-Sight Full-Stokes Polarimetric Imaging with Solution-Processed Metagratings and Shallow Neural Networks

LC 2012 Spatial Light Modulators
Deep Learning / Neuronal Network Imaging/ Image Processing Polarization Generation
Published on:
Authors: Weng, Xiaojing / Feng, Ji / Perry, Altai / Vuong, Luat T.
Abstract:

There is currently significant interest in approaches that combine metaphotonics with back-end algorithms to advance imaging capabilities with less complicated hardware. Here, we combine computational imaging with a low-cost polarimetric encoder to construct a non-line-of-sight full-Stokes polarimetric camera. The polarimetric encoder is a multiscale, solution-processed metagrating composed of conducting-polymer nanofibers. We image the highly corrugated speckle patterns from the metagrating with a polarization-agnostic CCD sensor and achieve full-Stokes imaging from single-image capture with a trained shallow neural network (SNN) model. As SNNs require large amounts of training data, we present an effective method to generate numerous polarimetric scenes that span the full range of the Poincaré sphere. To guide the paired encoder and algorithm design, we also compare the reconstruction performance of SNN to pseudoinverse algorithms with varied sensor sampling size and explore the issues of compressive sensing. Our results provide new guidelines and impressive possibilities with meso-ordered, multiscale, self-assembled materials in future hybrid computing and polarimetric imaging systems.

Open Access

Publication: ACS Photonics
Issue/Year: ACS Photonics 2023, 10, 8, 2570–2579
DOI: 10.1021/acsphotonics.3c00291
Link: https://doi.org/10.1021/acsphotonics.3c00291

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zejian Ren, Xu Yan, Kai Wen, Huijin Chen, Elnur Hajiyev, Chengdong He, Gyu-Boong Jo

Creation of a tweezer array for cold atoms utilizing a generative neural network

Applications: Deep Learning / Neuronal Network,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiuru He, Pengwei Zhang, Jianpo Su, Junqiao Wang, Yongzhi Tian, Yongsheng Hu, and Fengying Ma

Edge enhancement in three-dimensional vortex imaging based on FINCH by Bessel-like spiral phase modulation

Applications: Imaging/ Image Processing
LETO / LETO-3 Spatial Light Modulators
Authors:Wenxue Zhang, Yuhong Wan, Tianlong Man, Hongqiang Zhou

Computational incoherent edge enhancement imaging based on self-interference digital holography

Applications: Imaging/ Image Processing
HES / HEO 6001 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Ziyu Gu, Mengyang Shi, Yesheng Gao, and Xingzhao Liu

OP-FCNN: an optronic fully convolutional neural network for imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Dejin Zhang, Wei Sheng, Yaoyao Shi, and Youwen Liu

Imaging objects hidden inside the strongly scattering media based on bidirectional ghost imaging

Applications: Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Edgar Medina-Segura, Francisco I Mecillas-Hernández, Thomas Konrad, Carmelo Rosales-Guzmán and Benjamin Perez-Garcia

Violation of Bell’s inequality for helical Mathieu–Gauss vector modes

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Computing / Quantum Optics,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Grace Kuo , Florian Schiffers , Douglas Lanman , Oliver Cossairt , Nathan Matsuda

Multisource Holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheyu Wu, Ran Gao, Sitong Zhou, Fei Wang, Zhipei Li, Huan Chang, Dong Guo, Xiangjun Xin, Qi Zhang, Feng Tian, Qiang Wu

Robust Super-Resolution Image Transmission Based on a Ring Core Fiber with Orbital Angular Momentum

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chané Moodley and Andrew Forbes

All-digital quantum ghost imaging: tutorial

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Sitong Huang, Jian Wang, Daixuan Wu, Yin Huang, and Yuecheng Shen

Projecting colorful images through scattering media via deep learning

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Brecht Berteloot, Inge Nys, Sunqian Liu, and Kristiaan Neyts

Two-Dimensional Liquid-Crystal Photoalignment by Multiple Illumination Steps

Applications: Materials Processing / Optical Fabrication,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingwei Liu, Jing Chen, Bingsen Qiu, Yongtian Wang, and Juan Liu

DCPNet: a dual-channel parallel deep neural network for high quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yunping Qiu, Zisheng Wang, Zhe Weng, Zhi-Cheng Ren, Xi-Lin Wang, Jianping Ding, and Hui-Tian Wang

Single-shot measurement of the Jones matrix for anisotropic media using four-channel digital polarization holography

Applications: Digital-/ Computer Holography/ CGH,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kumar, Rahul, Naveen K. Nishchal, and Ayman Alfalou

Improving the False Alarm Capability of the Extended Maximum Average Correlation Height Filter

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: U. Ruiz and T. Cerda

Polarization sensitive security system

Applications: Digital-/ Computer Holography/ CGH,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Marshall B. Lindsay, Scott D. Kovaleski, Andy G. Varner, Charlie T. Veal, Derek T. Anderson, Stanton R. Price, and Steven R. Price

End-to-end physics-informed deep neural network optimization of sub-Nyquist lenses

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jianan Feng, Hang Chen, Dahai Yang, Junbo Hao, Jie Lin, and Peng Jin

Multi-wavelength diffractive neural network with the weighting method

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhang, Yantong, Huiling Huang, Feibin Wu, Jun Han, Yi Yang, and Ruyi Li

Imaging through a Scattering Medium under Different Intensities of Ambient Light Interference

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Allarakha Shikder and Naveen K. Nishchal

Image encryption using binary polarization states of light beam

Applications: Optical Communication,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:León Schweickhardt , Dirk Stöbener und Andreas Fischer

Specklebasierte Charakterisierung anisotroper Oberflächen

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jesus del Hoyo, Angela Soria-Garcia, Joaquin Andres-Porras, Luis Miguel Sanchez-Brea, Veronica Pastor-Villarrubia, Mahmoud H. Elshorbagy, Javier Alda

Robust Mueller polarimetry of spatial light modulators

Applications: Complex Modulation,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiangcheng Zhao, Chuanbiao Bai, Zhiguo Zhang and Qingchuan Zhang

Deep learning-based method for analyzing the optically trapped sperm rotation

Applications: Deep Learning / Neuronal Network,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ruibo Shang, Mikaela A. O’Brien, Fei Wang, Guohai Situ & Geoffrey P. Luke

Approximating the uncertainty of deep learning reconstruction predictions in single-pixel imaging

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nitin Dubey, Ravi Kumar, Joseph Rosen

Multi-wavelength imaging with extended depth of field using coded apertures and radial quartic phase functions

Applications: Imaging/ Image Processing