Non-Line-of-Sight Full-Stokes Polarimetric Imaging with Solution-Processed Metagratings and Shallow Neural Networks

LC 2012 Spatial Light Modulators
Deep Learning / Neuronal Network Imaging/ Image Processing Polarization Generation
Published on:
Authors: Weng, Xiaojing / Feng, Ji / Perry, Altai / Vuong, Luat T.
Abstract:

There is currently significant interest in approaches that combine metaphotonics with back-end algorithms to advance imaging capabilities with less complicated hardware. Here, we combine computational imaging with a low-cost polarimetric encoder to construct a non-line-of-sight full-Stokes polarimetric camera. The polarimetric encoder is a multiscale, solution-processed metagrating composed of conducting-polymer nanofibers. We image the highly corrugated speckle patterns from the metagrating with a polarization-agnostic CCD sensor and achieve full-Stokes imaging from single-image capture with a trained shallow neural network (SNN) model. As SNNs require large amounts of training data, we present an effective method to generate numerous polarimetric scenes that span the full range of the Poincaré sphere. To guide the paired encoder and algorithm design, we also compare the reconstruction performance of SNN to pseudoinverse algorithms with varied sensor sampling size and explore the issues of compressive sensing. Our results provide new guidelines and impressive possibilities with meso-ordered, multiscale, self-assembled materials in future hybrid computing and polarimetric imaging systems.

Open Access

Publication: ACS Photonics
Issue/Year: ACS Photonics 2023, 10, 8, 2570–2579
DOI: 10.1021/acsphotonics.3c00291
Link: https://doi.org/10.1021/acsphotonics.3c00291

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Allarakha Shikder and Naveen K. Nishchal

Image encryption using binary polarization states of light beam

Applications: Optical Communication,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiangcheng Zhao, Chuanbiao Bai, Zhiguo Zhang and Qingchuan Zhang

Deep learning-based method for analyzing the optically trapped sperm rotation

Applications: Deep Learning / Neuronal Network,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhu, Jialong / Zou, Fucheng / Wang, Le / Lu, Xiaodong / Zhao, Shengmei

Multiplexing Perfect Optical Vortex for Holographic Data Storage

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
GAEA Spatial Light Modulators
Authors:Tilmon, Brevin; Sun, Zhanghao; Koppal, Sanjeev; Wu, Yicheng; Evangelidis, Georgios; Zahreddine, Ramzi; Krishnan, Guru; Ma, Sizhuo & Wang, Jian

Energy-Efficient Adaptive 3D Sensing

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheng, Huadong / Peng, Junchang / Wang, Zhen / xinghua Shui / yu yingjie / Xia, Xinxing

Diffraction model-driven neural network trained using hybrid domain loss for real-time and high-quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Chaohui; Xin, Jun; Li, Yanan; Lu, Xiao-Ming

Measuring small displacements of an optical point source with digital holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LC 2012 Spatial Light Modulators
Authors:Tsukada, Takumi / Watanabe, Wataru

Central wavelength estimation in spectral imaging behind a diffuser via deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nys, Inge; Ropač, Peter; Berteloot, Brecht; Ravnik, Miha; Neyts, Kristiaan

Highly dispersive liquid crystal diffraction gratings with continuously varying periodicity

Applications: Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han, Tongyu; Peng, Tong; Li, Runze; Wang, Kaige; Sun, Dan & Yao, Baoli

Extending the Imaging Depth of Field through Scattering Media by Wavefront Shaping of Non-Diffraction Beams

Applications: Bessel-/ Airy Beam Generation,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Dongxu; Zhang, Lu; Zhang, Hongzhi; Zhang, Guoquan

Ghost images with controllable visibility and spatial resolution

Applications: Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ye, Zhiyuan; Hou, Wanting; Zhao, Jilun; Wang, Hai-Bo & Xiong, Jun

Computational holographic ghost diffraction

Applications: Imaging/ Image Processing,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yudaev, Andrey; Kiselev, Alexander; Shashkova, Inna; Tavrov, Alexander; Lipatov, Alexander & Korablev, Oleg

Wavefront Sensing by a Common-Path Interferometer for Wavefront Correction in Phase and Amplitude by a Liquid Crystal Spatial Light Modulator Aiming the Exoplanet Direct Imaging

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing,Phase Measurement / Phase Retrieval
LC 2012 Spatial Light Modulators
Authors:Neto, Jose Reinaldo da Cunha Santos Aroso Vieira da Silva; Nakamura, Tomoya; Makihara, Yasushi & Yagi, Yasushi

Extended Depth-of-Field Lensless Imaging using an Optimized Radial Mask

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wang, Jian; Zhong, Guangchao; Wu, Daixuan; Huang, Sitong; Luo, Zhi-Chao & Shen, Yuecheng

Multimode fiber-based greyscale image projector enabled by neural networks with high generalization ability

Applications: Deep Learning / Neuronal Network
GAEA Spatial Light Modulators
Authors:Dong, Zhenxing; Xu, Chao; Ling, Yuye; Li, Yan & Su, Yikai

Fourier-inspired neural module for real-time and high-fidelity computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jia, Qi; Zhang, Yanxia; Shi, Bojian; Li, Hang; Li, Xiaoxin; Feng, Rui; Sun, Fangkui; Cao, Yongyin; Wang, Jian; Qiu, Cheng-Wei & Ding, Weiqiang

Simultaneously sorting vector vortex beams of 120 modes

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kürekci, Şahin

Optical classification and reconstruction through multimode fibers

Applications: Deep Learning / Neuronal Network,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shui, Xinghua; Zheng, Huadong; Xia, Xinxing; Yang, Furong; Wang, Weisen & Yu, Yingjie

Diffraction model-informed neural network for unsupervised layer-based computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rowe, Connor M. L.; Cortes, Luis Romero; de Chatellus, Hugues Guillet; Seghilani, Mohamed & Azana, Jose

Generalized Talbot Self-Healing of Periodic Images

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Reda, Francesco; Salvatore, Marcella; Borbone, Fabio; Maddalena, Pasqualino; Ambrosio, Antonio & Oscurato, Stefano Luigi

Varifocal diffractive lenses for multi-depth microscope imaging

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing,Lithography
Spatial Light Modulators
Authors:Cheremkhin, Pavel; Evtikhiev, Nikolay; Krasnov, Vitaly; Ryabcev, Ilya; Shifrina, Anna & Starikov, Rostislav

Lensless Optical Encryption of Multilevel Digital Data Containers Using Spatially Incoherent Illumination

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Optical Communication
LC-R 720 Spatial Light Modulators
Authors:Liu, Xuan; Wan, Zhaoxiong; Zhang, Yuanwei & Liu, Yuwei

Optically computed phase microscopy for quantitative dynamic imaging of label-free cells and nanoparticles

Applications: Imaging/ Image Processing,Microscopy
LC 2012 Spatial Light Modulators
Authors:Lai, Xuetian; Li, Qiongyao; Chen, Ziyang; Shao, Xiaopeng & Pu, Jixiong

Reconstructing images of two adjacent objects passing through scattering medium via deep learning

Applications: Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Bulbul, Angika; Hai, Nathaniel & Rosen, Joseph

Coded aperture correlation holography (COACH) with a superior lateral resolution of FINCH and axial resolution of conventional direct imaging systems

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology