Toward simple, generalizable neural networks with universal training for low-SWaP hybrid vision

Spatial Light Modulators
Higher Order Modes / Optical Vortex / OAM Imaging/ Image Processing Optical Computing / Quantum Optics Phase Measurement / Phase Retrieval
Published on:
Authors: Muminov, Baurzhan; Perry, Altai; Hyder, Rakib; Asif, M. Salman & Vuong, Luat T.
Abstract:
“Speed, generalizability, and robustness are fundamental issues for building lightweight computational cameras. Here we demonstrate generalizable image reconstruction with the simplest of hybrid machine vision systems: linear optical preprocessors combined with no-hidden-layer, “small-brain” neural networks. Surprisingly, such simple neural networks are capable of learning the image reconstruction from a range of coded diffraction patterns using two masks. We investigate the possibility of generalized or “universal training” with these small brains. Neural networks trained with sinusoidal or random patterns uniformly distribute errors around a reconstructed image, whereas models trained with a combination of sharp and curved shapes (the phase pattern of optical vortices) reconstruct edges more boldly. We illustrate variable convergence of these simple neural networks and relate learnability of an image to its singular value decomposition entropy of the image. We also provide heuristic experimental results. With thresholding, we achieve robust reconstruction of various disjoint datasets. Our work is favorable for future real-time low size, weight, and power hybrid vision: we reconstruct images on a 15 W laptop CPU with 15,000 frames per second: faster by a factor of 3 than previously reported results and 3 orders of magnitude faster than convolutional neural networks.”

Open Access

Publication: Photonics Research
Issue/Year: Photonics Research, Volume 9; Number 7; Pages B253; 2021
DOI: 10.1364/prj.416614
Link: https://doi.org/10.1364/prj.416614

Related Papers

GAEA Spatial Light Modulators
Authors:Li, Baoli / Su, Hang / Meng, Weijia / Cheng, Ke / Luan, Haitao / Gu, Min / Fang, Xinyuan

Orbital angular momentum holographic multicasting for switchable and secure wireless optical communication links

Applications: Beam Shaping / Beam Steering,Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhu, Jialong / Zou, Fucheng / Wang, Le / Lu, Xiaodong / Zhao, Shengmei

Multiplexing Perfect Optical Vortex for Holographic Data Storage

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
LC 2012 Spatial Light Modulators
Authors:Weng, Xiaojing / Feng, Ji / Perry, Altai / Vuong, Luat T.

Non-Line-of-Sight Full-Stokes Polarimetric Imaging with Solution-Processed Metagratings and Shallow Neural Networks

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ni, Jincheng / Ji, Shengyun / Wang, Zhenyu / Liu, Shunli / Hu, Yanlei / Chen, Yang / Li, Jiawen / Li, Xiangping / Chu, Jiaru / Wu, Dong / Qiu, Cheng-Wei

Unidirectional unpolarized luminescence emission via vortex excitation

Applications: Higher Order Modes / Optical Vortex / OAM
GAEA Spatial Light Modulators
Authors:Tilmon, Brevin; Sun, Zhanghao; Koppal, Sanjeev; Wu, Yicheng; Evangelidis, Georgios; Zahreddine, Ramzi; Krishnan, Guru; Ma, Sizhuo & Wang, Jian

Energy-Efficient Adaptive 3D Sensing

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shikder, Allarakha / Nishchal, Naveen K.

Generation of optical vortex lattices by in-line phase modulation with partially coherent light

Applications: Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Chaohui; Xin, Jun; Li, Yanan; Lu, Xiao-Ming

Measuring small displacements of an optical point source with digital holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wen, Yong-Li / Wang, Yunfei / Tian, Li-Man / Zhang, Shanchao / Li, Jianfeng / Du, Jing-Song / Yan, Hui / Zhu, Shi-Liang

Demonstration of the quantum principle of least action with single photons

Applications: Optical Computing / Quantum Optics
LC 2012 Spatial Light Modulators
Authors:Tsukada, Takumi / Watanabe, Wataru

Central wavelength estimation in spectral imaging behind a diffuser via deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han, Tongyu; Peng, Tong; Li, Runze; Wang, Kaige; Sun, Dan & Yao, Baoli

Extending the Imaging Depth of Field through Scattering Media by Wavefront Shaping of Non-Diffraction Beams

Applications: Bessel-/ Airy Beam Generation,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ghosh, Bohnishikha; Daniel, Anat; Gorzkowski, Bernard & Lapkiewicz, Radek

Azimuthal backflow in light carrying orbital angular momentum

Applications: Complex Modulation,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhang, Yuanhang & Fontaine, Nicolas K.

Multi-Plane Light Conversion: A Practical Tutorial

Applications: Higher Order Modes / Optical Vortex / OAM,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kang, Xiangyu; Shan, Xinzhi; Chen, Keyu; Sun, Xiaojie; Wang, Guanxue; Gao, Xiumin; Liu, Yi & Zhuang, Songlin

Generation of vector elliptical perfect optical vortices with mixed modes in free space

Applications: Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Dongxu; Zhang, Lu; Zhang, Hongzhi; Zhang, Guoquan

Ghost images with controllable visibility and spatial resolution

Applications: Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ma, Junyao; Li, Zhe; Zhao, Shengmei & Wang, Le

Encrypting orbital angular momentum holography with ghost imaging

Applications: Complex Modulation,Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ye, Zhiyuan; Hou, Wanting; Zhao, Jilun; Wang, Hai-Bo & Xiong, Jun

Computational holographic ghost diffraction

Applications: Imaging/ Image Processing,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Luo, Li; Mi, Zhiyi; Huang, Junyi & Ruan, Zhichao

Wavelength-division multiplexing optical Ising simulator enabling fully programmable spin couplings and external magnetic fields

Applications: Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Gong, Yanyan; Zeng, Ming; Zhu, Yueqiang; Li, Shangyu; Zhao, Wei; Zhang, Ce; Zhao, Tianyun; Wang, Kaige; Yang, Jiangcun & Bai, Jintao

Flow Cytometry with Anti-Diffraction Light Sheet (ADLS) by Spatial Light Modulation

Applications: Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yudaev, Andrey; Kiselev, Alexander; Shashkova, Inna; Tavrov, Alexander; Lipatov, Alexander & Korablev, Oleg

Wavefront Sensing by a Common-Path Interferometer for Wavefront Correction in Phase and Amplitude by a Liquid Crystal Spatial Light Modulator Aiming the Exoplanet Direct Imaging

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing,Phase Measurement / Phase Retrieval
LC 2012 Spatial Light Modulators
Authors:Neto, Jose Reinaldo da Cunha Santos Aroso Vieira da Silva; Nakamura, Tomoya; Makihara, Yasushi & Yagi, Yasushi

Extended Depth-of-Field Lensless Imaging using an Optimized Radial Mask

Applications: Imaging/ Image Processing
Spatial Light Modulators
Authors:Sun, Zhuo; Hu, Juntao; Wang, Yishu; Ye, Wenni; Qian, Yixian & Li, Xinzhong

Generation of high-dimensional caustic beams via phase holograms using angular spectral representation

Applications: Beam Shaping / Beam Steering,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shikder, Allarakha & Nishchal, Naveen K.

Measurement of the fractional topological charge of an optical vortex beam through interference fringe dislocation

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Communication,Phase Measurement / Phase Retrieval
LC 2012 Spatial Light Modulators
Authors:Arriaga-Hernandez, Jesus; Cuevas-Otahola, Bolivia; Oliveros-Oliveros, Jacobo; Morin-Castillo, Maria; Martinez-Laguna, Ygnacio & Cedillo-Ramirez, Lilia

Simulated LCSLM with Inducible Diffractive Theory to Display Super-Gaussian Arrays Applying the Transport-of-Intensity Equation

Applications: Adaptive Optics / Wavefront Control,Higher Order Modes / Optical Vortex / OAM,Misc.: Speckle / Characterization / Metrology
GAEA Spatial Light Modulators
Authors:Gao, Yunhui & Cao, Liangcai

Pixel super-resolution quantitative phase imaging based on modulation diversity

Applications: Digital-/ Computer Holography/ CGH,Phase Measurement / Phase Retrieval