Toward simple, generalizable neural networks with universal training for low-SWaP hybrid vision

Spatial Light Modulators
Higher Order Modes / Optical Vortex / OAM Imaging/ Image Processing Optical Computing / Quantum Optics Phase Measurement / Phase Retrieval
Published on:
Authors: Muminov, Baurzhan; Perry, Altai; Hyder, Rakib; Asif, M. Salman & Vuong, Luat T.
Abstract:
“Speed, generalizability, and robustness are fundamental issues for building lightweight computational cameras. Here we demonstrate generalizable image reconstruction with the simplest of hybrid machine vision systems: linear optical preprocessors combined with no-hidden-layer, “small-brain” neural networks. Surprisingly, such simple neural networks are capable of learning the image reconstruction from a range of coded diffraction patterns using two masks. We investigate the possibility of generalized or “universal training” with these small brains. Neural networks trained with sinusoidal or random patterns uniformly distribute errors around a reconstructed image, whereas models trained with a combination of sharp and curved shapes (the phase pattern of optical vortices) reconstruct edges more boldly. We illustrate variable convergence of these simple neural networks and relate learnability of an image to its singular value decomposition entropy of the image. We also provide heuristic experimental results. With thresholding, we achieve robust reconstruction of various disjoint datasets. Our work is favorable for future real-time low size, weight, and power hybrid vision: we reconstruct images on a 15 W laptop CPU with 15,000 frames per second: faster by a factor of 3 than previously reported results and 3 orders of magnitude faster than convolutional neural networks.”

Open Access

Publication: Photonics Research
Issue/Year: Photonics Research, Volume 9; Number 7; Pages B253; 2021
DOI: 10.1364/prj.416614
Link: https://doi.org/10.1364/prj.416614

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenxing Yang, Shengxiang Shan, Mengsi Liu, Shubo Cheng, Tao Shui, Chenjie Dai, and Shaohua Tao

Image information transmission based on self-rotating beam arrays encoding/decoding

Applications: Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chang Lin, Le Wang, and Shengmei Zhao

Petal orbital angular momentum multiplexing holography for two-dimensional optical encryption

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Hangyu Zhang, Chenzhe Jiang, Leihong Zhang, and Dawei Zhang

Computational ghost imaging for atmospheric turbulence using model-driven and data-driven deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 Spatial Light Modulators
Authors:Kyosik Min, Myeong-Ho Choi, and Jae-Hyeung Park

Quality enhancement of computer-generated hologram without contents-dependent optimization by considering aberrations in the optical system

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Imaging/ Image Processing
LETO / LETO-3 Spatial Light Modulators
Authors:Zheng Yuan, Yuan Gao, Wenxiang Yan, Zhiming Qing, Zhi-Cheng Ren, Xi-Lin Wang, Jianping Ding, and Hui-Tian Wang

Spin-engineered 3D optical manipulation via polarization-gradient architecturing

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Trapping /-Tweezers,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngbin Na and Do-Kyeong Ko

Tailoring orbital angular momentum entanglement through inverse design based on gradient descent

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Fucheng Zou, Dechun Liu, Le Wang, Shengmei Zhao, and Jialong Zhu

Dynamic Micro-Vibration Monitoring Based on Fractional Optical Vortex

Applications: Higher Order Modes / Optical Vortex / OAM
GAEA / GAEA-2 Spatial Light Modulators
Authors:Tobias Wilm, Reinhold Fiess, and Ulrich Seger

In-situ automotive camera calibration using holographic resolution targets

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Materials Processing / Optical Fabrication,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nima Asoudegi and Mo Mojahedi

Orbital Angular Momentum Holography Using Neural Network and Camera in the Loop

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Farhana Firdous and Ravi Kadlimatti

Generation Techniques of Orbital Angular Momentum Beams for Wireless Communication Applications

Applications: Higher Order Modes / Optical Vortex / OAM
ERIS Spatial Light Modulators
Authors:Haijun Wu, Weijie Zhou, Zhihan Zhu and Yijie Shen

Optical skyrmion lattices accelerating in a free-space mode

Applications: Bessel-/ Airy Beam Generation,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Joseph Meyer, Yuval Reches, Georgi Gary Rozenman, Yaron Oz, Haim Suchowski and Ady Arie

Analogy of free-space quantum key distribution using spatial modes of light: scaling up the distance and the dimensionality

Applications: Optical Communication,Optical Computing / Quantum Optics
LC 2012 Spatial Light Modulators
Authors:Dayver Daza-Salgado, Edgar Medina-Segura, Valeria Rodriguez-Fajardo, Benjamin Perez-Garcia & Carmelo Rosales-Guzmán

A Higher-order poincaré ellipsoid representation for non-cylindrical vector beams

Applications: Higher Order Modes / Optical Vortex / OAM,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Carlos Vargas-Castrillón, Alejandro Velez-Zea, and John Fredy Barrera-Ramírez

Intensity equivalence between free-space propagation and a single-lens processor: application to adjustable magnification in hologram reconstruction

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhibing Liu, Siqing Zeng, Shuixian Yang, Yuetong Shi, Hongfei Chen, Yaoming Feng, Shecheng Gao, Jiajing Tu, Dawei Wang, Zhaojian Chen and Zhaohui Li

High-efficiency mode group demultiplexing based on diffractive optical network

Applications: Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ning Xu, Dalong Qi, Long Cheng, Zhen Pan, Chengyu Zhou, Wenzhang Lin, Hongmei Ma, Yunhua Yao, Yuecheng Shen, Lianzhong Deng, Zhenrong Sun, and Shian Zhang

Sparse point spread function-based multi-image optical encryption

Applications: Digital-/ Computer Holography/ CGH,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adolphe Ndagijimana, Iñigo Ederra and Miguel Heredia Conde

Single-Pixel Compressive Terahertz 3D Imaging

Applications: Complex Modulation,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shiyun Zhou, Lang Li, Liliang Gao, Zhiyuan Zhou, Jinyu Yang, Shurui Zhang, Tonglu Wang, Chunqing Gao, and Shiyao Fu

Hybrid strategy in compact tailoring of multiple degrees-of-freedom toward high-dimensional photonics

Applications: Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhi Wang, Peng Yi, Andong Wang, Taoyong Li, Wentao Chen, Xiaolin Qi and Xiaowei Li

Continuously adjustable hollow beam for ultrafast laser fabrication of size-controllable nanoparticles

Applications: Beam Shaping / Beam Steering,Higher Order Modes / Optical Vortex / OAM,Materials Processing / Optical Fabrication
LETO / LETO-3 Spatial Light Modulators
Authors:Augusto Arias, Susanna P. Clement, Pablo Artal and Siegfried Wahl

Chromatic imaging properties of myopia control spectacle lenses

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen

Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Microscopy,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
LETO / LETO-3 Spatial Light Modulators
Authors:Oliver J. Licht, Caleb Rohn and R. Krishna Mohan

Dynamically adjustable astigmatic transformations for OAM mode identification under atmospheric turbulence

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenjun Yi, Shuyue Zhu, Meicheng Fu, Nan Gu, Junli Qi, Siyu Liu, Mengjun Zhu, Ping Wang, Xin Chen, Yi Zhang, Hongyu Zhang, Yao Xu, Junyi Du, Peng Xiong, Zhaohua Dong, Luobing Dong, Qiong Liu and Xiujian Li

Relay-projection microscopic telescopy

Applications: Imaging/ Image Processing,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Allarakha Shikder, Naveen K. Nishchal

Image encryption using arbitrary modes of Hermite-Gaussian beams

Applications: Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing,Optical Computing / Quantum Optics