Optical classification and reconstruction through multimode fibers

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network Optical Communication Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Kürekci, Şahin
Abstract:
“When a light beam travels through a highly scattering medium, two-dimensional random intensity distributions (speckle patterns) are formed due to the complex scattering within the medium. Although they contain valuable information about the input signal and the characteristics of the propagation medium, the speckle patterns are difficult to unscramble, which makes imaging through scattering media an extremely challenging task. Multimode fibers behave similarly to scattering media since they scramble the input information through modal dispersion and create speckle patterns at the distal end. Because multimode fibers are compact and low-cost structures with the ability to transmit large amounts of data simultaneously for long distances, decoding the speckle patterns formed by a multimode fiber and reconstructing the input information has great implications in a wide range of applications, including fiber optic communication, sensor technology, optical imaging, and invasive biomedical applications such as endoscopy. In this thesis, we decode the speckle patterns and reconstruct the input information on the proximal end of a multimode fiber in three different scenarios. Our choice of input signals consists of numbers encoded as binary digits, handwritten letters, and optical frequencies. We train a deep learning model to classify and reconstruct the handwritten letters, while for the rest of the cases, we construct a transmission matrix between the input signals and the output speckle patterns, and solve the inverse propagation equation algebraically. In all cases, the relation between a speckle pattern and the corresponding input signal is learned with low error rates; thus, the signals are classified and reconstructed successfully using the speckle patterns they created. Classifying digits, letters, or images with speckle information aims to build useful systems in optical imaging, communication, and cryptography, while the classification of optical frequencies paves the way for building novel spectrometers. In addition to replicating the currently existing compact, low-budget, and high-resolution multimode fiber spectrometer, we also build a single-pixel fiber spectrometer in order to increase the compactness on the detection side and expand the application areas of the system. The single-pixel spectrometer we offer is based on the integrated intensity measurements of a fixed target region, where the light is focused by shaping the wavefront with a spatial light modulator. Spatial light modulators and wavefront shaping techniques are also utilized in other classification tasks in this thesis to generate the desired input signals.”

Open Access

Publication: Middle East Technical University, Thesis
Issue/Year: Graduate School of Natural and Applied Sciences, Thesis, 2022
DOI: https://hdl.handle.net/11511/101287
Link: https://hdl.handle.net/11511/101287

Related Papers

GAEA / GAEA-2 Spatial Light Modulators
Authors:Ekaterina A. Savchenkova, Andrey S. Ovchinnikov, Vladislav G. Rodin, Rostislav S. Starikov, Nikolay N. Evtikhiev, Pavel A. Cheremkhin

Adaptive non-iterative histogram-based hologram quantization

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LC 2012 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiaosheng Li, Yifei Chen, Tianyun Liu, Bo Wu & Qinnan Zhang

Single-pixel Fresnel incoherent correlation holography compressed imaging using a Trumpet network

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LETO / LETO-3 Spatial Light Modulators
Authors:Yan Liu, Jianwei Qin, Yanbing Liu, Yuanan Liu, Xun Liu, Fangwei Ye, and Wei Li

Optical Fourier convolutional neural network with high efficiency in image classification

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kyriakos Skarsoulis, Konstantinos Makris, Christophe Moser, and Demetri Psaltis

Ptychographic imaging with a fiber endoscope via wavelength scanning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shile Yang, Yuecheng Shen, Jiawei Luo, Zhengyang Wang, Daixuan Wu, Jiaming Liang, Zhiling Zhang, Dalong Qi, Yunhua Yao, Lianzhong Deng, Bin Zhang, Zhenrong Sun, and Shian Zhang

Neural network enabled fringe projection through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Siyu Gao, Xiaoyun Liu, Yonghao Chen, Jinyang Jiang, Ying Liu, Tengfei Chai and Yueqiu Jiang

Oceanic turbulence parameters recognition based on convolutional neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Optical Communication
LETO / LETO-3 Spatial Light Modulators
Authors:Manu Gopakumar, Gun-Yeal Lee, Suyeon Choi, Brian Chao, Yifan Peng, Jonghyun Kim & Gordon Wetzstein

Full-colour 3D holographic augmented-reality displays with metasurface waveguides

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Dotan Halevi, Boaz Lubotzky, Kfir Sulimany, Eric G. Bowes, Jennifer A. Hollingsworth, Yaron Bromberg, Ronen Rapaport

High-dimensional quantum key distribution using orbital angular momentum of single photons from a colloidal quantum dot at room temperature

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Communication,Optical Computing / Quantum Optics
GAEA / GAEA-2 Spatial Light Modulators
Authors:Xiaofei Li, Xin Liu, Quanying Wu, Jun Zeng, Yangjian Cai, Sergey A. Ponomarenko, Chunhao Liang

Prime number factorization with light beams carrying orbital angular momentum

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:S. R. Thapa, S. Smith-Dryden, Z. Zhu, S. S. Pang and G. Li

Experimental Demonstration and Characterization of a Non-Mode Selective (De)Multiplexer Using Multi-Plane Light Converter (MPLC)

Applications: Optical Communication,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhipeng Yu, Huanhao Li, Wannian Zhao, Po-Sheng Huang, Yu-Tsung Lin, Jing Yao, Wenzhao Li, Qi Zhao, Pin Chieh Wu, Bo Li, Patrice Genevet, Qinghua Song & Puxiang Lai

High-security learning-based optical encryption assisted by disordered metasurface

Applications: Optical Communication,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Xiong, Xiangchao Zhang, Xinyang Ma, Leheng Li, Zhanghao Ni, and Xiangqian Jiang

Adaptive coded phase mask design and high-quality image reconstruction for interference-less coded aperture correlation holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
HES / HEO 6001 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Omri Wengrowicz, Alex Bronstein, and Oren Cohen

Unsupervised physics-informed deep learning-based reconstruction for time-resolved imaging by multiplexed ptychography

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pan, Tuqiang / Ye, Jianwei / Liu, Haotian / Zhang, Fan / Xu, Pengbai / Xu, Ou / Xu, Yi / Qin, Yuwen

Non-orthogonal optical multiplexing empowered by deep learning

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Communication
GAEA / GAEA-2 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Fang, Xinyuan / Hu, Xiaonan / Li, Baoli / Su, Hang / Cheng, Ke / Luan, Haitao / Gu, Min

Orbital angular momentum-mediated machine learning for high-accuracy mode-feature encoding

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
GAEA / GAEA-2 Spatial Light Modulators
Authors:Han Gao, Haifeng Hu, and Qiwen Zhan

Generation and applications of spectral-spatially correlated principal mode in multimode fibers

Applications: Complex Modulation,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zejian Ren, Xu Yan, Kai Wen, Huijin Chen, Elnur Hajiyev, Chengdong He, Gyu-Boong Jo

Creation of a tweezer array for cold atoms utilizing a generative neural network

Applications: Deep Learning / Neuronal Network,Optical Trapping /-Tweezers
GAEA / GAEA-2 Spatial Light Modulators
Authors:Kaibo Yang, Hao Luo, Yidan Zhang, Peng Li, Feng Wen, Yuzong Gu, Zhenkun Wu

Modulating and identifying an arbitrary curvilinear phased optical vortex array of high-order orbital angular momentum

Applications: Complex Modulation,Higher Order Modes / Optical Vortex / OAM,Optical Communication
LC 2012 Spatial Light Modulators
Authors:Matsuda, Naoki; Tanida, Jun; Naruse, Makoto; Horisaki, Ryoichi

Noninvasive holographic imaging through dynamically scattering media

Applications: Turbid-/ Opaque Media /Multi Scattering
HES / HEO 6001 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Ziyu Gu, Mengyang Shi, Yesheng Gao, and Xingzhao Liu

OP-FCNN: an optronic fully convolutional neural network for imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Dejin Zhang, Wei Sheng, Yaoyao Shi, and Youwen Liu

Imaging objects hidden inside the strongly scattering media based on bidirectional ghost imaging

Applications: Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 Spatial Light Modulators
Authors:Jesper Glückstad, Andreas Erik Gejl Madsen

HoloTile Light Engine: New Digital Holographic Modalities and Applications

Applications: Adaptive Optics / Wavefront Control,Beam Shaping / Beam Steering,Materials Processing / Optical Fabrication,Optical Communication,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Grace Kuo , Florian Schiffers , Douglas Lanman , Oliver Cossairt , Nathan Matsuda

Multisource Holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheyu Wu, Ran Gao, Sitong Zhou, Fei Wang, Zhipei Li, Huan Chang, Dong Guo, Xiangjun Xin, Qi Zhang, Feng Tian, Qiang Wu

Robust Super-Resolution Image Transmission Based on a Ring Core Fiber with Orbital Angular Momentum

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing