Optical classification and reconstruction through multimode fibers

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network Optical Communication Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Kürekci, Şahin
Abstract:
“When a light beam travels through a highly scattering medium, two-dimensional random intensity distributions (speckle patterns) are formed due to the complex scattering within the medium. Although they contain valuable information about the input signal and the characteristics of the propagation medium, the speckle patterns are difficult to unscramble, which makes imaging through scattering media an extremely challenging task. Multimode fibers behave similarly to scattering media since they scramble the input information through modal dispersion and create speckle patterns at the distal end. Because multimode fibers are compact and low-cost structures with the ability to transmit large amounts of data simultaneously for long distances, decoding the speckle patterns formed by a multimode fiber and reconstructing the input information has great implications in a wide range of applications, including fiber optic communication, sensor technology, optical imaging, and invasive biomedical applications such as endoscopy. In this thesis, we decode the speckle patterns and reconstruct the input information on the proximal end of a multimode fiber in three different scenarios. Our choice of input signals consists of numbers encoded as binary digits, handwritten letters, and optical frequencies. We train a deep learning model to classify and reconstruct the handwritten letters, while for the rest of the cases, we construct a transmission matrix between the input signals and the output speckle patterns, and solve the inverse propagation equation algebraically. In all cases, the relation between a speckle pattern and the corresponding input signal is learned with low error rates; thus, the signals are classified and reconstructed successfully using the speckle patterns they created. Classifying digits, letters, or images with speckle information aims to build useful systems in optical imaging, communication, and cryptography, while the classification of optical frequencies paves the way for building novel spectrometers. In addition to replicating the currently existing compact, low-budget, and high-resolution multimode fiber spectrometer, we also build a single-pixel fiber spectrometer in order to increase the compactness on the detection side and expand the application areas of the system. The single-pixel spectrometer we offer is based on the integrated intensity measurements of a fixed target region, where the light is focused by shaping the wavefront with a spatial light modulator. Spatial light modulators and wavefront shaping techniques are also utilized in other classification tasks in this thesis to generate the desired input signals.”

Open Access

Publication: Middle East Technical University, Thesis
Issue/Year: Graduate School of Natural and Applied Sciences, Thesis, 2022
DOI: https://hdl.handle.net/11511/101287
Link: https://hdl.handle.net/11511/101287

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kenneth Chen, Anzhou Wen, Yunxiang Zhang, Praneeth Chakravarthula and Qi Sun

View synthesis for 3D computer-generated holograms using deep neural fields

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Juan Sebastián Ramírez-Quintero, Andres Osorno-Quiroz, Walter Torres-Sepúlveda and Alejandro Mira-Agudelo

Experimental wavefront sensing techniques based on deep learning models using a Hartmann-Shack sensor for visual optics applications

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenqi Xu, Junmin Leng, Ping Dai and Chao Wang

DSCCNet for high-quality 4K computer-generated holograms

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen

Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Microscopy,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
LETO / LETO-3 Spatial Light Modulators
Authors:Oliver J. Licht, Caleb Rohn and R. Krishna Mohan

Dynamically adjustable astigmatic transformations for OAM mode identification under atmospheric turbulence

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Allarakha Shikder, Sudheesh K. Rajput, Naveen K. Nishcha, Osamu Matoba and Yasuhiro Awatsuji

Audio encryption using polarized light beam

Applications: Optical Communication,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pin-Hsun Lin, Paul Nowitzki, Eduard A. Jorswieck, Dennis Pohle and Juergen Czarske

Secret Key Generation Over Multi-Mode Fiber: Channel Measurements, Key Rate Analysis, and System Implementation

Applications: Complex Modulation,Optical Communication,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiukun Liao, Shijie Zhang, Yongtian Wang and Juan Liu

High-quality real-time 3D holographic display for real-world scenes based on the optimized layered angular spectrum method

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Suman Karan, Martin P. Van Exter and Anand K. Jha

Broadband uniform-efficiency OAM-mode detector

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Communication,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhiyuan Ye, Chen-Xin Ding, Jilun Zhao, Wanting Hou, Xue-Jiao Men, Yi Cui, Hong-Chao Liu, Hai-Bo Wang and Jun Xiong

Vortex memory effect of light for scattering-assisted massive data transmission

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiajia Wu, Xinkuo Li, Ke Sun, Kai Gao, Chenduan Chen, Jianrong Qiu and Dezhi Tan

Tight Focusing Holographic Network Enables 3D Real Time and Accurate Light Field Modulation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
LETO / LETO-3 Spatial Light Modulators
Authors:Ziyuan Liu, Jian He, Jiahao Chen, Hongfei Gao, Fei Wang, Yimin Zhou, Yangjian Cai, Ruipin Chen and Guoquan Zhou

Exploring the upper limit of the number of vortices loaded onto a ring Airyprime vortex beam array to achieve the strongest auto-focusing ability

Applications: Beam Shaping / Beam Steering,Bessel-/ Airy Beam Generation,Higher Order Modes / Optical Vortex / OAM,Optical Communication
LETO / LETO-3 Spatial Light Modulators
Authors:Siteng Li, Fei Wang, Zhenfeng Fu, Yaoming Bian and Guohai Situ

Dynamic quantitative phase imaging using deep spatial-temporal prior

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Bahadır Utku Kesgin and Uğur Teğin

Photonic neural networks at the edge of spatiotemporal chaos in multimode fibers

Applications: Deep Learning / Neuronal Network
LC-R 2500 Spatial Light Modulators
Authors:Jianyi Li, Qingfeng Liu, Liying Tan, Jing Ma and Nanxing Chen

Enhanced Neural Architecture for Real-Time Deep Learning Wavefront Sensing

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shurui Zhang, Rui Song, Zhichao Zhang, Lan Hai, Chunqing Gao and Shiyao Fu

A 1.6 µm dual-channel cylindrical vector laser enabling multi-state shift keying

Applications: Beam Shaping / Beam Steering,Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Mathilde Hary, Teemu Koivisto, Sara Lukasik, John M. Dudley and Goëry Genty

Spectral optimization of supercontinuum shaping using metaheuristic algorithms, a comparative study

Applications: Beam Shaping / Beam Steering,Optical Communication,Pulse Application / -Shaping
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi Jia, Bojian Shi, Yanxia Zhang, Hang Li, Xiaoxin Li, Rui Feng, Fangkui Sun, Yongyin Cao, Jian Wang, Cheng-Wei Qiu, Min Gu and Weiqiang Ding

Partially coherent diffractive optical neural network

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhenting Yan, Huiling Huang, Yili Chen, Hanfei Lin, Ebraheem Farea, Xingzhao Hua and Jun Han

Scattering imaging of moving targets based on recurrent neural networks: a fusion of temporal and phase information

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiwei Fang, Huadong Zheng, Xinxing Xia, Junchang Peng, Tengfei Zhang, Xingyu Lin and Yingjie Yu

Diffraction model-driven neural network with semi-supervised training strategy for real-world 3D holographic photography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Haifeng Qin, Chao Han, Xuan Shi, Tao Gu and Kangsheng Sun

Complex-valued generative adversarial network for real-time and high-quality computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Mengyang Shi, Jiahui Ma, Zhishun Guo, Yesheng Gao and Xingzhao Liu

Speckle-free self-supervised learning for scalable imaging through scattering media with unseen condition changes

Applications: Deep Learning / Neuronal Network,Misc.: Speckle / Characterization / Metrology,Turbid-/ Opaque Media /Multi Scattering
LETO / LETO-3 Spatial Light Modulators
Authors:Yiran Wei, Yiyun Chen, Mi Zhou, Mu Ku Chen, Shuming Jiao, Qinghua Song, Xiao-Ping Zhang and Zihan Geng

Speckle-free holography with a diffraction-aware global perceptual model

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wei Liu, Chuanfu Tu, Yawen Liu and Zhiwei Ye

Orbital angular momentum superimposed mode recognition based on multi-label image classification

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM