Ptychographic imaging with a fiber endoscope via wavelength scanning

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network Imaging/ Image Processing
Published on:
Authors: Kyriakos Skarsoulis, Konstantinos Makris, Christophe Moser, and Demetri Psaltis
Abstract:

Ptychography has become a popular computational imaging method for microscopy in recent years. In the present work we employ a wavelength scanning ptychography technique enhanced by neural networks for imaging with a fiber endoscope. Illumination of the object at various wavelengths is achieved using a single mode fiber, while a multicore fiber collects diffracted light from a distance. Using a U-Net multilayer convolutional neural network, the diffraction pattern is recovered at the far end of the multicore fiber from the recorded intensity pattern at the proximal end. With the recovered diffraction pattern in place, the phase object can be reconstructed using the ptychography algorithm. The quality of the object reconstruction improves with the number of wavelengths used. Comparison with an end-to-end neural network highlights the effectiveness and practicality of this two-step hybrid system. This alternative and simplified ptychographic endoscopy setup delivers noticeable improvements through neural networks and wavelength scanning.

Open Access

Publication: Optica
Issue/Year: Optica 11, 782-790 (2024)
DOI: 10.1364/OPTICA.519965
Link: https://doi.org/10.1364/OPTICA.519965

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kenneth Chen, Anzhou Wen, Yunxiang Zhang, Praneeth Chakravarthula and Qi Sun

View synthesis for 3D computer-generated holograms using deep neural fields

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adolphe Ndagijimana, Iñigo Ederra and Miguel Heredia Conde

Single-Pixel Compressive Terahertz 3D Imaging

Applications: Complex Modulation,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Juan Sebastián Ramírez-Quintero, Andres Osorno-Quiroz, Walter Torres-Sepúlveda and Alejandro Mira-Agudelo

Experimental wavefront sensing techniques based on deep learning models using a Hartmann-Shack sensor for visual optics applications

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
LETO / LETO-3 Spatial Light Modulators
Authors:Augusto Arias, Susanna P. Clement, Pablo Artal and Siegfried Wahl

Chromatic imaging properties of myopia control spectacle lenses

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenqi Xu, Junmin Leng, Ping Dai and Chao Wang

DSCCNet for high-quality 4K computer-generated holograms

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen

Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Microscopy,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenjun Yi, Shuyue Zhu, Meicheng Fu, Nan Gu, Junli Qi, Siyu Liu, Mengjun Zhu, Ping Wang, Xin Chen, Yi Zhang, Hongyu Zhang, Yao Xu, Junyi Du, Peng Xiong, Zhaohua Dong, Luobing Dong, Qiong Liu and Xiujian Li

Relay-projection microscopic telescopy

Applications: Imaging/ Image Processing,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Allarakha Shikder, Naveen K. Nishchal

Image encryption using arbitrary modes of Hermite-Gaussian beams

Applications: Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiukun Liao, Shijie Zhang, Yongtian Wang and Juan Liu

High-quality real-time 3D holographic display for real-world scenes based on the optimized layered angular spectrum method

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jawahar Prabhakar Desai, Vijayakumar Anand and Joseph Rosen

Multiple Incoherent Deconvolutions for Improving the Image Resolution of Diffraction-Limited Imaging Systems

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiajia Wu, Xinkuo Li, Ke Sun, Kai Gao, Chenduan Chen, Jianrong Qiu and Dezhi Tan

Tight Focusing Holographic Network Enables 3D Real Time and Accurate Light Field Modulation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
LETO / LETO-3 Spatial Light Modulators
Authors:Siteng Li, Fei Wang, Zhenfeng Fu, Yaoming Bian and Guohai Situ

Dynamic quantitative phase imaging using deep spatial-temporal prior

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Bahadır Utku Kesgin and Uğur Teğin

Photonic neural networks at the edge of spatiotemporal chaos in multimode fibers

Applications: Deep Learning / Neuronal Network
LC-R 720 Spatial Light Modulators
Authors:Xuan Liu, Rupak Bhakta, Emily Kryvorutsky and Yuanwei Zhang

Imaging cells and nanoparticles using modulated optically computed phase microscopy

Applications: Imaging/ Image Processing
LC-R 2500 Spatial Light Modulators
Authors:Jianyi Li, Qingfeng Liu, Liying Tan, Jing Ma and Nanxing Chen

Enhanced Neural Architecture for Real-Time Deep Learning Wavefront Sensing

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi Jia, Bojian Shi, Yanxia Zhang, Hang Li, Xiaoxin Li, Rui Feng, Fangkui Sun, Yongyin Cao, Jian Wang, Cheng-Wei Qiu, Min Gu and Weiqiang Ding

Partially coherent diffractive optical neural network

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhenting Yan, Huiling Huang, Yili Chen, Hanfei Lin, Ebraheem Farea, Xingzhao Hua and Jun Han

Scattering imaging of moving targets based on recurrent neural networks: a fusion of temporal and phase information

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
LC 2002 Spatial Light Modulators
Authors:Jyoti Bikash Mohapatra, Naveen K. Nishchal and Jyothish Monikantan

Object Recognition in Foggy and Hazy Conditions Using Dark Channel Prior-Based Fringe-Adjusted Joint Transform Correlator

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiwei Fang, Huadong Zheng, Xinxing Xia, Junchang Peng, Tengfei Zhang, Xingyu Lin and Yingjie Yu

Diffraction model-driven neural network with semi-supervised training strategy for real-world 3D holographic photography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Sara Aissati, Tianlun Zou, Sabyasachi Goswami, Len Zheleznyak, Susana Marcos

Visual Quality and Accommodation With Novel Optical Designs for Myopia Control

Applications: Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
LETO / LETO-3 Spatial Light Modulators
Authors:Haifeng Qin, Chao Han, Xuan Shi, Tao Gu and Kangsheng Sun

Complex-valued generative adversarial network for real-time and high-quality computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Mengyang Shi, Jiahui Ma, Zhishun Guo, Yesheng Gao and Xingzhao Liu

Speckle-free self-supervised learning for scalable imaging through scattering media with unseen condition changes

Applications: Deep Learning / Neuronal Network,Misc.: Speckle / Characterization / Metrology,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:R. Gottschalk, A. Lindinger

Interference patterns of two-photon excited fluorescence by spatial beam shaping

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing,Microscopy
LETO / LETO-3 Spatial Light Modulators
Authors:Yiran Wei, Yiyun Chen, Mi Zhou, Mu Ku Chen, Shuming Jiao, Qinghua Song, Xiao-Ping Zhang and Zihan Geng

Speckle-free holography with a diffraction-aware global perceptual model

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH