Ptychographic imaging with a fiber endoscope via wavelength scanning

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network Imaging/ Image Processing
Published on:
Authors: Kyriakos Skarsoulis, Konstantinos Makris, Christophe Moser, and Demetri Psaltis
Abstract:

Ptychography has become a popular computational imaging method for microscopy in recent years. In the present work we employ a wavelength scanning ptychography technique enhanced by neural networks for imaging with a fiber endoscope. Illumination of the object at various wavelengths is achieved using a single mode fiber, while a multicore fiber collects diffracted light from a distance. Using a U-Net multilayer convolutional neural network, the diffraction pattern is recovered at the far end of the multicore fiber from the recorded intensity pattern at the proximal end. With the recovered diffraction pattern in place, the phase object can be reconstructed using the ptychography algorithm. The quality of the object reconstruction improves with the number of wavelengths used. Comparison with an end-to-end neural network highlights the effectiveness and practicality of this two-step hybrid system. This alternative and simplified ptychographic endoscopy setup delivers noticeable improvements through neural networks and wavelength scanning.

Open Access

Publication: Optica
Issue/Year: Optica 11, 782-790 (2024)
DOI: 10.1364/OPTICA.519965
Link: https://doi.org/10.1364/OPTICA.519965

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ping Wang, Meiling Zhou, Runze Li, Tong Peng, Yuan Zhou, Dan Dan, Junwei Min, Cuiping Yao, and Baoli Yao

Non-invasive fluorescence imaging through scattering media via variance-guided wavefront shaping and convex optimization-based deconvolution

Applications: Beam Shaping / Beam Steering,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
ERIS Spatial Light Modulators
Authors:Ying Zhao, Hao Wang, Dan Li, Ping Yan, and Qirong Xiao

In-situ forward sparse training of large-scale optical neural networks

Applications: Deep Learning / Neuronal Network,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qian Zhang, Yu Miao, Jiali Sun, Yuan Sui, Stefan Rothe, and Juergen W. Czarske

Digital design of mode decomposition systems for multimode fibers using physics-informed neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chenliang Chang, Chenzhou Zhao, Bo Dai, Qi Wang, Dawei Zhang, Songlin Zhuang, and Chao Ping Chen

Memory-Reduced Convolutional Neural Network for Fast Phase Hologram Generation

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Chuxuan Huang, Yue Huang, and Manhua Liu

NeuHolo: non-interferometric quantitative single-shot holographic imaging for 3D metrology using neural fields

Applications: Deep Learning / Neuronal Network,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Likai Cheng, Jianming Gao, Banlian Xu, Leihong Zhang, and Dawei Zhang

Computational ghost imaging of atmospheric turbulence based on a single variable convolution kernel

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jeong-Geun Yun, Hyunjung Kang, Kyookeun Lee, Youngmo Jeong, Eunji Lee, Joohoon Kim, Minseok Choi, Bonkon Koo, Doyoun Kim, Jongchul Choi, and Junsuk Rho

Compact eye camera with two-third wavelength phase-delay metalens

Applications: Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Hangyu Zhang, Chenzhe Jiang, Leihong Zhang, and Dawei Zhang

Computational ghost imaging for atmospheric turbulence using model-driven and data-driven deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Kyosik Min, Myeong-Ho Choi, and Jae-Hyeung Park

Quality enhancement of computer-generated hologram without contents-dependent optimization by considering aberrations in the optical system

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Imaging/ Image Processing
LC-R 720 Spatial Light Modulators
Authors:Don Bonifacio, Laterriean M. Minaya, Xuemei Chen, Yuanwei Zhang, and Xuan Liu

Phase-augmented deep learning for cell segmentation in wrapped quantitative phase images

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngbin Na and Do-Kyeong Ko

Tailoring orbital angular momentum entanglement through inverse design based on gradient descent

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Computing / Quantum Optics
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Tobias Wilm, Reinhold Fiess, and Ulrich Seger

In-situ automotive camera calibration using holographic resolution targets

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Materials Processing / Optical Fabrication,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nima Asoudegi and Mo Mojahedi

Orbital Angular Momentum Holography Using Neural Network and Camera in the Loop

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Carlos Vargas-Castrillón, Alejandro Velez-Zea, and John Fredy Barrera-Ramírez

Intensity equivalence between free-space propagation and a single-lens processor: application to adjustable magnification in hologram reconstruction

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kenneth Chen, Anzhou Wen, Yunxiang Zhang, Praneeth Chakravarthula and Qi Sun

View synthesis for 3D computer-generated holograms using deep neural fields

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adolphe Ndagijimana, Iñigo Ederra and Miguel Heredia Conde

Single-Pixel Compressive Terahertz 3D Imaging

Applications: Complex Modulation,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Juan Sebastián Ramírez-Quintero, Andres Osorno-Quiroz, Walter Torres-Sepúlveda and Alejandro Mira-Agudelo

Experimental wavefront sensing techniques based on deep learning models using a Hartmann-Shack sensor for visual optics applications

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
LETO / LETO-3 Spatial Light Modulators
Authors:Augusto Arias, Susanna P. Clement, Pablo Artal and Siegfried Wahl

Chromatic imaging properties of myopia control spectacle lenses

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Zhenqi Xu, Junmin Leng, Ping Dai and Chao Wang

DSCCNet for high-quality 4K computer-generated holograms

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen

Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Microscopy,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenjun Yi, Shuyue Zhu, Meicheng Fu, Nan Gu, Junli Qi, Siyu Liu, Mengjun Zhu, Ping Wang, Xin Chen, Yi Zhang, Hongyu Zhang, Yao Xu, Junyi Du, Peng Xiong, Zhaohua Dong, Luobing Dong, Qiong Liu and Xiujian Li

Relay-projection microscopic telescopy

Applications: Imaging/ Image Processing,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Allarakha Shikder, Naveen K. Nishchal

Image encryption using arbitrary modes of Hermite-Gaussian beams

Applications: Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiukun Liao, Shijie Zhang, Yongtian Wang and Juan Liu

High-quality real-time 3D holographic display for real-world scenes based on the optimized layered angular spectrum method

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jawahar Prabhakar Desai, Vijayakumar Anand and Joseph Rosen

Multiple Incoherent Deconvolutions for Improving the Image Resolution of Diffraction-Limited Imaging Systems

Applications: Imaging/ Image Processing