Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

PLUTO / PLUTO-2 Spatial Light Modulators
Adaptive Optics / Wavefront Control Deep Learning / Neuronal Network Digital-/ Computer Holography/ CGH Imaging/ Image Processing Microscopy Misc.: Speckle / Characterization / Metrology Phase Measurement / Phase Retrieval Polarization Generation Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen
Abstract:

Imaging technologies based on vector optical fields hold significant potential in the biomedical field, particularly for non-invasive scattering imaging of anisotropic biological tissues. However, the dynamic and anisotropic nature of biological tissues poses severe challenges to the propagation and reconstruction of vector optical fields due to light scattering. To address this, we propose a deep learning-based polarization-resolved restoration method aimed at achieving the efficient and accurate imaging reconstruction from speckle patterns generated after passing through anisotropic and dynamic time-varying biological scattering media. By innovatively leveraging the two orthogonal polarization components of vector optical fields, our approach significantly enhances the robustness of imaging reconstruction in dynamic and anisotropic biological scattering media, benefiting from the additional information dimension of vectorial optical fields and the powerful learning capacity of a deep neural network. For the first time, a hybrid network model is designed that integrates convolutional neural networks (CNN) with a Transformer architecture for capturing local and global features of a speckle image, enabling adaptive vectorial restoration of dynamically time-varying speckle patterns. The experimental results demonstrate that the model exhibits excellent robustness and generalization capabilities in reconstructing the two orthogonal polarization components from dynamic speckle patterns behind anisotropic biological media. This study not only provides an efficient solution for scattering imaging of dynamic anisotropic biological tissues but also advances the application of vector optical fields in dynamic scattering environments through the integration of deep learning and optical technologies.

Open Access

Publication: Sensors: Computational Optical Sensing and Imaging
Issue/Year: Sensors 2025, 25(6), 1803
DOI: 10.3390/s25061803
Link: https://doi.org/10.3390/s25061803

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ping Wang, Meiling Zhou, Runze Li, Tong Peng, Yuan Zhou, Dan Dan, Junwei Min, Cuiping Yao, and Baoli Yao

Non-invasive fluorescence imaging through scattering media via variance-guided wavefront shaping and convex optimization-based deconvolution

Applications: Beam Shaping / Beam Steering,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yuanhao Bao, Yuanyuan Liu, Yingying Wang, Shixun Dai, and Qiwen Zhan

Real-time compensatory mode control within few-mode fibers based on adaptive spatial light modulation

Applications: Adaptive Optics / Wavefront Control,Optical Communication,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Marius Constantin Chirita Mihaila, Petr Koutenský, Kamila Moriová, and Martin Kozák

Light-based electron aberration corrector

Applications: Adaptive Optics / Wavefront Control,Higher Order Modes / Optical Vortex / OAM,Microscopy,Pulse Application / -Shaping
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adriana R. Sánchez-Montes, Adrián Moya, Eva M. Calzado, Francisco J. Martínez-Guardiola, Andrés Márquez, Jorge Francés, Inmaculada Pascual, and Augusto Beléndez

Two-dimensional full-Stokes characterization of parallel-aligned liquid crystal on silicon spatial light modulators

Applications: Polarization Generation
ERIS Spatial Light Modulators
Authors:Ying Zhao, Hao Wang, Dan Li, Ping Yan, and Qirong Xiao

In-situ forward sparse training of large-scale optical neural networks

Applications: Deep Learning / Neuronal Network,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jun Zeng, Ruyi Li, Zhao Zhang, Dong Xu, Bernhard J. Hoenders, Fei Wang, Haiyun Wang, Yangjian Cai, and Hui Zhang

Partially coherent persistent hollow beams enabled by cross-phase modulation

Applications: Higher Order Modes / Optical Vortex / OAM,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qian Zhang, Yu Miao, Jiali Sun, Yuan Sui, Stefan Rothe, and Juergen W. Czarske

Digital design of mode decomposition systems for multimode fibers using physics-informed neural network

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chenliang Chang, Chenzhou Zhao, Bo Dai, Qi Wang, Dawei Zhang, Songlin Zhuang, and Chao Ping Chen

Memory-Reduced Convolutional Neural Network for Fast Phase Hologram Generation

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ziang Xiao, Yuhan Gong, Pengxiang Wang, Yixun Huang, Mian Wu, Lin Wu, Chao Yang, Bertrand Kibler, Arnaud Mussot, Jin Tao, and Gang Xu

Enhancement of Free-Space Optical Communication with Structured Frequency Combs

Applications: Beam Shaping / Beam Steering,Higher Order Modes / Optical Vortex / OAM,Optical Communication,Telecom / Optical Switching / WSS,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Chuxuan Huang, Yue Huang, and Manhua Liu

NeuHolo: non-interferometric quantitative single-shot holographic imaging for 3D metrology using neural fields

Applications: Deep Learning / Neuronal Network,Phase Measurement / Phase Retrieval
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yuta Goto, Satoshi Shinada, Atsushi Okamoto, Naoya Wada, and Hideaki Furukawa

Compact-size and high mode-scalability spatial-mode multiplexer using multiplexed volume holograms

Applications: Digital-/ Computer Holography/ CGH,Optical Communication,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Likai Cheng, Jianming Gao, Banlian Xu, Leihong Zhang, and Dawei Zhang

Computational ghost imaging of atmospheric turbulence based on a single variable convolution kernel

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jeong-Geun Yun, Hyunjung Kang, Kyookeun Lee, Youngmo Jeong, Eunji Lee, Joohoon Kim, Minseok Choi, Bonkon Koo, Doyoun Kim, Jongchul Choi, and Junsuk Rho

Compact eye camera with two-third wavelength phase-delay metalens

Applications: Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Suyeon Choi, Changwon Jang, Douglas Lanman & Gordon Wetzstein

Synthetic aperture waveguide holography for compact mixed-reality displays with large étendue

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xing Li, Dan Dan, Siarhei Zavatski, Wenyu Gao, Qiang Zhang, Yuan Zhou, Jia Qian, Yanlong Yang, Xianghua Yu, Shaohui Yan, Xiaohao Xu, Olivier J. F. Martin, and Baoli Yao

Optical tweeze-sectioning microscopy for 3D imaging and manipulation of suspended cells

Applications: Digital-/ Computer Holography/ CGH,Microscopy,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yangjun Li, Hangyu Zhang, Chenzhe Jiang, Leihong Zhang, and Dawei Zhang

Computational ghost imaging for atmospheric turbulence using model-driven and data-driven deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Kyosik Min, Myeong-Ho Choi, and Jae-Hyeung Park

Quality enhancement of computer-generated hologram without contents-dependent optimization by considering aberrations in the optical system

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Imaging/ Image Processing
LC-R 720 Spatial Light Modulators
Authors:Don Bonifacio, Laterriean M. Minaya, Xuemei Chen, Yuanwei Zhang, and Xuan Liu

Phase-augmented deep learning for cell segmentation in wrapped quantitative phase images

Applications: Deep Learning / Neuronal Network
LETO / LETO-3 Spatial Light Modulators
Authors:Zheng Yuan, Yuan Gao, Wenxiang Yan, Zhiming Qing, Zhi-Cheng Ren, Xi-Lin Wang, Jianping Ding, and Hui-Tian Wang

Spin-engineered 3D optical manipulation via polarization-gradient architecturing

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Trapping /-Tweezers,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngbin Na and Do-Kyeong Ko

Tailoring orbital angular momentum entanglement through inverse design based on gradient descent

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Computing / Quantum Optics
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Tobias Wilm, Reinhold Fiess, and Ulrich Seger

In-situ automotive camera calibration using holographic resolution targets

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Materials Processing / Optical Fabrication,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nima Asoudegi and Mo Mojahedi

Orbital Angular Momentum Holography Using Neural Network and Camera in the Loop

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication
LUNA Spatial Light Modulators
Authors:Xiangrui Duan and Zichun Le

Inter-layer edge supplementation in computer-generated multi-depth 3D holograms

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngrok Kim, Dong-Woo Seo, Chihyun In and Sung-Wook Min

Phase-assisted camera-in-the-loop hologram optimization with Fourier aperture function constraint

Applications: Digital-/ Computer Holography/ CGH