Photoacoustic-enabled automatic vascular navigation: accurate and naked-eye real-time visualization of deep-seated vessels

PLUTO / PLUTO-2 Spatial Light Modulators
AR/VR/MR / Holographic Display Digital-/ Computer Holography/ CGH
Published on:
Authors: Pan, Shu; Wang, Li; Ma, Yuanzheng; Zhang, Guangyu; Liu, Rui; Zhang, Tao; Xiong, Kedi; Chen, Siyu; Zhang, Jian; Li, Wende; Yang, Sihua
Abstract:

Accurate localization of blood vessels with image navigation is a key element in vascular-related medical research and vascular surgery. However, current vascular navigation techniques cannot provide naked-eye visualization of deep vascular information noninvasively and with high resolution, resulting in inaccurate vascular anatomy and diminished surgical success rates. Here, we introduce a photoacoustic-enabled automatic vascular navigation method combining photoacoustic computed tomography with augmented and mixed reality, for the first time, to our knowledge, enabling accurate and noninvasive visualization of the deep microvascular network within the tissues in real time on a real surgical surface. This approach achieves precise vascular localization accuracy (<0.89 mm) and tiny vascular relocation latency (<1 s) through a zero-mean normalization idea-based visual tracking algorithm and a curved surface-fitting algorithm. Further, the subcutaneous vessels of minimum diameter (∼0.15 mm) in rabbit thigh and the maximum depth (∼7 mm) in human arm can be vividly projected on the skin surface with a computer vision-based projection tracking system to simulate preoperative and intraoperative vascular localization. Thereby, this strategy provides a way to visualize deep vessels without damage on the surgical surface and with precise image navigation, opening an avenue for the application of photoacoustic imaging in surgical operations.

Open Access

Publication: Advanced Photonics Nexus
Issue/Year: Advanced Photonics Nexus, Vol. 2, Issue 4, 046001 (May 2023)
DOI: 10.1117/1.APN.2.4.046001
Link: https://doi.org/10.1117/1.APN.2.4.046001

Related Papers

LC 2012 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiaosheng Li, Yifei Chen, Tianyun Liu, Bo Wu & Qinnan Zhang

Single-pixel Fresnel incoherent correlation holography compressed imaging using a Trumpet network

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LETO / LETO-3 Spatial Light Modulators
Authors: Lukas T. Hiller, Jörg Wallaschek

Lensless projection of automotive light distributions using an advanced printer for volume holographic optical elements

Applications: Adaptive Optics / Wavefront Control,AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: I Komang Januariyasa, Francesco Reda, Fabio Borbone, Marcella Salvatore and Stefano L. Oscurato

Molding three-dimensional azopolymer microstructures with holographically structured light

Applications: Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
ERIS Spatial Light Modulators
Authors:Sumit Kumar Singh, Kenji Kinashi, Naoto Tsutsumi, Wataru Sakai, and Boaz Jessie Jackin

High-density polarization multiplexed holograms using azo-carbazole films for diverse applications

Applications: Digital-/ Computer Holography/ CGH,Polarization Generation
LETO / LETO-3 Spatial Light Modulators
Authors:Manu Gopakumar, Gun-Yeal Lee, Suyeon Choi, Brian Chao, Yifan Peng, Jonghyun Kim & Gordon Wetzstein

Full-colour 3D holographic augmented-reality displays with metasurface waveguides

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ethan Tseng, Grace Kuo, Seung-Hwan Baek, Nathan Matsuda, Andrew Maimone, Florian Schiffers, Praneeth Chakravarthula, Qiang Fu, Wolfgang Heidrich, Douglas Lanman & Felix Heide

Neural étendue expander for ultra-wide-angle high-fidelity holographic display

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing
GAEA / GAEA-2 Spatial Light Modulators
Authors:Xiaofei Li, Xin Liu, Quanying Wu, Jun Zeng, Yangjian Cai, Sergey A. Ponomarenko, Chunhao Liang

Prime number factorization with light beams carrying orbital angular momentum

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
GAEA / GAEA-2 Spatial Light Modulators
Authors:Rafal Kukolowicz, Tomasz Kozacki, Maksymilian Chlipala, Moncy Sajeev Idicula, Juan Martinez-Carranza, Weronika Finke, and Izabela Gerej

Digital holographic content manipulation for wide-angle holographic near-eye displays

Applications: AR/VR/MR / Holographic Display
LETO / LETO-3 Spatial Light Modulators
Authors:Chenliang Chang, Xian Ding, Di Wang, Zhizhou Ren, Bo Dai, Qi Wang, Songlin Zhuang, Dawei Zhang

Split Lohmann computer holography: fast generation of 3D hologram in single-step diffraction calculation

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Xiong, Xiangchao Zhang, Xinyang Ma, Leheng Li, Zhanghao Ni, and Xiangqian Jiang

Adaptive coded phase mask design and high-quality image reconstruction for interference-less coded aperture correlation holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ming Liu, Bing Dong

Principle and application of holographic modal wavefront sensor for extended objects and general aberration modes

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH
LETO / LETO-3 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Myeong-Ho Choi, Kwang-Soo Shin, Jae-Hyeung Park

Foveated holographic near-eye display with geometric phase lens and camera feedback

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Claudio Conci, Laura Sironi, Emanuela Jacchetti, Davide Panzeri, Donato Inverso, Rebeca Martínez Vázquez, Roberto Osellame, Maddalena Collini, Giulio Cerullo, Giuseppe Chirico, Manuela Teresa Raimondi

In vivo label-free tissue histology through a microstructured imaging window

Applications: Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Koray Kavaklı , Liang Shi , Hakan Urey , Wojciech Matusik , Kaan Akşit

Multi-color Holograms Improve Brightness in Holographic Displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Eric Markley , Nathan Matsuda , Florian Schiffers , Oliver Cossairt , Grace Kuo

Simultaneous Color Computer Generated Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Grace Kuo , Florian Schiffers , Douglas Lanman , Oliver Cossairt , Nathan Matsuda

Multisource Holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors: Seung-Woo Nam , Youngjin Kim , Dongyeon Kim , Yoonchan Jeong

Depolarized Holography with Polarization-Multiplexing Metasurface

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Li, Yuan Tao, Jiawen Li, Dongdong Jin, Chen Xin, Shengyun Ji, Chaowei Wang, Yachao Zhang, Yanlei Hu, Dong Wu, Li Zhang, Jiaru Chu

Rapid fabrication of reconfigurable helical microswimmers with environmentally adaptive locomotion

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingwei Liu, Jing Chen, Bingsen Qiu, Yongtian Wang, and Juan Liu

DCPNet: a dual-channel parallel deep neural network for high quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yunping Qiu, Zisheng Wang, Zhe Weng, Zhi-Cheng Ren, Xi-Lin Wang, Jianping Ding, and Hui-Tian Wang

Single-shot measurement of the Jones matrix for anisotropic media using four-channel digital polarization holography

Applications: Digital-/ Computer Holography/ CGH,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: U. Ruiz and T. Cerda

Polarization sensitive security system

Applications: Digital-/ Computer Holography/ CGH,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xinxing Xia, Weisen Wang, Frank Guan, Furong Yang, Xinghua Shui, Huadong Zheng, Yingjie Yu, and Yifan Peng

Exploring angular-steering illumination-based eyebox expansion for holographic displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Huadong Zheng, Zhen Wang, Junchang Peng, Xinxing Xia, Yingjie Yu

Multiplane full-color phase-only holograms generation based on iterative algorithm with a modified amplitude constraint

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Andreas Georgiou, Jia Jia, Charlie Hewitt, Changwon Jang, Jacob Hadnett-Hunter, Jinsoo Jeong, Joel Kollin

A holographic near-eye display with glass form factor and spectacle-free operation

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH