Photoacoustic-enabled automatic vascular navigation: accurate and naked-eye real-time visualization of deep-seated vessels

PLUTO / PLUTO-2 Spatial Light Modulators
AR/VR/MR / Holographic Display Digital-/ Computer Holography/ CGH
Published on:
Authors: Pan, Shu; Wang, Li; Ma, Yuanzheng; Zhang, Guangyu; Liu, Rui; Zhang, Tao; Xiong, Kedi; Chen, Siyu; Zhang, Jian; Li, Wende; Yang, Sihua
Abstract:

Accurate localization of blood vessels with image navigation is a key element in vascular-related medical research and vascular surgery. However, current vascular navigation techniques cannot provide naked-eye visualization of deep vascular information noninvasively and with high resolution, resulting in inaccurate vascular anatomy and diminished surgical success rates. Here, we introduce a photoacoustic-enabled automatic vascular navigation method combining photoacoustic computed tomography with augmented and mixed reality, for the first time, to our knowledge, enabling accurate and noninvasive visualization of the deep microvascular network within the tissues in real time on a real surgical surface. This approach achieves precise vascular localization accuracy (<0.89 mm) and tiny vascular relocation latency (<1 s) through a zero-mean normalization idea-based visual tracking algorithm and a curved surface-fitting algorithm. Further, the subcutaneous vessels of minimum diameter (∼0.15 mm) in rabbit thigh and the maximum depth (∼7 mm) in human arm can be vividly projected on the skin surface with a computer vision-based projection tracking system to simulate preoperative and intraoperative vascular localization. Thereby, this strategy provides a way to visualize deep vessels without damage on the surgical surface and with precise image navigation, opening an avenue for the application of photoacoustic imaging in surgical operations.

Open Access

Publication: Advanced Photonics Nexus
Issue/Year: Advanced Photonics Nexus, Vol. 2, Issue 4, 046001 (May 2023)
DOI: 10.1117/1.APN.2.4.046001
Link: https://doi.org/10.1117/1.APN.2.4.046001

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ethan Tseng, Grace Kuo, Seung-Hwan Baek, Nathan Matsuda, Andrew Maimone, Florian Schiffers, Praneeth Chakravarthula, Qiang Fu, Wolfgang Heidrich, Douglas Lanman & Felix Heide

Neural étendue expander for ultra-wide-angle high-fidelity holographic display

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing
GAEA / GAEA-2 Spatial Light Modulators
Authors:Xiaofei Li, Xin Liu, Quanying Wu, Jun Zeng, Yangjian Cai, Sergey A. Ponomarenko, Chunhao Liang

Prime number factorization with light beams carrying orbital angular momentum

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
GAEA / GAEA-2 Spatial Light Modulators
Authors:Rafal Kukolowicz, Tomasz Kozacki, Maksymilian Chlipala, Moncy Sajeev Idicula, Juan Martinez-Carranza, Weronika Finke, and Izabela Gerej

Digital holographic content manipulation for wide-angle holographic near-eye displays

Applications: AR/VR/MR / Holographic Display
LETO / LETO-3 Spatial Light Modulators
Authors:Chenliang Chang, Xian Ding, Di Wang, Zhizhou Ren, Bo Dai, Qi Wang, Songlin Zhuang, Dawei Zhang

Split Lohmann computer holography: fast generation of 3D hologram in single-step diffraction calculation

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Xiong, Xiangchao Zhang, Xinyang Ma, Leheng Li, Zhanghao Ni, and Xiangqian Jiang

Adaptive coded phase mask design and high-quality image reconstruction for interference-less coded aperture correlation holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LETO / LETO-3 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Myeong-Ho Choi, Kwang-Soo Shin, Jae-Hyeung Park

Foveated holographic near-eye display with geometric phase lens and camera feedback

Applications: AR/VR/MR / Holographic Display
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Claudio Conci, Laura Sironi, Emanuela Jacchetti, Davide Panzeri, Donato Inverso, Rebeca Martínez Vázquez, Roberto Osellame, Maddalena Collini, Giulio Cerullo, Giuseppe Chirico, Manuela Teresa Raimondi

In vivo label-free tissue histology through a microstructured imaging window

Applications: Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Koray Kavaklı , Liang Shi , Hakan Urey , Wojciech Matusik , Kaan Akşit

Multi-color Holograms Improve Brightness in Holographic Displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Eric Markley , Nathan Matsuda , Florian Schiffers , Oliver Cossairt , Grace Kuo

Simultaneous Color Computer Generated Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Grace Kuo , Florian Schiffers , Douglas Lanman , Oliver Cossairt , Nathan Matsuda

Multisource Holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors: Seung-Woo Nam , Youngjin Kim , Dongyeon Kim , Yoonchan Jeong

Depolarized Holography with Polarization-Multiplexing Metasurface

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Li, Yuan Tao, Jiawen Li, Dongdong Jin, Chen Xin, Shengyun Ji, Chaowei Wang, Yachao Zhang, Yanlei Hu, Dong Wu, Li Zhang, Jiaru Chu

Rapid fabrication of reconfigurable helical microswimmers with environmentally adaptive locomotion

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingwei Liu, Jing Chen, Bingsen Qiu, Yongtian Wang, and Juan Liu

DCPNet: a dual-channel parallel deep neural network for high quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yunping Qiu, Zisheng Wang, Zhe Weng, Zhi-Cheng Ren, Xi-Lin Wang, Jianping Ding, and Hui-Tian Wang

Single-shot measurement of the Jones matrix for anisotropic media using four-channel digital polarization holography

Applications: Digital-/ Computer Holography/ CGH,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: U. Ruiz and T. Cerda

Polarization sensitive security system

Applications: Digital-/ Computer Holography/ CGH,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xinxing Xia, Weisen Wang, Frank Guan, Furong Yang, Xinghua Shui, Huadong Zheng, Yingjie Yu, and Yifan Peng

Exploring angular-steering illumination-based eyebox expansion for holographic displays

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Huadong Zheng, Zhen Wang, Junchang Peng, Xinxing Xia, Yingjie Yu

Multiplane full-color phase-only holograms generation based on iterative algorithm with a modified amplitude constraint

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Andreas Georgiou, Jia Jia, Charlie Hewitt, Changwon Jang, Jacob Hadnett-Hunter, Jinsoo Jeong, Joel Kollin

A holographic near-eye display with glass form factor and spectacle-free operation

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LUNA Spatial Light Modulators
Authors:Michael Flachhuber, Johannes Scheuchenpflug, Thomas Hilbert, Norbert Danz, Peter Schreiber, Leo M. Wilhelm, Markus Metz, Jean-Christope Olaya, Tobias Reusch

MaMeK: a wide-angle dynamic holographic projection system for human-vehicle communication

Applications: Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Yingsi Qin, Wei-Yu Chen, Matthew O’Toole, Aswin C. Sankaranarayanan

Split-Lohmann Multifocal Displays

Applications: AR/VR/MR / Holographic Display,Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chen Xin, Zhongguo Ren, Leran Zhang, Liang Yang, Dawei Wang, Yanlei Hu, Jiawen Li, Jiaru Chu, Li Zhang & Dong Wu

Light-triggered multi-joint microactuator fabricated by two-in-one femtosecond laser writing

Applications: Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingyang Fu, Yaping Zhang, Bing Zhang, Wenlong Qin, Xianfeng Gu, and Ting-Chung Poon

Efficient rendering by parallelogram-approximation for full analytical polygon-based computer-generated holography using planar texture mapping

Applications: Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Ninghe Liu, Zhengzhong Huang, Zehao He, and Liangcai Cao

DGE-CNN: 2D-to-3D holographic display based on a depth gradient extracting module and ZCNN network

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhu, Jialong / Zou, Fucheng / Wang, Le / Lu, Xiaodong / Zhao, Shengmei

Multiplexing Perfect Optical Vortex for Holographic Data Storage

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM