Computational 3D Imaging with Position Sensors

HES / HEO 6001 Spatial Light Modulators
Published on:
Authors: Jeremy Klotz, Mohit Gupta, Aswin C. Sankaranarayanan
Abstract:

Underlying many structured light systems, especially those based on laser scanning, is a simple vision task: tracking a light spot. To accomplish this, scanners use conventional CMOS sensors to capture, transmit, and process millions of pixel measurements. This approach, while capable of achieving high-fidelity 3D scans, is wasteful in terms of (often scarce) sensing and computational resources. We present a structured light system based on position sensing diodes (PSDs), an unconventional sensing modality that directly measures the centroid of the spatial distribution of incident light, thus enabling high-resolution 3D laser scanning with a minimal amount of sensor data. We develop theory and computational algorithms for PSD-based structured light under a variety of light transport effects. We demonstrate the benefits of the proposed techniques using a hardware prototype on several real-world scenes, including optically-challenging objects with long-range inter-reflections and scattering.

Open Access

Publication: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)
Issue/Year: (ICCV), 2023, pp. 8125-8134
Link: https://openaccess.thecvf.com/content/ICCV2023/html/Klotz_Computational_3D_Imaging_with_Position_Sensors_ICCV_2023_paper.html

Related Papers

GAEA Spatial Light Modulators
Authors: Zhongzheng Lin, Weihang Zhong, Lixun Wu, Lin He, Hongjia Chen, Jianqi Hu, Yujie Chen, Siyuan Yu

Azimuthal beam shaping in orbital angular momentum basis

Applications: Beam Shaping / Beam Steering,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nikhil Vangety, P.M. Pooja, Anirban Majee, Sourabh Roy

Learning-enabled recognition of LG beams from multimode fiber specklegrams

Applications: Higher Order Modes / Optical Vortex / OAM
GAEA Spatial Light Modulators
Authors:Han Gao, Haifeng Hu, and Qiwen Zhan

Generation and applications of spectral-spatially correlated principal mode in multimode fibers

Applications: Complex Modulation,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Yongqiang Chen, Chenggui Luo, Shiqi Wang, Yanping Li, Binglin Shen, Rui Hu, Junle Qu, Liwei Liu

Rapid, high-contrast, and steady volumetric imaging with Bessel-beam-based two-photon fluorescence microscopy

Applications: Microscopy
LC 2012 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Gabriel Cáceres-Aravena, Milica Nedić, Paloma Vildoso, Goran Gligorić, Jovana Petrovic, Rodrigo A. Vicencio, Aleksandra Maluckov

Observation of topologically protected compact edge states in flux-dressed graphene photonic lattices

Applications: Complex Modulation,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi Lu, Weichao Gong, Ying Sun, Weiwei Wang, Xu Zhang, Peili Wang, Yifan Ding, Wei Wang, Shijie Liu, Xiangchao Zhang, Min Xu, and Jianda Shao

Fast, intelligent and high-precision adaptive null interferometry for optical freeform surfaces by backpropagation

Applications: Adaptive Optics / Wavefront Control,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zejian Ren, Xu Yan, Kai Wen, Huijin Chen, Elnur Hajiyev, Chengdong He, Gyu-Boong Jo

Creation of a tweezer array for cold atoms utilizing a generative neural network

Applications: Deep Learning / Neuronal Network,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Claudio Conci, Laura Sironi, Emanuela Jacchetti, Davide Panzeri, Donato Inverso, Rebeca Martínez Vázquez, Roberto Osellame, Maddalena Collini, Giulio Cerullo, Giuseppe Chirico, Manuela Teresa Raimondi

In vivo label-free tissue histology through a microstructured imaging window

Applications: Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: Sebastian Cremaschini Sebastian Cremaschini Dipartimento di Fisica e Astronomia “G. Galilei”, Università di Padova, Via Marzolo 8, 35131 Padova, Italy More by Sebastian Cremaschini Orcidhttps://orcid.org/0000-0002-6416-5782 , Alberto Cattelan, Davide Ferraro, Daniele Filippi, Filippo Marinello, Alessio Meggiolaro, Matteo Pierno, Cinzia Sada, Annamaria Zaltron*, Paolo Umari*, and Giampaolo Mistura

Trifurcated Splitting of Water Droplets on Engineered Lithium Niobate Surfaces

Applications: Beam Shaping / Beam Steering,Optical Trapping /-Tweezers
LETO / LETO-3 Spatial Light Modulators
Authors: Siqing Dai, Andrei Kobitski, Amirhossein Barati Sedeh, Süheyla Eroğlu-Kayıkçı, Lennart Hilbert, and G. Ulrich Nienhaus

Photon-Efficient Aberration Correction for 3D-STED Imaging of Thick Biological Specimens Using Sensorless Adaptive Optics

Applications: Adaptive Optics / Wavefront Control,Beam Shaping / Beam Steering,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Olivier Emile and Janine Emile

Optical orbital angular momentum transfer to electronic currents

Applications: Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shoaib R. Soomro, Santiago Sager, Alba M. Paniagua-Diaz, Pedro M. Prieto, and Pablo Artal

Head-mounted adaptive optics visual simulator

Applications: Adaptive Optics / Wavefront Control
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiuru He, Pengwei Zhang, Jianpo Su, Junqiao Wang, Yongzhi Tian, Yongsheng Hu, and Fengying Ma

Edge enhancement in three-dimensional vortex imaging based on FINCH by Bessel-like spiral phase modulation

Applications: Imaging/ Image Processing
LETO / LETO-3 Spatial Light Modulators
Authors:Wenxue Zhang, Yuhong Wan, Tianlong Man, Hongqiang Zhou

Computational incoherent edge enhancement imaging based on self-interference digital holography

Applications: Imaging/ Image Processing
GAEA Spatial Light Modulators
Authors:Kaibo Yang, Hao Luo, Yidan Zhang, Peng Li, Feng Wen, Yuzong Gu, Zhenkun Wu

Modulating and identifying an arbitrary curvilinear phased optical vortex array of high-order orbital angular momentum

Applications: Complex Modulation,Higher Order Modes / Optical Vortex / OAM,Optical Communication
LETO / LETO-3 Spatial Light Modulators
Authors:Jian He, Wensong Dan, Xiang Zang, Yimin Zhou, Fei Wang, Yangjian Cai, Guoquan Zhou

How to select the dimensionless radius to realize the strongest abruptly autofocusing ability of circular Airyprime beams

Applications: Beam Shaping / Beam Steering,Bessel-/ Airy Beam Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jawahar Prabhakar Desai, Joseph Rosen

Resolution-enhanced imaging by interferenceless coded aperture correlation holography with two competing methods of phase mask synthesis

Applications: Microscopy
LC 2012 Spatial Light Modulators
Authors:Matsuda, Naoki; Tanida, Jun; Naruse, Makoto; Horisaki, Ryoichi

Noninvasive holographic imaging through dynamically scattering media

Applications: Turbid-/ Opaque Media /Multi Scattering
HES / HEO 6001 PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zicheng Huang, Ziyu Gu, Mengyang Shi, Yesheng Gao, and Xingzhao Liu

OP-FCNN: an optronic fully convolutional neural network for imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
LETO / LETO-3 Spatial Light Modulators
Authors:Yi-Min Zhou, Jian He, Wen-Song Dan, Fei Wang, Guo-Quan Zhou

An optimum design of a ring Airyprime beam array based on dimensionless eccentric position

Applications: Bessel-/ Airy Beam Generation,Complex Modulation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Dejin Zhang, Wei Sheng, Yaoyao Shi, and Youwen Liu

Imaging objects hidden inside the strongly scattering media based on bidirectional ghost imaging

Applications: Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
GAEA Spatial Light Modulators
Authors:Jesper Glückstad, Andreas Erik Gejl Madsen

HoloTile Light Engine: New Digital Holographic Modalities and Applications

Applications: Adaptive Optics / Wavefront Control,Beam Shaping / Beam Steering,Materials Processing / Optical Fabrication,Optical Communication,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Tianhong Wang, Viet Tran, Pascal Bassène, Edwin Fohtung, Trevor Rhone, and Moussa N’Gom

Adaptive methods of generating complex light arrays

Applications: Bessel-/ Airy Beam Generation,Complex Modulation,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Krishnendu Samanta, Anupriya Tiwari, Samsheerali P.T., Joby Joseph

Improving resolution in two orthogonal orientations from a single-shot digital holographic microscopy

Applications: Microscopy