Quantitative phase imaging through an ultra-thin lensless fiber endoscope

Jiawei Sun; Jiachen Wu; Song Wu; Ruchi Goswami; Salvatore Girardo; Liangcai Cao; Jochen Guck; Nektarios Koukourakis; Juergen W. Czarske

doi:10.1038/s41377-022-00898-2

Go to Nature Website

Your Location：

Home >

Browse articles >

Quantitative phase imaging through an ultra-thin lensless fiber endoscope

Original Articles

- Quantitative phase imaging through an ultra-thin lensless fiber endoscope
- Quantitative phase imaging through an ultra-thin lensless fiber endoscope
- Light: Science & Applications 2022年11卷第8期页码：1843-1852
- Affiliations：
  
  1.Laboratory of Measurement and Sensor System Technique (MST), TU Dresden, Helmholtzstrasse 18, 01069, Dresden, Germany
  2.Competence Center for Biomedical Computational Laser Systems (BIOLAS), TU Dresden, Dresden, Germany
  3.State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instruments, Tsinghua University, 100084, Beijing, China
  4.Institute for Integrative Nanosciences, IFW Dresden, Helmholtzstraße 20, 01069, Dresden, Germany
  5.Max Planck Institute for the Science of Light & Max-Planck-Zentrum für Physik und Medizin, 91058, Erlangen, Germany
  6.Cluster of Excellence Physics of Life, TU Dresden, Dresden, Germany
  7.Institute of Applied Physics, TU Dresden, Dresden, Germany
- Author bio：
  
  Jiawei Sun (jiawei.sun@tu-dresden.de)
  Nektarios Koukourakis (nektarios.koukourakis@tu-dresden.de)
  Juergen W. Czarske (juergen.czarske@tu-dresden.de)
- Funds：
- DOI：10.1038/s41377-022-00898-2
  中图分类号：
- 纸质出版日期：2022-08-31，
  
  网络出版日期：2022-07-05，
  
  收稿日期：2022-01-08，
  
  修回日期：2022-06-10，
  
  录用日期：2022-06-16
- Accepted：
Scan for full text
Jiawei Sun, Jiachen Wu, Song Wu, 等. Quantitative phase imaging through an ultra-thin lensless fiber endoscope[J]. Light: Science & Applications, 2022,11(8):1843-1852.

Sun, J. W. et al. Quantitative phase imaging through an ultra-thin lensless fiber endoscope. Light: Science & Applications, 11, 1843-1852 (2022).
Jiawei Sun, Jiachen Wu, Song Wu, 等. Quantitative phase imaging through an ultra-thin lensless fiber endoscope[J]. Light: Science & Applications, 2022,11(8):1843-1852. DOI： 10.1038/s41377-022-00898-2.

Sun, J. W. et al. Quantitative phase imaging through an ultra-thin lensless fiber endoscope. Light: Science & Applications, 11, 1843-1852 (2022). DOI： 10.1038/s41377-022-00898-2.

摘要

Abstract

Quantitative phase imaging (QPI) is a label-free technique providing both morphology and quantitative biophysical information in biomedicine. However

applying such a powerful technique to in vivo pathological diagnosis remains challenging. Multi-core fiber bundles (MCFs) enable ultra-thin probes for in vivo imaging

but current MCF imaging techniques are limited to amplitude imaging modalities. We demonstrate a computational lensless microendoscope that uses an ultra-thin bare MCF to perform quantitative phase imaging with microscale lateral resolution and nanoscale axial sensitivity of the optical path length. The incident complex light field at the measurement side is precisely reconstructed from the far-field speckle pattern at the detection side

enabling digital refocusing in a multi-layer sample without any mechanical movement. The accuracy of the quantitative phase reconstruction is validated by imaging the phase target and hydrogel beads through the MCF. With the proposed imaging modality

three-dimensional imaging of human cancer cells is achieved through the ultra-thin fiber endoscope

promising widespread clinical applications.

关键词

Keywords

references

Y. K. Park, C. Depeursinge, G. Popescu. Quantitative phase imaging in biomedicine. Nat. Photonics, 2018. 12578-589. DOI:10.1038/s41566-018-0253-xhttp://doi.org/10.1038/s41566-018-0253-x.

M. Schürmann, 等. Three-dimensional correlative single-cell imaging utilizing fluorescence and refractive index tomography. J. Biophotonics, 2018. 11e201700145DOI:10.1002/jbio.201700145http://doi.org/10.1002/jbio.201700145.

C. J. Mann, 等. High-resolution quantitative phase-contrast microscopy by digital holography. Opt. Express, 2005. 138693-8698. DOI:10.1364/OPEX.13.008693http://doi.org/10.1364/OPEX.13.008693.

C. Polonschii, 等. High-resolution impedance mapping using electrically activated quantitative phase imaging. Light.: Sci. Appl., 2021. 1020DOI:10.1038/s41377-020-00461-xhttp://doi.org/10.1038/s41377-020-00461-x.

Z. Wang, 等. Dehydration of plant cells shoves nuclei rotation allowing for 3D phase-contrast tomography. Light.: Sci. Appl., 2021. 10187DOI:10.1038/s41377-021-00626-2http://doi.org/10.1038/s41377-021-00626-2.

B. Mandracchia, 等. Quantitative imaging of the complexity in liquid bubbles' evolution reveals the dynamics of film retraction. Light.: Sci. Appl., 2019. 820DOI:10.1038/s41377-019-0131-4http://doi.org/10.1038/s41377-019-0131-4.

X. Chen, 等. Wolf phase tomography (WPT) of transparent structures using partially coherent illumination. Light.: Sci. Appl., 2020. 9142DOI:10.1038/s41377-020-00379-4http://doi.org/10.1038/s41377-020-00379-4.

A. B. Parthasarathy, 等. Quantitative phase imaging using a partitioned detection aperture. Opt. Lett., 2012. 374062-4064. DOI:10.1364/OL.37.004062http://doi.org/10.1364/OL.37.004062.

A. Saba, 等. Polarization-sensitive optical diffraction tomography. Optica, 2021. 8402-408. DOI:10.1364/OPTICA.415343http://doi.org/10.1364/OPTICA.415343.

J. Lim, 等. High-fidelity optical diffraction tomography of multiple scattering samples. Light.: Sci. Appl., 2019. 882DOI:10.1038/s41377-019-0195-1http://doi.org/10.1038/s41377-019-0195-1.

Z. Wang, 等. Tissue refractive index as marker of disease. J. Biomed. Opt., 2011. 16116017DOI:10.1117/1.3656732http://doi.org/10.1117/1.3656732.

P. Y. Liu, 等. Cell refractive index for cell biology and disease diagnosis: past, present and future. Lab a Chip, 2016. 16634-644. DOI:10.1039/C5LC01445Jhttp://doi.org/10.1039/C5LC01445J.

M. Schürmann, 等. Cell nuclei have lower refractive index and mass density than cytoplasm. J. Biophotonics, 2016. 91068-1076. DOI:10.1002/jbio.201500273http://doi.org/10.1002/jbio.201500273.

S. Aknoun, 等. Living cell dry mass measurement using quantitative phase imaging with quadriwave lateral shearing interferometry: an accuracy and sensitivity discussion. J. Biomed. Opt., 2015. 20126009DOI:10.1117/1.JBO.20.12.126009http://doi.org/10.1117/1.JBO.20.12.126009.

S. P. Singh, 等. Label-free characterization of ultra violet-radiation-induced changes in skin fibroblasts with Raman spectroscopy and quantitative phase microscopy. Sci. Rep., 2017. 710829DOI:10.1038/s41598-017-11091-6http://doi.org/10.1038/s41598-017-11091-6.

S. R. Underwood, 等. Quantitative phase analysis in the assessment of coronary artery disease. Br. Heart J., 1989. 6114-22. DOI:10.1136/hrt.61.1.14http://doi.org/10.1136/hrt.61.1.14.

K. R. Lee, 等. Quantitative phase imaging techniques for the study of cell pathophysiology: from principles to applications. Sensors, 2013. 134170-4191. DOI:10.3390/s130404170http://doi.org/10.3390/s130404170.

Y. Rivenson, 等. PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning. Light.: Sci. Appl., 2019. 823DOI:10.1038/s41377-019-0129-yhttp://doi.org/10.1038/s41377-019-0129-y.

H. D. Wang, 等. Deep learning enables cross-modality super-resolution in fluorescence microscopy. Nat. Methods, 2019. 16103-110. DOI:10.1038/s41592-018-0239-0http://doi.org/10.1038/s41592-018-0239-0.

G. Kim, 等. Learning-based screening of hematologic disorders using quantitative phase imaging of individual red blood cells. Biosens. Bioelectron., 2019. 12369-76. DOI:10.1016/j.bios.2018.09.068http://doi.org/10.1016/j.bios.2018.09.068.

F. Merola, 等. Tomographic flow cytometry by digital holography. Light.: Sci. Appl., 2017. 6e16241DOI:10.1038/lsa.2016.241http://doi.org/10.1038/lsa.2016.241.

N. Goswami, 等. Label-free SARS-CoV-2 detection and classification using phase imaging with computational specificity. Light.: Sci. Appl., 2021. 10176DOI:10.1038/s41377-021-00620-8http://doi.org/10.1038/s41377-021-00620-8.

H. Majeed, 等. Quantitative phase imaging for medical diagnosis. J. Biophotonics, 2017. 10177-205. DOI:10.1002/jbio.201600113http://doi.org/10.1002/jbio.201600113.

J. X. Li, 等. Biopsy-free in vivo virtual histology of skin using deep learning. Light.: Sci. Appl., 2021. 10233DOI:10.1038/s41377-021-00674-8http://doi.org/10.1038/s41377-021-00674-8.

N. Krstajić, 等. Two-color widefield fluorescence microendoscopy enables multiplexed molecular imaging in the alveolar space of human lung tissue. J. Biomed. Opt., 2016. 21046009DOI:10.1117/1.JBO.21.4.046009http://doi.org/10.1117/1.JBO.21.4.046009.

V. Szabo, 等. Spatially selective holographic photoactivation and functional fluorescence imaging in freely behaving mice with a fiberscope. Neuron, 2014. 841157-1169. DOI:10.1016/j.neuron.2014.11.005http://doi.org/10.1016/j.neuron.2014.11.005.

T. Gissibl, 等. Two-photon direct laser writing of ultracompact multi-lens objectives. Nat. Photonics, 2016. 10554-560. DOI:10.1038/nphoton.2016.121http://doi.org/10.1038/nphoton.2016.121.

A. Orth, 等. Optical fiber bundles: ultra-slim light field imaging probes. Sci. Adv., 2019. 5eaav1555DOI:10.1126/sciadv.aav1555http://doi.org/10.1126/sciadv.aav1555.

J. Shin, 等. A minimally invasive lens-free computational microendoscope. Sci. Adv., 2019. 5eaaw5595DOI:10.1126/sciadv.aaw5595http://doi.org/10.1126/sciadv.aaw5595.

P. C. Costa, 等. Towards in-vivo label-free detection of brain tumor margins with epi-illumination tomographic quantitative phase imaging. Biomed. Opt. Express, 2021. 121621-1634. DOI:10.1364/BOE.416731http://doi.org/10.1364/BOE.416731.

M. Plöschner, T. Tyc, T. Čižmár. Seeing through chaos in multimode fibres. Nat. Photonics, 2015. 9529-535. DOI:10.1038/nphoton.2015.112http://doi.org/10.1038/nphoton.2015.112.

S. Rothe, 等. Transmission matrix measurement of multimode optical fibers by mode-selective excitation using one spatial light modulator. Appl. Sci., 2019. 9195DOI:10.3390/app9010195http://doi.org/10.3390/app9010195.

Haufe, D. et al. Transmission of multiple signals through an optical fiber using wavefront shaping. J. Vis. Exp. e55407 https://doi.org/10.3791/55407https://doi.org/10.3791/55407 (2017).

L. Büttner, M. Thümmler, J. Czarske. Velocity measurements with structured light transmitted through a multimode optical fiber using digital optical phase conjugation. Opt. Express, 2020. 288064-8075. DOI:10.1364/OE.386047http://doi.org/10.1364/OE.386047.

T. Tučková, 等. Computational image enhancement of multimode fibre-based holographic endo-microscopy: harnessing the muddy modes. Opt. Express, 2021. 2938206-38220. DOI:10.1364/OE.434848http://doi.org/10.1364/OE.434848.

S. Rothe, 等. Benchmarking analysis of computer generated holograms for complex wavefront shaping using pixelated phase modulators. Opt. Express, 2021. 2937602-37616. DOI:10.1364/OE.434842http://doi.org/10.1364/OE.434842.

R. Kuschmierz, 等. Ultra-thin 3D lensless fiber endoscopy using diffractive optical elements and deep neural networks. Light.: Adv. Manuf., 2021. 230.

J. W. Sun, 等. Real-time complex light field generation through a multi-core fiber with deep learning. Sci. Rep., 2022. 127732DOI:10.1038/s41598-022-11803-7http://doi.org/10.1038/s41598-022-11803-7.

O. Coquoz, 等. Performances of endoscopic holography with a multicore optical fiber. Appl. Opt., 1995. 347186-7193. DOI:10.1364/AO.34.007186http://doi.org/10.1364/AO.34.007186.

U. Weiss, O. Katz. Two-photon lensless micro-endoscopy with in-situ wavefront correction. Opt. Express, 2018. 2628808-28817. DOI:10.1364/OE.26.028808http://doi.org/10.1364/OE.26.028808.

R. Kuschmierz, 等. Self-calibration of lensless holographic endoscope using programmable guide stars. Opt. Lett., 2018. 432997-3000. DOI:10.1364/OL.43.002997http://doi.org/10.1364/OL.43.002997.

E. Scharf, 等. Video-rate lensless endoscope with self-calibration using wavefront shaping. Opt. Lett., 2020. 453629-3632. DOI:10.1364/OL.394873http://doi.org/10.1364/OL.394873.

V. Tsvirkun, 等. Widefield lensless endoscopy with a multicore fiber. Opt. Lett., 2016. 414771-4774. DOI:10.1364/OL.41.004771http://doi.org/10.1364/OL.41.004771.

J. W. Sun, N. Koukourakis, J. W. Czarske. Complex wavefront shaping through a multi-core fiber. Appl. Sci., 2021. 113949DOI:10.3390/app11093949http://doi.org/10.3390/app11093949.

J. W. Sun, 等. Rapid computational cell-rotation around arbitrary axes in 3D with multi-core fiber. Biomed. Opt. Express, 2021. 123423-3437. DOI:10.1364/BOE.423035http://doi.org/10.1364/BOE.423035.

L. F. Yu, M. K. Kim. Wavelength-scanning digital interference holography for tomographic three-dimensional imaging by use of the angular spectrum method. Opt. Lett., 2005. 302092-2094. DOI:10.1364/OL.30.002092http://doi.org/10.1364/OL.30.002092.

S. Girardo, 等. Standardized microgel beads as elastic cell mechanical probes. J. Mater. Chem. B, 2018. 66245-6261. DOI:10.1039/C8TB01421Chttp://doi.org/10.1039/C8TB01421C.

P. Müller, 等. Accurate evaluation of size and refractive index for spherical objects in quantitative phase imaging. Opt. Express, 2018. 2610729-10743. DOI:10.1364/OE.26.010729http://doi.org/10.1364/OE.26.010729.

N. Koukourakis, 等. Depth-filtered digital holography. Opt. Express, 2012. 2022636-22648. DOI:10.1364/OE.20.022636http://doi.org/10.1364/OE.20.022636.

M. Finkeldey, 等. Depth-filtering in common-path digital holographic microscopy. Opt. Express, 2017. 2519398-19407. DOI:10.1364/OE.25.019398http://doi.org/10.1364/OE.25.019398.

Badt, N. & Katz, O. Label-free video-rate micro-endoscopy through flexible fibers via Fiber Bundle Distal Holography (FiDHo). Digital Holography and Three-Dimensional Imaging 2021. (OSA, Washington 2021).

V. Tsvirkun, 等. Bending-induced inter-core group delays in multicore fibers. Opt. Express, 2017. 2531863-31875. DOI:10.1364/OE.25.031863http://doi.org/10.1364/OE.25.031863.

V. Tsvirkun, 等. Flexible lensless endoscope with a conformationally invariant multi-core fiber. Optica, 2019. 61185-1189. DOI:10.1364/OPTICA.6.001185http://doi.org/10.1364/OPTICA.6.001185.

A. Chambolle. An algorithm for total variation minimization and applications. J. Math. Imaging Vis., 2004. 2089-97. DOI:10.1023/B:JMIV.0000011320.81911.38http://doi.org/10.1023/B:JMIV.0000011320.81911.38.

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

Light | 光纤显微内窥镜：癌细胞三维成像

暂无数据