Ptycho-endoscopy on a lensless ultrathin fiber bundle tip

Pengming Song; Ruihai Wang; Lars Loetgering; Jia Liu; Peter Vouras; Yujin Lee; Shaowei Jiang; Bin Feng; Andrew Maiden; Changhuei Yang; Guoan Zheng

doi:10.1038/s41377-024-01510-5

Your Location：

Home >

Browse articles >

Ptycho-endoscopy on a lensless ultrathin fiber bundle tip

Original Articles

- Ptycho-endoscopy on a lensless ultrathin fiber bundle tip
- Ptycho-endoscopy on a lensless ultrathin fiber bundle tip
- LSA 2024年13卷第9期页码：1766-1778
- Affiliations：
  
  1.Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
  2.CarlZeiss AG, Carl Zeiss Promenade, Jena, Thuringia 07745, Germany
  3.United States Department of Defense, Washington, DC 20301, USA
  4.School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Republic of Korea
  5.Department of Electronic and Electrical Engineering, University of Sheffield, Sheffield South Yorkshire S1 3JD, UK
  6.Diamond Light Source, Harwell, Oxfordshire OX11 0DE, UK
  7.Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA
  8.Center for Biomedical and Bioengineering Innovation, University of Connecticut, Storrs, CT 06269, USA
- Author bio：
  
  Pengming Song (pengming.song@uconn.edu)
  Guoan Zheng (guoan.zheng@uconn.edu)
- Funds：
- DOI：10.1038/s41377-024-01510-5
  中图分类号：
- 收稿日期：2024-01-30，
  
  修回日期：2024-06-10，
  
  录用日期：2024-06-25，
  
  网络出版日期：2024-07-17，
  
  纸质出版日期：2024-09-30
- Accepted：
Scan QR Code
Ptycho-endoscopy on a lensless ultrathin fiber bundle tip[J]. LSA, 2024,13(9):1766-1778.

Song, P. M. et al. Ptycho-endoscopy on a lensless ultrathin fiber bundle tip. Light: Science & Applications, 13, 1766-1778 (2024).
Ptycho-endoscopy on a lensless ultrathin fiber bundle tip[J]. LSA, 2024,13(9):1766-1778. DOI： 10.1038/s41377-024-01510-5.

Song, P. M. et al. Ptycho-endoscopy on a lensless ultrathin fiber bundle tip. Light: Science & Applications, 13, 1766-1778 (2024). DOI： 10.1038/s41377-024-01510-5.

摘要

Abstract

Synthetic aperture radar (SAR) utilizes an aircraft-carried antenna to emit electromagnetic pulses and detect the returning echoes. As the aircraft travels across a designated area

it synthesizes a large virtual aperture to improve image resolution. Inspired by SAR

we introduce synthetic aperture ptycho-endoscopy (SAPE) for micro-endoscopic imaging beyond the diffraction limit. SAPE operates by hand-holding a lensless fiber bundle tip to record coherent diffraction patterns from specimens. The fiber cores at the distal tip modulate the diffracted wavefield within a confined area

emulating the role of the 'airborne antenna' in SAR. The handheld operation introduces positional shifts to the tip

analogous to the aircraft's movement. These shifts facilitate the acquisition of a ptychogram and synthesize a large virtual aperture extending beyond the bundle's physical limit. We mitigate the influences of hand motion and fiber bending through a low-rank spatiotemporal decomposition of the bundle's modulation profile. Our tests demonstrate the ability to resolve a 548-nm linewidth on a resolution target. The achieved space-bandwidth product is ~1.1 million effective pixels

representing a 36-fold increase compared to that of the original fiber bundle. Furthermore

SAPE's refocusing capability enables imaging over an extended depth of field exceeding 2 cm. The aperture synthesizing process in SAPE surpasses the diffraction limit set by the probe's maximum collection angle

opening new opportunities for both fiber-based and distal-chip endoscopy in applications such as medical diagnostics and industrial inspection.

关键词

Keywords

references

Moreira, A. et al. A tutorial on synthetic aperture radar. IEEE Geosci. Remote Sens. Mag. 1 , 6–43 (2013)..

Armano, M. et al. Sensor noise in LISA Pathfinder : Laser frequency noise and its coupling to the optical test mass readout. Phys. Rev. D. 109 , 042003 (2024)..

Faulkner, H. M. L. & Rodenburg, J. M. Movable aperture lensless transmission microscopy: a novel phase retrieval algorithm. Phys. Rev. Lett. 93 , 023903 (2004)..

Rodenburg, J.&Maiden, A. Ptychography. in Springer Handbook of Microscopy (eds Hawkes, P. W.&Spence, J. C. H. ) (Cham: Springer, 2019), 819–904.

Guizar-Sicairos, M. & Thibault, P. Ptychography: A solution to the phase problem. Phys. Today 74 , 42–48 (2021)..

Wang, T. B. et al. Optical ptychography for biomedical imaging: recent progress and future directions [Invited. Biomedical Optics Express 14, 489–532 (2023). Biomed. Opt. Express 14 , 489–532 (2023)..

Thibault, P. et al. High-resolution scanning x-ray diffraction microscopy. Science 321 , 379–382 (2008)..

Marrison, J. et al. Ptychography–a label free, high-contrast imaging technique for live cells using quantitative phase infor mation. Sci. Rep. 3 , 2369 (2013)..

Stockmar, M. et al. Near-field ptychography: phase retrieval for inline holography using a structured illumination. Sci. Rep. 3 , 1927 (2013)..

Thibault, P. & Menzel, A. Reconstructing state mixtures from diffraction measurements. Nature 494 , 68–71 (2013)..

Pfeiffer, F. X-ray ptychography. Nat. Photonics 12 , 9–17 (2018)..

Jiang, Y. et al. Electron ptychography of 2D materials to deep sub-ångström resolution. Nature 559 , 343–349 (2018)..

Jiang, S. W. et al. Spatial- and Fourier-domain ptychography for high-throughput bio-imaging. Nat. Protoc. 18 , 2051–2083 (2023)..

Jiang, S. W., Wang, T. B.&Zheng, G. A. Coded ptychographic imaging. in Coded Optical Imaging (ed Liang, J. Y. ) (Cham: Springer, 2024), 181–203.

Guizar-Sicairos, M. & Fienup, J. R. Phase retrieval with transverse translation diversity: a nonlinear optimization approac h. Opt. Express 16 , 7264–7278 (2008)..

Covi, D. et al. Miniaturized digital camera system for disposable endoscopic applications. Sens. Actuators A: Phys. 162 , 291–296 (2010)..

Matz, G. et al. Chip-on-the-tip compact flexible endoscopic epifluorescence video-microscope for in-vivo imaging in medicine and biomedical research. Biomed. Opt. Express 8 , 3329–3342 (2017)..

Wang, R. H. et al. Spatially‐coded fourier ptychography: flexible and detachable coded thin films for quantitative phase imaging with uniform phase transfer characteristics. Adv. Opt. Mater. 12 , 2303028 (2024)..

Choi, Y. et al. Scanner-free and wide-fieldendoscopic imaging by using a single multimode optical fiber. Phys. Rev. Lett. 109 , 203901 (2012)..

Kim, D. et al. Toward a miniature endomicroscope: pixelation-free and diffraction-limited imaging through a fiber bundle. Opt. Lett. 39 , 1921–1924 (2014)..

Kuschmierz, R. et al. Self-calibration of lensless holographic endoscope using programmable guide stars. Opt. Lett. 43 , 2997–3000 (2018)..

Scharf, E. et al. Video-rate lensless endoscope with self-calibration using wavefront shaping. Opt. Lett. 45 , 3629–3632 (2020)..

Saucedo, A. T. et al. Endoscopic pulsed digital holography for 3D measurements. Opt. Express 14 , 1468–1475 (2006)..

Hughes, M. R. Inline holographic microscopy through fiber imaging bundles. Appl. Opt. 60 , A1–A7 (2021)..

Badt, N. & Katz, O. Real-time holographic lensless micro-endoscopy through flexible fibers via fiber bundle distal holography. Nat. Commun. 13 , 6055 (2022)..

Choi, W. et al. Flexible-type ultrathin holographic endoscope for microscopic imaging of unstained biological tissues. Nat. Commun. 13 , 4469 (2022)..

Avenhaus, W. et al. Dynamic holographic endoscopy—ex vivo investigations of malignant tumors in the human stomach. Lasers Med. Sci. 19 , 223–228 (2005)..

Lee, J. S. et al. Intensity and phase st atistics of multilook polarimetric and interferometric SAR imagery. IEEE Trans. Geosci. Remote Sens. 32 , 1017–1028 (1994)..

Wu, Y. J. et al. Lensless multi-core-fiber-based imaging from speckle autocorrelation under highly coherent illumination. Opt. Lasers Eng. 175 , 108004 (2024)..

Sun, J. W. et al. Quantitative phase imaging through an ultra-thin lensless fiber endoscope. Light Sci. Appl. 11 , 204 (2022)..

Kogan, D. et al. Phase retrieval in multicore fiber bundles. Opt. Lett. 42 , 647–650 (2017)..

Borhani, N. et al. Learning to see through multimode fibers. Optica 5 , 960–966 (2018)..

Sun, J. W. et al. AI-driven projection tomography with multicore fibre-optic cell rotation. Nat. Commun. 15 , 147 (2024)..

Du, Y. et al. Hybrid multimode-multicore fibre based holographic endoscope for deep-tissue neurophotonics. Light. Adv. Manuf. 3 , 408–416 (2022)..

Vasquez-Lopez, S. A. et al. Subcellular spatial resolution achieved for deep-brain imaging in vivo using a minimally invasive multimode fiber. Light Sci. Appl. 7 , 110 (2018)..

Rothe, S. et al. Intensity-only mode decomposition on multimode fibers using a denselyconnected convolutional network. J. Lightwave Technol. 39 , 1672–1679 (2021)..

Hughes, M. R. Real-timing processing of fiber bundle endomicroscopy images in Python using PyFibreBundle. Appl. Opt. 62 , 9041–9050 (2023)..

Wang, T. B. et al. Remote referencing strategy for high-resolution coded ptychographic imaging. Opt. Lett. 48 , 485–488 (2023)..

Zhang, H. et al. Near-field Fourier ptychography: super-resolution phase retrieval via speckle illumination. Opt. Express 27 , 7498–7512 (2019)..

Odstrcil, M. et al. Ptychographic coherent diffractive imaging with orthogonal probe relaxation. Opt. Express 24 , 8360–8369 (2016)..

Song, P. M. et al. Synthetic aperture ptychography: coded sensor translation for joint spatial-Fourier bandwidth expansion. Photonics Res. 10 , 1624–1632 (2022)..

Jiang, S. W. et al. Resolution-enhanced parallel coded ptychography for high-throughput optical imaging. ACS Photonics 8 , 3261–3271 (2021)..

Jiang, S. W. et al. Blood-coated sensor for high-throughput ptychographic cytometry on a blu-ray disc. ACS Sens. 7 , 1058–1067 (2022)..

Jiang, S. W. et al. High-throughput digital pathology via a handheld, multiplexed, and AI-powered ptychographic whole slide scanner. Lab a Chip 22 , 2657–2670 (2022)..

Zheng, G. A., Horstmeyer, R. & Yang, C. Wide-field, high-resolution Fourier ptychographic microscopy. Nat. Photonics 7 , 739–745 (2013)..

Dong, S. Y. et al. Aperture-scanning Fourier ptychography for 3D refocusing and super-resolution macroscopic imaging. Opt. Express 22 , 13586–13599 (2014)..

Jiang, S. W. et al. Wide-field, high-resolution lensless on-chip microscopy via near-field blind ptychographic modulation. Lab a Chip 20 , 1058–1065 (2020)..

Bian, Z. C. et al. Autofocusing technologies for whole slide imaging and automated microscopy. J. Biophoto. 13 , e202000227 (2020)..

Horstmeyer, R. et al. Standardizing the resolution claims for coherent microscopy. Nat. Photonics 10 , 68–71 (2016)..

Popoff, S. M. et al. Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media. Phys. Rev. Lett. 104 , 100601 (2010)..

Mosk, A. P. et al. Controlling waves in space and time for imaging and focusing in complex media. Nat. Photonics 6 , 283–292 (2012)..

Plöschner, M., Tyc, T. & Čižmár, T. Seeing through chaos in multimode fibres. Nat. Photonics 9 , 529–535 (2015)..

Katz, O. et al. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nat. Photonics 8 , 784–790 (2014)..

Wen, Z. et al. Single multimode fibre for in vivo light-field- encoded endoscopic imaging. Nat. Photonics 17 , 679–687 (2023)..

Gora, M. J. et al. Endoscopic optical coherence tomography: technologies and clinical applications. Biomed. Opt. Express 8 , 2405–2444 (2017)..

Zheng, G. A. et al. Concept, implementations and applications of Fourier ptychography. Nat. Rev. Phys. 3 , 207–223 (2021)..

Zuo, C. et al. Wide-field high-resolution 3D microscopy with Fourier ptychographic diffraction tomography. Opt. Lasers Eng. 128 , 106003 (2020)..

Horstmeyer, R. et al. Diffraction tomography with Fourier ptychography. Optica 3 , 827–835 (2016)..

Li, S. et al. Far‐field synthetic aperture imaging via fourier ptychography with quasi‐plane wave illumination. Adv. Photonics Res. 4 , 2300180 (2023)..

Holloway, J. et al. SAVI: Synthetic apertures for long-range, subdiffraction-limited visible imaging using Fourier ptychography. Sci. Adv. 3 , e1602564 (2017)..

Bashkansky, M. et al. Two-dimensional synthetic aperture imaging in the optical domain. Opt. Lett. 27 , 1983–1985 (2002)..

Maiden, A., Johnson, D. & Li, P. Further improvements to the ptychographical iterative engine. Optica 4 , 736–745 (2017)..

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

Light | 从望远镜到内窥镜的孔径合成

暂无数据