Ptycho-endoscopy on a lensless ultrathin fiber bundle tip

Pengming Song; Ruihai Wang; Lars Loetgering; Jia Liu; Peter Vouras; Yujin Lee; Shaowei Jiang; Bin Feng; Andrew Maiden; Changhuei Yang; Guoan Zheng

doi:10.1038/s41377-024-01510-5

Go to Nature Website

Your Location：

Home >

Browse articles >

Ptycho-endoscopy on a lensless ultrathin fiber bundle tip

Original Articles

- Ptycho-endoscopy on a lensless ultrathin fiber bundle tip
- Light: Science & Applications Vol. 13, Issue 9, Pages: 1766-1778(2024)
- Affiliations：
  
  1.Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
  2.CarlZeiss AG, Carl Zeiss Promenade, Jena, Thuringia 07745, Germany
  3.United States Department of Defense, Washington, DC 20301, USA
  4.School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Republic of Korea
  5.Department of Electronic and Electrical Engineering, University of Sheffield, Sheffield South Yorkshire S1 3JD, UK
  6.Diamond Light Source, Harwell, Oxfordshire OX11 0DE, UK
  7.Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA
  8.Center for Biomedical and Bioengineering Innovation, University of Connecticut, Storrs, CT 06269, USA
- Author bio：
  
  Pengming Song (pengming.song@uconn.edu)
  Guoan Zheng (guoan.zheng@uconn.edu)
- Funds：
- DOI：10.1038/s41377-024-01510-5
  CLC：
- Published：30 September 2024，
  
  Published Online：17 July 2024，
  
  Received：30 January 2024，
  
  Revised：10 June 2024，
  
  Accepted：25 June 2024
- Accepted：
Scan QR Code
Song, P. M. et al. Ptycho-endoscopy on a lensless ultrathin fiber bundle tip. Light: Science & Applications, 13, 1766-1778 (2024).
DOI：

Song, P. M. et al. Ptycho-endoscopy on a lensless ultrathin fiber bundle tip. Light: Science & Applications, 13, 1766-1778 (2024). DOI： 10.1038/s41377-024-01510-5.

摘要

Abstract

Synthetic aperture radar (SAR) utilizes an aircraft-carried antenna to emit electromagnetic pulses and detect the returning echoes. As the aircraft travels across a designated area

it synthesizes a large virtual aperture to improve image resolution. Inspired by SAR

we introduce synthetic aperture ptycho-endoscopy (SAPE) for micro-endoscopic imaging beyond the diffraction limit. SAPE operates by hand-holding a lensless fiber bundle tip to record coherent diffraction patterns from specimens. The fiber cores at the distal tip modulate the diffracted wavefield within a confined area

emulating the role of the 'airborne antenna' in SAR. The handheld operation introduces positional shifts to the tip

analogous to the aircraft's movement. These shifts facilitate the acquisition of a ptychogram and synthesize a large virtual aperture extending beyond the bundle's physical limit. We mitigate the influences of hand motion and fiber bending through a low-rank spatiotemporal decomposition of the bundle's modulation profile. Our tests demonstrate the ability to resolve a 548-nm linewidth on a resolution target. The achieved space-bandwidth product is ~1.1 million effective pixels

representing a 36-fold increase compared to that of the original fiber bundle. Furthermore

SAPE's refocusing capability enables imaging over an extended depth of field exceeding 2 cm. The aperture synthesizing process in SAPE surpasses the diffraction limit set by the probe's maximum collection angle

opening new opportunities for both fiber-based and distal-chip endoscopy in applications such as medical diagnostics and industrial inspection.

关键词

Keywords

references

Moreira, A. et al. A tutorial on synthetic aperture radar.IEEE Geosci. Remote Sens. Mag.1, 6–43 (2013)..

Armano, M. et al. Sensor noise inLISA Pathfinder: Laser frequency noise and its coupling to the optical test mass readout.Phys. Rev. D.109, 042003 (2024)..

Faulkner, H. M. L.&Rodenburg, J. M. Movable aperture lensless transmission microscopy: a novel phase retrieval algorithm.Phys. Rev. Lett.93, 023903 (2004)..

Rodenburg, J.&Maiden, A. Ptychography. in Springer Handbook of Microscopy (eds Hawkes, P. W.&Spence, J. C. H. ) (Cham: Springer, 2019), 819–904.

Guizar-Sicairos, M.&Thibault, P. Ptychography: A solution to the phase problem.Phys. Today74, 42–48 (2021)..

Wang, T. B. et al. Optical ptychography for biomedical imaging: recent progress and future directions [Invited. Biomedical Optics Express 14, 489–532 (2023).Biomed. Opt. Express14, 489–532 (2023)..

Thibault, P. et al. High-resolution scanning x-ray diffraction microscopy.Science321, 379–382 (2008)..

Marrison, J. et al. Ptychography–a label free, high-contrast imaging technique for live cells using quantitative phase information.Sci. Rep.3, 2369 (2013)..

Stockmar, M. et al. Near-field ptychography: phase retrieval for inline holography using a structured illumination.Sci. Rep.3, 1927 (2013)..

Thibault, P.&Menzel, A. Reconstructing state mixtures from diffraction measurements.Nature494, 68–71 (2013)..

Pfeiffer, F. X-ray ptychography.Nat. Photonics12, 9–17 (2018)..

Jiang, Y. et al. Electron ptychography of 2D materials to deep sub-ångström resolution.Nature559, 343–349 (2018)..

Jiang, S. W. et al. Spatial- and Fourier-domain ptychography for high-throughput bio-imaging.Nat. Protoc.18, 2051–2083 (2023)..

Jiang, S. W., Wang, T. B.&Zheng, G. A. Coded ptychographic imaging. in Coded Optical Imaging (ed Liang, J. Y. ) (Cham: Springer, 2024), 181–203.

Guizar-Sicairos, M.&Fienup, J. R. Phase retrieval with transverse translation diversity: a nonlinear optimization approach.Opt. Express16, 7264–7278 (2008)..

Covi, D. et al. Miniaturized digital camera system for disposable endoscopic applications.Sens. Actuators A: Phys.162, 291–296 (2010)..

Matz, G. et al. Chip-on-the-tip compact flexible endoscopic epifluorescence video-microscope for in-vivo imaging in medicine and biomedical research.Biomed. Opt. Express8, 3329–3342 (2017)..

Wang, R. H. et al. Spatially‐coded fourier ptychography: flexible and detachable coded thin films for quantitative phase imaging with uniform phase transfer characteristics.Adv. Opt. Mater.12, 2303028 (2024)..

Choi, Y. et al. Scanner-free and wide-fieldendoscopic imaging by using a single multimode optical fiber.Phys. Rev. Lett.109, 203901 (2012)..

Kim, D. et al. Toward a miniature endomicroscope: pixelation-free and diffraction-limited imaging through a fiber bundle.Opt. Lett.39, 1921–1924 (2014)..

Kuschmierz, R. et al. Self-calibration of lensless holographic endoscope using programmable guide stars.Opt. Lett.43, 2997–3000 (2018)..

Scharf, E. et al. Video-rate lensless endoscope with self-calibration using wavefront shaping.Opt. Lett.45, 3629–3632 (2020)..

Saucedo, A. T. et al. Endoscopic pulsed digital holography for 3D measurements.Opt. Express14, 1468–1475 (2006)..

Hughes, M. R. Inline holographic microscopy through fiber imaging bundles.Appl. Opt.60, A1–A7 (2021)..

Badt, N.&Katz, O. Real-time holographic lensless micro-endoscopy through flexible fibers via fiber bundle distal holography.Nat. Commun.13, 6055 (2022)..

Choi, W. et al. Flexible-type ultrathin holographic endoscope for microscopic imaging of unstained biological tissues.Nat. Commun.13, 4469 (2022)..

Avenhaus, W. et al. Dynamic holographic endoscopy—ex vivo investigations of malignant tumors in the human stomach.Lasers Med. Sci.19, 223–228 (2005)..

Lee, J. S. et al. Intensity and phase statistics of multilook polarimetric and interferometric SAR imagery.IEEE Trans. Geosci. Remote Sens.32, 1017–1028 (1994)..

Wu, Y. J. et al. Lensless multi-core-fiber-based imaging from speckle autocorrelation under highly coherent illumination.Opt. Lasers Eng.175, 108004 (2024)..

Sun, J. W. et al. Quantitative phase imaging through an ultra-thin lensless fiber endoscope.Light Sci. Appl.11, 204 (2022)..

Kogan, D. et al. Phase retrieval in multicore fiber bundles.Opt. Lett.42, 647–650 (2017)..

Borhani, N. et al. Learning to see through multimode fibers.Optica5, 960–966 (2018)..

Sun, J. W. et al. AI-driven projection tomography with multicore fibre-optic cell rotation.Nat. Commun.15, 147 (2024)..

Du, Y. et al. Hybrid multimode-multicore fibre based holographic endoscope for deep-tissue neurophotonics.Light. Adv. Manuf.3, 408–416 (2022)..

Vasquez-Lopez, S. A. et al. Subcellular spatial resolution achieved for deep-brain imaging in vivo using a minimally invasive multimode fiber.Light Sci. Appl.7, 110 (2018)..

Rothe, S. et al. Intensity-only mode decomposition on multimode fibers using a denselyconnected convolutional network.J. Lightwave Technol.39, 1672–1679 (2021)..

Hughes, M. R. Real-timing processing of fiber bundle endomicroscopy images in Python using PyFibreBundle.Appl. Opt.62, 9041–9050 (2023)..

Wang, T. B. et al. Remote referencing strategy for high-resolution coded ptychographic imaging.Opt. Lett.48, 485–488 (2023)..

Zhang, H. et al. Near-field Fourier ptychography: super-resolution phase retrieval via speckle illumination.Opt. Express27, 7498–7512 (2019)..

Odstrcil, M. et al. Ptychographic coherent diffractive imaging with orthogonal probe relaxation.Opt. Express24, 8360–8369 (2016)..

Song, P. M. et al. Synthetic aperture ptychography: coded sensor translation for joint spatial-Fourier bandwidth expansion.Photonics Res.10, 1624–1632 (2022)..

Jiang, S. W. et al. Resolution-enhanced parallel coded ptychography for high-throughput optical imaging.ACS Photonics8, 3261–3271 (2021)..

Jiang, S. W. et al. Blood-coated sensor for high-throughput ptychographic cytometry on a blu-ray disc.ACS Sens.7, 1058–1067 (2022)..

Jiang, S. W. et al. High-throughput digital pathologyviaa handheld, multiplexed, and AI-powered ptychographic whole slide scanner.Lab a Chip22, 2657–2670 (2022)..

Zheng, G. A., Horstmeyer, R.&Yang, C. Wide-field, high-resolution Fourier ptychographic microscopy.Nat. Photonics7, 739–745 (2013)..

Dong, S. Y. et al. Aperture-scanning Fourier ptychography for 3D refocusing and super-resolution macroscopic imaging.Opt. Express22, 13586–13599 (2014)..

Jiang, S. W. et al. Wide-field, high-resolution lensless on-chip microscopyvianear-field blind ptychographic modulation.Lab a Chip20, 1058–1065 (2020)..

Bian, Z. C. et al. Autofocusing technologies for whole slide imaging and automated microscopy.J. Biophoto.13, e202000227 (2020)..

Horstmeyer, R. et al. Standardizing the resolution claims for coherent microscopy.Nat. Photonics10, 68–71 (2016)..

Popoff, S. M. et al. Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media.Phys. Rev. Lett.104, 100601 (2010)..

Mosk, A. P. et al. Controlling waves in space and time for imaging and focusing in complex media.Nat. Photonics6, 283–292 (2012)..

Plöschner, M., Tyc, T.&Čižmár, T. Seeing through chaos in multimode fibres.Nat. Photonics9, 529–535 (2015)..

Katz, O. et al. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations.Nat. Photonics8, 784–790 (2014)..

Wen, Z. et al. Single multimode fibre for in vivo light-field-encoded endoscopic imaging.Nat. Photonics17, 679–687 (2023)..

Gora, M. J. et al. Endoscopic optical coherence tomography: technologies and clinical applications.Biomed. Opt. Express8, 2405–2444 (2017)..

Zheng, G. A. et al. Concept, implementations and applications of Fourier ptychography.Nat. Rev. Phys.3, 207–223 (2021)..

Zuo, C. et al. Wide-field high-resolution 3D microscopy with Fourier ptychographic diffraction tomography.Opt. Lasers Eng.128, 106003 (2020)..

Horstmeyer, R. et al. Diffraction tomography with Fourier ptychography.Optica3, 827–835 (2016)..

Li, S. et al. Far‐field synthetic aperture imaging via fourier ptychography with quasi‐plane wave illumination.Adv. Photonics Res.4, 2300180 (2023)..

Holloway, J. et al. SAVI: Synthetic apertures for long-range, subdiffraction-limited visible imaging using Fourier ptychography.Sci. Adv.3, e1602564 (2017)..

Bashkansky, M. et al. Two-dimensional synthetic aperture imaging in the optical domain.Opt. Lett.27, 1983–1985 (2002)..

Maiden, A., Johnson, D.&Li, P. Further improvements to the ptychographical iterative engine.Optica4, 736–745 (2017)..

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰