Ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structured illumination microscopy (PAR-SIM)

Xinzhu Xu; Wenyi Wang; Liang Qiao; Yunzhe Fu; Xichuan Ge; Kun Zhao; Karl Zhanghao; Meiling Guan; Xin Chen; Meiqi Li; Dayong Jin; Peng Xi

doi:10.1038/s41377-024-01464-8

Your Location：

Home >

Browse articles >

Ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structured illumination microscopy (PAR-SIM)

Original Articles

- Ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structured illumination microscopy (PAR-SIM)
- Light: Science & Applications Vol. 13, Issue 6, Pages: 1140-1158(2024)
- Affiliations：
  
  1.Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing 100871, China
  2.Wallace H. Coulter Dept. of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta 30332 GA, USA
  3.National Biomedical Imaging Center, Peking University, Beijing 100871, China
  4.Department of Biomedical Engineering, College of Engineering, Southern University of Science and Technology, Shenzhen 518055, Guangdong, China
  5.Airy Technologies Co., Ltd., Beijing 100086, China
  6.Eastern Institute for Advanced Study, Eastern Institute of Technology, Ningbo, Zhejiang 315200, China
  7.School of Life Science, Peking University, Beijing 100871, China
  8.Institute for Biomedical Materials and Devices (IBMD), Faculty of Science, University of Technology Sydney, Sydney, NSW 2007, Australia
- Author bio：
  
  Dayong Jin (Dayong.Jin@uts.edu.au)
  Peng Xi (xipeng@pku.edu.cn)
- Funds：
- DOI：10.1038/s41377-024-01464-8
  CLC：
- Received：10 October 2023，
  
  Revised：2024-04-08，
  
  Accepted：24 April 2024，
  
  Published Online：29 May 2024，
  
  Published：30 June 2024
- Accepted：
Scan QR Code
Xu, X. Z. et al. Ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structured illumination microscopy (PAR-SIM)., Light: Science & Applications, 13, 1140-1158 (2024).
DOI：

Xu, X. Z. et al. Ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structured illumination microscopy (PAR-SIM)., Light: Science & Applications, 13, 1140-1158 (2024). DOI： 10.1038/s41377-024-01464-8.

摘要

Abstract

Structured illumination microscopy (SIM) has emerged as a promising super-resolution fluorescence imaging technique

offering diverse configurations and computational strategies to mitigate phototoxicity during real-time imaging of biological specimens. Traditional efforts to enhance system frame rates have concentrated on processing algorithms

like rolling reconstruction or reduced frame reconstruction

or on investments in costly sCMOS cameras with accelerated row readout rates. In this article

we introduce an approach to elevate SIM frame rates and region of interest (ROI) coverage at the hardware level

without necessitating an upsurge in camera expenses or intricate algorithms. Here

parallel acquisition-readout SIM (PAR-SIM) achieves the highest imaging speed for fluorescence imaging at currently available detector sensitivity. By using the full frame-width of the detector through synchronizing the pattern generation and image exposure-readout process

we have achieved a fundamentally stupendous information spatial-temporal flux of 132.9 MPixels · s

−1

9.6-fold that of the latest techniques

with the lowest SNR of −2.11 dB and 100 nm resolution. PAR-SIM demonstrates its proficiency in successfully reconstructing diverse cellular organelles in dual excitations

even under conditions of low signal due to ultra-short exposure times. Notably

mitochondrial dynamic tubulation and ongoing membrane fusion processes have been captured in live COS-7 cell

recorded with PAR-SIM at an impressive 408 Hz. We posit that this novel parallel exposure-readout mode not only augments SIM pattern modulation for superior frame rates but also holds the potential to benefit other complex imaging systems with a strategic controlling approach.

关键词

Keywords

references

Xue, G. G. et al. The HIV-1 capsid core is an opportunistic nuclear import receptor. Nat. Commun. 14 , 3782 (2023)..

Huang, X. S. et al. Fast, long-term, super-resolution imaging with Hessian structured illumination microscopy. Nat. Biotechnol. 36 , 451–459 (2018)..

Zhanghao, K. et al. High-dimensional super-resolution imaging reveals heterogeneity and dynamics of subcellular lipid membranes. Nat. Commun. 11 , 5890 (2020)..

Gustafsson, M. G. L. Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy: short communication. J. Microsc. 198 , 82–87 (2000)..

Chen, X. et al. Superresolution structured illumination microscopy reconstruction algorithms: a review. Light Sci. Appl. 12 , 172 (2023)..

Pawley, J. B. Handbook of Biological Confocal Microscopy. (New York: Springer, 1990).

Mogre, S. S., Brown, A. I. & Koslover, E. F. Getting around the cell: physical transport in the intracellular world. Phys. Biol. 17 , 061003 (2020)..

Zhao, W. S. et al. Sparse deconvolution improves the resolution of live-cell super-resolution fluorescence microscopy. Nat. Biotechnol. 40 , 606–617 (2022)..

Guo, Y. T. et al. Visualizing intracellular organelle and cytoskeletal interactions at nanoscale resolution on millisecond timescales. Cell 175 , 1430–1442.e17 (2018)..

Qiao, C. et al. Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes. Nat. Biotechnol. 41 , 367–377 (2023)..

Wu, C. T. et al. SARS-CoV-2 replication in airway epithelia requires motile cilia and microvillar reprogramming. Cell 186 , 112–130.e20 (2023)..

Mo, Y. Q. et al. Quantitative structured illumination microscopy via a physical model-based background filtering algorithm reveals actin dynamics. Nat. Commun. 14 , 3089 (2023)..

Zhao, W. S. et al. Enhanced detection of fluorescence fluctuations for high-throughput super-resolution imaging. Nat. Photonics 17 , 806–813 (2023)..

Song, L. et al. Fast structured illumination microscopy using rolling shutter cameras. Meas. Sci. Technol. 27 , 055401 (2016)..

Qian, J. M. et al. Structured illumination microscopy based on principal component analysis. eLight 3 , 4 (2023)..

Smith, C. S. et al. Structured illumination microscopy with noise-controlled image reconstructions. Nat. Methods 18 , 821–828 (2021)..

Airy Technology Co. Ltd. Airy Polar-SIM TM . at http://www.airy-tech.cn/ http://www.airy-tech.cn/ (2023).

Xu, X. Z. et al. Dataset of ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structure illumination microscopy, 1003. at https://doi.org/10.6084/m9.figshare.24054219.v3 https://doi.org/10.6084/m9.figshare.24054219.v3 (2023).

Wicker, K. et al. Phase optimisation for structured illumination microscopy. Opt. Express 21 , 2032–2049 (2013)..

Qin, J. S. et al. ER-mitochondria contacts promote mtDNA nucleoids active transportation via mitochondrial dynamic tubulation. Nat. Commun. 11 , 4471 (2020)..

Arganda-Carreras, I. et al. Trainable Weka Segmentation: a machine learning tool for microscopy pixel classification. Bioinformatics 33 , 2424–2426 (2017)..

Liu, T. Y. et al. Multi-color live-cell STED nanoscopy of mitochondria with a gentle inner membrane stain. Proc. Natl Acad. Sci. USA 119 , e2215799119 (2022)..

Cao, R. J. et al. Open-3DSIM: an open-source three-dimensional structured illumination microscopy reconstruction platform. Nat. Methods 20 , 1183–1186 (2023)..

He, C. et al. Polarisation optics for biomedical and clinical applications: a review. Light Sci. Appl. 10 , 194 (2021)..

Li, M. Q. et al. Structured illumination microscopy using digital micro-mirror device and coherent light source. Appl. Phys. Lett. 116 , 233702 (2020)..

Dan, D. et al. DMD-based LED-illumination Super-resolution and optical sectioning microscopy. Sci. Rep. 3 , 1116 (2013)..

Chen, Y. H. et al. Widefield and total internal reflection fluorescent structured illumination microscopy with scanning galvo mirrors. J. Biomed. Opt. 23 , 046007 (2018)..

Liu, W. J. et al. Three-dimensional super-resolution imaging of live whole cells using galvanometer-based structured illumination microscopy. Opt. Express 27 , 7237–7248 (2019)..

Yuan, Y. F. et al. Dual-color simultaneous structured illumination microscopy based on galvo-mirrors. Opt. Commun. 511 , 128012 (2022)..

Xu, F. H. et al. Real-time reconstruction using electro-optics modulator-based structured illumination microscopy. Opt. Express 30 , 13238–13251 (2022)..

Hinsdale, T. A., Stallinga, S. & Rieger, B. High-speed multicolor structured illumination microsc opy using a hexagonal single mode fiber array. Biomed. Opt. Express 12 , 1181–1194 (2021)..

Samanta, K. et al. Transmission structured illumination microscopy with tunable frequency illumination using tilt mirror assembly. Sci. Rep. 13 , 1453 (2023)..

Gustafsson, M. G. L., Agard, D. A. & Sedat, J. W. Doubling the lateral resolution of wide-field fluorescence microscopy using structured illumination. Proceedings of SPIE 3919, three-dimensional and multidimensional microscopy: image acquisition processing Ⅶ. San Jose: SPIE, 141–150, https://doi.org/10.1117/12.384189 https://doi.org/10.1117/12.384189 (2000).

Heintzmann, R. & Cremer, C. G. Laterally modulated excitation microscopy: improvement of resolution by using a diffraction grating. Proceedings of SPIE 3568, Optical Biopsies and Microscopic Techniques Ⅲ. Stockholm: SPIE, 185–196, https://doi.org/10.1117/12.336833 https://doi.org/10.1117/12.336833 (1999).

Gu, L. S. et al. Molecular resolution imaging by repetitive optical selective exposure. Nat. Methods 16 , 1114–1118 (2019)..

Cnossen, J. et al. Localization microscopy at doubled preci sion with patterned illumination. Nat. Methods 17 , 59–63 (2020)..

Qiao, L. et al. Laterally swept light-sheet microscopy enhanced by pixel reassignment for photon-efficient volumetric imaging. Adv. Photonics Nexus 2 , 016001 (2023)..

Feng, R. L. et al. Protocol for constructing a versatile tiling light sheet microscope for imaging cleared tissues. STAR Protoc. 2 , 100546 (2021)..

Wang, Z. J. et al. Rapid, artifact-reduced, image reconstruction for super-resolution structured illumination microscopy. Innovation 4 , 100425 (2023)..

Mudry, E. et al. Structured illumination microscopy using unknown speckle patterns. Nat. Photonics 6 , 312–315 (2012)..

Wen, G. et al. Spectrum-optimized direct image reconstruction of super-resolution structured illumination microscopy. PhotoniX 4 , 19 (2023)..

Mandracchia, B. et al. Fast and accurate sCMOS noise correction for fluorescence microscopy. Nat. Commun. 11 , 94 (2020)..

Hou, Y. W. et al. Noise-robust, physical microscopic deconvolution algorithm enabled by multi-resolution analysis regularization. Print at https://doi.org/10.1101/2023.03.02.530744 https://doi.org/10.1101/2023.03.02.530744 (2023).

Qiao, C. et al. Evaluation and development of deep neural networks for image super-resolution in optical microscopy. Nat. Methods 18 , 194–202 (2021)..

Huang, F. et al. Video-rate nanoscopy using sCMOS camera–specific single-molecule localization algorithms. Nat. Methods 10 ,653–658 (2013)..

Zhao, W. S. et al. Quantitatively mapping local quality of super-resolution microscopy by rolling Fourier ring correlation. Light Sci. Appl. 12 , 298 (2023)..

Tomer, R. et al. Quantitative high-speed imaging of entire developing embryos with simultaneous multiview light-sheet microscopy. Nat. Methods 9 , 755–763 (2012)..

Voigt, F. F. et al. The mesoSPIM initiative: open-source light-sheet microscopes for imaging cleared tissue. Nat. Methods 16 , 1105–1108 (2019)..

Zong, W. J. et al. Large-field high-resolution two-photon digital scanned light-sheet microscopy. Cell Res. 25 , 254–257 (2015)..

Dertinger, T. et al. Fast, background-free, 3D super-resolution optical fluctuation imaging (SOFI). Proc. Natl Acad. Sci. USA 106 , 22287–22292 (2009)..

Sun, J. S. et al. High-speed Fourier ptychographic microscopy based on programmable annular illuminations. Sci. Rep. 8 , 7669 (2018)..

Song, S. et al. Large-area, high-resolution birefringence imaging with polarization-sensitive Fourier ptychographic microscopy. ACS Photonics 8 , 158–165 (2021)..

Rodrigo, J. A., Soto, J. M. & Alieva, T. Fast label-free microscopy technique for 3D dynamic quantitative imaging of living cells. Biomed. Opt. Express 8 , 5507–5517 (2017)..

Weber, M. et al. MINSTED nanoscopy enters the Ångström localization range. Nat. Biotechnol. 41 , 569–576 (2023)..

Chen, X. Z. et al. Superior performance with sCMOS over EMCCD in super-resolution optical fluctuation imaging. J. Biomed. Opt. 21 , 066007 (2016)..

Fordey, T. et al. Single-shot three-dimensional orientation imaging of nanorods using spin to orbital angular momentum conversion. Nano Lett. 21 , 7244–7251 (2021)..

Wang, H. Q. et al. Enhancement of signal-to-noise ratio for fluorescence endoscope image based on fast digital lock-in algorithm. R. Soc. Open Sci. 8 , 200779 (2021)..

Wang, H. Q. et al. Signal-to-noise ratio analysis and improvement for fluorescence tomography imaging. Rev. Sci. Instrum. 89 , 093114 (2018)..

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰