1.Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China
2.School of Electronics and Information Engineering, Sichuan University, Chengdu 610065, China
3.Department of Precision Instruments, Tsinghua University, 100084 Beijing, China
Ni Chen (nichen@eee.hku.hk)
Jun Wang (jwang@scu.edu.cn)
Edmund Y. Lam (elam@eee.hku.hk)
收稿日期:2024-10-15,
修回日期:2025-05-24,
录用日期:2025-05-31,
网络出版日期:2025-07-07,
纸质出版日期:2025-09-30
Scan QR Code
Uncertainty-aware Fourier ptychography[J]. LSA, 2025,14(9):2514-2529.
Chen, N. et al. Uncertainty-aware Fourier ptychography. Light: Science & Applications, 14, 2514-2529 (2025).
Uncertainty-aware Fourier ptychography[J]. LSA, 2025,14(9):2514-2529. DOI: 10.1038/s41377-025-01915-w.
Chen, N. et al. Uncertainty-aware Fourier ptychography. Light: Science & Applications, 14, 2514-2529 (2025). DOI: 10.1038/s41377-025-01915-w.
Fourier ptychography (FP) offers both wide field-of-view and high-resolution holographic imaging
making it valuable for applications ranging from microscopy and X-ray imaging to remote sensing. However
its practical implementation remains challenging due to the requirement for precise numerical forward models that accurately represent real-world imaging systems. This sensitivity to model-reality mismatches makes FP vulnerable to physical uncertainties
including misalignment
optical element aberrations
and data quality limitations. Conventional approaches address these challenges through separate methods: manual calibration or digital correction for misalignment; pupil or probe reconstruction to mitigate aberrations; or data quality enhancement through exposure adjustments or high dynamic range (HDR) techniques. Critically
these methods cannot simultaneously address the interconnected uncertainties that collectively degrade imaging performance. We introduce Uncertainty-Aware FP (UA-FP)
a comprehensive framework that simultaneously addresses multiple system uncertainties without requiring complex calibration and data collection procedures. Our approach develops a fully differentiable forward imaging model that incorporates deterministic uncertainties (misalignment and optical aberrations) as optimizable parameters
while leveraging differentiable optimization with domain-specific priors to address stochastic uncertainties (noise and data quality limitations). Experimental results demonstrate that UA-FP achieves superior reconstruction quality under challenging conditions. The method maintains robust performance with reduced sub-spectrum overlap requirements and retains high-quality reconstructions even with low bit sensor data. Beyond improving image reconstruction
our approach enhances system reconfigurability and extends FP's capabilities as a measurement tool suitable for operation in environments where precise alignment and calibration are impractical.
Ou, X. Z. et al. Aperture scanning Fourier ptychographic microscopy. Biomed. Opt. Expr. 7 , 3140–3150 (2016)..
Holloway, J. et al. SAVI: Synthetic apertures for long-range, subdiffraction-limited visible imaging using Fourier ptychography. Sci. Adv. 3 , e1602564 (2017)..
Li, S. et al. Far field synthetic aperture imaging via fourier ptychography with quasi plane wave illumination. Adv. Photonics Res. 4 , 2300180 (2023)..
Zhang, Q. et al. First realization of macroscopic Fourier ptyc hography for hundred-meter distance sub-diffraction imaging Print at https://doi.org/10.48550/arXiv.2310.14515 https://doi.org/10.48550/arXiv.2310.14515 (2023).
Li, S. et al. Snapshot macroscopic Fourier ptychography: far-field synthetic aperture imaging via illumination multiplexing and camera array acquisition. Adv. Imaging 1 , 011005 (2024)..
Jiang, S. W. et al. Resolution-enhanced parallel coded ptychography for high-throughput optical imaging. ACS Photonics 8 , 3261–3271 (2021)..
Sun, J. S. et al. High-speed Fourier ptychographic microscopy based on programmable annular illuminations. Sci. Rep. 8 , 7669 (2018)..
Lee, B. et al. Single-shot phase retrieval via Fourier ptychographic microscopy. Optica 5 , 976–983 (2018)..
Wang, C. Y. et al. Snapshot ptychography on array cameras. Opt. Express 30 , 2585–2598 (2022)..
Chen, N. & Brady, D. J. Ptychographic wavefront cameras. Opt. Lett. 49 , 6653–6656 (2024)..
Park, Y., Depeursinge, C. & Popescu, G. Quantitative phase imaging in biomedicine. Nat. Photonics 12 , 578–589 (2018)..
Pan, A., Zuo, C. & Yao, B. L. High-resolution and large field-of-view Fourier ptychographic microscopy and its applications in biomedicine. Rep. Prog. Phys. 83 , 096101 (2020)..
Shu, Y. F. et al. Adaptive optical quantitative phase imaging based on annular illumination fourier ptychographic microscopy. PhotoniX 3 , 24 (2022)..
Fan, Y. et al. Efficient synthetic aperture for phaseless Fourier ptychographic microscopy with hybrid coherent and incoherent illumination. Laser Photonics Rev. 17 , 2200201 (2023)..
Chung, J. et al. Computational aberration compensation by coded-aperture-based correction of aberration obtained from optical Fourier coding and blur estimation. Optica 6 , 647–661 (2019)..
Zhang, S. H. et al. FPM-WSI: Fourier ptychographic whole slide imaging via feature-domain backdiffraction. Optica 11 , 634–646 (2024)..
Wu, H. et al. Wavelet-forward family enabling stitching-free full-field fourier ptychographic microscopy. Laser Photonics Rev. 19 , 2401183 (2025)..
Nashed, Y. S. G. et al. Distributed automatic differentiation for ptychography. Procedia Comput. Sci. 108 , 404–414 (2017)..
Ghosh, S. et al. ADP: Automatic differentiation ptychography. Proceedings of 2018 IEEE International Conference on Computational Photography (ICCP), Pittsburgh, PA, USA, IEEE, (2018), 1–10, https://doi.org/10.1109/ICCPHOT.2018.8368470 https://doi.org/10.1109/ICCPHOT.2018.8368470
Du, M. et al. Adorym: A multi-platform generic x-ray image reconstruction framework based on automatic differentiation. Opt. Expr. 29 , 10000–10035 (2021)..
Seifert, J. et al. Efficient and flexible approach to ptychography using an optimization framework based on automatic differentiation. OSA Contin. 4 , 121–128 (2021)..
Shao, Y. F. et al. Wavelength-multiplexed multi-mode euv reflection ptychography based on automatic differentiation. Light Sci. Appl. 13 , 196 (2024)..
Pan, A. et al. System calibration method for Fourier ptychographic microscopy. J. Biomed. Opt. 22 , 096005 (2017)..
Sun, J. S. et al. Efficient positional misalignment correction method for fourier ptychographic microscopy. Biomed. Opt. Expr. 7 , 1336–1350 (2016)..
Liu, J. et al. Stable and robust frequency domain position compensation strategy for Fourier ptychographic microscopy. Opt. Expr. 25 , 28053–28067 (2017)..
Ou, X. Z., Zheng, G. A. & Yang, C. Embedded pupil function recovery for Fourier ptychographic microscopy. Opt. Expr. 22 , 4960–4792 (2014)..
Yeh, L. H. et al. Experimental robustness of Fourier ptychography phase retrieval algorithms. Opt. Expr. 23 , 33214–33240 (2015)..
Nguyen, T. et al. Deep learning approach for Fourier ptychography microscopy. Opt. Expr. 26 , 26470–26484 (2018)..
Zhang, J. Z. et al. Fourier ptychographic microscopy reconstruction wit h multiscale deep residual network. Opt. Expr. 27 , 8612–8625 (2019)..
Bianco, V. et al. Deep learning-based, misalignment resilient, real-time Fourier ptychographic microscopy reconstruction of biological tissue slides. IEEE J. Sel. Top. Quantum Electron. 28 , 6800110 (2022)..
Yin, S. Y. et al. Can deep neural networks work with amplitude and phase input of defocused images? Opt. Expr. 32 , 25036–25045 (2024)..
Jiang, S. W. et al. Solving Fourier ptychographic imaging problems via neural network modeling and tensorflow. Biomed. Opt. Expr. 9 , 3306–3319 (2018)..
Sun, M. L. et al. Neural network model combined with pupil recovery for Fourier ptychographic microscopy. Opt. Expr. s 27 , 24161–24174 (2019)..
Zhang, J. L. et al. Forward imaging neural network with correction of positional misalignment for fourier ptychographic microscopy. Opt. Express 28 , 23164–23175 (2020)..
Aidukas, T. et al. Applications and extensions of Fourier ptychography. Microsc. Today 30 , 40–45 (2022)..
Wang, A. Y. et al. Fourier ptychographic microscopy via alternating direction method of multipliers. Cells 11 , 1512 (2022)..
Maiden, A., Johnson, D. & Li, P. Further improvements to the ptychographical iterative engine. Optica 4 , 736–745 (2017)..
Zhou, A. et al. Fast and robust misalignment correction of Fourier ptychographic microscopy for full field of view reconstruction. Opt. Express 26 , 23661–23674 (2018)..
Jiang, S. W. et al. Spatial- and fourier-domain ptychography for high-throughput bio-imaging. Nat. Protoc. 18 , 2051–2083 (2023)..
Zhao, W. S. et al. Sparse deconvolution improves the resolution of live-cell super-resolution fluorescence microscopy. Nat. Biotechnol. 40 , 606–617 (2022)..
Wolter, H. V on basic analogies and principal differences between optical and electronic information , vol. 1, 155–210 (Elsevier, 1961).
Goodman, J. W. Introduction to Fourier Optics. 3rd edn. (Roberts&Co, Englewood, Colo, 2005).
Seifert, J. et al. Maximum-likelihood estimation in ptychography in the presence of poisson–gaussian noise statistics. Opt. Lett. 48 , 6027–6030 (2023)..
Chen, N., Brady, D. J. & Lam, E. Y. Differentiable imaging: progress, challenges, and outlook (2025). Preprint at https://doi.org/10.1364/opticaopen.28423673 https://doi.org/10.1364/opticaopen.28423673 .
Chen, N., Wang, C. L. & Heidrich, W. ∂ H : differentiable holography. Laser Photonics Rev. 17 , 2200828 (2023)..
Wu, Y. et al. Single-shot high-density volumetric particle imaging enabled by differentiable holography. IEEE Trans. Ind. Inform. 20 , 13696–13706 (2024)..
Wang, J. B. et al. Align-free multi-plane phase retrieval. Opt. Laser Technol. 181 , 111784 (2025)..
Chen, N. & Lam, E. Y. Differentiable pixel-super-resolution lensless imaging. Opt. Lett. 50 , 1180–1183 (2025)..
Chen, N. et al. Differentiable imaging: A new tool for computational optical imaging. Adv. Phys. Res. 2 , 2200118 (2023)..
Whittaker, E. T. & Watson, G. N. A Course of Modern Analysis . 4 edn. (Cambridge: Cambridge University Press, 1996).
Zhang, S. H., Berendschot, T. T. J. M. & Zhou, J. H. Elfpie: an error-laxity Fourier ptychographic iterative engine. Signal Process. 210 , 109088 (2023)..
0
浏览量
0
Downloads
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621