Infrared visualized snakes-inspired artificial vision systems with CMOS sensors-integrated upconverters

Ge Mu; Yangye Lin; Kerui Fu; Xin Tang

doi:10.1038/s41377-025-02001-x

Your Location：

Home >

Browse articles >

Infrared visualized snakes-inspired artificial vision systems with CMOS sensors-integrated upconverters

Original Articles

- Infrared visualized snakes-inspired artificial vision systems with CMOS sensors-integrated upconverters
- Light: Science & Applications Vol. 14, Issue 10, Pages: 3035-3044(2025)
- Affiliations：
  
  1.School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
  2.Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, Beijing 100081, China
  3.Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing 314019, China
- Author bio：
  
  Ge Mu (gemu@bit.edu.cn)
  Xin Tang (xintang@bit.edu.cn)
- Funds：
- DOI：10.1038/s41377-025-02001-x
  CLC：
- Received：05 January 2025，
  
  Revised：2025-07-26，
  
  Accepted：04 August 2025，
  
  Published Online：20 August 2025，
  
  Published：31 October 2025
- Accepted：
Scan QR Code
Mu, G. et al. Infrared visualized snakes-inspired artificial vision systems with CMOS sensors-integrated upconverters. Light: Science & Applications, 14, 3035-3044 (2025).
DOI：

Mu, G. et al. Infrared visualized snakes-inspired artificial vision systems with CMOS sensors-integrated upconverters. Light: Science & Applications, 14, 3035-3044 (2025). DOI： 10.1038/s41377-025-02001-x.

摘要

Abstract

Biological visions have inspired the development of artificial vision systems with diverse visual functional traits

however

the detected wavelength is only in visible light between 0.4 and 0.78 μm

restricting their applications. Snakes generate a thermal image of animals due to pit organs for detecting and converting infrared

allowing them to accurately target predators or prey even under darkness. Inspired by natural infrared visualized snakes

we propose artificial vision systems with CMOS sensors-integrated upconverters to break visible light limitations to realize 3840 × 2160 ultra-high-resolution short-wave infrared (SWIR) and mid-wave infrared (MWIR) visualization imaging for the first time. Through colloidal quantum dot barrier heterojunction architecture design of infrared detecting units and the introduction of co-hosted emitting units

the luminance and upconversion efficiency reach up to 6388.09 cd m

−2

and 6.41% for SWIR

1311.64 cd m

−2

and 4.06% for MWIR at room temperature. Our artificial vision systems broaden a wide spectrum of applications within infrared

such as night vision

agricultural science

and industry inspection

marking a significant advance in bioartificial vision.

关键词

Keywords

references

Gu, L. L. et al. A biomimetic eye with a hemispherical perovskite nanowire array retina. Nature 581 , 278–282 (2020)..

Kim, M. et al. An aquatic-vision-inspired camera based on a monocentric lens and a silicon nanorod photodiode array. Nat. Electron. 3 , 546–553 (2020)..

Kim, M. S. et al. Feline eye–inspired artificial vision for enhanced camouflage breaking under diverse light conditions. Sci. Adv. 10 , eadp2809 (2024)..

Park, J. et al. Avian eye–inspired perovskite artificial vision system for foveated and multispectral imaging. Sci. Robot. 9 , eadk6903 (2024)..

Lee, M. et al. An amphibious artificial vision system with a panoramic visual field. Nat. Electron. 5 , 452–459 (2022)..

Gracheva, E. O. et al. Molecular basis of infrared detection by snakes. Nature 464 , 1006–1011 (2010)..

Beneking, H., Grote, N. & Svilans, M. N. Monolithic GaAlAs/GaAs infrared-to-visible wavelength converter with optical power amplification. IEEE Trans. Electron Devices 28 , 404–407 (1981)..

Chu, X. B. et al. Improved efficiency of organic/inorganic hybrid near-infrared light upconverter by device optimization. ACS Appl. Mater. Interfaces 4 , 4976–4980 (2012)..

Shih, C. J. et al. Transparent organic upconversion device targeting high-grade infrared visual image. Nano Energy 86 , 106043 (2021)..

Mu, G. et al. Ultrasensitive colloidal quantum-dot upconverters for extended short-wave infrared. ACS Appl. Mater. Interfaces 14 , 45553–45561 (2022)..

Zhou, W. J. et al. Solution-processed upconversion photodetectors based on quantum dots. Nat. Electron. 3 , 251–258 (2020)..

Sergeeva, K. A. et al. The rise of hgte colloidal quantum dots for infrared optoelectronics. Adv. Funct. Mater. 34 , 2405307 (2024)..

Tang, X., Ackerman, M. M. & Guyot-Sionnest, P. Thermal imaging with plasmon resonance enhanced hgte colloidal quantum dot photovoltaic devices. ACS Nano 12 , 7362–7370 (2018)..

Ackerman, M. M., Tang, X. & Guyot-Sionnest, P. Fast and sensitive colloidal quantum dot mid-wave infrared photodetectors. ACS Nano 12 , 7264–7271 (2018)..

Wang, B. B. et al. Synergism in binary nanocrystals enables top-illuminated hgte colloidal quantum dot short-wave infrared imager. Nano Lett. 24 , 9583–9590 https://doi.org/10.1021/acs.nanolett.4c02235 (2024)..

Keuleyan, S. et al. Mid-infrared HgTe colloidal quantum dot photodetectors. Nat. Photonics 5 , 489–493 (2011)..

Rota, M. B. et al. A source of entangled photons based on a cavity-enhanced and str ain-tuned GaAs quantum dot. eLight 4 , 13 (2024)..

Tang, X. et al. Dual-band infrared imaging using stacked colloidal quantum dot photodiodes. Nat. Photonics 13 , 277–282 (2019)..

Chen, Y. F. et al. Unipolar barrier photodetectors based on van der Waals heterostructures. Nat. Electron. 4 , 357–363 (2021)..

Rogalski, A. & Martyniuk, P. Mid-wavelength infrared n B n for HOT detectors. J. Electron. Mater. 43 , 2963–2969 (2014)..

Xue, X. M. et al. High-operating-temperature mid-infrared photodetectors via quantum dot gradient homojunction. Light Sci. Appl. 12 , 2 https://doi.org/10.1038/s41377-022-01014-0 (2023)..

Khai, L. W. et al. Room temperature 3.5-μm mid-infrared InAs photovoltaic detector on a Si substrate. IEEE Photonics Technol. Lett. 28 , 1653–1656 (2016)..

Xie, H. et al. Room-temperature InAsSb pBin detectors for mid-infrared application. Infrared Phys. Technol. 128 , 104475 (2023)..

Peterson, J. C. & Guyot-Sionnest, P. Room-temperature 15% efficient mid-infrared hgte colloidal quantum dot photodiodes. ACS Appl. Mater. Interfaces 15 , 19163–19169 (2023)..

Yu, H. et al. High-gaininfrared-to-visible upconversion light-emitting phototransistors. Nat. Photonics 10 , 129–134 (2016)..

Shih, C. J. et al. Transparent organic upconversion devices displaying high-resolution, single-pixel, low-power infrared images perceived by human vision. Sci. Adv. 9 , eadd7526 (2023)..

Kwon, T. H. et al. Quantum dot-based three-stack tandem near-infrared-to-visible optoelectric upconversion devices. ACS Nano 18 , 21957–21965 https://doi.org/10.1021/acsnano.4c03206 (2024)..

Ding, H. et al. Microscale optoelectronic infrared-to-visible upconversion devices and their use as injectable light sources. Proc. Natl. Acad. Sci. USA 115 , 6632–6637 (2018)..

Tachibana, H. et al. Tunable full-color electroluminescence from all-organic optical upconversion devices by near-infrared sensing. ACS Photonics 4 , 223–227 (2017)..

Strassel, K. et al. Squaraine dye for a visibly transparent all-organic optical upconversion device with sensitivity at 1000 nm. ACS Appl. Mater. Interfaces 10 , 11063–11069 (2018)..

Strassel, K. et al. Solution-processed organic optical upconversion device. ACS Appl. Mater. Interfaces 11 , 23428–23435 (2019)..

Yu, B. H. et al. Sub-band gap turn-on near-infrared-to-visible up-conversion device enabled by an organic-inorganic hybrid perovskite photovoltaic absorber. ACS Appl. Mater. Interfaces 10 , 15920–15925 (2018)..

Li, N. et al. NIR to visible light upconversion devices comprising an nir charge generation layer and a perovskite emitter. Adv. Opt. Mater. 6 , 1801084 (2018)..

Yeddu, V. et al. Low-band-gap polymer-based infrared-to-visible upconversion organic light-emitting diodes with infrared sensitivity up to 1.1 μm. ACS Photonics 6 , 2368–2374 (2019)..

Li, N. et al. SWIR photodetection and visualization realized by incorporating an organic SWIR sensitive bulk heterojunction. Adv. Sci. 7 , 2000444 (2020)..

Choi, C. et al. Nanomaterial-based artificial vision systems: from bioinspired electronic eyes to in-sensor processing devices. ACS Nano 18 , 1241–1256 (2024)..

Mu, G. et al. Visible to mid-wave infrared PbS/HgTe colloidal quantum dot imagers. Nat. Photonics 18 , 1147–1154 (2024)..

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰