Optoelectronic array of photodiodes integrated with RRAMs for energy-efficient in-sensor computing

Wen Pan; Lai Wang; Jianshi Tang; Heyi Huang; Zhibiao Hao; Changzheng Sun; Bing Xiong; Jian Wang; Yanjun Han; Hongtao Li; Lin Gan; Yi Luo

doi:10.1038/s41377-025-01743-y

Go to Nature Website

Your Location：

Home >

Browse articles >

Optoelectronic array of photodiodes integrated with RRAMs for energy-efficient in-sensor computing

Original Articles

- Optoelectronic array of photodiodes integrated with RRAMs for energy-efficient in-sensor computing
- Light: Science & Applications Vol. 14, Issue 2, Pages: 430-440(2025)
- Affiliations：
  
  1.Department of Electronic Engineering, Tsinghua University, Beijing, China
  2.Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
  3.School of Integrated Circuits, Tsinghua University, Beijing 100084, China
- Author bio：
  
  Lai Wang (wanglai@tsinghua.edu.cn)
- Funds：
- DOI：10.1038/s41377-025-01743-y
  CLC：
- Received：12 April 2024，
  
  Revised：13 December 2024，
  
  Accepted：2025-01-02，
  
  Published Online：15 January 2025，
  
  Published：28 February 2025
- Accepted：
Scan QR Code
Pan, W. et al. Optoelectronic array of photodiodes integrated with RRAMs for energy-efficient in-sensor computing. Light: Science & Applications, 14, 430-440 (2025).
DOI：

Pan, W. et al. Optoelectronic array of photodiodes integrated with RRAMs for energy-efficient in-sensor computing. Light: Science & Applications, 14, 430-440 (2025). DOI： 10.1038/s41377-025-01743-y.

摘要

Abstract

The rapid development of internet of things (IoT) urgently needs edge miniaturized computing devices with high efficiency and low-power consumption. In-sensor computing has emerged as a promising technology to enable in-situ data processing within the sensor array. Here

we report an optoelectronic array for in-sensor computing by integrating photodiodes (PDs) with resistive random-access memories (RRAMs). The PD-RRAM unit cell exhibits reconfigurable optoelectronic output and photo-responsivity by programming RRAMs into different resistance states. Furthermore

a 3 × 3 PD-RRAM array is fabricated to demonstrate optical image recognition

achieving a universal architecture with ultralow latency and low power consumption. This study highlights the great potential of the PD-RRAM optoelectronic array as an energy-efficient in-sensor computing primitive for future IoT applications.

关键词

Keywords

references

Zhou, F. C. et al. Low-voltage, optoelectronic CH 3 NH 3 PbI 3− x Cl x memory with integrated sensing and logic operations. Adv. Funct. Mater. 28 , 1800080 (2018)..

Chen, Z. G. & Segev, M. Highlighting photonics: looking into the next decade. eLight 1 , 2 (2021)..

Zhou, Z. C. et al. Prospects and applications of on-chip lasers. eLight 3 , 1 (2023)..

Fan, Z. B. et al. Integral imaging near-eye 3D display using a nanoimprint metalens array. eLight 4 , 3 (2024)..

Zeng, K. B. et al. Synthesized complex-frequency excitation for ultrasensitive molecular sensing. eLight 4 , 1 (2024)..

Sun, L. F. et al. In-sensor reservoir computing for language learning via two-dimensional memristors. Sci. Adv. 7 , eabg1455 (2021)..

Zhou, F. C. & Chai, Y. Near-sensor and in-sensor computing. Nat. Electron. 3 , 664–671 (2020)..

Yang, X. H. et al. Breaking the energy-efficiency barriers for smart sensing applications with "sensing with computing" architectures. Sci. China Inf. Sci. 66 , 200409 (2023)..

Pan, W. et al. A future perspective on in-sensor computing. Engineering 14 , 19–21 (2022)..

Cui, B. Y. et al. Ferroelectric photosensor network: an advanced hardware solution to real-time machine vision. Nat. Commun. 13 , 1707 (2022)..

Wu, N. J. Neuromorphic vision chips. Sci. China Inf. Sci. 61 , 060421 (2018)..

Komuro, T., Kagami, S. & Ishikawa, M. A dynamically reconfigurable S IMD processor for a vision chip. IEEE J. Solid-State Circuits 39 , 265–268 (2004)..

Jendernalik, W. et al. An analog sub-miliwatt CMOS image sensor with pixel-level convolution processing. IEEE Trans. Circuits Syst. I: Regul. Pap. 60 , 279–289 (2013)..

Shi, C. et al. A 1000 fps vision chip based on a dynamically reconfigurable hybrid architecture comprising a PE array processor and self-organizing map neural network. IEEE J. Solid-State Circuits 49 , 2067–2082 (2014)..

Yang, L. Q. et al. A 1.2 V, 3.1% 3σ-accuracy thermal sensor analog front-end circuit in 12 nm CMOS process. J. Semicond. 42 , 032401 (2021)..

Yamazaki, T. et al. 4.9 A 1ms high-speed vision chip with 3D-stacked 140GOPS column-parallel PEs for spatio-temporalimage processing. In : Proceedings of the 2017 IEEE International Solid-State Circuits Conference. San Francisco, CA, USA: IEEE, 82–3 (2017).

Zhang, Z. F. et al. In-sensor reservoir computing system for latent fingerprint recognition with deep ultraviolet photo-synapses and memristor array. Nat. Commun. 13 , 6590 (2022 )..

Chu, M. et al. Neuromorphic hardware system for visual pattern recognition with memristor array and CMOS neuron. IEEE Trans. Ind. Electron. 62 , 2410–2419 (2015)..

Li, C. et al. Analogue signal and image processing with large memristor crossbars. Nat. Electron. 1 , 52–59 (2018)..

Wang, M. et al. Gesture recognition using a bioinspired learning architecture that integrates visual data with somatosensory data from stretchable sensors. Nat. Electron. 3 , 563–570 (2020)..

Wang, S. et al. Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception. Natl Sci. Rev. 8 , nwaa172 (2021)..

Tong, L. et al. 2D materials–based homogeneous transistor-memory architecture for neuromorphic hardware. Science 373 , 1353–1358 (2021)..

Zhang, J. Y. et al. Recent progress in photonic synapses for neuromorphic systems. Adv. Intell. Syst. 2 , 1900136 (2 020)..

Dai, S. L. et al. Light-stimulated synaptic devices utilizing interfacial effect of organic field-effect transistors. ACS Appl. Mater. Interfaces 10 , 21472–21480 (2018)..

Gao, S. et al. An oxide schottky junction artificial optoelectronic synapse. ACS Nano 13 , 2634–2642 (2019)..

Hu, D. C. et al. Memristive synapses with photoelectric plasticity realized in ZnO 1- x /AlO y heterojunction. ACS Appl. Mater. Interfaces 10 , 6463–6470 (2018)..

Kumar, M., Abbas, S. & Kim, J. All-oxide-based highly transparent photonic synapse for neuromorphic computing. ACS Appl. Mater. Interfaces 10 , 34370–34376 (2018)..

Lee, M. et al. Brain-inspired photonic neuromorphic devices using photodynamic amorphous oxide semiconductors and their persistent photoconductivity. Adv. Mater. 29 , 1700951 (2017)..

Wu, J. Y. et al. Broadband MoS 2 field-eff ect phototransistors: ultrasensitive visible-light photoresponse and negative infrared photoresponse. Adv. Mater. 30 , 1705880 (2018)..

Fu, X. et al. Graphene/MoS 2- x O x /graphene photomemristor with tunable non-volatile responsivities for neuromorphic vision processing. Light Sci. Appl. 12 , 39 (2023)..

Qu, T. Y. et al. A flexible carbon nanotube sen-memory device. Adv. Mater. 32 , e1907288 (2020)..

Dang, B. J. et al. Physically transient optic-neural synapse for secure in-sensor computing. IEEE Electron Device Lett. 41 , 1641–1644 (2020)..

Liu, W. Z. et al. Self-powered and broadband opto-sensor with bionic visual adaptation function based on multilayer γ-InSe flakes. Light Sci. Appl. 12 , 180 (2023)..

Wang, S. J.et al. An organic electrochemical transistor for multi-modal sensing, memory and processing. Nat. Electron. 6 , 281–291 (2023)..

Lee, S. et al. Programmable black phosphorus image sensor for broadband optoelectronic edge computing. Nat. Commun. 13 , 1485 (2022)..

Jang, H. et al. In-sensor optoelectronic computing using electrostatically doped silicon. Nat. Electron. 5 , 519–525 (2022)..

Mennel, L. et al. Ultrafast machine vision with 2D material neural network image sensors. Nature 579 , 62–66 (2020)..

Rao, M. Y. et al. Thousands of conductance levels in memristors integrated on CMOS. Nature 615 , 823–829, (2023)..

Zhang, W. B. et al. Analog-type resistive switching devices for neuromorphic computing. Phys. Status Solidi (RRL)-Rapid Res. Lett. 13 , 1900204 (2019)..

Bertaud, T. et al. In-operando and non-destructive analysis of the resistive switching in the Ti/HfO 2 /TiN-based system by hard x-ray photoelectron spectroscopy. Appl. Phys. Lett. 101 , 143501 (2012)..

Wu, W. et al. Improving analog switching in HfO x -based resistive memory with a thermal enhanced layer. IEEE Electron Device Lett. 38 , 1019–1022 (2017)..

Roy, S. et al. Toward a reliable synaptic simulation using Al-doped HfO 2 RRAM. ACS Appl. Mater. Interfaces 12 , 10648–10656 (2020)..

Wang, C. X. et al. HfO x /AlO y superlattice-like memristive synapse. Adv. Sci. 9 , e2201446 (2022)..

Woo, J. et al. Improved synaptic behavior under identical pulses using AlO x /HfO 2 bilayer RRAM array for neuromorphic systems. IEEE Electron Device Lett. 37 , 994–997 (2016)..

Woo, J. et al. Linking conductive filament properties and evolution to synaptic behavior of RRAM devices for neuromorphic applications. IEEE Electron Device Lett. 38 , 1220–1223 (2017)..

Mahata, C. et al. Resistive switching and synaptic behaviors of an HfO 2 /Al 2 O 3 stack on ITO for neuromorphic systems. J. Alloy. Compd. 826 , 154434 (2020)..

Jiang, H. et al. Sub-10 nm Ta channel responsible for superior performance of a HfO 2 memristor. Sci. Rep. 6 , 28525 (2016)..

Wang, Q. et al. Low-cost dual-stage offset-cancelled sense amplifier with hybrid read reference generator for improved read performance of RRAM at advanced technology nodes. J. Semicond. 42 , 082401 (2021)..

Zahoor, F., Azni Zulkifli, T. Z. & Khanday, F. A. Resistive Random Access Memory (RRAM): an overview of materials, switching mechanism, performance, multilevel cell (mlc) storage, modeling, and applications. Nanoscale Res. Lett. 15 , 90 (2020)..

Yao, P. et al. Face classification using electronic synapses. Nat. Commun. 8 , 15199 (2017)..

Pan, W. et al. An encoded photodetector array for high-frame-rate compressed sensing and computational imaging. IEEE Sens. J. 1–1, https://doi.org/10.1109/JSEN.2024.3506937 (2024).

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰