Skip to main content
SpringerLink
Log in

All-optically controlled memristor for dual-channel emotional circuit and its application

  • Regular Article
  • Published:
The European Physical Journal Plus Aims and scope Submit manuscript

Abstract

Most emotional neural network circuits only consider the generation of emotions, ignoring the effect of semantic linkage between different sensory channels on the intensity and rate of emotional generation. Inspired by the theory of multichannel information interaction and biological phenomena, this paper proposes an all-optically controlled memristive audio–visual dual-channel emotional circuit with semantic linkage. The circuit is mainly composed of a judgment module, an adjustment module and an emotion module. According to the input visual and auditory signals with different semantics, the circuit will output emotional signals with different intensities and generation rates. The feasibility and accuracy of the circuit are verified in PSpice. In addition, the circuit can be applied to the automotive anti-collision early warning system. The audio–visual dual-channel emotional circuit with semantic linkage based on all-optically controlled memristor may provide some reference for the construction of brain-like intelligent systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Data availability

No data were used for the research described in the article.

References

  1. X. Gao, J. Mou, S. Banerjee, Y. Zhang, Color-gray multi-image hybrid compression–encryption scheme based on BP neural network and knight tour. IEEE Trans. Cybern. 53(8), 5037–5047 (2023)

    Article  Google Scholar 

  2. H. Ngoubi, I. Sali, G.H. Ben-Bolie, T.C. Kofané, Complex Ginzburg–Landau equation in the modified Peyrard–Bishop–Dauxois model. Eur. Phys. J. Plus 138(9), 1–14 (2023)

    Article  Google Scholar 

  3. H. Yedjour, D. Yedjour, A spatiotemporal energy model based on spiking neurons for human motion perception. Cogn. Neurodyn. (2024). https://doi.org/10.1007/s11571-024-10068-2

    Article  Google Scholar 

  4. X. Liu, J. Mou, Y. Zhang, Y. Cao, A new hyperchaotic map based on discrete memristor and meminductor: dynamics analysis, encryption application, and DSP implementation. IEEE Trans. Ind. Electron. 71(5), 5094–5104 (2024)

    Article  Google Scholar 

  5. J. Sun, C. Li, Z. Wang, Y. Wang, A memristive fully connect neural network and application of medical image encryption based on central diffusion algorithm. IEEE Trans. Ind. Inform. (2024). https://doi.org/10.1109/TII.2023.3312405

    Article  Google Scholar 

  6. Y. Sha, J. Mou, S. Banerjee, Y. Zhang, Exploiting flexible and secure cryptographic technique for multi-dimensional image based on graph data structure and three-input majority gate. IEEE Trans. Ind. Inform. (2023). https://doi.org/10.1109/TII.2023.3281659

    Article  Google Scholar 

  7. H. Yu, Q. Zhao, Brain-inspired multisensory integration neural network for cross-modal recognition through spatiotemporal dynamics and deep learning. Cogn. Neurodyn. (2023). https://doi.org/10.1007/s11571-023-09932-4

    Article  Google Scholar 

  8. M. Guo, K. Zhao, J. Sun, S. Wen, G. Dou, Implementing bionic associate memory based on spiking signal. Inf. Sci. 649, 119613 (2023)

    Article  Google Scholar 

  9. J. Sun, G. Han, Z. Zeng, Y. Wang, Memristor-based neural network circuit of full-function Pavlov associative memory with time delay and variable learning rate. IEEE Trans. Cybern. 50(7), 2935–2945 (2020)

    Google Scholar 

  10. Q. Xu, X. Chen, B. Chen, H. Wu, Z. Li, H. Bao, Dynamical analysis of an improved FitzHugh–Nagumo neuron model with multiplier-free implementation. Nonlinear Dyn. 111(9), 8737–8749 (2023)

    Article  Google Scholar 

  11. J. Sun, Y. Zhai, P. Liu, Y. Wang, Memristor-based neural network circuit of associative memory with overshadowing and emotion congruent effect. IEEE Trans. Neural Netw. Learn. Syst. (2024). https://doi.org/10.1109/TNNLS.2023.3348553

    Article  Google Scholar 

  12. M. Guo, Y. Zhu, R. Liu, K. Zhao, G. Dou, An associative memory circuit based on physical memristors. Neurocomputing 472, 12–23 (2022)

    Article  Google Scholar 

  13. J. Mou, Z. Han, Y. Cao, S. Banerjee, Discrete second-order memristor and its application to chaotic map. IEEE Trans. Circuits Syst. II Express Briefs (2024). https://doi.org/10.1109/TCSII.2023.3348998

    Article  Google Scholar 

  14. J. Sun, Y. Xu, P. Liu, Y. Wang, Memristor-based neural network circuit of duple-reward and duple-punishment operant conditioning with time delay. IEEE Trans Circuits Syst. I Regul. Pap. 70(11), 4369–4379 (2023)

    Article  Google Scholar 

  15. C. Vigneswaran, S.S. Nair, V.S. Chakravarthy, A Basal Ganglia model for understanding working memory functions in healthy and Parkinson’s conditions. Cogn. Neurodyn. (2024). https://doi.org/10.1007/s11571-023-10056-y

    Article  Google Scholar 

  16. P. BeimGraben, S. Gerth, S. Vasishth, Towards dynamical system models of language-related brain potentials. Cogn. Neurodyn. 2, 229–255 (2008)

    Article  Google Scholar 

  17. Y. Zhang, J. Lv, Z. Zeng, The framework and memristive circuit design for multisensory mutual associative memory networks. IEEE Trans. Cybern. 53(12), 7844–7857 (2023)

    Article  Google Scholar 

  18. J. Sun, Y. Wang, P. Liu, S. Wen, Y. Wang, Memristor-based neural network circuit with multimode generalization and differentiation on Pavlov associative memory. IEEE Trans. Cybern. 53(5), 3351–3362 (2023)

    Article  Google Scholar 

  19. L. Wang, H. Zou, A new emotion model of associative memory neural network based on memristor. Neurocomputing 410(14), 83–92 (2020)

    Article  Google Scholar 

  20. K. Zheng, Y. Zhou, S. Duan, X. Hu, Memristive patch attention neural network for facial expression recognition and edge computing. Cogn. Neurodyn. (2023). https://doi.org/10.1007/s11571-023-10029-1

    Article  Google Scholar 

  21. L. Yang, C. Wang, Emotion model of associative memory possessing variable learning rates with time delay. Neurocomputing 460(14), 117–125 (2021)

    Article  Google Scholar 

  22. X. Ju, M. Li, W. Tian, D. Hu, EEG-based emotion recognition using a temporal-difference minimizing neural network. Cogn. Neurodyn. (2023). https://doi.org/10.1007/s11571-023-10004-w

    Article  Google Scholar 

  23. J. Sun, L. Zhao, S. Wen, Y. Wang, Memristor-based neural network circuit of emotional habituation with contextual dependency. IEEE Internet Things J. 10(19), 17382–17391 (2023)

    Article  Google Scholar 

  24. A. Goshvarpour, A. Goshvarpour, Lemniscate of Bernoulli’s map quantifiers: innovative measures for EEG emotion recognition. Cogn. Neurodyn. (2023). https://doi.org/10.1007/s11571-023-09968-6

    Article  Google Scholar 

  25. L. Li, Z. Zhao, Designing behaviors of robots based on the artificial emotion expression method in human–robot interactions. Machines 11(5), 533 (2023)

    Article  Google Scholar 

  26. D. Jiang, D. Jin, J. Zhuang, D. Tan, D. Chen, Y. Liang, A computational model of emotion based on audio-visual stimuli understanding and personalized regulation with concurrency. Concurr. Comput. 33(17), e6269 (2021)

    Article  Google Scholar 

  27. Z. Zhang, F. Tang, Y. Li, X. Feng, Modeling the grid cell activity based on cognitive space transformation. Cogn. Neurodyn. (2023). https://doi.org/10.1007/s11571-023-09972-w

    Article  Google Scholar 

  28. F. Han, Q. Wang, J. Su, Preface for special issue on nonlinear dynamics modeling and control for brain science and brain-like intelligence. Cogn. Neurodyn. (2023). https://doi.org/10.1007/s11571-023-09959-7

    Article  Google Scholar 

  29. Z. Wang, X. Wang, Z. Zeng, Memristive circuit design of brain-like emotional learning and generation. IEEE Trans. Cybern. 53(1), 222–235 (2023)

    Article  Google Scholar 

  30. Z. Wang, Q. Hong, X. Wang, Memristive circuit design of emotional generation and evolution based on skin-like sensory processor. IEEE Trans. Biomed. Circuits Syst. 13(4), 631–644 (2019)

    Article  MathSciNet  Google Scholar 

  31. J. Sun, J. Han, Y. Wang, P. Liu, Memristor-based neural network circuit of emotion congruent memory with mental fatigue and emotion inhibition. IEEE Trans. Biomed. Circuits Syst. 15(3), 606–616 (2021)

    Article  Google Scholar 

  32. H. Zhou, Z. Fei, Q. Hong, J. Sun, S. Du, T. Li, J. Zhang, Bionic dual-loop emotional learning circuit and its application in radiation early warning monitoring. IEEE Trans. Cogn. Dev. Syst. 15(3), 1191–1208 (2023)

    Article  Google Scholar 

  33. J. Sun, J. Yang, Y. Wang, P. Liu, Y. Sheng, Generalization and differentiation circuit design based on memristor under different emotional conditions. IEEE Trans. Circuits Syst. I Regul. Pap. 70(6), 2331–2341 (2023)

    Article  Google Scholar 

  34. C. Wang, C. Xu, J. Sun, Q. Deng, A memristor-based associative memory neural network circuit with emotion effect. Neural Comput. Appl. 35, 10929–10944 (2023)

    Article  Google Scholar 

  35. J.H. Venezia, W. Matchin, G. Hickok, Multisensory integration and audiovisual speech perception. Brain Mapp. Encycl. Ref. 2, 565–572 (2015)

    Article  Google Scholar 

  36. Y. Zhang, Y. Li, X. Wang, E.G. Friedman, Synaptic characteristics of Ag/AgInSbTe/Ta-based memristor for pattern recognition applications. IEEE Trans. Electron Devices 64(4), 1806–1811 (2017)

    Article  ADS  Google Scholar 

  37. Z. Ding, Z. Zeng, L. Wang, Robust finite-time stabilization of fractional-order neural networks with discontinuous and continuous activation functions under uncertainty. IEEE Trans. Neural Netw. Learn. Syst. 29(5), 1477–1490 (2018)

    Article  MathSciNet  Google Scholar 

  38. K. Deng, S. Zhu, W. Dai, C. Yang, S. Wen, New criteria on stability of dynamic memristor delayed cellular neural networks. IEEE Trans. Cybern. 52(6), 5367–5379 (2022)

    Article  Google Scholar 

  39. S. Wen, X. Xie, Y. Zheng, T. Huang, Z. Zeng, General memristor with applications in multilayer neural networks. Neural Netw. 103, 142–149 (2018)

    Article  Google Scholar 

  40. L. Hu, J. Yang, J. Wang, P. Cheng, L.O. Chua, F. Zhuge, All-optically controlled memristor for optoelectronic neuromorphic computing. Adv. Funct. Mater. 31(4), 2005582 (2021)

    Article  Google Scholar 

  41. V. Campos, B. Jou, X. Giró-i-Nieto, From pixels to sentiment: fine-tuning cnns for visual sentiment prediction. Image Vis. Comput. 65, 15–22 (2017)

    Article  Google Scholar 

  42. M.S. Likitha, S.R.R. Gupta, K. Hasitha, A.U. Raju, Speech based human emotion recognition using MFCC, in: 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET) 2257–2260 (2017)

  43. P. Sun, R. Song, H. Wang, Analysis of the causes of traffic accidents on roads and countermeasures. Saf. Environ. Eng. 14(2), 97–100 (2007)

    Google Scholar 

  44. Y. Pei, J. Ma, Research on countermeasures for road condition causes of traffic accidents. China J. Highw. Transport 16(4), 77–82 (2003)

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China under Grant 62276239 and 62272424, in part by the Zhongyuan Talents Program under Grant ZYYCYU202012154, in part by the Henan Natural Science Foundation-Outstanding Youth Foundation under Grant 222300420095 and in part by the Scientific and Technological Innovation Team in University of Henan Province under Grant 24IRTSTHN023.

Author information

Author notes

  1. Yingcong Wang, Yang Zhao, Junwei Sun, Yan Wang and Yanfeng Wang have contributed equally to this work.

Authors and Affiliations

  1. School of Electrical Information and Engineering, Zhengzhou University of Light Industry, Zhengzhou, 450002, China

    Yingcong Wang, Yang Zhao, Junwei Sun, Yan Wang & Yanfeng Wang

Authors
  1. Yingcong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yang Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Junwei Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yanfeng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Junwei Sun.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Y., Zhao, Y., Sun, J. et al. All-optically controlled memristor for dual-channel emotional circuit and its application. Eur. Phys. J. Plus 139, 320 (2024). https://doi.org/10.1140/epjp/s13360-024-05075-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1140/epjp/s13360-024-05075-5

Search

Navigation