Skip to main content
Log in

Neural Network Approaches for Recommender Systems

  • ARTIFICIAL INTELLIGENCE
  • Published:
Journal of Computer and Systems Sciences International Aims and scope

Abstract

Recommender systems are special algorithms that allow users to receive personalized recommendations on topics that interest them. Systems of this kind are widely used in various fields, for example, in e-commerce, provider services, social networks, etc. Together with classical approaches, neural networks have also become popular in recommender systems in recent years, which are gradually replacing traditional methods of collaborative filtering and content-based algorithms. However, neural networks require large computing resources, which often raises questions on whether an increase in quality will be justified and whether there be one at all. The neural network approach in recommender systems—the self-attentive sequential recommendation (SASRec) transformer model from Microsoft Recommenders—is studied and compared with the classic algorithm, the LightFM hybrid model. For training and validation, the data taken from a housing search application are used. It is proposed to use the hit rate as the main metric for comparison. The results of the experiments will help to understand which algorithms have higher accuracy in terms of predictions and recommendations. As an additional part, the clustering of user and object embeddings is considered.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.

REFERENCES

  1. W.-Ch. Kang and J. McAuley, “Self-Attentive Sequential Recommendation,” in IEEE Int. Conf. on Data Mining (ICDM) (Singapore, 2018), pp. 197–206.

  2. Python implementation of the SASRec model. https://github.com/microsoft/recommenders/tree/main/recommenders/models/sasrec. Accessed April 22, 2023.

  3. M. Kula, “Metadata embeddings for user and item cold-start recommendations,” in Proceedings of the Second Workshop on New Trends on Content-Based Recommender Systems Co-Located with 9th ACM Conference on Recommender Systems (RecSys) (Vienna, 2015), pp. 14–21.

  4. LightFM Documentation, LYST’s Engineering Blog. https://making.lyst.com/lightfm/docs/home.html. Accessed April 20, 2023.

  5. I. S. Sineva, V. Y. Denisov, and V. D. Galinova, “Building recommender system for media with high content update rate,” in IEEE Int. Conf. Quality Management, Transport and Information Security, Information Technologies (St. Petersburg, 2018), p. 385.

  6. P. G. Sudasinghe, Enhancing book recommendation with the use of reviews, Master’s Degree Dissertation (University of Colombo School of Computing, 2019).

  7. J. Manotumruksa and E. Yilmaz, “Sequential-based adversarial optimisation for personalised Top-N item recommendation,” in Proc. 43rd Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (Xi’an, China, 2020), pp. 2045–2048.

  8. I. Tenney, D. Das, and E. Pavlick, “BERT rediscovers the classical NLP pipeline,” in Proc. 57th Annual Meeting of the Association for Computational Linguistics (Florence, Italy, 2019), pp. 4593–4601.

  9. J. Bi, Z. Zhu, and Q. Meng, “Transformer in computer vision,” in IEEE Int. Conf. on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI) (Fuzhou, China, 2021), pp. 178–188.

  10. K. Han, Y. Wang, H. Chen, X. Chen, J. Guo, Z. Liu, Y. Tang, A. Xiao, C. Xu, Y. Xu, Z. Yang, Y. Zhang, and D. Tao, “A survey on vision transformer,” IEEE Trans. Pattern Anal. Mach. Intell. 45 (1), 87–110 (2022).

    Article  Google Scholar 

  11. J. B. Schafer, D. Frankowski, J. Herlocker, and Sh. Sen, “Collaborative filtering recommender systems,” in The Adaptive Web: Methods and Strategies of Web Personalization (Berlin, 2007), pp. 291–324.

    Google Scholar 

  12. E. Rosenthal, Learning to Rank Sketchfab Models with LightFM. https://www.ethanrosenthal.com/2016/11/07/implicit-mf-part-2. Accessed April 20, 2023.

  13. A. A. Patoulia, A. Kiourtis, A. Mavrogiorgou, and D. Kyriazis, “A comparative study of collaborative filtering in product recommendation,” Emerging Sci. J. 7 (1), 15 (2023).

    Google Scholar 

  14. M. Polignano, M. de Gemmis, and G. Semeraro, “Comparing transformer-based NER approaches for analysing textual medical diagnoses,” in Proceedings of Working Notes of CLEF (Bucharest, Romania, 2021), vol. 2936, pp. 818–833.

Download references

Funding

This work was supported by ongoing institutional funding. No additional grants to carry out or direct this particular research were obtained.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to M. A. Zharova or V. I. Tsurkov.

Ethics declarations

CONFLICT OF INTEREST

The authors of this work declare that they have no conflicts of interest.

CONSENT TO PARTICIPATE

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher’s Note.

Pleiades Publishing remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zharova, M.A., Tsurkov, V.I. Neural Network Approaches for Recommender Systems. J. Comput. Syst. Sci. Int. 62, 1048–1062 (2023). https://doi.org/10.1134/S1064230723060126

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1064230723060126

Keywords:

Navigation