Skip to main content
SpringerLink
Log in

Optimized neural attention mechanism for aspect-based sentiment analysis framework with optimal polarity-based weighted features

  • Regular paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

In recent years, sentimental analysis has been broadly investigated to extract information to identify whether it is positive, negative or neutral. Sentimental analysis can be broadly performed in social media content, survey response and review. Still, it faces issues while detecting and analyzing social media content. Moreover, a social media network contains indirect sentiments and natural language ambiguities make it complicated to classify the words. Thus, the aspect-based sentiment analysis (ABSA) is emerged to develop explicating extraction methods by utilizing the syntactic parsers to make use of the relation among sentiments and aspects terms. Along with this extraction method, the word embedding is performed through Word2Vec methods to attain a low-dimensional vector depiction of text, which could not capture valuable information. Thus, it aims to design a novel ABSA model using the optimized neural network along with optimal text feature extraction. Initially, various data is collected through the benchmark dataset are given to the image pre-processing. Then, it might undergo different techniques like stemming, stop word removal as well as punctuation removal. Then, the preprocessed data are further given into the feature extraction phase to attain adequate extracted aspects. Then, it further undergoes for deep feature extraction stage, where the text conventional neural network and Glove embedding are utilized to obtain the deep features. Further, the feature concatenation is done to attain the optimization for polarity-based weighted features utilized by the enhanced hybrid optimization algorithm called hybrid Chameleon rat swarm optimization (HCRSO) for improving the performance in sentiment analysis. The optimal features are selected by the HCRSO that provides the polarity-based-weight features; thus, it separates the polarity, and the weighted features are occurred by multiplying the weight with polarities. Especially, the optimized features of polarity-based weighted features and also the parameters of epochs and hidden neuron count of neural attention mechanism-based long short-term network (NAM-LSTM) are optimized using the HCRSO algorithm. The weighted feature is applied by incorporating the NAM-LSTM and proposed HCRSO algorithm for improving the model efficiency. The empirical outcome of the recommended method shows 94% and 93% regarding accuracy and specificity. Thus, the experimental outcomes of the proposed ABSA model reveal the model’s efficiency while validating with other conventional approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Bie Y, Yang Y (2021) A multitask multiview neural network for end-to-end aspect-based sentiment analysis. Big Data Min Anal 4(3):195–207

    Article  Google Scholar 

  2. Zhang B, Li X, Xu X, Leung K-C, Chen Z, Ye Y (2020) Knowledge guided capsule attention network for aspect-based sentiment analysis. IEEE/ACM Trans Audio Speech Lang Process 28:2538–2551

    Article  Google Scholar 

  3. Zhao N, Gao H, Wen X, Li H (2021) Combination of convolutional neural network and gated recurrent unit for aspect-based sentiment analysis. IEEE Access 9:15561–15569

    Article  Google Scholar 

  4. Che W, Zhao Y, Guo H, Su Z, Liu T (2015) Sentence compression for aspect-based sentiment analysis. IEEE/ACM Trans Audio Speech Lang Process 23(12):2111–2124

    Article  Google Scholar 

  5. Sweidan AH, El-Bendary N, Al-Feel H (2021) Sentence-level aspect-based sentiment analysis for classifying adverse drug reactions (ADRs) using hybrid ontology-XLNET transfer learning. IEEE Access 9:90828–90846

    Article  Google Scholar 

  6. Lin Y, Wang C, Song H, Li Y (2021) Multi-head self-attention transformation networks for aspect-based sentiment analysis. IEEE Access 9:8762–8770

    Article  Google Scholar 

  7. Li X, Fu X, Xu G, Yang Y, Wang J, Jin L, Liu Q, Xiang T (2020) Enhancing BERT representation with context-aware embedding for aspect-based sentiment analysis. IEEE Access 8:46868–46876

    Article  Google Scholar 

  8. Aygün I, Kaya B, Kaya M (2021) Aspect based twitter sentiment analysis on vaccination and vaccine types in Covid-19 pandemic with deep learning. IEEE J Biomed Health Inform 26(5):2360–2369

    Article  Google Scholar 

  9. Sun J, Han P, Cheng Z, Wu E, Wang W (2020) Transformer based multi-grained attention network for aspect-based sentiment analysis. IEEE Access 8:211152–211163

    Article  Google Scholar 

  10. Shams M, Khoshavi N, Baraani-Dastjerdi A (2020) LISA: language-independent method for aspect-based sentiment analysis. IEEE Access 8:31034–31044

    Article  Google Scholar 

  11. Ishaq A, Asghar S, Gillani SA (2020) Aspect-based sentiment analysis using a hybridized approach based on CNN and GA. IEEE Access 8:135499–135512

    Article  Google Scholar 

  12. Sattar K, Umer Q, Vasbieva DG, Chung S, Latif Z, Lee C (2021) A multi-layer network for aspect-based cross-lingual sentiment classification. IEEE Access 9:133961–133973

    Article  Google Scholar 

  13. Meng W, Wei Y, Liu P, Zhu Z, Yin H (2019) Aspect based sentiment analysis with feature enhanced attention CNN-BiLSTM. IEEE Access 7:167240–167249

    Article  Google Scholar 

  14. Rida-E-Fatima S, Javed A, Banjar A, Irtaza A, Dawood H, Dawood H, Alamri A (2019) A multi-layer dual attention deep learning model with refined word embeddings for aspect-based sentiment analysis. IEEE Access 7:114795–114807

    Article  Google Scholar 

  15. Boumhidi A, Benlahbib A et al (2021) Cross-platform reputation generation system based on aspect-based sentiment analysis. IEEE Access 10:2515–2531

    Article  Google Scholar 

  16. Shim H, Lowet D, Luca S, Vanrumste B (2021) LETS: a label-efficient training scheme for aspect-based sentiment analysis by using a pre-trained language model. IEEE Access 9:115563–115578

    Article  Google Scholar 

  17. Abas AR, El-Henawy I, Mohamed H, Abdellatif A (2020) Deep learning model for fine-grained aspect-based opinion mining. IEEE Access 8:128845–128855

    Article  Google Scholar 

  18. Onan A, Korukoğlu S (2017) A feature selection model based on genetic rank aggregation for text sentiment classification. J Inf Sci 43(1):25–38

    Article  Google Scholar 

  19. Onan A (2018) An ensemble scheme based on language function analysis and feature engineering for text genre classification. J Inf Sci 44(1):28–47

    Article  Google Scholar 

  20. Onan A, Korukoğlu S, Bulut H (2016) Ensemble of keyword extraction methods and classifiers in text classification. Expert Syst Appl 57:232–247

    Article  Google Scholar 

  21. Onan A, Bal V, Yanar Bayam B (2016) The use of data mining for strategic management: a case study on mining association rules in student information system. Croat J Educ Hrvatski časopis za odgoj i obrazovanje 18(1):41–70

    Google Scholar 

  22. Onan A, Korukoğlu S, Bulut H (2017) A hybrid ensemble pruning approach based on consensus clustering and multi-objective evolutionary algorithm for sentiment classification. Inf Process Manag 53(4):814–833

    Article  Google Scholar 

  23. Onan A, Toçoğlu MA (2021) A term weighted neural language model and stacked bidirectional LSTM based framework for sarcasm identification. IEEE Access 9:7701–7722

    Article  Google Scholar 

  24. Onan, A.: Biomedical text categorization based on ensemble pruning and optimized topic modelling. Comput Math Methods Med 2018 (2018)

  25. Onan, A., et al.: Consensus clustering-based undersampling approach to imbalanced learning. Sci Program 2019 (2019)

  26. Onan A (2020) Mining opinions from instructor evaluation reviews: a deep learning approach. Comput Appl Eng Educ 28(1):117–138

    Article  Google Scholar 

  27. Onan, A.: Deep learning based sentiment analysis on product reviews on twitter. In: Big data innovations and applications: 5th international conference, Innovate-Data 2019, Istanbul, Turkey, August 26–28, 2019, Proceedings 5, pp. 80–91. Springer (2019)

  28. Onan A (2019) Two-stage topic extraction model for bibliometric data analysis based on word embeddings and clustering. IEEE Access 7:145614–145633

    Article  Google Scholar 

  29. Rida-E-Fatima S, Javed A, Banjar A, Irtaza A, Dawood H, Dawood H, Alamri A (2019) A multi-layer dual attention deep learning model with refined word embeddings for aspect-based sentiment analysis. IEEE Access 7:114795–114807

    Article  Google Scholar 

  30. Onan A (2021) Sentiment analysis on massive open online course evaluations: a text mining and deep learning approach. Comput Appl Eng Educ 29(3):572–589

    Article  Google Scholar 

  31. Onan A (2021) Sentiment analysis on product reviews based on weighted word embeddings and deep neural networks. Concurr Comput Pract Exp 33(23):5909

    Article  Google Scholar 

  32. Huang F, Wei K, Weng J, Li Z (2020) Attention-based modality-gated networks for image-text sentiment analysis. ACM Trans Multimedia Comput Commun Appl (TOMM) 16(3):1–19

    Article  Google Scholar 

  33. Li N, Chow C-Y, Zhang J-D (2020) SEML: a semi-supervised multi-task learning framework for aspect-based sentiment analysis. IEEE Access 8:189287–189297

    Article  Google Scholar 

  34. Jia Z, Bai X, Pang S (2020) Hierarchical gated deep memory network with position-aware for aspect-based sentiment analysis. IEEE Access 8:136340–136347

    Article  Google Scholar 

  35. Su J, Yu S, Luo D (2020) Enhancing aspect-based sentiment analysis with capsule network. IEEE Access 8:100551–100561

    Article  Google Scholar 

  36. Pimpalkar A et al (2022) Mbilstmglove: embedding glove knowledge into the corpus using multi-layer bilstm deep learning model for social media sentiment analysis. Expert Syst Appl 203:117581

    Article  Google Scholar 

  37. Su J, Tang J, Jiang H, Lu Z, Ge Y, Song L, Xiong D, Sun L, Luo J (2021) Enhanced aspect-based sentiment analysis models with progressive self-supervised attention learning. Artif Intell 296:103477

    Article  MathSciNet  Google Scholar 

  38. Srividya K, Sowjanya AM (2021) WITHDRAWN: NA-DLSTM-A neural attention based model for context aware Aspect-based sentiment analysis. Elsevier, New York

    Google Scholar 

  39. Mohammad A-S, Hammad MM, Sa’ad A, Saja A-T, Cambria E (2021) Gated recurrent unit with multilingual universal sentence encoder for arabic aspect-based sentiment analysis. Knowl Based Syst 107540

  40. Onan A (2022) Bidirectional convolutional recurrent neural network architecture with group-wise enhancement mechanism for text sentiment classification. J King Saud Univ Computer Inf Sci 34(5):2098–2117

    Google Scholar 

  41. Xu J, Li Z, Huang F, Li C, Philip SY (2020) Visual sentiment analysis with social relations-guided multiattention networks. IEEE Trans Cybern 52(6):4472–4484

    Article  Google Scholar 

  42. Xu M, Zeng B, Yang H, Chi J, Chen J, Liu H (2022) Combining dynamic local context focus and dependency cluster attention for aspect-level sentiment classification. Neurocomputing 478:49–69

    Article  Google Scholar 

  43. Zeng J, Liu T, Jia W, Zhou J (2022) Relation construction for aspect-level sentiment classification. Inf Sci 586:209–223

    Article  Google Scholar 

  44. Xiao L, Xue Y, Wang H, Hu X, Gu D, Zhu Y (2022) Exploring fine-grained syntactic information for aspect-based sentiment classification with dual graph neural networks. Neurocomputing 471:48–59

    Article  Google Scholar 

  45. Albawi S, Mohammed TA, Al-Zawi S (2017) Understanding of a convolutional neural network. In: 2017 international conference on engineering and technology (ICET). IEEE, pp 1–6

  46. Braik MS (2021) Chameleon swarm algorithm: a bio-inspired optimizer for solving engineering design problems. Expert Syst Appl 174:114685

    Article  Google Scholar 

  47. Dhiman G, Garg M, Nagar A, Kumar V, Dehghani M (2021) A novel algorithm for global optimization: rat swarm optimizer. J Ambient Intell Humaniz Comput 12:8457–8482

    Article  Google Scholar 

  48. Kumar Gupta D, Srikanth Reddy K, Shweta, Ekbal A (2015) Pso-asent: Feature selection using particle swarm optimization for aspect based sentiment analysis. In: Natural language processing and information systems: 20th international conference on applications of natural language to information systems, NLDB 2015, Passau, Germany, June 17–19, 2015, Proceedings 20. Springer, pp 220–233

  49. Dhiman G, Garg M, Nagar A, Kumar V, Dehghani M (2021) A novel algorithm for global optimization: rat swarm optimizer. J Ambient Intell Humaniz Comput 12:8457–8482

    Article  Google Scholar 

  50. Johari NF, Zain AM, Noorfa MH, Udin A (2013) Firefly algorithm for optimization problem. Appl Mech Mater 421:512–517

    Article  Google Scholar 

  51. Singh NK, Suprabhath KS (2021) Har using bi-directional LSTM with RNN. In: 2021 international conference on emerging techniques in computational intelligence (ICETCI). IEEE, pp 153–158

  52. Li X, Ma X, Xiao F, Wang F, Zhang S (2020) Application of gated recurrent unit (GRU) neural network for smart batch production prediction. Energies 13(22):6121

    Article  Google Scholar 

  53. Graves A, Graves A (2012) Long short-term memory. Supervised sequence labelling with recurrent neural networks, pp 37–45

  54. Wang Y, Huang M, Zhu X, Zhao L (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp 606–615

  55. Xing B, Liao L, Song D, Wang J, Zhang F, Wang Z, Huang H (2019) Earlier attention? aspect-aware LSTM for aspect-based sentiment analysis. arXiv preprint arXiv:1905.07719

  56. Wang B (2018) Disconnected recurrent neural networks for text categorization. In: Proceedings of the 56th annual meeting of the association for computational linguistics (Volume 1: Long Papers), pp 2311–2320

  57. Johnson R, Zhang T (2017) Deep pyramid convolutional neural networks for text categorization. In: Proceedings of the 55th annual meeting of the association for computational linguistics (Volume 1: Long Papers), pp 562–570

  58. Li, X., Ming, H.: Stock market prediction using reinforcement learning with sentiment analysis. Int J Cybern Inform 12(1):1–20 (2023)

  59. Aslan, S., Kızıloluk, S., Sert, E.: Tsa-cnn-aoa: Twitter sentiment analysis using CNN optimized via arithmetic optimization algorithm. Neural Comput Appl 1–18 (2023)

  60. Muthulakshmi, V., Shajin, F.H., Dhiviya Rose, J., Rajesh, P.: Generative adversarial networks classifier optimized with water strider algorithm for fake tweets detection. IETE J Res 1–16 (2023)

  61. Shaddeli A, Soleimanian Gharehchopogh F, Masdari M, Solouk V (2022) An improved African vulture optimization algorithm for feature selection problems and its application of sentiment analysis on movie reviews. Big Data Cognit Comput 6(4):104

    Article  Google Scholar 

  62. Majumder, N., Poria, S., Gelbukh, A., Akhtar, M.S., Cambria, E., Ekbal, A.: IARM: inter-aspect relation modeling with memory networks in aspect-based sentiment analysis. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 3402–3411 (2018)

  63. Oh, S., Lee, D., Whang, T., Park, I., Seo, G., Kim, E., Kim, H.: Deep context-and relation-aware learning for aspect-based sentiment analysis. arXiv preprint arXiv:2106.03806 (2021)

Download references

Acknowledgements

We acknowledge DST-File No.368. DST-FIST (SR/FIST/College-235/2014 dated 21-11-2014) for financial support and DBT-STAR-College-Scheme-ref.no: BT/HRD/11/09/2018 for providing infrastructure support.

Author information

Authors and Affiliations

  1. Department of Information Science and Engineering, Bannari Amman Institute of Technology, Sathyamangalam, Tamil Nadu, 638401, India

    Mekala Ramasamy

  2. Department of Computer Science and Engineering, K.S.Rangasamy College of Technology, KSR Kalvi Nagar, Namakkal, Tamil Nadu, 637215, India

    Mohanraj Elangovan

Authors
  1. Mekala Ramasamy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohanraj Elangovan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors have made substantial contributions to conception and design, revising the manuscript, and the final approval of the version to be published. Also, all authors agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Corresponding author

Correspondence to Mekala Ramasamy.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ramasamy, M., Elangovan, M. Optimized neural attention mechanism for aspect-based sentiment analysis framework with optimal polarity-based weighted features. Knowl Inf Syst 66, 2501–2535 (2024). https://doi.org/10.1007/s10115-023-01998-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-023-01998-0

Keywords

Search

Navigation