Abstract
Twitter as a marketing tool has led to a growing interest in measuring the effectiveness of content marketing on this platform. However, there has yet to be a comprehensive analytical model to measure the effectiveness of public content marketing (PCM) accurately and reliably. A literature review determined the gaps between preliminary studies and constructing a new model to measure the content effectiveness, considering variables related to interactivity and performance of digital content marketing (DCM) strategies. For this reason, this study aims to build an analytical model that determines which content characteristics improve the effectiveness of Twitter accounts, taking as a case study the governorates of Colombia. Within the methodology for data mining, CRISP-DM was used, which allowed the cleaning, processing and analysis of all data collected from the accounts of Colombian governments. The results allowed to establish factors that have yet to be considered to measure the Engagement Rate per Post (ERP) and have a critical load on users’ interactivity with the content, such as the tweet type, emojis, dates, the type of media, sentiment associated with the post and emotions. With the model, it was possible to identify the variables that improve the ERP and their impact on the effectiveness of the content.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Allcott, H., M. Gentzkow, and C. Yu. 2019. Trends in the diffusion of misinformation on social media. Research & Politics 6 (2): 205316801984855. https://doi.org/10.1177/2053168019848554.
Atif, M., and V. Franzoni. 2022. Tell me more: Automating Emojis classification for better accessibility and emotional context recognition. Future Internet 14 (5): 142. https://doi.org/10.3390/fi14050142.
Bijmolt, T.H.A., P.S.H. Leeflang, F. Block, M. Eisenbeiss, B.G.S. Hardie, A. Lemmens, and P. Saffert. 2010. Analytics for customer engagement. Journal of Service Research 13 (3): 341–356. https://doi.org/10.1177/1094670510375603.
Bonsón, E., D. Perea, and M. Bednárová. 2019. Twitter as a tool for citizen engagement: An empirical study of the Andalusian municipalities. Government Information Quarterly 36 (3): 480–489. https://doi.org/10.1016/j.giq.2019.03.001.
Bonsón, E., and M. Ratkai. 2013. A set of metrics to assess stakeholder engagement and social legitimacy on a corporate Facebook page. Online Information Review 37 (5): 787–803. https://doi.org/10.1108/oir-03-2012-0054.
Bonsón, E., L. Torres, S. Royo, and F. Flores. 2012. Local e-government 2.0: Social media and corporate transparency in municipalities. Government Information Quarterly 29 (2): 123–132. https://doi.org/10.1016/j.giq.2011.10.001.
Bozkurt, S., D. Gligor, and N. Gligor. 2021. Investigating the impact of psychological customer engagement on customer engagement behaviors: The moderating role of customer commitment. Journal of Marketing Analytics 10: 408–424. https://doi.org/10.1057/s41270-021-00146-3.
Calderón-Monge, E., and J.M. Ramírez-Hurtado. 2021. Measuring the consumer engagement related to social media: the case of franchising. Electronic Commerce Research 22: 1–26. https://doi.org/10.1007/s10660-021-09463-2.
Casaló, L., C. Flavián, and M. Guinalíu. 2007. The impact of participation in virtual brand communities on consumer trust and loyalty. Online Information Review 31 (6): 775–792. https://doi.org/10.1108/14684520710841766.
Chapman, P., J. Clinton, R. Kerber, T. Khabaza, T. Reinartz, C. Shearer, and R. Wirth. 2000. CRISP-DM 1.0. Step-by-step data mining guide. London: SSSP Inc.
Choi, J.-C., and C. Song. 2020. Factors explaining why some citizens engage in e-participation, while others do not. Government Information Quarterly 37 (4): 101524. https://doi.org/10.1016/j.giq.2020.101524.
Chun, S.A., S. Shulman, R. Sandoval, and E. Hovy. 2010. Government 2.0: Making connections between citizens, data and government. Information Polity 15 (1): 1–9. https://doi.org/10.3233/ip-2010-0205.
Criado, J.I., R. Sandoval-Almazan, and J.R. Gil-Garcia. 2013. Government innovation through social media. Government Information Quarterly 30 (4): 319–326. https://doi.org/10.1016/j.giq.2013.10.003.
Ekman, J., and E. Amnå. 2012. Political participation and civic engagement: Towards a new typology. Human Affairs 22 (3): 283–300. https://doi.org/10.2478/s13374-012-0024-1.
Ellison, N., and M. Hardey. 2013. Social media and local government: Citizenship, consumption and democracy. Local Government Studies 40 (1): 21–40. https://doi.org/10.1080/03003930.2013.799066.
Eltantawy, N., and J. Wiest. 2011. Social media in the egyptian revolution: Reconsidering resource mobilization theory. International Journal of Communication 5 (1): 1207–1224.
Feroz Khan, G., H. Young Yoon, J. Kim, and H. Woo Park. 2014. From e-government to social government: Twitter use by Korea’s central government. Online Information Review 38 (1): 95–113. https://doi.org/10.1108/oir-09-2012-0162.
Flynn, D.J., B. Nyhan, and J. Reifler. 2017. The nature and origins of misperceptions: Understanding false and unsupported beliefs about politics. Political Psychology 38 (S1): 127–150. https://doi.org/10.1111/pops.12394.
Gao, X., and J. Lee. 2017. E-government services and social media adoption: Experience of small local governments in Nebraska state. Government Information Quarterly 34 (4): 627–634. https://doi.org/10.1016/j.giq.2017.09.005.
Gil de Zúñiga, H., N. Jung, and S. Valenzuela. 2012. Social media use for news and individuals’ social capital, civic engagement and political participation. Journal of Computer-Mediated Communication 17 (3): 319–336. https://doi.org/10.1111/j.1083-6101.2012.01574.x.
Gomez, H., G. Pantoja, A. Martinez, I. Argote, and R. Jimenez. 2016. Comparativa entre CRISP-DM y SEMMA para la limpieza de datos en productos MODIS en un estudio de cambio de cobertura y uso del suelo. In IEEE 11th Colombian Computing Conference (CCC). IEEE.
Gordon, E., J. Baldwin-Philippi, and M. Balestra. 2013. Why we engage: How theories of human behavior contribute to our understanding of civic engagement in a digital era. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.2343762.
Haro-de-Rosario, A., A. Sáez-Martín, and M. del Carmen Caba-Pérez. 2016. Using social media to enhance citizen engagement with local government: Twitter or Facebook? New Media & Society 20 (1): 29–49. https://doi.org/10.1177/1461444816645652.
Henisa, D., and N. Wilantika. 2021. Content characteristics of government social media and the impact on citizen engagement rate. In 2021 International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS, Jakarta, Indonesia, 2021), 349–355. https://doi.org/10.1109/ICIMCIS53775.2021.9699299.
Hollebeek, L.D., and K. Macky. 2019. Digital content marketing’s role in fostering consumer engagement, trust, and value: Framework, fundamental propositions, and implications. Journal of Interactive Marketing 45 (1): 27–41.
Holliman, G., and J. Rowley. 2014. Business to business digital content marketing: Marketers’ perceptions of best practice. Journal of Research in Interactive Marketing 8 (4): 269–293. https://doi.org/10.1108/jrim-02-2014-0013.
Hootsuite and We are Social. 2022. Digital 2022 Report. Hootsuite. https://www.hootsuite.com/resources/digital-trends-q4-update.
Jahn, B., and W.H. Kunz. 2012. How to transform consumers into fans of your brand. SSRN Electronic Journal 23 (3): 344–361. https://doi.org/10.2139/ssrn.2307093.
Jaramillo, A., and H. Paz. 2015. Aplicación de Técnicas de Minería de Datos para Determinar las Interacciones de los Estudiantes en un Entorno Virtual de Aprendizaje. Revista Tecnológica ESPOL, 28(1). Recuperado a partir de http://www.rte.espol.edu.ec/index.php/tecnologica/article/view/351
Joo, S., K. Lu, and T. Lee. 2020. Analysis of content topics, user engagement and library factors in public library social media based on text mining. Online Information Review 44 (1): 258–277. https://doi.org/10.1108/oir-11-2018-0345.
José, J., Juan Pedro Giudici and F.M. Luque. 2021. pysentimiento: A Python Toolkit for Sentiment Analysis and SocialNLP tasks. Research Gate. https://www.researchgate.net/publication/352505261_pysentimiento_A_Python_Toolkit_for_Sentiment_Analysis_and_SocialNLP_tasks. Accessed 4 Jun. 2023.
Khalid, S., T. Khalil, and S. Nasreen. 2014. A survey of feature selection and feature extraction techniques in machine learning. In Science and Information Conference, 372–378. https://doi.org/10.1109/SAI.2014.6918213.
Khan, G.F. 2017. Social media for government implementing and managing a participatory, open, and collaborative government. Singapore: Springer.
Koob, C. 2021. Determinants of content marketing effectiveness: Conceptual framework and empirical findings from a managerial perspective. PLOS ONE 16 (4): e0249457. https://doi.org/10.1371/journal.pone.0249457.
Kunal, S., A. Saha, A. Varma, and V. Tiwari. 2018. Textual dissection of live Twitter reviews using naive bayes. Procedia Computer Science 132: 307–313. https://doi.org/10.1016/j.procs.2018.05.182.
Lasso, E., D.C. Corrales, J. Avelino, E. de MeloVirginioFilho, and J.C. Corrales. 2020. Discovering weather periods and crop properties favorable for coffee rust incidence from feature selection approaches. Computers and Electronics in Agriculture 176 (1): 105640. https://doi.org/10.1016/j.compag.2020.105640.
Lazer, D.M.J., M.A. Baum, Y. Benkler, A.J. Berinsky, K.M. Greenhill, F. Menczer, M.J. Metzger, B. Nyhan, G. Pennycook, D. Rothschild, M. Schudson, S.A. Sloman, C.R. Sunstein, E.A. Thorson, D.J. Watts, and J.L. Zittrain. 2018. The science of fake news. Science 359 (6380): 1094–1096. https://doi.org/10.1126/science.aao2998.
LeCompte, T., and J. Chen. 2017. Sentiment analysis of Tweets including emoji data. In 2017 International Conference on Computational Science and Computational Intelligence (CSCI). https://doi.org/10.1109/csci.2017.137.
Lei, S.S.I., S. Pratt, and D. Wang. 2016. Factors influencing customer engagement with branded content in the social network sites of integrated resorts. Asia Pacific Journal of Tourism Research 22 (3): 316–328. https://doi.org/10.1080/10941665.2016.1250792.
Lundberg, S.M., G. Erion, H. Chen, A. DeGrave, J.M. Prutkin, B. Nair, R. Katz, J. Himmelfarb, N. Bansal, and S.-I. Lee. 2020. From local explanations to global understanding with explainable AI for trees. Nature Machine Intelligence 2 (1): 56–67. https://doi.org/10.1038/s42256-019-0138-9.
Lundberg, S.M., and S.-I. Lee. 2017. A unified approach to interpreting model predictions. In 31st Conference on Neural Information Processing Systems. https://proceedings.neurips.cc/paper/2017/file/8a20a8621978632d76c43dfd28b67767-Paper.pdf. Accessed 22 Oct 2022.
Matsumoto, K., M. Yoshida, and K. Kita. 2018. Classification of Emoji categories from Tweet based on deep neural networks. In I Association for Computing Machinery. NLPIR 2018: 2nd International Conference on Natural Language Processing and Information Retrieval . United States: Association for Computing Machinery. New York. https://doi.org/10.1145/3278293.3278306.
Mayor, E., and L.M. Bietti. 2021. Twitter, time and emotions. Royal Society Open Science 8 (5): 201900. https://doi.org/10.1098/rsos.201900.
MINTIC. 2021. Hablemos de redes sociales en entidades del Estado. Gobierno en redes. https://www.gobiernoenredes.gov.co/hablemos-redes-sociales-entidades-del-estado/#:~:text=%E2%9C%85%20Para%20los%20colombianos%2C%20las. Accessed 19 July 2022.
Mulyono, B., I. Affandi, K. Suryadi, and C. Darmawan. 2022. Online civic engagement: Fostering citizen engagement through social media. Journal Civics: Media Kajian Kewarganegaraan 19 (1): 75–85. https://doi.org/10.21831/jc.v19i1.49723.
Muñoz-Expósito, M., M.Á. Oviedo-García, and M. Castellanos-Verdugo. 2017. How to measure engagement in Twitter: Advancing a metric. Internet Research 27 (5): 1122–1148. https://doi.org/10.1108/intr-06-2016-0170.
Neel, L.A.G., J.G. McKechnie, C.M. Robus, and C.J. Hand. 2023. Emoji alter the perception of emotion in affectively neutral text messages. Journal of Nonverbal Behavior. https://doi.org/10.1007/s10919-022-00421-6.
Pulizzi, J. 2012a. The rise of storytelling as the new marketing. Publishing Research Quarterly 28 (2): 116–123. https://doi.org/10.1007/s12109-012-9264-5.
Pulizzi, J. 2012b. Content Marketing Definition—Examples. Content Marketing Institute. http://contentmarketinginstitute.com/2012/06/content-marketing-definition/ Accessed May 2022.
Ramirez-Madrid, J.P., M. Escobar-Sierra, I. Lans-Vargas, and J.M. Montes Hincapie. 2022. Government influence on e-government adoption by citizens in Colombia: Empirical evidence in a Latin American context. PLoS ONE 17 (2): e0264495. https://doi.org/10.1371/journal.pone.0264495.
Raschka, S. 2018. MLxtend: Providing machine learning and data science utilities and extensions to Python’s scientific computing stack. Journal of Open Source Software 3 (24): 638. https://doi.org/10.21105/joss.00638.
Salminen, J., V. Yoganathan, J. Corporan, B.J. Jansen, and S.-G. Jung. 2019. Machine learning approach to auto-tagging online content for content marketing efficiency: A comparative analysis between methods and content type. Journal of Business Research 101 (1): 203–217. https://doi.org/10.1016/j.jbusres.2019.04.018.
Santoso, A.D., D. Rinjany, and O.M. Bafadhal. 2020. Social media and local government in Indonesia: Adoption, use and stakeholder engagement. Romanian Journal of Communication and Public Relations 22 (3): 21. https://doi.org/10.21018/rjcpr.2020.3.307.
Saura, J.R. 2020. Using data sciences in digital marketing: Framework, methods, and performance metrics. Journal of Innovation & Knowledge 6 (2): 92–102. https://doi.org/10.1016/j.jik.2020.08.001.
Saura, J.R., D. Ribeiro-Soriano, and P. Zegarra Saldaña. 2022. Exploring the challenges of remote work on Twitter users’ sentiments: From digital technology development to a post-pandemic era. Journal of Business Research 142 (1): 242–254. https://doi.org/10.1016/j.jbusres.2021.12.052.
Schreiner, M., T. Fischer, and R. Riedl. 2019. Impact of content characteristics and emotion on behavioral engagement in social media: Literature review and research agenda. Electronic Commerce Research 21 (2): 329–345. https://doi.org/10.1007/s10660-019-09353-8.
Schröer, C., F. Kruse, and J.M. Gómez. 2021. A systematic literature review on applying CRISP-DM process model. Procedia Computer Science 181 (2): 526–534. https://doi.org/10.1016/j.procs.2021.01.199.
Sidorov, G., F. Velasquez, E. Stamatatos, A. Gelbukh, and L. Chanona-Hernández. 2014. Syntactic N-grams as machine learning features for natural language processing. Expert Systems with Applications 41 (3): 853–860. https://doi.org/10.1016/j.eswa.2013.08.015.
Siebers, V., R. Gradus, and R. Grotens. 2018. Citizen engagement and trust: A study among citizen panel members in three Dutch municipalities. The Social Science Journal 56 (4): 545–554. https://doi.org/10.1016/j.soscij.2018.09.010.
Skoric, M.M., Q. Zhu, D. Goh, and N. Pang. 2016. Social media and citizen engagement: A meta-analytic review. New Media and Society 18 (9): 1817–1839. https://doi.org/10.1177/1461444815616221.
Sweeney, J. 2019. Public sector marketing pro: The definitive guide to digital marketing and social media for government and public sector. Barna: Js Press.
Torres, J.A.S., F.J.A. Cañada, A.V. Sandoval, and J.A.S. Alzate. 2021. Adoption of e-government in Colombia: The importance of government policy in citizens’ use of e-government. Electronic Government, an International Journal 17 (2): 220. https://doi.org/10.1504/eg.2021.114577.
Vinerean, S., and A. Opreana. 2021. Measuring customer engagement in social media marketing: A higher-order model. Journal of Theoretical and Applied Electronic Commerce Research 16 (7): 2633–2654. https://doi.org/10.3390/jtaer16070145.
Vivek, S.D., S.E. Beatty, and R.M. Morgan. 2012. Customer engagement: Exploring customer relationships beyond purchase. Journal of Marketing Theory and Practice 20 (2): 122–146.
Warren, A.M., A. Sulaiman, and N.I. Jaafar. 2014. Social media effects on fostering online civic engagement and building citizen trust and trust in institutions. Government Information Quarterly 31 (2): 291–301. https://doi.org/10.1016/j.giq.2013.11.007.
Wirtz, J., A. den Ambtman, J. Bloemer, C. Horváth, B. Ramaseshan, J. van de Klundert, Z. Gurhan Canli, and J. Kandampully. 2013. Managing brands and customer engagement in online brand communities. Journal of Service Management 24 (3): 223–244. https://doi.org/10.1108/09564231311326978.
Wirth, R., and J. Hipp. 2000. CRISP-DM: Towards a standard process model for data mining. In Proceedings of the 4th International Conference on the Practical Applications of Knowledge Discovery and Data Mining, vol. 4, pp. 29–39.
Zheng, L., and T. Zheng. 2014. Innovation through social media in the public sector: Information and interactions. Government Information Quarterly 31: 106–117. https://doi.org/10.1016/j.giq.2014.01.011.
Funding
Funding was provided by Departamento Administrativo de Ciencia, Tecnología e Innovación (COLCIENCIAS) (Grant no. 860).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Annexes
Annexes
See Annex 1.
Relationship between PT-hour/PT-day and the ERP of the Government of Cesar
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Guzmán Ordóñez, A., Arroyo Cañada, F.J., Lasso, E. et al. Analytical model to measure the effectiveness of content marketing on Twitter: the case of governorates in Colombia. J Market Anal (2023). https://doi.org/10.1057/s41270-023-00243-5
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1057/s41270-023-00243-5