Abstract
The Peruvian government adopted the ISO/IEC 12207 standard and established its mandatory implementation in public entities to improve the quality of the software products. In this context, software requirements validation tasks were introduced to improve the quality of the software product. In this study, the relationship between the improvement of software requirement quality and the software product quality in use was explored and analyzed. Analysis was based on the design of software product quality-in-use and the measure of metrics from ISO/IEC 25010 standard in two software products. The results show that the validation activities introduced in the software requirements stage have a positive relationship with the quality in use of the software products analyzed. In the software studied, it can be said that the improvement of the quality of the requirements has contributed to the improvement of the quality in use of software products. In this case, it has increased time efficiency to complete tasks by 45%, reduced errors for a task by 40%, the number of tasks with errors by 47%, the cost of time to perform tasks by 29%, and unnecessary actions by 53%. In addition, overall satisfaction, user pleasure, information quality, and interfaces quality are the metrics that significantly improve.
REFERENCES
PCM: RM no. 179-2004-PCM: Uso obligatorio de la Norma Tecnica Peruana NTP-ISO/IEC 12207:2004, 2004.
PCM: RM no. 041-2017-PCM. Uso Obligatorio de la Norma Tecnica Peruana NTP-ISO/IEC 12207:2016, Peru, 2017.
ISO/IEC: no. TR 29110-1:2016: Systems and Software Engineering–Lifecycle Profiles for Very Small Entities (VSEs)–Part 1: Overview, Genewa, 2016.
Demirel, S.T. and Das, R., Software requirement analysis: research challenges and technical approaches, in Proc. 6th Int. Symp. on Digital Forensic and Security, ISDFS 2018, Institute of Electrical and Electronics Engineers Inc., 2018, pp. 1–6. https://doi.org/10.1109/ISDFS.2018.8355322
Atoum, I., Baklizi, M.K., Alsmadi, I., Otoom, A.A., Alhersh, T., Ababneh, J., Almalki, J., and Alshahrani, S.M., Challenges of software requirements quality assurance and validation: A systematic literature review, IEEE Access, 2021, vol. 9, pp. 137613–137634. https://doi.org/10.1109/ACCESS.2021.3117989
Anuar, U., Ahmad, S., and Emran, N.A., A simplified systematic literature review: Improving software requirements specification quality with boilerplates, in Proc. 9th Malaysian Software Engineering Conf., MySEC 2015, Institute of Electrical and Electronics Engineers Inc., 2015, pp. 99–105. https://doi.org/10.1109/MySEC.2015.7475203
García-Mireles, G.A., Addressing product quality characteristics using the ISO/IEC 29110, in Trends and Applications in Software Engineering. Advances in Intelligent Systems and Computing, Mejia, J., Munoz, M., and Rocha, Á.C.-M.J., Eds., Cham: Springer, 2016, pp. 25–34. https://doi.org/10.1007/978-3-319-26285-7_3
Hussain, A., Mkpojiogu, E.O.C., and Kamal, F.M., The role of requirements in the success or failure of software projects, Proc. Int. Soft Science Conf. (ISSC), Kedah, 2016.
Niazi, M., Mahmood, S., Alshayeb, M., Qureshi, A.M., Faisal, K., and Cerpa, N., Toward successful project management in global software development, Int. J. Project Manag., 2016, vol. 34, pp. 1553–1567. https://doi.org/10.1016/j.ijproman.2016.08.008
Bhardwaj, M. and Rana, A., Key software metrics and its impact on each other for software development projects, Int. J. Electr. Comput. Eng., 2016, vol. 6, pp. 242–248. https://doi.org/10.11591/ijece.v6i1.8247
Duran Toro, A., Un Entorno Metodológico de Ingeniería de Requisitos para Sistemas de Información, PhD, 2000. https://idus.us.es/handle/11441/15365
Mishra, D. and Abdalhamid, S., Software quality issues in SCRUM: a systematic mapping, J. Univ. Comput. Sci., 2018, vol. 24, pp. 1690–1716.
Atoum, I., A novel framework for measuring software quality-in-use based on semantic similarity and sentiment analysis of software reviews, J. King Saud Univ., Comput. Inf. Sci., 2020, vol. 32, pp. 113–125. https://doi.org/10.1016/j.jksuci.2018.04.012
Salomón, S., Duque, R., Montana, J.L., and Tenés, L., Towards automatic evaluation of the quality-in-use in context-aware software systems, J. Ambient Intell. Humaniz. Comput., 2022, vol. 14, pp. 10321–10346. https://doi.org/10.1007/s12652-021-03693-w
Canchari, L. and Dávila, A., Requirements validation in the information systems software development: an empirical evaluation of its benefits for a Public Institution in Lima, in Trends and Applications in Software Engineering. CIMPS 2019. Advances in Intelligent Systems and Computing, Mejia, J., Munoz, M., and Rocha, A.A.C.-M.J., Eds., Guanajuato: Springer Nature Switzerland, 2020, pp. 23–35. https://doi.org/10.1007/978-3-030-33547-2_3
ISO/IEC no. 25022:2016: Systems and Software Engineering–Systems and Software Quality Requirements and Evaluation (SQuaRE)–Measurement of Quality in Use, Genewa: Springer US, 2016.
Kim, S.-H. and Kim, W.-J., Evaluation of software quality-in-use attributes based on analysis network process, Cluster Comput., 2019, vol. 22, pp. 2101–2114. https://doi.org/10.1007/s10586-018-2309-6
ISO/IEC no. 25001:2014: Systems and Software Engineering–Systems and Software Quality Requirements and Evaluation (SQuaRE)–Planning and Management, Genewa, 2014.
Marín, B., Condori-Fernández, N., and Pastor, O., Calidad en Modelos Conceptuales: Un Analisis Multidimensional de Modelos Cuantitativos Basados en la ISO 9126, Proc. 8th Conf. Anu. de la Asociacion Espanola de Metricas de Sistemas Informaticos, 2007, pp. 153–167.
ISO/IEC no. 25010:2011: Systems and Software Engineering–Systems and Software Quality Requirements and Evaluation (SQuaRE)–System and Software Quality Models, Genewa, 2011.
Fenton, N. and Nell, M., Software metrics: roadmap, Proc. 22nd Int. Conf. on Software Engineering “Future of Software Engineering,” Limerick, 2000, pp. 357–370. https://doi.org/10.1145/336512.336588
Estayno, M., Dapozo, G., Cuenca Pletsch, L., and Greiner, C., Modelos y Métricas para Evaluar Calidad de Software, Proc. 11th Workshop de Investigadores en Ciencias de la Computacion, San Juan, 2009, pp. 382–388.
Bevan, N., Los Nuevos Modelos de ISO para la Calidad y la Calidad en Uso del Software, in Calidad del Producto y Proceso Software, Calero, C., Moraga, A., and Piattini, M., Eds., Madrid, 2012, pp. 55–78.
Kurosu, M., Usability, quality in use and the model of quality characteristics, in Human-Computer Interaction: Design and Evaluation, Los Angeles: Springer Int. Publ. Switzerland, 2015, pp. 227–237. https://doi.org/10.1007/978-3-319-20901-2_21
Atoum, I., Bong, C.H., and Kulathuramaiyer, N., Towards resolving software quality-in-use measurement challenges, J. Emerging Trends Comput. Inf. Sci., 2014, vol. 5, pp. 877–885.
Charters, E., The use of think-aloud methods in qualitative research an introduction to think-aloud methods, Brock Edu. J., 2003, vol. 12, pp. 68–82.
Nielsen, J., Thinking Aloud: The #1 Usability Tool. https://www.nngroup.com/articles/thinking-aloud-the-1-usability-tool/. Accessed May 30, 2021.
Sauro, J., 10 Things to Know about the Post Study System Usability Questionnaire. https://measuringu.com/pssuq/. Accessed March 3, 2019.
Allasi, D. and Dávila, A., Financial impact on the adoption of software validation tasks in the analysis phase: A business case, in Trends and Applications in Software Engineering. CIMPS 2017. Advances in Intelligent Systems and Computing, Mejia, J., Munoz, M., Rocha, A., and Quinonez, Y.C.-M.J., Eds., Zacatecas: Springer Int. Publ., 2018, pp. 106–116. https://doi.org/10.1007/978-3-319-69341-5_10
Pardo, C., Garcia, F., Pino, F., and Piattini, M., Producto y Proceso: Una Relación Compleja en la Ingeniería de Software, Hombre Maquina, 2013, nos. 42–43, pp. 67–72.
Covella, G. and Olsina, L., Medición y Evaluación de Calidad en Uso: Un Caso de Estudio para una Aplicación E-Learning, in Proc. 9th Conf. Iberoamericana de Software Engineering–CibSE, Castro, J., Cernuzzi, L., and Gordillo, S.E., Eds., La Plata, 2006, pp. 317–330.
Sierra González, J.C., Métodos de Evaluación de Usabilidad para Sistemas de Información Web: Una Revisión, in Proc. Conf. Colombiana en Gestión de Sistemas de Información y de TIC–GSTIC, Manizalez: Univ. Nacional de Colombia, 2013, pp. 1–13.
Hassan Montero, Y. and Ortega Santamaria, S., Informe APEI sobre usabilidad, Gijon: Asociacion Profesional de Especialistas en Informacion, 2009.
Del-Ángel-Flores, H., López-Domínguez, E., Hernández-Velázquez, Y., Domínguez-Isidro, S., Medina-Nieto, M.A., and De-La-Calleja, J., Usability evaluation of a mobile learning platform focused on learning monitoring and customization based on a laboratory study, Program. Comput. Software, 2022, vol. 48, pp. 583–597. https://doi.org/10.1134/S0361768822080102
Hornbæk, K., Current practice in measuring usability: Challenges to usability studies and research, Int. J. Human Comput. Stud., 2006, vol. 64, pp. 79–102. https://doi.org/10.1016/j.ijhcs.2005.06.002
González-Sánchez, J.-L., Montero-Simarro, F., and Gutiérrez-Vela, F.-L., Evolución del Concepto de Usabilidad como Indicador de Calidad del Software, Prof. Inf., 2012, vol. 21, pp. 529–536. https://doi.org/10.3145/epi.2012.sep.13
Runeson, P. and Höst, M., Guidelines for conducting and reporting case study research in software engineering, Emp. Softwaer Eng., 2009, vol. 14, pp. 131–164. https://doi.org/10.1007/s10664-008-9102-8
Genero Bocco, M., Cruz-Lemus, J.A., and Piattini Velthuis, M.G., Métodos de Investigación en Ingeniería de Software, Madrid, 2013.
Pedrosa, I., Suárez-Álvarez, J., and García-Cueto, E., Evidencias sobre la Validez de Contenido: Avances Teóricos y Métodos para su Estimacion, Acc. Psicol., 2014, vol. 10, pp. 3–18. https://doi.org/10.5944/ap.10.2.11820
Canchari, L., La validación de requisitos de software como base del éxito de los proyectos de sistemas informáticos desarrollados e implementados en la Comisión Nacional para el Desarrollo y Vida sin Drogas-DEVIDA, 2018.
Pérez-Verdejo, J.M., Sánchez-García, J., Ocharán-Hernández, J.O., Mezura-Montes, E., and Cortés-Verdín, K., Requirements and GitHub issues: An automated approach for quality requirements classification, Program. Comput. Software, 2021, vol. 47, pp. 704–721. https://doi.org/10.1134/S0361768821080193
Dávila Nicanor, L. and Mejia Alvarez, P., Evaluación de la Calidad de Software en Sistemas de Información en Internet, Proc. Congreso de Ingenierıa Electrica, CInvestAv-IPN., Zacatenco, 2003, pp. 1–11.
ACKNOWLEDGMENTS
This research was supported by Software Engineering Research and Development Group (GIDIS) – Pontifical Catholic University of Peru.
Funding
This work was supported by ongoing institutional funding. No additional grants to carry out or direct this particular research were obtained.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
The authors declare that they have no conflicts of interest.
Additional information
Publisher’s Note.
Pleiades Publishing remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
APPENDIX
APPENDIX
Appendix A and B in original Spanish language are presented in https://drive.google.com/drive/folders/169Z4QhsO4nVxoRaDj_kEndoGS7JdyBey?usp=drive_link.
Rights and permissions
About this article
Cite this article
Canchari, L., Angeleri, P. & Dávila, A. Requirements Validation in the Information System Software Development Lifecycle: A Software Quality in Use Evaluation. Program Comput Soft 49, 610–624 (2023). https://doi.org/10.1134/S0361768823080054
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0361768823080054