Evaluation of the Integrated University Information System at Universidad Técnica del Norte Using the DeLone and McLean Success Model
DOI:
https://doi.org/10.56294/dm2025187Keywords:
Evaluation, impact, information system, success, Delone & McLean modelAbstract
This study aims to evaluate the Integrated University Information System (SIIU) at Universidad Técnica del Norte by applying the DeLone and McLean Information Systems Success Model. The SIIU plays a crucial role in academic management by integrating key modules, such as executive, faculty, and student portfolios. Despite its long-standing implementation, a comprehensive assessment of the system's performance and its impact on academic activities had not been conducted until now. The research specifically focuses on assessing the SIIU's impact from the students' perspective, applying the six dimensions of the DeLone and McLean model: system quality, information quality, service quality, use/intention to use, user satisfaction, and net impacts. Four assessments were carried out over two years (May 2022, February 2023, July 2023, and July 2024), using a 28-item survey to measure these dimensions.
The findings confirm the validity of the DeLone and McLean model in evaluating information systems and reveal a positive trend in students' perceptions of the "SIIU – Student Portfolio" over the past years. The results also provide a detailed breakdown of the system's strengths, weaknesses, and areas for improvement, as experienced by students. These insights offer valuable guidance for the SIIU management team, facilitating targeted improvements to optimize the system’s contribution to the university’s academic environment.
References
1. Silva B, Rodrigues L. Evaluation of the Success of an Academic Portal: the students’ perspective. CAPSI 2021 Proc [Internet]. 2021 Oct 16; Available from: https://aisel.aisnet.org/capsi2021/8
2. Acuña Garzón M. Evaluación del Sistema de Información Académica (SIA) de la Universidad Nacional de Colombia. 2016 [cited 2023 Mar 26]; Available from: https://repositorio.unal.edu.co/handle/unal/59044
3. DeLone WH, McLean ER. Information Systems Success: The Quest for the Dependent Variable. Inf Syst Res [Internet]. 1992 Mar [cited 2015 Jul 27];3(1):60–95. Available from: http://search.ebscohost.com/login.aspx?direct=true&db=bth&AN=4430803&site=ehost-live&scope=site
4. DeLone WH, McLean ER. The DeLone and McLean Model of Information Systems Success: A Ten-Year Update. J Manag Inf Syst [Internet]. 2003 Apr 1 [cited 2015 Jul 27];19(4):9–30. Available from: http://www.tandfonline.com/doi/abs/10.1080/07421222.2003.11045748
5. DeLone WH, McLean ER. Information Systems Success Measurement. Found Trends® Inf Syst [Internet]. 2016 Aug 25 [cited 2018 May 2];2(1):1–116. Available from: https://www.nowpublishers.com/article/Details/ISY-005
6. Lestanti NR, Umari K, Santoso IA, Suzanna. The Implementation of DeLone and McLean Method to Measure the Success of PMCS Application at Wij aya Karya Rekayasa Konstruksi Inc. In: 2024 International Conference on Science, Engineering and Business for Driving Sustainable Development Goals (SEB4SDG) [Internet]. 2024 [cited 2024 Sep 29]. p. 1–6. Available from: https://ieeexplore.ieee.org/abstract/document/10630226
7. Hidayat Ur Rehman I, Ali Turi J, Rosak-Szyrocka J, Alam MN, Pilař L. The role of awareness in appraising the success of E-government systems. Cogent Bus Manag [Internet]. 2023 Dec 31 [cited 2024 Sep 29];10(1):2186739. Available from: https://www.tandfonline.com/doi/full/10.1080/23311975.2023.2186739
8. Sabeh HN, Husin MH, Kee DMH, Baharudin AS, Abdullah R. A Systematic Review of the DeLone and McLean Model of Information Systems Success in an E-Learning Context (2010–2020). IEEE Access [Internet]. 2021 [cited 2024 Sep 25];9:81210–35. Available from: https://ieeexplore.ieee.org/abstract/document/9443172
9. Martins J, Branco F, Gonçalves R, Au-Yong-Oliveira M, Oliveira T, Naranjo-Zolotov M, et al. Assessing the success behind the use of education management information systems in higher education. Telemat Inform [Internet]. 2019 May 1 [cited 2023 Mar 26];38:182–93. Available from: https://www.sciencedirect.com/science/article/pii/S0736585318306348
10. Shim M, Jo HS. What quality factors matter in enhancing the perceived benefits of online health information sites? Application of the updated DeLone and McLean Information Systems Success Model. Int J Med Inf [Internet]. 2020 May 1 [cited 2023 Mar 26];137:104093. Available from: https://www.sciencedirect.com/science/article/pii/S1386505619310718
11. Purwati A, Mustafa Z, Deli M. Management Information System in Evaluation of BCA Mobile Banking Using DeLone and McLean Model | Journal of Applied Engineering and Technological Science (JAETS) [Internet]. [cited 2024 Sep 29]. Available from: https://www.yrpipku.com/journal/index.php/jaets/article/view/217
12. Pietrzak Z. The Delone and McLean model of success. ProQuest [Internet]. [cited 2024 Sep 29]; Available from: https://www.proquest.com/openview/60b7d86780ea0ab18c4d08dc27cd33d7/1?pq-origsite=gscholar&cbl=2032514
13. Olabanji A, Gonese G, Tafadzwa M. The Impact of Management Information Systems on a South African University’s Organisational Processes. Mediterr J Soc Sci [Internet]. 2014 May 1 [cited 2024 Sep 29]; Available from: https://www.richtmann.org/journal/index.php/mjss/article/view/2629
14. Skoumpopoulou D, Nguyen-Newby T. The Organizational Impact of Implementing Information Systems in Higher Education Institutions: A Case Study from a UK University. Strateg Change [Internet]. 2015 [cited 2024 Sep 29];24(5):463–82. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1002/jsc.2022
15. Khan MA, Khan AZ, Ali MI, Mahmood F. The role of post-implementation strategies for projects of enterprise information systems in enhancing management system: A case study approach. Hum Syst Manag [Internet]. 2023 Jan 1 [cited 2024 Sep 29];42(2):247–56. Available from: https://content.iospress.com/articles/human-systems-management/hsm220061
16. Gerón-Piñón G, Solana-González P, Trigueros-Preciado S, Pérez-González D, Gerón-Piñón G, Solana-González P, et al. Sistemas de información en las universidades latinoamericanas: su impacto en los rankings internacionales. Rev Educ Super [Internet]. 2021 Jun [cited 2024 Sep 29];50(198):23–35. Available from: http://www.scielo.org.mx/scielo.php?script=sci_abstract&pid=S0185-27602021000200023&lng=es&nrm=iso&tlng=es
17. Al-Debei MM. The quality and acceptance of websites: an empirical investigation in the context of higher education. Int J Bus Inf Syst [Internet]. 2014 Jan [cited 2023 Mar 26];15(2):170–88. Available from: https://www.inderscienceonline.com/doi/abs/10.1504/IJBIS.2014.059252
18. Balaban I. Development of an electronic Portfolio system success model: An information systems approach. Comput Educ [Internet]. 2013 Jan 1 [cited 2024 Sep 29];60(1):396–411. Available from: https://www.sciencedirect.com/science/article/abs/pii/S036013151200173X
19. Vega-Zepeda V, Quelopana A, Flores C, Munizaga A. Guía de Aplicación del Modelo de DeLone y McLean para la Evaluación de Productos de Software. RISTI - Rev Ibérica Sist E Tecnol Informação [Internet]. 2018 Oct [cited 2023 Mar 26];(29):14–29. Available from: http://scielo.pt/scielo.php?script=sci_abstract&pid=S1646-98952018000400003&lng=pt&nrm=iso&tlng=es
20. Akrong GB, Shao Y, Owusu E. Evaluation of organizational climate factors on tax administration enterprise resource planning (ERP) system. Heliyon [Internet]. 2022 Jun 1 [cited 2023 Mar 26];8(6):e09642. Available from: https://www.sciencedirect.com/science/article/pii/S2405844022009306
21. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ [Internet]. 2011 Jun 27 [cited 2024 Sep 29];2:53–5. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4205511/
22. Hair JF, Hult GTM, Ringle CM, Sarstedt M, Danks NP, Ray S. An Introduction to Structural Equation Modeling. In: Hair Jr. JF, Hult GTM, Ringle CM, Sarstedt M, Danks NP, Ray S, editors. Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R: A Workbook [Internet]. Cham: Springer International Publishing; 2021 [cited 2024 Oct 13]. p. 1–29. Available from: https://doi.org/10.1007/978-3-030-80519-7_1
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Irving Reascos, Fernando Garrido, Carpio Pineda, Fausto Salazar-Fierro, Ricardo Pomasqui, Jessica Cachipuendo (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
The article is distributed under the Creative Commons Attribution 4.0 License. Unless otherwise stated, associated published material is distributed under the same licence.
