Presenting a Model for the Evaluation of the Quality of e-learning at Payam Noor University
Article Sidebar
Main Article Content
Abstract
The current study aims to design a quality evaluation model of the electronic education system at Payam Noor University by applying a mixed methodology. The statistical population of the qualitative section includes twelve professors, researchers, and experts in the field of e-learning, who were selected by selective sampling. The conceptual model of the research was collected after conducting in-depth semi-structured interviews. The quantitative data based on a questionnaire designed by the researcher was collected from 274 professors and students with experience teaching or studying in the electronic education system of Payam Noor University. The data was analyzed using the structural equation modeling method in PLS3 software. The research results show that quality is a concept consisting of four categories behavioral, scientific, cognitive ability, and virtual learning experience. The study’ findings also reveal that cultural, pedagogical, learner, communication, infrastructural, and institutional factors affect the quality of Payam Noor University's electronic education system. Also, the results show that these characteristics will help universities achieve the four outcomes of competitiveness, job opportunities, economy, and reputation by establishing a quality education system. The ideal model for evaluating the quality of e-learning at Payam Noor University is a process approach in which the three dimensions of factors, quality indicators, and outputs are examined and measured. In other words, electronic education is successful when it can create a valuable experience of virtual education while empowering the learners scientifically, behaviorally, and cognitively to let all the stakeholders of higher education benefit from a valuable electronic education.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
References
Abbaspour, A & Mojtabazadeh, M. (2022). Designing and validation of accreditation and quality assurance model for Iranian higher education. Research on Educational Leadership and Management, 6(22), 7-39. (In Persian)
Abdoli, S., Mohammad Hasani, N. (2015). Research Synthesis of Used Components, Tools and Methods in E-Learning and Presenting a Comprehensive Model for E-Learning Evaluation. Journal of Educational Measurement & Evaluation Studies, 5 (9), 153-172. (In Persian)
Abdullah, F. (2006). The development of HEdPERF: A new measuring instrument of service quality for the higher education sector. International Journal of Consumer Studies, 30(6), 569–581. https://doi.org/10.1111/j.1470-6431.2005.00480.x DOI: https://doi.org/10.1111/j.1470-6431.2005.00480.x
Abili, K., Mostafavi, Z., Narenji thani, F., & Shahosseini, M. A. (2021). A systematic review of the factors and criteria for the accreditation of higher education institutions in the e-learning environment. Information and Communication Technology in Educational Sciences, 12(46), 89-108. (In Persian)
Ahmadi. , S., Qormani , J.,& Abbaszadeh, D. (2020) Presenting a model for the electronic education system of higher education institutions. Educational Leadership and Management Quarterly . 14 (1). 137-164
Ahmady, S., Yazdani, S., Hosseini, M.A., Rokhafroz, D., & Gilav, A. (2019). An Integrated Model of Educational Services Quality. Journal of Research in Medical and Dental Science, 7, 7-13.
Alkhateeb, H., & Romanowski, M. H. (2021). Identifying administrators’ and faculty perspectives regarding CAEP accreditation in a College of Education: AQ methodology research. Studies in Educational Evaluation, 70, 101004. DOI: https://doi.org/10.1016/j.stueduc.2021.101004
Arkorful, V. & Abaidoo, N. (2015). The role of e-learning, advantages and disadvantages of its adoption in higher education. Instructional Technology,
(1): 29-77.
Asheqi B. M., Esmaeili Shad, B. & Hafizian M. (2023). Designing the model of the functional components of the higher education system Using theme analysis. Journal Of Educational Leadership & Administration, 16 (4), 351 -376. (In Persian)
Bakker, A. B., & Xanthopoulou, D. (2009). The crossover of daily work engagement: Test of an actor–partner interdependence model. Journal of Applied Psychology, 94(6), 1562–1571. https://doi.org/10.1037/a0017525 DOI: https://doi.org/10.1037/a0017525
Barkhoda, J., & Ezzatpour S. (2022). Representing the narrative of school principals about the challenges of e-learning Corona pandemic period. MEO; 11 (4): 2. (In Persian) DOI: https://doi.org/10.52547/meo.11.4.13
Bauer, P. & Fedak, V. (2004). Educational visualization of different aspects for power circuits and electrical drives. In 11th International Power Electronics and Motion Control Conference, EPE-PEMC, 4: 2-4. DOI: https://doi.org/10.1080/09398368.2004.11463554
Budiharso, T., & Tarman, B. (2020). Improving Quality Education through Better Working Conditions of Academic Institutes. Journal of Ethnic and Cultural Studies, 7(1), 99-115. DOI: https://doi.org/10.29333/ejecs/306
Can, E. (2016). Open and Distance Education Accreditation Standards Scale: Validity and Reliability Studies. International journal of environmental and science education, 11(14), 644-645.
Castle, S. R. & McGuire, C. (2010). An analysis of student self-assessment of online, blended, and face-to-face learning environments: Implications for sustainable education delivery. International Education Studies, 3(3): 36. DOI: https://doi.org/10.5539/ies.v3n3p36
Cham Asemani.M & Ehtesham, Z. (2021). Designing a Conceptual Model of Factors Affecting the Quality of University Virtual Education and Evaluate its Quality During the COVID.19 Pandemic Institute of Higher Education Mehr Alborz. 10.22034/dtj.2021.292380.1009.
Chen, Z., Zhang, G., & Li, J. (2015). Goodness-of-fit test for meta-analysis. Scientific reports, 5, 16983. https://doi.org/10.1038/srep16983 DOI: https://doi.org/10.1038/srep16983
Chik, A. and Breidbach, S. (2011), Online Language Learning Histories Exchange: Hong Kong and German Perspectives. TESOL Quarterly, 45: 553-564. https://doi.org/10.5054/tq.2011.256795 DOI: https://doi.org/10.5054/tq.2011.256795
Chiu, Ch. M., Chiu, Ch. Sh., & Chang, H.Ch. (2007). Examining the integrated influence of fairness and quality on learners’ satisfaction and web-based learning continuance intention. Information Systems Journal,7(3), 271–287. DOI: https://doi.org/10.1111/j.1365-2575.2007.00238.x
Coppola, N.W. & Hiltz, Starr & Rotter, N. (2002). Becoming a Virtual Professor: Pedagogical Roles and Asynchronous Learning Networks. J. of Management Information Systems. 18. 169-190. 10.1080/07421222.2002.11045703. DOI: https://doi.org/10.1080/07421222.2002.11045703
Cronin, J. J., & Taylor, S. A. (1994). SERVPERF versus SERVQUAL: Reconciling performance-based and perceptions-minus-expectations measurement of service quality. Journal of Marketing, 58(1), 125–131. https://doi.org/10.2307/1252256 DOI: https://doi.org/10.1177/002224299405800110
Davari, A. & Rezazadeh, A. (2013). Structural Equation Modeling with PLS.
de Freitas, Sara & Oliver, Martin. (2005). Does E‐learning Policy Drive Change in Higher Education? A case study relating models of organisational change to e‐learning implementation. Journal of Higher Education Policy and Management. 27. 81-96. 10.1080/13600800500046255 DOI: https://doi.org/10.1080/13600800500046255
Enayati Novinfar, A., Uosefi, M., Siyami, L & Javaheri Daneshmand, M. (2012). Evaluation of the Quality of Education Services of Payam Noor University of Hamedan Based on the SERVQUAL Model, Qurterly Journal of Research and Planing in Higher Education, 17(3), 135. (In Persian)
Farasatkhah, Maghsoud. (2009). “The adventure of university in Iran”. Tehran: Rasa. (In Persian)
Friesen, N. (2009). Re-thinking e-learning research: Foundations, methods, and practices. Peter Lang Publishing. DOI: https://doi.org/10.19173/irrodl.v10i3.733
Gary, F. T. & Terry, A. B. (2003). Determinants of the relative Advantage of a structured SDM during the adoption stage of implementation. Information Technology and Management, 20: 409–428.
Ghanbari, S., Rezghi, S.H., Ziyaeei, M.S., & Mosleh, M. (2019). Presentation an E-Learning Assessment Model - Islamic Azad Univesity E-Campus. 11(41), Journal of Educational Administration Research. 75-100. (In Persian)
Hassanzadeh, A., & Kanaani, F., & Elahi, Sh. (2012). A Model for Measuring e-learning Systems Success in Universities. Expert Syst. Appl. 39 (12), 10959–10966. https://doi.org/10.1016/j.eswa.2012.03.028 DOI: https://doi.org/10.1016/j.eswa.2012.03.028
Ho, S.K. & Wearn, K. (1996). A higher education TQM excellence model:HETQMEX. Quality Assurance in Education, 4(2): 35–42 DOI: https://doi.org/10.1108/09684889610116049
Ibrahim, O. (2015). The implications of applying Total Quality Management (TQM) on e-learning in Egypt: suggested e-learning service quality model. Thesis, University of Huddersfield. http://eprints.hud.ac.uk/id/eprint/26437/.
Jafarzadeh, M.R., Saeidipoor, B., Sarmadi, MR & Esmaeili, Z. (2016). An Analysis of Student-Teacher Interaction in Iranian Electronic Higher Education System, Journal of Educational Measurement & Evaluation Studies, 6 (13), 109-131. (In Persian)
Javadi Bora, M. A., Ebrahimzadeh, I., Farajollahi, M., & Sarmadi, M. R. (2011). Designing an Effectiveness Assessment Model for Distance Education System in Payame Noor University. Information and Communication Technology in Educational Sciences, 2(1), 79-98. (In Persian)
Kelly, A. P. & Columbus, R. (2020). College in the time of coronavirus: Challenges Facing American Higher Education, https://www.jstor.org/stable/resrep2535
Kim, Y. C. (2021). Korean Institute of Medical Education and Evaluation Presidential Address: the role of KIMEE as a medical education accreditation agency during the coronavirus disease 2019 pandemic. Journal of Educational Evaluation for Health Professions, 18. DOI: https://doi.org/10.3352/jeehp.2021.18.2
Khan, M. L., & Setiawan, A. (2019). The impact of E-learning on higher education perception, skills, critical thinking and satisfaction. Journal of Physics: Conference Series. 1375. 012084. 10.1088/1742-6596/1375/1/012084. DOI: https://doi.org/10.1088/1742-6596/1375/1/012084
Khodadad Hoseiny, H., Noori, A & Zabihi, MR. (2013). E-learning acceptance in higher education: Application of flow theory, technology acceptance model & e-service quality. Journal of irphe. 67, 111-136. (In Persian)
Khoury, Ansar & Nasir Eddeen, Lubna & Saadah, Doaa & Harfoushi, Osama. (2011). E-Learning: Justifications and Obstacles. iJET. 6. 53-56. 10.3991/ijet. v6i3.1610. DOI: https://doi.org/10.3991/ijet.v6i3.1610
Lien, N. H. & Kao, S. L. (2008.). The Effects of Service Quality Dimensions on Customer Satisfaction Across Different Service Types: Alternative Differentiation As a Moderator. Advances in Consumer Research, 35: 522-526.
Loiacono, E. T., Watson, R. T., & Goodhue, D. L. (2002). WebQual: A measure of website quality. American Marketing Association. Conference Proceedings, Suppl.2002 AMA Winter Educators' Conference, 13, 432. http://spot.lib.auburn.edu/login?url=https://www.proquest.com/scholarly-journals/webqual-measure-website-quality/docview/199486360/se-2
Martin, F. & Parker, M. (2014). Use of Synchronous Virtual Classrooms: Why, Who and How? MERLOT Journal of Online Learning and Teaching, 10, 2, 192-210. MERLOT Journal of Online Learning and Teaching. 10. 192-210.
Maatuk, A. M., Elberkawi, E. K., Aljawarneh, S., Rashaideh, H., & Alharbi, H. (2021). The COVID-19 Pandemic and E-learning: Challenges and Opportunities from the Perspective of Students and Instructors. Journal of Computing in Higher Education, 1-18. DOI: https://doi.org/10.1007/s12528-021-09274-2
Marsh, H.W. (1982). SEEQ: A Reliable, Valid, and Useful Instrument for Collecting Students' Evaluations of University Teaching. British Journal of Educational Psychology, 52, 77-95. DOI: https://doi.org/10.1111/j.2044-8279.1982.tb02505.x
Martínez-Torres, M. R., Toral, S. L., & Barrero, F. (2011). Identification of the design variables of eLearning tools). Interacting with Computers 23(3), 279-288. doi: 10.1016/j.intcom.2011.04.00. 137-95. DOI: https://doi.org/10.1016/j.intcom.2011.04.004
Masouminia, J., Masoudi Nadushan, E., & Golzari, Z. (2023). Providing a model for evaluating the performance of research organizations of research centers and research institutes of the Ministry of Science Research and Technology. Journal Of Educational Leadership & Administration, 17 (2), 1 -30. (In Persian)
Mirghafoori, S. H., Hatami Manesh, M., & Banifateme, S. A. M. (2013). Designing a Model for Evaluating Services Quality of Electronic News Sites (E-News-Qual) by Factor Analysis. Global Media Journal-Persian Edition, 8(2).
Moawad, R. A. (2020). Online Learning During the COVID-19 Pandemic and Academic Stress in University Students, Revista Romaneasca pentru Educatie Multidimensional, 12 (1). 100-107. DOI: https://doi.org/10.18662/rrem/12.1sup2/252
Mohammadi, R., Zafaripoor, T., Sadeghi Mandi, F & Zamanifar, M. (2015). Accreditation and Quality Assurance of Distance Learning: A review on Patterns and Processes. Journal of Educational Measurement & Evaluation Studies, 4 (8), 95-137. (In Persian)
Momen Moghadam, R., Maleki Avarsin, S., Yari Haj Atalo J., & Habibi, H. (2023). The model of improving the quality of staff training (case study: Broadcasting Organization of the Islamic Republic of Iran). MEO. 12 (3): 4. (In Persian) DOI: https://doi.org/10.61186/meo.12.3.93
Moinikia, M., & Zahidbablan, A. (2012) Assessing the status of the electronic service excellence gap in Payam Noor University Information and communication technology of Iran . 4 (11). 27-35
Mosavei Salehi, H., Esfijani, A & Zamani, B. (2020). Development & Validation of a Framework for Quality Assessment of Massive Open Online Courses (MOOC). Journal of Educational Measurement & Evaluation Studies, 10(30), 187-215. (In Persian)
Mothibi, G. (2015). A Meta-Analysis of the Relationship between E-Learning and Students’ Academic Achievement in Higher Education. Journal of
Education and Practice, 6(9): 6-9.
Papadomichelaki, X., & Mentzas, G. (2012). e-GovQual: A multiple-item scale for assessing e-government service quality. Gov. Inf. Q., 29, 98-109. DOI: https://doi.org/10.1016/j.giq.2011.08.011
Parasuraman, A P., Zeithaml, V & Berry, L. (1988). SERVQUAL A Multiple-item Scale for Measuring Consumer Perceptions of Service Quality. Journal of Retailing. 64. 12-40.
Powell, T. C. (1995). Total Quality Management as Competitive Advantage: A Review and Empirical Study. Strategic Management Journal, 16(1), 15–37. http://www.jstor.org/stable/2486944 DOI: https://doi.org/10.1002/smj.4250160105
Roshani A., H., Fathi Vajargah, K. & Khorasani, A. (2017). The Challenges of the Quality Evaluation of Virtual Education Curriculum: The Case of Shahid Beheshti University. Journal of Educational Measurement & Evaluation Studies, 7 (18). 29-52. (In Persian)
Shahhoseini, M, A., Narenji Thani, F., Ebadi, R & Roodbari, H. (2015). Service quality Evaluation of teaching-learning system in higher education, Journal of Academic Librarianship and Information Research, 49(2), 277-303. (In Persian)
Shams Nosrati, V & Moazami, M. (2022). The Impact of Education Quality on e-Learning in Higher Education Institutions. Journal of Management and Leadership Studies in Educational Organizations. 3 (2), 15-30. (In Persian)
Shokri, N., Salavati, A., & Hasani, R. (2019). Designing a Model for Strategic Indicators of Quality in Applied Science Education Centers. Journal of Strategic Management Studies, 10 (39), 231 -250. (In Persian)
Shilova, T., Artamonova, L., & Averina, S. (2014). Computer-based Tests as an Integral Component of an EFL Course in Moodle for Non-linguistic Students. Procedia - Social and Behavioral Sciences. 154. 10.1016/j.sbspro.2014.10.187. DOI: https://doi.org/10.1016/j.sbspro.2014.10.187
Soni, V.D. (2020). Global Impact of E-learning during COVID 19A. SSRN: https://ssrn.com/abstract=3630073 or http://dx.doi.org/10.2139/ssrn.3630073 DOI: https://doi.org/10.2139/ssrn.3630073
Saputra, D. E. E., Maulida Rahma, V., Eliyana, A., Pratama, A. S., Anggraini, R. D., Kamil, N. L. M., & Ismail, I. (2023). Do system quality and information quality affect job performance? The mediation role of users' perceptions. PloS one, 18(6), e0285293. https://doi.org/10.1371/journal.pone.0285293 DOI: https://doi.org/10.1371/journal.pone.0285293
Subrahmanyam, K., Michikyan, M., Clemmons, C., Carrillo, R., Uhls, Y.T., & Greenfield, P.M. (2014). Paper versus computer screens: The impact of reading medium and multitasking on memory and report writing. International Journal of Cyber Behavior, Psychology and Learning. 3(4):1-27. DOI: https://doi.org/10.4018/ijcbpl.2013100101
Tan, Q., Chang, W., & Kinshuk (2015). Location-Based Augmented Reality for Mobile Learning: Algorithm, System, and Implementation. Electronic Journal of e-Learning, 13, 138-148.
Wang, Y. S. (2003). Assessment of learner satisfaction with asynchronous electronic 52. learning systems. Information and Management, 41(1): 75-86. DOI: https://doi.org/10.1016/S0378-7206(03)00028-4
Webb, H. and Webb, L. (2004) SiteQual: An Integrated Measure of Web Site Quality. Journal of Enterprise Information Management, 17, 430-440.
https://doi.org/10.1108/17410390410566724 DOI: https://doi.org/10.1108/17410390410566724
Yasini, A., Niku, A., Taban, M., & Purashraf, Y. (2017). Designing a Model for Higher Education Marketing in Iran. Journal of Business Management, 9(2), 415-438. doi: 10.22059/jibm.2017.217294.2285
Zakeri M. (2023). Criticism of the training program from the Perspective of Farhangian University Students: A Case Study of Hormozgan. MEO. 12 (1): 9. (In Persian) DOI: https://doi.org/10.52547/meo.12.1.231
Zamani, A., Mohamad, M., Reesha, A., & Kamarudin, R. (2022). The Impact of Covid-19: A Literature Review on Challenges in E-Learning. Creative Education. 13. 3490-3503. 10.4236/ce.2022.1311224. DOI: https://doi.org/10.4236/ce.2022.1311224
Zarei Saroukolaei, M., Shams, G., RezaeiZadeh, M., Ghahramani, M. (2021). Learning assessment techniques in university e-learning. Educational Measurement and Evaluation Studies, 11 (1): 27. (In Persian)