Abstract
The increasing use of digital tools in education has revolutionized teaching practices, yet comprehensive evidence of their educational impact remains limited. A 2023 UNESCO report reveals that while 78% of classrooms now employ educational technology, only 32% of educators receive sufficient training to implement these tools effectively. This discrepancy emphasizes the importance of examining how technology can truly enhance learning when properly integrated with pedagogical methods. This study investigates the effects of pedagogically-informed technology use on student achievement, identifying the most effective combinations of digital resources and teaching approaches across various educational settings. Employing a mixed-methods design, the research analyzed 185 studies (2018-2023) from major databases, along with classroom observations across 15 nations. Qualitative insights from 250 educators revealed implementation challenges. Three key factors emerged as crucial for success: teacher expertise in technology-enhanced pedagogy (β=0.63), curriculum integration (β=0.57), and student digital competence (β=0.49). The results underscore that meaningful educational technology integration requires deliberate pedagogical design, not merely technological access, highlighting the critical need for professional development focused on pedagogical-technological knowledge.
Full text article
References
Aljaloud, A. S. (2022). A Deep Learning Model to Predict Student Learning Outcomes in LMS Using CNN and LSTM. IEEE Access, 10(Query date: 2025-04-09 18:56:00), 85255–85265. https://doi.org/10.1109/ACCESS.2022.3196784
Baboolal, S. O. (2024). Implementation and Impact of an Adapted Digital Perioperative Competency-Building Tool to Enhance Teaching, Learning And Feedback in Postgraduate Competency-Based Medical Education. Journal of Surgical Education, 81(5), 722–740. https://doi.org/10.1016/j.jsurg.2024.01.015
Bailey, D. R. (2022). Video conferencing in the e-learning context: Explaining learning outcome with the technology acceptance model. Education and Information Technologies, 27(6), 7679–7698. https://doi.org/10.1007/s10639-022-10949-1
Bertsimas, D. (2021). Adverse Outcomes Prediction for Congenital Heart Surgery: A Machine Learning Approach. World Journal for Pediatric and Congenital Heart Surgery, 12(4), 453–460. https://doi.org/10.1177/21501351211007106
Birgili, B. (2021). The trends and outcomes of flipped learning research between 2012 and 2018: A descriptive content analysis. Journal of Computers in Education, 8(3), 365–394. https://doi.org/10.1007/s40692-021-00183-y
Cajiao, D. (2022). Tourists’ motivations, learning, and trip satisfaction facilitate pro-environmental outcomes of the Antarctic tourist experience. Journal of Outdoor Recreation and Tourism, 37(Query date: 2025-04-09 18:56:00). https://doi.org/10.1016/j.jort.2021.100454
Chai, Y. J. (2021). Transoral endoscopic thyroidectomy vestibular approach (Toetva): Surgical outcomes and learning curve. Journal of Clinical Medicine, 10(4), 1–15. https://doi.org/10.3390/jcm10040863
Fu, Q. K. (2024). A review of AWE feedback: Types, learning outcomes, and implications. Computer Assisted Language Learning, 37(1), 179–221. https://doi.org/10.1080/09588221.2022.2033787
Gerpott, F. H. (2021). Age diversity and learning outcomes in organizational training groups: The role of knowledge sharing and psychological safety. International Journal of Human Resource Management, 32(18), 3777–3804. https://doi.org/10.1080/09585192.2019.1640763
Gilsenan, C. (2023). Reflective practice ePortfolios: A digital teaching tool to enhance third year BA culinary and gastronomic science students’ professional learning experiences. International Conference on Higher Education Advances, Query date: 2025-04-09 18:54:23, 1225–1232. https://doi.org/10.4995/HEAd23.2023.16089
Gregorio, F. D. (2022). Accuracy of EEG Biomarkers in the Detection of Clinical Outcome in Disorders of Consciousness after Severe Acquired Brain Injury: Preliminary Results of a Pilot Study Using a Machine Learning Approach. Biomedicines, 10(8). https://doi.org/10.3390/biomedicines10081897
Grønlien, H. K. (2021). A blended learning teaching strategy strengthens the nursing students’ performance and self-reported learning outcome achievement in an anatomy, physiology and biochemistry course – A quasi-experimental study. Nurse Education in Practice, 52(Query date: 2025-04-09 18:56:00). https://doi.org/10.1016/j.nepr.2021.103046
Guo, J. P. (2022). Academic self-concept, perceptions of the learning environment, engagement, and learning outcomes of university students: Relationships and causal ordering. Higher Education, 83(4), 809–828. https://doi.org/10.1007/s10734-021-00705-8
Guo, L. (2022). Using metacognitive prompts to enhance self-regulated learning and learning outcomes: A meta-analysis of experimental studies in computer-based learning environments. Journal of Computer Assisted Learning, 38(3), 811–832. https://doi.org/10.1111/jcal.12650
Hariton, E. (2021). A machine learning algorithm can optimize the day of trigger to improve in vitro fertilization outcomes. Fertility and Sterility, 116(5), 1227–1235. https://doi.org/10.1016/j.fertnstert.2021.06.018
Haryana, M. R. A. (2022). Virtual reality learning media with innovative learning materials to enhance individual learning outcomes based on cognitive load theory. International Journal of Management Education, 20(3). https://doi.org/10.1016/j.ijme.2022.100657
Iatrellis, O. (2021). A two-phase machine learning approach for predicting student outcomes. Education and Information Technologies, 26(1), 69–88. https://doi.org/10.1007/s10639-020-10260-x
Jia, L. (2022). Research Progress in the Design and Synthesis of Herbicide Safeners: A Review. Journal of Agricultural and Food Chemistry, 70(18), 5499–5515. https://doi.org/10.1021/acs.jafc.2c01565
Jiang, X. (2023). An MRI Deep Learning Model Predicts Outcome in Rectal Cancer. Radiology, 307(5). https://doi.org/10.1148/radiol.222223
Khasawneh, M. A. S. (2024). Breaking Traditional Boundaries in Translation Pedagogy; Evaluating How Senior Lecturers Have Incorporated Digital Tools to Enhance Translation Teaching. World Journal of English Language, 14(4), 154–165. https://doi.org/10.5430/wjel.v14n4p154
Kourou, K. (2021). A machine learning-based pipeline for modeling medical, socio-demographic, lifestyle and self-reported psychological traits as predictors of mental health outcomes after breast cancer diagnosis: An initial effort to define resilience effects. Computers in Biology and Medicine, 131(Query date: 2025-04-09 18:56:00). https://doi.org/10.1016/j.compbiomed.2021.104266
Lee, J. (2022). What affects learner engagement in flipped learning and what predicts its outcomes? British Journal of Educational Technology, 53(2), 211–228. https://doi.org/10.1111/bjet.12717
Levitt, H. M. (2021). The methodological integrity of critical qualitative research: Principles to support design and research review. Journal of Counseling Psychology, 68(3), 357–370. https://doi.org/10.1037/cou0000523
Liu, Y. (2022). The Impact of Teacher Competence in Online Teaching on Perceived Online Learning Outcomes during the COVID-19 Outbreak: A Moderated-Mediation Model of Teacher Resilience and Age. International Journal of Environmental Research and Public Health, 19(10). https://doi.org/10.3390/ijerph19106282
Martin, F. (2021). A Meta-Analysis on the Effects of Synchronous Online Learning on Cognitive and Affective Educational Outcomes. International Review of Research in Open and Distributed Learning, 22(3), 205–242. https://doi.org/10.19173/IRRODL.V22I3.5263
Martin, F. (2022). A Meta-Analysis on the Community of Inquiry Presences and Learning Outcomes in Online and Blended Learning Environments. Online Learning Journal, 26(1), 325–359. https://doi.org/10.24059/olj.v26i1.2604
Nurtanto, M. (2021). A Review of Gamification Impact on Student Behavioral and Learning Outcomes. International Journal of Interactive Mobile Technologies, 15(21), 22–36. https://doi.org/10.3991/ijim.v15i21.24381
O’Brien, G. (2021). Flipped learning as a tool to enhance digital citizenship: How teachers’ experiences of online teaching during the COVID-19 pandemic can encourage participatory and justice-oriented citizenship. Citizenship Teaching and Learning, 16(2), 213–223. https://doi.org/10.1386/ctl_00057_1
Pearson, H. A. (2022). 3D printing as an educational technology: Theoretical perspectives, learning outcomes, and recommendations for practice. Education and Information Technologies, 27(3), 3037–3064. https://doi.org/10.1007/s10639-021-10733-7
Pedersen, C. F. (2022). Applied Machine Learning for Spine Surgeons: Predicting Outcome for Patients Undergoing Treatment for Lumbar Disc Herniation Using PRO Data. Global Spine Journal, 12(5), 866–876. https://doi.org/10.1177/2192568220967643
Pfob, A. (2023). Towards Patient-centered Decision-making in Breast Cancer Surgery: Machine Learning to Predict Individual Patient-reported Outcomes at 1-year Follow-up. Annals of Surgery, 277(1). https://doi.org/10.1097/SLA.0000000000004862
Phelan, S. M. (2022). A model of weight-based stigma in health care and utilization outcomes: Evidence from the learning health systems network. Obesity Science and Practice, 8(2), 139–146. https://doi.org/10.1002/osp4.553
Roche, C. (2021). Validation of a machine learning–derived clinical metric to quantify outcomes after total shoulder arthroplasty. Journal of Shoulder and Elbow Surgery, 30(10), 2211–2224. https://doi.org/10.1016/j.jse.2021.01.021
Rossi, I. V. (2021). Active learning tools improve the learning outcomes, scientific attitude, and critical thinking in higher education: Experiences in an online course during the COVID-19 pandemic. Biochemistry and Molecular Biology Education, 49(6), 888–903. https://doi.org/10.1002/bmb.21574
Schmidt, L. J. (2022). A machine-learning–based algorithm improves prediction of preeclampsia-associated adverse outcomes. American Journal of Obstetrics and Gynecology, 227(1), 77–77. https://doi.org/10.1016/j.ajog.2022.01.026
Serpe, A. (2023). Digital Tools to Enhance Interdisciplinary Mathematics Teaching Practices in High School. Communications in Computer and Information Science, 1779(Query date: 2025-04-09 18:54:23), 209–218. https://doi.org/10.1007/978-3-031-29800-4_16
Shafait, Z. (2021). An assessment of students’ emotional intelligence, learning outcomes, and academic efficacy: A correlational study in higher education. PLoS ONE, 16(8). https://doi.org/10.1371/journal.pone.0255428
Shu, X. (2023). An Empirical Study of A Smart Education Model Enabled by the Edu-Metaverse to Enhance Better Learning Outcomes for Students. Systems, 11(2). https://doi.org/10.3390/systems11020075
Tunthanathip, T. (2021). Application of machine learning to predict the outcome of pediatric traumatic brain injury. Chinese Journal of Traumatology - English Edition, 24(6), 350–355. https://doi.org/10.1016/j.cjtee.2021.06.003
Wekerle, C. (2022). Using digital technology to promote higher education learning: The importance of different learning activities and their relations to learning outcomes. Journal of Research on Technology in Education, 54(1), 1–17. https://doi.org/10.1080/15391523.2020.1799455
Wigfield, A. (2023). The Role of Children’s Achievement Values in the Self-Regulation of Their Learning Outcomes. Self-Regulation of Learning and Performance Issues and Educational Applications, Query date: 2025-04-09 18:56:00, 101–124. https://doi.org/10.4324/9780203763353-5
Yang, Y. (2021). A multi-omics-based serial deep learning approach to predict clinical outcomes of single-agent anti-PD-1/PD-L1 immunotherapy in advanced stage non-small-cell lung cancer. American Journal of Translational Research, 13(2), 743–756.
Yu, Z. (2022). A meta-analysis and systematic review of the effect of virtual reality technology on users’ learning outcomes. Computer Applications in Engineering Education, Query date: 2025-04-09 18:56:00. https://doi.org/10.1002/cae.22532
Yunusa, A. A. (2021). A scoping review of Critical Predictive Factors (CPFs) of satisfaction and perceived learning outcomes in E-learning environments. Education and Information Technologies, 26(1), 1223–1270. https://doi.org/10.1007/s10639-020-10286-1
Zhang, Q. (2021). A literature review on the influence of Kahoot! On learning outcomes, interaction, and collaboration. Education and Information Technologies, 26(4), 4507–4535. https://doi.org/10.1007/s10639-021-10459-6
Zhang, X. (2021). Application of design-based learning and outcome-based education in basic industrial engineering teaching: A new teaching method. Sustainability (Switzerland), 13(5), 1–23. https://doi.org/10.3390/su13052632
Zheng, W. (2021). Research on the design of analytical communication and information model for teaching resources with cloud-sharing platform. Computer Applications in Engineering Education, 29(2), 359–369. https://doi.org/10.1002/cae.22375
Zhou, S. (2021). Research on blade design method of multi-blade centrifugal fan for building efficient ventilation based on Hicks-Henne function. Sustainable Energy Technologies and Assessments, 43(Query date: 2025-04-10 17:07:54). https://doi.org/10.1016/j.seta.2020.100971
Authors
Copyright (c) 2025 Wardani Purnama Sari, Febi Nuris Putra, Faisal Razak

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.