Effects of a TPACK-based online didactic design on university students’ statistical literacy: A quasi-experimental study
DOI:
https://doi.org/10.58524/jasme.v6i1.1103Keywords:
Distance education, Prior mathematical knowledge, Statistical literacy, TPACKAbstract
Background: Students in distance statistics courses often achieve lower learning outcomes compared to those in face-to-face settings. Although the Technological Pedagogical Content Knowledge (TPACK) framework has been widely applied in technology-integrated instruction, limited empirical evidence clarifies whether prior mathematical knowledge (PMK) moderates its effectiveness in asynchronous online statistics learning.
Aim: This study examined the effectiveness of a TPACK-based online tutorial design in improving students’ statistical literacy and investigated the moderating role of PMK.
Methods: A quasi-experimental design involved 170 distance education students (experimental n = 85; control n = 85) classified into low, medium, and high PMK levels. The experimental group participated in a 12-session TPACK-based online tutorial with periodic webinar integration, while the control group received conventional online instruction. Statistical literacy was measured using post-test and normalized gain scores and analyzed through two-way ANOVA and simple effects tests.
Results: The analysis revealed a significant main effect of tutorial design (ηp² = .102–.116), indicating higher achievement among students receiving TPACK-based instruction. PMK showed a stronger main effect (ηp² = .215–.230), suggesting substantial differences in performance across readiness levels. A significant interaction effect demonstrated a threshold pattern. Students with medium and high PMK obtained significantly higher post-test scores and normalized gains in the experimental group, while students with low PMK showed no statistically significant differences between tutorial designs. The magnitude of learning gains increased consistently from low to high PMK categories, confirming that instructional benefits intensified alongside mathematical readiness.
Conclusion: The effectiveness of TPACK-based online tutorials depends on students’ prior mathematical knowledge. Instructional advantages are pronounced for learners with adequate foundational skills but limited for those with low readiness. These findings emphasize the need for adaptive support mechanisms to ensure that technology-integrated instruction produces equitable outcomes in distance statistics education.
References
Abousoliman, A. D., Ibrahim, A. M., Abualruz, H., Magdi, H. M., Zaghamir, D. E. F., Alhowimel, A., ... & Zoromba, M. A. (2024). Exploring the relationship between nursing students’ knowledge and attitudes towards climate change and their psychological distress: a cross-national investigation. BMC nursing, 23(1), 294. https://doi.org/10.1186/s12912-024-01927-8
Bozkurt, A., Jung, I., Xiao, J., Vladimirschi, V., Schuwer, R., Egorov, G., Lambert, S., Al-Freih, M., Pete, J., Olcott, D., Rodes, V., Aranciaga, I., Bali, M., Alvarez, A., Roberts, J., Pazurek, A., Raffaghelli, J., Panagiotou, N., de Coëtlogon, P., & Paskevicius, M. (2020). A global outlook to the interruption of education due to COVID-19 pandemic: Navigating in a time of uncertainty and crisis. Asian Journal of Distance Education, 15(1), 1–126. https://doi.org/10.5281/zenodo.3878572
Bueno, R., Niess, M. L., Engin, R. A., Ballejo, C. C., & Lieban, D. (2023). Technological pedagogical content knowledge: Exploring new perspectives. Australasian Journal of Educational Technology, 39(1), 88-105. https://doi.org/10.14742/ajet.7970
Chen, O., Paas, F., & Sweller, J. (2023). A cognitive load theory approach to defining and measuring task complexity through element interactivity. Educational Psychology Review, 35, Article 63. https://doi.org/10.1007/s10648-023-09782-w
Conway IV, B., Gary Martin, W., Strutchens, M., Kraska, M., & Huang, H. (2019). The statistical reasoning learning environment: A comparison of students’ statistical reasoning ability. Journal of Statistics Education, 27(3), 171-187. https://doi.org/10.1080/10691898.2019.1647008
Edisherashvili, N., Saks, K., Pedaste, M., & Leijen, Ä. (2022). Supporting self-regulated learning in distance learning contexts at higher education level: Systematic literature review. Frontiers in psychology, 12, 792422. https://doi.org/10.3389/fpsyg.2021.792422
Feng, B., Chen, M., Lin, Y., & Li, X. (2020). How does prior knowledge influence learning engagement? The mediating roles of cognitive load and help-seeking. Frontiers in Psychology, 11, Article 591203. https://doi.org/10.3389/fpsyg.2020.591203
Keazer, L., & Phaiah, J. (2023). Analyzing prospective elementary teachers’ evidence of conceptual understanding and procedural fluency. Investigations in Mathematics Learning, 15(2), 135-148. https://doi.org/10.1080/19477503.2022.2139112
Koga, S. (2022). Characteristics of statistical literacy skills from the perspective of critical thinking. Teaching Statistics, 44(2), 59-67. https://doi.org/10.1111/test.12302
Lachner, A., Fabian, A., Franke, U., Preiß, J., Jacob, L., Führer, C., Küchler, U., Paravicini, W., Randler, C., & Thomas, P. (2021). Fostering pre-service teachers' technological pedagogical content knowledge (TPACK): A quasi-experimental field study. Computers & Education, 174, Article 104304. https://doi.org/10.1016/j.compedu.2021.104304
Martin, A. J., Ginns, P., Burns, E. C., Kennett, R., Munro-Smith, V., Collie, R. J., & Pearson, J. (2023). Load reduction instruction: Multilevel effects for motivation, engagement, and achievement in mathematics. Educational Psychology, 43(10), 1125–1143. https://doi.org/10.1080/01443410.2023.2290442
Morales-López, Y., Poveda-Vásquez, R., & Chacón-Camacho, Y. (2023). A systematic literature review of technological, pedagogical and content knowledge (TPACK) in mathematics education. Cogent Education, 10(2), Article 2269047. https://doi.org/10.1080/2331186X.2023.2269047
Ngu, B. H., & Phan, H. P. (2023). Instructional efficiency: The role of prior knowledge and cognitive load. Applied Cognitive Psychology, 37(3), e4117. https://doi.org/10.1002/acp.4117
Ning, Y., Zhang, C., Xu, B., Zhou, Y., & Wijaya, T. T. (2024). Teachers’ AI-TPACK: Exploring the relationship between knowledge elements. Sustainability, 16(3), 978. https://doi.org/10.3390/su16030978
Plass, J. L., & Kalyuga, S. (2019). Four ways of considering emotion in cognitive load theory. Educational psychology review, 31(2), 339-359. https://doi.org/10.1007/s10648-019-09473-5
Paas, F., & van Merriënboer, J. J. G. (2020). Cognitive load theory: Methods to manage working memory load in the learning of complex tasks. Current Directions in Psychological Science, 29(4), 394–398. https://doi.org/10.1177/0963721420922183
Schmid, M., Brianza, E., & Petko, D. (2020). Developing a short assessment instrument for technological pedagogical content knowledge (TPACK.xs) and comparing the factor structure of an integrative and a transformative model. Computers & Education, 157, Article 103967. https://doi.org/10.1016/j.compedu.2020.103967
Schmid, M., Brianza, E., Mok, S. Y., & Petko, D. (2024). Running in circles: A systematic review of reviews on technological pedagogical content knowledge (TPACK). Computers & Education, 214, Article 105024. https://doi.org/10.1016/j.compedu.2024.105024
Schneider, M., & Simonsmeier, B. A. (2025). How does prior knowledge affect learning? A review of 16 mechanisms and a framework for future research. Learning and Individual Differences, 122, Article 102744. https://doi.org/10.1016/j.lindif.2025.102744
Seaman, J. E., Allen, I. E., & Seaman, J. (2018). Grade increase: Tracking distance education in the United States. Babson Survey Research Group.
Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57(1), 1–23. https://doi.org/10.17763/haer.57.1.j463w79r56455411
Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019). Cognitive architecture and instructional design: 20 years later. Educational Psychology Review, 31(2), 261–292. https://doi.org/10.1007/s10648-019-09465-5
Tetzlaff, L., & Peters, T. (2025). A cornerstone of adaptivity: A meta-analysis of the expertise reversal effect. Learning and Instruction. Advance online publication. https://doi.org/10.1016/j.learninstruc.2025.102142
Tondeur, J., Scherer, R., Siddiq, F., & Baran, E. (2020). Enhancing pre-service teachers' technological pedagogical content knowledge (TPACK): A mixed-method study. Educational Technology Research and Development, 68(1), 319–343. https://doi.org/10.1007/s11423-019-09692-1
Tseng, J. J., Chai, C. S., Tan, L., & Park, M. (2022). A critical review of research on technological pedagogical and content knowledge (TPACK) in language teaching. Computer Assisted Language Learning, 35(4), 948-971. https://doi.org/10.1080/09588221.2020.1868531
Xu, D., & Jaggars, S. S. (2014). Performance gaps between online and face-to-face courses: Differences across types of students and academic subject areas. The Journal of Higher Education, 85(5), 633–659. https://doi.org/10.1080/00221546.2014.11777343
Zeng, Y., Wang, Y., & Li, S. (2022). The relationship between teachers' information technology integration self-efficacy and TPACK: A meta-analysis. Frontiers in Psychology, 13, Article 1091017. https://doi.org/10.3389/fpsyg.2022.1091017
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Kartono Kartono, Sudirman Sudirman, Camilo Andrés Rodríguez-Nieto
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
