Development and evaluation of a steam-based digital activity book and numeracy assessment for elementary mathematics learning

Ayu Made Juniwati Wiratha; Hartono; Via Yustitia

doi:10.58524/jasme.v6i4.1607

Authors

Ayu Made Juniwati Wiratha Universitas PGRI Adi Buana, Indonesia
Hartono Universitas PGRI Adi Buana, Indonesia
Via Yustitia Universitas PGRI Adi Buana, Indonesia

DOI:

https://doi.org/10.58524/jasme.v6i4.1607

Keywords:

Digital Activity Book, Elementary Mathematics Education, Numeracy Assessment, Psychometric Evaluation, STEAM-Based Learning

Abstract

Background: Developing elementary students’ numeracy skills requires innovative instructional resources supported by valid and reliable assessment instruments. Integrating Science, Technology, Engineering, Arts, and Mathematics (STEAM) into digital learning environments offers opportunities to promote interactive and contextualized mathematics learning.

Aims: This study aims to develop and evaluate a STEAM-based Digital Activity Book and examine the psychometric quality of its accompanying numeracy assessment instrument.

Method: A Research and Development (R&D) approach employing the ADDIE model was implemented. The development process involved instructional design, expert validation, and empirical assessment. Media feasibility was evaluated by four experts, while item validity and internal consistency were examined using Pearson Product–Moment correlation and Kuder–Richardson Formula 20 (KR-20), respectively.

Results: Expert evaluation yielded an average media feasibility score of 87.5%, indicating high validity. Of the 30 dichotomously scored multiple-choice items developed, 18 were reported as valid. The numeracy assessment demonstrated acceptable internal consistency, with a KR-20 coefficient of 0.78.

Conclusion: The findings provide preliminary evidence supporting the feasibility of the STEAM-based Digital Activity Book and the reliability of its accompanying numeracy assessment, establishing a foundation for further evaluation of mathematics learning in elementary education.

References

Adi, L., & Winarso, W. (2026). Problems in Mathematics Learning: Fundamental Concepts, Scope, Contributing Factors, Consequences, and Interventions (SSRN Scholarly Paper No. 7547285). Social Science Research Network. https://doi.org/10.2139/ssrn.7547285

Bang, H. J., Li, L., & Flynn, K. (2023). Efficacy of an Adaptive Game-Based Math Learning App to Support Personalized Learning and Improve Early Elementary School Students' Learning. Early Childhood Education Journal, 51(4), 717–732. https://doi.org/10.1007/s10643-022-01332-3

Belbase, S., Mainali, B. R., Kasemsukpipat, W., Tairab, H., Gochoo, M., & Jarrah, A. (2022). At the dawn of science, technology, engineering, arts, and mathematics (STEAM) education: Prospects, priorities, processes, and problems. International Journal of Mathematical Education in Science and Technology, 53(11), 2919–2955. https://doi.org/10.1080/0020739X.2021.1922943

Chai, C. S., Rahmawati, Y., & Jong, M. S.-Y. (2020). Indonesian Science, Mathematics, and Engineering Preservice Teachers' Experiences in STEM-TPACK Design-Based Learning. Sustainability, 12(21), 9050. https://doi.org/10.3390/su12219050

Chen, W. (2025). Problem-Solving Skills, Memory Power, and Early Childhood Mathematics: Understanding the Significance of the Early Childhood Mathematics in an Individual's Life. Journal of the Knowledge Economy, 16(1), 1–25. https://doi.org/10.1007/s13132-023-01557-6

Chin, H., Chew, C. M., & Lim, H. L. (2021). Development and validation of online cognitive diagnostic assessment with ordered multiple-choice items for 'Multiplication of Time.' Journal of Computers in Education, 8(2), 289–316. https://doi.org/10.1007/s40692-020-00180-7

Cirneanu, A.-L., & Moldoveanu, C.-E. (2024). Use of Digital Technology in Integrated Mathematics Education. Applied System Innovation, 7(4), 66. https://doi.org/10.3390/asi7040066

Danuri, S. B. W. (2025). Numeracy Literacy Reviewed From Mathematical Reasoning In Child-Friendly Mathematics Learning. TPM - Testing, Psychometrics, Methodology in Applied Psychology, 32(2-June), 504–515.

Demosthenous, E., Christou, C., & Pitta-Pantazi, D. (2021). Mathematics Classroom Assessment: A Framework for Designing Assessment Tasks and Interpreting Students' Responses. European Journal of Investigation in Health, Psychology and Education, 11(3), 1088–1106. https://doi.org/10.3390/ejihpe11030081

Gilleece, L., Karakolidis, A., & Clerkin, A. (2026). The validity of school socio-economic status measures: How do indicators from TIMSS and PISA compare to national administrative data sources? Large-Scale Assessments in Education, 14(1), 45. https://doi.org/10.1186/s40536-026-00305-x

Hadi, S., Dolk, M., Kamaliyah, & Hidayanto, T. (2025). Mathematical Reasoning: How Students Learn Mathematics? Journal on Mathematics Education, 16(3), 937–954. https://doi.org/10.22342/jme.v16i3.pp937-954

Hosgoren Alici, Y., Özbaran, N. B., Köse, S., Gormez, A., Kandeğer, A., Algedik, P., Erbaş, S., Yenice, H. A., Mançe Çalışır, Ö., Hasanli, J., Asut, G., Mısır, E., Torenli, Z. K., Bağcaz, A., Ceran, S., Ayraler Taner, H., Emekli, E., Özel, B., Aksoy, U. M., … Atbaşoğlu, C. (2026). Validity and Reliability of the Turkish Version of the Adult Autism Subthreshold Spectrum Scale. Intellectual and Developmental Disabilities, 0(0), 1–16. https://doi.org/10.1080/19349491.2026.2734441

Joshi, D. R., Adhikari, K. P., Khanal, J., Belbase, S., & Khanal, B. (2023). Developing and integrating digital resources in online mathematics instruction and assessment during Covid-19. Cogent Education, 10(2), 2230394. https://doi.org/10.1080/2331186X.2023.2230394

Juškevičienė, A., Dagienė, V., & Dolgopolovas, V. (2021). Integrated activities in STEM environment: Methodology and implementation practice. Computer Applications in Engineering Education, 29(1), 209–228. https://doi.org/10.1002/cae.22324

Kaminski, J. A., & Sloutsky, V. M. (2020). The use and effectiveness of colorful, contextualized, student-made material for elementary mathematics instruction. International Journal of STEM Education, 7(1), 6. https://doi.org/10.1186/s40594-019-0199-7

Karakolidis, A., Duggan, A., Shiel, G., & Kiniry, J. (2021). Examining educational inequalities: Insights in the context of improved mathematics performance on national and international assessments at primary level in Ireland. Large-Scale Assessments in Education, 9(1), 5. https://doi.org/10.1186/s40536-021-00098-1

Khanipour, H., Geramipour, M., Radfar, M., & Mirahadi, S. S. (2025). Psychometric properties of process assessment of the learner (second edition): Diagnostics for math among Iranian elementary school students. Applied Neuropsychology: Child, 0(0), 1–9. https://doi.org/10.1080/21622965.2025.2461716

Larrain, M., Navarro, M., & Pezoa, J. (2026). Development and psychometric validity evidence of a curriculum-based and adaptive mathematics assessment tool. Assessment in Education: Principles, Policy & Practice, 33(3), 285–305. https://doi.org/10.1080/0969594X.2026.2689693

Lavicza, Z., Weinhandl, R., Prodromou, T., Anđić, B., Lieban, D., Hohenwarter, M., Fenyvesi, K., Brownell, C., & Diego-Mantecón, J. M. (2022). Developing and Evaluating Educational Innovations for STEAM Education in Rapidly Changing Digital Technology Environments. Sustainability, 14(12), 7237. https://doi.org/10.3390/su14127237

Liston, M., Morrin, A. M., Furlong, T., & Griffin, L. (2022). Integrating Data Science and the Internet of Things Into Science, Technology, Engineering, Arts, and Mathematics Education Through the Use of New and Emerging Technologies. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.757866

Liu, Y., Peng, P., & Yan, X. (2025). Early numeracy and mathematics development: A longitudinal meta-analysis on the predictive nature of early numeracy. Journal of Educational Psychology, 117(6), 863–883. https://doi.org/10.1037/edu0000925

McNeil, N. M., Jordan, N. C., Viegut, A. A., & Ansari, D. (2025). What the Science of Learning Teaches Us About Arithmetic Fluency. Psychological Science in the Public Interest, 26(1), 10–57. https://doi.org/10.1177/15291006241287726

Navas-Echazarreta, N., Juárez-Vela, R., Martínez-Sabater, A., Echániz-Serrano, E., Fernández-Rodrigo, M. T., Navarro-Martínez, O., Sancho-Sánchez, C., Cobos-Rincón, A., Rodríguez-Calvo, A., González-Fernández, S., Chover-Sierra, E., & Satústegui-Dordá, P. J. (2024). Measuring Instruments for Media Health Literacy: A Systematic Review of Psychometric Properties. Nursing Reports, 14(4), 2795–2818. https://doi.org/10.3390/nursrep14040206

Onoshakpokaiye, O. (2023). Early Childhood Mathematics: An Insight into Strategies for Developing Young Children Mathematical Skills. Mathematics Education Journal, 7(1), 16–30. https://doi.org/10.22219/mej.v7i1.24534

Outhwaite, L. A., Aunio, P., Leung, J. K. Y., & Van Herwegen, J. (2024). Measuring Mathematical Skills in Early Childhood: A Systematic Review of the Psychometric Properties of Early Maths Assessments and Screeners. Educational Psychology Review, 36(4), 110. https://doi.org/10.1007/s10648-024-09950-6

Purcar, A.-M., Bocoș, M., Pop, A.-L., Roman, A., Rad, D., Mara, D., Crișan, C., Răduț-Taciu, R., Mara, E.-L., Todor, I., Muntean-Trif, L., Neacșu, M.-G., Costache Colareza, C., Maier, M., Tăușan-Crișan, L., Triff, Z., Baciu, C., Marin, D.-C., & Triff, D.-G. (2024). The Effect of Visual Reasoning on Arithmetic Word Problem Solving. Education Sciences, 14(3), 278. https://doi.org/10.3390/educsci14030278

Rosita, C. D., Setiyani, Asmara, A. S., Sumarwati, S., & Suprayo, T. (2026). Mathematical Thinking Processes Based on Decision-Making Types in Grade VIII Numeracy: Foundations for Differentiated Instruction in Geometry. Journal on Mathematics Education, 17(1), 1–26. https://doi.org/10.22342/jme.v17i1.pp1-26

Rosyidi, A. H., Sari, Y. M., Fardah, D. K., & Masriyah, M. (2024). Designing mathematics problem-solving assessment with GeoGebra Classroom: Proving the instrument validity. Journal of Education and Learning (EduLearn), 18(3), 1038–1046. https://doi.org/10.11591/edulearn.v18i3.21191

Sakurai, J., & Goos, M. (2023). Revisiting tools in numeracy learning: The role of authentic digital tools. Frontiers in Education, 8. https://doi.org/10.3389/feduc.2023.1291407

Sudirman, S., Martadiputra, B. A. P., Faizah, S., Rodríguez-Nieto, C., Soeharto, S., Lavicza, Z., Isnawan, M. G., Sembiring, M. G., Runisah, R., & Suprihatin, R. J. (2026). Integrating steam-based MOOC as a supplement to didactical and pedagogical practices in school mathematics: A design-based research. Journal of Technology and Science Education, 16(1), 125–146. https://doi.org/10.3926/jotse.3633

Supianti, I. I., Yaniawati, P., Bonyah, E., Hasbiah, A. W., & Rozalini, N. (2025). STEAM approach in project-based learning to develop mathematical literacy and students' character. Infinity Journal, 14(2), 283–302. https://doi.org/10.22460/infinity.v14i2.p283-302

Szablewska, A. W., Czerwińska-Osipiak, A., Popowicz, H., Radzikowski, A., Rozmarynowska, W., Wójcicka, L. P., Stefanowicz-Bielska, A., Pietrzak, K., Krawczyk, A., Michalik, A., Gaworska-Krzemińska, A., Jakimczyk, B., García-Valdivieso, I., & José, F. (2026). Knowledge, Attitudes, and Practices in Pediatric Pain Management: Cross-Cultural Adaptation and Initial Psychometric Evaluation of the Polish HUPEDCARE-Q Among Healthcare Students and Professionals. Journal of Clinical Medicine, 15(10), 3678. https://doi.org/10.3390/jcm15103678

Tegegne, W. A., Bizuneh, S. M., & Negasi, R. D. (2025). Exploring the promises and classroom realities of constructivist learning at upper primary school in Ethiopia. Discover Education, 4(1), 513. https://doi.org/10.1007/s44217-025-00967-9

Torres-Peña, R. C., Peña-González, D., Lara-Orozco, J. L., Ariza, E. A., & Vergara, D. (2025). Enhancing Numerical Thinking Through Problem Solving: A Teaching Experience for Third-Grade Mathematics. Education Sciences, 15(6), 667. https://doi.org/10.3390/educsci15060667

Turner, E. E., Chen, M.-K., Roth McDuffie, A., Smith, J. E., Aguirre, J., Foote, M. Q., & Bennett, A. B. (2021). Validating a student assessment of mathematical modeling at elementary school level. School Science and Mathematics, 121(7), 408–421. https://doi.org/10.1111/ssm.12494

Wu, Y. (2025). Unlocking Mathematics Success: Global Lessons on Student Achievement, Teacher Satisfaction, and School Environments. International Electronic Journal of Mathematics Education, 20(2). https://eric.ed.gov/?id=EJ1469671. https://doi.org/10.29333/iejme/15900

Zhang, L., Liu, X., Cui, L., Yang, X., Hou, X., & Hou, L. (2026). Development and Initial Psychometric Evaluation of the Adolescent Oral and Maxillofacial Health Knowledge-Attitude-Practice and Self-Efficacy Questionnaire (AOMH-KAPQ). Healthcare, 14(16), 2615. https://doi.org/10.3390/healthcare14162615