Competence-Adaptive Assessment Using IRT for Junior Photographer Qualification
DOI:
https://doi.org/10.58524/oler.v5i2.858Keywords:
Competency-based assessment, Item Response Theory, Project-Based Learning, photography learning course, adaptive testingAbstract
The rapid evolution of workforce demands necessitates competency-adaptive assessments that align education with industry standards. Traditional methods, often static and norm-referenced, fail to address the dynamic skills required in creative disciplines like photography. This study developed a Competence-Adaptive Assessment (CAA) integrating Item Response Theory (IRT) to enhance validity, and reliability in a photography course. A mixed-methods design was employed, involving 120 undergraduate photography students and six instructors in a 12-week quasi-experimental study. Quantitative results demonstrated significant learning gains (effect size d = 1.12), improved certification pass rates (24% increase), and enhanced technical competencies, particularly in lighting mastery. Qualitative findings revealed that adaptive feedback and personalized pathways increased engagement but also highlighted tensions between automated assessment and creative evaluation. The study contributes a scalable framework for competency-based education in creative fields, though it underscores the need to balance technical precision with artistic freedom. Implications include the potential for CAA to modernize vocational assessments while calling for further refinement to address creative subjectivityReferences
Awajan, N. W. (2023). The effect of implementing technology in formative assessments to ensure student learning in higher education English literature courses after COVID-19. Online Journal of Communication and Media Technologies, 13(2), e202320. https://doi.org/10.30935/ojcmt/13049
Biggs, J. B. (1999). Teaching for quality learning at university: What the student does. Society for Research into Higher Education & Open University Press.
Bok, H. G. J., Jonker, G., Hamstra, S. J., Boscardin, C. K., Ten Cate, O., & Hennus, M. P. (2024). Integrating key concepts in workplace-based assessment: Entrustable professional activities, programmatic assessment, and milestones. In O. Ten Cate, V. C. Burch, H. C. Chen, F. C. Chou, & M. P. Hennus (Eds.), Entrustable professional activities and entrustment decision-making in health professions education (pp. 65–73). Ubiquity Press. https://doi.org/10.5334/bdc.f
Brown, G. T. L. (2024). An integrated approach to improve the credibility and quality of assessment in higher education. In C. Evans & M. Waring (Eds.), Research handbook on innovations in assessment and feedback in higher education (pp. 372–388). Edward Elgar Publishing. https://doi.org/10.4337/9781800881600.00029
Brown, K., Schnars, M., Karan, A. T., Ucar, I., & Gershenson, J. (2023). The feasibility of introducing mobile technology in Kenyan schools that utilize the competency based curriculum. 2023 IEEE Global Humanitarian Technology Conference (GHTC), 108–114. https://doi.org/10.1109/GHTC56179.2023.10354692
Cheung, W. J., Bhanji, F., Gofton, W., Hall, A. K., Karpinski, J., Richardson, D., Frank, J. R., & Dudek, N. (2024). Design and implementation of a national program of assessment model – integrating entrustable professional activity assessments in Canadian specialist postgraduate medical education. Perspectives on Medical Education, 13(1), 44–55. https://doi.org/10.5334/pme.956
Creswell, J. W., & Creswell, J. D. (2023). Research design: Qualitative, quantitative, and mixed methods approaches (6th ed.). Sage Publications.
David, J. O. (2025). Redefining assessment for sustainability: A reflective approach to curriculum transformation in environmental education. Frontiers in Education, 10, 1553999. https://doi.org/10.3389/feduc.2025.1553999
Deliwe, A. P., & Zvapano, Z. (2024). A model for effective implementation of contemporary assessment methods in higher education institutions. International Conference on Education Research, 1(1), 42–51. https://doi.org/10.34190/icer.1.1.2874
Embretson, S. E., & Reise, S. P. (2013). Item response theory (0th ed.). Psychology Press. https://doi.org/10.4324/9781410605269
Evans, C., & Waring, M. (2024a). Exploring innovations in assessment and feedback in higher education. In C. Evans & M. Waring (Eds.), Research handbook on innovations in assessment and feedback in higher education (pp. 2–14). Edward Elgar Publishing. https://doi.org/10.4337/9781800881600.00007
Evans, C., & Waring, M. (2024b). Prioritising a self-regulatory assessment and feedback approach in higher education. In C. Evans & M. Waring (Eds.), Research handbook on innovations in assessment and feedback in higher education (pp. 479–515). Edward Elgar Publishing. https://doi.org/10.4337/9781800881600.00036
Forsyth, R., Cullen, R., & Stubbs, M. (2024). Implementing electronic management of assessment and feedback in higher education. In C. Evans & M. Waring (Eds.), Research handbook on innovations in assessment and feedback in higher education (pp. 389–405). Edward Elgar Publishing. https://doi.org/10.4337/9781800881600.00030
Galymova, N. G., Mukatayeva, Z. S., Zhussupbekova, N. S., Orazbayeva, M. A., & Aharodnik, V. E. (2024). Methodology for integrating socio-humanitarian safety into the training of future chemistry teachers. Journal of Turkish Science Education, 21(4), 749–774. https://doi.org/10.36681/tused.2024.041
Hundley, S. P., & Keith, C. J. (2023). Trends in assessment: Ideas, opportunities, and issues for higher education (2nd ed.). Routledge. https://doi.org/10.4324/9781003440604
Hussain, N. A. S., Matore, M. E. E. M., & Hamzah, M. I. M. (2025). Performance evaluation for educators in higher education from bibliometric analysis views. International Journal of Learning, Teaching and Educational Research, 24(5), 283–303. https://doi.org/10.26803/ijlter.24.5.15
Jin, Y., Yan, L., Echeverria, V., Gašević, D., & Martinez-Maldonado, R. (2025). Generative AI in higher education: A global perspective of institutional adoption policies and guidelines. Computers and Education: Artificial Intelligence, 8, 100348. https://doi.org/10.1016/j.caeai.2024.100348
Kiesler, N., Opel, S., & Thorbrügge, C. (2024). With great power comes great responsibility—integrating data ethics into computing education. Proceedings of the 2024 on Innovation and Technology in Computer Science Education, V. 1, 471–477. https://doi.org/10.1145/3649217.3653637
Kolen, M. J., Cumming, T., & Miller, M. D. (2023). Enhancing assessment in higher education: Putting psychometrics to work (1st ed.). Routledge. https://doi.org/10.4324/9781003444534
Masaiti, G., Kakupa, P., & Mupeta, S. (2023). Re-imagining assessment in higher education: Creating alternative pathways for inclusive and democratic assessments in Zambian higher education institutions. Scholarship of Teaching and Learning in the South, 7(3), 46–77. https://doi.org/10.36615/sotls.v7i3.384
Murugan, T., Periasamy, K., & Abirami, A. M. (Eds.). (2025). Adopting Artificial Intelligence Tools in Higher Education: Student Assessment (1st ed.). CRC Press. https://doi.org/10.1201/9781003470304
Ndeezi, M., Pedersen, G. A., Alipanga, B., Luberenga, I., Kohrt, B. A., & Kasujja, R. (2024). Integrating EQUIP competency-based training into a university curriculum: A qualitative inquiry with students and faculty at Makerere University in Uganda. Frontiers in Education, 8, 1290630. https://doi.org/10.3389/feduc.2023.1290630
Norman-Eck, R., Chandler, T., Boyd, B., DeCotes, C., Winters, N., Palmer, L., & Levitt, C. (2023). Meeting the AACN’s essentials for competency-based education with hands-free video-recorded skills assessment. Journal of Nursing Education, 62(12), 733–736. https://doi.org/10.3928/01484834-20231108-01
Nusri, A., Prima, A., Ardi, N. F., & Bangun, S. Y. (2025). FBSTS: Innovative assessment tool for futsal basic skills in higher education learning. International Journal of Human Movement and Sports Sciences, 13(2), 414–425. https://doi.org/10.13189/saj.2025.130219
Park, J., Kim, S., & Lee, H. (2022). Photography assessment using computer vision and IRT. Computers & Education: Artificial Intelligence, 3, 100053.
Shadan, M., Shalaby, R. H., Ziganshina, A., & Ahmed, S. (2025). Integrating portfolio and mentorship in competency-based medical education: A Middle East experience. BMC Medical Education, 25(1), 36. https://doi.org/10.1186/s12909-024-06553-1
Shavelson, R. (2023). Reflections on transfer of competence assessment to teaching and learning in higher education. Zeitschrift für Erziehungswissenschaft, 26(3), 585–599. https://doi.org/10.1007/s11618-023-01164-w
Thomas, J. W. (2000). A review of research on project-based learning (pp. 1–45). Autodesk Foundation. https://www.pblworks.org/sites/default/files/2019-01/A_Review_of_Research_on_Project_Based_Learning.pdf
Xiong, W., Zhu, Y., & Zhang, Y. (2023). Exploring the innovation of assessment in higher education amid the COVID-19 pandemic: A case study of postgraduate programs at Lingnan University, Hong Kong. In A. Y. C. Hou, J. Smith, K. H. Mok, & C.-Y. Guo (Eds.), Crafting the future of international higher education in Asia via systems change and innovation (pp. 215–230). Springer Nature Singapore. https://doi.org/10.1007/978-981-99-1874-4_12
Downloads
Published
Issue
Section
License
Online Learning in Educational Research is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with Online Learning in Educational Research agree to the following terms:
Copyright Retention: Authors retain the copyright of their work without any restrictions.
Publishing Rights: Authors retain the right to publish and distribute their work without any restrictions.
License Agreement: By publishing with Online Learning in Educational Research, authors agree that their work will be licensed under the Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA). This license allows others to share and adapt the work, provided that appropriate credit is given, any changes are indicated, and the new creations are licensed under the same terms.
