Introducing A Reflective Framework for the Assessment and Recognition of Microcredentials

Authors

DOI:

https://doi.org/10.18357/otessaj.2022.2.2.37

Keywords:

assessment, recognition, quality assurance, microcredentials, framework

Abstract

Assessment and recognition are key aspects of microcredentials, and other courses offered on massive open online course (MOOC) platforms. Microcredentials are designed to address the needs of employers and learners looking for units of study at a higher education level aligned with the requirements of labour markets. This paper reviews current methods for assessment and recognition used in MOOCs and microcredentials, proposing a framework with seven aspects and two checklists for use at planning and design stages. The framework is based on a review of 27 documents and a synthesis process. It provides a tool for microcredential producers to check whether the best ID verification, assessment, recognition, and quality assurance approaches are in place, enabling them to reflect on, and possibly improve, their choices.

References

AlQaidoom, H., & Shah, A. (2020). The Role of MOOC in Higher Education during Coronavirus Pandemic: A Systematic Review. International Journal of English and Education, 9(4).

Antonaci, A., Henderikx, P., & Ubachs, G. (2021). The Common Microcredentials Framework for MOOCs and Short Learning Programmes. Journal of Innovation in Polytechnic Education, 3(1), 5-9.

Barends, E., Rousseau, D.M., & Briner, R.B. (Eds.) (2017). CEBMa Guideline for rapid evidence assessments in management and organizations, Version 1.0. Amsterdam, NL: Center for Evidence Based Management. Retrieved from: https://cebma.org/wp-content/uploads/CEBMa-REA-Guideline.pdf

Baughan, P. (2021). Assessment and Feedback in a Post-Pandemic Era: A Time for Learning and Inclusion. Advance HE. Retrieved from: https://www.advance-he.ac.uk/news-and-views/assessment-and-feedback-post-pandemic-era-time-learning-and-inclusion

Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews. Review of general psychology, 1(3), 311-320. DOI: https://doi.org/10.1037/1089-2680.1.3.311

Bergmans, L., Bouali, N., Luttikhuis, M., & Rensink, A. (2021). On the Efficacy of Online Proctoring using Proctorio. In CSEDU (1) (pp. 279-290). DOI: https://doi.org/10.5220/0010399602790290

bin Mubayrik, H. F. (2020). New Trends in Formative-Summative Evaluations for Adult Education. SAGE Open 10 (3). https://doi.org/10.1177/2158244020941006 DOI: https://doi.org/10.1177/2158244020941006

Brasher, A., Whitelock, D., Holmes, W., Pozzi, F., Persico, D., Manganello, F., ... & Sangrà, A. (2022). Comparing the comparators: How should the quality of education offered by online universities be evaluated?. European Journal of Education, 57(2), 306-324. https://doi.org/10.1111/ejed.12497 DOI: https://doi.org/10.1111/ejed.12497

Bretag, T., Harper, R., Burton, M., Ellis, C., Newton, P., van Haeringen, K., & Rozenberg, P. (2019). Contract cheating and assessment design: exploring the relationship. Assessment & Evaluation in Higher Education, 44(5), 676-691. https://doi.org/10.1080/02602938.2018.1527892 DOI: https://doi.org/10.1080/02602938.2018.1527892

Dawson, P. (2020). Defending assessment security in a digital world: preventing e-cheating and supporting academic integrity in higher education. Routledge. DOI: https://doi.org/10.4324/9780429324178

Day, T., Chung, C. K. L., Doolittle, W. E., Housel, J., & McDaniel, P. N. (2022). Beyond COVID Chaos: What postsecondary educators learned from the online pivot. The Professional Geographer, 1-17.https://doi.org/10.1080/00330124.2022.2081225 DOI: https://doi.org/10.1080/00330124.2022.2081225

DESE (Department of Education, Skills and Employment). (2021). National Microcredentials Framework. Retrieved from: https://www.voced.edu.au/content/ngv:93222

Desmarchelier, R., & Cary, L. J. (2022). Toward just and equitable micro-credentials: an Australian perspective. International Journal of Educational Technology in Higher Education, 19(1), 1-12. https://doi.org/10.1186/s41239-022-00332-y DOI: https://doi.org/10.1186/s41239-022-00332-y

Dunn, C. (2021). Recognition of short learning programmes (SLPs) within the European Higher

Education Area. Policy Forum on Microcredentials and Short Learning Programmes. Retrieved from: https://www.slideshare.net/EADTU/recognition-of-short-learning-programmes-policy-forum-may-28-2021-by-clare-dunn

EADTU. (2019). EMC Common Microcredential Framework. Retrieved from: https://emc.eadtu.eu/images/EMC_Common_Microcredential_Framework_.pdf

Edwards, C., Holmes, W., Whitelock, D., & Okada, A. (2018). Student trust in e-authentication. In Proceedings of the Fifth Annual ACM Conference on Learning at Scale (pp. 1-4). DOI: https://doi.org/10.1145/3231644.3231700

European Commission. (2020). A European Approach to Micro-credentials – Output of the Micro-credentials Higher Education Consultation Group – Executive Summary. Retrieved from: https://education.ec.europa.eu/sites/default/files/document-library-docs/european-approach-micro-credentials-higher-education-consultation-group-output-executive-summary.pdf

Farrow, R. (2020). The role of MOOCs in promoting social inclusion through employability: a rapid assessment of evidence. Italian Journal of Educational Technology, 28(3), 189-209.

Farrow, R., Ferguson, R., Weller, M., Pitt, R., Sanzgiri, J., & Habib, M. (2021). Assessment and Recognition of MOOCs: The State of the Art. Journal of Innovation in Polytechnic Education, 3(1), 15-26.

Gamage, D., Staubitz, T., & Whiting, M. (2021). Peer assessment in MOOCs: Systematic literature review. Distance Education, 1-22. https://doi.org/10.1080/01587919.2021.1911626 DOI: https://doi.org/10.1080/01587919.2021.1911626

Habib, M. & Sanzgiri, J. (2020). Compendium on good practices in assessment and recognition of MOOCs for the EU labour market. EMC-LM Project. EMC-LM Project. CC-BY 4.0. Retrieved from: https://emc.eadtu.eu/images/publications_and_outputs/EMC-LM_Compendium_on_good_practices_final.pdf

Hanafy, A. (2020). Features and affordances of Micro-Credential Platforms in Higher Education. Master of Science Thesis Faculty of Management and Business. Tampere University. https://trepo.tuni.fi/bitstream/handle/10024/124188/HanafyAhmed.pdf?sequence=2

Healy, M. (2021). Microcredential learners need quality careers and employability support. Journal of Teaching and Learning for Graduate Employability, 12(1), 21-23. DOI: https://doi.org/10.21153/jtlge2021vol12no1art1071

Hussein, M. J., Yusuf, J., Deb, A. S., Fong, L., & Naidu, S. (2020). An evaluation of online proctoring tools. Open Praxis, 12(4), 509-525. DOI: https://doi.org/10.5944/openpraxis.12.4.1113

Iniesto, F. (2021) Models and Guidelines for Assessment and Recognition of MOOCs and microcredentials. EMC-LM Project. CC-BY 4.0

Iniesto, F., McAndrew, P., Minocha, S., & Coughlan, T. (2019). Auditing the accessibility of MOOCs: a four-component approach. In European Conference on Technology Enhanced Learning (pp. 650-654). Springer, Cham. DOI: https://doi.org/10.1007/978-3-030-29736-7_59

Iniesto, F., McAndrew, P., Minocha, S., & Coughlan, T. (2022). A qualitative study to understand the perspectives of MOOC providers on accessibility. Australasian Journal of Educational Technology, 38(1), 87-101. DOI: https://doi.org/10.14742/ajet.6610

Jansen, D., Rosewell, J., & Kear, K. (2017). Quality frameworks for MOOCs. In Open education: from OERs to MOOCs (pp. 261-281). Springer, Berlin, Heidelberg. DOI: https://doi.org/10.1007/978-3-662-52925-6_14

Kharbat, F. F., & Daabes, A. S. A. (2021). E-proctored exams during the COVID-19 pandemic: A close understanding. Education and Information Technologies, 1-17. https://doi.org/10.1007/s10639-021-10458-7 DOI: https://doi.org/10.1007/s10639-021-10458-7

Lancaster, T., & Cotarlan, C. (2021). Contract cheating by STEM students through a file sharing website: a Covid-19 pandemic perspective. International Journal for Educational Integrity, 17(1), 1-16. https://doi.org/10.1007/s40979-021-00070-0 DOI: https://doi.org/10.1007/s40979-021-00070-0

Lantero, L., Finocchietti, C., & Petrucci, E. (2021). Micro-credentials and Bologna Key Commitments: State of Play in the European Higher Education Area. Retrieved from: https://microcredentials.eu/wp-content/uploads/sites/20/2021/02/Microbol_State-of-play-of-MCs-in-the-EHEA.pdf

McGreal, R., & Olcott, D. (2022). A strategic reset: micro-credentials for higher education leaders. Smart Learning Environments, 9(1), 1-23. https://doi.org/10.1186/s40561-022-00190-1 DOI: https://doi.org/10.1186/s40561-022-00190-1

Mayer, R. E. (2019). Thirty years of research on online learning. Applied Cognitive Psychology, 33(2), 152-159. https://doi.org/10.1002/acp.3482 DOI: https://doi.org/10.1002/acp.3482

Mee, C. K., Salam, S., & Sui, L. K. M. (2018). Undergraduate’s perception on Massive Open Online Course (MOOC) Learning to foster employability skills and enhance learning experience. International Journal of Advanced Computer Science and Applications, 9(10). DOI: https://doi.org/10.14569/IJACSA.2018.091060

Melai, T., van der Westen, S., Winkels J., Antonaci, A., Henderikx, P., & Ubachs, G. (2020). Concept and role of Short Learning Programmes in European higher education. (Research Report No. 02.1). Retrieved from: https://e-slp.eadtu.eu/images/Concept_and_role_of_SLPs.pdf

Mellati, M., & Khademi, M. (2018). Exploring teachers’ assessment literacy: Impact on learners’ writing achievements and implications for teacher development. Australian Journal of Teacher Education, 43(6), 1. DOI: https://doi.org/10.14221/ajte.2018v43n6.1

Milian, R. P. (2021). Back to Basics: Facilitating the Recognition of Micro-Credentials in Ontario PSE. Journal of Innovation in Polytechnic Education, 3(1), 37-46.

Monsen, S., Cook, S., & Hannant, L. (2017). Students as partners in negotiated assessment in a teacher education course. Teaching and Learning Together in Higher Education, 1(21), 2.

Morris, E. J. (2018). Academic integrity matters: five considerations for addressing contract cheating. International journal for educational integrity, 14(1), 1-12. https://doi.org/10.1007/s40979-018-0038-5 DOI: https://doi.org/10.1007/s40979-018-0038-5

Mulder, F., & Jansen, D. (2015). MOOCs for opening up education and the OpenupEd initiative. In MOOCs and Open Education around the world (pp. 130-142). Routledge. DOI: https://doi.org/10.4324/9781315751108-16

Nguyen, Q., Rienties, B., Toetenel, L., Ferguson, R., & Whitelock, D. (2017). Examining the designs of computer-based assessment and its impact on student engagement, satisfaction, and pass rates. Computers in Human Behavior, 76, 703-714. DOI: https://doi.org/10.1016/j.chb.2017.03.028

Okada, A., Whitelock, D., Holmes, W., & Edwards, C. (2019). e‐Authentication for online assessment: A mixed‐method study. British Journal of Educational Technology, 50(2), 861-875. DOI: https://doi.org/10.1111/bjet.12608

Oliver, B. (2019). Making micro-credentials work for learners, employers and providers. Deakin University. Retrieved from: http://hdl.voced.edu.au/10707/515939

Oliver, B. (2021). Micro-credentials: A learner value framework: Provocation. Journal of Teaching and Learning for Graduate Employability, 12(1), 48-51. https://doi.org/10.21153/jtlge2021vol12no1art1456 DOI: https://doi.org/10.21153/jtlge2021vol12no1art1456

Pickard, L. (2018). Analysis of 450 MOOC-based microcredentials reveals many options but little consistency. Retrieved from https://www.classcentral.com/report/moocs-microcredentials-analysis-2018/

Pitt, R. (2018). Evaluating the BizMOOC project Learning to Learn MOOC: The OpenupEd Quality Framework in Action. In International Entrepreneurship as the Bridge between International Economics and International Business: Conference Proceedings of the 9th ENTRE Conference–5th AIB-CEE Chapter Annual Conference. Kraków: Cracow University of Economics.

Pollard, V., & Vincent, A. (2022). Micro-credentials: A Postdigital Counternarrative. Postdigital Science and Education, 1-17. https://doi.org/10.1007/s42438-022-00311-6 DOI: https://doi.org/10.1007/s42438-022-00311-6

Read, T., Bárcena, E., Bick, M., Camilleri, A. F., Creelman, A., Henderikx, P., ... & Center, K. I. (2018). The MOONLITE Policy Report on MOOCS for Social Inclusion: Maximising the potential and minimising the risks for designing and utilizing MOOCs for refugees. Retrieved from https://moonliteproject.eu/wp-content/uploads/sites/30/2020/06/MOONLITE-O6_Report.pdf

Sambell, K., Brown, S., & Race, P. (2019). Assessment as a locus for engagement: priorities and practicalities. Italian Journal of Educational Research, 45-62. https://doi.org/10.7346/SIRD-1S2019-P45

Shah, D. (2020). 18M Learners, 70K Reviews: Class Central’s 2020 Year in Review. Class Central. Retrieved from https://www.classcentral.com/report/class-central-2020-review/

Shah, D. (2021). A Decade of MOOCs: A Review of Stats and Trends for Large-Scale Online Courses in 2021. EdSurge. Retrieved from: https://www.edsurge.com/news/2021-12-28-a-decade-of-moocs-a-review-of-stats-and-trends-for-large-scale-online-courses-in-2021

Wheelahan, L., & Moodie, G. (2021). Analysing micro-credentials in higher education: a Bernsteinian analysis. Journal of Curriculum Studies, 53(2), 212-228. https://doi.org/10.1080/00220272.2021.1887358 DOI: https://doi.org/10.1080/00220272.2021.1887358

Von Gruenigen, D., e Souza, F. B. D. A., Pradarelli, B., Magid, A., & Cieliebak, M. (2018). Best practices in e-assessments with a special focus on cheating prevention. In 2018 IEEE Global Engineering Education Conference (EDUCON) (pp. 893-899). IEEE. DOI: https://doi.org/10.1109/EDUCON.2018.8363325

Xiong, Y., & Suen, H. K. (2018). Assessment approaches in massive open online courses: Possibilities, challenges and future directions. International Review of Education, 64(2), 241-263. https://doi.org/10.1007/s11159-018-9710-5 DOI: https://doi.org/10.1007/s11159-018-9710-5

Zlatović, M., Balaban, I., & Kermek, D. (2015). Using online assessments to stimulate learning strategies and achievement of learning goals. Computers & education, 91, 32-45. DOI: https://doi.org/10.1016/j.compedu.2015.09.012

Downloads

Published

2022-12-31

How to Cite

Iniesto, F., Ferguson, R., Weller, M., Farrow, R., & Pitt, R. (2022). Introducing A Reflective Framework for the Assessment and Recognition of Microcredentials. The Open/Technology in Education, Society, and Scholarship Association Journal, 2(2), 1–24. https://doi.org/10.18357/otessaj.2022.2.2.37

Issue

Section

Research Articles