Introducing A Reflective Framework for the Assessment and Recognition of Microcredentials
DOI:
https://doi.org/10.18357/otessaj.2022.2.2.37Keywords:
assessment, recognition, quality assurance, microcredentials, frameworkAbstract
Assessment and recognition are key aspects of microcredentials, and other courses offered on massive open online course (MOOC) platforms. Microcredentials are designed to address the needs of employers and learners looking for units of study at a higher education level aligned with the requirements of labour markets. This paper reviews current methods for assessment and recognition used in MOOCs and microcredentials, proposing a framework with seven aspects and two checklists for use at planning and design stages. The framework is based on a review of 27 documents and a synthesis process. It provides a tool for microcredential producers to check whether the best ID verification, assessment, recognition, and quality assurance approaches are in place, enabling them to reflect on, and possibly improve, their choices.
References
AlQaidoom, H., & Shah, A. (2020). The Role of MOOC in Higher Education during Coronavirus Pandemic: A Systematic Review. International Journal of English and Education, 9(4).
Antonaci, A., Henderikx, P., & Ubachs, G. (2021). The Common Microcredentials Framework for MOOCs and Short Learning Programmes. Journal of Innovation in Polytechnic Education, 3(1), 5-9.
Barends, E., Rousseau, D.M., & Briner, R.B. (Eds.) (2017). CEBMa Guideline for rapid evidence assessments in management and organizations, Version 1.0. Amsterdam, NL: Center for Evidence Based Management. Retrieved from: https://cebma.org/wp-content/uploads/CEBMa-REA-Guideline.pdf
Baughan, P. (2021). Assessment and Feedback in a Post-Pandemic Era: A Time for Learning and Inclusion. Advance HE. Retrieved from: https://www.advance-he.ac.uk/news-and-views/assessment-and-feedback-post-pandemic-era-time-learning-and-inclusion
Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews. Review of general psychology, 1(3), 311-320. DOI: https://doi.org/10.1037/1089-2680.1.3.311
Bergmans, L., Bouali, N., Luttikhuis, M., & Rensink, A. (2021). On the Efficacy of Online Proctoring using Proctorio. In CSEDU (1) (pp. 279-290). DOI: https://doi.org/10.5220/0010399602790290
bin Mubayrik, H. F. (2020). New Trends in Formative-Summative Evaluations for Adult Education. SAGE Open 10 (3). https://doi.org/10.1177/2158244020941006 DOI: https://doi.org/10.1177/2158244020941006
Brasher, A., Whitelock, D., Holmes, W., Pozzi, F., Persico, D., Manganello, F., ... & Sangrà, A. (2022). Comparing the comparators: How should the quality of education offered by online universities be evaluated?. European Journal of Education, 57(2), 306-324. https://doi.org/10.1111/ejed.12497 DOI: https://doi.org/10.1111/ejed.12497
Bretag, T., Harper, R., Burton, M., Ellis, C., Newton, P., van Haeringen, K., & Rozenberg, P. (2019). Contract cheating and assessment design: exploring the relationship. Assessment & Evaluation in Higher Education, 44(5), 676-691. https://doi.org/10.1080/02602938.2018.1527892 DOI: https://doi.org/10.1080/02602938.2018.1527892
Dawson, P. (2020). Defending assessment security in a digital world: preventing e-cheating and supporting academic integrity in higher education. Routledge. DOI: https://doi.org/10.4324/9780429324178
Day, T., Chung, C. K. L., Doolittle, W. E., Housel, J., & McDaniel, P. N. (2022). Beyond COVID Chaos: What postsecondary educators learned from the online pivot. The Professional Geographer, 1-17.https://doi.org/10.1080/00330124.2022.2081225 DOI: https://doi.org/10.1080/00330124.2022.2081225
DESE (Department of Education, Skills and Employment). (2021). National Microcredentials Framework. Retrieved from: https://www.voced.edu.au/content/ngv:93222
Desmarchelier, R., & Cary, L. J. (2022). Toward just and equitable micro-credentials: an Australian perspective. International Journal of Educational Technology in Higher Education, 19(1), 1-12. https://doi.org/10.1186/s41239-022-00332-y DOI: https://doi.org/10.1186/s41239-022-00332-y
Dunn, C. (2021). Recognition of short learning programmes (SLPs) within the European Higher
Education Area. Policy Forum on Microcredentials and Short Learning Programmes. Retrieved from: https://www.slideshare.net/EADTU/recognition-of-short-learning-programmes-policy-forum-may-28-2021-by-clare-dunn
EADTU. (2019). EMC Common Microcredential Framework. Retrieved from: https://emc.eadtu.eu/images/EMC_Common_Microcredential_Framework_.pdf
Edwards, C., Holmes, W., Whitelock, D., & Okada, A. (2018). Student trust in e-authentication. In Proceedings of the Fifth Annual ACM Conference on Learning at Scale (pp. 1-4). DOI: https://doi.org/10.1145/3231644.3231700
European Commission. (2020). A European Approach to Micro-credentials – Output of the Micro-credentials Higher Education Consultation Group – Executive Summary. Retrieved from: https://education.ec.europa.eu/sites/default/files/document-library-docs/european-approach-micro-credentials-higher-education-consultation-group-output-executive-summary.pdf
Farrow, R. (2020). The role of MOOCs in promoting social inclusion through employability: a rapid assessment of evidence. Italian Journal of Educational Technology, 28(3), 189-209.
Farrow, R., Ferguson, R., Weller, M., Pitt, R., Sanzgiri, J., & Habib, M. (2021). Assessment and Recognition of MOOCs: The State of the Art. Journal of Innovation in Polytechnic Education, 3(1), 15-26.
Gamage, D., Staubitz, T., & Whiting, M. (2021). Peer assessment in MOOCs: Systematic literature review. Distance Education, 1-22. https://doi.org/10.1080/01587919.2021.1911626 DOI: https://doi.org/10.1080/01587919.2021.1911626
Habib, M. & Sanzgiri, J. (2020). Compendium on good practices in assessment and recognition of MOOCs for the EU labour market. EMC-LM Project. EMC-LM Project. CC-BY 4.0. Retrieved from: https://emc.eadtu.eu/images/publications_and_outputs/EMC-LM_Compendium_on_good_practices_final.pdf
Hanafy, A. (2020). Features and affordances of Micro-Credential Platforms in Higher Education. Master of Science Thesis Faculty of Management and Business. Tampere University. https://trepo.tuni.fi/bitstream/handle/10024/124188/HanafyAhmed.pdf?sequence=2
Healy, M. (2021). Microcredential learners need quality careers and employability support. Journal of Teaching and Learning for Graduate Employability, 12(1), 21-23. DOI: https://doi.org/10.21153/jtlge2021vol12no1art1071
Hussein, M. J., Yusuf, J., Deb, A. S., Fong, L., & Naidu, S. (2020). An evaluation of online proctoring tools. Open Praxis, 12(4), 509-525. DOI: https://doi.org/10.5944/openpraxis.12.4.1113
Iniesto, F. (2021) Models and Guidelines for Assessment and Recognition of MOOCs and microcredentials. EMC-LM Project. CC-BY 4.0
Iniesto, F., McAndrew, P., Minocha, S., & Coughlan, T. (2019). Auditing the accessibility of MOOCs: a four-component approach. In European Conference on Technology Enhanced Learning (pp. 650-654). Springer, Cham. DOI: https://doi.org/10.1007/978-3-030-29736-7_59
Iniesto, F., McAndrew, P., Minocha, S., & Coughlan, T. (2022). A qualitative study to understand the perspectives of MOOC providers on accessibility. Australasian Journal of Educational Technology, 38(1), 87-101. DOI: https://doi.org/10.14742/ajet.6610
Jansen, D., Rosewell, J., & Kear, K. (2017). Quality frameworks for MOOCs. In Open education: from OERs to MOOCs (pp. 261-281). Springer, Berlin, Heidelberg. DOI: https://doi.org/10.1007/978-3-662-52925-6_14
Kharbat, F. F., & Daabes, A. S. A. (2021). E-proctored exams during the COVID-19 pandemic: A close understanding. Education and Information Technologies, 1-17. https://doi.org/10.1007/s10639-021-10458-7 DOI: https://doi.org/10.1007/s10639-021-10458-7
Lancaster, T., & Cotarlan, C. (2021). Contract cheating by STEM students through a file sharing website: a Covid-19 pandemic perspective. International Journal for Educational Integrity, 17(1), 1-16. https://doi.org/10.1007/s40979-021-00070-0 DOI: https://doi.org/10.1007/s40979-021-00070-0
Lantero, L., Finocchietti, C., & Petrucci, E. (2021). Micro-credentials and Bologna Key Commitments: State of Play in the European Higher Education Area. Retrieved from: https://microcredentials.eu/wp-content/uploads/sites/20/2021/02/Microbol_State-of-play-of-MCs-in-the-EHEA.pdf
McGreal, R., & Olcott, D. (2022). A strategic reset: micro-credentials for higher education leaders. Smart Learning Environments, 9(1), 1-23. https://doi.org/10.1186/s40561-022-00190-1 DOI: https://doi.org/10.1186/s40561-022-00190-1
Mayer, R. E. (2019). Thirty years of research on online learning. Applied Cognitive Psychology, 33(2), 152-159. https://doi.org/10.1002/acp.3482 DOI: https://doi.org/10.1002/acp.3482
Mee, C. K., Salam, S., & Sui, L. K. M. (2018). Undergraduate’s perception on Massive Open Online Course (MOOC) Learning to foster employability skills and enhance learning experience. International Journal of Advanced Computer Science and Applications, 9(10). DOI: https://doi.org/10.14569/IJACSA.2018.091060
Melai, T., van der Westen, S., Winkels J., Antonaci, A., Henderikx, P., & Ubachs, G. (2020). Concept and role of Short Learning Programmes in European higher education. (Research Report No. 02.1). Retrieved from: https://e-slp.eadtu.eu/images/Concept_and_role_of_SLPs.pdf
Mellati, M., & Khademi, M. (2018). Exploring teachers’ assessment literacy: Impact on learners’ writing achievements and implications for teacher development. Australian Journal of Teacher Education, 43(6), 1. DOI: https://doi.org/10.14221/ajte.2018v43n6.1
Milian, R. P. (2021). Back to Basics: Facilitating the Recognition of Micro-Credentials in Ontario PSE. Journal of Innovation in Polytechnic Education, 3(1), 37-46.
Monsen, S., Cook, S., & Hannant, L. (2017). Students as partners in negotiated assessment in a teacher education course. Teaching and Learning Together in Higher Education, 1(21), 2.
Morris, E. J. (2018). Academic integrity matters: five considerations for addressing contract cheating. International journal for educational integrity, 14(1), 1-12. https://doi.org/10.1007/s40979-018-0038-5 DOI: https://doi.org/10.1007/s40979-018-0038-5
Mulder, F., & Jansen, D. (2015). MOOCs for opening up education and the OpenupEd initiative. In MOOCs and Open Education around the world (pp. 130-142). Routledge. DOI: https://doi.org/10.4324/9781315751108-16
Nguyen, Q., Rienties, B., Toetenel, L., Ferguson, R., & Whitelock, D. (2017). Examining the designs of computer-based assessment and its impact on student engagement, satisfaction, and pass rates. Computers in Human Behavior, 76, 703-714. DOI: https://doi.org/10.1016/j.chb.2017.03.028
Okada, A., Whitelock, D., Holmes, W., & Edwards, C. (2019). e‐Authentication for online assessment: A mixed‐method study. British Journal of Educational Technology, 50(2), 861-875. DOI: https://doi.org/10.1111/bjet.12608
Oliver, B. (2019). Making micro-credentials work for learners, employers and providers. Deakin University. Retrieved from: http://hdl.voced.edu.au/10707/515939
Oliver, B. (2021). Micro-credentials: A learner value framework: Provocation. Journal of Teaching and Learning for Graduate Employability, 12(1), 48-51. https://doi.org/10.21153/jtlge2021vol12no1art1456 DOI: https://doi.org/10.21153/jtlge2021vol12no1art1456
Pickard, L. (2018). Analysis of 450 MOOC-based microcredentials reveals many options but little consistency. Retrieved from https://www.classcentral.com/report/moocs-microcredentials-analysis-2018/
Pitt, R. (2018). Evaluating the BizMOOC project Learning to Learn MOOC: The OpenupEd Quality Framework in Action. In International Entrepreneurship as the Bridge between International Economics and International Business: Conference Proceedings of the 9th ENTRE Conference–5th AIB-CEE Chapter Annual Conference. Kraków: Cracow University of Economics.
Pollard, V., & Vincent, A. (2022). Micro-credentials: A Postdigital Counternarrative. Postdigital Science and Education, 1-17. https://doi.org/10.1007/s42438-022-00311-6 DOI: https://doi.org/10.1007/s42438-022-00311-6
Read, T., Bárcena, E., Bick, M., Camilleri, A. F., Creelman, A., Henderikx, P., ... & Center, K. I. (2018). The MOONLITE Policy Report on MOOCS for Social Inclusion: Maximising the potential and minimising the risks for designing and utilizing MOOCs for refugees. Retrieved from https://moonliteproject.eu/wp-content/uploads/sites/30/2020/06/MOONLITE-O6_Report.pdf
Sambell, K., Brown, S., & Race, P. (2019). Assessment as a locus for engagement: priorities and practicalities. Italian Journal of Educational Research, 45-62. https://doi.org/10.7346/SIRD-1S2019-P45
Shah, D. (2020). 18M Learners, 70K Reviews: Class Central’s 2020 Year in Review. Class Central. Retrieved from https://www.classcentral.com/report/class-central-2020-review/
Shah, D. (2021). A Decade of MOOCs: A Review of Stats and Trends for Large-Scale Online Courses in 2021. EdSurge. Retrieved from: https://www.edsurge.com/news/2021-12-28-a-decade-of-moocs-a-review-of-stats-and-trends-for-large-scale-online-courses-in-2021
Wheelahan, L., & Moodie, G. (2021). Analysing micro-credentials in higher education: a Bernsteinian analysis. Journal of Curriculum Studies, 53(2), 212-228. https://doi.org/10.1080/00220272.2021.1887358 DOI: https://doi.org/10.1080/00220272.2021.1887358
Von Gruenigen, D., e Souza, F. B. D. A., Pradarelli, B., Magid, A., & Cieliebak, M. (2018). Best practices in e-assessments with a special focus on cheating prevention. In 2018 IEEE Global Engineering Education Conference (EDUCON) (pp. 893-899). IEEE. DOI: https://doi.org/10.1109/EDUCON.2018.8363325
Xiong, Y., & Suen, H. K. (2018). Assessment approaches in massive open online courses: Possibilities, challenges and future directions. International Review of Education, 64(2), 241-263. https://doi.org/10.1007/s11159-018-9710-5 DOI: https://doi.org/10.1007/s11159-018-9710-5
Zlatović, M., Balaban, I., & Kermek, D. (2015). Using online assessments to stimulate learning strategies and achievement of learning goals. Computers & education, 91, 32-45. DOI: https://doi.org/10.1016/j.compedu.2015.09.012
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Francisco Iniesto, Rebecca Ferguson, Martin Weller, Rob Farrow, Rebecca Pitt
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to the OTESSA Journal agree to release their articles under the Creative Commons Attribution 4.0 International (CC BY 4.0) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the OTESSA Journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in the OTESSA Journal.
