Reinforcing equity and justice in learning: Using digital co-created rubrics and audio feedback as/for assessment
DOI:
https://doi.org/10.18357/otessaj.2024.4.3.71Keywords:
blended learning, rubric, feedback, educational technology, justice theory, bilingual learners, assessmentAbstract
The paper explores a study of a foreign learning experience during the pandemic that was unique due to the co-creative engagement with students. This study examines the effects of using technologically novel feedback strategies and assessment practices to analyze student performance within the frame of the justice theory. Using targeted blended means of assessment to provide leveled methods included auditory and co-created rubric conversations to support bilingual learners in a diverse environment. Qualitatively, using a questionnaire to collect student feedback on co-created decoding of rubrics with thematic analysis and quantitatively using a paired sample t-test by comparing scores for the first and final draft provided fulsome results. Findings indicate how these uses of technology can promote learner autonomy by allowing students to take agency of their own learning and increase students’ performance. The findings reflect the need for using technological avenues to assist bilingual learners in the development of their language skills through extended feedback.
Metrics
References
Abuosbeh, Z., Burchell, D., Krenca, K., & Chen, X. (2024). The impact of online learning during the pandemic on language and reading performance in English–French bilingual children. Journal of Research in Reading. https://doi.org/10.1111/1467-9817.12450 DOI: https://doi.org/10.1111/1467-9817.12450
AbuSa’aleek, A. O., & Shariq, M. (2021). Innovative Practices in Instructor E-feedback: A Case Study of E-feedback given in Three Linguistic Courses during the COVID 19 Pandemic. Arab World English Journal, 1, 183–198. https://doi.org/10.24093/awej/covid.14 DOI: https://doi.org/10.24093/awej/covid.14
Adams, J. S. (1963). Toward an understanding of inequity. Journal of Abnormal and Social Psychology, 67, 422–436. DOI: https://doi.org/10.1037/h0040968
Alomari, A. M. (2024). Perceptions of Faculty Members on Using Moodle as a Learning Management System in Distance Education. International Journal of Technology in Education and Science, 8(1), 75–110. https://doi.org/10.46328/ijtes.507 DOI: https://doi.org/10.46328/ijtes.507
Arter, J. A., & Chappuis, J. (2006). Creating & recognizing quality rubrics. Portland, OR: Educational Testing Service.
Ataizi, M., & Aksak Kömür, İ. (2021). Teaching writing skills in EFL classes with blending learning. Journal of Educational Technology and Online Learning, 4(4), 822–834. https://doi.org/10.31681/jetol.932682 DOI: https://doi.org/10.31681/jetol.932682
Banu, R., Shrivastava, P., & Salman, M. (2024). An empirical study of students’ perceptive on e-learning systems success. The International Journal of Information and Learning Technology, 41(2), 130–143. https://doi.org/10.1108/IJILT-03-2023-0040 DOI: https://doi.org/10.1108/IJILT-03-2023-0040
Bray, A., Devitt, A., Banks, J., Sanchez Fuentes, S., Sandoval, M., Riviou, K., Byrne, D., Flood, M., Reale, J., & Terrenzio, S. (2024). What next for Universal Design for Learning? A systematic literature review of technology in UDL implementations at second level. British Journal of Educational Technology, 55(1), 113–138. https://doi.org/10.1111/bjet.13328 DOI: https://doi.org/10.1111/bjet.13328
Canabarro, A. P. F., van der Westhuizen, A., Zanni, F., Abbadi, A., Shabnab, S., & Mölsted Alvesson, H. (2023). “We were like Zoom beings”: Insider perspectives on student learning during the initial shift to online classes in Sweden at the outbreak of the COVID-19 pandemic. Cogent Education, 10(1). https://doi.org/10.1080/2331186X.2022.2160116 DOI: https://doi.org/10.1080/2331186X.2022.2160116
Chambers, A. W., & Harkins Monaco, E. (2023). Increasing Student Engagement with Instructor Feedback using Criteria-Based Rubrics as a tool for Self-Assessment. Journal of the Scholarship of Teaching and Learning, 23(2). https://doi.org/10.14434/josotl.v23i2.33715 DOI: https://doi.org/10.14434/josotl.v23i2.33715
Charteris, J., & Thomas, E. (2017). Uncovering ‘unwelcome truths’ through student voice: teacher inquiry into agency and student assessment literacy. Teaching Education, 28(2), 162–177. https://doi.org/10.1080/10476210.2016.1229291 DOI: https://doi.org/10.1080/10476210.2016.1229291
Creswell, J. W., & Creswell, J. D. (2018). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches (5th ed.). SAGE Publications.
Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.) SAGE Publications.
Daniel, S., & Mazzurco, A. (2020). Development of a scenario-based instrument to assess co-design expertise in humanitarian engineering. European Journal of Engineering Education, 45(5), 654–674. https://doi.org/10.1080/03043797.2019.1704689 DOI: https://doi.org/10.1080/03043797.2019.1704689
Didion, L., Filderman, M. J., Roberts, G., Benz, S. A., & Olmstead, C. L. (2023). Using Audio Recordings to Reliably and Efficiently Observe Teacher Behavior Related to Explicit Instruction. Assessment for Effective Intervention, 48(4), 179–189. https://doi.org/10.1177/15345084221148202 DOI: https://doi.org/10.1177/15345084221148202
Dörnyei, Z. (2007). Research Methods in Applied Linguistics. Oxford University Press. https://doi.org/10.4000/asp.294 DOI: https://doi.org/10.4000/asp.294
Dron, J. (2022). Educational technology: What it is and how it works. AI & Society, 37(1), 155–166. https://doi.org/10.1007/s00146-021-01195-z DOI: https://doi.org/10.1007/s00146-021-01195-z
Ellision, C. (2023). Effects of Adaptive Comparative Judgement on Student Engagement with Peer Formative Feedback. PRHE Journal, 15(1), 24–35. https://mentimeter.com
Farley, I. A., & Burbules, N. C. (2022). Online education viewed through an equity lens: Promoting engagement and success for all learners. Review of Education, 10(3). https://doi.org/10.1002/rev3.3367 DOI: https://doi.org/10.1002/rev3.3367
Fowler, D. J., & Brown, K. (2017). Data-Driven Decisions: Using Equity Theory to Highlight Implications for Underserved Students. AASA Journal of Scholarship & Practice, 14(4).
Ghaffar, M. A., Khairallah, M., & Salloum, S. (2020). Co-constructed rubrics and assessment for learning: The impact on middle school students’ attitudes and writing skills. Assessing Writing, 45, 100468. https://doi.org/10.1016/j.asw.2020.100468 DOI: https://doi.org/10.1016/j.asw.2020.100468
Ghufron, M. A., & Nurdianingsih, F. (2019). Flipped Teaching with CALL in EFL Writing Class: How Does It Work and Affect Learner Autonomy? European Journal of Educational Research, volume-8-2019(volume8-issue4.html), 983–997. https://doi.org/10.12973/eu-jer.8.4.983 DOI: https://doi.org/10.12973/eu-jer.8.4.983
Gonulal, T., & Loewen, S. (2018). Scaffolding Technique. In The TESOL Encyclopedia of English Language Teaching (pp. 1–5). Wiley. https://doi.org/10.1002/9781118784235.eelt0180 DOI: https://doi.org/10.1002/9781118784235.eelt0180
Goldsmith, D. J., Nielsen, D., Rezendes, G., & Manly, C. A. (2006). Basic eSkills--Foundation or Frustration: A Research Study of Entering Community College Students’ Computer Competency. In Online Submission.
Granados, M. (2023). Improving Second Language Learning Through Performance-Improving Second Language Learning Through Performance-Based Assessment Practices Based Assessment Practices (772). Digital Commons @ NLU. https://digitalcommons.nl.edu/diss/772
Güneş, S. (2021). Learner Autonomy in an Asynchronous Distance Education Environment Implemented through Frequent Instructor-Involvement. The Turkish Online Journal of Educational Technology, 70–79.
Horn, M. S., Crouser, R. J., & Bers, M. U. (2012). Tangible interaction and learning: the case for a hybrid approach. Personal and Ubiquitous Computing, 16(4), 379–389. https://doi.org/10.1007/s00779-011-0404-2 DOI: https://doi.org/10.1007/s00779-011-0404-2
Huseman, R. C., Hatfield, J. D., & Miles, E. W. (1987). A New Perspective on Equity Theory: The Equity Sensitivity Construct. Academy of Management Review, 12(2), 222–234. DOI: https://doi.org/10.2307/258531
Ironsi, C. S. (2023). Efficacy of blended interactive educational resources in improving writing skills in a hybrid learning environment. Quality Assurance in Education, 31(1), 107–120. https://doi.org/10.1108/QAE-02-2022-0032 DOI: https://doi.org/10.1108/QAE-02-2022-0032
Kumas, A. (2022). Measurement-evaluation applications of context-based activities in hybrid learning environments [Special issue]. International Journal of Assessment Tools in Education, 9, 197-217. https://doi.org/10.21449/ijate.1111886 DOI: https://doi.org/10.21449/ijate.1111886
Lafferty, D. R. (2022). Middle School Teacher Methods for Cultivating Student Autonomy: A PLC Case Study During COVID-19. Rowan University.
Liu, Q., & Chao, C.-C. (2018). CALL from an ecological perspective: How a teacher perceives affordance and fosters learner agency in a technology-mediated language classroom. ReCALL, 30(1), 68–87. https://doi.org/10.1017/S0958344017000222 DOI: https://doi.org/10.1017/S0958344017000222
Liubashenko, O., & Kornieva, Z. (2019). Dialogic interactive speaking skills assessment in the experiential teaching of technical English to tertiary school students. Advanced Education, 6(13), 18–25. https://doi.org/10.20535/2410-8286.156228 DOI: https://doi.org/10.20535/2410-8286.156228
Ma, M., & Bui, G. (2021). Chinese secondary school teachers’ conceptions of l2 assessment: A mixed-methods study. Studies in Second Language Learning and Teaching, 11(3), 445–472. https://doi.org/10.14746/ssllt.2021.11.3.7 DOI: https://doi.org/10.14746/ssllt.2021.11.3.7
Martin, J. (2023). The need for quality course design in a post-pandemic world: a case study. International Journal of Teaching and Learning in Higher Education, 35(1), 115-122. https://files.eric.ed.gov/fulltext/EJ1411893.pdf
Moffitt, P., & Bligh, B. (2024). Online tasks and students’ transformative agency: double-stimulation as a design principle for synchronous online workshops. Journal of Vocational Education & Training, 76(1), 1–24. https://doi.org/10.1080/13636820.2021.1998792 DOI: https://doi.org/10.1080/13636820.2021.1998792
Morton, T., & Nashaat-Sobhy, N. (2024). Exploring Bases of Achievement in Content and Language Integrated Assessment in a Bilingual Education Program. TESOL Quarterly, 58(1), 5–31. https://doi.org/10.1002/tesq.3207 DOI: https://doi.org/10.1002/tesq.3207
Nerad, M. (2020). Governmental Innovation Policies, Globalisation, and Change in Doctoral Education Worldwide: Are Doctoral Programmes Converging? Trends and Tensions. In Structural and Institutional Transformations in Doctoral Education (pp. 43–84). Springer International Publishing. https://doi.org/10.1007/978-3-030-38046-5_3 DOI: https://doi.org/10.1007/978-3-030-38046-5_3
Pang, T. Y., Kootsookos, A., Fox, K., & Pirogova, E. (2022). Does an assessment rubric provide a better learning experience for undergraduates in developing transferable skills? Journal of University Teaching & Learning Practice, 19(3). https://ro.uow.edu.au/jutlp/vol19/iss3/03 DOI: https://doi.org/10.53761/1.19.3.03
Parkes, M., & Fletcher, P. (2017). A longitudinal, quantitative study of student attitudes towards audio feedback for assessment. Assessment and Evaluation in Higher Education, 42(7), 1046–1053. https://doi.org/10.1080/02602938.2016.1224810 DOI: https://doi.org/10.1080/02602938.2016.1224810
Pham, L. N. (2023). The interplay between learner autonomy and indirect written corrective feedback in EFL writing. TESOL Journal, 14(2). https://doi.org/10.1002/tesj.694 DOI: https://doi.org/10.1002/tesj.694
Poehner, M. E., & Yu, L. (2022). Dynamic Assessment of L2 Writing: Exploring the Potential of Rubrics as Mediation in Diagnosing Learner Emerging Abilities. TESOL Quarterly, 56(4), 1191–1217. https://doi.org/10.1002/tesq.3098 DOI: https://doi.org/10.1002/tesq.3098
Ponce, O. A., & Pagán-Maldonado, N. (2015). Mixed Methods Research in Education: Capturing the Complexity of the Profession. International Journal of Educational Excellence, 1(1), 111–135. https://doi.org/10.18562/IJEE.2015.0005 DOI: https://doi.org/10.18562/IJEE.2015.0005
Quinton, S., & Smallbone, T. (2010). Feeding forward: using feedback to promote student reflection and learning – a teaching model. Innovations in Education and Teaching International, 47(1), 125–135. https://doi.org/10.1080/14703290903525911 DOI: https://doi.org/10.1080/14703290903525911
Raes, A., Vanneste, P., Pieters, M., Windey, I., Van Den Noortgate, W., & Depaepe, F. (2020). Learning and instruction in the hybrid virtual classroom: An investigation of students’ engagement and the effect of quizzes. Computers & Education, 143, 103682. https://doi.org/10.1016/j.compedu.2019.103682 DOI: https://doi.org/10.1016/j.compedu.2019.103682
Rasooli, A., Zandi, H., & DeLuca, C. (2019). Conceptualising fairness in classroom assessment: exploring the value of organisational justice theory. Assessment in Education: Principles, Policy and Practice, 26(5), 584–611. https://doi.org/10.1080/0969594X.2019.1593105 DOI: https://doi.org/10.1080/0969594X.2019.1593105
Smith, P., Blooma, M. J., & Kurian, J. (2016, June 4). A Conceptual Framework to Assess the Effectiveness of Rubric Tool. ACIS 2015 Proceedings.
Shafique, S., & Hameed, A. (2022). Pandemic, Problems, and Possibilities: A Qualitative Study of EFL Teachers’ Perspectives in Higher Education Institutions (HEIs). MEXTESOL Journal, 47(3), 2023. DOI: https://doi.org/10.61871/mj.v47n3-17
Topping, K. J., Douglas, W., Robertson, D., & Ferguson, N. (2022). Effectiveness of online and blended learning from schools: A systematic review. Review of Education, 10(2). https://doi.org/10.1002/rev3.3353 DOI: https://doi.org/10.1002/rev3.3353
Valverde-Berrocoso, J., Acevedo-Borrega, J., & Cerezo-Pizarro, M. (2022). Educational Technology and Student Performance: A Systematic Review. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.916502 DOI: https://doi.org/10.3389/feduc.2022.916502
Wenmoth, D., Jones, M., & DiMartino, J. (2021). Agency by Design: Making Learning Engaging. In Aurora Institute. https://ezproxy.lib.ucalgary.ca/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=eric&AN=ED618072&site=ehost-live
Zhao, K., Zhou, J. & Zou, B. (2021). Developing subject knowledge co-construction and specific language use in a technology-enhanced CLIL programme: effectiveness and productive patterns. International Journal of Bilingual Education and Bilingualism. https://doi.org/10.1080/13670050.2021.1890688 DOI: https://doi.org/10.1080/13670050.2021.1890688
Zhao, H., & Zhao, B. (2023). Co-constructing the assessment criteria for EFL writing by instructors and students: A participative approach to constructively aligning the CEFR, curricula, teaching and learning. Language Teaching Research, 27(3), 765–793. https://doi.org/10.1177/1362168820948458 DOI: https://doi.org/10.1177/1362168820948458
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Nadia Delanoy, Shahneela Tasmin-Sharmi
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to the OTESSA Journal agree to release their articles under the Creative Commons Attribution 4.0 International (CC BY 4.0) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the OTESSA Journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in the OTESSA Journal.
