The Design and Evaluation of Online Faculty Development for Effective Graduate Supervision

Authors

DOI:

https://doi.org/10.18357/otessaj.2021.1.1.3

Keywords:

Massive Open Online Course, Graduate Supervision, Faculty Development, Online Learning, Media Development, Microcredentials

Abstract

This design-based research aims to improve the quality of graduate supervision using a Massive Open Online Course (MOOC). The Quality Graduate Supervision MOOC brings interdisciplinary faculty, postdoctoral scholars, and expert supervisors together in an online learning community to discuss and consider effective supervision practice, strategies for relationship building, supports for academic writing, mentoring for diverse careers, and how to combine excellence and wellness. The survey, interview, and system data were analyzed to inform and assess the design and development of the QGS MOOC, to gain insights into learner experience and engagement, and to assess the impact of the online learning community on graduate supervision practices. Through ongoing design and evaluation of this online learning course for graduate supervisors, the research team found the learning community influenced faculty members’ awareness, collective knowledge building, goal setting, and actions for graduate supervision practice. We present results from our evaluation of the design components in the QGS MOOC, the learning benefits for supervisors, impacts on graduate supervision practice, and make several recommendations for research and practice.

References

Adkins, B. (2009). PhD pedagogy and the changing knowledge landscapes of universities. Higher Education Research & Development, 28(2), 165–177. https://doi.org/10.1080/07294360902725041 DOI: https://doi.org/10.1080/07294360902725041

Alharbi, H. (2018). Using design-based research to design a miniMOOC for faculty development on quality graduate supervision [Unpublished doctoral dissertation]. University of Calgary, Calgary, AB. https://doi.org/10.11575/PRISM/32957

Alharbi, H., & Jacobsen, M. (2018). Evaluating the design and development of the quality graduate supervision miniMOOC. Quarterly Review of Distance Education, 19(1), 13–26. https://eric.ed.gov/?id=EJ1190068

Alharbi, H., & Jacobsen, M. (2019, April 5–9). The design and evaluation of a miniMOOC for quality graduate supervision in higher education [Conference presentation]. American Educational Research Association (AERA), Toronto, ON, Canada.

Ali, F., Shet, A., Yan, WR., Al-Maniri, A., Atkins, S., & Lucas, H. (2017). Doctoral level research and training capacity in the social determinants of health at universities and higher education institutions in India, China, Oman and Vietnam: A survey of needs. Health Research Policy and Systems, 15(1), 1–11. https://doi.org/10.1186/s12961-017-0225-5 DOI: https://doi.org/10.1186/s12961-017-0225-5

Bates, A. W. (2019). Teaching in a digital age, 2nd edition. OpenTextBC. https://opentextbc.ca/teachinginadigitalage/

Beaudin, A., Emami, E., Palumbo, M., & Tran, S. D. (2015). Quality of supervision: Postgraduate dental research trainees’ perspectives. European Journal of Dental Education, 20, 32–38. https://doi.org/10.1111/eje.12137 DOI: https://doi.org/10.1111/eje.12137

Berdahl, L., & Malloy, J. (2018). Work your career: Get what you want from your social science or humanities PhD. University of Toronto Press.

Berdahl, L., Malloy, J., Cowley, S., & Sá, C. (2019). Departmental engagement in doctoral professional development: Lessons from political science. Canadian Journal of Higher Education, 49(2), 37–53. https://doi.org/10.47678/cjhe.v49i2.188226 DOI: https://doi.org/10.47678/cjhe.v49i2.188226

Bloom, J. L., Cuevas, A. E. P., Hall, J. W., & Evans, C. V. (2007). Graduate students' perceptions of outstanding graduate advisor characteristics. NACADA Journal, 27(2), 28–35. https://eric.ed.gov/?id=EJ802468 DOI: https://doi.org/10.12930/0271-9517-27.2.28

Canadian Association for Graduate Studies (CAGS). (2018a). Investing in the next generation of researchers. https://cags.ca/cags-publications/

Canadian Association for Graduate Studies (CAGS). (2018b). Report of the task force on the dissertation. https://cags.ca/cags-publications/

Ciampa, K., & Wolfe, Z. (2019). Preparing for dissertation writing: Doctoral education students’ perceptions. Studies in Graduate and Postdoctoral Education, 10(2), 86–108. https://doi.org/10.1108/SGPE-03-2019-0039 DOI: https://doi.org/10.1108/SGPE-03-2019-0039

Cohan, D. J. (2019). Self-care for the new year. Inside Higher Ed. https://www.insidehighered.com/advice/2019/01/17/professor-gives-advice-colleagues-starting-new-year-self-care-opinion

Dombroski, K., Watkins, A., Fitt, H., Frater, J., Banwell, K., Mackenzie, K., Mutambo, L., Hawke, K., Persendt, F., Turković, J., Ko, S. Y., & Hart, D. (2018). Journeying from "I" to "we": Assembling hybrid caring collectives of geography doctoral scholars. Journal of Geography in Higher Education, 42(1), 80–93. https://doi.org/10.1080/03098265.2017.1335295 DOI: https://doi.org/10.1080/03098265.2017.1335295

Downes, S. (2014, March 10). The MOOC of One. [Keynote]. International Academy of Technology, Education and Development (IATED), Valencia, Spain.

Eley, A., & Jennings, R. (2005). Effective postgraduate supervision: Improving the student/supervisor relationship. Open University Press, UK.

Erichsen, E. A., Bolliger, D. U., & Halupa, C. (2014). Student satisfaction with graduate supervision in doctoral programs primarily delivered in distance education settings. Studies in Higher Education, 39(2), 321–338. https://eric.ed.gov/?id=EJ1027373 DOI: https://doi.org/10.1080/03075079.2012.709496

Evans, T. M., Bira, L., Gastelum, J. B., Weiss, L. T., & Vanderford, N. L. (2018). Evidence for a mental health crisis in graduate education. Nature Biotechnology, 36(3), 282–284. https://doi.org/10.1038/nbt.4089 DOI: https://doi.org/10.1038/nbt.4089

Flaherty, C. (2019). How mindfulness helps grad students. Inside Higher Ed. https://www.insidehighered.com/news/2019/11/15/mindfulness-significantly-benefits-graduate-students-says-first-study-its-kind

Freeman, C., & Clare, B. (2019). Avoiding burnout: Self-care strategies for faculty. https://www.facultyfocus.com/articles/faculty-development/avoiding-burnout-self-care-strategies-faculty/

Hawkins, H. (2019). Creating care-full academic spaces? ACME: An International Journal for Critical Geographies, 18(4), 816–834. https://acme-journal.org/index.php/acme/article/view/1465

Jacobsen, D. Y. (2017). Dropping out or dropping in? A connectivist approach to understanding participants' strategies in an e-Learning MOOC pilot. Technology, Knowledge and Learning, 24(1), 1–21. http://dx.doi.org/10.1007/s10758-017-9298-z DOI: https://doi.org/10.1007/s10758-017-9298-z

Jacobsen, M. (2014). Design based research: Sponsoring innovation in education. Education Canada, 54(5), 22–24. https://www.edcan.ca/articles/design-based-research/

Kamler, B., & Thomson, P. (2014). Helping doctoral students write: Pedagogies for supervision (2nd Edition). Routledge. DOI: https://doi.org/10.4324/9781315813639

Kiers, J. (2016). MOOCs and their effect on the institution: Experiences in course design, delivery and evaluation; Research; Faculty development; Unbundling and credits for MOOCs. Foro de Educación, 14(21), 133–149. http://dx.doi.org/10.14516/fde.2016.014.021.007 DOI: https://doi.org/10.14516/fde.2016.014.021.007

Kumar, S. & Coe, C. (2017). Online mentoring and student support in online doctoral programs. American Journal of Distance Education, 31(2),128–142. http://dx.doi.org/10.1080/08923647.2017.1300464 DOI: https://doi.org/10.1080/08923647.2017.1300464

Kumar, S. & Johnson, M. (2019). Online mentoring of dissertations: The role of structure and support. Studies in Higher Education, 44(1), 59–71. http://dx.doi.org/10.1080/03075079.2017.1337736 DOI: https://doi.org/10.1080/03075079.2017.1337736

Nowell, L. Ovie, G., Kenny, N., & Jacobsen, M. (2020). Postdoctoral scholar’s perspectives about professional learning and development: A concurrent mixed-methods study. Palgrave Communications, 6(95), 1–11. https://doi.org/10.1057/s41599-020-0469-5

Mackness, J., Waite, M., Roberts, G., & Lovegrove, E. (2013). Learning in a small, task-oriented, connectivist MOOC: Pedagogical issues and implications for higher education. International Review of Research in Open and Distance Learning, 14(4), 140–159. https://doi.org/10.19173/irrodl.v14i4.1548 DOI: https://doi.org/10.19173/irrodl.v14i4.1548

Maor, D., Ensor, J., & Fraser, B., (2016). Doctoral supervision in virtual spaces: A review of research of web-based tools to develop collaborative supervision. Higher Education Research and Development, 35(1), 172–188. https://doi.org/10.1080/07294360.2015.1121206 DOI: https://doi.org/10.1080/07294360.2015.1121206

McAlpine, L. (2017). Building on success? Future challenges for doctoral education globally. Studies in Graduate and Postdoctoral Education, 8(2), 66–77. https://doi.org/10.1108/SGPE-D-17-00035 DOI: https://doi.org/10.1108/SGPE-D-17-00035

McAlpine, L., & Austin, N. (2018). Humanities PhD graduates: Desperately seeking careers? Canadian Journal of Higher Education, 48(2), 1–19. https://doi.org/10.47678/cjhe.v48i2.188157 DOI: https://doi.org/10.47678/cjhe.v48i2.188157

McAlpine, L., & McKinnon, M. (2013). Supervision - the most variable of variables: Student perspectives. Studies in Continuing Education, 35(3), 265–280. http://doi.org/10.1080/0158037X.2012.746227 DOI: https://doi.org/10.1080/0158037X.2012.746227

McKenney, S., & Reeves, T. (2019). Conducting educational design research (2nd Edition). Routledge. DOI: https://doi.org/10.4324/9781315105642

Moskal, P., Thompson, K., & Futch, L. (2015). Enrollment, engagement, and satisfaction in the BlendKit faculty development open, online course. Online Learning Journal (OLJ), 19(4), 12. https://doi.org/10.24059/olj.v19i4.555 DOI: https://doi.org/10.24059/olj.v19i4.555

Nowell, L. Ovie, G., Kenny, N., & Jacobsen, M. (2020). Postdoctoral scholar’s perspectives about professional learning and development: A concurrent mixed-methods study. Palgrave Communications, 6(95), 1–11. https://doi.org/10.1057/s41599-020-0469-5 DOI: https://doi.org/10.1057/s41599-020-0469-5

Osborne, B. J., Carpenter, S., Burnett, M., & Rolheiser, C. (2014). Preparing graduate students for a changing world of work. Canadian Journal of Higher Education, 44(3), i–ix. https://journals.sfu.ca/cjhe/index.php/cjhe/article/view/186033/pdf_9 DOI: https://doi.org/10.47678/cjhe.v44i3.186033

Reich, J., & Ruiperez-Valiente, J. A. (2019). The MOOC Pivot. Science, 363(6423), 130–131. http://doi.org/10.1126/science.aav7958 DOI: https://doi.org/10.1126/science.aav7958

Roberts, L., Tinari, C., & Bandlow, R. (2019). An effective doctoral student mentor wears many hats and asks many questions. International Journal of Doctoral Studies, 14, 133–159. https://doi.org/10.28945/4195 DOI: https://doi.org/10.28945/4195

Rodrigues, V. & Leinster, S. (2016, February 22–24). Clinical supervision with confidence: Exploring the potential of MOOCs for faculty development. In Khalil, M., Ebner, M., Kopp, M., Lorenz, A., & Kalz, M (Eds.), Proceedings of the European Stakeholder Summit on experiences and best practices in and around MOOCs (EMOOCS 2016), (pp. 287–296), Graz, Austria. BoD.

Rose, D. H., & Meyer, A. (2002). Teaching every student in the digital age: Universal design for learning. Educational Technology Research and Development, 55(5), 521–525. https://doi.org/10.1007/s11423-007-9056-3 DOI: https://doi.org/10.1007/s11423-007-9056-3

Roumell, E., & Bolliger, D. (2017). Experiences of faculty with doctoral student supervision in programs delivered via distance. The Journal of Continuing Higher Education, 65(2), 82–93. https://doi.org/10.1080/07377363.2017.1320179 DOI: https://doi.org/10.1080/07377363.2017.1320179

Saleem, T., & Mehmood, N. (2018). Assessing the quality of supervision experiences in the different research stages at postgraduate level. Journal of Education and Educational Development, 5(2), 8–27. https://doi.org/10.22555/joeed.v5i2.1851 DOI: https://doi.org/10.22555/joeed.v5i2.1851

Salmon, G., Gregory, J., Lokuge Dona, K., & Ross, B. (2015). Experiential online development for educators: The example of the Carpe Diem MOOC. British Journal of Educational Technology, 46(3), 542–556. https://doi.org/10.1111/bjet.12256 DOI: https://doi.org/10.1111/bjet.12256

Sekuler, A. B., Crow, B., & Annan, R. B. (2013). Beyond labs and libraries: Career pathways for doctoral students. Higher Education Quality Council of Ontario.

Skarakis-Doyle, E., & McIntyre, G. L. (2008). Western guide to graduate supervision. Western University, Teaching Support Centre. https://ir.lib.uwo.ca/tsc-purple-guides/3/

Sommer, M., Ritzhaupt, A.D., Muller, K.E., & Glueck. (2019). Transformation of a face-to-face workshop into a Massive Open Online Course (MOOC): A design and development case. J Form Des Learn 3, 97–110. https://doi.org/10.1007/s41686-019-00037-y DOI: https://doi.org/10.1007/s41686-019-00037-y

University of Calgary. (2015). Campus mental health strategy: Creating a community of caring. https://www.ucalgary.ca/mentalhealth/strategy/about

Walker, G. E., Golde, C. M., Jones, L., Bueschel, A. C., & Hutchings, P. (2008). The formation of scholars: Rethinking doctoral education for the twenty-first century. Jossey-Bass.

Williams, G. (2005). Doctoral Education in Canada 1900 – 2005. Conference paper prepared for the Canadian Association for Graduate Studies. Online: https://cags.ca/cags-publications/

Wisker, G. (2012). The good supervisor: Supervising postgraduate and undergraduate research for doctoral theses and dissertations (2nd ed.). Palgrave MacMillan.

Wisker, G., & Robinson, G. (2016). Supervisor wellbeing and identity: Challenges and strategies. International Journal for Researcher Development, 7(2), 123–140. https://doi.org/10.1108/IJRD-03-2016-0006 DOI: https://doi.org/10.1108/IJRD-03-2016-0006

Downloads

Published

2021-11-30

How to Cite

Jacobsen, M., Alharbi, H., Taylor, L., Bairstow, L., & Roberts, V. (2021). The Design and Evaluation of Online Faculty Development for Effective Graduate Supervision . The Open/Technology in Education, Society, and Scholarship Association Journal, 1(1), 1–23. https://doi.org/10.18357/otessaj.2021.1.1.3

Issue

Section

Research Articles