Impact of an Instructor's Personalized Email Intervention on Completion Rates in a Massive Open Online Course (MOOC)
DOI:
https://doi.org/10.34190/ejel.20.3.2376Keywords:
MOOC,, massive open online course, email intervention, dropout, completion rate, online learningAbstract
Although Massive Open Online Courses (MOOCs) are increasing in popularity, they have been subject to criticism due to the high dropout rate. This study examined the impact of an instructor's personalized email intervention on the rate of completion of a nine week course, which included seven weekly quizzes, and the rate of completion of the final exam. The participants, who took an Israeli noncredit academic MOOC on negotiation management, were randomly assigned to two groups. Treatment group participants (N = 576) who did not complete the weekly quiz received a tailored reminder by email from their instructor encouraging them to complete the quiz and offering them assistance in order to deal with the past week’s contents. The control group (N = 608) that did not complete the weekly quiz did not get any emails from the instructor. The impact of the intervention was measured in three different ways: the immediate-impact, the delayed-impact and a cumulative impact. The increase in quiz completion within a week after the instructor's email was defined as an immediate-impact. The increase in the completion of the next quiz was defined as a delayed impact. The increase in the final exam completion rates was defined as a cumulative impact. The results show that the weekly intervention had an immediate impact as well as a cumulative impact on the final exam completion rate. The results suggest that an instructor's acknowledgement and interest might increase learners' commitment to learning in a MOOC. This study aimed to gain insight into learners' propensity to stay active in a MOOC and to increase completion rates. Findings of this study can be useful to MOOC designers and instructors to design and facilitate more effective MOOCs for learners by using email interventions to prevent students from dropping out of courses.
References
Alario-Hoyos, C., Estévez-Ayres, I., Pérez-Sanagustín, M., Delgado Kloos, C. and Fernández-Panadero, C. 2017. Understanding learners’ motivation and learning strategies in MOOCs. International Review of Research in Open and Distance Learning, 18(3), pp. 120–137. https://doi.org/10.19173/irrodl.v18i3.2996
Barak, M., Watted, A. and Haick, H. 2016. Motivation to learn in massive open online courses: examining aspects of language and social engagement. Computers and Education, 94, pp. 49–60. https://doi.org/10.1016/j.compedu.2015.11.010
Baxter, J. A. and Haycock, J. 2014. Roles and student identities in online large course forums: implications for practice", International Review of Research in Open and Distance Learning, 15(1), pp. 21–40. https://doi.org/https://doi.org/10.19173/irrodl.v15i1.1593
Breslow, L., E. Pritchard, D., DeBoer, J., S. Stump, G., Ho, D., A. and T. Seaton, D. 2013. Studying learning in the worldwide classroom research into edX’s first MOOC. Research & Practice in Assessment, 8, pp. 13–25. https://doi.org/10.1007/BF01173772
Borrella, I., Caballero-Caballero, S. and Ponce-Cueto, E. 2019. Predict and intervene: Addressing the dropout problem in a MOOC-based program. In: Proceedings of the 6th 2019 ACM Conference on Learning@ Scale, pp. 1–9.
Chaw, Y. L. and Tang, M. C. 2019. Driving high inclination to complete massive open online courses (MOOCs): motivation and engagement factors for learners The Electronic Journal of e-Learning, 17(2), pp. 118–130. Available from
https://academic-publishing.org/index.php/ejel/article/view/1876
[Accessed 10 August 2021]
Chen, Y., Gao, Q., Yuan, Q. and Tang, Y. 2019. Facilitating students’ interaction in MOOCs through timeline-anchored discussion. International Journal of Human-Computer Interaction, 35(19), pp. 1781–1799. https://doi.org/10.1080/10447318.2019.1574056
Cheng, H. F., Yu, B., Fu, S., Zhao, J., Hecht, B., Konstan, J., Terveen, L., Yarosh, S. and Zhu, H. 2019. Teaching UI design at global scales: A case study of the design of collaborative capstone projects for MOOCs. In: Proceedings of the 6th 2019 ACM Conference on Learning at Scale, L@S 2019. https://doi.org/10.1145/3330430.3333635
Cho, M.-H. and Byun, M.-K. 2017. Nonnative English-Speaking students’ lived learning experiences with MOOCs in a regular college classroom. International Review of Research in Open and Distance Learning, 18(5), pp. 173–190. https://doi.org/10.19173/irrodl.v18i5.2892
Cisel, M. 2018. Interactions in MOOCs: the hidden part of the iceberg. International Review of Research in Open and Distance Learning, 19(5), pp. 81–94. https://doi.org/10.19173/irrodl.v19i5.3459
Dalipi, F., Imran, A. S. and Kastrati, Z. 2018. MOOC dropout prediction using machine learning techniques: review and research challenges. IEEE Global Engineering Education Conference, EDUCON, pp. 1007–1014. https://doi.org/10.1109/EDUCON.2018.8363340
Dhawal, S. 2020. The Second Year of the MOOC: A Review of MOOC stats and Trends in 2020, [online]. Available from https://www.classcentral.com/report/the-second-year-of-the-mooc/ [Accessed 10 August 2021].
Edinburgh Group. 2013. A Report Summarising the Experience of the University of Edinburgh of Offering Our First 6 Massive Open Online Courses (MOOCs) in Partnership with Coursera. Available from http://hdl.handle.net/1842/6683 [Accessed 10 August 2021]
Evans, B., Baker, R. and Dee, T. 2016. Persistence patterns in massive open online courses (MOOCs). The Journal of Higher Education, 87(2), pp. 206–242. https://doi.org/10.1353/jhe.2016.0006
Evans, T., Kensington-Miller, B. and Novak, J. 2021. Effectiveness, efficiency, engagement: Mapping the impact of pre-lecture quizzes on educational exchange. Australasian Journal of Educational Technology, 37(1), pp. 163–177. Available from https://doi.org/10.14742/ajet.6258
Fyfield, M., Henderson, M., Heinrich, E. and Redmond, P. 2019. Videos in higher education: Making the most of a good thing. Australasian Journal of Educational Technology, 35(5), pp. 1–7. Available from https://doi.org/10.14742/ajet.5930
Garrison, D. R. and Anderson, T. 2003. E-learning in the 21st century: a framework for research and practice. In: Open Universiteit Nederland, pp. 49–70. https://doi.org/10.4324/9780203838761
Garrison, D. R. Anderson, T. and Archer, W. 2000. Critical inquiry in a text-based environment: Computer conferencing in higher education. Internet and Higher Education, 2(2-3), pp. 87–105. https://doi.org/10.1016/S1096-7516(00)00016-6
Ghosh, R., Haynes, R. K. and Kram, K. E. 2013. Developmental networks at work: Holding environments for leader development. Career Development International, 18(3), pp. 232–256. https://doi.org/10.1108/CDI-09-2012-0084
Guo, P. J., Kim, J. and Rubin, R. 2014. How video production affects student engagement: an empirical study of MOOC videos. First ACM Conference on Learning @ Scale, pp. 41–50. https://doi.org/10.1145/2556325.2566239
Hausman, D. M. and Welch, B. 2010. Debate: To nudge or not to nudge. Journal of Political Philosophy, 18(1), pp. 123–136. https://doi.org/10.1111/j.1467-9760.2009.00351.x
Hew, K. F. 2015. Towards a model of engaging online students: Lessons from MOOCs and four policy documents. International Journal of Information and Education Technology, 5(6), pp. 425–431. https://doi.org/10.7763/ijiet.2015.v5.543
Hone, K. and El Said, G. 2016. Exploring the factors affecting MOOC retention: a survey study. Computers and Education, 98, pp. 157–168. https://doi.org/10.1016/j.compedu.2016.03.016
Jordan, K. 2015. Massive open online course completion rates revisited: assessment, length and attrition. International Review of Research in Open and Distributed Learning, 16(3), pp. 341–358.
Kahn, W. A. 2001. Holding environments at work. The Journal of Applied Behavioral Science, 37(3), pp. 260–279. https://doi.org/10.1177/0021886301373001
Kilgore, W. and Lowenthal, P. R. 2015. The human element MOOC: an experiment in social presence. In: Wright, R. D. (Ed.), Establishing an Equitable and Fair Admissions System for an Online Doctoral Program, IGI Global, pp. 389–407.
Kizilcec, R. F., Schneider, E., Cohen, G. L. and McFarland, D. A. 2014. Encouraging forum participation in online courses with collectivist, individualist and neutral motivational framings. eLearning Papers, 37, pp 13–21.
Kopolovich, O. 2020. Learning soft skills in the digital age: Challenges and insights from development and teaching 'Negotiation Management' MOOC. The Online Journal of Applied Knowledge Management (OJAKM), 8(2), pp. 91–106. https://doi.org/10.36965/OJAKM.2020.
Lee, Y. and Choi, J. 2011. A review of online course dropout research: implications for practice and future research. Educational Technology Research and Development, 59(5), pp. 593–618.
Lee, J. and Martin, L. 2017. Investigating students’ perceptions of motivating factors of online class discussions. International Review of Research in Open and Distance Learning, 18(5), pp. 149–172. https://doi.org/10.19173/irrodl.v18i5.2883
Min, L. and Jingyan, L. 2017. Assessing the effectiveness of self-regulated learning in MOOCs using macro-level behavioural sequence data. CEUR Workshop Proceedings, pp. 1–9.
Mohamed, A., Yousef, F., Chatti, M. A., Schroeder, U. and Wosnitza, M. 2015. A usability evaluation of a blended MOOC environment: an experimental case study. The International Review of Research in Open and Distributed Learning, 16(2), pp. 69–93. https://doi.org/https://doi.org/10.19173/irrodl.v16i2.2032
Padilla Rodriguez, B. C. and Armellini, A. 2015. Expanding the interaction equivalency theorem. International Review of Research in Open and Distance Learning, 16(3), pp. 298–317. https://doi.org/10.19173/irrodl.v16i3.2085
Rabin, E., Henderikx, M., Kalman, Y. M. and Kalz, M. 2020. What are the barriers to learners’ satisfaction in MOOCs and what predicts them? The role of age, intention, self-regulation, self-efficacy and motivation. Australasian Journal of Educational Technology, 36(3), pp. 119–131. https://doi.org/10.14742/ajet.5919
Reich, J. 2014. MOOC completion and retention in the context of student intent. Educause Review. Available from https://er.educause.edu/articles/2014/12/mooc-completion-and-retention-in-the-context-of-student-intent [Accessed 10 August 2021].
Reich, J. and Ruipérez-Valiente, J. A. 2019. The MOOC pivot. Science, 363(6423), pp. 130–131. https://doi.org/10.1126/science.aav7958
Schuwer, R., Gil-Jaurena, I., Aydin, C. H., Costello, E., Dalsgaard, C., Brown, M., Jansen, D. and Teixeira, A. 2015. Opportunities and threats of the MOOC movement for higher education: The European perspective. International Review of Research in Open and Distance Learning, 16(6), pp. 20–38. https://doi.org/10.19173/irrodl.v16i6.2153
Soffer, T. and Cohen, A. 2015. Implementation of Tel Aviv university MOOCs in academic curriculum: A pilot study. International Review of Research in Open and Distance Learning, 16(1), pp. 80–97. https://doi.org/10.19173/irrodl.v16i1.2031
Spiro, R. J. and Jehng, J. C. 1990. Cognition, education, and multimedia: exploring ideas in high technology. In: Nix, D. and Spiro, R. (Eds.), Cognition, Education, and Multimedia: Exploring Ideas in High Technology, Lawrence Erlbaum Associates, pp. 163–205.
Teusner, R., Hille, T. and Staubitz, T. 2018. Effects of automated interventions in programming assignments: evidence from a field experiment. In: Proceedings of the 5th Annual ACM Conference on Learning at Scale, L@S 2018, pp. 1–10. https://doi.org/10.1145/3231644.3231650
Thaler, R. H. and Sunstein, C. R. 2008. Nudge: improving decisions about health, wealth, and happiness. New Haven and London: Yale University Press. https://doi.org/10.1016/s1477-3880(15)30073-6
Van Buskirk, W. and McGrath, D. 1999. Organizational cultures as holding environments: a psychodynamic look at organizational symbolism. Human Relations, 52(6), pp. 805–832. https://doi.org/10.1177/001872679905200606
Winnicott, D. W. 1982. Playing and reality. London and New York: Routledge Classics. https://doi.org/10.4324/9780203441022
Downloads
Published
Issue
Section
License
Copyright (c) 2022 Gila Kurtz, Orna Kopolovich, Elad Segev, Limor Sahar-Inbar, Lilach Gal, Ronen HAmmer
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Open Access Publishing
The Electronic Journal of e-Learning operates an Open Access Policy. This means that users can read, download, copy, distribute, print, search, or link to the full texts of articles, crawl them for indexing, pass them as data to software, or use them for any other lawful purpose, without financial, legal, or technical barriers other than those inseparable from gaining access to the internet itself. The only constraint on reproduction and distribution, and the only role for copyright in this domain, is that authors control the integrity of their work, which should be properly acknowledged and cited.
