2022 VOL. 9, No. 1
Abstract: The coronavirus (COVID-19) pandemic has been a global crisis, affecting many areas of society, including higher education, which has not been immune to its effects. This study, therefore, examines COVID-19 from the perspective of higher education, applying data mining and analytics approaches, i.e., t-SNE analysis, text-mining, and social network analysis, to identify research themes and patterns. The results obtained show that studies have not been restricted to addressing only the impact of COVID-19 on learners and educational institutions in terms of pedagogical issues. The study identified three broad themes from the body of research on this subject: (1) educational crisis and higher education in the new normal: resilience, adaptability, and sustainability, (2) psychological pressures, social uncertainty, and mental well-being of learners, and (3) the rise of online distance education and blended-hybrid modes. The study concludes that the survival of higher education depends on the resilience, adaptability, and sustainability skills of higher education institutions.
Keywords: COVID-19 pandemic, higher education, teaching and learning, emergency remote education, online distance education.
The coronavirus (COVID-19) has struck the entire globe, sparking in its wake a turning point, not only for education but for every aspect of our lives. The hope was that the vaccination would stop the pandemic, yet the different variants of coronavirus that have emerged signal that the virus may be with us for some time and, therefore, we must ensure our educational ecosystem is resilient and sustainable. Even if the virus were to be completely eradicated, it is believed that the ripples created by the COVID-19 pandemic will continue in the near and distant future, and that there will always be the threat of a similar global-scale crisis occurring again. In the light of the global scale of the COVID-19 crisis and the deep impact it has had on the educational landscape, this study aims to gain a deeper understanding of the effects that the COVID-19 pandemic has had on education.
According to Bozkurt and Sharma (2021), the COVID-19 pandemic created a deep and wide rupture in human history, prompting researchers from a broad range of fields to examine the crisis through their respective perspectives. One of the earliest studies to be conducted on the impact of COVID-19 on higher education (HE) was by Aristovnik et al (2020), who analysed how the COVID-19 pandemic affected the life of HE students on a global scale. They reported that the mental wellbeing of learners in HE was most affected by the radical changes caused by the measures instituted to address COVID-19, and that this impact on their wellbeing negatively affected their academic performance. They further noted that the onset of the pandemic in the northern hemisphere occurred in the middle of the academic year, while in the southern hemisphere the onset occurred at the beginning of the academic year, and that this triggered a different emotional response in the two hemispheres. Crawford et al (2020) conducted a systematic review of the state of HE during the COVID-19 crisis and highlighted the need to develop strategies aimed at not only digital education but also at digital pedagogies. Carrillo and Flores (2020), in their study seeking to identify research patterns in online teaching and learning from the perspective of teacher education during the pandemic, found that the most recurrent themes were related to interactions and discussions, online communities involving teacher participation or engagement, teacher knowledge, the use and effects of video, and finally, feedback and peer assessment activities.
Many systematic reviews, mapping studies, and bibliometric analyses focusing on education, emergency remote teaching and learning, and HE have been conducted to analyse and understand the consequences of the COVID-19 pandemic. For instance, Bond et al (2021) conducted an extensive systematic review on this subject and found that the most referenced concepts in the sampled studies were firmly established concepts like distance education, online learning, and e-learning, while Bozkurt and Sharma (2020a) and Hodges et al (2020) argued that during the early waves of the pandemic, rather than traditional online distance education, emergency remote education better described the practices applied by educational institutions. Bond et al (2021) noted that HE research tended to focus on the experiences of learners, while an earlier study by the same author (Bond, 2020) that examined the body of literature related to the K-12 level reported that students' wellbeing was one of the primary concerns at this level. Another study, which investigated learning with technology, particularly internet-based technologies and non-internet-based technologies, at the K-12 level, was conducted by Crompton et al (2021), who reported that, “Six categories emerged on how teaching strategies and technologies were used to continue K-12 learning in emergency situations: communication, delivery systems, student ERE readiness, partnerships, promoting student learning and engagement, and resources.” (p. 1571).
In their bibliometric study, Mishra et al (2021) reported that remote teaching, the assessment of distance learning, emergency online teaching, virtual learning environments, and student readiness were trending topics in online distance learning during the COVID-19 pandemic. They also highlighted that technologies for teaching and learning and psychosocial issues were emerging issues in the sampled publications. In the systematic review conducted by Talib et al (2021), it was found that the transition from face-to-face education to online distance education and the impact of the pandemic-related lockdowns and other imposed measures on the academic and personal lives of students and on their experiences with online distance education were the most salient themes. The same authors also noted that the pandemic itself could be an impetus for change but warned that there were potentially serious issues that needed to be addressed, such as inequality and inaccessibility, inadequacies, poor communication quality, technical difficulties, the need for technology literacy, the balance between professional and personal life, privacy concerns in online environments, difficulties in the assessment of student performance, lack of student engagement, participation and motivation, and lastly, stress, workload and morale.
Di Pietro et al (2020) noted in their study that while emergency remote teaching and learning was implemented to ensure continuity of education during the pandemic, the separation of K-12 level learners from onsite learning environments during quarantine or lockdown periods led to learning loss as a result of less time spent in learning, stress and anxiety due to isolation, loss of in-person communication, changes in the way students interact, and lack of learning motivation. They further emphasised that the sudden shift from offline/onsite education to online education could exacerbate existing educational inequalities. Along similar lines, the study conducted by Bozkurt et al (2020) that was aimed at presenting a global outlook on the interruption of education reported that social injustice, inequity and the digital divide have been compounded during the pandemic. Their study also highlighted that all educational stakeholders have experienced different degrees of trauma, psychological pressure, and anxiety, which suggests that a pedagogy of care, affection and empathy is needed. Pointing out that the COVID‑19 pandemic has been more than a biological crisis, as it has social, psychological, and educational aspects, Jandrić et al (2021) argued that emergency remote teaching and learning was a survival reflex, and that educators have learned to adapt to the changing teaching requirements. The same authors also noted that the pandemic was viral in nature and, likewise, hope was also viral, and, therefore, individuals kept hoping, teaching and learning as a survival mechanism. Farnell et al (2021) investigated the impact of COVID-19 on HE and presented from the results three issues to consider during and after the pandemic: teaching and learning, the social dimension of HE, and student mobility. The authors offered suggestions for each of these issues.
Accordingly, in the teaching and learning area, HE institutions need to develop assessment and evaluation strategies for online learning, develop the digital literacies of teachers and students, adapt quality assurance mechanisms, and identify at-risk students to minimise inequalities. In the social dimension of HE, there are challenges related to “studying conditions (access to a quiet place to study, access to equipment and a reliable internet connection, access to course study materials, and confidence in using online platforms), funding (loss of employment/income, difficulties in meeting living costs, issues with receiving scholarships), and wellbeing (lack of supportive social networks; feelings of frustration, anxiety, and boredom with academic activities)” (Farnell et al, 2021, p. 10). For the student mobility area, they reported that there should be flexibility in access, the same support provided to domestic students and international students, alternative solutions offered through the lens of equity and diversity, and a reworking of the traditional models governing international mobility.
Corell-Almuzara et al (2021), in their bibliometric analysis, revealed that the psychological impact of the pandemic on mental wellbeing is one of the major themes in the field of education. Monjaraz-Fraustro et al (2021), who examined e-learning research in the COVID-19 context, found that distance learning, the effects of distance education, telemedicine, and virtual training were the most dominant research clusters. Mustapha et al (2021), in their investigation involving a bibliometric analysis of the effectiveness of digital technology, reported the following thematic research clusters: quick shift to online teaching and learning, digital education during the pandemic and rethinking of the sustainable community, digital education for medical education and healthcare in hospitals, and digital education and digital innovation development during COVID-19. Similarly, the study by Arias-Chávez et al (2021) identified online teaching and e-learning as central nodes in medical education.
Since the COVID-19 phenomenon is still relatively recent, this study aimed to identify the research themes and patterns relating to COVID-19 from the perspective of HE. To this end, the study examined scholarly papers through data mining and analytic approaches to identify how the COVID-19 pandemic has impacted the HE landscape.
This study applied an exploratory approach involving systematic review and bibliometric analysis methods to analyse published scholarly documents on the subject in question. Unlike traditional review techniques, this study used data mining and analytic approaches (Fayyad et al, 2002), specifically text mining (Aggarwal & Zhai, 2012) and social network analysis (Hansen et al, 2020), to visualise the large volume of data. Multiple data analysis approaches were used to triangulate the data (Thurmond, 2001), which served to increase the validity and reliability of the research findings.
The inclusion criteria used for creating the research corpus were that the publications were written in English, indexed by Scopus, and have the search strings (see Table 1) included in their titles. The use of only English language publications was preferred because lexical analyses are better able to identify meaningful patterns in one language. Scopus was selected as the database for its breadth of publications, as it is the largest academic database, and because it indexes the publications available in different databases. The explicit use of search strings that were included in the title of publications was done to get a more focused, concentrated outlook by sampling publications whose research focus was the COVID-19 pandemic and HE.
Table 1: Search strings used to create the research corpus
"Covid-19" OR "pandemic*" OR "Coronavirus*"
"higher education" OR "graduate" OR "undergraduate" OR "tertiary education" OR “academ*”
The query using the above shown search strings returned a total of 841 publications. After applying the PRISMA protocol (Page et al, 2021) (Table 2), the final phase included a total of 572 publications. The scholarly findings from peer-reviewed journal articles and conference papers that met the predefined inclusion criteria were included in the analysis.
Table 2: The PRISMA flow chart
Operating under the assumption that the title, abstract, and keywords of a paper when taken together adequately represent its essence, this study examined the sampled publications in three research phases. The first phase used t-distributed stochastic neighbor embedding (t-SNE) analysis (van der Maaten & Hinton, 2008) to examine the titles of the publications in the research corpus. The t-SNE is helpful for visualising “high-dimensional data by assigning each datapoint [words in titles] a position within a two or three-dimensional map” (van der Maaten & Hinton, 2008, p. 2579). The second phase used text-mining (Aggarwal & Zhai, 2012) to examine the abstracts of the publications. In this phase, a lexical analysis, which “employs two stages of co-occurrence information extraction, semantic and relational, using a different algorithm for each stage”, was performed on the abstracts. (Smith & Humphreys, 2006, p. 262). Lastly, the third phase used SNA (Hansen et al, 2020) to examine the keywords identified by the authors. In this phase, the keywords were considered as nodes and their relationships were considered as links between them (Hansen et al, 2020), a process which helped to identify and visualise the significant nodes.
The study acknowledges the following limitations. First, although the research corpus was created from publications indexed by the largest database, Scopus, there are other publications in the grey literature that may have provided additional invaluable insights. However, this limitation was to a certain degree compensated for by applying the criterion of selecting only peer-reviewed publications. Second, the research corpus only included English-language publications. However scholarly papers in languages other than English could have provided deeper insight into the study subject. Yet, with that said, given that the study aimed to develop a global perspective on the subject in question, it was determined that publications in English offered the best opportunity to achieve this.
To identify the foci of studies included in the research corpus, a t-SNE analysis of the titles was conducted. From the results of this analysis, a structure with three clusters was identified (see Figure 1). The first cluster shows that the COVID-19 pandemic has affected mostly undergraduate and graduate students and their learning processes, in terms of online learning and emerging challenges (see the green cluster in Figure 1). The second cluster represents the institutional crisis that emerged as a result of the shift to emergency online remote education, as this was an entirely new experience for several HE institutions. Within this cluster, learners' experiences in online/virtual learning spaces were a noteworthy issue (see the purple cluster in Figure 1). Finally, the third cluster reflects a variety of issues, outside of those in the other clusters, that emerged from the pandemic (see the blue cluster in Figure 1). The most salient issue was psychological problems, such as stress and anxiety from the uncertainty generated by the lockdowns and other measures taken to slow down the pandemic (e.g., closures of the educational institutions). This was followed by assessment and evaluation issues, particularly in terms of the challenges presented by having to develop and apply new assessment and evaluation strategies, different than those applied in traditional learning environments, for online learning processes. Overall, the studies included in the research corpus demonstrated a special interest in the perceptions, perspectives, and experiences of learners in HE institutions. The t-SNE analysis clearly outlines that the studies paid special attention to learners and the issues related to them, as well as to the institutional challenges and problems resulting from having to navigate in a new territory with many unknowns.
Figure 1: t-SNE analysis of the titles of studies included in the research corpus
This section presents the three broad themes that were identified from the text-mining (Figure 1) and social network analysis (Figure 2). Accordingly, these themes are (1) educational crisis and HE in the new normal: resilience, adaptability, and sustainability, (2) psychological pressures, social uncertainty, and mental well-being of learners, and (3) rise of online distance education and blended-hybrid modes.
Figure 2: Text-mining of the abstracts from the sampled studies
Figure 3: Social network analysis of the keywords from the sampled studies
Educational Crisis and Higher Education in the New Normal: Resilience, Adaptability and Sustainability
The first theme demonstrates the responses HE institutions have had to the pandemic and the key features of these responses, namely, resilience, adaptability, and sustainability (see paths in Figure 2: COVID-19, pandemic, lockdown, Coronavirus, outbreak, disruption, readiness, university, crisis, response and emergency, remote, education, educational, distance and higher, education, institutions, normal, future, sustainable, transformation, adoption; see nodes in Figure 3: COVID-19, higher education, higher education systems, challenges, resilience, sustainability). Accordingly, it can be argued that the COVID-19 pandemic could be considered a benchmark test for identifying effective and ineffective HE services. The implementation of emergency remote education in response to the educational crisis witnessed in the first wave of the pandemic and to the major challenges it presented helped to soften the impact of this first wave. The first theme highlights the need for HE to develop strategies directed at strengthening the resilience and sustainability of HE institutions and the services they offer.
The related literature supports the ideas constituting the first theme and the conclusions drawn from them. The disruption to education caused by the COVID-19 pandemic deepened the bleeding wounds of educational systems and demonstrated how vulnerable these systems were (d’Orville, 2020). While emergency remote education (Bozkurt & Sharma, 2020a; Hodges et al, 2020) was adopted as a response to the pandemic, it only provided temporary solutions. In prompting the need to change (Ossiannilsson, 2021a; 2021b), all of the challenges that emerged from the pandemic have forced HE institutions to adopt new learning technologies and styles, the effects of which revealed the need to develop a new type of digital resiliency in all stakeholders (Eri et al, 2021). Being prepared for the uncertainty and future challenges is a necessity at a time “when the future is unpredictable, capacity is uncertain and unknown, and learning is an issue of social and economic security” (Waller et al, 2020, p. 55). Such a view requires improving resilience, which means that HE institutions should “adopt new systems and processes, ensuring continued competitiveness and survival, especially when either internal or external interventions force them to undergo certain disruptions” (Bhagat & Kim, 2020, p. 368). However, improving resilience is not limited to an organisation's capability, it is also related to students (Bozkurt & Sharma, 2021) and instructors (Lagat, 2021) and a wide range of other factors (Cahapay, 2021). Lastly, it can be argued that with the fundamental transformations expected from the inevitability of change (Doerfel & Prezelj, 2017) and the new normal (Bozkurt & Sharma, 2020b; Xiao, 2021), it is critical for HE to reimagine and redefine itself to meet the requirements and needs of the post-Covid world.
Psychological Pressures, Social Uncertainty and Mental Well-Being of Learners
The second theme highlights how the impact of the COVID-19 pandemic on HE has reached beyond pedagogy (see paths in Figure 2: psychological, coping, depression, stress, distress, anxiety and mental, health, care, well-being; See nodes in Figure 3: uncertainty, undergraduate, mental health, anxiety, stress, mental stress, psychologic, psychological distress, depression, fear). It is clear that the COVID-19 pandemic was unexpected, unprecedented, and came as a complete element of surprise in this age of progress and advancement. In addition to its effect on education and educational institutions, the COVID-19 pandemic deeply impacted learners’ mental wellbeing due to the intense psychological pressures and high uncertainty they experienced as a result of the dramatic changes to social mechanisms caused by the imposed restrictive measures.
This theme is consistent with the findings of the study by Mishra et al (2021), who reported that the impact of psychosocial issues on teaching and learning is among the most researched topics. With the traumatic consequences of the pandemic (Bozkurt, 2021), a decrease in social (Saladino et al, 2020) and psychological wellbeing (Vindegaard & Benros, 2020) was observed throughout all of society, including the educational field (Cao et al, 2020; Sifat, 2021; Son et al, 2020; Sundarasen et al, 2020). In addition to the social distancing, lockdowns, and self-isolation (Nurunnabi et al, 2020), the sudden shift to online emergency remote education, social inequality, and ineffective educational strategies (Irawan et al, 2020) adversely affected learners' social and psychological wellbeing. As a result of these negativities, attention has been drawn to prioritising care-oriented, human-centered pandemic pedagogy by focusing on affective proximity in teaching and learning (Bozkurt & Sharma, 2020b), as well as on measures to narrow transactional distance (MacKenzie et al, 2022).
Rise of Online Distance Education and Blended-Hybrid Modes
The final theme involved the issue of reflecting the paradigm shift in the delivery of education (see paths in Figure 2: teaching, learning, instruction, digital, technology, virtual, blended, open and e-learning, pedagogical, online, experience, interaction; see nodes in Figure 3: teaching, learning, technology, e-learning, online learning, distance learning, virtual learning, remote learning, blended learning). Although distance and online education are not new to many HE institutions, the shift that occurred in the wake of the pandemic was massive and on a global scale. Metaphorically, the shift to online distance education can be understood as the migration of the educational tribes to the digital landscapes by leaving behind the so-called gold-standard of education, face-to-face instruction, and moving forward with the hope of surviving and adapting to online distance education, which first appeared as emergency remote education during the first waves of the pandemic.
Other studies on this subject report similar findings. For instance, in the pursuit of achieving a proper balance between face-to-face and online distance education in the new normal, blended and hybrid educational modes were increasingly adopted by HE institutions (Pelletier et al, 2021; Singh et al, 2021). Being stuck in a state of vu jàdé, to borrow a French term, meaning to be unfamiliar with and never having experienced a situation (Weick, 1993), which in this case, refers to online distance education, was a real challenge for many HE institutions (Heng & Sol, 2020; Miller et al, 2021), especially for traditional brick and mortar HE institutions that were not familiar with online distance education and its modalities. It has also been reported that while online distance education can be a better fit for disciplines like the social sciences and humanities, it can be challenging for applied disciplines, like medicine (Adedoyin & Soykan, 2020). However, the biases regarding the application of online distance education in applied disciplines have been discredited through the success observed in the prominent use of telemedicine (see, for instance, Figure 2) in delivering education during the COVID-19 pandemic. Figuratively speaking, the pandemic coin has two sides, an ‘opportunities’ side and a ‘challenges’ side, where issues like online assessment and evaluation, digital divide, digital burnout and fatigue, misinterpreted technology adaptation, digital competencies and literacies, online distance education instructional and learning design, lack of interaction and communication, and the need for digital infrastructures to facilitate and operate online distance education represent the challenges, while the eliciting of best practices and resulting improvement to known online distance education practices, the encouragement of creativity and drive to transform the internal status quo of online distance education, the greater accessibility for learners with special needs, and the granting of autonomy and agency to students can be considered as opportunities in a post-pandemic world.
Applying data mining and analytics, this study identified three broad themes concerning the HE landscape. These are: (1) educational crisis and higher education in the new normal: resilience, adaptability, and sustainability, (2) psychological pressures, social uncertainty, and mental well-being of learners, and (3) the rise of online distance education and blended-hybrid modes. These themes imply that pedagogy cannot be confined to only teaching and learning activities but, rather, trauma-informed pedagogies of care and empathy need to be developed. There is a shift to online distance education with different modes (e.g., blended, hybrid, hyflex), yet it is still a challenge to apply online pedagogies without proper instructional/learning design and with purely techno-centric educational strategies. It can be argued that the institution of HE should equip itself with skills and competencies to navigate and survive in a time of global crisis. To be sustainable, being adaptive and resilient is a need and this requires learning from the past and reimagining a future where HE truly accepts its failures and mistakes as an opportunity for change and rebirth.
In all, the global state of HE indicates that there has been a tectonic shift in the entire educational landscape, and that our paradigms are changing due to the effects forced upon us by the COVID-19 pandemic. The unknown is always scary and, naturally, the COVID-19 pandemic has frightened everyone. As noted by Bozkurt and Sharma (2020b), “It is high time for HE to renew, recalibrate, and reposition itself in the educational landscape. This would require the institution of HE to regenerate itself and be born again. Like the Phoenix (also known as anqā, sīmorgh), it needs to rise from the ashes, but to do this, it must first face the flames” (p. v). In line with these thoughts, it can be argued that the new normal is a time when HE will face to flames. However, if we consider the pandemic as a benchmark for global society, the question that should be raised is, ‘What did we learn from our failures and will we keep on repeating our mistakes?’
Acknowledgement: The research was supported by Anadolu University Scientific Research Projects Commission under grant no: 2107E135.
Adedoyin, O. B., & Soykan, E. (2020). COVID-19 pandemic and online learning: The challenges and opportunities. Interactive Learning Environments, 1-13. https://doi.org/10.1080/10494820.2020.1813180
Aggarwal, C. C., & Zhai, C. (Eds.). (2012). Mining text data. Springer Science & Business Media. https://doi.org/10.1007/978-1-4614-3223-4
Arias-Chávez, D., Postigo-Zumarán, J. E., Augusto, L. M. C., & Francia, L. D. R. L. (2021). Global scientific output on online education during the COVID-19 pandemic: Analysis of the 2020-2021 periods. Revista Geintec-Gestao Inovacao E Tecnologias, 11(3), 1261-1273. https://doi.org/10.47059/revistageintec.v11i3.2008
Aristovnik, A., Keržič, D., Ravšelj, D., Tomaževič, N., & Umek, L. (2020). Impacts of the COVID-19 pandemic on life of higher education students: A global perspective. Sustainability, 12(20), 8438. https://doi.org/10.3390/su12208438
Bhagat, S., & Kim, D. J. (2020). Higher education amidst COVID-19: Challenges and silver lining. Information Systems Management, 37(4), 366-371. https://doi.org/10.1080/10580530.2020.1824040
Bond, M. (2020). Schools and emergency remote education during the COVID-19 pandemic: A living rapid systematic review. Asian Journal of Distance Education, 15(2), 191-247. https://doi.org/10.5281/zenodo.4425683
Bond, M., Bedenlier, S., Marín, V. I., & Händel, M. (2021). Emergency remote teaching in higher education: Mapping the first global online semester. International Journal of Educational Technology in Higher Education, 18(1). https://doi.org/10.1186/s41239-021-00282-x
Bozkurt, A., & Sharma, R. C. (2021). On the verge of a new renaissance: Care and empathy oriented, human-centered pandemic pedagogy. Asian Journal of Distance Education, 16(1), i-vii. https://doi.org/10.5281/zenodo.5070496
Bozkurt, A., & Sharma, R. C. (2020a). Emergency remote teaching in a time of global crisis due to Coronavirus pandemic. Asian Journal of Distance Education, 15(1), i-vi. https://doi.org/10.5281/zenodo.3778083
Bozkurt, A. (2021). Handbook of research on emerging pedagogies for the future of education: Trauma-informed, care, and pandemic pedagogy. IGI Global. http://doi:10.4018/978-1-7998-7275-7
Bozkurt, A., & Sharma, R. C. (2020b). Education in normal, new normal, and next normal: Observations from the past, insights from the present and projections for the future. Asian Journal of Distance Education, 15(2), i-x. https://doi.org/10.5281/zenodo.4362664
Bozkurt, A., Jung, I., Xiao, J., Vladimirschi, V., Schuwer, R., Egorov, G., Lambert, S. R., Al-Freih, M., Pete, J., Olcott, Jr., D. Rodes, V., Aranciaga, I., Bali, M., Alvarez, Jr., A. V., Roberts, J., Pazurek, A., Raffaghelli, J. E., Panagiotou, N., de Coëtlogon, P., Shahadu, S., Brown, M., Asino, T. I. Tumwesige, J., Ramírez Reyes, T., Barrios Ipenza, E., Ossiannilsson, E., Bond, M., Belhamel, K., Irvine, V., Sharma, R. C., Adam, T., Janssen, B., Sklyarova, T., Olcott, N. Ambrosino, A., Lazou, C., Mocquet, B., Mano, M., & Paskevicius, M. (2020). A global outlook to the interruption of education due to COVID-19 pandemic: Navigating in a time of uncertainty and crisis. Asian Journal of Distance Education, 15(1), 1-126. https://doi.org/10.5281/zenodo.3878572
Cahapay, M. B. (2021). Navigating the post-COVID-19 era of ‘Next Normal’ in the context of Philippine higher education. Asia-Pacific Journal of Educational Management Research, 5(3), 57-64. http://dx.doi.org/10.21742/ajemr.2020.5.3.06
Cao, W., Fang, Z., Hou, G., Han, M., Xu, X., Dong, J., & Zheng, J. (2020). The psychological impact of the COVID-19 epidemic on college students in China. Psychiatry Research, 287, 1-5. https://doi.org/10.1016/j.psychres.2020.112934
Carrillo, C., & Flores, M. A. (2020). COVID-19 and teacher education: A literature review of online teaching and learning practices. European Journal of Teacher Education, 43(4), 466-487. https://doi.org/10.1080/02619768.2020.1821184
Corell-Almuzara, A., López-Belmonte, J., Marín-Marín, J. A., & Moreno-Guerrero, A. J. (2021). COVID-19 in the field of education: State of the art. Sustainability, 13(10), 5452. https://doi.org/10.3390/su13105452
Crawford, J., Butler-Henderson, K., Rudolph, J., Malkawi, B., Glowatz, M., Burton, R., & Lam, S. (2020). COVID-19: 20 countries’ higher education intra-period digital pedagogy responses. Journal of Applied Learning & Teaching, 3(1), 120. https://doi.org/10.37074/jalt.2020.3.1.7
Crompton, H., Burke, D., Jordan, K., & Wilson, S. W. G. (2021). Learning with technology during emergencies: A systematic review of K- 12 education. British Journal of Educational Technology, 52, 1554-1575. https://doi.org/10.1111/ bjet.13114
d’Orville, H. (2020). COVID-19 causes unprecedented educational disruption: Is there a road towards a new normal? Prospects, 49, 11-15. https://doi.org/10.1007/s11125-020-09475-0
Di Pietro, G., Biagi, F., Costa, P., Karpiński, Z., & Mazza, J. (2020). The likely impact of COVID-19 on education: Reflections based on the existing literature and recent international datasets (Vol. 30275). Publications Office of the European Union. http://dx.doi.org/10.2760/126686
Doerfel, M. L., & Prezelj, I. (2017). Resilience in a complex and unpredictable world. Journal of Contingencies and Crisis Management, 25(3), 118-122. https://doi.org/10.1111/1468-5973.12177
Eri, R., Gudimetla, P., Star, S., Rowlands, J., Girgla, A., To, L., Li, F., Sochea, N., & Bindal, U. (2021). Digital resilience in higher education in response to COVID-19 pandemic: Student perceptions from Asia and Australia. Journal of University Teaching & Learning Practice, 18(5), 2021. https://ro.uow.edu.au/jutlp/vol18/iss5/7
Farnell, T., Skledar Matijevic, A., & Šcukanec Schmidt, N. (2021). The impact of COVID-19 on higher education: A review of emerging evidence. NESET report. Publications Office of the European Union. http://dx.doi.org/10.2766/069216
Fayyad, U., Grinstein, G. G., & Wierse, A. (Eds.). (2002). Information visualization in data mining and knowledge discovery. Morgan Kaufmann.
Hansen, D. L., Shneiderman, B., Smith, M. A., & Himelboim, I. (2020). Analyzing social media networks with NodeXL: Insights from a connected world (2nd ed.). Morgan Kaufmann.
Heng, K., & Sol, K. (2020). Online learning during COVID-19: Key challenges and suggestions to enhance effectiveness. Cambodian Education Forum, 1-15. https://cambodianeducationforum.wordpress.com/2020/12/08/online-learning-during-covid-19-key-challenges-and-suggestions-to-enhance-effectiveness/
Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020, March 27). The difference between emergency remote teaching and online learning. EDUCAUSE Review. https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remoteteaching-and-online-learning
Irawan, A. W., Dwisona, D., & Lestari, M. (2020). Psychological impacts of students on online learning during the pandemic COVID-19. KONSELI: Jurnal Bimbingan dan Konseling (E-Journal), 7(1), 53-60. https://doi.org/10.24042/kons.v7i1.6389
Jandrić, P., Bozkurt, A., McKee, M., & Hayes, S. (2021). Teaching in the age of COVID-19—A longitudinal study. Postdigital Science and Education, 3(3). https://doi.org/10.1007/s42438-021-00252-6
Lagat, K. T. (2021). Factors affecting teachers’ resiliency amidst the COVID-19 pandemic. Recoletos Multidisciplinary Research Journal, 9(1), 133-145. https://doi.org/10.32871/rmrj2109.01.12
MacKenzie, A., Bacalja, A., Annamali, D., Panaretou, A., Girme, P., Cutajar, M., Abegglen, S., Evens, M., Neuhaus, F., Wilson, K., Psarikidou, K., Koole, M., Hrastinski, S., Sturm, S., Adachi, C., Schnaider, K. Bozkurt, A., Rapanta, C., Themelis, C., Thestrup, K., Gislev, T., Örtegren, A., Costello, E., Dishon, G., Hoechsmann, M., Bucio, J., Vadillo, G., Sánchez‑Mendiola, M. Goetz, G., Gusso, H. L., Arantes, J. A., Kishore, P., Lodahl, M., · Suoranta, J., Markauskaite, L., Mörtsell, S., O’Reilly, T., Reed, J., Bhatt, I., Brown, C. MacCallum, K., Ackermann, C., Alexander, C., Payne, A. L., Bennett, R., Stone, C., Collier, A., Watulak, S. L., Jandrić, P., Peters, M., & Gourlay, L. (2022). Dissolving the dichotomies between online and campus-based teaching: A collective response to the manifesto for teaching online (Bayne et al, 2020). Postdigital Science and Education, 4(1). https://doi.org/10.1007/s42438-021-00259-z
Miller, A. N., Sellnow, D. D., & Strawser, M. G. (2021). Pandemic pedagogy challenges and opportunities: Instruction communication in remote, HyFlex, and BlendFlex courses. Communication Education, 70(2), 202-204. https://doi.org/10.1080/03634523.2020.1857418
Mishra, S., Sahoo, S., & Pandey, S. (2021). Research trends in online distance learning during the COVID-19 pandemic. Distance Education, 1-26. https://doi.org/10.1080/01587919.2021.1986373
Monjaraz-Fraustro, C., Casas-Valadez, M. A., Aguilera, J. I. A., López-Robles, L. D., Diez, R. A., & López-Robles, J. R. (2021). Current status of the e-learning research field: Challenges and opportunities in the e-learning research field during COVID-19 pandemic. International Journal of Progressive Sciences and Technologies, 27(1), 380-390. http://dx.doi.org/10.52155/ijpsat.v27.1.3239
Mustapha, I., Van, N. T., Shahverdi, M., Qureshi, M. I., & Khan, N. (2021). Effectiveness of digital technology in education during COVID-19 pandemic. A bibliometric analysis. International Journal of Interactive Mobile Technologies, 15(8), 136-154. https://online-journals.org/index.php/i-jim/article/view/20415
Nurunnabi, M., Almusharraf, N., & Aldeghaither, D. (2020). Mental health and well-being during the COVID-19 pandemic in higher education: Evidence from G20 countries. Journal of Public Health Research, 17(9). https://dx.doi.org/10.4081%2Fjphr.2020.2010
Ossiannilsson, E. (2021a). The new normal: Post COVID-19 is about change and sustainability. Near East University Online Journal of Education, 4(1), 72-77. https://dergipark.org.tr/en/download/article-file/1576529
Ossiannilsson, E. (2021b). Resilient sustainable education for the future of education: Emerging challenges. In A. Bozkurt (Ed.), Handbook of research on emerging pedagogies for the future of education: Trauma-informed, care, and pandemic pedagogy (pp. 16-43). IGI Global. http://doi:10.4018/978-1-7998-7275-7.ch002
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372. https://doi.org/10.1136/bmj.n71
Pelletier, K., Brown, M., Brooks, D. C., McCormack, M., Reeves, J., Arbino, N., Bozkurt, A., Crawford, S., Czerniewicz, L., Gibson, R., Linder, K., Mason, J., & Mondelli, V. (2021). 2021 EDUCAUSE Horizon Report Teaching and Learning Edition. EDUCAUSE. https://www.learntechlib.org/p/219489/
Saladino, V., Algeri, D., & Auriemma, V. (2020). The psychological and social impact of Covid-19: New perspectives of well-being. Frontiers in Psychology, 11, 1-6 https://doi.org/10.3389/fpsyg.2020.577684
Sifat, R. I. (2021). COVID-19 pandemic: Mental stress, depression, anxiety among the university students in Bangladesh. Social Psychiatry, 67(5) 609-610. https://doi.org/10.1177%2F0020764020965995
Singh, J., Steele, K., & Singh, L. (2021). Combining the best of online and face-to-face learning: Hybrid and blended learning approach for COVID-19, post vaccine, & post-pandemic world. Journal of Educational Technology Systems, 50(2), 140-171. https://doi.org/10.1177%2F00472395211047865
Smith, A. E., & Humphreys, M. S. (2006). Evaluation of unsupervised semantic mapping of natural language with Leximancer concept mapping. Behavior Research Methods, 38(2), 262–279. https://doi.org/10.3758/BF03192778
Son, C., Hegde, S., Smith, A., Wang, X., & Sasangohar, F. (2020). Effects of COVID-19 on college students’ mental health in the United States: Interview survey study. Journal of Medical Internet Research, 22(9), e21279. https://doi.org/10.2196/21279
Sundarasen, S., Chinna, K., Kamaludin, K., Nurunnabi, M., Baloch, G. M., Khoshaim, H. B., Hossain, S. F. A., & Sukayt, A. (2020). Psychological impact of COVID-19 and lockdown among university students in Malaysia: Implications and policy recommendations. International Journal of Environmental Research and Public Health, 17(17), 1-13. https://doi.org/10.3390/ijerph17176206
Talib, M. A., Bettayeb, A. M., & Omer, R. I. (2021). Analytical study on the impact of technology in higher education during the age of COVID-19: Systematic literature review. Education and Information Technologies, 1-28. https://doi.org/10.1007/s10639-021-10507-1
Thurmond, V. A. (2001). The point of triangulation. Journal of Nursing Scholarship, 33(3), 253-258. https://doi.org/10.1111/j.1547-5069.2001.00253.x
van der Maaten, L., & Hinton, G. (2008). Visualizing data using t-SNE. Journal of Machine Learning Research, 9(2008), 2579-2605. http://www.jmlr.org/papers/volume9/vandermaaten08a/vandermaaten08a.pdf
Vindegaard, N., & Benros, M. E. (2020). COVID-19 pandemic and mental health consequences: Systematic review of the current evidence. Brain, Behavior, and Immunity, 89, 531-542. https://doi.org/10.1016/j.bbi.2020.05.048
Waller, R. E., Lemoine, P. A., McCormack, T. J., Garretson, C. J., & Richardson, M. D. (2020). Resiliency: A necessary skill for global higher educatıon leaders durıng COVID-19. International Journal of Education Humanities and Social Science, 3(6), 55-67. https://ijehss.com/uploads2020/EHS_3_198.pdf
Weick, K. E. (1993). The collapse of sensemaking in organizations: The Mann Gulch disaster. Administrative Science Quarterly, 38(4), 628-652. https://doi.org/10.2307/2393339
Xiao, J. (2021). Decoding new normal in education for the post-COVID-19 world: Beyond the digital solution. Asian Journal of Distance Education, 16(1), 141-155. https://doi.org/10.5281/zenodo.4818369
Aras Bozkurt is a researcher and faculty member in the Department of Distance Education, Open Education Faculty at Anadolu University, Turkey. He holds MA and PhD degrees in distance education. Dr. Bozkurt conducts empirical studies on distance education, open and distance learning, online learning, networked learning, and educational technology to which he applies various critical theories, such as connectivism, rhisomatic learning, and heutagogy. He is also interested in emerging research paradigms, including social network analysis, sentiment analysis, and data mining. He shares his views on his Twitter feed @arasbozkurt Email: email@example.com
Cite this paper as: Bozkurt, A. (2022). Resilience, adaptability, and sustainability of higher education: A systematic mapping study on the impact of the coronavirus (COVID-19) pandemic and the transition to the new normal. Journal of Learning for Development, 9(1), 1-16.