Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Flipped classroom improves nursing students’ theoretical learning in China: A meta-analysis

  • Bao-Zhu Li ,

    Contributed equally to this work with: Bao-Zhu Li, Nv-Wei Cao

    Roles Conceptualization, Methodology, Writing – original draft, Writing – review & editing

    lbz88730@163.com

    Affiliations Department of Epidemiology and Biostatistics, School of Public Health, Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Major Autoimmune Diseases, Hefei, Anhui, China

  • Nv-Wei Cao ,

    Contributed equally to this work with: Bao-Zhu Li, Nv-Wei Cao

    Roles Conceptualization, Writing – original draft, Writing – review & editing

    Affiliations Department of Epidemiology and Biostatistics, School of Public Health, Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Major Autoimmune Diseases, Hefei, Anhui, China

  • Chun-Xia Ren,

    Roles Data curation, Formal analysis

    Affiliation Department of Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, P.R. China

  • Xiu-Jie Chu,

    Roles Data curation, Formal analysis, Software

    Affiliations Department of Epidemiology and Biostatistics, School of Public Health, Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Major Autoimmune Diseases, Hefei, Anhui, China

  • Hao-Yue Zhou,

    Roles Formal analysis, Methodology

    Affiliations Department of Epidemiology and Biostatistics, School of Public Health, Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Major Autoimmune Diseases, Hefei, Anhui, China

  • Biao Guo

    Roles Software

    Affiliation Department of Human Resource, The Second Affiliated Hospital of Anhui Medical University, Anhui, Hefei, China

Abstract

Objective

At present, current didactic teaching delivery method help nursing students apply theory to clinical situations in an inefficient way. The flipped classroom (FC), a novel teaching mode emphasizing self-study and critical thinking, has generated interest in nursing education in China. However, there are a gap in the literature and no consistent outcomes of current studies which compared FC and lecture-based learning (LBL), and no systematic review has comprehensively compared theoretical scores as an affected outcome in FC versus LBL modes.

Methods

In this review, we analyze flipped-learning nursing students’ scores, and aim to assess the efficacy and provide a deeper understanding of the FC in nursing education. Following the inclusion criteria, articles were obtained by searching PubMed, Embase and Chinese data, including the China National Knowledge Infrastructure, Wanfang Data, and VIP database until 3 January 2020. Data were extracted from eligible articles and quality was assessed. A meta-analysis was then performed using a random effects model with a standardized mean value (SMD) and a 95% confidence interval (CI).32 studies were included after reviewing 2,439 citations. All studies were randomized controlled trials (RCTs). The FC theoretical knowledge scores in FC were significantly positively affected compared to those of the traditional classroom (SMD = 1.33, 95% CI: 1.02–1.64; P < 0.001). In addition, 23 studies reported skill scores, indicating significant difference between the FC mode and LBL mode (SMD = 1.58, 95%CI: 1.23–1.93; P < 0.001).

Conclusions

The results of this meta-analysis suggest that compared to the LBL teaching method, the FC mode dose significantly improve Chinese nursing students’ theoretical scores. However, the problems of heterogeneity and publication bias in this study need to be remedied high-quality future studies.

Introduction

At present, nursing is taught mainly via the traditional teaching mode, which is teacher-centered. In traditional lectures, teachers often use a stand-and-deliver approach, in which students passively receive lesson-related information [1]. In China, teachers generally adopt this traditional teaching mode, which is a common didactic method, with course material delivered by book. Also called lecture-based learning (LBL), this traditional teaching method has obvious shortcomings. As cognitive subjects, students passively receive knowledge during the teaching process, leading to their insufficient grasp of professional knowledge and a lack of enthusiasm for learning. Although the traditional mode helps students master practical skills in a short time, it cannot promote thinking and discussion among students toward the overarching goal of cultivating their abilities [2]. Consequently, exploring a new teaching mode to promote students’ acquisition of knowledge and skills has become an important current topic.

In the early 1990s, Eric Mazur proposed the peer teaching method, the earliest form of flipping the classroom [3]. In 1996, Maureen J. Lage and Glenn J. Platt proposed the idea of inverting the classroom [4]. In 2000, Baker recommended using online tools to guide classroom teaching [5]. In 2004, Salman Khan uploaded short instructional videos online. Bergmann and Sams [6], two high school chemistry teachers, started FCs in 2007. Moreover, founded in 2007, the Khan Academy provided online teaching services for the first time. They prerecorded video lectures as homework assignments for their students so that class time could be dedicated to problem-solving activities and the review of difficult materials [6]. The FC is a novel teaching method that differs from traditional teaching. The focus on the FC is the student's accountability for their own learning, and a necessary reflective approach. The FC also entails a process that shifts learning from memory recall to comprehension and application [68]. Its advent indicates that education is undergoing a role shift, from teacher- (teaching) to student-oriented (characterized by active student participation) teaching strategies [9]. This novel teaching method alters the amount of time that is spent inside versus outside the traditional classroom, placing students in control of their time. Before class, students engage in independent learning by reading the handout(s) or watching the video materials that the teacher has provided. Students then inform the teacher if they have problems with the material. In class, the teacher and the students discuss any problematic aspects together [10].

Nurses constitute one of the important components of the healthcare system. At present, the world is experiencing a serious epidemic caused by the coronavirus disease 2019 (COVID-19), and there is an extreme shortage of medical workers. A large volume of medical workers went to assist with the COVID-19 impact, but their numbers were still insufficient. Nurses are a necessary element of the treatment process. To perform their roles, nurses were required substantial professional knowledge to face a variety of potential problems. As such, nursing teaching is of great significance in contemporary medical education. For nurses, the skill of critical thinking is essential to provide safe and comprehensive care [11]. However, the current didactic teaching delivery method does not help nursing students foster the ability to reason critically and apply theory to clinical situations [12]. Therefore, scholars have begun to seeking other effective methods to promote student enthusiasm and efficiency in nursing teaching [2, 1315]. Since the FC can enhance students’ understanding of materials through active learning, it has recently become a popular, effective teaching model for application to health professions [16], medical [17], dental [18], and pharmaceutical education [19]. However, the existing studies have not strictly treated the randomized controlled trial (RCT) as an inclusion criterion [2022]. RCT is well-equipped to deal with the intervention factors’ effects on outcomes, thereby reducing selection bias and other potential bias. Excluding non-RCTs is a great way to improve the quality of the meta-analysis.

The FC has been widely applied in various nursing education courses. There has been a systematic review, with a meta-analysis indicating that the flipped approach positively affects nursing students’ skill competence [22]. Since theory is the basis of practice, faculties usually set up theory courses in advance of practical operation to teach theoretical knowledge and furnish a theoretical basis. Students need to translate theoretical knowledge into practice to improve their nursing abilities. At present, there is a lack of research to comprehensively analyze flipped-learning nursing students’ theoretical test scores in RCTs. It is therefore necessary to conduct a meta-analysis to quantitatively analyze existing evidence in RCTs. In this review, we analyze flipped-learning nursing students’ scores, and aim to assess the efficacy and provide a deeper understanding of the FC in nursing education.

Methods

Search strategy

A systematic search was carried out in PubMed, Embase and Chinese database including the China National Knowledge Infrastructure, Wanfang Data, and VIP database. The search was from database establishment to the end of 3 January 2020. The search strategy was used as follows: (flipped OR inverted) AND (class OR learn) AND (nursing OR nurse teaching). Examples of search strategies are as follows: 1) The search strings were run in PubMed: (((flipped OR inverted)) AND (class OR learn)) AND (nursing[MeSH Terms] OR nurse education); 2) For Embase we used the strings: (flipped* OR inverted*) AND (class* OR learn*) AND (nursing* OR 'nurse education'); 3) In Chinese databases, the search terms were used as (flipped classroom OR inverted classroom) AND nursing.

Inclusion criteria

Abstracts of all articles were used for preliminary screening, and obtained full articles for further screening. The inclusion criteria that met requirements were as follows: 1) The study must be designed as a randomized controlled trial; 2) The subjects were nursing undergraduates, higher and middle vocational students in schools rather than in hospitals; 3) The course of the study was related to nursing. 4) The experimental group received flipped teaching, consisting self-learning by video before class and problem-solving activities in class; 5) The control group received traditional lecture-based learning (LBL) method which was typically used in general classroom; 6) Objective-based assessment, such as theoretical knowledge test, was applied to evaluate students’ learning outcomes and quantitative theory score was taken as an outcome; 7) Published articles were in Chinese. Articles would be excluded as long as met one of the criteria: 1) The study wasn’t reported as a randomized controlled trial; 2) The subjects were interns or nurses in hospitals; 3) The control group did not use traditional teaching; 4) It didn’t evaluate the theoretical scores as primary outcomes or had incomplete data; 5) The full text could not be obtained; 6) It was duplicate.

Two searchers (CXR and XJC) screened the articles respectively. All results after screening would be taken into account. All discrepancies were discussed and determined by a third party.

Data extraction and quality assessment

Relevant information in the included articles was extracted by two researchers independently. If the data is inconsistent, two researchers decided whether to include it after discussing and reaching a consensus. The information was extracted in a table which mainly included first author, publication year, educational background of subjects, disciplines or curricula, duration of intervention, sample size of the experimental group and control group, and test score index. The potential risk of bias was assessed by multiple researchers using the Cochrane Collaboration’s tool [23] independently.

Statistical analysis

In this study, Review Manager 5.3 (The Cochrane Collaboration, Copenhagen, Denmark) and STATA 14.0 software (STATA Corporation, College Station, TX, USA) were used to work with data. The standardized mean value (SMD) with 95% confidence interval (CI) was used as the effect measure to compare consecutive results from different scales to calculate each study. The point estimates associated with the summary results for each study were shown in forest plots. Heterogeneity of meta-analysis was evaluated by I2 statistic. And I2 statistic with values >50% indicated significant heterogeneity in this study. SMD was combined with 95% CI by using random effect model with heterogeneity or fixed effect model without heterogeneity. If heterogeneity existed, a sensitivity analysis was performed to investigate the impact of each study on the overall estimate. Publication bias was detected by the funnel plots using STATA 14.0 software.

Results

Search results

After systematically searching related databases, a total of 2,439 records were retrieved. After 1,284 records were removed because of duplication, 1,155 records remained. A total of 1,059 records were excluded after screening titles and abstracts. Moreover, 96 records were further screened according to the established inclusion criteria. After reading the full text, 41 records were excluded as non-randomized controlled trials and 23 because of missing or incomplete results. Consequently, only 32 records were included in this meta-analysis. The flow of articles, screened according to the exclusion and inclusion criteria is shown in Fig 1.

thumbnail
Fig 1. PRISMA diagram for the literature search.

CNKI, China National Knowledge Infrastructure.

https://doi.org/10.1371/journal.pone.0237926.g001

Study characteristics and study quality

In total, 32 articles [2455] were included. These were published between 2015 and 2019, with theoretical scores as comparable outcomes. One included three curricula on the same research object. These studies’ authors are all Chinese, and all articles have been published in Chinese journals. The studies involved 4,389 participants, of which 2,197 and 2,192 belonged to the FC and LBL groups, respectively. The sample size varied from 56 to 448 participants. The subjects in 23 studies [2444] were undergraduates, while those in 11 studies [4555] were higher and secondary vocational students. Nine studies [31, 33, 34, 38, 41, 42, 45, 50, 52] applied the FC mode to basic nursing teaching. Four [26, 31, 36, 53] among the included articles compared the two teaching methods in surgical nursing. Three studies [30, 37, 54] used the FC in obstetrics and gynecology nursing. Another three [31, 47, 55] concentrated on internal medicine nursing. The length of the teaching intervention varied from 24 class hours to two semesters. The knowledge examination scores were used to evaluate students’ theoretical knowledge. The baseline characteristics of the included studies are shown in Table 1. Funnel plots of the theoretical knowledge scores were used to assess publication bias, which was found to be present (Fig 2) The risk of bias in all included articles is shown in Fig 3. All included studies were RCTs, but only four illustrated their randomized sequence generation methods. None of the studies describe their allocation concealment and the blinding of outcome assessments. Only one reported applying the blinding process to participants and personnel. None of these studies were conducted in a way to indicate whether data were missing or excluded and whether there had been selective reporting.

thumbnail
Fig 2. Funnel plot analysis of theoretical knowledge scores for the potential publication bias in the meta-analysis.

https://doi.org/10.1371/journal.pone.0237926.g002

thumbnail
Table 1. The detailed baseline characteristics of all included studies.

https://doi.org/10.1371/journal.pone.0237926.t001

The effects of FC on theoretical knowledge scores

Theoretical knowledge scores were reported in all the included studies (2197 and 2192 in the FC and LBL groups, respectively). The mean of the theoretical knowledge scores in the FC was 1.33 compared to the traditional classroom (95%CI: 1.02–1.64; P < 0.001). A meta-analysis of a random model was carried out in this study. A forest plot of the nursing students' theoretical score is shown in Fig 4.

thumbnail
Fig 4. Forest plot of the nursing students' theoretical scores.

https://doi.org/10.1371/journal.pone.0237926.g004

The effects of the FC on the subgroup analyses

Based on the skill scores and student feedback, subgroup analyses were performed in this study. The skill scores were reported as a secondary outcome in 23 studies [2628, 3335, 37, 38, 41, 42, 4554] (1,549 and 1,539 in the FC and LBL groups, respectively). The mean of the skill scores in the FC was 1.58 compared to that in the traditional classroom (95% CI: 1.23–1.93; P < 0.001). A forest plot of the nursing students’ skill scores is shown in Fig 5. The results of students’ feedback, as it pertains to cooperative spirit and self-management, were represented in two respective forest plots respectively (Fig 6). In general, student feedback from the FC group was better than that from the LBL group.

thumbnail
Fig 5. Forest plot of the nursing students' skills scores.

https://doi.org/10.1371/journal.pone.0237926.g005

thumbnail
Fig 6. Forest plot of the nursing students’ feedback.

(A): cooperative spirit; (B): self-management.

https://doi.org/10.1371/journal.pone.0237926.g006

How the FC affected different characteristics

Publication year, educational background, and subject were each considered a subgroup. The scores for different characteristics were analyzed as subgroups, and the results are shown in Table 2. Analysis revealed that in some segments of the subgroups, the theoretical scores of the FC group were higher than that of the LBL group. Moreover, there was significant heterogeneity among the different subgroups (I2 > 50%), indicating that these three characteristics were irrelevant to heterogeneity. This meta-analysis was limited by low reliability because these subgroups were unable to reduce the level of heterogeneity.

thumbnail
Table 2. Subgroup analyses of the nursing outcomes stratified by the various contexts.

https://doi.org/10.1371/journal.pone.0237926.t002

Sensitivity analysis

Sensitivity analyses were conducted in this meta-analysis. To assess the statistical stability of the results, the impact of a single dataset on the combined results was shown after removing a single study. The results of the sensitivity analyses of the FC and LBL are shown in Fig 7. For the flipped classroom, there were no excluded studies. The results pertaining to the theoretical scores were statistically stable (Estimate = 1.04, 95% CI: 0.98–1.11, P < 0.001).

thumbnail
Fig 7. Sensitivity analysis of the nursing students' skills scores.

https://doi.org/10.1371/journal.pone.0237926.g007

Discussion

This 34-study meta-analysis of summarized Chinese nursing students’ relevant outcomes, including theoretical test and skill scores. The results of this study indicated that the FC mode produced a significantly higher theoretical scores than the LBL mode, with a mean theoretical knowledge score of 1.33 for the former. Moreover, the mean of the flipped classroom skill scores was 1.58 times higher than that of the traditional classroom. These results are consistent with previous results in pharmaceutical [56], dental [18], and ophthalmology [57] education. Students who are new to the flipped classroom require a certain adaptation period during which they can familiarize with and prepare to embrace this teaching method [58]. Furthermore, the results of this review showed that effects of the FC on undergraduate and higher vocational students were almost the same and that both which were better than LBL teaching. It meant that using the FC was effective in different educational backgrounds. There are some explanations for the more active student learning and the better effect of the FC over the LBL. One explanation is that the FC allows students to master content at their own pace while browsing online materials. Since students can only focus on a lecture for about 10 minutes before their attention is reduced, using online materials can give them the flexibility to rest as needed [59]. Another explanation, classroom activities are designed to allow students to focus on applying the content to better understand the materials being taught [56]. These activities can be completed individually or in peer teams, thus shifting the teacher’s role from source of knowledge to promoter of student learning [56]. Moreover, in the FC, class time is full use for students to apply, analyze, and evaluate the knowledge [60]. As such, the FC has been proven to effectively improve students’ motivation, satisfaction, academic performance, and classroom engagement [6163].

Some scholars have recognized the traditional classroom’s limitations; hence, it is very important to change or improve LBL teaching, given that faculty members teaching experiences and the teaching methods that they choose influence students’ learning feedback [58]. Inadequate teaching leads to low efficiency among teachers, which among teachers in students’ inattention during class. By this measure, many scholars have attempted to evaluate the new teaching mode ‘s effect on Chinese students. The FC is one of several feasible teaching modes. Based on various massive open online course (MOOC) platforms, the FC mode can be applied to numerous curricula, with students choosing an appropriate MOOC video for self-learning toward the overarching goal of improving their learning efficiency. Furthermore, pre work, such as reading and writing, is essential [64]. In this meta-analysis, the FC improved students’ theoretical performance, but its effect was not as beneficial with respect to skill performance Therefore, instructional designers should make full use of MOOCs to further improve students’ theoretical performance.

As one of the most populous countries in the world, with unmet needs of nurse number and various quality of nursing education, China needs to equip itself to deal with a large complex healthcare system [65]. Besides, in China, the study load and duration of nursing programs are high. Furthermore, as an undergraduate, every nursing student has to complete ten semesters over 5 years to finish complete various courses, including surgical, critical care, and pediatric nursing, and more. Moreover, Lee et al. [66] illustrated that nursing students need to study not only nursing but also other medical courses such as medical physics, microbiology, parasitology, and preventive medicine. In addition, nursing students need participate in clinical practice in their final academic year [66]. However, Limited content can be learned in the restricted time, and it’s very difficult for students to master a large volume of professional knowledge in such a short time. It is therefore crucial to explore an efficient teaching mode. This meta-analysis suggests that the flipped teaching mode significantly increases students’ theoretical scores, comparing favorably with the LBL mode. In future, the FC mode is worth using in nursing education.

Apart from the FC mode, there are other novel teaching modes, such as problem-based learning (PBL), case-based learning (CBL), and team-based learning (TBL). PBL mode concentrates on the process of students discovering and solving problems [67]. In CBL mode, students focus on the key point and solve real-world cases with facilitators’ guidance [68]. TBL focuses on solving problems through group cooperation and discussion [69]. A variety of teaching models have been used in various areas of professional teaching. For instance, Hu [70] applied the mixed FC and PBL teaching mode Similarly, Elangovan et al. [71] integrated PBL and CBL in dental education. Moreover, a mixed mode that combined the FC with team-, case-, lecture-, and evidence-based learning in ophthalmology teaching yielded only improved independent learning among students, but also an awareness of cooperation and competition [72].

There are some strengths in this meta-analysis. Theoretical score is considered as the first outcome and skill score as second outcome to compare the effects of the FC and LBL in this review. Besides, The FC mode in nursing education is popular and has been applied to ensure its effect. In this meta-analysis, all studies were RCTs and had different educational backgrounds, which were examined to judge whether different educational backgrounds would affect the effect of the new teaching mode.

This meta-analysis had several limitations. First, with regard to the geographical generalizability of the results, only Chinese articles met the screening criteria and were included in this study; thus, this study is only able to evaluate the FC’s implementation effect in China or Asia, as it would be difficult to a make such an assessment in other regions. Second, the included studies had significant heterogeneity, which may have reduced the reliability of the analysis. Furthermore, study quality was uneven because of different teaching resources, levels and evaluation standards in different schools. Third, the funnel plot for theoretical scores revealed asymmetry, indicating a publication bias.

Conclusion

The results of this meta-analysis suggest that compared to the LBL teaching method, FC mode significantly improved Chinese nursing students’ theoretical scores. However, high heterogeneity and publication bias were present, which may have influenced the reliability of the FC effect in the context of nursing teaching. High-quality, multi-regional studies should be feature in future analysis.

Supporting information

Acknowledgments

The authors of this meta-analysis acknowledge all reviewers for their helpful contributions in this study.

References

  1. 1. Burnham KD, Mascenik J. Comparison of student performance and perceptions of a traditional lecture course versus an inverted classroom format for clinical microbiology. J Chiropr Educ. 2018;32(2):90–7. https://doi.org/10.7899/JCE-17-21 pmid:29873245
  2. 2. Zhou H, Liu M, Zeng J, Zhu J. Selection of nursing teaching strategies in mainland China: A questionnaire survey. Nurse Educ Today. 2016;39:147–51. https://doi.org/10.1016/j.nedt.2015.12.022 pmid:27006047
  3. 3. Mazur , Physics EJCi. Can We Teach Computers to Teach? Computers in Physics. 1991;5(1):31.
  4. 4. Lage MJ, Platt GJ, Treglia M. Inverting the Classroom: A Gateway to Creating an Inclusive Learning Environment. The Journal of Economic Education. 2000;31(1):30–43.
  5. 5. Baker WJ. The "Classroom Flip": Using Web Course Management Tools to Become the Guide by the Side". the 11th International Conference on College Teaching and Learning. 2000:9–17.
  6. 6. Bergmann J, Sams A. Flip Your Classroom: Reach Every Student in Every Class Every Day. 1st Ed Eugene, OR: International Society for Technology in Education 2012:100.
  7. 7. Bates JE, Almekdash H, Gilchrest-Dunnam MJ. The flipped classroom: A brief, brief history. In: Santos Green L, Banas J, Perkins R (Editors). The Flipped College Classroom: Conceptualized and Re-Conceptualized. 1st Ed Cham, The Switherland: Springer International Publishing. 2017:3–10.
  8. 8. Betihavas V, Bridgman H, Kornhaber R, Cross M. The evidence for ‘flipping out’: A systematic review of the flipped classroom in nursing education. Nurse Educ Today. 2016;38:15–21. https://doi.org/10.1016/j.nedt.2015.12.010 pmid:26804940
  9. 9. Persky AM, McLaughlin JE. The Flipped Classroom—From Theory to Practice in Health Professional Education. Am J Pharm Educ. 2017;81(6):118. https://doi.org/10.5688/ajpe816118 pmid:28970619
  10. 10. Lambert C. Twilight of the lecture. Harvard Magazine: Harvard Magazine, Inc. 2012(23):7.
  11. 11. Popil I. Promotion of critical thinking by using case studies as teaching method. Nurse Educ Today. 2011;31(2):204–7. https://doi.org/10.1016/j.nedt.2010.06.002 pmid:20655632
  12. 12. Pu D, Ni J, Song D, Zhang W, Wang Y, Wu L, et al. Influence of critical thinking disposition on the learning efficiency of problem-based learning in undergraduate medical students. BMC Med Educ. 2019;19(1):1. https://doi.org/10.1186/s12909-018-1418-5 pmid:30606170
  13. 13. Bressington DT, Wong WK, Lam KKC, Chien WT. Concept mapping to promote meaningful learning, help relate theory to practice and improve learning self-efficacy in Asian mental health nursing students: A mixed-methods pilot study. Nurse Educ Today. 2018;60:47–55. https://doi.org/10.1016/j.nedt.2017.09.019 pmid:29028566
  14. 14. Li YS, Chen PS, Tsai SJ. A comparison of the learning styles among different nursing programs in Taiwan: Implications for nursing education. Nurse Educ Today. 2008;28(1):70–6. https://doi.org/10.1016/j.nedt.2007.02.007 pmid:17391813
  15. 15. Tsai HM, Cheng CY, Chang CH, Liou SR. Preparing the future nurses for nursing research: A creative teaching strategy for RN-to-BSN students. International Journal of Nursing Practice. 2014;20(1):25–31. https://doi.org/10.1111/ijn.12119 pmid:24580972
  16. 16. Hew KF, Lo CK. Flipped classroom improves student learning in health professions education: a meta-analysis. BMC Med Educ. 2018;18(1):38. https://doi.org/10.1186/s12909-018-1144-z pmid:29544495
  17. 17. Morgan H, McLean K, Chapman C, Fitzgerald J, Yousuf A, Hammoud M. The flipped classroom for medical students. Clin Teach. 2015;12(3):155–60. https://doi.org/10.1111/tct.12328 pmid:26009948
  18. 18. Crothers AJ, Bagg J, McKerlie R. The Flipped Classroom for pre-clinical dental skills teaching—a reflective commentary. Br Dent J. 2017;222(9):709–13. https://doi.org/10.1038/sj.bdj.2017.409 pmid:28496219
  19. 19. Munson A, Pierce R. Flipping Content to Improve Student Examination Performance in a Pharmacogenomics Course. Am J Pharm Educ. 2015;79(7):103. https://doi.org/10.5688/ajpe797103 pmid:27168616
  20. 20. Gillette C, Rudolph M, Kimble C, Rockich-Winston N, Smith L, Broedel-Zaugg K. A Meta-Analysis of Outcomes Comparing Flipped Classroom and Lecture. Am J Pharm Educ. 2018;82(5):6898. https://doi.org/10.5688/ajpe6898 pmid:30013248
  21. 21. Chen KS, Monrouxe L, Lu YH, Jenq CC, Chang YJ, Chang YC, et al. Academic outcomes of flipped classroom learning: a meta-analysis. Med Educ. 2018;52(9):910–24. https://doi.org/10.1111/medu.13616 pmid:29943399
  22. 22. Xu P, Chen Y, Nie W, Wang Y, Song T, Li H, et al. The effectiveness of a flipped classroom on the development of Chinese nursing students' skill competence: A systematic review and meta-analysis. Nurse Educ Today. 2019;80:67–77. https://doi.org/10.1016/j.nedt.2019.06.005 pmid:31279251
  23. 23. Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ (Clinical research ed). 2011;343:d5928. https://doi.org/10.1136/bmj.d5928 pmid:22008217
  24. 24. Wan J, Ruan L, Wang T, Cheng CY, Tang J, Chen JL, et al. Practice and Exploration of Flipped Classroom in Pathology and Pathophysiology. Education Teaching Forum. 2019;(36):137–8.
  25. 25. Shang LY, Wu F, Zhang L. Application of flipped classroom in Critical Care Nursing teaching. Int J Nur. 2019;38(18):2890–3. https://doi.org/10.3760/cma.j.issn.1673-4351.2019.18.004
  26. 26. Wang XL, Liu HY. Application of MOSO Teach and Flipped Class Model to Surgical Nursing Practice Teaching. Journal of Taizhou University. 2019;41(3):89–92. https://doi.org/10.13853/j.cnki.issn.1672-3708.2019.03.016
  27. 27. Bai BP, Liu JX. Application of Flipped Classroom based on micro-lecture in practical teaching of health assessment for nursing undergraduates. Chin J Med Edu Res. 2019;18(5):515–8. https://doi.org/10.3760/cma.j.issn.2095-1485.2019.05.021.
  28. 28. Wang XH, Wan XJ, Ding DY, ZHENG Y. Application of the flipped class in teaching of clinical anatomy for nursing students. Nursing of Integrated Traditional Chinese and Western Medicine. 2019;5(6):157–9. https://doi.org/10.11997/nitcwm.201906049
  29. 29. Tan XL, Wan J, Li Q. Application of flipped classroom in community nursing teaching. Health Vocational Education. 2019;37(11):96–9.
  30. 30. Chen AX, Qin ZP. Effect of mixed teaching mode for nursing courses in obstetrics and gynecology. Chinese Nursing Research. 2019;33(6):1023–8. https://doi.org/10.12102/j.issn.1009-6493.2019.06.025
  31. 31. Tao WW, Chen ZN, Liu Y, Jiang TT. Effect of small private online course self-directed learning ability of students. Journal of Nursing Science. 2017;32(15):66–9. https://doi.org/10.3870/j.issn.1001-4152.2017.15.066
  32. 32. Yin SY, Li PF, Liu WD. Research on the application of flipped classroom in preventive medicine teaching. China Higher Medical Education. 2017;(11):126–7. https://doi.org/10.3969/j.issn.1002-1701.2017.11.064
  33. 33. Zhang HM, Wu XW, Shao ZZ. Application of micro learning resource–based flipped class model in the teaching of basic nursing. Nursing Practice and Research. 2017;14(2):127–9. https://doi.org/10.3969/j.issn.1672-9676.2017.02.056
  34. 34. Jin RH, Tian ZJ, Luo D, Liu CF. Application of flipped classroom teaching mode in experimental teaching of basic nursing. China Higher Medical Education. 2017;(2):61–2. https://doi.org/10.3969/j.issn.1002-1701.2017.02.031
  35. 35. Bian F. Effect evaluation of flipped classroom teaching mode based on micro class in clinical nursing teaching. Psychological Doctor. 2017;23(20):316–7.
  36. 36. Liu J, Wang YL. Application of flipped classroom teaching mode based on micro course in nursing teaching of Urology. Contemporary Education Research and Teaching Practice. 2017;(8):917–8. https://doi.org/10.3969/j.issn.2095-6711.2017.08.761
  37. 37. Guo XZ. Research on the application and innovation of flipped classroom based on virtual simulation technology in the teaching of Obstetrics and Gynecology Nursing. Course Education Research. 2017;(11):209. https://doi.org/10.3969/j.issn.2095-3089.2017.11.194
  38. 38. Ning J, Li QW. Application of flipped classroom model based on micro course in basic nursing teaching. Journal of Shenyang Medical College. 2017;19(5):458–60. https://doi.org/10.16753/j.cnki.1008-2344.2017.05.023
  39. 39. Zhang Y, Chen CS. The application of flipped classroom combined with case-based teaching mode in the medical statistics course for undergraduate nursing students. Journal of Nursing Administration. 2017;17(7):488–9,92. https://doi.org/10.3969/j.issn.1671-315X.2017.07.011
  40. 40. Liu F. Application of flipped classroom teaching mode based on micro lecture in teaching of “Introduction of Nursing Science”. Chinese Nursing Research. 2016;30(27):3406–7,8. https://doi.org/10.3969/j.issn.1009-6493.2016.27.029
  41. 41. Yuan FJ. Application and design of flipped classroom in the teaching of basic nursing. Journal of Today Health. 2016;15(7):393. https://doi.org/10.3969/j.issn.1671-5160.2016.07.375
  42. 42. Zhao H, Yao PB, Liu YH, Wu MC. Application of flipped classroom teaching mode based on micro course in basic nursing teaching. Journal of SNAKE. 2016;28(1):108–9. https://doi.org/10.3969/j.issn.1001-5639.2016.01.057
  43. 43. Wang QH, Liang L, Luan SR, Xu DH. Evaluation and effect of flipped classroom teaching model on nursing research course teaching. BMU Journal. 2016;39(6):460–3. https://doi.org/10.3969/j.issn.1001-9510.2016.06.019
  44. 44. Tian ZJ, Jin RH, Liu CF. Application of flipped instruction in the course of Geriatric Nursing. Chin J Nurs Educ. 2015;12(5):333–5. https://doi.org/10.3761/j.issn.1672-9234.2015.05.003
  45. 45. Yan LF. Application of flipped classroom teaching mode based on micro course in basic nursing technology teaching of Higher Vocational Education. Health Vocational Education. 2019;37(4):106–7.
  46. 46. Ai YS, Ding HQ, Liu JX. Application of flipped classroom based on curriculum resource platform in emergency nursing teaching. Nursing Research of China. 2017;31(18):2256–8. https://doi.org/10.3969/j.issn.1009-6493.2017.18.027
  47. 47. Chen L, Hu SZ, Cao XP, Yuan AD, Luo D. Application of flipped classroom model based on micro course in the teaching of internal medicine nursing in Higher Vocational Education. Nursing and Rehabilitation Journal. 2017;16(4):377–9. https://doi.org/10.3969/j.issn.1671-9875.2017.04.028
  48. 48. Jing J, Li L. The implementation and thinking of flipped classroom in the teaching of symptom assessment of health assessment technology. Health Vocational Education. 2017;35(8):143–4.
  49. 49. Zhou M, CHEN JY. Modification of the transitional process between higher and middle vocational education for the teaching of pediatric nursing. Journal of Nursing Science. 2019;34(21):53–5. https://doi.org/10.3870/j.issn.1001-4152.2019.21.053
  50. 50. Zhou HY. The effect of flipped classroom teaching in basic nursing. New Education Era. 2018;(47):168. https://doi.org/10.3969/j.issn.2095-4743.2018.47.166
  51. 51. Zhao GD, Yue JJ. Application of flipped classroom in nursing teaching for the aged. Yiyao Qianyan. 2018;8(34):398. https://doi.org/10.3969/j.issn.2095-1752.2018.34.343
  52. 52. Kang D, Li M, Ding Y. Study on the application of micro course teaching method in the course of nursing basic. Chinese and Foreign Communication. 2018;(42):36–7.
  53. 53. Wang B, Yang M, Jin W, Zhu ZW, Luo XL, Zha C. The application of mixed teaching mode based on micro course in surgical nursing teaching of five-year specialty. Joumal of MuDanJiang Medical University. 2017;38(2):166–7,73.
  54. 54. Guo YJ, Zhang S, Li N. Implementation and effect evaluation of nursing flipped classroom in obstetrics and Gynecology. Health Vocational Education. 2017;35(12):130–1.
  55. 55. Pan CY. Research on the application of flipped classroom in the teaching of internal medicine nursing. Health Vocational Education. 2017;35(20):111–2.
  56. 56. Anderson HG Jr., Frazier L, Anderson SL, Stanton R, Gillette C, Broedel-Zaugg K, et al. Comparison of Pharmaceutical Calculations Learning Outcomes Achieved Within a Traditional Lecture or Flipped Classroom Andragogy. Am J Pharm Educ. 2017;81(4):70. https://doi.org/10.5688/ajpe81470 pmid:28630511
  57. 57. Tang F, Chen C, Zhu Y, Zuo C, Zhong Y, Wang N, et al. Comparison between flipped classroom and lecture-based classroom in ophthalmology clerkship. Med Educ Online. 2017;22(1):1395679. https://doi.org/10.1080/10872981.2017.1395679 pmid:29096591
  58. 58. Naber J, Best D. Is a flipped Classroom an effective Educational Method to meet Nursing Students Learning needs? Madridge Journal of Nursing. 2016;1:7–10.
  59. 59. Prober CG, Heath C. Lecture Halls without Lectures—A Proposal for Medical Education. N Engl J Med. 2012;366(18):1657–9. https://doi.org/10.1056/NEJMp1202451 pmid:22551125
  60. 60. French H, Arias-Shah A, Gisondo C, Gray MM. Perspectives: The Flipped Classroom in Graduate Medical Education. NeoReviews. 2020;21(3):e150–e6. https://doi.org/10.1542/neo.21-3-e150 pmid:32123119
  61. 61. McLaughlin JE, Roth MT, Glatt DM, Gharkholonarehe N, Davidson CA, Griffin LM, et al. The flipped classroom: a course redesign to foster learning and engagement in a health professions school. Acad Med. 2014;89(2):236–43. https://doi.org/10.1097/ACM.0000000000000086 pmid:24270916
  62. 62. Evans KH, Thompson AC, O'Brien C, Bryant M, Basaviah P, Prober C, et al. An Innovative Blended Preclinical Curriculum in Clinical Epidemiology and Biostatistics: Impact on Student Satisfaction and Performance. Acad Med. 2016;91(5):696–700. https://doi.org/10.1097/ACM.0000000000001085 pmid:26796089
  63. 63. Presti CR. The Flipped Learning Approach in Nursing Education: A Literature Review. J Nurs Educ. 2016;55(5):252–7. https://doi.org/10.3928/01484834-20160414-03 pmid:27115451
  64. 64. Han E, Klein KC. Pre-Class Learning Methods for Flipped Classrooms. Am J Pharm Educ. 2019;83(1):6922. https://doi.org/10.5688/ajpe6922 pmid:30894772
  65. 65. H J, M C, L Z, D Z, S B, Z J, et al. Transformation of the education of health professionals in China: progress and challenges. Lancet (London, England). 2014;384(9945):819–27. https://doi.org/10.1016/S0140-6736(14)61307-6 pmid:25176552
  66. 66. Lee HY, Kim Y, Kang H, Fan X, Ling M, Yuan Q, et al. An international comparison of Korean and Chinese nursing students with nursing curricula and educational outcomes. Nurse Education Today. 2011;31(5):450–5. https://doi.org/10.1016/j.nedt.2010.09.002 pmid:20932610
  67. 67. Heale J, Davis D, Norman G, Woodward C, Neufeld V, Dodd P. A randomized controlled trial assessing the impact of problem-based versus didactic teaching methods in CME. Res Med Educ. 1988;27:72–7. pmid:3218878
  68. 68. Srinivasan M, Wilkes M, Stevenson F, Nguyen T, Slavin S. Comparing Problem-Based Learning with Case-Based Learning: Effects of a Major Curricular Shift at Two Institutions. Acad Med. 2007;82(1). https://doi.org/10.1097/01.ACM.0000249963.93776.aa pmid:17198294
  69. 69. Haidet P, Levine RE, Parmelee DX, Crow S, Kennedy F, Kelly PA, et al. Perspective: Guidelines for Reporting Team-Based Learning Activities in the Medical and Health Sciences Education Literature. Acad Med. 2012;87(3). https://doi.org/10.1097/ACM.0b013e318244759e pmid:22373620
  70. 70. Hu XL, Zhang HY, Song Y, Wu CC, Yang QQ, Shi ZM, et al. Implementation of flipped classroom combined with problem-based learning: an approach to promote learning about hyperthyroidism in the endocrinology internship. BMC Med Educ. 2019;19(1):290. https://doi.org/10.1186/s12909-019-1714-8 pmid:31362729
  71. 71. Elangovan S, Venugopalan SR, Srinivasan S, Karimbux NY, Weistroffer P, Allareddy V. Integration of Basic-Clinical Sciences, PBL, CBL, and IPE in U.S. Dental Schools' Curricula and a Proposed Integrated Curriculum Model for the Future. J Dent Educ. 2016;80(3):281–90. pmid:26933103
  72. 72. Ding C, Li S, Chen B. Effectiveness of flipped classroom combined with team-, case-, lecture- and evidence-based learning on ophthalmology teaching for eight-year program students. BMC Med Educ. 2019;19(1):419. https://doi.org/10.1186/s12909-019-1861-y pmid:31727043