https://orcid.org/0000-0003-1944-144X
Figures
Abstract
Background
PBL approach has been widely used in many Chinese universities over the past decade. However, the effects of PBL approach on medical psychology education in China are inconsistent. The purpose of this study was to ascertain whether the PBL approach was superior to the lecture-based teaching method in the context of the medical psychology curriculum in China.
Methods
A systematic review and meta-analysis was performed to confirm the effectiveness of PBL in Chinese medical psychology. Corresponding databases were searched for available studies, where data were extracted to calculated Hedges’ g and its 95% confidence interval in total and subgroup analyses. Subgroup analyses were also carried out.
Results
Nine studies with 551 cases and 496 controls were identified. The total examination scores of students in the PBL approach group were significantly higher compared with students in the traditional lecture-based teaching group under the random effect model (Hedges’ g = 1.510, 95%CI 0.792–2.227, p<0.001). Subgroup analyses based on major and school system exhibited similar results.
Citation: Gao J, Yang L, Zhao J, Wang L, Zou J, Wang C, et al. (2020) Comparison of problem-based learning and traditional teaching methods in medical psychology education in China: A systematic review and meta-analysis. PLoS ONE 15(12): e0243897. https://doi.org/10.1371/journal.pone.0243897
Editor: Mohammed Saqr, University of Eastern Finland, SWEDEN
Received: March 22, 2020; Accepted: December 1, 2020; Published: December 14, 2020
Copyright: © 2020 Gao et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: Our study was supported by the Teaching Foundation of School of Psychology, Army Medical University, China under Grant (XJ2017206).
Competing interests: The authors have declared that no competing interests exist.
Introduction
Problem-based learning (PBL) is an educational approach, originally introduced by Barrows and Tamblyn in the 1960s [1, 2]. It is characterized by the application of problems for knowledge acquisition and practical skills [3, 4]. The PBL approach is student-centered compared with the traditional teaching model. Students are encouraged to participate in the discussion of prepared problems to improve themselves in the process [5, 6]. The PBL approach aims to promote the integration of learned knowledge, rather than simply implanting knowledge and skills [7]. Therefore, this teaching model has been highly praised in medical education courses in the past two decades, and medical psychology has been studied extensively.
Medical psychology is an emerging discipline in medical universities worldwide and plays a bridge role between basic and clinical courses in medical education [8]. With the transformation of the medical model from a single biomedical model to a multidisciplinary bio-psycho-social model, increasing attention has been paid to medical psychology. Medical students are said to acquire basic psychological knowledge and to develop improved skills in dealing with the doctor-patient relationship through their learning in this course. However, medical psychology teaching faces some unique difficulties compared with other basic and medicine courses. For instance, there is no specific specimen or model for intuitive display teaching. Medical students must rely only on their wisdom and imagination to understand corresponding problems. At present, Chinese medical colleges universally lag behind Western colleges in their medical psychology teaching content, style, and methodology [9]. Some researchers tried to introduce the PBL approach into medical psychology coursework in Chinese medical colleges and universities to promote teaching reform and accelerate improvement in teaching outcomes [10]. However, the results were controversial. A previous study suggested that the PBL approach did not significantly affect students’ final exam scores of medical psychology [11]. Therefore, we conducted the systematic review and meta-analysis to verify whether the PBL approach has a positive effect on medical psychology education in China.
Materials and methods
Publication search
We searched all records in the PubMed, Web of Knowledge, Embase, China National Knowledge Infrastructure (CNKI), and Wan-fang databases with no language restrictions up to March 13, 2020. The combination of terms was as follows: ((problem-based learning) OR PBL) AND (medical psychology). The references of retrieved articles were also checked to avoid missing additional studies.
Inclusion and exclusion criteria
The inclusion criteria were as follows: (1) Research subjects were students in Chinese colleges or universities; (2) Studies evaluated the effect of the PBL approach on medical psychology education; (3) Students’ final exam scores for medical psychology were presented as a mean with a corresponding standard deviation or sample size and p value in the full text. The exclusion criteria were as follows: (1) Studies with insufficient data; (2) Reviews, comments, or abstracts. For studies with overlapping data, only the one with the largest sample size was included. When an article reported results on different groups, we treated them as separate studies.
Data extraction
Two authors (JG and LY) independently identified records and screened corresponding titles, abstracts and full texts. Data were extracted into a predesigned Excel sheet by two reviewers (JG and LY). The extracted data were collected from the included studies as follows: the first author’s name, publication year, source and major of students, school system, proportion of PBL teaching time, educational approach, outcome measures, duration of course, sample size, mean and standard deviation (SD) of medical psychology scores in both groups, or p value from the studies. Discrepancies were settled through discussion with a third person (JZ). Attempts were also made to contact authors for missing data.
Quality assessment
The methodological quality of studies was evaluated by two independent reviewers (JG and LY) according to the Newcastle–Ottawa Scale (NOS), which contains three dimensions: selection, comparability, and exposure or outcome. Eight items were included to assess the quality of studies. Disagreements were resolved by discussion with a third author (JZ).
Statistical analysis
Effect sizes (standardized mean differences, SMDs) were calculated according to sample size and mean (SD) values or sample size and P values. Then, we converted the SMD to Hedges’ g, which serves a more unbiased role. Data were then pooled together using Hedges’ g as appropriate. A fixed effect model or random effect model was chosen depending on heterogeneity analysis results, which were assessed by the I2 value and Chi-square based Q-test. When the effect was evaluated to be heterogeneous, a random effect model was selected; otherwise, a fixed effect model was used. In addition to the overall analysis, subgroup analyses were also conducted according to the major and school system of students. A Galbraith plot was drawn to explore the source of between-study heterogeneity. Sensitivity analysis was performed by removing each study sequentially. Publication bias was assessed by the Begg’s test. All statistical tests were performed using Comprehensive Meta-analysis 2.0 software (Biostat Inc) and STATA 12.0 (STATA Corporation).
Results
Study characteristics
There were 887 records identified in the initial search up to March 13, 2020. Sixty-seven duplicate records were found among these results. Scanning of titles and abstracts help to remove 800 records. Further, several studies were excluded by full-text reading because of insufficient data (2 articles), overlapping data (2 articles) and review (8 articles). We treated the record by Dang et al. [12], which reported results on different ethnicities, as two separate studies. Ultimately, eight records (nine studies) with 551 cases and 496 controls were included in our meta-analysis [11–18] (Flow diagram in Fig 1).
Of the nine studies, the majority of participants were in clinical medicine. The duration of a medical psychology course was generally one semester. The sample sizes ranged from 11 to 114 students in PBL groups and control groups. Most studies not only included the final examination results of both groups but also carried out a corresponding questionnaire, whose specific items varied in the included studies. Generally, students were satisfied with the PBL approach. Nearly half of the studies were conducted with medical students in the five-year system. The results of methodological quality assessment were shown were shown in Table 1.
Quantitative data synthesis
In our meta-analysis, the combined results of the overall comparison revealed a significant difference in the total examination scores of students in favor of the PBL approach, compared with traditional teaching under the random effect model (Hedges’ g = 1.510, 95%CI 0.792–2.227, p<0.001) (Fig 2) (Table 2).
Investigation of heterogeneity
A high degree of heterogeneity across studies was detected in overall comparisons (P<0.001), which was why we selected the random effect model. Next, we attempted to identify the source of heterogeneity. Subgroup analyses were carried out according to the major and school system of students. The total examination scores of clinical medicine students were significantly higher in the PBL group than in the control group (Hedges’ g = 2.086, 95% CI 0.997–3.174, p<0.001) (Fig 3). Moreover, the total examination scores of five-year system students were still significantly higher in the PBL group than in the control group (Hedges’ g = 1.571, 95% CI 0.751–2.391, p<0.001) (Fig 4). However, heterogeneity was not obviously decreased. In addition, a Galbraith plot was drawn to identify some studies that were obviously different from others, which suggested that studies conducted by Zhang 2011, Long et al. 2012, Huang 2014, Wang et al. 2019, and Wang et al. 2017 [11, 15–18] may affect the results of heterogeneity analysis (Fig 5). After removing them, no obvious heterogeneity was found across studies (I2 = 26.807%, p = 0.251). A forest plot indicated that the total examination scores of students in the PBL group were still significantly higher than those of controls (Hedges’ g = 0.592, 95% CI 0.415–0.770, p<0.001) (Table 2) (Fig 6).
Sensitivity analysis
Sensitivity analysis was conducted to access the influence of each individual study on pooled Hedges’ g. The results showed that no single study could affect the statistically significant difference in total examination scores between students in PBL groups and controls (Fig 7).
Publication bias
The shape of the funnel plot was slightly asymmetrical (Fig 8), the result of Begg’s test indicated the p value is around the critical value (p = 0.048). To investigate whether publication bias could affect our results, publication bias was also evaluated in subgroup analyses. No publication bias was found in subgroups, and the association changed little.
Discussion
Although many efforts have been made in medical education reform, it is still critical that college educators design, develop and implement a series of innovative medicine curriculums, which could guide undergraduate medical students to strive to become doctors [19]. As a bridge course between basic medicine and clinical medicine, medical psychology provides medical students with psychological knowledge and helps them establish the bio-psycho-social concept of illness for future clinical work [20]. In recent years, educators have tried to introduce the PBL approach into Chinese medical psychology classes. Compared with the traditional teaching method, PBL has several advantages in the developed world. Students were encouraged to take responsibility for their own learning, which was an essential skill in their professional development. The PBL approach changed the traditional relationships between teaching and learning. Students elaborated their subjective initiative rather than simply listening and taking notes [21, 22]. Considering the students’ cultural background and social development, some previous studies showed that it was still controversial whether the PBL approach was superior to traditional teaching methods for use in medical psychology classes at Chinese colleges and universities. Therefore, we performed the present meta-analysis to determine the effect of the PBL approach on students’ total scores in a final medical psychology examination in China.
To the best of our knowledge, this is the first meta-analysis to investigate whether the PBL approach is superior to the traditional lecture-based teaching method in Chinese medical psychology course. The strength of this study was that our meta-analysis included more studies with larger sample sizes and showed that the total scores of the PBL group were significantly higher than those of the control group. These results were in line with many previous studies [23–25]. The results of a sensitivity analysis revealed that the correlation was not affected by a particular study, or that it even changed in direction. Moreover, we also noted that high levels of heterogeneity across studies were found in the meta-analysis. Some factors that may cause heterogeneity should be pointed out. First, although these students were all from China, some basic characteristics, such as age, gender, were missing. Second, the teachers and teaching emphasis may be inconsistent in different medical colleges. Third, the proportions of PBL teaching time were different in the included studies. Fourth, the duration of medical psychology course was imprecise. All of these factors may lead to significant heterogeneity in our study. However, for the limited information of the included studies, we could only explore the sources of heterogeneity as much as possible. Subgroup analyses based on school system and major failed to decrease heterogeneity. A Galbraith plot helped us identify five studies that may have been the source of heterogeneity. After removing them, heterogeneity obviously decreased and the correlation did not change. In addition, the results showed that publication bias did not affect our outcomes despite the p value around the critical value. All of these illustrated the credibility of our results. Therefore, we verified that the total examination scores of the PBL group were significantly higher than those of the control group in China. In fact, many medical students and teachers could not accept this teaching mode well, which may be related to the traditional Chinese culture, and most courses were still taught in the traditional way. However, the traditional teaching mode impacted by information technology faced new challenges. Based on such a reality, we suggested trying PBL approach in more courses, so as to verify the results.
Some limitations of our study should be pointed out. First, the sample size was relatively small both in the randomized comparison study and in the meta-analysis, which may potentially have some influence on the results. The homogeneity of the included samples could not be assessed for the limited information, which may be the cause of heterogeneity. Second, the duration of the medical psychology course was relatively short, generally one semester. We could not evaluate the efficacy of PBL in Chinese medical psychology education over a longer period of time. Third, the test to assess the effect of the PBL approach was only performed at the end of the semester, which prevents us from performing delayed assessment for the limited information. Fourth, all of the included studies were performed in China. Whether the conclusion was applicable to other countries and regions was still investigated further. Finally, we did not take cultural factors into account for the limited information. Further studies may focus on this.
Conclusions
In conclusion, the present study suggested that the PBL approach in medical psychology education in China appeared to be more effective than the traditional teaching method in improving students’ knowledge. Large and well-designed studies are warranted to further confirm whether the PBL approach is superior to different teaching methods in China.
Acknowledgments
The authors wish to acknowledge Dr. Zhiru Zhu and Dr. Xie He for their help in this study.
References
- 1. Lim WK. Dysfunctional problem-based learning curricula: resolving the problem. BMC medical education. 2012;12:89. pmid:23009729; PubMed Central PMCID: PMC3532094.
- 2. Kwan CY. A thorny path: the developmental course of problem-based learning for health sciences education in Asia. Advances in health sciences education: theory and practice. 2019. pmid:31641943.
- 3. Alrahlah A. How effective the problem-based learning (PBL) in dental education. A critical review. The Saudi dental journal. 2016;28(4):155–61. pmid:27872545; PubMed Central PMCID: PMC5110467.
- 4. Walton HJ, Matthews MB. Essentials of problem-based learning. Medical education. 1989;23(6):542–58. pmid:2593886.
- 5. Holen A, Manandhar K, Pant DS, Karmacharya BM, Olson LM, Koju R, et al. Medical students' preferences for problem-based learning in relation to culture and personality: a multicultural study. International journal of medical education. 2015;6:84–92. pmid:26188962; PubMed Central PMCID: PMC4515359.
- 6. Tsai TI, Lee SD, Yu WR. Impact of a Problem-Based Learning (PBL) Health Literacy Program on Immigrant Women's Health Literacy, Health Empowerment, Navigation Efficacy, and Health Care Utilization. Journal of health communication. 2018;23(4):340–9. pmid:29543568.
- 7. Bodagh N, Bloomfield J, Birch P, Ricketts W. Problem-based learning: a review. British journal of hospital medicine. 2017;78(11):C167–C70. pmid:29111794.
- 8. Soons P, Denollet J. Medical psychology services in dutch general hospitals: state of the art developments and recommendations for the future. Journal of clinical psychology in medical settings. 2009;16(2):161–8. pmid:19266269.
- 9. Qian Y, Han Q, Yuan W, Fan C. Insights into medical humanities education in China and the West. The Journal of international medical research. 2018;46(9):3507–17. pmid:30088424; PubMed Central PMCID: PMC6135995.
- 10. Dring JC. Problem-Based Learning—Experiencing and understanding the prominence during Medical School: Perspective. Annals of medicine and surgery. 2019;47:27–8. pmid:31641498; PubMed Central PMCID: PMC6796570.
- 11. Long J, Zhang D. Research on the teaching reform of medical psychology. Education and Teaching Forum. 2012;(31):133–5.
- 12. Dang H, Nian F, Rexidan G. Discussion on the combination mode of LBL and PBL in the teaching of medical psychology for Uygur medical students. Journal of Xinjiang Medical University. 2014;37(08):1096–8.
- 13. Yi G. Practice teaching of medical psychology. Acta Academiae Medicinae Qingdao Universitatis. 2007;43(1):80–2.
- 14. Pan H, Xie X. On the importance of students' learning subject in PBL teaching of medical psychology. China higher medical education. 2009;(8). Epub 20091130.
- 15. Zhang J. The application of PBL in the teaching of medical psychology. Journal of Jingdezhen College. 2011;26(01):91–2.
- 16. Huang L. Experience of PBL teaching method in medical psychology teaching. Medical Information. 2014;27(21):14–5.
- 17. Wang Y, Qiao W. The application and practice of PBL in the teaching of medical psychology. Health vocational education. 2017;35(17). Epub 20180309.
- 18. Wang X, Shi K, Liu X, Wang H, Wu S. Application of PBL Teaching Pattern in Military Experimental Psychology Teaching. Education Teaching Forum. 2019;52:198–200.
- 19. Duvivier RJ, Boulet JR, Opalek A, van Zanten M, Norcini J. Overview of the world's medical schools: an update. Medical education. 2014;48(9):860–9. pmid:25113113.
- 20. Rossmanith S. The importance and purpose of medical psychology in the study of medicine. Psychotherapy and psychosomatics. 1990;53(1–4):108–14. pmid:2290882.
- 21. Jones RW. Problem-based learning: description, advantages, disadvantages, scenarios and facilitation. Anaesthesia and intensive care. 2006;34(4):485–8. pmid:16913347.
- 22. Somporn P, Ash J, Walters L. Stakeholder views of rural community-based medical education: a narrative review of the international literature. Medical education. 2018;52(8):791–802. pmid:29603320.
- 23. Gao X, Luo S, Mu D, Xiong Y, Guanjian L, Wan C. Effects of problem-based learning in paediatric education in China: a meta-analysis. Journal of evidence-based medicine. 2016;9(3):136–43. pmid:26845692.
- 24. Zhou J, Zhou S, Huang C, Xu R, Zhang Z, Zeng S, et al. Effectiveness of problem-based learning in Chinese pharmacy education: a meta-analysis. BMC medical education. 2016;16:23. pmid:26787019; PubMed Central PMCID: PMC4719679.
- 25. Yang M, O'Sullivan PS, Irby DM, Chen Z, Lin C, Lin C. Challenges and adaptations in implementing an English-medium medical program:a case study in China. BMC medical education. 2019;19(1):15. pmid:30626387; PubMed Central PMCID: PMC6325837.