Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Medical Students Perceive Better Group Learning Processes when Large Classes Are Made to Seem Small

  • Juliette Hommes ,

    Juliette.Hommes@Maastrichtuniversity.nl

    Affiliation Department of Educational Development and Research, Faculty of Health Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands

  • Onyebuchi A. Arah,

    Affiliation Department of Epidemiology, The Fielding School of Public Health, University of California Los Angeles, Los Angeles, California, United States of America

  • Willem de Grave,

    Affiliation Department of Educational Development and Research, Faculty of Health Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands

  • Lambert W. T. Schuwirth,

    Affiliation Flinders Innovation and Clinical Education, Flinders Medical School, Flinders University, Adelaide, Australia

  • Albert J. J. A. Scherpbier,

    Affiliation Department of Educational Development and Research, Faculty of Health Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands

  • Gerard M. J. Bos

    Affiliation University Hospital Maastricht, Department of Internal medicine, Haematology, Maastricht, The Netherlands

Abstract

Objective

Medical schools struggle with large classes, which might interfere with the effectiveness of learning within small groups due to students being unfamiliar to fellow students. The aim of this study was to assess the effects of making a large class seem small on the students' collaborative learning processes.

Design

A randomised controlled intervention study was undertaken to make a large class seem small, without the need to reduce the number of students enrolling in the medical programme. The class was divided into subsets: two small subsets (n = 50) as the intervention groups; a control group (n = 102) was mixed with the remaining students (the non-randomised group n∼100) to create one large subset.

Setting

The undergraduate curriculum of the Maastricht Medical School, applying the Problem-Based Learning principles. In this learning context, students learn mainly in tutorial groups, composed randomly from a large class every 6–10 weeks.

Intervention

The formal group learning activities were organised within the subsets. Students from the intervention groups met frequently within the formal groups, in contrast to the students from the large subset who hardly enrolled with the same students in formal activities.

Main Outcome Measures

Three outcome measures assessed students' group learning processes over time: learning within formally organised small groups, learning with other students in the informal context and perceptions of the intervention.

Results

Formal group learning processes were perceived more positive in the intervention groups from the second study year on, with a mean increase of β = 0.48. Informal group learning activities occurred almost exclusively within the subsets as defined by the intervention from the first week involved in the medical curriculum (E-I indexes>−0.69). Interviews tapped mainly positive effects and negligible negative side effects of the intervention.

Conclusion

Better group learning processes can be achieved in large medical schools by making large classes seem small.

Introduction

Powerful learning environments comply with the cognitive architecture of learning [1] combining learning within a meaningful context (contextualism), learning as an active process (constructivism) and learning in groups (collaboration). These learning environments assemble small groups as the units in which learning takes place to ‘teach’ undergraduate medical students. In such small groups, students are supposed to solve meaningful problems, share information and discuss conflicting ideas [2]. These distinctive steps in the process of learning have shown positive effects on short- and long-term knowledge acquisition [3][6]. Performing these steps within a small group has been shown more effective than acted by an individual alone [7], [8]. Furthermore, in the field of medical education positive effects of these group processes on a variety of medical competencies have been shown repeatedly [9][12]. In accordance with the evidence, many medical schools all over the world have changed their learning context towards powerful learning environments.

Medical schools have grown towards ‘mega’ classes with commonly over 300 students in European medical schools. This scale enlargement has shown to make teaching large classes difficult [13][15]. In these traditional learning contexts the solution to involve all students in the mega-class was to include group-based activities in the learning contexts [16]. However, in powerful learning contexts, which are founded upon learning in small groups, it is plausible that the scale enlargement threatens the students' learning processes. Random allocation of students into new groups every few weeks again results in small groups of unfamiliar students. Sharing knowledge in the collaborative process incurs an implicit cost, while the expected returns of relevant new knowledge and/or expertise are uncertain. Some students are therefore less willing to share knowledge than others. Group member familiarity might reduce costs of sharing information among students [17], [18]. Second, groups must invest time and energy in the collaborative process before the group can become effective [19]. Changing the composition of groups too quickly might prevent groups from reaching the beneficial effects of collaboration in groups. Such suboptimal effectiveness of physicians' medical training increases the need for parsimonious solutions to make medical education more effective.

The battle against scale enlargement cannot be won by reducing the number of students enrolling in medical schools. Dividing a medical parallel programme into two (or more) sections will result in a duplication of necessary staff time [20]. Next, in medical education we strive towards evidenced-based decision making to design the most powerful learning context. Therefore, our study angled this large class debate differently. We conducted a randomised controlled intervention study to test if subdividing a large class into small subsets could facilitate the students' collaborative learning processes positively. This division of a large class in small subsets, which is schematically illustrated in Figure 1, makes students collaborate with the same students frequently in small groups. Hereby, these subsets increase the time students spend collaborating with the same students they have collaborated with in the past. More time to collaborate with one another aligns with the group development literature [19], [21] which has shown to increase the effectiveness of groups.

thumbnail
Figure 1. Overview of the randomised controlled trial allocation procedure and intervention.

The class of 2010–2011 was randomised into two intervention groups (A and B) with 50 students in each subset and the control group (n = 102). The control group was mixed with the non-randomised students representing the large subset of the class. The intervention consisted of allocating students within the subsets of the class to new tutorial groups while progressing through the curriculum. This way, students in the small subsets frequently interacted with the same students over time.

https://doi.org/10.1371/journal.pone.0093328.g001

Our primary aim was to assess group dynamics in small groups in the medical curriculum. As was briefly expounded in the first paragraph, interaction among students when problem solving, sharing knowledge and discussing medical scenarios are the steps in which learning takes place. However, learners in groups do not necessarily interact when present in the same space at the same time [22], [23]. Attitudes, motivation and beliefs drive or inhibit interaction within a group. For example, potency beliefs -beliefs that the group will be valuable for one's learning process- is an important predictor for effective learning in a group [24], [25]. A strong body of evidence shows that effective learning in groups is dependent on the quality of interaction and a variety of attitudes, motivations and beliefs among the group members [26], [27]. Therefore, we borrowed the parameters of effective group processes as the primary outcome measures: group learning behaviour, potency, social cohesion and psychological safety e.g. [19], [28]. In this study we hypothesized that the students in small subsets perceived better group learning processes, reflected as more positive primary outcome measures compared to the control group.

The second aim of this study, focuses on the informal side of group learning. Students spend the majority of time studying and interacting with other students outside the formally organised activities. Learning in the ‘informal’ context with other students has been found an important part of the students' learning process [29] and could thus confound our findings related to learning in the formally organised groups [30]. Large classes allow students to learn with or from a large number of students. However, large learning networks have been shown to be less effective as it demands much energy to maintain the learning network [31]. Therefore our second hypothesis tested whether dividing the class into subsets directed informal group learning networks towards learning primarily within their own subset.

Finally, to be thorough and not miss (unexpected) effects of this intervention study on the students' group learning process in an actual medical school, the third aim was to explore students' perceptions on the intervention.

Methods

Research in medical education is exempted from the Medical Ethical Committee in The Netherlands on the ground that this type of research does not intend to answer a research question on health or pathology (aetiology, pathogenesis, symptoms, diagnosis, prevention, results of a treatment) [32]. As the medical educational domain does not agree with this view, a review board for medical education was designed, but was not yet in function when this research was planned and applied. This did not prevent our research team to apply ethical guidelines for our research. To meet the need for thorough ethical guidelines normally tested in an ethical committee, the students were given the details of the intervention, after which they were asked for informed consent to take part. Students could withdraw at any moment without having to provide a reason. The intervention did not influence the contents of the educational programme at all. For each study (observation), students were again briefed with the goals of the research and asked to participate and provide informed consent to use their data for research purposes. Stop criteria were formulated on the basis of achievement, the pre-requisite for students to progress through the medical programme. To replace an independent institutional review board the management team of the medical faculty responsible for the quality of education in the medical programme, approved our research proposal and annual feedback on the progress was given.

Setting & participants

This study was conducted in the first two years of the undergraduate-entry pre-clinical curriculum in the Maastricht University medical school. This medical school employs a Problem-Based Learning (PBL) approach with small-group tutorials as the backbone of the curriculum in conjunction with practical learning sessions, e.g. gross anatomy laboratory sessions, to complement these groups. The formal activities compose approximately ten hours per week, which leaves plenty of time for informal learning. At its inception in 1974, classes consisted of 34 students. Nowadays, this school enrols approximately 320 students yearly.

Students enrol in a class and participate in a set of modules in chronological order. Recruitment for this study started with enrolment for the new academic year of 2010–2011 (July 2010). One inclusion criterion was used: informed consent to participate in this RCT.

Randomisation and intervention

Of the students enrolling in the undergraduate-entry Maastricht University medical school, 202 students were randomised into three groups: Two intervention groups (A & B) with 50 students each and the control group (C) consisting of 102 students. For logistical reasons, mainly on the national level, approximately 100 students were not allocated to our medical school before the randomisation of students to tutorial group, which occurs two weeks before the start of the medical programme. Therefore, these students could not participate in the study. The majority of these students still started within the first week of the medical programme. Only eighteen students entered late in the first module. Together with 27 students who did not want to participate in the intervention study, these ‘non-randomised’ students were mixed with the control group, to generate a large subset of the class.

Students were stratified on their Grade Point Average (GPA) as a proxy to divide weak and strong students evenly over all subsets [33], [34]. It was decided to have two intervention groups so that each intervention group could serve as a cross validation for the results of the other group. Randomisation was performed using block randomisation in STATA version 11 [35]. As is shown in Table 1, gender and age did not differ significantly between the intervention groups and the control group. The non-randomised students were slightly but significantly older and had a lower GPA than the control group.

The intervention consisted of allocating students to small groups within the subsets of the class for two years (as illustrated in Figure 1). As such, in the first curriculum year, time wise 54.7% of all formally organised educational events in small groups (clinical skills training sessions and tutorial groups) were organised within the subsets of the class. In the second curriculum year, students were only allocated into the tutorial groups within the subsets of the class, resulting in 39.4% of all formally organised activities was spend within the subsets of the class. To control costs no extra staff time was used in this intervention study. To strengthen students' awareness of being involved in the intervention, three two-hour workshops were organised in which students were actively involved in icebreaker games.

Instruments

Group processes in the formal learning context.

A repeated measures study assessed the primary outcome measure: interaction or collaboration among students in the formally organised small groups over time. The Team Learning Beliefs and Behaviour Questionnaire [28] based on validated scales [36][42] assessed learning processes in these formally organised groups by measuring four parameters of effective group processes [43]: group learning behaviour, feelings of psychological safety, social cohesion (communal attraction to the group and its members), and group potency (the belief that the group is effective). These group learning processes were measured on a seven-point scale ranging from (1) ‘I do not agree at all’ to (7) ‘I fully agree’. To assess the developmental aspect of these processes, a longitudinal repeated measures analysis was performed. Figure 2 shows the administration moments over four modules in the two study years. Students were assessed twice per module: in the second week (observation null) and in the penultimate week (observation one).

thumbnail
Figure 2. Overview of the instrument assessment over time.

Students progressed through six modules every study year. Formal interaction was assessed in the first tutorial group (M1 and M2; since the composition of first two modules did not change), the second tutorial group (M3) and in year two the second and penultimate tutorial groups (M2 and M5 in curriculum year two). The assessment consisted of two observations within the module, indicated as * in the orange boxes. The first observation took place in the second week of the tutorial group and the second in the penultimate week. Informal learning in social networks was assessed during the first three modules in the first year and during two modules in the second study year (T1–T5). Finally, semi-structured interviews assessed the perceptions of the intervention during M2 and M6 of the second curriculum year.

https://doi.org/10.1371/journal.pone.0093328.g002

Group processes in the informal learning context.

The secondary aim was to study informal group learning among the students, which was quantified by longitudinal social network analyses. Social networks define student learning as interaction between a set of actors or individuals (“nodes”) and their interrelationships (“ties”). Three network types assessed social interaction between students; friendships, giving and receiving information related to the module in which students were involved. Friendship networks explore passive information diffusion, while communication networks have a more instrumental nature (e.g. asking explicitly for help on a certain topic) [44], [45]. Tie strength, the value of the information that was given or received respectively, or the intensity of the friendship was measured on a Likert scale ranging from ‘not valuable’ (1) to ‘very valuable’ (5). A previous study demonstrated validity of this method [29]. Five times during the two curriculum years (T1–T5), students' were asked to indicate with whom they interacted in the informal context (outside all formally organised activities), see Figure 2.

Perceptions of the intervention.

Individual interviews were held with students to explore any (other) positive or negative effects of the randomised controlled trial. Two independent trained interviewers conducted n = 39 and n = 36 interviews with students from the intervention groups A and B and the control group in the beginning and in the end of the second study year (see Figure 2). Students were asked what they noticed from being involved in a small or large subset.

Analyses

Group processes in the formal learning context.

Per-protocol multilevel cross-classified regression modelling was used to analyse the data, since two observations per students were obtained while students were involved in tutorial groups, which were assembled from the subsets of the class [46]. The intervention groups (A and B) were compared to the control group. In the large subset of the class, the control group was mixed with non-randomised students. Furthermore, the control group and the non-randomised group of students were compared to ensure that the control group was not put in disadvantage. Response rates varied between 87.6% and 96.6%.

Group processes in the informal learning context.

Response rates varied between 82.2% and 94.0%. Missing data have considerable negative effects on social network analysis since interpretations of social network relations rely heavily on the assumption that the presence or absence of ties is identified. We dealt with the missing relational data as follows [47], treating the missing ties on the precise estimates of mutuality and other (full) network characteristics to fit from the observed data.

Analyses of social networks started with graphical analysis using Pajek v4G. In order to determine if informal group learning occurred within the subsets of the class, Krackhardt and Stern's External – Internal index was used in UCINET (v6.439) [48]. The E-I index takes the number of ties to members of other subsets of the group (E), subtracts the number of ties to members within the same subset of the class (I), and divides it by the total number of ties in the network. The resulting index ranges from −1 (all ties are only within the subset) to +1 (all ties are outside the subset of the class).

Perceptions of the intervention.

Thematic analyses [49] was applied to categorise students perception about positive and negative effects of the intervention. The first author (JH) analysed all transcripts. WdG randomly analysed four transcripts to limit reliance of a single researcher. Comparison showed a high level of agreement. Differences were solved by consensus following qualitative research practice [50].

Results

Demographics at baseline

Of all randomised students 65.8% were female and the mean age was 19.2 years at the start of the medical course. Four students chose to discontinue participation in the intervention or control group, during the two academic years. Reasons were: planning problems with clinical skills training sessions (n = 2), objections to having exam results analysed (n = 1) or personal dislike of some students within the subgroup (n = 1). Twenty-seven students were lost to follow-up as can be seen in Table 1.

Group processes in the formal learning context

The intervention was expected to take effect when the small groups were randomised to new small groups at least twice. However, to understand and monitor the effects of mixing the control group and the non-randomised group to generate a large subset, we explored what happened in the first two small groups that students were involved in. In Table 2 and the Table S1 can be found that no significant differences were found between the control group and the non-randomised group.

thumbnail
Table 2. Effect sizes of the learning processes in formal groups over time.

https://doi.org/10.1371/journal.pone.0093328.t002

In the second curriculum year students in the intervention groups generally reported a higher quality of group dynamics at the start of the module than the control group (cf. Figure 3 and Figures S1), confirming our expectations. Effect sizes are shown in Tables 2, 3 and in the Table S1. For example, in the case of psychological safety, students in the intervention groups perceived higher degrees of safety than the control group in Module 2 (M2); [Group A] β = 0.47 (0.21) p<0.001, [Group B] β = 0.58 (0.21) p<0.001. Similarly, in Module 5 (M5), students in the intervention groups reported a higher degree of safety [Group A]: β = 0.37 (0.16) p<0.001, [Group B] β = 0.36 (0.15) p<0.001. As for social cohesion, it is clear that students in the intervention groups reported significantly higher cohesion towards the members of the tutorial group at the start and the end of both modules in year two. Potency seems to be perceived higher in the intervention groups since a significant difference was found in group A (β = 0.58 (0.27)), but only a trend was seen in group B (β 0.42,(0.26)). The scale group learning behaviour based on (co)construction and cognitive conflict in the group, reaches a trend to be perceived higher in both intervention groups but didn't reach significance (as can be seen in Table 2). When controlling for the lack of power as the subset size decreased to approximately 40 students per interventions group in the second curriculum year, these non-significant differences by combining both intervention groups (Table 3), group learning behaviour and potency are perceived significantly higher in the beginning of the module than the control group.

thumbnail
Figure 3. Learning processes in formal groups.

This Figure depicts mean perceptions of the four parameters for effective group processes. These learning processes were assessed in two modules in the second curriculum year. The * represents a difference from the control group with a p-value≤0.05. The arrow represents a significant difference when both intervention groups were combined to improve power and overcome the low number of students in the intervention groups in year 2 (approximately 40 students). Please note that Y-axis starts at 4 since this was ‘neutral’ on the scale.

https://doi.org/10.1371/journal.pone.0093328.g003

thumbnail
Table 3. Learning in formal groups over time: a problem of power?

https://doi.org/10.1371/journal.pone.0093328.t003

The control group was mixed with non-randomised students and could thus be influenced by the latter group of students. Therefore, it is important to note that in all periods, students in the control group did not differ significantly from students in the non-randomised groups. For all results, including the observations in the first year of the medical programme, we refer to the Table S1.

Group processes in the informal learning context

Graphical illustrations represented in Figure 4 and the film S1 with 3D images of the learning networks show that students' build informal social networks within the subsets of the class in either one of the two intervention groups or the large subset over two years.

thumbnail
Figure 4. Visualisation of learning among students in the informal learning context over time.

These Figures illustrate how students' learning in the informal context is arranged within the subsets of the class over time (T1–T5). The nodes (students) are connected by lines, which represent information flow among the students. In these learning networks, the lines indicated that student received information from the other students (GET network). The colour of each node depicts the subset of the class. A = T1, B = T2, C = T3, D = T4, E = T5.

https://doi.org/10.1371/journal.pone.0093328.g004

The E-I indexes (Table 4) quantify the invisible barriers between the subsets showing that the three subsets hardly share any information external to their own subset of the class. These results demonstrate that a simple change in educational design has strong effects on the students' learning process for (at least) 22 months.

thumbnail
Table 4. Students learn primarily within the subsets of the class in the informal context.

https://doi.org/10.1371/journal.pone.0093328.t004

Perceptions of the intervention

The students in the control group mentioned not to perceive any positive nor negative effects of the randomised controlled trial. The majority of the interviewed students from the intervention groups perceived positive influences from participating in a small intervention group. The positive influences are summarised in Table 5. Students mentioned that they were more familiar to one another, which made collaboration easier. Students were more at ease to ask one another questions and provide feedback to one another. Also, member familiarity made it easier to know what to expect from the other group members. Groups developed rather quickly towards an ‘effective group’. Besides these positive experiences on the process of group learning, students developed a close group of friends and felt rather at home at the university. Finally, students mentioned that they valued to be able to see the personal growth of other students as they met frequently again in tutorial groups over time.

thumbnail
Table 5. How 38 students from the intervention groups perceived the intervention.

https://doi.org/10.1371/journal.pone.0093328.t005

Negative influences of the intervention experienced by the 38 students interviewed from the intervention groups (subsets A & B) were limited to uneasy feelings towards collaboration in future groups in which the majority of students will not be familiar to them, not liking to be more frequently involved with a student whom he or she did not like, and fewer time slots to plan clinical skills training sessions (see Table 5).

Discussion

This randomised controlled study aimed at improving the students' group learning processes in a large class (n∼320). The first outcome measure shows that making a class seem small resulted in more effective group dynamics in formally organised small groups. In other words, changing the composition of small tutorial groups in the medical programme to ensure higher member familiarity among students induced more effective group dynamics as indicated by significantly more positive feelings of psychological safety, social cohesion, group potency and group learning behaviour when a new group was assembled. These findings align with those from the team-based literature describing that group members need to get to know one another before the group can be considered ‘effective’ [19], [43]. Interestingly when comparing effect sizes among the parameters of group dynamics, social cohesion and psychological safety stand out. The literature refers to these perceptions or beliefs as the basis of collaboration in teams [36], [51], [52]. Future studies might be able to determine more specifically how these processes relate to one another to further enhance insights how design features can influence group dynamics. For example, van den Bossche et al [28] suggest that social cohesion and psychological safety are the first steps towards group learning behaviour. However, group potency towards as might grow concurrently with social cohesion (I like the group members and I belief that as a group we will be able to gain in-depth knowledge into the subject matter), and even more strongly after a group had a deep discussion in one of the group sessions. Thus, group dynamics might be related in a non-sequential and more complex cyclical pattern [21], [53]. Although more studies might enable us more insights in the complex matter of group learning behaviour over time, this study does show that a change in curriculum design has a substantial effect on formal group processes. In this study the group processes among the students in the large subset were ‘lower’ as those in the intervention groups for at least 20% of all tutorial group sessions in these two modules. Although this study did not assess group processes during all tutorial groups sessions over all modules, this intervention does indicate that making classes seem small, increases formal group learning for a substantial duration of the formal medical programme.

This study also discovered that the educational design directed informal group learning to occur mainly within the subset of the class over 22 months which might even enhance the effects of the intervention as students spend more time with the same students. At first glance it might seem a disadvantage to be involved in a small subset as this reduces the chance to meet a large number of students. However, in the organisational sciences research has shown that large networks need quite some energy to be maintained [31]. Therefore big networks are not necessarily effective networks. In contrast, safety and judgements of expertise are the strongest indicators of successful informal learning from peers [31]. Since the students in the small subsets indicated to know one another better (interview data) and feel safer among others (formal group learning processes), it is likely that informal learning in networks is also more effective in these small classes. Alternatively, positive experiences during informal group learning networks could contribute to group learning processes in the formally organised small groups. Therefore, this study might have created a better context to learn outside formal activities as well. As students arrange and develop their informal group learning networks themselves, it has been regarded as difficult to steer this learning process in a variety of disciplines [54]. This study is a promising example that it is possible for educators to direct informal learning among students besides formal group learning.

The results of the interviews exploring students' perception of the effects of the intervention support the positive perceptions of students being involved in small subsets. These interviews showed that students perceived higher member familiarity, which in turn improved collaboration among students within the tutorial groups. Moreover, these interviews might indicate that students feel more related to the university when students have developed towards a tight group of friends among close fellow students. Tinto [55] has shown that the curriculum design can make students feel more at home at the university which reduced attrition rates. Future studies might be able to indicate whether subdividing a large class into small subsets indeed causes students to be related closer to the university and results in lower attrition rates as has been shown in the past. Interestingly, students mentioned that it was easier to understand the competency development of fellow students. This intervention might thus be a rather valuable tool for students to receiver better feedback from fellow students, which is in the end a vital method to improving medical competencies of our future medics [56], especially since students tend to be dissatisfied with the feedback they receive [57]. In the end, these interviews show minor to negligible ‘side effects’. What can be learned from these ‘negative’ side effects that can be taken into account when implementing this study into practice, is the ability for students to manage their own agenda. In PBL curricula, students usually have choices in when they can attend skills or anatomy training sessions. These sessions per subset should be flexible enough to fit students' training. We believe that once students choose to be involved in a training session, students also engage more easily in the training session. The literature continues to show that student engagement enhances student learning [58].

Time plays a key role in developing students' collaborative learning processes. We measured processes representing formal group interaction in five modules over two years. Yet, we cannot define precisely the timeframe needed for students in the intervention arm to start experiencing more positive learning processes than the control group. At the same time, within the modules, it cannot be defined when the control group develops to the same level as the intervention arm. This shows that time is still an unsolved parameter with respect to the students' learning process. Previous studies in team learning recognise groups as dynamic social systems changing over time [43]. Future research in education should focus on the influence of time on groups within and over modules.

In the search for evidence-based practice in medical education, randomised controlled trials are valuable tools to show how education can be improved. Especially since very little studies have applied this research method to show effects of the educational context on learning. The setting of an actual learning context is strength of this study and makes the outcomes much more ecologically valid than controlled (lab) experiments, but it also made the study more complex. A pure experimental design, for example, would not have included a control group mixed with a non-randomised group. However, because it was situated in an actual learning context, the study could not avoid mixing the controls with students that do not want to participate or who could not be included. The most important reason was that it would have been unethical to give the non-participants anything but an optimal ‘standard education’. Had we separated out the control group and the non-participants then the participants would have been automatically put in their own small subset and thus be similar to the intervention groups. When analysing their results we found that the GPA was lower in the non-randomised group, which indicates that the latter group consisted of ‘weaker’ students and could affect the students from the control group negatively. No differences were found in group learning processes between the control group and the not randomised student group in the first and second curriculum years. Several interpretations are possible to understand the effects from mixing these two groups on the results and conclusions. First of all, mixing might not have ‘weakened’ the control group nor the non-randomised group. Second, the initially weaker non-randomised group lifted on the ‘stronger’ control group. Finally, the control group leaned on the non-randomised student group and became weaker than would have occurred when not mixed. Although theoretically all three possibilities could have occurred we think that the results suggest that the control group was not weakened nor lifted by the non-randomised groups as no differences in group dynamics were measured from the second week of medical programme and further onwards in the curriculum between the control and non-randomised groups.

Since two intervention groups (A & B) were used in one experiment, each replicating the findings of the other, we conclude that the beneficial effect of the intervention is valid and replicable. The validity of our results are strongly founded on the collaborative learning literature aligning to Kane's notion of an argument-based approach to validity [59]. Since this research was conducted in an actual learning context, we believe that the results are quite unique and underline the ecologic validity of the results, which is normally a critical downside in pure tightly controlled experimental studies.

This study was performed in the context of the Maastricht Medical School, a Problem-Based Learning context. We want to argue that the results of this intervention study are also beneficial to other small-group learning contexts similar to this curriculum design, such as team-based learning contexts. Implementation of this intervention can be rather simple since no additional costs are needed to reducing class size by dividing the class into subsets.

Increasing the strength of the intervention could further accelerate the positive effects. In this study we manipulated only a part of the educational processes (the tutorial groups) and not all other educational activities (practical, lectures). It is plausible to assume that with a stronger intervention even stronger effects would be caused. In a further step-up, for example linking a student group to subgroups of faculty further improvement of the efficacy of formal and informal group learning processes could be achieved, as this study clearly shows that classes need to seem small to reach optimal learning processes. In such study we feel that competency development should be introduced as outcome parameters. Since the foundation of learning in small groups, the quality of learning processes, seems to be positively correlated to ‘smaller classes’, it is of extra interest to study performance of students in a variety of competency domains. This has however not been done in this study since the main parameter that was available in the early curriculum years was medical knowledge. We would value incorporating multiple performance indicators such as communication and collaboration skills in a following study, especially if a stronger intervention has been realized as described in the previous paragraph.

To conclude this study, we advise our medical school and others, which make use of a powerful learning context to change the formal group design and make large classes seem small.

Supporting Information

Figures S1.

A–D: Learning in small groups in the formal learning context over two curriculum years. The * represents a significant difference from the control group with a p-value≤0.05. The arrow represents a significant difference when both intervention groups are added to counterbalance the lack of power due to a low number of students in the small subsets in year 2 (circa 40 students). Please note that Y-axis starts at 4 since this was ‘neutral’ on the scale. Figure S1 and Table S1 depict perceptions of the four parameters for effective group processes. These learning processes were assessed in two modules in the first and second curriculum year, observed twice per module. The intervention was expected to take effect when the small groups were randomised to new small groups at least twice. However, to understand and monitor the effects of mixing the control group and the non-randomised group to generate a large subset, we explored what happened in the first two small groups that students were involved in.

https://doi.org/10.1371/journal.pone.0093328.s001

(TIF)

Table S1.

Effect sizes of learning in small groups in the formal context two curriculum years. GLB: Group learning behaviour, Potency: Group Potency, Cohesion: Social cohesion, Safety: Psychological Safety. Effect sizes are given in regression coefficients, with standard errors between brackets. Obs 0: starting point in the module. Slope: increase (β) between the start and the end of the module. C = control group, A & B are the intervention groups (small subsets), and nR is the non-randomised group of students. * signifies p-value≤0.05. Figure S1 and Table S1 depict perceptions of the four parameters for effective group processes. These learning processes were assessed in two modules in the first and second curriculum year, observed twice per module. The intervention was expected to take effect when the small groups were randomised to new small groups at least twice. However, to understand and monitor the effects of mixing the control group and the non-randomised group to generate a large subset, we explored what happened in the first two small groups that students were involved in.

https://doi.org/10.1371/journal.pone.0093328.s002

(DOCX)

Film S1.

Students learn in the informal context within the subset that the university assigned the students to. These learning networks over time are shown in 3D.

https://doi.org/10.1371/journal.pone.0093328.s003

(ZIP)

Acknowledgments

We thank the students in the class for participating in the longitudinal studies, the board of directors of the Maastricht Medical School for allowing an intervention to take place in an actual educational programme for two years, Mrs. Delnooz for her work on organising the allocation of students within the subsets of the class, and all others that have invested time and efforts in this research project to increase the effectiveness of medical educational designs. Disclaimer: No data was used in other manuscripts or published previously.

Author Contributions

Conceived and designed the experiments: JH WdG GB LS AS. Performed the experiments: JH. Analyzed the data: JH WdG OAA. Wrote the paper: JH WdG AS GB LS OAA.

References

  1. 1. Konings KD, Brand-Gruwel S, van Merrienboer JJG (2005) Towards more powerful learning environments through combining the perspectives of designers, teachers, and students. British Journal of Educational Psychology 75: 645–660.
  2. 2. Simons R-J, van der Linden J, Duffy T (2000) New learning. Dordrecht, the Netherlands: Kluwer Academic Publishers.
  3. 3. van Blankenstein FM, Dolmans DHJM, van der Vleuten CPM, Schmidt HG (2009) Which cognitive processes support learning during small-group discussion? The role of providing explanations and listening to others. Instructional Science 32: 1–16.
  4. 4. Schmidt HG, De Grave W, De Volder ML, Moust JHC, Patel VL (1989) Explanatory models in the processing of science text: the role of prior knolwege activation through small-group discussion. Journal of Educational Psychology 81: 610–619.
  5. 5. Visschers-Pleijers AJSF, Dolmans DHJM, Wolfhagen HAP, van der Vleuten CPM (2004) Exploration of a method to analyze group interactions in problem-based learning. Medical Teacher 26: 471–478.
  6. 6. van Boxtel C, van der Linden J, Kanselaar G (2000) Collaborative learning tasks and the elaboration of conceptual knowledge. Learning and instruction 10: 311–330.
  7. 7. De Grave W, Schmidt HG, Belie NJJ, Moust JHC, De Volder ML, et al. (1985) Effecten van verschillende typen van activatie van voorkennis of recall, gemeten met een aanvultoets (Effects of different types of activation of prior knowledge on recall, measured with a completion procedure). Onderwijs Research Dagen. Tilburg.
  8. 8. van der Linden J, Erkens G, Schmidt HG, Renshaw P (2000) Collaborative learning; Simons R-J, Linden Jvd, Duffy T, editors. London: Kluwer Academic Publishers.
  9. 9. Schmidt HG, Rotgans JI, Yew EHJ (2011) The process of Problem-Based Learning: what works and why. Medical Education 45: 792–806.
  10. 10. Michaelsen LK, Richards B (2005) Drawing Conclusions from the Team-Learning Literature in Health-Sciences Education: A Commentary. Teaching and learning in medicine 17: 85–88.
  11. 11. Slavin RE (1996) Research on cooperative learning and achievement: What we know, what we need to know. Contemporary educational psychology 21: 43–69.
  12. 12. Schmidt HG (2009) Constructivist, Problem-Based Learning Does Work: A Meta-Analysis of Curricular Comparisons Involving a Single Medical School. Educational psychologist 44: 227–249.
  13. 13. Jenkins JJ (1991) Teaching Psychology in Large Classes: Research and Personal Experience. Teaching of psychology 18: 74–80.
  14. 14. McConnell CR, Sosin K (1984) Some determinants of student attituteds toward large classes. Research in Economic Education 181–190.
  15. 15. Anderson WT (1964) Large classes in elementary accounting. The accounting review 1034–1036.
  16. 16. Murdoch B, Guy PW (2002) Active learaning in small and large classes. Accounting Education 11: 271–282.
  17. 17. Gruenfeld DH, Mannix EA, Williams KY, Neale MA (1996) Group composition and decision making: How member familiarity and information distribution affect process and performance. Organizational behavior and human decision processes 67: 1–15.
  18. 18. Harrison DA, Mohammed S, McGrath JE, Florey AT, Vanderstoep SW (2003) Time matters in team performance: effects of member familitary, entrainment, and task discontinuity on speed and quality. Personnel Psychology 56: 663–669.
  19. 19. Mathieu J, Maynard MT, Rapp T, Gilson L (2008) Team effectiveness 1997–2007: A review of recent advancements and a glimpse into the future. Journal of Management 34: 410–476.
  20. 20. Bridges EM (1992) Implementing Problem-Based Learning in a Higher Education Context. In: Bridges EM, editor. Problem-Based Learning for administrators. Oregon: ERIC Clearninghouse on Educational Management, University of Oregon.
  21. 21. Fransen J, Weinberger A, Kirschner PA (2013) Team Effectiveness and Team Development in CSCL. Educational psychologist 48: 9–24.
  22. 22. Johnson D, Johnson R (2002) Social interdependence theory and university instruction: Theory into practice. Swiss journal of psychology 61: 119–129.
  23. 23. Roschelle J, Teasley SD (1995) The construction of shared knowledge in collaborative problem solving. In: O'Malley CE, editor. Computer supported collaborative learning. Berlin: Springer-Verlag. pp. 69–197.
  24. 24. Gully SM, Incalcaterra KA, Joshi A, Beaubien JM (2002) A meta-analysis of team-efficacy, potency, and performance: interdependence and level of analysis as moderators of observed relationships. Journal of applied psychology 87: 819–832.
  25. 25. Stajkovic AD, Nyberg AJ, Lee D (2009) Collective efficacy, group potency, and group performance: Meta-analyses of their relationships and test of a mediation model. Journal of applied psychology 94: 814–828.
  26. 26. Harrington B, Fine GA (2006) Where the Action Is: Small Groups and Recent Developments in Sociological Theory. Small group research 37: 4–19.
  27. 27. Goodman PS, Dabbish LA (2011) Methodological issues in measuring group learning. Small group research 42: 379–404.
  28. 28. van den Bossche P, Gijselaers WH, Segers M, Kirschner PA (2006) Social and cognitive factors driving teamwork in collaborative learning environments: Team learning beliefs and behaviors. Small Group Research 37: 490–521.
  29. 29. Hommes J, Rienties B, de Grave W, Bos G, Schuwirth L, et al. (2012) Visualising the invisible: A network approach to reveal the informal social side of student learning. Advances in Health Sciences Education 17: 743–757.
  30. 30. Krackhardt D, Hanson JR (1993) Informal networks: The company behind the chart. Harvard Business Review July-August 104–111.
  31. 31. Cross R, Thomas RJ (2008) How top talent uses networks and where rising stars get trapped. Organizational Dynamics 37: 165–180.
  32. 32. Center MUM. Available: http://www.azm.nl/info/azMorganisatie/MEC/wmoonderzoek/indienenonderzoek1. Accessed 2013 July.
  33. 33. Moruzi CK, Norman GR (2002) Validity of Admissions Measures in Predicting Performance Outcomes: The Contribution of Cognitive and Non-Cognitive Dimensions. Teaching and learning in medicine 14: 34–42.
  34. 34. Lei SA (2010) Group composition affecting student interaction and achievement: instructors' perspectives. Journal of instructional psychology 37: 317–325.
  35. 35. StataCorp L (2010) Stata. 11.1 ed. Texas, USA: Stata Corporation.
  36. 36. Edmondson A (1999) Psychological safety and learning behaviour in work teams. Administrative science quarterly 44: 350–383.
  37. 37. van Offenbeek M (2001) Processes and outcomes of team learning. European journal of work and organizational psychology 10: 303–317.
  38. 38. Visschers-Pleijers AJSF, Dolmans DHJM, Wolfhagen HAP, van der Vleuten CPM (2003) Development and validation of a questionnaire to identify interactions that promote deep learning in PBL. 10th Euopean conference of research on learning and instruction. Padova, Italy.
  39. 39. van der Vegt G, Emans B, van de Vliert E (1998) Motivating effects of task and outcome interdependence in work teams. Group & organization management 23: 124–143.
  40. 40. Sargent LD, Sue-Chan C (2001) Does diversity affect group efficacy? The intervening role of cohesion and task-interdependence Small group research 32: 426–450.
  41. 41. Guzzo RA, Yost PR, Campbell JR, Shea GP (1993) Potency in teams: Articulating a construct. British journal of social psychology 32: 87–106.
  42. 42. Gibson CB, Randel AE, Early PC (2000) Understanding group efficacy. Group & organization management 25: 67–97.
  43. 43. Decuyper S, Dochy F, van den Bossche P (2010) Grasping the dynamic complexity of team learning: An integrative model for effective team learning in organisations. Educational Research Review 5: 111–133.
  44. 44. Ibarra H, Andrews SB (1993) Power, Social Influence, and Sense Making: Effects of Network Centrality and Proximity on Employee Perceptions. Administrative Science Quarterly 38: 277–303.
  45. 45. Katz N, Lazer D, Arrow H, Contractor N (2004) Network theory and small groups. Small Group Research 35: 307–332.
  46. 46. Fielding A, Goldstein H (2006) Cross-classified and multiple membership structures in multilevel models: An Introduction and review. Nottingham: University of Birmingham.
  47. 47. Gile K, Handcock MS (2006) Model-based assessment of the impact of missing data on inference for networks. Center for statistics and the social sciences. University of Washington, Seattle. pp. 1–18.
  48. 48. Krackhardt D, Stern RN (1988) Informal networks and organizational crises: An experimental simulation. Social Psychology Quarterly 51: 123–140.
  49. 49. Braun V, Clarke V (2006) Using thematic analysis in psychology. Qualitative research in psychology 3: 77–101.
  50. 50. Kuper A, Lingard LA, Levinson W (2008) Practice Qualitative Research: Critically appraising qualitative research. British Medical Journal 337: 687–692.
  51. 51. Beal DJ, Cohen RR, Burke MJ, McLendon CL (2003) Cohesion and performance in groups: A meta-analytical clarification of construct relations. Journal of applied psychology 88: 989–1004.
  52. 52. Chiocchio F, Essiembre H (2009) Cohesion and performance: a meta-analytic review of disparities between project teams, production teams, and service teams. Small group research 40: 382–420.
  53. 53. Hommes J, van den Bossche P, de Grave W, Bos G, Schuwirth L, et al. (2014) Understanding the effects of time on collaborative learning processes in a Problem Based Learning setting: a mixed methods study. Accepted in Advances in Health Sciences Education
  54. 54. Marsick VJ, Watkins DE (2001) Informal and incidental learning. New directions for adult and continuing education 89: 25–34.
  55. 55. Tinto V (1975) Dropout from higher education: A theoretical synthesis of recent research. Review of educational research 45: 89–125.
  56. 56. Schuwirth L, van der Vleuten CPM (2006) Challenges for educationalists. British medical journal 333: 544–546.
  57. 57. Molloy EK, Boud D (2014) Feedback models for learning, teaching and performance. In: Spector JM, Merrill MD, Elen J, Bishop MJ, editors. Handbook of research on educational communications and technology. New York: Springer Science+Business. pp. 413–424.
  58. 58. Carini RM, Kuh GD, Klein SP (2006) Student engagement and student learning: testing the linkages. Resarch in higher education 47.
  59. 59. Kane MT (1992) An argument-based approach to validation. Psychological bulletin 112: 527–535.