{'fraction_non_alphanumeric': 0.026838288094212265, 'fraction_numerical': 0.010681459141174781, 'mean_word_length': 5.091306724986332, 'pattern_counts': {'":': 0, '<': 22, '<?xml version=': 0, '>': 2, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 3, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Enablers and Barriers to Successful Implementation of Cooperative Learning through Professional Development

: Literature shows cooperative learning has positive beneﬁts for students’ learning and social outcomes. Even though cooperative learning studies have been conducted in all areas of the curriculum, few studies have investigated whether there are similar effects for students across several curriculum areas or age groups. Moreover, less attention has been given to how professional learning and development (PLD) opportunities can contribute to changes in instructional practice. We illustrate how research on cooperative learning can be translated into practice, through a one-year University-School partnership. The current study is focused on our PLD work in one large private school based in New Zealand. Analysis of school data (quantitative student data and qualitative teacher data) indicated that, by the end of the school year, students reported experiencing more cooperative learning opportunities in their classes. Teachers believed that the PLD supported change in their practice and noted positive changes in student engagement. Analysis of student data also revealed differential outcomes by subject and age group. Overall, our study showed that PLD opportunities can contribute to the successful implementation of cooperative learning.


Introduction
Cooperative learning involves students in small groups working and learning together in a supportive manner to complete an assigned task [1]. It has been implemented successfully across a wide range of curriculum areas and with students at all levels of schooling. Cooperative learning has also been shown to be effective across a wide range of tasks designed to develop higher levels of conceptual understanding and critical thinking [2,3]. Hence, because cooperative learning has consistently been shown to improve student learning and social outcomes, interest in implementing this strategy has continued to increase since the 1980s [4]. Nevertheless, researchers often introduce interventions over a short period, in one curriculum area and with one age level [5,6]. Further, many interventions do not take place within an authentic classroom context. As a result, when the intervention ends, teachers are not equipped to incorporate cooperative learning across a range of curriculum areas and throughout the academic year [7], and so may revert to a more didactic form of teaching. Further, teachers are often not involved in the design of the tasks or how they will be implemented [8]. This can mean that they are not well equipped to carry on with the intervention once the research project ends.
The current project was designed to address some of these gaps in the literature. First, rather than focusing on one curriculum area, our intervention was implemented across four core areas: English, mathematics, science and social sciences. Second, both elementary and middle school students were involved, rather than there being a focus on one age group. Third, the professional development that comprised the intervention took place over four school terms (40 weeks, a full academic year in New Zealand), whereby the staff of one school attended a series of workshops with the researchers, coupled with regular meetings with the leadership team and Deputy Principal to discuss progress, successes and barriers, and to plan future sessions. Finally, a key component of the professional development involved the teachers planning cooperative learning tasks together for their students that they would implement. This planning took place with the researchers on hand to monitor the alignment of cooperative learning principles with what was to be instituted. Hence, the researchers worked cooperatively with the school leaders and teaching staff to help them monitor and implement cooperative learning tasks into their teaching.
Cooperative learning is described [9][10][11] as being comprised of certain key components if students are to benefit from being involved. First, students need to be positively interdependent. Second, students need to be seated in a manner which facilitates face-toface interaction so they can see each other and read each other's body language. Third, students, both individually and collectively, need to be responsible and accountable for particular aspects of the task. Fourth, the task should encourage students to develop and demonstrate positive teamwork skills. Fifth, there should be equal participation of group members accompanied by helpful, supportive behavior among the group. Sixth, regular reflection on the group's progress in developing cooperative learning skills is useful so that students understand which skills they have mastered and where they still need to put in additional effort [7].
There are additional organizational and structural arrangements that have been shown to contribute to positive cooperative learning experiences for students [12]. These include having no more than four of five students in each group and beginning with two-three students working together. Further, maintaining stable groups for one term (approximately 10 weeks) enables students to develop positive relationships which include trust, respect and sensitivity to others' views. When groups are stable for an extended period, this also builds confidence among all members and encourages them to contribute. Baines and colleagues [12] also recommend using mixed ability groups but putting high and middle achievers together and low and middle together in other groups to avoid frustration. In addition, they recommend including boys and girls in each group.
For the above criteria to be fulfilled, teachers play a critical role. It is mainly teachers who will decide on the group task and the tasks need to be appropriate for group work, but the tasks also need to encourage the development of teamwork skills and positive interdependence. Such tasks are likely to have multiple open-ended solutions that encourage discussion. Students also need a clear understanding of what is required from the task and how they are expected to work together [4]. Further, students may be unused to working cooperatively in groups and so will need explicit training to develop positive and supportive teamwork skills [7]. This means that students need to be taught the prosocial and group work skills necessary to form positive interactions with their peers to cooperatively engage in the task at hand. It is also important that teachers monitor their groups closely when they are interacting. Teachers can ask thought-provoking questions, ask for elaborations and prompt students to provide explanations and justifications [4,13]. In short, if students are to successfully exchange ideas, speculate about possible conclusions, explain or justify their reasoning or make inferences, they need to be taught these new ways of working together. Given that students are engaged in high-level interactions that will enhance their thinking and learning, as well as in advanced groupwork skills, the training that teachers implement is likely to take time. Students cannot be expected to sit in groups and immediately work as a group [2,7,12,14]. This is one reason why gradual and extended implementation of cooperative learning is likely to be more effective than a brief intervention. In setting up a cooperative learning classroom, time to effectively train students in how to work together needs to be set aside. Endorsing this point, researchers [7,15] have shown that when students are taught how to engage in group learning and support, they exhibit higher level thinking, reasoning and academic performance than students who have not been trained. For similar reasons, it is also beneficial to allow time at the end of each cooperative learning session to have students reflect on their mastery of the skills required. This enables students to think about how well they have interacted, the degree to which all students were involved, and how they are moving to positive interdependence.
There is now a vast literature that attests to the positive benefits of cooperative learning for student outcomes. In addition, a number of meta-analyses [16][17][18][19] have further endorsed the advantages of this form of structuring the learning environment. In an early meta-analysis of 122 studies, Johnson and colleagues [16] reported that cooperative learning resulted in better achievement outcomes than either individual efforts or group competition. Additionally, their meta-analysis incorporated studies in several curriculum areas (literacy, mathematics, science, social studies and physical education) and at all schooling levels. There were advantages for students in cooperative learning groups for any activities that involved higher level and logical thinking, problem solving and drawing conclusions.
Slavin [19] compared students at elementary and secondary schools, in 60 studies who were either in control or cooperative learning groups. He showed that in most of the studies (72%), students achieved better academic results on the same task when they were working in cooperative groups than if they were in a control group.
Later Johnson and Johnson [20] compared outcomes across 117 studies when students were in cooperative groups, competitive groups or working alone. They found large, positive differences for cooperative learning compared with the other two learning structures across a wide range of variables: academic performance, social support, self-esteem, perspective-taking and handling controversy. Hence, this meta-analysis also endorsed the benefits for students of cooperative learning.
A more recent meta-analysis [18] of 148 studies again compared differences in achievement outcomes for cooperative learning versus competitive or individual learning structures. However, the authors also investigated the effects on peer relationships. Again, they reported high levels of achievement when students cooperated in groups rather than when they competed or worked alone but in addition, they were also able to show that peer relationships were more positive with cooperative learning than for the other two learning structures. Overall, these meta-analyses have indicated that there are clear achievement and social benefits for students when they work in cooperative groups compared with other ways of organizing students.
Even though cooperative learning studies have been conducted in all areas of the curriculum [16], few studies have investigated whether there are effects for the same students across several curriculum areas. This is important because some curriculum areas may be more conducive than others to enhancing student outcomes through the use of cooperative learning. For example, there have been several studies in the past two decades that have investigated the effects of cooperative learning on science outcomes [21][22][23][24]. Other studies have investigated effects in mathematics [25][26][27]. Far fewer studies have investigated effects in literacy (see study Marcos and colleagues [8] for a recent exception) and social studies [28]. Even though, the studies of cooperative learning in science and mathematics consistently report positive benefits for students, the recent intervention study of Wanzek and colleagues [28] in social studies is less convincing. In that study, students in the intervention group produced more accurate ideas in an essay and showed small positive differences for providing supporting details in their essay compared with the control group, but they did not show any gains when assessed on a multiple-choice test of content knowledge. However, one key aspect of cooperative learning activities is that they are designed to improve student social outcomes, for example, peer relationships, peer support, positive interdependence. Even though most studies report student academic outcomes, few investigate student perceptions of the cooperative learning activities or changed learning environment that results.
The current study took place in a private boys' school and included students from both Years 5 and 6 (Grades 4 and 5) and Years 7 and 8 (Grades 6 and 7). The school had a very traditional approach to teaching, but the management team were interested in whether or not the introduction of cooperative learning would lead to improved student-teacher relationships and student enjoyment of school. They were also interested in whether teachers would implement cooperative group work during and following the intervention. The study involved primary students (Years 5 and 6) whose teachers were responsible for all curriculum areas and also middle school students (Years 7-8) who had subject teachers for each different curriculum area. The researchers used the work of Blatchford and colleagues [2,7,12,14] as a basis for the intervention and paid close attention to the guidelines offered in the handbook that arose from the, Social and Pedagogical Research into Grouping (SPRinG project; see [12]), a large cooperative group project conducted in the UK. This handbook clearly outlines the steps needed for effective implementation of cooperative learning activities, including both the teacher and student learning that needs to occur.
The research questions pertaining to this study were: 1.
Is the introduction of whole-school professional development on cooperative learning associated with changes in classroom practices (teacher support and group work behaviors)? 2.
Do students report greater levels of teacher support and more group work in math, science, English and social sciences from the beginning to the end of the year of the implementation? 3.
Do student reports of teacher support and group work differ by age group from the beginning to the end of the year of the implementation?

Materials and Methods
This study was based on a partnership between the authors, who provided the teacher professional learning and development (PLD) and a single-sex full primary (Years 1-8; ages 5-12), private school located in a high socioeconomic area within New Zealand. All teachers at the school undertook a whole-year of professional development with the authors (described later) and were asked to implement group work and cooperative learning strategies 2-3 times per term to begin with, then increase that every term. A product of this partnership was a survey, co-developed with the school leaders and authors to measure student perceptions of specific teaching and learning priorities within the school related to cooperative learning. The school was interested in whether students reported greater teacher support (as a byproduct of working in groups) and increased opportunities to work in groups over the year of the intervention. Anonymized student data and teacher feedback on the PLD were provided to the authors, following ethical and school permission to use these data for research purposes. Since data were gathered before and after the PLD had begun, and given our partnership was centered around a whole-school professional development program, this led the research design to form a natural quasi-experimental study whereby pre-and post-data were gathered on student experiences following planned changes in teaching practice. Hence, we could compare beginning-year student reports related to group work with end-of-year reports after they had been involved in group work for one school year.

Participants
A total of 599 and 437 students, respectively, completed the student surveys in Terms 1 and 4 (i.e., at the beginning and end of the academic year, corresponding to before and after the school-wide professional development). The school gathered data from elementary (Years 5-6, approximately 9-10 years old) and middle (Years 7-8, approximately 11-12 years old) school students across all curriculum areas. We have, however, focused our analyses on the four core curriculum areas (English, Social Science, Science and Mathematics). We acknowledge the drop in student responses at Term 4, which are likely due to students changing schools or being absent on the day of the survey administration. Table 1 (below) shows the breakdown of the students by year level and curriculum area.

Measures
Below we report on our findings from the student survey data and teacher feedback. As noted earlier, the student survey was co-designed to ensure that the items reflected the school's teaching and learning priorities for the year which were to increase teacher support of students and to increase teacher use of cooperative learning in their classroom programs. We wanted to ensure that the school could use the information from the survey items for their ongoing professional development. This meant that the adoption of existing or pre-established scales was not possible because the school wanted input into the items that constituted the survey.
The survey gathered anonymized student data on specific learning experiences during the year. Students were asked to indicate their levels of agreement versus disagreement on a 5-point Likert scale (1 = strongly disagree, 2 = disagree, 3 = neither agree or disagree, 4 = agree, 5 = strongly agree) on nine items. For example, "My teacher gives me opportunities to work in a small group" and "I find the group learning tasks enjoyable" (all items are presented in Figure 1 within Section 3).
In addition, teachers were asked to provide anonymous feedback online following Term 4, on their thoughts on the PLD and whether they thought it had made a difference to their practice. It must be noted here that gathering of student achievement data was not possible in this study, as different groups of teachers indicated that they used different achievement tests for different subjects, some of which were not standardized. This meant that baseline achievement data would not have been comparable across the subjects and year levels. Therefore, we opted for a school-wide student survey and teacher feedback as our proxies for successful implementation-or at least trialing-of cooperative learning strategies and group work skills in the classroom. Feedback from school leaders also suggested that data from student surveys would be beneficial to inform future school-wide teaching and learning priorities.

Professional Learning Development and Data Collection Procedures
We were approached by the school at the end of one academic year to form a partnership focused around providing support with implementing cooperative learning and group work skills as a school-wide focus for the following year's teaching and learning priorities. We spent time meeting with the school's teaching staff and senior leadership team in order to develop our relationships with the school and to understand their needs. We also wanted to mutually agree on potential measures that were specific to the school's needs but would also allow us to explore changes over time in student attitudes towards (and perceptions of) cooperative learning and group work skills, and to include a teacher measure to determine if PLD was effective in shifting teachers' practice.
During our initial conversations with the school and curriculum leaders, we discovered that most teachers did not typically use cooperative learning strategies in their classes. We also discovered that some teaching departments-particularly mathematics-were resistant to group work learning strategies and mixed ability grouping, as they employed ability grouping instead. This informed our planning of the PLD workshops where we incorporated, for example, a comprehensive range of literature showing the potential positive effects of cooperative learning strategies and teaching group work skills, compared with the negligible and often negative effects of ability grouping on student learning outcomes [29]. We also discovered that the school provided few opportunities for teachers to talk about their teaching practice in their subject departments or year-level groups. Therefore, in our workshops, we incorporated examples of cooperative learning strategies across curricular areas and year levels, and, later in the year, we invited teachers from different departments to share their teaching practice and how they had tried to incorporate cooperative learning strategies into their lesson plans and teaching practice.
The main component of the PLD consisted of a series of eight workshops (both with the senior leadership team and teaching staff) across the academic year. In addition, the first author met monthly with the Deputy Principal about progress and any challenges staff were facing and provided individual teacher support when requested. It was important to involve the senior leadership team in the PLD program to encourage their buy-in, involvement, and on-going support of teachers' change in practice within their departments and year-level groups. We were available both in-person and online to provide one-on-one support and to disseminate research resources or help with any difficulties that teachers or departments encountered.
As part of the school's teaching inquiry and review of practice, teachers were expected to be familiar with the research supporting cooperative grouping and to share examples and reflections from their own practice. We factored that into our professional learning and development workshops and allowed opportunities for teachers to present their ideas and ways in which they had incorporated cooperative learning and group work skills into their teaching during Terms 2 and 3 (April-June and July-September) when we were delivering the PLD. This meant that teachers were involved in each other's professional development and had opportunities to learn more about how others had incorporated cooperative learning within their curriculum area and for their group of students. Running a workshop with the school once or twice a term meant that teachers were also reminded of, and exposed to, the content of the PLD on numerous occasions, and were given multiple opportunities to clarify understandings or acquire feedback on how to fine-tune their cooperative learning practices and implementation of group work skills. As authors and PLD providers, we held regular meetings together and met with the Deputy Principal for debriefing and reflection sessions, following each workshop.
School leaders disseminated the student survey in both Terms 1 and 4. Students in this school are used to providing input into school and classroom processes so completion of a survey was not a new experience. The same survey was used with students of all ages, and we ensured that the wording was simple and easy to understand by primary-aged children. We provided the teachers with specific instructions to ensure reliable and consistent data collection protocols, including a spreadsheet into which the data would be entered at both Terms 1 and 4. All students completed their surveys online, and we were provided with a collated anonymized dataset for analysis. Following Term 4, teachers provided their anonymous feedback on the PLD electronically to the school leaders who were interested in the teacher-perceived value of the PLD and whether the PLD had resulted in any changes to their practice. Teacher feedback was in the form of open-ended responses. This anonymous data was then forwarded to the authors. Table 2 below summarizes the main activities undertaken throughout the year in partnership with the school. Note. * It was common practice for teachers at the school to conduct peer observations, so we incorporated that into our PLD and asked that they focus on observing their peers using cooperative learning tasks in their classes and provide feedback on successes and areas for development.

Data Analysis Plan
Preliminary checks of the data were conducted to ensure reliability and validity prior to the main analyses. Given the student survey was developed by the school in consultation with us, a factor analysis was necessary to investigate potential underlying patterns in student responses. Since previous studies have found varying effects across subjects and/or year levels, differences in student responses were analyzed separately for Year 5-6 students in homeroom classes, and for Year 7-8 students in different subjects, using analysis of variance tests and Bonferroni correction to account for possible inflations in Type-1 Error. F-tests and associated p-values were used to detect statistically significant differences that were not due to chance, whereas eta-squared was used as a measure of effect size to check whether the magnitude of differences was practically significant or meaningful (0.01, 0.06 and 0.14 denote small, moderate and large effects, respectively, see Pallant [30]). In addition, we examined whether there were overall changes in student reports of their teachers' support and group work behaviors. We were particularly interested in whether students were provided with more opportunities to work in groups following our PLD. Therefore, analysis of the responses to this item is presented below. All quantitative analyses were conducted using IBM SPSS Statistics v27. Teacher feedback was gathered following Term 4, and a reflexive thematic analysis [31] was conducted to look for overall themes in how staff perceived the PLD.

Preliminary Analyses
We hypothesized that responses to the 9-item student survey were likely to yield a single-factor solution (grouping all items into one overall 'teaching and learning' factor) or a two-factor solution that separated out the items specifically pertaining to group work behaviors from those pertaining to the personal and academic support provided by teachers (see Figure 1 below).
Type-1 Error. F-tests and associated p-values were used to detect statistically significant differences that were not due to chance, whereas eta-squared was used as a measure of effect size to check whether the magnitude of differences was practically significant or meaningful (0.01, 0.06 and 0.14 denote small, moderate and large effects, respectively, see Pallant [30]). In addition, we examined whether there were overall changes in student reports of their teachers' support and group work behaviors. We were particularly interested in whether students were provided with more opportunities to work in groups following our PLD. Therefore, analysis of the responses to this item is presented below. All quantitative analyses were conducted using IBM SPSS Statistics v27. Teacher feedback was gathered following Term 4, and a reflexive thematic analysis [31] was conducted to look for overall themes in how staff perceived the PLD.

Preliminary Analyses
We hypothesized that responses to the 9-item student survey were likely to yield a single-factor solution (grouping all items into one overall 'teaching and learning' factor) or a two-factor solution that separated out the items specifically pertaining to group work behaviors from those pertaining to the personal and academic support provided by teachers (see Figure 1 below). We ran a confirmatory factor analysis (CFA) with maximum likelihood estimation to explore the factorial reliability of a two-factor solution on the full cohort, being our theorydriven model, versus a single factor solution being the alternative or competing model [32]. An examination of the model fit indices suggested that our hypothesized two-factor model (Chi-square/df = 4.22, p < 0.05; CFI = 0.97; TLI = 0.96; RMSEA = 0.056; SRMR = 0.03) was superior to a single factor model (Chi-Square/df = 7.37, p < 0.05; CFI = 0.90; TLI = 0.87; We ran a confirmatory factor analysis (CFA) with maximum likelihood estimation to explore the factorial reliability of a two-factor solution on the full cohort, being our theory-driven model, versus a single factor solution being the alternative or competing model [32]. An examination of the model fit indices suggested that our hypothesized two-factor model (Chi-square/df = 4.22, p < 0.05; CFI = 0.97; TLI = 0.96; RMSEA = 0.056; SRMR = 0.03) was superior to a single factor model (Chi-Square/df = 7.37, p < 0.05; CFI = 0.90; TLI = 0.87; RMSEA = 0.103; SRMR = 0.05) and was deemed acceptable [33]. Figure 2 shows the two-factor measurement model along with standardized estimates using the full sample (i.e., the Terms 1 and 4 combined data; n = 1036). All items loaded significantly onto their respective factors (standardized regression estimates > 0.30 for all items, p < 0.001), with the two factors beings positively and strongly correlated (r = 0.87, p < 0.001). RMSEA = 0.103; SRMR = 0.05) and was deemed acceptable [33]. Figure 2 shows the twofactor measurement model along with standardized estimates using the full sample (i.e., the Terms 1 and 4 combined data; n = 1036). All items loaded significantly onto their respective factors (standardized regression estimates > 0.30 for all items, p < 0.001), with the two factors beings positively and strongly correlated (r = 0.87, p < 0.001). Having established that a two-factor model could be used with the full cohort of students, measurement invariance testing was conducted to ensure that the factor structure was equivalent across cohorts (i.e., those who completed the survey at Terms 1 and 4). To do so, changes in model fit indices (specifically CFI, SRMR and RMSEA) were inspected, and are presented below in Table 3. As can be seen, given that changes in CFI, SRMR and RMSEA were less than 0.01 [34][35][36] across the four levels of invariance (|Δ| < 0.004 for all three indices), this suggests residual or strict invariance was achieved, and that the same two-factor structure could Having established that a two-factor model could be used with the full cohort of students, measurement invariance testing was conducted to ensure that the factor structure was equivalent across cohorts (i.e., those who completed the survey at Terms 1 and 4). To do so, changes in model fit indices (specifically CFI, SRMR and RMSEA) were inspected, and are presented below in Table 3. As can be seen, given that changes in CFI, SRMR and RMSEA were less than 0.01 [34][35][36] across the four levels of invariance (|∆| < 0.004 for all three indices), this suggests residual or strict invariance was achieved, and that the same two-factor structure could be used for either cohort of students. We therefore proceeded to calculating mean scores for the two factors for both cohorts at Terms 1 and 4, as shown in Table 4 below.

Differences in Student Ratings
Multiple analysis of variance (MANOVA) testing was conducted to assess whether there were statistically significant changes in student perceptions of teacher levels of support and their group work behaviors over time, and whether there was a significant interaction between those and the subject in which cooperative learning was introduced, as well as the age group of the students. Furthermore, we were particularly interested in whether the PLD had influenced the extent to which students were given more opportunities to work cooperatively in small groups. This was a central focus of the PLD. Therefore, we ran additional analyses on student responses to that particular item.
First, we found statistically significant differences in the extent to which students reported that they were provided with more opportunities to work cooperatively in small groups (F (1, 1026) = 45.82, p < 0.001; partial eta-squared = 0.04). That is, overall, significantly more students in Term 4 reported getting opportunities to work in small groups than in Term 1.
There were also statistically significant differences in student ratings by subject. Students who undertook cooperative learning in different subject areas reported significantly different levels of teacher support (F (4, 1026) = 12.30, p < 0.001; partial eta-squared = 0.05), group work behaviors (F (4, 1026) = 7.18, p < 0.001; partial eta-squared = 0.03) and opportunities to work in small groups (F (4, 1026) = 10.43, p < 0.001; partial eta-squared = 0.04). Post-hoc Tukey tests revealed that students in science and homeroom classes (where teachers taught all curriculum areas) reported significantly lower levels of teacher support and group work behaviors, whereas students in English classes reported higher levels. Finally, students in Mathematics and Homeroom classes reported experiencing significantly fewer opportunities to work in small groups. Interestingly, although students in science classes reported significantly lower levels of teacher support and group work behaviors, those students reported getting the most opportunities to work in small groups.
Moreover, we found a statistically significant interaction between cohorts (i.e., beginning and end-of-year students) and subjects for group work behaviors (F (4, 1026) = 3.47, p < 0.01; partial eta-squared = 0.01) and getting opportunities to work cooperatively in small groups (F (4, 1026) = 4.39, p < 0.01; partial eta-squared = 0.02), but not for teacher support. These interactions are presented in Figures 3 and 4 below. As shown in Figure 3, students in English classes reported significantly more positive ratings of group work behaviors than any other group by Term 4, and those in science were the only group whose ratings dropped by Term 4. Further, Figure 4 depicts student perceptions of the opportunities they were given to work cooperatively in small groups. Even though all group ratings increased by Term 4, students in English classes had the largest increase, whereas those in Science and Mathematics classes had the smallest increase.
Lastly, we found a statistically significant difference in student ratings by age group for teacher support (F (1, 1032) = 6.81, p < 0.01; partial eta-squared = 0.01), group work behaviors (F (1, 1032) = 23.64, p < 0.001; partial eta-squared = 0.02) and being given opportunities to work cooperatively in small groups (F (1, 1032) = 10.35, p < 0.01; partial eta-squared = 0.01). That is, younger students (aged 9-10 years) reported receiving less teacher support, engaging in fewer group work behaviors and getting fewer opportunities to work cooperatively in small groups than older students (aged 11-12 years). The finding of no statistically significant interaction between terms and student ratings suggests that these differences remained similar across the whole year.
Overall, student ratings of group work behaviors and opportunities to work in small groups increased over the year, particularly in English. However, few or no changes were evident in ratings of teacher support and by students in science and mathematics classes. No changes were evident for younger students over the year who consistently reported lower levels of teacher support, group work behaviors and opportunities to work cooperatively in small groups, when compared with their older counterparts. Below, we present the findings from the teachers' evaluations of the PLD.  Figures 3 and 4 below. As shown in Figure 3, students in English classes reported significantly more positive ratings of group work behaviors than any other group by Term 4, and those in science were the only group whose ratings dropped by Term 4. Further, Figure 4 depicts student perceptions of the opportunities they were given to work cooperatively in small groups. Even though all group ratings increased by Term 4, students in English classes had the largest increase, whereas those in Science and Mathematics classes had the smallest increase.   Lastly, we found a statistically significant difference in student ratings by age group for teacher support (F (1, 1032) = 6.81, p < 0.01; partial eta-squared = 0.01), group work behaviors (F (1, 1032) = 23.64, p < 0.001; partial eta-squared = 0.02) and being given opportunities to work cooperatively in small groups (F (1, 1032) = 10.35, p < 0.01; partial etasquared = 0.01). That is, younger students (aged 9-10 years) reported receiving less teacher support, engaging in fewer group work behaviors and getting fewer opportunities to work cooperatively in small groups than older students (aged 11-12 years). The finding of no statistically significant interaction between terms and student ratings suggests that these differences remained similar across the whole year.
Overall, student ratings of group work behaviors and opportunities to work in small groups increased over the year, particularly in English. However, few or no changes were evident in ratings of teacher support and by students in science and mathematics classes. No changes were evident for younger students over the year who consistently reported lower levels of teacher support, group work behaviors and opportunities to work cooperatively in small groups, when compared with their older counterparts. Below, we present the findings from the teachers' evaluations of the PLD.

Qualitative Data Analysis
Reflexive thematic analysis [31] involves six phases: familiarization with the data, coding, generating initial themes, reviewing themes, defining and naming themes and writing up. The second author began by reading and re-reading the feedback in order to become thoroughly familiar with the data. Following this, codes were attached to the data. This resulted in the generation of some initial themes. The themes were then checked

Qualitative Data Analysis
Reflexive thematic analysis [31] involves six phases: familiarization with the data, coding, generating initial themes, reviewing themes, defining and naming themes and writing up. The second author began by reading and re-reading the feedback in order to become thoroughly familiar with the data. Following this, codes were attached to the data. This resulted in the generation of some initial themes. The themes were then checked against the data to ensure that there was fit across the whole dataset. The second author then went back to the dataset to determine the scope and focus of each theme. The results of the analysis are presented below. Once the second author had decided on the themes and the data that pertained to each theme, the first author then checked the assignment of data to themes. There were no disagreements about how the data had been categorized into themes.
Three main themes emerged from the data: what teachers had learned about cooperative grouping as a result of the PLD, the teacher-perceived effects on the students of using cooperative grouping, and what teachers hoped that this would mean for the future. Remembering that the feedback was requested by the school leaders and not the researchers, it was reassuring that no feedback from any teacher was negative. Hence, although all the data below presents a very positive view of the PLD and outcomes for students, that is because it reflects the teacher perceptions. Nevertheless, only eight teachers sent their evaluations to the school leaders, so it is possible that teachers who were less amenable to the PLD and the outcomes for their students did not respond to the request for feedback.

Teacher Learning
Teachers were very positive about the PLD and its perceived benefits: "I enjoyed the sharing sessions particularly when we were in mixed groups from throughout the school. It was interesting to hear how different teachers approached their collaboration lessons with different age groups throughout the school". (Homeroom teacher) Another teacher said: "I have found the cooperative grouping PLD to be both informative and practical. In the lecture portion of the PLD sessions, we were equipped with useful ideas and tools to improve our practice. We were then given time to collaborate in our curriculum teams to create lesson plans and share our own ideas. This was both effective and beneficial, and our curriculum team is putting many of these ideas and practices into place". (Math teacher) Teachers also reflected on what they had learned. Some teachers indicated that before the PLD, they thought that they knew what cooperative learning was because they used group work at times, for example, "There has been a tendency, prior to the PLD, to do group work and call it cooperative learning. I now have more clarity on what cooperative grouping actually is" (English teacher). Teachers became aware that cooperative grouping involved more than seating students in groups: "Cooperative grouping requires detailed planning and flexibility which I think is something that can be lost when units have been taught in the same way for the same purpose for a number of years. [The PLD] allowed me to be more reflective". (English teacher) The PLD appeared to improve the teachers' knowledge of what setting up cooperative groups involved, for example, from one teacher, who often used group work, a very practical consideration, "As a result of the sessions (PLD), I realized some of my group numbers were too large at 5-8, things are working much better with reduced numbers of between 2 and 4." Another teacher reported, "I have now extended my thinking to [how to] include a variety of different curriculum areas [using cooperative grouping] . . . Cooperative grouping looks different in different curriculum areas and within different age groups" (Homeroom teacher).
Teachers also recognized the importance of teaching students the social skills needed for cooperative grouping to be effective, "Developing a harmonious class climate is paramount in order for collaboration to take place. Teaching boys to co-operate and be accepting/tolerant of differences is vital" (Homeroom teacher).
A further consideration for teachers was a consideration of time when moving to cooperative grouping: "[The PLD] has made me slow down and take the time to think about how to implement cooperative grouping. It is a long-term approach, not a one hit wonder. It will get better with time and the results will be worth it". (Homeroom teacher)

Student Outcomes
Teachers reported many benefits for the students as a result of implementing cooperative grouping. Some teachers perceived cognitive benefits: "I have noticed that as more [cooperative group] work has been accomplished the boys are picking up the language of cooperation and the discussions are starting to become richer" (English teacher). Another said, "Using cooperative grouping is a wonderful way of setting boys up for success with their learning. It is a great way to develop leadership skills, vocabulary with all [students], but especially with ESOL learners, and confidence with all" (Homeroom teacher). Others noted additional psycho-social advantages, "I think the most important aspect for me is the engagement that the boys are showing." (Science teacher).
However, several teachers noted the importance of training students in cooperative grouping skills before expecting them to work together successfully. Four examples are provided below. In the first one, in a class survey, the students had identified that they wanted to spend more time working in groups: "They want to work in groups, and it has been my challenge to ensure they are working as groups. I have enjoyed the cooperative grouping lessons that we have accomplished. It has meant less 'teacher talk' and more student action. Their success or failure at certain tasks has been more down to them engaging in those soft skills that will be so important going forward rather than time management of lessons by me, which makes the learning more meaningful in my view". (English teacher) Another teacher spoke about the gains in social skills that his students had made since cooperative grouping had been introduced: "As the boys have got used to the cooperative grouping, they have gone to automatically setting their roles within the groups rather than needing as much teacher prompting. The boys are listening to each other more and making sure everyone in the group is included which has been very encouraging. I have found this has particularly helped with scaffolding within the groups. The boys have more confidence to step up and help each other". (PE teacher) A further teacher was pleased to report that his Term 3 student survey had identified cooperative grouping as a strength of his teaching. They went on to report: "Understanding more about roles within groups and how groups collaborate has made the boys more efficient when working in cooperative groups. Time spent learning these skills has been very beneficial in the long run. I feel more confident letting the boys take the lead with their learning due to their ability to work together and set their own goals. It has certainly helped the lower achievers in class raise the standard of what they are producing. The boys are able to give feedback and feedforward in a more honest and sensitive way. There is less conflict around collaborative tasks. Boys seem more comfortable when sharing work with others in the class environment. Seem to be able to work through problems together better, rather than relying on the teacher to sort these out". (Social science teacher) The final teacher to report on benefits beyond academic gains stated, "They are calmer as they now know they will all get their turn at each role. They are using gentle language to disagree. They have vocabulary to argue constructively" (Homeroom teacher).

Future Possibilities
Since teachers saw benefits of the PLD for their teaching as well as for the students' development of soft skills, several wanted the school to build on what had been learned and to continue using cooperative grouping into the future. One teacher said, "I will be looking to include cooperative grouping more next year to complement the explicit teaching that happens now. This has been very worthwhile PLD and should be ongoing in my view" (Science teacher). Another math teacher was already thinking about how to integrate their teaching with aspects of the math curriculum, "Next year, we want to structure our curriculum to directly teach collaborative skills along with problem-solving skills in Term 1." A further teacher spoke more globally about how they believed the school could support their efforts: "I will look to implement [cooperative grouping] into my planning and I feel it is now important that termly planning includes explicit cooperative grouping teaching and activities. The PLD has been useful and now I would like to see the school look at devising a progression throughout the school and resources and steps for the skills that are to be taught, so that there is clarity and progression to be tracked." The teachers were overwhelmingly positive about the professional development in cooperative grouping. They reported on what they had learned, what their students had learned and how they had benefited, and expressed a desire to see cooperative grouping maintained within their school.

Discussion
The current study sought to explore whether the introduction of whole-school professional development on cooperative learning would be associated with changes in classroom practices, measured by student ratings of teacher support, group work behaviors and opportunities to work cooperatively in small groups, as well as by teacher perceptions of the benefits of the PLD on their practice and students' outcomes. The study also explored whether there were differential outcomes of the PLD by subject or age group, given the existing literature had typically focused on either one curricular area (typically math or science) or age group (typically secondary-aged students). Therefore, this study presented a unique perspective on the differential effects potentially found across curricular areas and age groups, when a whole-school intervention is introduced.
Most importantly, it seemed as though our design of whole-school PLD, rooted in a strong and ongoing partnership with the school, may have led to students experiencing more group work behaviors and cooperation in their classes by the end of the year. Given that the effect sizes reported earlier ranged from small to medium, we posit that positive changes are likely to be emerging at this stage, with teachers' positive feedback suggesting that interventions of this type might require more time before seeing larger effects, as teachers acquire more opportunities to fine-tune their instructional practices around cooperative learning [7,15].
Indeed, we were not surprised to find that student perceptions of teacher support did not increase over time, given these were already high at both the beginning and end of the year. Perhaps, these already-high levels of teacher support were the catalyst for sustained change in practice. Through strong teaching support of students, teachers would have had the opportunity to clearly communicate the goals of each lesson to students and what they were expected to achieve. They would have provided consistent and ongoing scaffolding as students gradually shifted from an individual style of learning and instruction to a more cooperative peer-assisted style of learning. Teachers would have also ensured that students had the appropriate social and group work skills needed to stay on-task and work as groups and not just in groups. This was evident in both the increased levels in perceived group work behaviors reported by students, and by feedback from teachers who articulated the steps required to shift students towards a cooperative style of teaching and learning. Baines and colleagues [12] also point to the importance of training students to work as a group.
Even though we located more studies in the literature that explored the potential benefits of cooperative learning on student outcomes in mathematics and science [23,25], than in other curriculum areas, it was interesting to find that there were no changes evident in ratings of teaching support and opportunities to learn cooperatively in those subjects. Instead, the greatest changes in perceived classroom practices and instruction were in English. On one hand, the qualitative comments by English teachers suggested that they may have been 'early adopters' and supporters of the PLD, which may have translated into greater engagement with the professional development and changes in practice. On the other hand, the science and mathematics departments in the school may have found the change to a more cooperative style of learning and instruction to be particularly challenging. This may have been because these departments used ability grouping in their classes, which is not conducive to implementing cooperative learning strategies in the classroom [12]. Given the mathematics teacher feedback that the PLD was well received by them and potentially their department, it may be that it would take longer than one academic year for change in student ratings to be visible. In future studies, in-depth investigation of the critical enablers (e.g., teacher buy-in and engagement with the PLD) and barriers (e.g., ability grouping) to successful implementation of cooperative learning strategies would help better understand the differential effects of interventions of this kind on student outcomes. Notably, enablers and barriers such as these would not have been possible to pinpoint had this study focused on a single curriculum area.
Lastly, the finding that cooperative learning practices-and potentially the impact of our PLD on student outcomes-seemed to be more positive for older students in the study is noteworthy. Younger students in the study were taught by a single homeroom teacher who was in charge of all the curriculum areas, whereas older students were taught by different specialist teachers for different subjects. It was possible that specialist teachers found it easier to focus on implementing cooperative learning in their classes, given their emphasis on a single subject or a core curriculum area that they were comfortable teaching. The homeroom teachers would have had to choose a curriculum area first before deciding on when and how to introduce cooperative learning into a lesson. Even though, this reinforces the key message that whole-school interventions may not result in whole-school shifts in attitudes or perceived outcomes, and that care needs to be taken to understand the context and content-specific conditions that would enable teachers to better implement changes in their practice.

Limitations and Future Directions
This study was designed as a natural quasi-experimental design, as the school wanted to partner up to develop a whole-school intervention in cooperative grouping. Nonetheless, this meant that no control group was available to draw conclusions on the effects of the intervention. We caution against generalizing findings from this study to all other school types, given the unique context and demographic breakdown of the school from which the data were analyzed for this study.
As stated earlier, it was not possible to gather comparable and standardized achievement baseline data in this study, which would have allowed us to explore the potential effects of this PLD on students' academic outcomes alongside their psycho-social outcomes. This would have allowed us to triangulate the evidence and compare students' achievement and attitudinal data alongside teachers' feedback. Future studies should also consider developing teacher measures that would enable controls for implementation fidelity and attitudes towards cooperative learning practices, as well as gather feedback from a larger sample of students and teachers. We are aware that only eight teachers were included in the qualitative data, and it is possible that those who were less receptive to the PLD may have chosen not to provide any feedback.
Even though this study has established that our intervention may have had differential outcomes by subject and age group, future studies should also consider exploring whether there could be further differential outcomes by school-level demographics such as school type or resourcing. It is possible that our positive findings may have been because the school we worked with was a well-resourced private school located in a high socio-economic area in New Zealand. We encourage future research to be conducted in schools that may benefit even more from enhancing their learning environments through cooperative learning.

Conclusions
The results of the current study reinforced the potential positive effects of cooperative learning on both classroom practices and teacher perceptions of their learning environment. Whereas previous research had sought to describe the added benefits of cooperative learning in specific curricular areas or with specific groups of students, our study pointed to the need to better understand the enablers and barriers to ensuring that all students could benefit from cooperative grouping. Importantly, though, our study showed that understanding how to translate cooperative learning research into practice, through a one-year university-school partnership, could bring about positive change on classroom practices and outcomes. Our description of how we built the university-school partnership as PLD facilitators, and how we used the student and teacher data to draw conclusions on the potential effects of our approach, showed that PLD opportunities can contribute to changes in instructional practice. We hope that our study will provide a replicable model for future interventions in cooperative grouping. Institutional Review Board Statement: The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of The University of Auckland.