http://orcid.org/0000-0003-3022-6716
Figures
Abstract
One of the core objectives of many animal-welfare organisations is to achieve improvements in animal welfare through school education programmes. However, whilst many charities and organisations develop and deliver these educational activities, impact relating to specific animal welfare attitudes and behaviours remains largely undescribed. This study evaluated the effects of an hour-long dog welfare workshop delivered to children aged 7–11, evaluating 2732 learners in state primary schools across the UK. Two types of workshop were evaluated; “Be Dog Smart” (BDS) and “Responsible Dog Ownership” (RDO). This study assessed short-term impact on attitude outcomes, as a first step in developing a full education monitoring and evaluation framework. Learners within each class were randomly assigned to two groups; one completing an attitude-based questionnaire before (control) and the other after the workshop (treatment). Dog ownership status, age, gender, and social deprivation (measured as access to free school meals) were collected for all participants. Questionnaire scores were compared between treatment and control groups. Mean scores were significantly different (BDS p<0.001; Cohen’s D 0.65; RDO p<0.001; Cohen’s D 0.51) between control (BDS 13.57 ± 3.15; RDO 22.97 ± 4.78) and treatment groups (BDS 15.61 ± 3.10; RDO 25.47 ± 5.06) for both workshops, suggesting workshops effectively convey key messages and improve learner attitudes concerning dogs. Gender, age and social deprivation were found to significantly influence questionnaire responses. These findings contribute to a broader effort to improve canine welfare via childhood education while also demonstrating the feasibility of effective monitoring and evaluation during operational delivery of a schools workshop programme. Ongoing impact assessment is important in ensuring successful development, delivery and refinement of educational programmes to maximise the probabilty of positive changes in participants. Further work is needed to evaluate longer term impact, and ensure that desired influences on human behaviour change, and animal welfare, are achieved.
Citation: Baatz A, Anderson KL, Casey R, Kyle M, McMillan KM, Upjohn M, et al. (2020) Education as a tool for improving canine welfare: Evaluating the effect of an education workshop on attitudes to responsible dog ownership and canine welfare in a sample of Key Stage 2 children in the United Kingdom. PLoS ONE 15(4): e0230832. https://doi.org/10.1371/journal.pone.0230832
Editor: Simon Russell Clegg, University of Lincoln, UNITED KINGDOM
Received: October 10, 2019; Accepted: March 9, 2020; Published: April 20, 2020
Copyright: © 2020 Baatz et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Our datasets can be found here: https://figshare.com/articles/Be_Dog_Smart_Workshop_Evaluation_Data/11973333 (DOI: 10.6084/m9.figshare.11973333) and https://figshare.com/articles/Responsible_Dog_Ownership_Workshop_Evaluation_Data/11968905 (DOI: 10.6084/m9.figshare.11968905)
Funding: This work was funded by Dogs Trust and all the authors (AB, KA, RC, MK, KM, HS and MU) at the time the research was conducted were salaried employees of Dogs Trust. The specific roles of these authors are articulated in the ‘author contributions’ section. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have read the journal’s policy and the authors of this manuscript have the following competing interests: At the time this research was conducted, all authors were paid employees of Dogs Trust, UK. This does not alter our adherence to PLOS ONE policies on sharing data and materials. There are no patents, products in development or marketed products to declare.
Introduction
Many charitable (non-profit) organisations and individuals are working towards improving animal welfare. Despite the introduction of the United Kingdom’s (UK) Animal Welfare Act [1], animal cruelty and neglect remain a large and concerning problem [2].
Workshop-based education programmes for school age children are suggested to be a vital part of the solution to improving canine welfare, enabling learners to gain better understanding of dogs and behaving more appropriately around them [3]. The potential of influencing knowledge and behaviours around animal welfare issues in the next generation means that animal welfare charities commit considerable investment into these programmes, although animal welfare-related education is still often overlooked by governments.
The paucity of systematic scientific evaluation of programmes [4] means there is limited evidence as to how animal welfare education programmes impact children’s knowledge and attitudes. However, a recent study evaluated the impact of the SSPCA’s ‘Prevention through Education’ programme which highlighted a tendency for improved animal welfare conducive attitudes, knowledge, attachment and belief in animal minds following an animal welfare education intervention [5]. Other studies have demonstrated short term improvement in knowledge and / or attitudes following classroom-based education interventions in the United States, Italy and India [6–8]. Education programmes are particularly salient around dog bite prevention, given the health and welfare risks for both children and dogs associated with human directed aggression. A systematic review of 12 education interventions targeting dog bite prevention, using both classroom and home based techniques (e.g. video based vs. live-dog), concluded that education interventions have moderate efficacy in reducing the risk of dog bites to children, and that classroom-based lessons evidenced the most success in knowledge and behaviour changes [9]. One study evaluated the impact of an educational intervention through observation of pupils’ subsequent behaviour around a real dog; this suggested that an immediate change of behaviour is possible as a result of an educational intervention [10]. Recent discussions in the UK around dog control legislation have highlighted the importance of education in the reduction of dog bites and injuries. However these discussions have noted that there is currently insufficient evaluative evidence of the impact of such programmes, and more studies in this area are required [11,12].
As the long term impact of interventions is largely dependent on human behavioural change, assessment of impact can usefully employ the theories developed to aid understanding of human behaviour and decision making [13]. With the increasing interest in influencing human behaviour for a wide range of purposes, a framework to summarise characterising and designing behaviour change interventions has been described, in the formation of a hub termed the ‘behaviour change wheel’ [14]. This concept incorporates education as one of the interventions alongside the specific behaviours to be targeted. Taking a ‘Theory of Change’ (ToC) approach to assessing impact involves mapping clear causal pathways to identify all the underlying issues related to the prevailing problem and the changes and conditions required (the outcomes) to reach the end-goal. These outcomes may include intermediate and long-term stages of the component issues which are assumed to underly the end-goal. For education specifically, a clearly stated intended impact is needed, based on how education contributes to the organisational end-goal. A causal pathway between intermediate outcomes (e.g. knowledge acquisition) and long-term outcomes (e.g. behaviour change) helps to identify the necessary outputs (in this case, the type and content of the educational intervention) needed to reach these outcomes [15]. Thereafter a methodology for monitoring and evaluation (M and E) of these impacts is required. In this study, the Theory of Change (ToC) model was utilised to develop and evaluate the impact of workshops delivered by the Dogs Trust Education Officers across the UK.
Dogs Trust is the largest dog welfare charity in the UK, and has delivered single event, in-school education workshops by a team of Education Officers (all certified teachers) across the UK since 2003, reaching thousands of learners a year [16]. Applying structured M and E processes to examine the programmes’ efficacy enables the organisation to understand the contribution of such activities towards achieving organisational objectives. Dogs Trust education workshops operate under a ToC model (Fig 1) where a large-scale end goal (Dogs Trust’s mission statement) is broken down into intermediate outcomes that connect in a causal chain. Assumptions underlying this causal chain need to be tested to validate the model.
Theory of Change model for Dogs Trust educational workshop, aiming to develop attitude and behavioural outcomes that contribute to the Dogs Trust mission.
Each Dogs Trust educational workshop is designed to work towards and evidence a learner demonstrating positive short-term change in core attitude outcomes. For Be Dog Smart (BDS) workshops the first three listed below are desired outcomes, for Responsible Dog Ownership, (RDO) workshops all five are targetted:
- appreciation that dogs are sentient beings with feelings and needs,
- understanding that their own behaviour can have an impact both on their own safety and overall dog welfare,
- the ability to think critically and select information based on welfare, rejecting conflicting information from peers and media,
- understanding that a dog is a lifetime commitment, not a disposable commodity,
- understanding of the importance of selecting the right type of dog to suit their home and lifestyle.
Changes in these outcomes are assumed to create conditions necessary to cultivate subsequent long-term behaviour change conducive with both safer behaviours when around dogs with the associated potential to prevent dog bites and subsequent dog destructions, and behaviour supportive of more responsible dog ownership.
The BDS and RDO workshops evaluated in this study are designed for children aged 7–11 only, as this age range is suggested to be when specific cognitive abilities crucial to the outcome of interest develop [17,18]. The workshops have been designed in line with national curricular expectations for this age range particularly relating to the concept of responsibility, risk and use of critical thought [19,20].
The primary aim of this study was to assess the effect of Dogs Trust primary school education workshops on learner attitudes to dog ownership and dog interaction. As a secondary aim, the effect of other factors previously reported to influence these outcomes (gender, dog ownership, age and socioeconomic factors) were investigated. Our hypothesis was that children aged 7–11 would have a significantly enhanced attitude towards safety around dogs and responsible dog ownership after attending a Dogs Trust educational workshop as compared to reported attitudes prior to the event.
Methods
Ethical approval
Ethical approval for this study was granted by Dogs Trust Ethical Review Board in March 2018, reference number ERB004. Consent for data collection during workshops was initially gained from the Head of the School at time of booking. If deemed necessary by the school, individual parental consent was thereafter sought. A clear opt out option at each point was offered for those not wishing to be included. A second opt-out stage was delivered verbally by the Education Officer delivering the workshop first to the teacher of the class prior to the workshop commencing, and finally direct to the learners in the class.
Questionnaire development
As no validated pre-existing tool was available for the specific attitude outcomes of our intervention (Fig 1), a new questionnaire was developed for this study (see S1 and S2 Files). This was based on published non-cognitive educational skills tools used to evaluate scores for similar interventions [21,22]. Pre-testing involved piloting the tool with 120 children to assess age suitability and ease of completion. The questions assessed attitudes that support the five short-term outcomes discussed above addressed within the workshops using a likert scale. Two questions were developed per outcome—hence the BDS questionnaire comprised 6 questions demonstrating:
- 1. Learners appreciated dog is sentient with feelings
- 2. Learners show understanding that their own behaviour can have an impact both on their own safety and overall dog welfare
- 3. Learners demonstrate the ability to think critically and select information based on welfare, rejecting conflicting information from peers and media
The RDO questionnaire comprised 10 questions addressing outcomes 1–3 as above plus questions 7–10 addressing outcomes 4 and 5 demonstrating:
- 4. Learners understand that a dog is a lifetime commitment, not a disposable commodity,
- 5. Learners understand the importance of selecting the right type of dog to suit their home and lifestyle.
Each question was scored from 0 (strongly disagree) to 4 (strongly agree), and therefore the maximum score in BDS workshops is 24 and in RDO 40, where a higher score reflects more positive attitudes. Four questions in the BDS, and seven questions in the RDO tool were randomly reversed to avoid guessing of ‘correct’ answers, and these scores are inverted accordingly, so that the higher scores remain as the more positive attitude. The following data were also collected, suggested by previous research to be potential confounding factors: the participant’s socio-economic status [23] measured by proxy as Free School Meal (FSM) (the provision of free meals at school for disadvanteged children under the Education Act 1996, in the UK) at class level %, current dog ownership status (measured at participant level) [24], age (measured by proxy as school year group at class level) and gender (measured at participant level) [25–27].
Selection of study participants
During May-July 2018 twenty Education Officers working UK wide, each sampled eight classes. Four of these were allocated a BDS workshop and four a RDO workshop. Based on 80% power to detect an estimated score difference of 20% and allowing for class-level clustering at 4 per Education Officer per intervention type, the required sample was 7 children per group (i.e. 7 ‘treatment’ and 7 ‘controls’).
Education Officers normally book a selection of class workshops in each school visit they conduct, for operational reasons. For this analysis, for schools where more than one class was delivered, one class per school was randomly selected. Where logistically feasible, each Education Officer selected two of each Key Stage 2 year group (age 7–11 according to the English education system). To balance for gender as far as practicable, all schools included in the sample were co-educational.
Data collection
Prior to collecting data in workshops all Education Officers were trained by the lead researcher (AB) in data collection methods, including minimising bias. Learners within each class were randomly assigned as number one or number two. After being assigned their number, learners were seated on opposite sides of the classroom to separate number 1s as the control (C) (pre-intervention) and number 2s as the treatment (T) (post-intervention) group. The between-subject methodology was favoured over a within-subject study design, to minimise social desirability biases and ’Hawthorne Effect’ [28]. Given the short duration of the intervention which was on average 60 minutes in length a within-subject approach would have resulted in participants responding twice to the same set questions only 60 minutes apart. Exposure to these questions immediately prior to the intervention could influence their focus on information transfer within the intervention. Randomisation into a control and treatment group ensured participants were exposed to the questionnaire only once, thus responses in the treatment group were not influenced by prior exposure.
Following randomisation, the Education Officer provided each learner in the control group with a copy of the questionnaire to complete in silence in their own time. Once questionnaires were collected, the workshop was delivered to the whole class with the two groups remaining in their allotted classroom sides (see S3 and S4 Files for intervention material). On completing the workshop, the treatment group were given questionnaires and allowed to complete these in silence before collection. Care was taken to minimise social desirability response bias or the temptation to copy one another by the Education Officer verbally clarifying to the class that the questionnaire was anonymous and there was no right or wrong answer. Teachers and Teaching Assistants were asked not to aid pupils in the completion of questionnaires unless to address literacy or English as an additional language difficulty. In the event that the Education Officer suspected the learner was being guided in their answers the questionnaire was marked and subsequently destroyed without the learner being made aware, in order to avoid embarrassment. The completed questionnaires for the treatment and control groups were collected into separate envelopes, clearly marked and sent directly to Dogs Trust Head Office for data entry.
Data analysis
Statistical analysis was conducted using IBM SPSS v25. Data were tested for normality graphically using Q-Q plots and histograms, and the appropriate parametric or non-parametric tests used. Each BDS and RDO workshop treatment group was analysed compared to their respective control group. An independent t-test or Mann-Whitney, where data assumptions were not met, was used to test whether there was a statistically significant difference (significance set at p<0.05) between the attitude scores achieved by the treatment versus the control group for each individual question and the overall score (between-subject). The mean scores and standard deviation were used to quantify the treatment effect size using Cohen’s D.
Using R (version 3.6.2; R Core Team 2019) [29] the relationship between free school meal (FSM) percentage, year group, dog ownership, gender and treatment intervention (variables defined in Table 1) and total attitude score were tested by creating two separate generalised linear mixed models (implementing a Gaussian error structure), for Be Dog Smart and Responsible Dog Ownership respectively. Model assumptions were tested graphically and collinearity was tested between variables using variance inflation factor (VIF). All logical and feasible hypotheses and subsequent models reflecting these were developed, creating a set of 17 candidate models constructed to test for relationship of the predictor variables and score outcome for both Be Dog Smart and Responsible Dog Ownership workshops (Supplementary files 5 and 6). Possible non-independence of learners was accounted for by including classroom as a random effect to control for the influence of classroom level factors on total score, and all other predictor variables (listed above) and logical interactions were included as fixed effects. Using Akaike information criterion (AIC) model selection was conducted to identify a top model set that best supported the data, using a delta 6 cut-off (all models within 6 points of the top model were deemed to have comparable support). A ‘nesting rule’ was applied whereby models that fell within 6 points of the best-fit model, and only those that were less complex than the top model, were retained in the top model set [30,31]. For Be Dog Smart, the top model set contained 4 models overall, however 3 were removed due to being more complex than the top model (S5 File) and for Responsible Dog Owneship, the top model set contained 2 models overall, however 1 was removed due to being more complex than the top model (S6 File). As only one model remained in both analyses, model-averaging was not suitable and consequently all reported results are based on the top model.
Results
A total of 2732 participant responses were used in the analysis, summarised below in Table 2. Summary descriptive statistics for both workshops are shown in Table 3. All questionnaires were included in the t-test/Mann-Whitney analyses. However, in analysis of effects of predictor variables (gender, FSM%, year group and dog ownership), cases with incomplete data were omitted (recorded in Table 3 as ‘Missing data’). The number of questionnaires omitted due to potential inaccuracies during data collection was not recorded. Tests for collinearity showed little correlation between variables with all VIF scores being below 1.5.
Be Dog Smart
How effective is a single Be Dog Smart workshop in improving children’s attitudes towards responsible dog ownership?
The treatment group had significantly higher scores than the control group (higher score represents more positive attitudes) overall (control 13.57 ± 3.15, treatment 15.61 ± 3.10; p<0.001) suggesting that BDS workshops have a significant positive effect on children’s attitudes towards dogs. The difference was also significant for all individual questions except question 4 (Table 4). The effect size was large (Cohen’s D 0.65), whereby the score of an average participant in the treatment group exceeds 73% of the scores of the control group. When picked at random there is a 66% chance of treatment participant scoring higher than a member of the control group.
Factors predicting ‘Be Dog Smart’ attitude scores.
The top model, reported below, included the variables treatment (intervention) and year group. Class-level factors were shown to explain 7% of the variance within total score. As described above, being part of the treatment group saw an increase in total score compared to the control group, and older year groups (years 5&6) were shown to score higher than younger year groups (Table 5).
Responsible Dog Ownership
How effective is a single Responsible Dog Ownership workshop in improving children’s attitudes towards responsible dog ownership?
The treatment group had significantly higher scores than the control group (higher score represents more positive attitudes) overall (control 22.97 ± 4.78, treatment 25.47 ± 5.06; p<0.001), suggesting that RDO workshops have a significant positive effect on children’s attitudes of responsibility towards dogs. The difference was also significant for all individual questions except question 4 (Table 6). The Cohen’s D effect size for total score was 0.51, whereby the score of an average participant in the treatment group exceeds 69% of the scores of the control group. When picked at random there is a 64% chance that a participant from the treatment group will have a higher score than someone picked randomly from the control group.
Factors predicting ‘Responsible Dog Ownership’ attitude scores.
The top model, reported below, included the variables treatment (intervention), year group, FSM% and gender. Furthermore, the model contained an interaction between gender and year group. Class-level factors were shown to explain 9% of the variance within total score. Being part of the treatment group again saw an increase in total score compared to the control group. Females had higher attitude scores than males, except for males in Year 6 who scored higher than females, and older year groups (years 5&6) were shown to score higher than younger year groups, with the exception of males scoring lower in year 4 & 5 than year 3. Finally higher FSM percentage groups scored lower in comparison to 0–20% FSM (Table 7).
Discussion
This study identified a significant difference between treatment and control scores for children attending Dogs Trust ‘Be Dog Smart’ and ‘Responsible Dog Ownership’ primary school workshops. We also identified an influence on questionnaire scores for gender (females scoring higher than males in RDO) and age (with older age groups scoring higher in both workshops). For social deprivation, results highlight that classes with a lower percentage of children receiving free school meals, often produce higher attitude scores within RDO workshops. Additionally, this study aimed to assess the feasibility of implementing a monitoring framework, using a controlled trial design to evaluate the impact of school workshops on children’s knowledge and attitudes about dogs within the constraints of normal operational requirements. This was intended to inform future Dogs Trust monitoring activities and to assist the development of assessment processes for interventional programmes delivered by other stakeholders involved in animal welfare education both in the UK and worldwide.
The aim of Dogs Trust’s Education workshops is to improve child learners’ attitudes towards dogs, and knowledge of responsible dog ownership. The results of this study are encouraging, indicating a significantly increased score (suggesting a more positive attitude) immediately following the delivery of the workshop to 7–11 year olds in the treatment group for both workshops as compared with the control group. There is an assumption in this work, which needs testing, that a change in attitude leads to behavioural change. Further studies are needed to investigate both long-term attitude, knowledge and behavioural changes whilst controlling for counfounding factors. Responses to question 4 (‘It is generally how I behave around a dog, that makes a situation safe or dangerous’) in the questionnaire were not significantly different between control and treatment scores for either workshop. During trialling phases, the tool was tested for feasibility only, and therefore ease of understanding or interpretation of question 4 may need reviewing. Whether question 4 is meaningiful to the participants and reflects the content delivered during the workshop may also need reviewing. Full scale development and validation of the tool [32] is required for future studies and to reassess inconsistencies. This will be incorporated into future trials. However, evidence suggests internal inconsistencies within tools are common in interventions involving children [33], and therefore question inconsistencies may be unavoidable.
The study also aimed to investigate possible variables that may influence the attitude of children after workshops. Previous research suggests dog ownership during childhood can result in greater empathy and prosocial attitudes in to adulthood [24] and that adulthood attitudes towards animal welfare positively correlate with pet ownership [34,35]. No influence on scores was detected between dog owners and non-dog owners in our study. This is similar to a previous study which found no difference between owners’ and non-owners’ empathy levels [36]. This suggests that education is equally important for all individuals, regardless of their pet ownership status.
Previous research has highlighted how socioeconomic influences can result in differences in knowledge attainment throughout education [23]. Prevalence of dog bite injuries resulting in hospitalisation have been suggested to be higher in lowest income areas measured in both urban and rural locations. We recorded the free school meal (FSM) percentage for each class, as a proxy indicator of socio-economic status [23]. For BDS, no relationship was detected. However, in RDO results, those with a lower FSM% scored higher than those with higher FSM%. The BDS and RDO workshops have similar participant profiles, therefore these mixed findings require further investigation to understand the root cause for the difference, including reviewing the structure of the two workshop types. A previous study proposed that education and prevention efforts should be suitably and carefully tailored and focused on particular areas/target groups [37] but the difference in the effect of socioeconomic status on outcome in our study suggests that the relationship between animal welfare education outcomes and socioeconomic status is not necessarily straightforward. Females demonstrated greater improvement in attitudes than males in our analysis for RDO workshops, which is not an uncommon finding [25], with previous studies finding females more likely to be more sympathetic towards animal welfare [26,27] and further develop recognition of internal emotions and sentience of animals [38]. Older children (years 5 and 6) scored significantly higher than younger children (years 3 and 4). However, the biggest effect was observed in the younger children. This combination of impact findings emphasises that ‘children’ as an audience should not be considered homogeneous.
An intrinsic consideration of likely influence on the outcomes should be the age-associated cognitive capabilities of the children receiving the intervention. Studies conducted with children aged under 7 suggest very limited evidence that a change in behaviour is likely to manifest in children this age as a result of gaining knowledge [39]. However more promisingly with interventions delivered to children aged over 7, there is evidence that learners can both sustain the change in attitudes at least a year after the intervention [40], and can demonstrate a change in actual behaviour around dogs [10]. Younger children may be more receptive of educational interventions in general, potentially due to the fact that they simply have more to learn [41]. With older children, there is also evidence that a standalone workshop delivered by an external organisation educator can have an even greater effect on childrens’ attitudes applying to behaviour change than a scheme of learning delivered by the children’s own teacher [42]. This is promising given the extent to which this ‘light touch’ single workshop approach is utilised by many animal welfare education programmes, amidst calls to integrate animal welfare into the UK curriculum [43].
Humans’ treatment of and feelings about animals are heterogeneous and subject to multiple personal and external influences. Animal welfare education programmes may be delivered in a multitude of countries and contexts, so a single programme’s causal framework or evaluations will only ever serve as marginally empirical. Effects and influences may differ from one context to another. Iterative M and E is vital to show whether what is being delivered is effective and to facilitate appropriate modifications of work programmes when objectives are not being met. Further to this, educational M and E should be viewed as a continual process of development to enhance education programs to optimise productivity with the aim of achieving human behaviour change in favour of animal welfare. Using structured monitoring of education activities in a large organisation facilitates identification of teams which are particularly successful, so that their approach can be shared across the organisation. Any unexpectedly lower contributions can be assessed to identify obstacles to achievement which can be addressed by changes in programme design and/or delivery. It also enables demonstration of effective use of supporters’ funds towards achievement of the ultimate goal.
Two key questions remain for an animal welfare education programme undertaking such a proof of concept evaluation:
- 1. Will the immediate effect of the treatment fade out before reaching the long term outcome?
While there is some evidence an improvement in animal welfare conducive attitudes can be sustained at least for a year [40], the heterogeneity of this field and associated differing outcomes warrants an ‘action research’ approach whereby each programme conducts their own longitudinal assessments allowing for maximum external validity of evaluative findings [44]. Should the change in attitudes associated with workshop attendance fade out quickly, a resulting change in behaviour is unlikely.
- 2. Will the change in attitudes that can be evidenced result in a change in behaviour?
A change in attitudes may be viewed as an intrinsic causal step towards the achievement of behaviour change, but it cannot be assumed that interventions that influence attitude necessarily lead to behavioural change [45]. For example, a sizeable treatment effect on responsible parenting attitudes was observed when an infant simulator doll was used as an educational intervention aimed at reducing teenage pregnancy [46]. However almost a decade later Brinkman et al [47] conducted a large scale RCT of the behaviour change arising from this intervention and found the treatment group were significantly more likely to become pregnant in their teenage years. The intervention was effective at changing attitudes but counter effective at changing behaviour—a salient reminder that making an assumption of links between short term changes and long term outcomes is risky. Hence, although this paper identifies a change in attitude subsequent to a single animal welfare education intervention, it cannot be assumed that behaviour change necessarily follows. Nevertheless, this paper demonstrates the feasibility of developing a protocol of M and E for animal welfare education programs, and is a starting point for further work investigating longer term influences on behaviour change. The heterogeneity of audience and contexts means that local M and E in each programme is essential to build understanding of factors affecting success in different contexts. Our own trial was relatively inexpensive and logistically feasible with minimal disruption to an already existing educational workshop process. It did not require substantial in depth training or additional skills for wider education team members. The methodology was relatively easy to follow and required little practical adaptation to what an existing education programme was undertaking in schools. Some level of expertise in impact assessment methodology and statistical approaches is necessary to develop the framework for this type of programme, and embedding these skills in the management or staffing of programmes to evaluate impact is an important consideration for animal welfare organisations.
Limitations
This study only investigated short-term effects of an educational intervention on measures of attitudes and knowledge. Whilst the intervention had a positive outcome, this does not directly demonstrate the behaviour change this programme seeks to achieve. The possibility of ‘fade-out’ post-intervention, and how this is affected by the age at which children participate remain to be investigated. This study involved a convenience sample of schools throughout the UK, with purposive sampling of schools within the available population to facilitate inclusion of a range of values for variables of interest as far as possible, depending on invitations received from schools. Randomisation was only feasible at participant level within a given class. Since schools had to have requested the actual intervention before being invited to participate within this research study, an inherent selection bias arising from schools that wish to host a canine welfare educational intervention potentially not being representative of the general population of schools is unavoidable.
It should be noted that no valid pre-existing tool was relevant to the specific outcomes of our intervention and therefore our own tool was created. Pre-testing involved piloting the tool with 120 children to assess age suitability and ease of completion. Therefore, the inconsistencies in our results may be explained by the lack of validity and reliability of the tool. However, evidence suggests inconsistencies are common in interventions involving children [33], therefore this may not be avoidable. Full validation of the tool is required for future studies and the inconsistencies reassessed, this will be monitored across future trials. The data are also subject to potential biases, relating to social desirability bias and hawthorne effect, where participants in the study may have responded to the tool in a manner they consider to be more accepted as the correct answer [28,48]. Care was taken to minimise such biases by training the delivering team to clearly communicate to learners how important ‘honest’ answers were over ‘correct’ answers, and through using a between-subject versus a with subject study design. Care was taken to ensure that constraints involving the pupils’ ability to complete the questionnaires, such as literacy ability or English as an additional language, were identified without causing any embarrassment to the individual participant. Pupils were advised that if they found the questionnaire too hard to read and complete alone, that it was not a problem and to simply let the Education Officer or their teacher know by raising their hand. In the event of occurrence, the pupil’s questionnaire was discreetly taken from them and omitted. As this took place in the classroom the number of these omitted questionnaires was not recorded, they were discarded on the day and not included in this study. It should be noted that this could therefore result in selection bias favouring pupils with greater literacy or language skills, however due to practicalties of conducting research in schools this method of approach was deemed the most appropriate.
Conclusion
Our study concludes that the Dogs Trust education programs effectively communicate our key messages as we found a significant difference between the scores of the control and treatment groups, whereby those that received the workshop recorded more positive attitudes towards dogs. We identified that year group (BDS and RDO), gender (RDO) and FSM% (RDO) significantly influenced total score, and therefore highlighted the need for appropriately tailored workshop content for the target audience. We also demonstrate that monitoring of existing programs is feasible, and forms a basis for longer term studies. The findings of impact assessments can increase the likelihood of delivering successful educational programmes that result in positive changes which improve animal welfare. A causal framework such as a ToC can be utilised as a first step for education programmes’ development of an M and E structure. There is a need for more structured M and E processes to be placed around animal welfare education, and it is important for each programme to develop monitoring relevant to their own context of activity. Reducing bias and randomising interventions as much as possible is an important element for evaluating the impact of these types of programmes, and ensuring collaboration with researchers familiar with these constraints is an important consideration. Longitudinal research of educational interventions and human behaviour change evaluation is also warranted to inform the animal welfare sector about the effectiveness of educational intervention in supporting behaviour change both in the short and longer-term.
Supporting information
S1 File. Tool used for data collection of attitudes towards safety around dogs.
https://doi.org/10.1371/journal.pone.0230832.s001
(DOCX)
S2 File. Tool used for data collection of attitudes toward responsible ownership.
https://doi.org/10.1371/journal.pone.0230832.s002
(DOCX)
S3 File. Lesson plan material for Be Dog Smart workshops for KS2 learners.
https://doi.org/10.1371/journal.pone.0230832.s003
(DOCX)
S4 File. Lesson plan material for Responsible Dog Ownership workshops for KS2 learners.
https://doi.org/10.1371/journal.pone.0230832.s004
(DOCX)
S5 File. Akaike’s information criterion candidate models for explaining effect of predictor variables on total attitude scores for a Be Dog Smart workshop, controlled at class level.
k, number of parameters; lokLik, log likelihood; AIC, Akaike’s information criterion; ΔAIC, difference in AIC compared with the model with the lowest AIC; wi, model weight; Retained, models within delta-6 AIC are not retained if they are more complex versions of nested models with better AIC support; Treatment, Random assignment of learner in to either treatment or control group; FSM, Free school meal percentage for participant’s class; Year, year group of participant; Gender, gender of participant; DO, dog ownership status of participant.
https://doi.org/10.1371/journal.pone.0230832.s005
(DOCX)
S6 File. Akaike’s information criterion candidate models for explaining effect of predictor variables on total attitude scores for a Responsible Dog Ownership workshop, controlled at class level.
k, number of parameters; lokLik, log likelihood; AIC, Akaike’s information criterion; ΔAIC, difference in AIC compared with the model with the lowest AIC; wi, model weight; Retained, models within delta-6 AIC are not retained if they are more complex versions of nested models with better AIC support; Treatment, Random assignment of learner in to either treatment or control group; FSM, Free school meal percentage for participant’s class; Year, year group of participant; Gender, gender of participant; DO, dog ownership status of participant.
https://doi.org/10.1371/journal.pone.0230832.s006
(DOCX)
Acknowledgments
The authors would like to thank Dogs Trust for providing funding for this project and publication. Furthermore, this paper would not have been possible without the contribution of the following Dogs Trust Education department team members: Joanna Robertson for data input and management and Alison Donald, Alison Gray, Anthea Holloway, Angela Madigan, Bethan Richardson, Cathy Clyde, Claire Kendrick, Charlotte Paddock, Emma-Jo Hill, Gemma Kelly, Helen Peake, Jo Cullum-Fernandez, Joanne Goodman, Kelly Craig, Rachel Bliss and Sarah Saunders for their contributions to the data collection. We would finally like to thank all schools, teachers and children that participated in this study.
References
- 1.
Legislation.gov.uk. Animal Welfare Act 2006. 2006;2006: 1–30. http://www.legislation.gov.uk/ukpga/2006/45/pdfs/ukpga_20060045_en.pdf
- 2. Royal Society for the Prevention of Cruelty to Animals. Prosecutions Annual Report 2015. 2015; 1–32.
- 3. McGreevy P, Starling M, Payne E, Bennett P. Defining and measuring dogmanship: A new multidisciplinary science to improve understanding of human–dog interactions. Vet J. 2017;229: 1–5. pmid:29183567
- 4. Ascione FR. Humane education research: Evaluating efforts to encourage children’s kindness and caring toward… Genet Soc Gen Psychol Monogr. 1997;123: 59.
- 5. Hawkins RD, Williams JM, Scottish Society for the Prevention of Cruelty to Animals. Assessing Effectiveness of a Nonhuman Animal Welfare Education Program for Primary School Children. J Appl Anim Welf Sci. 2017; 1–17. pmid:28368662
- 6. Mariti C, Papi F, Mengoli M, Moretti G, Martelli F, Gazzano A. Improvement in children’s humaneness toward nonhuman animals through a project of educational anthrozoology. J Vet Behav Clin Appl Res. 2011;6: 12–20.
- 7. Tardif-Williams CY, Bosacki SL. Evaluating the impact of a humane education summer-camp program on school-aged children’s relationships with companion animals. Anthrozoos. 2015;28: 587–600.
- 8. Nicoll K, Trifone C, Ellery Samuels W. An in-class, humane education program can improve young students’ attitudes toward animals. Soc Anim. 2008;16: 45–60.
- 9. Shen J, Rouse J, Godbole M, Wells HL, Boppana S, Schwebel DC. Systematic Review: Interventions to Educate Children about Dog Safety and Prevent Pediatric Dog-Bite Injuries: A Meta-Analytic Review. Journal of Pediatric Psychology. 2017. pp. 779–791. pmid:26773009
- 10. Chapman S, Cornwall J, Righetti J, Sung L. Preventing dog bites in children: randomised controlled trial of an educational intervention. Bmj. 2000;320: 1512–1513. pmid:10834894
- 11.
House of Commons. Environment, Food and Rural Affairs Committee: Oral evidence: Dangerous Dogs: Breed Specific Legislation, HC 1040. 2018.
- 12.
Environment Food and Rural Affairs. Controlling dangerous dogs. www.parliament.uk. 2018.
- 13. Norris E, Finnerty A, Hastings J, Stokes G, Michie S. Identifying and evaluating ontologies related to human behaviour change interventions: a scoping review. Nat Hum Behav. 2019.
- 14. Michie S, van Stralen MM, West R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6. pmid:21513547
- 15. Reed K, Upjohn MM. Better Lives for Dogs: Incorporating Human Behaviour Change Into a Theory of Change to Improve Canine Welfare Worldwide. Front Vet Sci. 2018;5. pmid:29892603
- 16. Dogs Trust. LEARN WITH DOGS TRUST. 2018. https://www.learnwithdogstrust.org.uk/
- 17.
Piaget J. The Construction of Reality in the Child. The Construction of Reality in the Child. New York: US: Basic Books; 1954. p. 386. https://doi.org/10.1037/11168-000
- 18.
McLeod S. Concrete Operational Stage. In: Simply Psychology [Internet]. 2010 [cited 19 Dec 2018]. https://www.simplypsychology.org/concrete-operational.html
- 19.
PSHE Association. PSHE Education Programme of Study. 2017. https://doi.org/10.1007/s11012-011-9532-z
- 20.
Department for Education. The national curriculum in England. 2013. https://doi.org/10.1080/09571739185200191
- 21. Lakestani N, Donaldson ML. Dog bite prevention: Effect of a short educational intervention for preschool children. PLoS One. 2015;10. pmid:26287686
- 22. Jalongo MR. Beyond a pets theme: Teaching young children to interact safely with dogs. Early Child Educ J. 2008;36: 39–45.
- 23. Banerjee PA. A systematic review of factors linked to poor academic performance of disadvantaged students in science and maths in schools. Cogent Education. 2016.
- 24. Daly B, Morton LL. Empathic differences in adults as a function of childhood and adult pet ownership and pet type. Anthrozoos. 2009;22: 371–382.
- 25. Taylor N, Signal TD. Empathy and attitudes to animals. Anthrozoos. 2005. pp. 18–27.
- 26. Herzog HA. Gender differences in human-animal interactions: A review. Anthrozoos. 2007. pp. 7–21.
- 27. Knight S, Vrij A, Cherryman J, Nunkoosing K. Attitudes towards animal use and belief in animal mind. Anthrozoos. 2004. pp. 43–62.
- 28. Cook DL. The Hawthorne effect in educational research. Phi Delta Kappan. 1962;44: 116–122.
- 29.
R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2019. https://www.r-project.org/.
- 30. Harrison XA, Donaldson L, Correa-Cano ME, Evans J, Fisher DN, Goodwin CED, et al. A brief introduction to mixed effects modelling and multi-model inference in ecology. PeerJ. 2018. pmid:29844961
- 31. Richards SA, Whittingham MJ, Stephens PA. Model selection and model averaging in behavioural ecology: The utility of the IT-AIC framework. Behav Ecol Sociobiol. 2011.
- 32. Boateng GO, Neilands TB, Frongillo EA, Melgar-Quiñonez HR, Young SL. Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Front Public Heal. 2018;6: 149. pmid:29942800
- 33. Spiliotopoulou G. Reliability reconsidered: Cronbach’s alpha and paediatric assessment in occupational therapy. Aust Occup Ther J. 2009;56: 150–155. pmid:20854508
- 34. Paul ES, Serpell J a. Childhood Pet Keeping and Humane Attitudes in Young Adulthood. Anim Welf. 1993;2: 321–337.
- 35. Paul ES. Empathy with animals and with humans: Are they linked? Anthrozoos. 2000;13: 194–202.
- 36. Daly B, Morton LL. Children with pets do not show higher empathy: A challenge to current views. Anthrozoos. 2003. pp. 298–314.
- 37. Raghavan M, Martens PJ, Burchill C. Exploring the relationship between socioeconomic status and dog-bite injuries through spatial analysis. Rural Remote Heal. 2014;14: 2846.
- 38. Cornish A, Wilson B, Raubenheimer D, McGreevy P. Demographics Regarding Belief in Non-Human Animal Sentience and Emotional Empathy with Animals: A Pilot Study among Attendees of an Animal Welfare Symposium. Animals. 2018;8: 174. pmid:30287771
- 39. Schwebel DC, Morrongiello BA, Davis AL, Stewart J, Bell M. The blue dog: Evaluation of an interactive software program to teach young children how to interact safely with dogs. J Pediatr Psychol. 2012;37: 272–281. pmid:22173883
- 40. Ascione FR, Weber C V. Children’s attitudes about the humane treatment of animals and empathy: One-year follow UP of a school-based intervention. Anthrozoos. 1996;9: 188–195.
- 41. Samuels WE. Nurturing kindness naturally: A humane education program’s effect on the prosocial behavior of first and second graders across China. Int J Educ Res. 2018;91: 49–64.
- 42. Dupas P, Huillery E, Seban J. Risk information, risk salience, and adolescent sexual behavior: Experimental evidence from Cameroon. J Econ Behav Organ. 2018;145: 151–175.
- 43.
Animal Welfare Education Alliance. Pet Education Resources. [cited 19 Nov 2018]. http://www.peteducationresources.co.uk/
- 44. Sagor R. Guiding school improvement with action research. Educational Leadership. 2000. pp. 1–232. http://books.google.com/books?hl=en&lr=&id=4KQHuAkSuzMC&oi=fnd&pg=PR7&dq=Guiding+School+Improvement+With+Action+Research&ots=cz-pemoBgu&sig=IPacsfWu3W0Y9xzFdb1euDveBYo
- 45. Hargreaves T. Practice-ing behaviour change: Applying social practice theory to pro-environmental behaviour change. J Consum Cult. 2011;11: 79–99.
- 46. Strachan W, Gorey KM. Infant simulator lifespace intervention: Pilot investigation of an adolescent pregnancy prevention program. Child Adolesc Soc Work J. 1997;14: 171–180.
- 47. Brinkman SA, Johnson SE, Codde JP, Hart MB, Straton JA, Mittinty MN, et al. Efficacy of infant simulator programmes to prevent teenage pregnancy: a school-based cluster randomised controlled trial in Western Australia. Lancet. 2016;388: 2264–2271. pmid:27570178
- 48. McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects. J Clin Epidemiol. 2014;67: 267–277. pmid:24275499