Figures
Abstract
Associative learning is essential for resource acquisition, predator avoidance and reproduction in a wide diversity of species, and is therefore a key target for evolutionary and comparative cognition research. Automated operant devices can greatly enhance the study of associative learning and yet their use has been mainly restricted to laboratory conditions. We developed a portable, weatherproof, battery-operated operant device and conducted the first fully automated colour-associative learning experiment using free-ranging individuals in the wild. We used the device to run a colour discrimination task in a monitored population of tits (Paridae). Over two winter months, 80 individuals from four species recorded a total of 5,128 trials. Great tits (Parus major) were more likely than other species to visit the devices and engage in trials, but there were no sex or personality biases in the sample of great tits landing at the devices and registering key pecks. Juveniles were more likely than adults to visit the devices and to register trials. Individuals that were successful at solving a novel technical problem in captivity (lever-pulling) learned faster than non-solvers when at the operant devices in the wild, suggesting cross-contextual consistency in learning performance in very different tasks. There was no significant effect of personality or sex on learning rate, but juveniles’ choice accuracy tended to improve at a faster rate than adults. We discuss how customisable automated operant devices, such as the one described here, could prove to be a powerful tool in evolutionary ecology studies of cognitive traits, especially among inquisitive species such as great tits.
Citation: Morand-Ferron J, Hamblin S, Cole EF, Aplin LM, Quinn JL (2015) Taking the Operant Paradigm into the Field: Associative Learning in Wild Great Tits. PLoS ONE 10(8): e0133821. https://doi.org/10.1371/journal.pone.0133821
Editor: Nigel E. Raine, University of Guelph, CANADA
Received: May 13, 2014; Accepted: July 2, 2015; Published: August 19, 2015
Copyright: © 2015 Morand-Ferron et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was funded by a Natural Environment Research Council grant (NE/I017208/1) to JLQ, and EFC was funded by a Leverhulme grant (RPG-265) (http://www.leverhulme.ac.uk/) to JLQ. JMF was funded by a NERC grant (NE/I017208/1) and a Natural Sciences and Engineering Research Council Discovery grant (435596-2013). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Cognition–the processes by which animals collect, store and use information from their environment [1]—has traditionally been studied in captivity, using either lab-raised or wild-caught animals. This allows the control of external factors that could impact on performance during tests, and trials can be administered to targeted subjects on experimenter-defined schedules. However, more recently researchers have begun to develop cognitive assays that can be conducted in the wild, with free-ranging individuals interacting with devices or being tracked in their natural environment [2,3,4,5,6]. This has the advantage of reducing stress linked with capture and housing, and therefore avoiding potential problems associated with interactions between individual stress responses and cognitive performance [7,8]. Moreover, performance is then expressed in a context where the costs and benefits of cognitive processes are consistent with those normally experienced by individuals, with trials occurring under unconstrained group size, habitat complexity, time of day, etc. Combining field experiments and captive assays thus is a valuable approach that could help to achieve both ecological relevance and experimental control, respectively. This integrated approach has been applied for social learning [9,10] and innovative problem solving [11,12,13,14]; here we aim to develop this approach further for associative learning.
Associative learning—a behavioural modification following reinforcement, based on associations between stimuli, or between stimuli and responses–has been found in all bilateral animals tested to date [15,16]. This conserved cognitive process is key to the development of several behaviours, including those involved in foraging [4,17], predator avoidance [18,19], and reproduction [20,21]. Associative learning is therefore an important focus for evolutionary and comparative cognition research [16,22,23].
Several devices and protocols for studying learning and memory have been used in the field, including artificial flowers [5,24,25], differently-coloured feeders [26], and mazes [2,27]. However these studies have often required the experimenter to be present in the field during the presentation of experimental cues and assays. This may influence the behaviour of animals, and is likely to considerably limit the amount of data that can be collected. Automated operant conditioning devices offer a solution to these limitations [28,29]. In operant conditioning experiments, subjects learn to exhibit a behavioural response upon detecting a stimulus (e.g. light or sound) that predicts reinforcement or punishment. However for technical, conceptual and logistic reasons the use of Skinner boxes has traditionally been restricted to laboratory settings (i.e. permanent chambers linked to a central computer).
Here we report on a new portable operant research device that can be used in both field and captive conditions. The device functions as an “inverted”, free operant conditioning chamber, in which subjects that visit voluntarily can proceed to learning trials via an automated process. This approach builds upon earlier work on learning in flocks of free-ranging pigeons [30,31] and socially-housed monkeys [32,33]. In contrast to most operant systems, our device is battery-operated and can be fitted within a 30 x 20 x 30 cm space, allowing its use in the wild away from mains electrical power (see also[34]). It also features a simple technical innovation that removes the need to engage in shaping of the operant response (e.g. [26,35]), i.e. clear response keys containing food that act as an attractant for free-ranging subjects, but can never be taken or depleted.
This presentation of a free-access cognitive testing device in natural settings could however lead to sampling bias, if some individuals are preferentially visiting and using the device [36,37]. Experimental protocols involving novel objects may elicit avoidance in individuals with neophobic personality types [38], or by those that have better access to other resources (e.g. adults compared to juvenile [13]). For instance, individuals that are more active in novel room assays(i.e. “fast explorers” as opposed to “slow explorers” [39]) could be more likely to encounter, contact, and use the devices, due to increased activity rates [37] and a higher propensity to take risks [39,40,41]. It is therefore an important step in the development of field studies on animal cognition to examine the composition of individuals participating in the experiments. Here we take advantage of knowledge derived from the marked population of parids in our long-term study population to assess species, age, sex and personality (exploration) biases in the sample of birds contributing to our wild associative learning experiment.
Empirical evidence for the existence of individual differences in cognitive performance in various cognitive domains has accumulated in the past years [42,43], and have recently been examined in the context of evolutionary ecology studies in natural populations (reviewed in [44, 45]). While there is some evidence for individual differences in associative learning performance within natural populations [26,46,47,48,49,50], little is known about the consistency of these differences across ecological contexts or their impact on life-history traits and fitness in natural populations [44].
Here we examine the link between problem-solving performance at a novel foraging task in captivity [51,52] and learning rate at operant devices in the wild. Though yet to be shown definitively, success at the captive lever-pulling task has been suggested to be mediated by operant learning [52,53]. More accurate colour-associated learning in the wild by those solving problems in captivity would suggest that individual differences in learning performance are robust to drastic variation in the socio-ecological context and the type of learning involved (i.e. operant learning for a motor task vs. colour-based discrimination). Moreover, we examine the effects of sex and age on learning rate, and test the hypothesis that fast explorers are faster at forming simple behavioural associations [47,54,55] and thus at learning an association between colour and food rewards.
Our main goals were therefore to; (1) develop and test an automated operant device and protocol in field conditions; (2) determine any species, sex, age class, or exploration biases in the population of individuals that landed at the devices and recorded trials (i.e. “sampling biases”); (3) compare learning rates of successful and unsuccessful problem-solvers; and (4) to examine individual determinants (sex, age, and exploration score) of learning rate in the wild. We used automated data outputs to examine the sequence of choices made by marked individuals in a simple colour association test. The learning test consisted of a simultaneous discrimination procedure, in which pecking the red key once was rewarded 100% of the time (fixed ratio 1 schedule), and pecking the yellow or green keys was never rewarded. The position of colour cues was varied pseudo-randomly between trials to ensure that birds learnt colour rather than spatial position as a predictor of reward.
Material and Methods
Study site and subjects
The study took place in Wytham Woods, Oxfordshire, UK, from 5 January to 3 March 2012. In the context of another study targeting mixed-species flocks of tits in Wytham, great, blue (Cyanistes caeruleus), coal (Periparus ater), and marsh tits (Poecile palustris) were caught in mistnets, each fitted with a PIT (passive integrated transponder) tag [56,57] leg-band in addition to the standard metal leg-ring from the British Trust for Ornithology. All birds were sexed and aged (juvenile/adult) based on plumage [58]. While any bird could potentially visit the operant devices, only individuals equipped with a PIT-tag could be detected when landing on the device; our target sample therefore comprised marked individuals from these four tit species. The proportion of marked great tits in Wytham was estimated at 90% [59].
Species, sex and age composition of the overall population was extracted from a grid of 65 sunflower feeders fitted with RFID antennae that collected spatio-temporal flocking data throughout Wytham woods from December 2011 to March 2012 [60,61]. Given that food was freely available throughout the wood, and that individuals could not dominate feeders, it is assumed that any bias in visitations to feeders was negligible [62]. Secondly, a personality trait, exploration behaviour of a novel environment, was assayed on great tits taken into captivity over 24h between 2007 and 2012. Exploration score captures the behaviour of individuals when placed in a novel room and is calculated using the number and duration of flights, number of hops and the areas of the room utilized during an 8 minute assay [63]. The final score is generated using the first component from a principal component analysis on all of these measures (see [63] for complete methodological details). This trait has been demonstrated to be heritable, is linked to competitive ability, promiscuity and social behaviour in the wild, and is associated with variation in parental care, dispersal, and reproductive success in this population [52,59,63,64,65,66]. Finally, as per another study [52], problem-solving performance was assessed in isolation in captivity the evening and morning preceding the exploration test; birds were exposed to inaccessible waxworms in a clear Perspex tube upon their housing following capture in Wytham woods [52]. To obtain the waxworms, a bird had to pull out the lever, which caused the worms to fall in the receptacle at the bottom of the tube. While nearly all birds collected the free waxworm deposited in the receptacle at the beginning of the trial, only 44% solved the lever-pulling problem (see [51] for details). Problem-solving assays were run in the autumn and winter of 2007 to 2012, and have been shown to predict competitive ability, parental provisioning behaviour and several reproductive life history traits linked with fitness [52,67]. All birds were released at their point of capture in the woods after a short captivity period (24h to 5 days).
Portable operant devices
We used five identical operant devices for this experiment (Fig 1 and S1 Fig; see also S1 Text and S1–S3 Movies). Each device was composed of (i) weatherproof (Perspex) external casing; (ii) a printed circuit board (PCB); (iii) three response keys; (iv) a motor-activated feeding wheel; and (v) a PIT-tag detection system. The external casing had two hooks on each side so that the device could be installed on wooden stakes planted in the ground (~1.5 m high). The PCB (“Darwin board” designed by Stickman Technologies Inc., UK) receives information from the PIT tag detection system and the response keys, and determines the state of the response keys and of the motor activating the feeding mechanism. The front panel of the operant device was freely available to any wild individual and displayed three response keys located 1 cm from each other, and 1.5 cm above a central feeding hole by which only one reward could be taken. Each key was made up of a circular, transparent plastic container (1.5 cm diameter) held in place in a hole on the front panel by elastics installed within the device, such that even a very light pressure would break a light beam and convey information to the PCB that a choice had been made.
The weatherproof external casing is made of opaque Perspex, while the three response keys and the section of the front panel comprising the feeding hole are transparent. The perch (bottom of the front panel) is equipped with an antenna that relays information about the unique PIT-tag combination of marked individuals to the printed circuit board located within the device.
To elicit pecking at the keys without having to shape this response through successive steps (e.g. [35]), we placed four live mealworms (Tenebrio molitor) inside each transparent response key. These were visible to a bird landing on the device but could never be taken. The learning program instructed each response key to light up either red, yellow or green with Red-Green-Blue light-emitting diodes, while not using the same colour in the same location more than twice in a row (i.e. a pseudo-random colour sequence to avoid the possibility of spatial learning). To obtain a food reward, individuals had to press the response key that was lit up red (fixed ratio 1 schedule), thereby activating the feeding wheel (<1s) and returning the program to its initial state after 2s. Pressing yellow or green led to no reward and an immediate delay of 15s before a new trial would start. This delay acted as a punishment, preventing birds that made an incorrect choice from immediately beginning another trial. We chose red as the rewarded colour because it is a common aposematic coloration and was expected to be a non-preferred option based on previous experiments in birds [68,69,70]. The observed proportion of initial pecks to the red option did not differ significantly from the random expectation of 33.3% (N = 67, one-sample t-test: t = 0.968, d.f. = 66, p = 0.337). We used two non-rewarding colours instead of one to reduce the probability of exhibiting correct choices randomly. The feeding wheel was made of transparent Perspex and featured 48 wells, each 0.8 cm deep and baited with one half-mealworm. Mealworms are a highly preferred food item for tits, particularly compared with the food available in Wytham’s winter environment, which is mainly seed-based (e.g. beechmast; [71]). Finally, once the 48 rewards were depleted, operant devices turned themselves off.
The identity of PIT-tagged individuals landing at the device was relayed to the PCB by an antenna located in the perch (Dorset Identification, NL). This perch was a horizontal plane of 10cm x 5cm x 1cm and was small enough to hold only one bird at once, but large enough to give access to all three keys on the front panel. The whole system for each device was powered by a 12V sealed lead-acid battery; a 12Ah battery was enough to power a device for at least three days in winter conditions. When the device was powered on (i.e. almost continuously over the experimental period for each location), all keys were illuminated and the timing of visits and PIT combination, as well as the timing and colour choice for each peck, were recorded automatically on an output file stored on a SD card. A visit recorded the time when a PIT-tagged bird landed on the device, whether it pecked at the keys or not (“visit”). A “trial” was defined as a key peck when the keys would be illuminated with colours and a choice had thus been made (see S1 Text).
Field protocol
Operant devices were deployed at four locations across Wytham Woods. Sites featured an open area with nearby tree cover from which the birds could come and perch on the devices. We first baited each location for several days with a regular multi-access feeder containing sunflower seeds, before installing either two (N = 2 locations) or three operant devices (N = 2 locations) 1m from tree cover, 3 to 8 m from each other, and placing a few mealworms on the roof of each device. We used two to three devices per location to reduce monopolisation of devices by dominant individuals. We then activated the operant devices (see below) and allowed the sunflower feeder to be depleted, refilling it bi-weekly until birds started to peck regularly at the operant devices. Devices were left in place for 26, 18, 21 and 11 days, respectively at each location; devices were removed when depletion rate became high, indicating that no new birds were likely to be given the chance to learn. During this period we changed batteries every 3 days and refilled rewards within devices when they were depleted (no more than twice per day).
Statistical analysis
We examined species, sex, age class, problem-solving performance and exploratory personality biases among birds that landed at the devices at least once, or registered at least one trial (key peck). The proportion of different species, sexes, age classes, and of solvers (vs. non-solvers) visiting the devices and recording trials were compared with the proportion of birds not visiting the devices or recording trials in the wider Wytham woods population using a Chi-square test with Yates’s continuity correction. Mean exploration score in these groups was compared using two-group t-tests.
We assessed colour-based associative learning by testing for improvement in colour choice accuracy over successive trials by individual birds. Because the number of trials was different for all birds, we scaled trial number by the highest number of trials recorded by any individual (n = 700 trials). We used generalised linear mixed models (GLMM, function “glmer”) with correct (red = 1) vs. incorrect (yellow, green = 0) choice as the response variable, and individual identity as a random intercept. A positive and significant fixed term for trial number would be evidence for learning of the colour-based association. A significant interaction between the random term for ID and trial number (i.e. significant random slope) would be evidence for individual differences in learning rates, and was assessed using the log-likelihood ratio test (LRT) [72,73,74]. Finally, we examined the effect of problem-solving success, age class, sex, and exploration personality score on the rate of learning by testing for significant interactions between each of these terms and trial number. All other individual variables, as well as site and inter-trial interval (log-transformed) were controlled for as fixed factors. Each model included significant random terms (i.e. intercept and slope). Results were qualitatively the same when other individual predictors were excluded (not shown). All analyses were conducted in R version 3.2.0 [75].
Ethics statement
Work was subject to review by the Department of Zoology ethical committee, University of Oxford. All work adhered to UK standard requirements and was carried out under Natural England licence 20114732. Field work took place in Wytham Woods (lat 51°46’N, long 1°20’W), private land that belongs to the University of Oxford; for permission contact the Conservator, Nigel Fisher. No endangered or protected species were involved in the study.
Results
Which species used the free-operant devices?
We recorded 7,480 visits to the operant devices by 144 PIT-tagged birds (Table A in S2 Text). Eighty of these birds (55.6%) registered at least one trial by pecking at one of the three keys (range 1–700 trials per individual), with 5,128 trials recorded across all birds. Great tits recorded the highest number of trials (N = 5,086), followed by blue tits (N = 32), marsh tits (N = 9) and coal tits (N = 1; Table A in S2 Text). The proportion of great tits having recorded at least one visit and at least one trial was higher than the proportion among the four Parid species wintering in Wytham (Table 1; visits: Χ2 = 31.3, d.f. = 1, p < 0.001; trials: Χ2 = 68.2, d.f. = 1, p < 0.001). On average, great tits collectively recorded 66.9 trials per day per site, with this value reaching an average of 698 trials per site on the last complete day of data collection (mean ± s.e. number of trials per individual great tit = 75.9 ± 19.4; See also Table A in S2 Text).
Statistics are shown for individuals that visited devices at least once (Visited), and for those that had pecked at least one key (Pecked).
Sex, age class and personality biases in use of the devices by great tits
The sex ratio of great tits having recorded at least one visit and at least one trial was not significantly different from the sex ratio in the wintering population (Table 2; visits: Χ2 < 0.01, d.f. = 1, p = 0.976; trials: Χ2 = 0.003, d.f. = 1, p = 0.956). However, the proportion of juveniles having recorded at least one visit and at least one trial was greater than the corresponding proportion in adults (Table 3; visits: Χ2 = 8.92, d.f. = 1, p = 0.003; trials: Χ2 = 8.61, d.f. = 1, p = 0.003). The proportion of problem-solvers who registered visits or trials at the devices did not differ from that of non-solvers (visits: Χ2 = 0.57, d.f. = 1, p = 0.451; trials: Χ2 = 0.006, d.f. = 1, p = 0.941). Mean exploration score did not differ between great tits that had (and had not) recorded at least one visit at the device (-0.326 ± 0.048 vs. -0.319 ± 0.067), or amongst those that had (and had not) pecked at least one key (-0.033 ± 0.032 vs. -0.276 ± 0.073; visits: t = -1.0, d.f. = 51.7, p = 0.924; trials: t = -0.71, d.f. = 39.5, p = 0.479).
Statistics are shown for individuals that visited devices at least once (Visited), and for those that had pecked at least one key (Pecked). Individuals that had been marked as chicks and not sexed a posteriori (N = 3), and those not recorded on the regular grid of feeders (N = 1; see Methods for details) were not included in the analyses.
Statistics are shown for individuals that visited devices at least once (Visited), and for those that had pecked at least one key (Pecked). Individuals not recorded on the regular grid of feeders (N = 1; see Methods for details) were not included in the analyses.
Colour-based associative learning in the wild
Individual great tits (N = 67) improved their colour choice accuracy over successive trials in the field (trial number: Χ2 = 563.2, d.f. = 1, p < 0.001; see Fig 2 for examples). Furthermore, there were significant individual differences in learning rate over trials (Χ2 = 29.1, d.f. = 1, p < 0.001). We explored determinants of this individual variation in learning performance for great tits of known sex, age class, personality and problem-solving success (N = 21). We found that: (i) solvers learned faster than non-solvers (Fig 3A; Χ2 = 5.3, d.f. = 1, p = 0.021); (ii) juveniles showed a marginally non-significant tendency to learn faster than adults (Fig 3B; Χ2 = 3.5, d.f. = 1, p = 0.061); but there was no effect of (iii) sex (Fig 3C; Χ2 = 0.4, d.f. = 1, p = 0.547), or of (iv) exploration score on learning rate in the field (Fig 3D; Χ2 = 0.97, d.f. = 1, p = 0.326) (see also Tables B-E in S2 Text).
One panel per individual (N = 16 birds; only individuals having recorded 50 trials or more are shown).
(a) non-solvers vs. solvers; (b) adults vs. juveniles; (c) females vs. males; and (d) fast explorers vs. slow explorers. Note that exploration score was analysed as a continuous variable but was split into 50% slower birds vs. 50% fastest explorers for illustration purposes.
Discussion
We developed a portable, automated operant device and tested a research protocol for the measurement of associative learning in free-ranging songbirds. Wild parids landed on the free-operant device, and great tits could learn to obtain food rewards by pecking at the red-lit key, but not at the green or yellow-lit keys. Our devices were therefore successful in administering learning trials without the need to shape or train individuals before test trials, or requiring an experimenter to be present during the trials. This is, to our knowledge, the first time a fully-automated colour-associative learning test recording individual behaviour has been administered to free-ranging animals.
The experimental protocol was successful in attracting a large number of free-ranging individuals to the devices: 144 PIT-tagged birds visited the devices within two months of automated field observations. All species were able to register trials at the devices but only great tits proved to be a useful model species for this type of study at Wytham, with 76% of individuals visiting the devices registering at least one trial. It is possible that species differences arose from differences in body size, and that the ca. 100% larger great tit [61,76] found it easier to peck the keys, and faced relatively lower energy costs when doing so. Alternatively they may have been more likely to exhibit a pecking motor action than other species. We suggest that species differences in visit and trial registration at the devices was not due to aggressive monopolisation of the device by great tits because we installed two to three replicates of the devices at each site, and there were long periods when no bird was present at one or several devices.
The sex ratio and mean exploration score of individual great tits using the devices did not differ significantly from the rest of the tagged population, suggesting that the experimental sample was not biased in these respects. It might have been expected that fast explorers should be more likely to encounter the devices due to increased activity rate [37], and more likely to use the device due to lower levels of neophobia and a higher propensity to take risks [39,40,41]. However the long duration of the experiment might have allowed novelty responses to reduce with time, eliminating personality biases in the sampled population, analogously to the process of familiarisation used in captive studies of cognition (e.g. [49]). Juveniles were more prevalent in the experimental sample than in the wintering population in terms of both those that visited the devices and those that engaged in trials. This age bias is consistent with other behavioural studies showing increased participation or persistence by young individuals [13,33,77]. Whether this results from reduced access to other resources due to lower competitive rank, or reduced knowledge about alternative food sources, remains to be determined.
Individual great tits improved gradually over trials in their choice accuracy, providing evidence for colour-based discrimination occurring in the wild. Individuals differed significantly in the rate at which they learned this colour-based association in the field, even when controlling for site and inter-trial interval duration. Birds that were successful at a novel foraging problem (tested in isolation, in captivity) learned the colour association faster than non-solvers once released in the field, which could suggest that individual differences in general associative learning abilities expressed in the novel problem-solving situation and in this colour-based learning test can be stable over time and consistent across contexts. Positive correlations were also observed between innovative problem solving performance and efficiency in motor learning [78,79], as well as associative learning tasks [80] in captive tests on different avian species. Innovative performance was not significantly associated with colour discrimination performance in free-ranging bowerbirds (Ptilonorhynchus maculates) but it loaded positively on the first principal component of an analysis including five other cognitive tasks, suggesting that fast problem-solvers also performed well on other cognitive tasks [6]. Between-task consistency in problem-solving performance had already been demonstrated in great tits, with successful lever-pullers being more likely to succeed at a string-pulling task in captivity [51]. Yet few studies have examined the consistency in cognitive performance of the same individuals tested in the wild versus in captivity, and to our knowledge, all have involved similar innovative problem-solving tasks in both contexts [12,13]. The current demonstration of individual consistency when using a reward mechanism that provided only one food item at a time contrasts with partial evidence for consistency in a previous study [13], suggesting that scrounging opportunities or costs may act to reduce cross-contextual consistency in cognitive performance (see also [32]).
Juveniles were more likely to use the devices and showed a marginally non-significant tendency to learn faster than adults. Faster improvement over repeated trials in juveniles cannot be explained by potential differences in temporal patterns of device use because all analyses controlled for inter-trial interval duration. Interestingly, this effect is similar to more rapid learning by young versus older baboons (Papio papio) engaged in an automated self-administered associative learning task where individuals took trials at their own pace [81]. The interplay between the effect of voluntary participation (versus forced trials) and individual characteristics of subjects on cognitive performance clearly deserves further investigation. Sex and personality scores did not significantly impact learning rates in this experiment, but a larger sample size would give greater power to detect any such effects in future tests. Finally, the impact of social and ecological factors on cognitive performance (e.g. predation risk, group size [82]) has yet to be examined in this context; automated detection of individuals allows recording and using information on these variables in the natural context [44].
Because trials were not run on individuals in isolation, birds could potentially have learned to peck at the red key by observing successful conspecifics interacting with the device [83,84]. We failed to detect evidence of observational learning in a previous field experiment in the same population using a simpler novel foraging problem and larger sample sizes [13]. However great tits and blue tits are known to rely on social information to find patchy food sources in the wild [85,86], to be able to learn socially from conspecifics in aviary experiments [87,88], and to learn positional cues socially in the wild [89]. Whether birds used social information in the form of cues derived from the foraging activity of others at the devices to increase their probability or frequency of visit (local enhancement, which would not affect choice accuracy) or information about the correct option (observational learning, which could impact learning rates) is currently under investigation. To rule out social information use, a possible modification would be to install an opaque box around the perch so as to limit the availability of visual cues in the field [90].
In conclusion, our operant device has the advantages of being portable, affordable (overall unit price around £700), and capable of automatically running and recording large numbers of trials (up to 698 trials daily per location in this experiment) in individual-based learning assays, with relatively little human intervention in the field. However not all species seem to be responsive to this experimental set-up, with great tits being the only species among the four tit species in Wytham to show participation rates >50%. Because the response keys can be replaced by any other mechanical object that can break the optical beam located behind the front panel, experimenters could potentially use the device with a range of avian or non-avian species, making it a useful tool in comparative cognition research between or within species. The device can be customised by users to administer several types of rewards and tests; for instance multiple schedules of reinforcement can be programmed for the different keys, and reversing the contingencies attributed to each colour would assess reversal learning speed (e.g. [91]). Other aspects of cognition than discrimination could also be examined, including extinction, memory span and accuracy. We hope this work will contribute to the development of integrated evolutionary and comparative research on animal learning by broadening the contexts in which this traditional laboratory equipment can be used.
Supporting Information
S2 Text. Supplementary results.
Total number of visits to the devices, proportion of these visits leading to at least one trial (i.e. key-peck), number of individuals with at least one trial recorded in the field, along with range (minimum-maximum), median and mean ± standard error (s.e.) for total number of trials per individual, for each of the four species (Table A in S2 Text). Results of a binomial GLMM for correct (red) vs. incorrect (green, yellow) choices over successive trials, including a random intercept for individual identity and a random slope for identity over scaled trial number (N = 3470 trials by 21 individuals). This model examines differences in learning slopes over trials in successful problem-solvers vs. non-solvers (Table B in S2 Text). Results of a binomial GLMM for correct (red) vs. incorrect (green, yellow) choices over successive trials, including a random intercept for individual identity and a random slope for identity over scaled trial number (N = 3470 trials by 21 individuals). This model examines differences in learning slopes over trials in adults versus juveniles (Table C in S2 Text). Results of a binomial GLMM for correct (red) vs. incorrect (green, yellow) choices over successive trials, including a random intercept for individual identity and a random slope for identity over scaled trial number (n = 3470 trials by 21 individuals). This model examines differences in learning slopes over trials in females vs. males (Table D in S2 Text). Results of a binomial GLMM for correct (red) vs. incorrect (green, yellow) choices over successive trials, including a random intercept for individual identity and a random slope for identity over scaled trial number (n = 3470 trials by 21 individuals). This model examines differences in learning slopes over trials in relation to exploration score Table E in S2 Text).
https://doi.org/10.1371/journal.pone.0133821.s002
(PDF)
S1 Fig. Steps to building a portable operant device equipped with PIT recognition system and printed circuit board.
https://doi.org/10.1371/journal.pone.0133821.s003
(PDF)
S1 Movie. Free-ranging great tit registering three successful trials.
https://doi.org/10.1371/journal.pone.0133821.s004
(WMV)
S2 Movie. Free-ranging great tit registering two successful trials.
https://doi.org/10.1371/journal.pone.0133821.s005
(WMV)
S3 Movie. Free-ranging great tit registering two unsuccessful trials.
https://doi.org/10.1371/journal.pone.0133821.s006
(WMV)
S1 Dataset. Wytham great tits.
Great tits present in the population in the winter 2012.
https://doi.org/10.1371/journal.pone.0133821.s007
(XLSX)
S2 Dataset. Trials by great tits.
Trials recorded by great tits on the operant boxes.
https://doi.org/10.1371/journal.pone.0133821.s008
(XLSX)
Acknowledgments
We would like to thank everyone involved in marking birds in Wytham. Special thanks to Adam Hoffman for allowing us to use modified versions of his ELOPTA device for pre-trials, and to Martin Whitaker (Stickman Technologies Inc., Southampton, UK), Eric Trottier, John Hogg and Tony Price (Zoology and Experimental Psychology Workshop, University of Oxford, UK) for help with design and production of the final devices. We would also like to thank Alex Kacelnik for useful discussions, Louis Lefebvre and the reviewers for commenting on an earlier version of the manuscript. This work was funded by a Natural Environment Research Council grant (NE/I017208/1) to JLQ, and EFC was funded by a Leverhulme grant (RPG-265) to JLQ. JMF was funded by a NERC grant (NE/I017208/1) and a Natural Sciences and Engineering Research Council Discovery grant (435596–2013). JMF designed the device and study with input from JLQ. EC provided problem-solving and some personality data. LMA provided personality data. JMF and SH conducted all of the analyses. JMF wrote the paper and all authors commented on the paper. We are grateful for infrastructure support from a grant from the ERC (AdG 250164) to Ben Sheldon.
Author Contributions
Conceived and designed the experiments: JMF JLQ. Performed the experiments: JMF EFC LMA. Analyzed the data: JMF SH. Wrote the paper: JMF JLQ SH EFC LMA.
References
- 1.
Shettleworth SJ. Cognition, evolution, and behavior. 2nd ed. Oxford: Oxford University Press; 2009.
- 2. Lipp H-P, Pleskacheva MG, Gossweiler H, Ricceri L, Smirnova AA, Garin NN, et al. A large outdoor radial maze for comparative studies in birds and mammals. Neurosci Biobehav Rev. 2001;25:83–99. pmid:11166080
- 3. Lihoreau M, Raine NE, Reynolds AM, Stelzer RJ, Lim KS, Smith AD, et al. Unravelling the mechanisms of trapline foraging in bees. Comm Integr Biol. 2013;6: e22701.
- 4. Marshall RES, Hurly TA, Healy SD. Do a flower’s features help hummingbirds to learn its contents and refill rate? Anim Behav. 2012;83:1163–1169.
- 5. Nachev V, Winter DG. The psychophysics of uneconomical choice: non-linear reward evaluation by a nectar feeder. Anim Cogn.2012; 15:393–400. pmid:22045545
- 6. Isden J, Panayi C, Dingle C, Madden J. Performance in cognitive and problem-solving tasks in male spotted bowerbirds does not correlate with mating success. Anim Behav. 2013; 86:829–838.
- 7. Lupien SJ, McEwen BS, Gunnar MR, Heim C. Effects of stress throughout the lifespan on the brain, behaviour and cognition. Nat Rev Neurosci. 2009;10:434–445. pmid:19401723
- 8. Toxopeus IB, Sterck EHM, Hooff JARAMv, Spruijt BM, Heeren TJ. Effects of trait anxiety on performance of socially housed monkeys in a learning test. Behaviour. 2005;142:1269–1287.
- 9. Galef BG. Approaches to the study of traditional behaviors of free-living animals. Learn Behav. 2004;32:53–61. pmid:15161140
- 10. Kendal RL, Galef BG, Schaik CPV. Social learning research outside the laboratory: How and why? Learn Behav. 2010;38:187–194. pmid:20628158
- 11. Webster SJ, Lefebvre L. Problem solving and neophobia in a columbiform-passeriform assemblage in Barbados. Anim Behav. 2001;62:23–32.
- 12. Morand-Ferron J, Lefebvre L, Reader SM, Sol D, Elvin S. Dunking behaviour in Carib grackles. Anim Behav. 200468:1267–1274.
- 13. Morand-Ferron J, Cole EF, Rawles JEC, Quinn JL. Who are the innovators? A field experiment with two passerine species. Behav Ecol. 2011;22:1241–1248.
- 14. Benson-Amram S, Weldele ML, Holekamp KE. A comparison of innovative problem-solving abilities between wild and captive spotted hyaenas, Crocuta crocuta. Anim Behav. 2013;85:349–356.
- 15. Papini MR. Pattern and process in the evolution of learning. Psychol Rev. 2002;109:186–201. pmid:11863037
- 16. Ginsburg S, Jablonka E. The evolution of associative learning: a factor in the Cambrian explosion. J Theor Biol. 2010;266:11–20. pmid:20558182
- 17. Greenlees MJ, Phillips BL, Shine R. Adjusting to a toxic invader: native Australian frogs learn not to prey on cane toads. Behav Ecol. 2010;21:966–971.
- 18. Marzluff JM, Walls J, Cornell HN, Withey JC, Craig DP. Lasting recognition of threatening people by wild American crows. Anim Behav. 2010;79:699–707.
- 19. Ferrari MCO, Chivers DP. Learning about non-predators and safe places: the forgotten elements of risk assessment. Anim Cogn. 2011;14:309–316. pmid:21203793
- 20. Hollis KL, Cadieux EL, Colbert MM. The biological function of pavlovian conditioning: a mechanism for mating success in the blue gourami (Trichogaster trichopterus). J Comp Psychol. 1989;103:115–121.
- 21. Paur J, Gray DA. Individual consistency, learning and memory in a parasitoid fly, Ormia ochracea. Anim Behav. 2011;82:825–830.
- 22. Dickinson A. Associative learning and animal cognition. Phil Trans Roy Soc B. 2012;367:2733–2742.
- 23. Heyes C. Simple minds: a qualified defence of associative learning. Phil Trans Roy Soc B. 2012;367:2695–2703.
- 24. Hurly TA, Healy SD. Memory for flowers in rufous hummingbirds: location or local visual cues? Anim Behav. 1996;51: 1149–1157.
- 25. Lihoreau M, Raine NE, Reynolds AM, Stelzer RJ, Lim KS, Smith AD, et al. Radar tracking and motion-sensitive cameras on flowers reveal the development of pollinator multi-destination routes over large spatial scales. PLoS Biol. 2012;10:e1001392. pmid:23049479
- 26. Boogert NJ, Monceau K, Lefebvre L. A field test of behavioural flexibility in Zenaida doves (Zenaida aurita). Behav Proc. 2010;85:135–141.
- 27. Schwarz S, Cheng K. Visual associative learning in two desert ant species. Behav Ecol Sociobiol. 2010;64:2033–2041.
- 28. Skinner BF. Drive and reflex strength: II. J Gen Psychol. 1932;6:38–48.
- 29. Steurer MM, Aust U, Huber L. The Vienna comparative cognition technology (VCCT): an innovative operant conditioning system for various species and experimental procedures. Behav Res Methods. 2012;44:909–918. pmid:22437512
- 30. Morgan MM, Fitch MD, Holman JG, Lea SEG. Pigeons learn the concept of an "A". Perception. 1976;5:57–66. pmid:958849
- 31. Baum WM. Choice in free-ranging wild pigeons. Science. 1974;185:78–79. pmid:17779288
- 32. Drea CM, Wallen K. Low-status monkeys "play dumb" when learning in mixed social groups. Proc Natl Acad Sci USA. 1999;96:12965–12969. pmid:10536031
- 33. Fagot J, Bonté E. Automated testing of cognitive performance in monkeys: use of a battery of computerized test systems by a troop of semi-free-ranging baboons (Papio papio). Behav Res Methods. 2010;42:507–516. pmid:20479182
- 34. Hoffman AM, Song J, Tuttle EM. ELOPTA: a novel microcontroller-based operant device. Behav Res Methods. 2007;39:776–782. pmid:18183890
- 35. Healy SD. Memory for objects and positions: delayed non-matching-to-sample in storing and non-storing tits. Q J Exp Psychol. 1995;48:179–191.
- 36. Wilson DS, Coleman K, Clark AB, Biederman L. Shy-bold continuum in pumpkinseed sunfish (Lepomis gibbosus): an ecological study of a psychological trait. J Comp Psychol. 1993;107:250–260.
- 37. Biro PA, Dingemanse NJ. Sampling bias resulting from animal personality. TREE. 2009;24:66–67. pmid:19110338
- 38. Stuber EF, Araya-Ajoy YG, Mathot KJ, Mutzel A, Nicolaus M, Wijmenga JJ, et al. Slow explorers take less risk: a problem of sampling bias in ecological studies. Behav Ecol. 2013;24:1092–1098.
- 39. Verbeek MEM, Drent PJ, Wiepkema PR. Consistent individual differences in early exploratory behavior of male great tits. Anim Behav. 1994;48:1113–1121.
- 40. Quinn JL, Cole EF, Bates J, Payne RW, Cresswell W. Personality predicts individual responsiveness to the risks of starvation and predation. Proc Roy Soc B. 2012;279:1919–1926.
- 41. Groothuis TGG, Carere C. Avian personalities: characterization and epigenesis. Neurosci Biobehav Rev. 2005;29:137–150. pmid:15652261
- 42. Thornton A, Lukas D. Individual variation in cognitive performance: developmental and evolutionary perspectives. Phil Trans Roy Soc B. 2012;367:2773–2783.
- 43. Reader SM. Innovation and social learning: individual variation and brain evolution. Anim Biol. 2003;53:147–158.
- 44. Morand-Ferron J, Cole EF, Quinn JL. Studying the evolutionary ecology of cognition in the wild: a review of practical and conceptual challenges. Biol Rev. 2015;
- 45. Rowe C, Healy SD. Measuring variation in cognition. Behav Ecol. 2014;25:1287–1292.
- 46. Roth TC, LaDage LD, Pravosudov VV. Learning capabilities enhanced in harsh environments: a common garden approach. Proc Roy Soc B. 2010;277:3187–3193.
- 47. Guillette LM, Reddon AR, Hurd PL, Sturdy CB. Exploration of a novel space is associated with individual differences in learning speed in black-capped chickadees, Poecile atricapillus. Behav Proc. 2009;82:265–270.
- 48. Ings TC, Raine NE, Chittka L. A population comparison of the strength and persistence of innate colour preference and learning speed in the bumblebee Bombus terrestris. Behav Ecol Sociobiol. 2009;63:1207–1218.
- 49. Titulaer M, van Oers K, Naguib M. Personality affects learning performance in difficult tasks in a sex-dependent way. Anim Behav. 2012;83:723–730.
- 50. Raine NE, Chittka L. The correlation of learning speed and natural foraging success in bumble-bees. Proc Roy Soc B. 2008;275:803–808.
- 51. Cole EF, Cram DL, Quinn JL. Individual variation in spontaneous problem-solving performance among wild great tits. Anim Behav. 2011;81:491–498.
- 52. Cole EF, Morand-Ferron J, Hinks A, Quinn JL. Cognitive ability influences reproductive life history variation in the wild. Curr Biol. 2012;22:1808–1812. pmid:22940473
- 53. Quinn JL, Cole EF, Morand-Ferron J. Studying microevolutionary processes in cognitive traits: a comment on Rowe and Healy. Behav Ecol. 2014;25:1297–1298.
- 54. Marchetti C, Drent PJ. Individual differences in the use of social information in foraging by captive great tits. Anim Behav. 2000;60:131–140. pmid:10924212
- 55. Guenther A, Brust V, Dersen M, Trillmich F. Learning and personality types are related in cavies (Cavia aperea). J Comp Psychol. 2014;128:74–81. pmid:24127657
- 56. Bonter DN, Bridge ES. Applications of radio frequency identification (RFID) in ornithological research: a review. J Field Ornithol. 2011;82:1–10.
- 57. Krause J, Krause S, Arlinghaus R, Psorakis I, Roberts S, Rutz C. Reality mining of animal social systems. TREE. 2013;28:541–551. pmid:23856617
- 58.
Svensson L. Identification guide to European passerines. Thetford: British Trust for Ornithology. 1992.
- 59. Aplin LM, Farine DR, Morand-Ferron J, Cole EF, Cockburn A, Sheldon BC. Individual personalities and social behaviour in wild networks of great tits (Parus major). Ecol Lett. 2013;16:1365–1372. pmid:24047530
- 60. Psorakis I, Roberts SJ, Rezek I, Sheldon BC. Inferring social network structure in ecological systems from spatio-temporal data streams. J Roy Soc Interface. 2012;9:3055–3066.
- 61. Farine DR, Garroway CJ, Sheldon BC. Social network analysis of mixed-species flocks: exploring the structure and evolution of interspecific social behaviour. Anim Behav. 2012;84:1271–1277.
- 62. Matechou E, Cheng SC, Kidd L, Garroway CJ. Reproductive consequences of the timing of seasonal movements in a non-migratory wild bird population. Ecology. 2015;96:1641–1649.
- 63. Quinn JL, Patrick SC, Bouwhuis S, Wilkin TA, Sheldon BC. Heterogeneous selection on a heritable temperament trait in a variable environment. J Anim Ecol. 2009;78:1203–1215. pmid:19558612
- 64. Patrick SC, Chapman JR, Dugdale HL, Quinn JL, Sheldon BC. Promiscuity, paternity and personality in the great tit. Proc Roy Soc B. 2011;279:1724–1730.
- 65. Cole EF, Quinn JL. Shy birds play it safe: personality in captivity predicts risk responsiveness during reproduction in the wild. Biol Lett. 2014;10:20140178. pmid:24829251
- 66. Quinn JL, Cole EF, Patrick S, Sheldon BC. State and scale dependent links between personality and dispersal. J Anim Ecol. 2011;80:918–928. pmid:21488872
- 67. Cole EF, Quinn JL. Personality and problem-solving explain competitive ability in the wild. Proc Roy Soc B. 2012;279:1168–1175
- 68. Ham AD, Ihalainen E, Lindström L, Mappes J. Does colour matter? The importance of colour in avoidance learning, memorability and generalisation. Behav Ecol Sociobiol. 2006;60:482–491.
- 69. Svádová K, Exnerová A, Štys P, Landová E, Valenta J, Fučíiková A,et al. Role of different colours of aposematic insects in learning, memory and generalization of naive bird predators. Anim Behav. 2009;77:327–336.
- 70. Schuler W, Roper TJ. Responses to warning coloration in avian predators. Adv Study Behav. 1992;21:111–146.
- 71.
Gosler AG. The great tit. London: Hamlyn. 1993.
- 72. Bolker BM, Brooks ME, Clark CJ, Geange SW, Poulsen JR, et al. Generalized linear mixed models: a practical guide for ecology and evolution. TREE. 2008;24:127–135.
- 73. Schielzeth H, Forstmeier W. Conclusions beyond support: overconfident estimates in mixed models. Behav Ecol. 2009;20:416–420. pmid:19461866
- 74.
Pinheiro JC, Bates DM. Mixed-effects models in S and S-PLUS. New York: Springer. 2000.
- 75.
R Development Core Team. R: A language and environment for statistical computing: R Foundation for Statistical Computing. Vienna, Austria. 2015.
- 76.
Perrins CM. British tits. London: Collins. 1979.
- 77. Biondi LM, Bó MS, Vassallo AI. Inter-individual and age differences in exploration, neophobia and problem-solving ability in a Neotropical raptor (Milvago chimango). Anim Cogn. 2010;13:701–710. pmid:20300791
- 78. Overington SE, Cauchard L, Côté K-A, Lefebvre L. Innovative foraging behaviour in birds: what characterizes an innovator? Behav Proc. 2011;87:274–285.
- 79. Boogert NJ, Reader SM, Hoppitt W, Laland KN. The origin and spread of innovations in starlings. Anim Behav. 2008;75:1509–1518.
- 80. Griffin AS, Guez D, Lermite F, Patience M. Tracking changing environments: innovators are fast, but not flexible learners. PLos ONE. 2013;8:e84907. pmid:24391981
- 81. Bonté E, Kemp C, Fagot J. Age effects on transfer index performance and executive control in baboons (Papio papio). Front Psychol. 2014;5:1–7.
- 82. Morand-Ferron J, Quinn JL. Larger groups are more efficient problem-solvers in the wild. Proc Natl Acad Sci USA. 2011;108:15898–15903. pmid:21930936
- 83. Galef BG, Giraldeau LA. Social influences on foraging in vertebrates: causal mechanisms and adaptive functions. Anim Behav. 2001;61:3–15. pmid:11170692
- 84. Hoppitt W, Laland KN. Social processes influencing learning in animals: a review of the evidence. Adv Study Behav. 2008;38:105–165.
- 85. Sasvári L. Great tits benefit from feeding in mixed-species flocks: a field experiment. Anim Behav. 1992;43:289–296.
- 86. Aplin LM, Farine DR, Morand-Ferron J, Sheldon BC. Social networks predict patch discovery in a wild population of songbirds. Proc Roy Soc B. 2012;279:4199–4205.
- 87. Aplin LM, Sheldon BC, Morand-Ferron J. Milk-bottles revisited: social learning and individual variation in the blue tit, Cyanistes caeruleus. Anim Behav. 2013;85:1225–1232.
- 88. Sasvári L. Observational learning in great, blue and marsh tits. Anim Behav. 1979;27:767–771.
- 89. Aplin LM, Farine DR, Morand-Ferron J, Cockburn A, Thornton A, Sheldon BC. Experimentally induced innovations lead to persistent culture via conformity in wild birds. Nature. 2014;518:538–541. pmid:25470065
- 90. Boisvert MJ, Sherry DF. A system for the automated recording of feeding behavior and body weight. Physiol Behav. 2000;71:147–151. pmid:11134696
- 91. Bond AB, Kamil AC, Balda RP. Serial reversal learning and the evolution of behavioral flexibility in three species of North American corvids (Gymnorhinus cyanocephalus, Nucifraga columbiana, Aphelocoma californica). J Comp Psychol. 2007;121:372–379. pmid:18085920