Skip to main content
Advertisement
  • Loading metrics

Intraspecific diversity loss in a predator species alters prey community structure and ecosystem functions

  • Allan Raffard ,

    Roles Conceptualization, Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    allan.raffard@uclouvain.be (AR); simon.blanchet@sete.cnrs.fr (SB)

    Affiliations CNRS, Université Toulouse III Paul Sabatier, Station d’Écologie Théorique et Expérimentale du CNRS à Moulis, UMR-5321, Moulis, France, EcoLab, Université de Toulouse, CNRS, INPT, UPS, Toulouse, France

  • Julien Cucherousset,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation CNRS, Université Toulouse III Paul Sabatier, UMR-5174 EDB (Laboratoire Evolution & Diversité Biologique), Toulouse, France

  • José M. Montoya,

    Roles Writing – review & editing

    Affiliation CNRS, Université Toulouse III Paul Sabatier, Station d’Écologie Théorique et Expérimentale du CNRS à Moulis, UMR-5321, Moulis, France

  • Murielle Richard,

    Roles Data curation, Methodology, Writing – review & editing

    Affiliation CNRS, Université Toulouse III Paul Sabatier, Station d’Écologie Théorique et Expérimentale du CNRS à Moulis, UMR-5321, Moulis, France

  • Samson Acoca-Pidolle,

    Roles Data curation, Writing – review & editing

    Affiliation CNRS, Université Toulouse III Paul Sabatier, Station d’Écologie Théorique et Expérimentale du CNRS à Moulis, UMR-5321, Moulis, France

  • Camille Poésy,

    Roles Data curation, Writing – review & editing

    Affiliation CNRS, Université Toulouse III Paul Sabatier, Station d’Écologie Théorique et Expérimentale du CNRS à Moulis, UMR-5321, Moulis, France

  • Alexandre Garreau,

    Roles Data curation

    Affiliation CNRS, Université Toulouse III Paul Sabatier, Station d’Écologie Théorique et Expérimentale du CNRS à Moulis, UMR-5321, Moulis, France

  • Frédéric Santoul,

    Roles Conceptualization, Funding acquisition, Writing – review & editing

    Affiliation EcoLab, Université de Toulouse, CNRS, INPT, UPS, Toulouse, France

  • Simon Blanchet

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Writing – review & editing

    allan.raffard@uclouvain.be (AR); simon.blanchet@sete.cnrs.fr (SB)

    Affiliation CNRS, Université Toulouse III Paul Sabatier, Station d’Écologie Théorique et Expérimentale du CNRS à Moulis, UMR-5321, Moulis, France

Abstract

Loss in intraspecific diversity can alter ecosystem functions, but the underlying mechanisms are still elusive, and intraspecific biodiversity–ecosystem function (iBEF) relationships have been restrained to primary producers. Here, we manipulated genetic and functional richness of a fish consumer (Phoxinus phoxinus) to test whether iBEF relationships exist in consumer species and whether they are more likely sustained by genetic or functional richness. We found that both genotypic and functional richness affected ecosystem functioning, either independently or interactively. Loss in genotypic richness reduced benthic invertebrate diversity consistently across functional richness treatments, whereas it reduced zooplankton diversity only when functional richness was high. Finally, losses in genotypic and functional richness altered functions (decomposition) through trophic cascades. We concluded that iBEF relationships lead to substantial top-down effects on entire food chains. The loss of genotypic richness impacted ecological properties as much as the loss of functional richness, probably because it sustains “cryptic” functional diversity.

Introduction

Human disturbances associated with global change are increasingly altering worldwide patterns of species diversity, as well as the functions and services provided by ecosystems [13]. Nonetheless changes observed at the species and ecosystem levels are always preceded by changes in phenotypic and genotypic composition within plant and animal populations [46]. Accordingly, extremely rapid changes in intraspecific diversity are currently occurring worldwide [710]. Changes in intraspecific diversity can affect species turnover and composition [11,12], as well as ecosystem functioning [13,14]. For instance, the loss of genotypes within primary producers can reduce ecosystem process rates and species diversity [1517], suggesting the existence of biodiversity–ecosystem functioning relationships at the intraspecific level (iBEF) [14,18,19], in addition to the more widely studied BEF relationships at the interspecific level.

The relationships between intraspecific diversity and ecosystem functioning are challenging to study, and this is primarily because of the confusion between genetic and functional trait diversity. iBEF studies have initially manipulated genotypic richness within experimental populations [16,20,21]. Genetic variability is expected to encapsulate a large proportion of trait variability, and thus higher genotypic richness should maintain higher functional diversity [18]. Although this approach allows deciphering the general effects of intraspecific diversity on ecosystem functioning, it does not provide mechanisms since ecological interactions are supported by functional traits that are—partly—genetically encoded. As a consequence, parallel studies have directly manipulated functional trait richness within populations, which enabled to determine a direct mechanistic linkage between functional richness and community structure and ecosystem functioning [22,23]. For instance, individual body mass (and traits covarying with body mass) has strong ecological effects because of the associated functional differences and resource use complementarity among individuals [2428]. Focusing on specific traits, such as body mass, might conversely blur the ecological effects of “cryptic” trait variation (i.e., unmeasured functional traits such as metabolic rate, feeding behavior and activity [29,30]) that is likely supported by genotypic richness. We therefore argue that manipulating simultaneously genotypic richness and the diversity of key functional traits such as body mass should allow assessing whether cryptic trait diversity is ecologically important and could provide a better mechanistic understanding of iBEF relationships.

The ecological effects of biodiversity changes can be particularly strong when the later occur at high trophic levels such as secondary consumers or predators [3133]. Changes in the diversity and abundance of predatory species can trigger important effects in functions supported by lower trophic levels, especially in regulating the abundance of the lower trophic levels and indirectly ecosystem functioning, such as biomass production [34,35]. High predator species richness can sometimes favor resource use complementarity and decrease prey abundance [33,36]. In some cases, however, increasing predator richness increases prey abundance through mechanisms such as predator interference [37,38] and can modify multiple ecosystem functions along food webs [35,39]. These mechanisms have all been investigated at the interspecific level, but they may also apply within a predatory species (intraspecific diversity), and we can expect relationships—either positive or negative—between predator intraspecific diversity and the structure of prey communities, which could subsequently cascade down on ecosystem functions such as decomposition rate or primary production [31,40]. However, it is still difficult to forecast how loss in intraspecific diversity in consumer species could affect ecosystem functioning, because iBEF studies have primarily focused on primary producers [14,19]. This is despite the fact that human activities strongly affect predator and consumer populations, for instance, through harvest or fisheries activities, which may alter ecosystem functioning through intraspecific changes in traits and genotypes [4144].

In this study, we investigated whether a loss in genotypic and functional diversity within a consumer species at the top of a three-level trophic chain could mediate top-down effects on key ecosystem functions. In a 9-month pond mesocosm experiment, we simultaneously manipulated genotypic richness (number of genetic entities) and the functional richness (variance in individuals body mass) of experimental populations of a freshwater fish, the European minnow (Phoxinus phoxinus), a common and abundant species with important ecosystems effects [45,46]. We predicted that increased functional richness should affect ecological functions; if functional richness captures the entire functional differences among genotypes, then increasing genotypic richness should not impact ecological functions further (Fig 1A). Alternatively, if functional richness does not capture all the functional differences among genotypes, then increasing genotypic richness should increase functional diversity and affect ecological functions (Fig 1B). The ecological effects of genotypic and functional richness might display different shape following different conceptual predictions to which we compared our experimental findings (Fig 1): (i) “additive” effects when loss in genotypic richness affects ecological functions regardless of changes in functional richness; (ii) “enhancing” effects when loss in genotypic richness affect ecological functions solely at higher levels of functional richness; or (iii) “compensatory” effects when high genotypic richness compensates for the loss of functional richness, maintaining higher ecological functions at lower levels of functional richness. Finally, we investigated the mechanistic basis of the ecological effects of genotypic and functional richness. In particular, we expected that genotypic and functional richness affect directly community structure through trophic interactions and indirectly ecosystem functions at lower trophic levels through trophic cascades. Hence, we specifically tested whether the loss in genotypic and functional richness directly affected population performance and community structure, and indirectly ecosystem functioning mediated by changes in community structure of benthic and pelagic food web.

thumbnail
Fig 1. Predicted ecological effects of genotypic richness in relation with functional richness.

Functional richness is assumed to positively affect ecological functions, whereas genotypic richness might have different effects depending on it supports cryptic functional diversity. First, if functional richness does capture the essential of the functional differences among genotypes, then genotypic richness would have no ecological effects (a). Second, if genotypic richness supports cryptic functional diversity, the effects could be (b) additive, (c) enhancing, or (d) compensatory.

https://doi.org/10.1371/journal.pbio.3001145.g001

Results

Both genotypic and functional richness of experimental populations significantly affected several ecological processes (Table 1). At the population level, we found that the interaction between genotypic and functional richness tended (p = 0.057) to alter fish biomass production (i.e., population performance) of experimental populations (Table 1 and Fig 2A). Specifically, the less diversified experimental populations (low genotypic richness and low functional richness) displayed a lower biomass production than all other treatments (Fig 2A). At the community level, the diversity of benthic invertebrates was significantly higher in the high genotypic richness treatment (mean D-inv ± SE = 0.64 ± 0.04) than in the low genotypic richness treatment (D-inv ± SE = 0.53 ± 0.03), and this pattern was repeatable across functional richness treatments (Fig 2D and Table 1). Irrespective of the genotypic richness treatment, mesocosms containing fish populations with low functional richness had higher diversity of benthic invertebrates than mesocosms containing fish populations with high functional diversity (Fig 2D and Table 1). In contrast, the diversity of zooplankton (D-zoo) was affected by the interaction between genotypic and functional richness (Fig 2E and Table 1). Zooplankton diversity was strikingly higher in populations with both high genotypic richness and high functional richness (Fig 2E and Table 1), suggesting that, in this case, the effect of genotypic richness depended on the functional richness of experimental fish populations. Benthic invertebrates and zooplankton abundances were consistently (i.e., across genotypic richness treatment) enhanced when increasing functional richness (Fig 2F and 2G and Table 1). Genotypic richness of populations did not affect benthic invertebrates and zooplankton abundances (Fig 2F and 2G and Table 1). A weak but significant negative effect of functional richness on the pelagic algae stock was detected (Table 1 and Fig 2C), and there was no significant effects genotypic and functional richness on decomposition rate (Table 2). Overall, genotypic and functional richness induced ecological effects of similar intensity (mean |ggenotypic| = 0.356, CIs = 0.043 to 0.669, and mean |gfunctional| = 0.564, CIs = 0.247 to 0.882; see S1 Fig for details).

thumbnail
Fig 2.

Effects of genotypic and functional richness on population biomass production index (a), decomposition rate (b), algae stock (c), diversity of benthic invertebrates (e), diversity of zooplankton (f), abundance of benthic invertebrates (g), and abundance of zooplankton (h). Error bars represent ± 1 SE. The data underlying this Figure can be found at https://doi.org/10.6084/m9.figshare.12459065.v7.

https://doi.org/10.1371/journal.pbio.3001145.g002

thumbnail
Table 1. Results of the mixed effect linear models quantifying the relationships between genotypic richness, functional richness, and ecological parameters.

Significant—and near-significant—p-values are displayed in bold; R2 are shown into brackets. Interaction terms were removed from the model when not significant.

https://doi.org/10.1371/journal.pbio.3001145.t001

thumbnail
Table 2. Model fits of the 2 confirmatory path analyses explaining decomposition rate and algae stock variation. C, df, and p-value are given for full models as indication.

https://doi.org/10.1371/journal.pbio.3001145.t002

Confirmatory path analyses revealed that effects of intraspecific diversity on ecosystem functioning were primarily mediated by trophic cascades through changes in community structure (Fig 3). First, genotypic and functional richness affected the diversity and abundance of benthic invertebrates (Fig 3), which subsequently and positively affected the decomposition rate (p < 0.001, Fig 4A and 4B and S1 Table). Second, functional richness positively affected abundance of zooplankton, leading to a decrease in pelagic algae stock (p < 0.001, Fig 4C and 4D and S1 Table). Overall, the confirmatory path analysis confirmed the key role of intraspecific diversity for both food chains and its indirect effects for ecosystem functions (Fig 3 and Table 2). Indeed, models including genotypic and functional richness reproduced adequately the causal pathways (Table 2), and their Akaike information criteria (AICs) were better than that of both alternative and simplified models for each ecosystem function (Table 2).

thumbnail
Fig 3. Causal pathways between genotypic richness, functional richness, community structure, and ecosystem functioning.

Two models have been run separately on decomposition rate (a) and pelagic algae stock (b). Only significant links are drawn, blue arrows represent positive links, yellow arrows negative links.

https://doi.org/10.1371/journal.pbio.3001145.g003

thumbnail
Fig 4.

Effects of the diversity (a) and the abundance (b) of benthic invertebrates on decomposition rate and effects of the diversity and the abundance of zooplankton on pelagic algae stocks (c and d, respectively). Points are partial residuals extracted from models described in the statistical analysis section (see also S1 Table). Straight lines represent the slope predicted by the models (see statistical analyses) when significant (α < 0.05), and gray shadows represent 95% CIs. The data underlying this Figure can be found at https://doi.org/10.6084/m9.figshare.12459065.v7.

https://doi.org/10.1371/journal.pbio.3001145.g004

Discussion

The present study demonstrates that loosing intraspecific diversity in a secondary consumer species has substantial top-down consequences for community structure and ecosystem functioning in food webs. We showed that both losses in functional (mass) and genotypic richness sustained these iBEF relationships, suggesting that differences in mass among individuals (an important functional trait for food web dynamics [24]) did not capture the entire functional space, and thus that genotypic richness encapsulates important and “cryptic” (unmeasured) functional diversity. The loss of genotypes within consumer populations can affect both the community structure and the abundance of lower trophic levels, as well as ecosystem functions with a similar strength than the loss of functional entities (i.e., body mass). Specifically, we found that diversity loss (genotypic and functional) within populations indirectly affects primary producer biomass and organic matter recycling, 2 ecosystem functions forming the bases of food chains. This suggests that intraspecific diversity is a key but understudied facet of biodiversity as it indirectly sustains BEF relationships, even when changes in intraspecific diversity occur in a single species at the top of the food chains.

Our study suggests that genotypic richness can support nonnegligible cryptic functional diversity. Cryptic functional traits, such as physiological and behavioral traits, can affect interactions in food webs and ecological functions. As such, behavioral variation within populations is widespread in nature and can be genetically encoded [47,48]. For instance, personality traits (e.g., activity or boldness) can determine foraging activity and diet, ultimately affecting trophic interactions and ecosystem functioning in food webs [30,49]. Additionally, metabolic and stoichiometric traits can also strongly differ within species and can be functionally important in shaping energetic needs both quantitatively and qualitatively (i.e., specific elemental needs) [29,50,51]. Hence, fish with different genotypes may share obvious functional traits (such as body mass) but may subtly differ in other cryptic functional traits, making them unique ecologically [52]. Although such “ecological dissimilarity-despite-morphological similarity” has rarely been demonstrated within species, there is now ample evidence that cryptic species (species being morphologically and phylogenetically similar) can actually be ecologically unique regarding their influence on ecosystems (e.g., [53]).

Interestingly, this cryptic diversity can interact with functional richness in various ways (i.e., additive, enhancing, or compensatory; Fig 1) depending on the ecological parameter considered (i.e., benthic invertebrate diversity, zooplankton diversity, and fish biomass production, respectively). For instance, we found that genotypic richness can compensate for the loss of functional diversity for population performance (i.e., increase fish biomass production), with high genotypic richness maintaining high biomass production even when the distribution of body mass in the population is limited. We speculate that genotypic richness can increase niche variation among individuals, thereby limiting the loss of biomass production when decreasing functional richness [54]. These findings echo and expand on studies at the interspecific level demonstrating that phylogenetic diversity among species explains variance in ecosystem functions that is not explained either by species or functional diversity, suggesting that phylogenetic diversity sustains unmeasured functional differences among species [5557]. We argue that iBEF relationships are sustained by differences in functional traits among individuals that can be directly measured (e.g., mass) and/or indirectly captured through quantification of the genetic pool of individuals composing populations.

Accordingly, we showed that genotypic and functional richness can affect independently (i.e., additively) and consistently community structure, demonstrating that multiple facets of intraspecific diversity can regulate lower trophic levels. First, genotypic richness increased benthic invertebrate diversity. This effect was very robust, as it was repeatable and consistent across functional richness treatments. Genotypic richness probably enhanced resource partitioning, allowing individuals to forage on a more diverse array of resources, regulating the abundance of each taxonomic group and leading to a higher diversity [15,31]. Second, functional richness led to increased prey abundance that was repeatable across both communities of benthic invertebrates and zooplankton. Previous studies at the inter- and intraspecific levels provide nonconsistent predictions, since an increase in consumer diversity can affect either positively or negatively resource abundance [28,33,35,37,39]. Our results indicate that functionally rich populations did not consume fewer resources than functionally poor populations since they had higher biomass production. This suggests that the increase in prey abundance was not due to an increase in interindividual competition in functionally rich populations. At the opposite, flexible exploitation of resources might occur in functional rich populations because European minnows are omnivorous [58,59]; their diet probably included some periphyton, decreasing the predation risk on animal resources, and hence increasing invertebrate abundance. Because the top-down control of intraspecific diversity on community structure is likely driven by trophic mechanisms, quantifying individual diet (e.g., using gut content, eDNA, or stable isotope analysis) and its temporal dynamic in such experiments would allow making more accurate predictions regarding trophic niche partitioning.

Our results further revealed how changes in top consumers’ genotypic and functional richness percolate through the food web and alter ecosystem functions at the base of the food chains. Such trophic cascade induced by intraspecific diversity could be driven by a “classical” (i.e., interspecific) BEF relationship between benthic invertebrate diversity and decomposition rate [60,61]. Specifically, fish genotypic richness increased benthic invertebrate diversity that accelerated litter decomposition rate. The higher decomposition rate of organic matter is likely produced by higher consumption efficiency through trophic complementarity among clades of invertebrates in diverse community [61]. Invertebrate community with a high diversity probably harbored a high functional diversity [62], and focusing on the functional type of invertebrates might allow a more precise understanding of this link. These results echo those reported at the community level and those manipulating richness within primary producer species [16,63], while implying a modification of top-down effects by intraspecific diversity in consumers.

Biodiversity within consumer species is largely impacted by anthropogenic activities [8]. Multiple drivers of global change (including habitat loss and fragmentation, emerging diseases, or climate change) can alter the genetic diversity and uniqueness of populations [64,65]. While genetic loss is notoriously detrimental for the adaptive potential of species [66], our results show that genetic loss within a single species can further lead to underestimated cascading impacts on ecosystem functioning. Maintaining the genetic integrity of populations (i.e., the diversity and frequency of genes within a population) can hence be highly beneficial to all biodiversity components in the ecosystem. Importantly, these benefits of genetic diversity for the ecological dynamics of ecosystems apply to all trophic levels through cascading interactions. Our results therefore have major implications for the conservation of natural ecosystems and are actually strengthening recent calls [67] that developing conservation strategies targeting intraspecific genetic diversity is urgently needed for preserving not only the adaptive potential of species but also the integrity of ecosystems in which they live.

In conclusion, we demonstrated that both genetic and functional richness within consumer populations are important facets of biological diversity, inducing effects on prey community structure and trophic cascades mediating ecosystem functions. These results are consistent with previous synthetic works [14,19], reinforcing the call for considering changes of intraspecific diversity in consumer species as an important ecological predictor. Importantly, genotypic richness can sustain important cryptic functional diversity, and future investigations should aim at developing a general framework from genes to ecosystems to better understand the global links existing among the multiple facets of biodiversity and ecosystem functioning and, ultimately, ecosystem services.

Material and methods

Model species

The European minnow (P. phoxinus) is a common species occurring across Western Europe, living in relatively cold water (summer water temperature generally lower than 24°C) including mountain lakes, small rivers at intermediate altitude, and mountain streams [68]. It is a small-bodied cyprinid fish species (<12 cm long, 4 to 8 cm long as an adult in general) playing the role of secondary consumer in most ecosystems [69], with a generalist diet composed of small invertebrates, algae, or zooplankton [58,59]. Populations of European minnows differed in their genetic and phenotypic richness [70], and previous works revealed that genetically and phenotypically unique populations differently affect prey community abundance and ecosystem functions [46].

We selected 10 populations from a large river basin in southern France (the Garonne catchment) based on a priori knowledge to maximize both genetic and functional differentiations among populations [70,71] (S2 Fig). Specifically, the 10 selected populations displayed a high level of genetic differentiation (mean pairwise Fst = 0.133, range = 0.029 to 0.320) and greatly varied in the number of alleles they harbor (from 5.470 alleles in average for the less diverse population to 10.176 alleles for the most diverse population) according to data measured using 17 microsatellite markers (from [7072]). Moreover, we selected 5 populations mainly composed of small-bodied adults (mean body mass ± standard error (SE) = 1.03 g ± 0.02) and 5 populations mainly composed of large-bodied adults (mean body mass ± SE = 3.06 g ± 0.07) (S3A Fig). These differences in adult body mass are due to selective pressures from the local environment such as mean water temperature; the higher the mean water temperature, the smallest the adult body mass due to increased metabolic rate and an accelerated pace of life [71]. Finally, populations are geographically distant one from each other, and they were considered as functionally and genetically unique entity, and intraspecific richness will be manipulated by varying the number of populations in independent mesocosms (see details below).

In September 2017, individuals were collected in each river by electrofishing a 200-m section and visually selecting 30 to 50 individuals reflecting the size range of adults. Fish collections and husbandry were done in accordance with permit from local authorities (sampling: E-2017-146, PE-2017-031, 2017–858, PE-2017-032, AP-25-04-2017, AP-04-05-2017, AP-31-01-2017; husbandry: SA-013-PB-092, 09–273). Fish were maintained at similar density in outdoor tanks for 3 weeks before the start of the experiment. Fish were fed ad libitum with frozen Chironomidae during this period.

Mesocosm experiment

In October 2016, 24 outdoor mesocosms were filled with 900 L of water and 3 cm of gravel. Nutrients were added to the mesocosms using 10 mL of solution containing nitrogen and phosphorus (ratio N:P:K = 3.3:1.1:5.8). Each mesocosm was then inoculated twice (October 2016 and May 2017) with 200 mL of a concentrated solution of phytoplankton and 200 mL of concentrated solution of zooplankton collected from a unique lake nearby (Lamartine Lake, France 43° 30′ 21.5″ N, 1° 20′ 32.7″ E). In May 2017, we introduced 3 adult pond snails (Lymnaeidae) and 10 adult isopods (Asellidae) in each mesocosms. They were let uncovered to allow natural colonization by other invertebrates and community assemblage until the start of the experiment that occurred approximately 6 months later.

In October 2017, 8 fish were weighted and introduced in each mesocosm, which were assigned to 1 of 4 treatments according to a full-factorial design with genotypic richness (2 levels, high and low genotypic richness) and functional richness (2 levels, high and low functional richness) as the main factors. Genotypic richness was manipulated by introducing individuals sourced from either 2 (low genotypic richness, 4 individuals from each population) or 4 (high genotypic richness, 2 individuals from each population) out of the 10 populations displaying significant genetic differentiation [70,71]. These 2 levels of genotypic richness were selected as it has previously been shown in a meta-analysis that the effect of intraspecific richness on ecosystem functioning increases linearly until approximately 4 genotypes and then reaches a plateau beyond that [14]. Since we aimed at testing the effect of richness while minimizing the effects of population identity, each replicate of each treatment of richness contained a different (unique) assemblage of populations. Functional richness consisted in manipulating the body mass of the individuals present in the mesocosms; hence, experimental populations contained individuals sourced either from large or small populations (i.e., 1 functional entity, low functional richness) or from both small and large populations (i.e., 2 functional entities, high functional richness; see S2 Table and S3 Fig for details on the different experimental populations). It is noteworthy that populations containing only either small or large individuals were actually more functionally redundant than populations containing large and small individuals. Experimental populations hence varied simultaneously according to their genotypic and functional richness, leading to 4 treatments.

The experiment lasted 30 weeks (210 days) after fish were introduced. Mesocosms were checked daily for mortality, which was rarely observed over the course of the experiment. At the end of the experiment, we measured several ecological parameters to assess effects of genotypic and functional richness on population performance, community structure, and ecosystem functioning:

Population performance.

All tanks were emptied and we recaptured all remaining fish to estimate mortality rate (; mean per tank ± SE = 0.22 ± 0.01). Fish were weighted to assess fish biomass production (biomass production = averaged final weight − averaged initial weight) of each experimental population during the experiment. Since individuals with small initial body mass intrinsically displayed a higher growth rate than large individuals, a standardized biomass production index was calculated as the residuals of the relationship between biomass production and initial fish size.

Community structure.

Zooplankton community structure was quantified by filtering 5 L of water through a 200-μm sieve. Samples were conserved in a 70% ethanol solution and subsequently identified to the order or family levels, including Cyclopoida, Calanoida, Daphniidae, Chydoridae, and Bosminidae. The diversity of zooplankton was calculated as the Simpson diversity (D-zoo) representing the probability that 2 randomly chosen individuals belong to different clades. D-zoo was calculated as , where Ntot was the total number of sampled individuals, and Ni the number of sampled individuals for each group [73,74]. Zooplankton abundance was quantified as the total number of individuals for all taxa pooled at the tank level.

Benthic invertebrates were collected from the mesh bags used to measure decomposition rates (see below), conserved in a 70% ethanol solution, and identified as Isopoda, Diptera, Gastropoda, Ephemeroptera, Plecoptera, Odonata, Copepoda, Cladocera, and Ostracoda. The diversity of benthic invertebrates was calculated as the Simpson diversity (D-inv). The abundance of benthic invertebrates was quantified as the total number of individuals for all taxa pooled at the tank level.

Ecosystem functioning.

Decomposition rate was measured by quantifying the mass loss of black poplar (Populus nigra, a dominant riparian tree in southern France) abscised leaves [75]. On 7 March 2018 (19 weeks after the introduction of fish), 4 g of air-dried leaves were put in each mesocosm within a coarse mesh (1 × 1 cm) bag. At the end of the experiment, the remaining leaf material was removed from the mesocosms, rinsed with tap water, oven dried at 60°C for 3 days, and weighed to the nearest 0.001 g to assess the loss of biomass. The decomposition rate was calculated as [75], where X is the proportion of litter remaining, and t is the elapsed time in days.

Pelagic algae stock was measured as the chlorophyll-a concentration (μg.L−1) in the water column using a multiparametric probe (OTT, Hydrolab DS5). Five measurements were taken in each mesocosm and averaged for subsequent analyses. Since phytoplankton are the main primary producers in these mesocosms [63], pelagic algae stock can be considered as a proxy for the biomass of primary producers.

Statistical analyses

Prior to analysis, the pelagic algae stock (i.e., the chlorophyll-a concentration), zooplankton and benthic invertebrate abundances were log-transformed to reach normality of models’ residuals. After analyses of outliers using Cook distance, we removed 1 mesocosm from the final analyses that displayed outliers for several of the measured variables (S4 Fig). Analyses were hence run on 23 replicates.

We first assessed the ecological effects of genotypic and functional richness using mixed effects linear models (LMMs). We ran one model for each ecological parameter as a dependent variable, and the genotypic richness, functional richness, and the resulting two-term interaction (that was removed when nonsignificant) as explanatory variables. Fish mortality rate during the experiment was included as a fixed effect to control for a potential effect of final density on ecological processes. To control for the disposition of the tanks during the experiment, the position of tanks was added as a random term. To compare the relative strength of a loss in genotypic and functional richness on ecological parameters, we calculated effect sizes. Hedges g were computed as follow: , where X1 and X2 are means of treatments (for each genotypic or functional richness treatment separately) measured for each ecological parameters respectively, and spooled is the pooled standard deviation computed as , where n is sample size, and s2 is variance [76]. An effect size was hence measured for each variable response (n = 7), and each treatment independently. These individual effect sizes were then averaged for genotypic (gG) and functional richness (gS), respectively, so as to get an absolute mean effect sizes that were compared visually based on 95% confidence intervals (CIs).

Secondly, we ran confirmatory path analysis [77] to assess the direct and indirect links among intraspecific diversity (genotypic and functional richness), prey (invertebrates and zooplankton) community structure, and ecosystem functioning. We expected that intraspecific diversity in European minnows affects directly invertebrate community (both diversity and abundance) through predation, and indirectly ecosystem functions (decomposition rate, algae stock) through trophic cascades. Specifically, benthic invertebrates consume leaf litter, affecting decomposition rate [61,78], while zooplankton forages on phytoplankton, affecting pelagic algae stock (brown and green trophic food chain, respectively). Because genotypic and functional richness likely interact to shape processes (see Fig 1), we initially included in all models the interaction term between genotypic and functional richness on community structure. As above, interaction terms were removed when not significant. Specifically, we computed 2 path analyses: one for the benthic food chain (fish-invertebrates-decomposition), and one for the pelagic food chain (fish-zooplankton-algae stock) (S5 Fig). The fits of the structural models were assessed using the C statistic (see independent claims in S3 Table), that follows a χ2 distribution and whose associated p-value indicates whether the models adequately fit the data or not. Alternative models including direct effects of fish intraspecific diversity on community components and ecosystem functions were performed (S5 Fig) to test whether genotypic and functional richness affected ecosystem functions through unmeasured parameters (e.g., other community parameters, nutrient recycling). This approach allows testing whether the predicted indirect effects are the most likely effects that explain the data. Finally, the structural models were further compared to simplified models that did not include the effects of genotypic and functional richness on community parameters (see S5 Fig) using AIC [79,80]. This later test allows assessing whether the indirect effects of genotypic and functional richness lead to a better explanation of the data, and whether trophic cascades were important or not.

All statistical analyses were run using R software [81]; LMM were run using the R-package lme4 [82]; and confirmatory path analyses were run using the R-package ggm [83].

Supporting information

S1 Fig. Effect size (Hedges g) of genotypic and functional richness for each ecological parameter and their overall means.

Error bars represent ± 1 SE. The data underlying this Figure can be found at https://doi.org/10.6084/m9.figshare.12459065.v7.

https://doi.org/10.1371/journal.pbio.3001145.s001

(EPS)

S2 Fig. Geographical distribution of the 10 populations of European minnows (Phoxinus phoxinus) used in this study.

This map was drawn based on data from http://www.geoinformations.developpement-durable.gouv.fr/bd-carthage-r363.html.

https://doi.org/10.1371/journal.pbio.3001145.s002

(PNG)

S3 Fig.

Relationships between fish body mass and (a) population of origin, (b) genotypic richness treatments (high = 4 populations, and low = 2 populations), and (c) functional richness. The data underlying this Figure can be found at https://doi.org/10.6084/m9.figshare.12459065.v7.

https://doi.org/10.1371/journal.pbio.3001145.s003

(EPS)

S4 Fig. Analysis of outliers using Cook distance [84,85].

The higher the distance, the more influential the points on the variable. The horizontal bar, representing the mean across all tanks multiplied by 4, is given as an indicative threshold above which a point may be considered as influential. Tank 13 was influential in all variable and was therefore discarded from analyses. The data underlying this Figure can be found at https://doi.org/10.6084/m9.figshare.12459065.v7.

https://doi.org/10.1371/journal.pbio.3001145.s004

(PDF)

S5 Fig.

Diagram of the causal pathways used to explain variation in (a) decomposition rate and (b) algae stock. These models were compared to alternative models ((c) and (d), respectively) including direct effects of genotypic and functional richness on ecosystem functions. Finally, simplified models were performed, in which the effects of genotypic and functional richness on community structure were excluded ((e) and (f)). “G x F” denotes the interaction between genotypic and functional richness.

https://doi.org/10.1371/journal.pbio.3001145.s005

(PDF)

S1 Table. Linkages between community and ecosystem variables.

Significant p-values are displayed in bold; R2 are shown in brackets.

https://doi.org/10.1371/journal.pbio.3001145.s006

(XLSX)

S2 Table. Population origin of minnows (Phoxinus phoxinus) used in each experimental treatment.

https://doi.org/10.1371/journal.pbio.3001145.s007

(XLSX)

S3 Table. D-separation claims implied in the structural models shown in S4 Fig.

Alg, Algae stock; Dec, decomposition rate; Frich, functional richness; Grich, genotypic richness; Int, FxG interaction; Invab, benthic invertebrates abundance; Invdiv, benthic invertebrates diversity; Zooab, zooplankton abundance; Zoodiv, zooplankton diversity.

https://doi.org/10.1371/journal.pbio.3001145.s008

(XLSX)

Acknowledgments

We thank Kéoni Saint-Pe and Jérôme G. Prunier for their help for fish sampling. Version 3 of this preprint has been peer-reviewed and recommended by Peer Community In Ecology (https://doi.org/10.24072/pci.ecology.100064). We warmly thank Frederik De Laender, Jes Hines, and Andrew Barnes for valuable comments.

References

  1. 1. Parmesan C. Ecological and evolutionary responses to recent climate change. Annu Rev Ecol Evol Syst. 2006;37:637–669.
  2. 2. Naeem S, Bunker DE, Hector A, Loreau M, Perrings C. Biodiversity, Ecosystem Functioning, and Human Wellbeing. Oxford University Press; 2009. https://doi.org/10.1093/acprof:oso/9780199547951.001.0001
  3. 3. Isbell F, Gonzalez A, Loreau M, Cowles J, Díaz S, Hector A, et al. Linking the influence and dependence of people on biodiversity across scales. Nature. 2017;546:65–72. pmid:28569811
  4. 4. Clements CF, Ozgul A. Including trait-based early warning signals helps predict population collapse. Nat Commun. 2016;7:10984. pmid:27009968
  5. 5. Clements CF, Blanchard JL, Nash KL, Hindell MA, Ozgul A. Body size shifts and early warning signals precede the historic collapse of whale stocks. Nat Ecol Evol. 2017;1:0188. pmid:28812591
  6. 6. Baruah G, Clements CF, Guillaume F, Ozgul A. When do shifts in trait dynamics precede population declines? Am Nat. 2019;193:633–644. pmid:31002565
  7. 7. Darimont CT, Carlson SM, Kinnison MT, Paquet PC, Reimchen TE, Wilmers CC. Human predators outpace other agents of trait change in the wild. Proc Natl Acad Sci. 2009;106:952–954. pmid:19139415
  8. 8. Miraldo A, Li S, Borregaard MK, Florez-Rodriguez A, Gopalakrishnan S, Rizvanovic M, et al. An Anthropocene map of genetic diversity. Science. 2016;353:1532–1535. pmid:27708102
  9. 9. Mimura M, Yahara T, Faith DP, Vázquez-Domínguez E, Colautti RI, Araki H, et al. Understanding and monitoring the consequences of human impacts on intraspecific variation. Evol Appl. 2016;10:121–139. pmid:28127389
  10. 10. Leigh DM, Hendry AP, Vázquez-Domínguez E, Friesen VL. Estimated six per cent loss of genetic variation in wild populations since the industrial revolution. Evol Appl. 2019;12:1505–1512. pmid:31462910
  11. 11. Vellend M, Geber MA. Connections between species diversity and genetic diversity. Ecol Lett. 2005;8:767–781.
  12. 12. Vellend M. Species diversity and genetic diversity: parallel processes and correlated patterns. Am Nat. 2005;166:199–215. pmid:16032574
  13. 13. Des Roches S, Post DM, Turley NE, Bailey JK, Hendry AP, Kinnison MT, et al. The ecological importance of intraspecific variation. Nat Ecol Evol. 2018;2:57–64. pmid:29203921
  14. 14. Raffard A, Santoul F, Cucherousset J, Blanchet S. The community and ecosystem consequences of intraspecific diversity: a meta-analysis. Biol Rev. 2019;94:648–661. pmid:30294844
  15. 15. Johnson MTJ, Lajeunesse MJ, Agrawal AA. Additive and interactive effects of plant genotypic diversity on arthropod communities and plant fitness. Ecol Lett. 2006;9:24–34. pmid:16958865
  16. 16. Crutsinger GM, Collins MD, Fordyce JA, Gompert Z, Nice CC, Sanders NJ. Plant genotypic diversity predicts community structure and governs an ecosystem process. Science. 2006;313:966–968. pmid:16917062
  17. 17. Fridley JD, Grime JP. Community and ecosystem effects of intraspecific genetic diversity in grassland microcosms of varying species diversity. Ecology. 2010;91:2272–2283. pmid:20836449
  18. 18. Hughes AR, Inouye BD, Johnson MTJ, Underwood N, Vellend M. Ecological consequences of genetic diversity. Ecol Lett. 2008;11:609–623. pmid:18400018
  19. 19. Koricheva J, Hayes D. The relative importance of plant intraspecific diversity in structuring arthropod communities: A meta-analysis. Funct Ecol. 2018;32:1704–1717.
  20. 20. Hughes AR, Stachowicz JJ. Ecological impacts of genotypic diversity in the clonal seagrass Zostera marina. Ecology. 2009;90:1412–1419. pmid:19537560
  21. 21. Abbott JM, Grosberg RK, Williams SL, Stachowicz JJ. Multiple dimensions of intraspecific diversity affect biomass of eelgrass and its associated community. Ecology. 2017;98:3152–3164. pmid:28983913
  22. 22. Violle C, Navas M-L, Vile D, Kazakou E, Fortunel C, Hummel I, et al. Let the concept of trait be functional! Oikos. 2007;116:882–892.
  23. 23. Matthews B, Narwani A, Hausch S, Nonaka E, Peter H, Yamamichi M, et al. Toward an integration of evolutionary biology and ecosystem science. Ecol Lett. 2011;14:690–701. pmid:21554512
  24. 24. Woodward G, Ebenman B, Emmerson M, Montoya J, Olesen J, Valido A, et al. Body size in ecological networks. Trends Ecol Evol. 2005;20:402–409. pmid:16701403
  25. 25. Hildrew AG, Raffaelli D, Edmonds-Browns R. Body size: the structure and function of aquatic ecosystems. Cambridge, UK: Cambridge University Press; 2007.
  26. 26. Rudolf VHW, Rasmussen NL, Dibble CJ, Van Allen BG. Resolving the roles of body size and species identity in driving functional diversity. Proc R Soc B Biol Sci. 2014;281:20133203. pmid:24598423
  27. 27. Harmon LJ, Matthews B, Des Roches S, Chase JM, Shurin JB, Schluter D. Evolutionary diversification in stickleback affects ecosystem functioning. Nature. 2009;458:1167–1170. pmid:19339968
  28. 28. Rudolf VHW, Rasmussen NL. Population structure determines functional differences among species and ecosystem processes. Nat Commun. 2013;4. pmid:23933614
  29. 29. Brown JH, Gillooly JF, Allen AP, Savage VM, West GB. Toward a metabolic theory of ecology. Ecology. 2004;85:1771–1789.
  30. 30. Wolf M, Weissing FJ. Animal personalities: consequences for ecology and evolution. Trends Ecol Evol. 2012;27:452–461. pmid:22727728
  31. 31. Duffy JE. Biodiversity and ecosystem function: the consumer connection. Oikos. 2002;99:201–219.
  32. 32. Duffy JE. Biodiversity loss, trophic skew and ecosystem functioning. Ecol Lett. 2003;6:680–687.
  33. 33. Griffin JN, Byrnes JEK, Cardinale BJ. Effects of predator richness on prey suppression: a meta-analysis. Ecology. 2013;94:2180–2187. pmid:24358704
  34. 34. Shurin JB, Borer ET, Seabloom EW, Anderson K, Blanchette CA, Broitman B, et al. A cross-ecosystem comparison of the strength of trophic cascades. Ecol Lett. 2002;5:785–791.
  35. 35. Barnes AD, Jochum M, Lefcheck JS, Eisenhauer N, Scherber C, O’Connor MI, et al. Energy flux: the link between multitrophic biodiversity and ecosystem functioning. Trends Ecol Evol. 2018;33:186–197. pmid:29325921
  36. 36. Cardinale BJ, Srivastava DS, Emmett Duffy J, Wright JP, Downing AL, Sankaran M, et al. Effects of biodiversity on the functioning of trophic groups and ecosystems. Nature. 2006;443:989–992. pmid:17066035
  37. 37. Sih A, Englund G, Wooster D. Emergent impacts of multiple predators on prey. Trends Ecol Evol. 1998;13:350–355. pmid:21238339
  38. 38. O’Connor MI, Bruno JF. Predator richness has no effect in a diverse marine food web. J Anim Ecol. 2009;78:732–740. pmid:19261036
  39. 39. Antiqueira PAP, Petchey OL, Romero GQ. Warming and top predator loss drive ecosystem multifunctionality. Ecol Lett. 2018;21:72–82. pmid:29098798
  40. 40. Bruno JF, O’Connor MI. Cascading effects of predator diversity and omnivory in a marine food web. Ecol Lett. 2005;8:1048–1056.
  41. 41. Hauser L, Adcock GJ, Smith PJ, Bernal Ramirez JH, Carvalho GR. Loss of microsatellite diversity and low effective population size in an overexploited population of New Zealand snapper (Pagrus auratus). Proc Natl Acad Sci. 2002;99:11742–11747. pmid:12185245
  42. 42. Estes JA, Terborgh J, Brashares JS, Power ME, Berger J, Bond WJ, et al. Trophic Downgrading of Planet Earth. Science. 2011;333:301–306. pmid:21764740
  43. 43. Palkovacs EP, Kinnison MT, Correa C, Dalton CM, Hendry AP. Fates beyond traits: ecological consequences of human-induced trait change. Evol Appl. 2012;5:183–191. pmid:25568040
  44. 44. Palkovacs EP, Moritsch MM, Contolini GM, Pelletier F. Ecology of harvest-driven trait changes and implications for ecosystem management. Front Ecol Environ. 2018;16:20–28.
  45. 45. Miró A, Sabás I, Ventura M. Large negative effect of non-native trout and minnows on Pyrenean lake amphibians. Biol Conserv. 2018;218:144–153.
  46. 46. Raffard A, Cucherousset J, Santoul F, Di Gesu L, Blanchet S. Intraspecific variation alters ecosystem and next-generation performance as much as temperature. bioRxiv. 2019.
  47. 47. Sih A, Bell A, Johnson JC. Behavioral syndromes: an ecological and evolutionary overview. Trends Ecol Evol. 2004;19:372–378. pmid:16701288
  48. 48. Anreiter I, Sokolowski MB. The foraging gene and its behavioral effects: pleiotropy and plasticity. Annu Rev Genet. 2019;53:373–392. pmid:31487469
  49. 49. Toscano BJ, Gownaris NJ, Heerhartz SM, Monaco CJ. Personality, foraging behavior and specialization: integrating behavioral and food web ecology at the individual level. Oecologia. 2016;182:55–69. pmid:27170290
  50. 50. Leal MC, Seehausen O, Matthews B. The ecology and evolution of stoichiometric phenotypes. Trends Ecol Evol. 2016;32:108–117. pmid:28017452
  51. 51. Rosenblatt AE, Schmitz OJ. Climate change, nutrition, and bottom-up and top-down food web processes. Trends Ecol Evol. 2016;31:965–975. pmid:27726943
  52. 52. Loreau M. Biodiversity and Ecosystem Functioning: Current Knowledge and Future Challenges. Science. 2001;294:804–808. pmid:11679658
  53. 53. Fišer Ž, Altermatt F, Zakšek V, Knapič T, Fišer C. Morphologically Cryptic Amphipod Species Are “Ecological Clones” at Regional but Not at Local Scale: A Case Study of Four Niphargus Species. PLoS ONE. 2015;10:e0134384. pmid:26226375
  54. 54. Duffy JE, Macdonald KS, Rhode JM, Parker JD. Grazer diversity, functional redundancy, and productivity in seagrass beds: an experimental test. Ecology. 2001;82:2417–2434.
  55. 55. Cadotte MW, Dinnage R, Tilman D. Phylogenetic diversity promotes ecosystem stability. Ecology. 2012;93:S223–S233.
  56. 56. Mouquet N, Devictor V, Meynard CN, Munoz F, Bersier L-F, Chave J, et al. Ecophylogenetics: advances and perspectives. Biol Rev. 2012;87:769–785. pmid:22432924
  57. 57. Le Bagousse-Pinguet Y, Soliveres S, Gross N, Torices R, Berdugo M, Maestre FT. Phylogenetic, functional, and taxonomic richness have both positive and negative effects on ecosystem multifunctionality. Proc Natl Acad Sci. 2019;116:8419–8424. pmid:30948639
  58. 58. Frost WE. The natural history of the minnow, Phoxinus phoxinus. J Anim Ecol. 1943;12:139.
  59. 59. Collin H, Fumagalli L. Evidence for morphological and adaptive genetic divergence between lake and stream habitats in European minnows (Phoxinus phoxinus, Cyprinidae). Mol Ecol. 2011;20:4490–4502. pmid:21951706
  60. 60. Hooper DU, Chapin FS, Ewel JJ, Hector A, Inchausti P, Lavorel S, et al. Effects of biodiversity on ecosystem functioning: a consensus of current knowledge. Ecol Monogr. 2005;75:3–35.
  61. 61. Gessner MO, Swan CM, Dang CK, McKie BG, Bardgett RD, Wall DH, et al. Diversity meets decomposition. Trends Ecol Evol. 2010;25:372–380. pmid:20189677
  62. 62. Cadotte MW, Carscadden K, Mirotchnick N. Beyond species: functional diversity and the maintenance of ecological processes and services. J Appl Ecol. 2011;48:1079–1087.
  63. 63. Downing AL, Leibold MA. Ecosystem consequences of species richness and composition in pond food web. Nature. 2002;416:837–841. pmid:11976680
  64. 64. De Kort H, Prunier JG, Ducatez S, Honnay O, Baguette M, Stevens VM, et al. Life history, climate and biogeography interactively affect worldwide genetic diversity of plant and animal populations. Nat Commun. 2021;12:516. pmid:33483517
  65. 65. Manel S, Schwartz MK, Luikart G, Taberlet P. Landscape genetics: combining landscape ecology and population genetics. Trends Ecol Evol. 2003;18:189–197.
  66. 66. Eizaguirre C, Baltazar-Soares M. Evolutionary conservation-evaluating the adaptive potential of species. Evol Appl. 2014;7:963–967.
  67. 67. Laikre L, Hoban S, Bruford MW, Segelbacher G, Allendorf FW, Gajardo G, et al. Post-2020 goals overlook genetic diversity. Science. 2020;367:1083.2–1085. pmid:32139534
  68. 68. Keith P, Persat H, Feunteun E, Allardi J. Les poissons d’eau douce de France. Paris and Mèze:Muséum National d’Histoire Naturelle and Publications Biotope; 2011.
  69. 69. Raffard A, Santoul F, Blanchet S, Cucherousset J. Linking intraspecific variability in trophic and functional niches along an environmental gradient. Freshw Biol. 2020;fwb.13508.
  70. 70. Fourtune L, Prunier JG, Mathieu-Begne E, Canto N, Veyssiere C, Loot G, et al. Intraspecific genetic and phenotypic diversity: parallel processes and correlated patterns? 2018
  71. 71. Raffard A, Cucherousset J, Prunier JG, Loot G, Santoul F, Blanchet S. Variability of functional traits and their syndromes in a freshwater fish species (Phoxinus phoxinus): The role of adaptive and nonadaptive processes. Ecol Evol. 2019;9:2833–2846. pmid:30891220
  72. 72. Prunier JG, Chevalier M, Raffard A, Loot G, Poulet N, Blanchet S. Contemporary loss of genetic diversity in wild fish populations reduces biomass stability over time. bioRxiv. 2019
  73. 73. Simpson EH. Measurement of diversity. Nature. 1949;163:688.
  74. 74. Lande R. Statistics and partitioning of species diversity, and similarity among multiple communities. Oikos. 1996;76:5.
  75. 75. Alp M, Cucherousset J, Buoro M, Lecerf A. Phenological response of a key ecosystem function to biological invasion. Ecol Lett. 2016;19:519–527. pmid:26931804
  76. 76. Nakagawa S, Cuthill IC. Effect size, confidence interval and statistical significance: a practical guide for biologists. Biol Rev. 2007;82: 591–605. pmid:17944619
  77. 77. Shipley B. Confirmatory path analysis in a generalized multilevel context. Ecology. 2009;90:363–368. pmid:19323220
  78. 78. Gessner MO, Chauvet E, Dobson M. A perspective on leaf litter breakdown in streams. Oikos. 1999;85:377–384.
  79. 79. Cardon M, Loot G, Grenouillet G, Blanchet S. Host characteristics and environmental factors differentially drive the burden and pathogenicity of an ectoparasite: a multilevel causal analysis: Causalities in host-parasite interactions. J Anim Ecol. 2011;80:657–667. pmid:21303365
  80. 80. Shipley B. The AIC model selection method applied to path analytic models compared using ad-separation test. Ecology. 2013;94:560–564. pmid:23687881
  81. 81. R Core Team. R: a language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2013.
  82. 82. Bates D, Maechler, M, Bolker, B, Walker, S. lme4: Linear mixed-effects models using Eigen and S4. R package version 1. 1–7. 2014.
  83. 83. Marchetti GM, Drton M, Sadeghi K. ggm: functions for graphical Markov models. Version 2.5. 2020. Available from: https://CRAN.R-project.org/package=ggm.
  84. 84. Cook RD. Detection of influential observation in linear regression. Technometrics. 1977;19:15.
  85. 85. Cousineau D, Chartier S. Outliers detection and treatment: a review. Int J Psychol Res. 2010;3:58–67.