Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Estimating the Incidence of Symptomatic Rotavirus Infections: A Systematic Review and Meta-Analysis

  • Joke Bilcke ,

    joke.bilcke@ua.ac.be

    Affiliation Centre for Health Economics Research & Modeling of Infectious Diseases (CHERMID), Centre for the Evaluation of Vaccinations (CEV), Vaccine and Infectious Disease Institute (VAXINFECTIO), University of Antwerp, Wilrijk, Antwerp, Belgium

  • Pierre Van Damme,

    Affiliation Centre for Health Economics Research & Modeling of Infectious Diseases (CHERMID), Centre for the Evaluation of Vaccinations (CEV), Vaccine and Infectious Disease Institute (VAXINFECTIO), University of Antwerp, Wilrijk, Antwerp, Belgium

  • Marc Van Ranst,

    Affiliation Laboratory of Clinical and Epidemiological Virology, Department of Microbiology and Immunology, Rega Institute for Medical Research, Catholic University of Leuven, Leuven, Belgium

  • Niel Hens,

    Affiliations Centre for Health Economics Research & Modeling of Infectious Diseases (CHERMID), Centre for the Evaluation of Vaccinations (CEV), Vaccine and Infectious Disease Institute (VAXINFECTIO), University of Antwerp, Wilrijk, Antwerp, Belgium, Interuniversitary Institute for Biostatistics and Statistical Bioinformatics (I-BioStat), Hasselt University, Diepenbeek, Belgium

  • Marc Aerts,

    Affiliation Interuniversitary Institute for Biostatistics and Statistical Bioinformatics (I-BioStat), Hasselt University, Diepenbeek, Belgium

  • Philippe Beutels

    Affiliations Centre for Health Economics Research & Modeling of Infectious Diseases (CHERMID), Centre for the Evaluation of Vaccinations (CEV), Vaccine and Infectious Disease Institute (VAXINFECTIO), University of Antwerp, Wilrijk, Antwerp, Belgium, School of Public Health, University of Sydney, Sydney, New South Wales, Australia

Abstract

Background

We conducted for the first time a systematic review, including a meta-analysis, of the incidence of symptomatic rotavirus (RV) infections, because (1) it was shown to be an influential factor in estimating the cost-effectiveness of RV vaccination, (2) multiple community-based studies assessed it prospectively, (3) previous studies indicated, inconclusively, it might be similar around the world.

Methodology

Pubmed (which includes Medline) was searched for surveys assessing prospectively symptomatic (diarrheal) episodes in a general population and situation, which also reported on the number of the episodes being tested RV+ and on the persons and the time period observed. A bias assessment tool was developed and used according to Cochrane guidelines by 4 researchers with different backgrounds. Heterogeneity was explored graphically and by comparing fits of study-homogenous ‘fixed effects’ and -heterogeneous ‘random effects’ models. Data were synthesized using these models. Sensitivity analysis for uncertainty regarding data abstraction, bias assessment and included studies was performed.

Principal Findings

Variability between the incidences obtained from 20 studies is unlikely to be due to study groups living in different environments (tropical versus temperate climate, slums versus middle-class suburban populations), nor due to the year the study was conducted (from 1967 to 2003). A random effects model was used to incorporate unexplained heterogeneity and resulted in a global incidence estimate of 0.31 [0.19; 0.50] symptomatic RV infections per personyear of observation for children below 2 years of age, and of 0.24 [0.17; 0.34] when excluding the extreme high value of 0.84 reported for Mayan Indians in Guatemala. Apart from the inclusion/exclusion of the latter study, results were robust.

Conclusions/Significance

Rather than assumptions based on an ad-hoc selection of one or two studies, these pooled estimates (together with the measure for variability between populations) should be used as an input in future cost-effectiveness analyses of RV vaccination.

Introduction

Meta-analyses of Randomized Controlled Trials (RCT's) are frequently undertaken as part of systematic reviews to estimate clinical effect sizes. Effect size estimates based on meta-analyses are even regarded as superior to estimates from a single RCT, particularly when they serve as an input in Health Technology Assessments(HTA's) [1], [2]. But clinical effect sizes are only one of the many input variables needed for a HTA (others include estimates on incidence of morbidity and mortality, costs and utilities), and meta-analysis for estimating these other types of variables have been used to a far lesser extent [1]. However, in some cases (e.g. when data is available from different sources for similar study groups, but not for the specific study group under analysis), meta-analysis could be as strong a tool for good estimation of these other types of variables, as it is for clinical effect sizes.

This seems for instance the case for the estimation of the incidence of symptomatic rotavirus (RV) infections, including those that do not present to a physician or a hospital. Despite common believe, several HTA studies showed this estimate to be influential on the cost-effectiveness of RV vaccination [3][8]. However, many other studies considered only RV cases presenting to physicians and hospitals [9][16], some of them justifying this by claiming a lack of information on RV cases not presenting to a physician or hospital. Nonetheless, a number of published studies recorded prospectively the incidence of symptomatic RV infections. Moreover, De Zoysa and Feachem [17] already pointed out that the incidence of symptomatic RV infections in a study group from Canada [18] was similar to one from Bangladesh [19]. This suggests that the incidence of RV diarrhoea may generally be similar between developing and developed countries, and that basic improvements in water supply, sanitation, hygiene, nutrition and education do not necessarily reduce this incidence.

In short, because (1) the incidence of all symptomatic RV infections can be an influential factor in estimating the cost-effectiveness of RV vaccination, (2) multiple community-based studies exist that assessed prospectively the incidence of symptomatic RV infections, and (3) it would be important for global public health policy to verify whether the incidence of symptomatic RV infections is similar around the world, we conducted a systematic review, including a meta-analysis, of community-based studies on the incidence of symptomatic RV infections. To our knowledge this is the first meta-analysis on this subject. The main aim of this meta-analysis is to produce reliable estimates of the incidence of symptomatic RV infections, which can then be used for HTA. Since this incidence was shown to be highly age-dependent [17], age is taken into account.

Methods

The strategy used and the reporting hereafter is based on the QUORUM [20] and MOOSE statement [21] and follows Cochrane guidelines [22]. JB, who determined the strategy, is a Biologist (BSc, MSc), Biostatistician (MSc), and current PhD student. The strategy was implemented after conferring with PVD: vaccinologist and infectious disease epidemiologist (PhD); MVR: virologist and epidemiologist (PhD) and PB: infectious disease modeller and economist (PhD). All these authors have worked and published on RV before.

Searching

Pubmed, the main database for health sciences that fully includes Medline, was searched using EndNote 9 (title, abstract and keywords of each paper were searched). A first search of PubMed to identify relevant papers for our meta-analysis was conducted on September 6th 2007 using search string ‘rotavirus’ AND ‘infection’ NOT ‘review’ NOT ‘letter’ NOT ‘clinical trial’. But as not all relevant papers were detected through this search, a second, more exhaustive search of PubMed was performed on January 16th 2008 using the search terms ‘rotavirus AND diarrh*’ OR ‘rotavirus AND symptom*’ OR ‘rotavirus AND gastroenteritis’ OR ‘rotavirus AND gastro-enteritis’. This search was updated up to January 12th 2009 to yield our final set of papers for review. All papers in foreign languages (i.e. not familiar to any of the authors), but of possible interest based on an English title and/or abstract were translated by people ignorant of the purpose of our study. Papers published prior to 1985 were excluded since relevant studies up to 1985 were taken from the review on incidence of symptomatic RV infections published in 1985 (de Zoysa & Feachem [17]).

Selection

All papers identified through the search were screened manually for eligibility by JB, based on titles, abstracts and full text if necessary. Only one person (JB) did the screening because of the heavy workload involved. However, to assure high reliability of the assessment of study eligibility, a detailed and complete list of eligibility criteria was defined by multiple researchers (JB and PB, advised by MVR and PVD), prior to scanning the references (as recommended by Cochrane guidelines [22]):

  1. Original papers, i.e. excluding review papers, letters and editorial comments.
  2. Descriptive studies (community surveys), i.e. not comparative, hence excluding controlled trials and case-control studies, because they often use a strictly controlled study design (e.g. strict recruitment criteria), and because all participants usually received some sort of intervention (placebo or treatment of interest).
  3. Prospective, because RV testing is required to discern RV from other infections as a cause of diarrhea, and such tests are not standard practice. Therefore, RV cases should be recorded prospectively, with RV testing included in the study protocol.
  4. In a ‘general population, and general situation’, because we want to estimate the incidence of all symptomatic RV cases, and not restrict to cases for whom medical care is sought, nor to cases occurring in a particular setting such as day care centres, refugee camps and homes for the elderly. Reports of outbreaks are also excluded, because they focus on a particular period of time during which incidence is high.
  5. On humans, i.e. excluding studies of RV in animals.
  6. Reporting incidence of symptomatic laboratory-confirmed RV infections per person-year directly OR reporting number/percentage of RV+ tests and number/percentage of diarrheal/symptomatic infections (implying the number of symptomatic RV+ cases can be derived), and the person-time of observation (or the number of persons under observation and the time period during which they were observed). Studies assessing incidence of symptomatic RV infection using serological assays and not stool tests are not included, because it is very difficult to link symptoms with blood tests indicating RV.

Validity assessment

In the absence of standard tools for validating studies that measure non-comparative outcomes, a simple and transparent risk of bias assessment tool was developed (for details see Text S1), based on existing validation tools for studies on comparative outcomes [22]. In a similar way as the ‘Cochrane collaboration's tool for assessing risk of bias’ [22], the tool consists of key sources of bias (selection bias, confounders age and season, drop-outs and detection bias) and is used to evaluate all studies that passed the first two selection hurdles described above (database search and eligibility criteria). Four assessors gave for each study a description and judgement of each of these sources of bias (see Table S1). All four assessors (JB, MVR, PB, PVD) had an adequate understanding of the methods used for assessing the incidence of symptomatic RV infections (see before), and MVR is an expert in laboratory techniques used to identify rotaviruses. Although the use of multiple assessors may limit bias, minimise errors and improve reliability, it could give rise to disagreements [22]. Therefore, as generally recommended [22], we adhered to the following procedure:

  1. Compare the individual assessments in group and try to come to an agreement
  2. If disagreement on a topic persists because of lack of knowledge on this topic: gather the information to get agreement.
  3. If impossible to come to an agreement: report different opinions.

Based on a pilot study (for details see Text S1), it was decided that assessors should not be blinded from the results section nor author names, institutions and journal names because (1) the results section includes sometimes information on drop-outs and on how potential confounders were dealt with, and (2) converting the papers to a standardised anonymous format is labour intensive at the arguably low benefit of excluding journal names for assessors. We realise this could induce prejudice in interpretation but we believe we minimized such prejudice by having four independent assessors use a tool with specific questions. The papers to evaluate were given to each of the four assessors in a random order. Methodological papers from the reference lists were provided to the assessors upon request. Although attempts to assess risk of bias may be hampered by incomplete reporting, no attempt was made to obtain missing information from authors.

Data abstraction

From each eligible paper, JB derived independently the incidence of laboratory-confirmed symptomatic RV infections as the number of such infections on the person-years of observation. The abstraction method is made completely transparent by reporting for each study in detail how the data were abstracted (Table S2).

Study characteristics

All studies included are community surveys assessing prospectively symptomatic (diarrheal) episodes in a general population and situation (not restricted to e.g. day care centres), which also reported on the number of the episodes being tested RV+, and on the persons and the time period observed. Variation in study characteristics and their possible impact on the study outcomes was explored by plotting incidence per study according to a range of study characteristics, such as person-years of observation, risk of bias, Human Development Index (HDI, United Nations Development Programme's Human Development Report 2007/2008, compiled on the basis of 2005 data), socioeconomic status of study group (see further), and year in which the study was conducted (for multi-year studies, the midpoint was taken). Note that the data are too scarce to allow for a specific analysis with the aim of identifying explanatory variables.

Quantitative data synthesis

Principal measure – Incidence of laboratory confirmed symptomatic RV infections, obtained as the number of such infections on the personyears of observation. 95% credible intervals for the incidence values reported in each study were obtained by taken the 95% interval of a gamma distribution with parameters α, the number of symptomatic RV+ episodes, and β, the inverse of the personyears of observation. The gamma distribution conforms with the gamma we assumed as a prior distribution in the models (see below).

Statistical heterogeneity.

Statistical heterogeneity was explored graphically with a forest plot and by comparing the fit of a fixed-effects (study-homogeneous) model with a random-effects (study-heterogeneous) model [23]. The use of a random effects model allows for variation between the studies and can be used when the source of variation cannot be identified [22], [23]. A test for statistical heterogeneity (e.g. by calculating I2) was not performed, as we believe a pooled incidence estimate for symptomatic RV infections makes sense, even in case of (some) heterogeneity. This is because previous studies already indicated incidence might be similar around the world as RV is so contagious that basic improvements in water supply, sanitation, hygiene, nutrition and education do not necessarily decrease incidence. Note that incidence values taking into account possible heterogeneity will also be estimated (see further).

Combining results.

A pooled estimate for the incidence of symptomatic RV infections was obtained by fitting the following models to the data:

Study-homogeneous (‘fixed effects’) model: This model assumes that the number of symptomatic RV infections, Y, as recorded in each study can be sampled from a Poisson distribution with a common mean (μti).

with

yi = the number of symptomatic RV infections for each study i

μ = mean incidence rate (number of symptomatic RV infections/person-years of observation)

ti = person-years of observation for each study i

Study-heterogeneous (‘random effects’) model [24]: This model allows the number of symptomatic RV infections recorded in each study to deviate from the common mean μti by a factor μi, with μi having a gamma distribution defined by parameter v ( = shape parameter and scale parameter, i.e. a gamma distribution with common mean one and unknown variance). As μi works multiplicative on the mean μti of the Poisson, a positive gamma distribution with mean one is a logical choice to reflect the heterogeneity of the studies compared to the global incidence. With the above model, three types of incidences can be estimated:

  • Global incidence μ, a common incidence estimate not taking into account heterogeneity between the studies.
  • Incidence estimates for the study populations included in this meta-analysis μiμ, taking into account the heterogeneity between the studies.
  • Incidence estimates for study populations not included in this meta-analysis. This relates to the situation in which one wants to estimate the incidence for a specific population (in HTA this population will often be all children <2 years of age of one country) in the absence of empirical incidence estimates for this specific population. If the study population is then not directly comparable to any of the populations covered in our meta-analysis, the uncertainty stemming from this incomparability should be accounted for. This can be done by sampling from the gamma distribution (Gamma(v,v)), conditional on the posterior distribution for v to get an estimate for the deviation from the global incidence μu, where μuμ represents the incidence estimate. Note that the above procedure will increase the 95% credible interval around the global incidence estimate as more uncertainty is taken into account.

Models were fitted in Winbugs14, using uninformative gamma priors for μ and v (i.e. shape = scale parameter = 1E-03), implying results are not carried by the priors, but by the data. If possible, age would be added as a covariate to the models (continuous or ordinal, depending on the width of age intervals reported). In what we termed hereafter ‘base case analysis’, the models were fitted on the outcomes from the nine studies without high risk of bias.

Publication bias.

Unlike for RCT's and observational studies on effects, for studies on incidence there is no reason to not publish results (i.e. no publication bias) as it does not involve a significance test for a certain treatment or intervention (and hence, there is no possible bias to false-positive results).

Sensitivity analysis.

To investigate whether the conclusions rely on the inclusion/exclusion of any particular study, the meta-analysis was repeated systematically excluding each individual study in turn. Data were also re-analysed where uncertainties concerning the values extracted existed. Because there is little consensus concerning the optimal way of dealing with study validity in meta-analysis, the impact of excluding/including outcomes of studies with (possible) high risk of bias was investigated [22], [23].

Results

Flow of included studies (Figure 1)

The literature search in Pubmed identified 5301 papers, 1016 of which were published before 1985. Manual screening resulted in 37 papers fulfilling the predefined inclusion criteria. Another 16 papers were excluded due to the following reasons:

  1. Three papers [25][27] followed neonates for a very short observation period (maximum 28 days).
  2. Twelve papers [28][39] did not provide sufficient information on age of the study group.
  3. Two papers [40], [41] reported on the same study, and are further referred to as one study.

Incidence estimates were obtained from the remaining 21 studies, and for all these studies the risk of bias in the reported outcomes was assessed. A separate reference list for the 5279 excluded studies, as recommended by the MOOSE statement [21], can be found in the Reference List S1.

Study characteristics

The main characteristics of each of these 21 studies are presented in Table 1. Papers were assigned to different categories according to the socioeconomic status (SES) of the study group: low (study group living in poor, crowded area), probably low (studies performed in developing countries), not low (studies performed in developed countries) or unclear (Table 1).

thumbnail
Table 1. Background characteristics, incidence of symptomatic rotavirus infections per personyear of observation for children <2 years and bias assessment of 21 prospective studies included in the meta-analysis.

https://doi.org/10.1371/journal.pone.0006060.t001

Data abstraction

From the 21 papers, the number of symptomatic RV infections and person-years of observation were obtained for children under 2 years of age from all but one paper [42] (only data until age 1 available). Data on older children or adults were rare and often not separately presented. Outcomes for yearly, 6-monthly and 3-monthly age intervals could be obtained from 18, 15 and 3 papers respectively.

For most studies, outcomes of interest were reported or could be calculated directly using information provided by the study. For instance, if the number of RV infections and/or person-years of observation in the first and second year were reported separately, they were summed to get the number of RV infections for the first 2 years. In case person-months or -days were given instead of person-years of observation [18], [41][53], the numbers were divided by 12, respectively 365. For Espinoza et al [54], the person-years of observation for age intervals 0–6 months and 6–12 months could be obtained by dividing the person-years of observation in the first year by two, because no drop-outs occurred during that period. For Hasan et al [55], the number of symptomatic RV infections was obtained by multiplying the number of diarrhea cases by the proportion due to RV.

When number of symptomatic RV infections, and/or person-years of observation was/were not reported, or could not be calculated directly, we approximated it (for details see Table S2).

The number of symptomatic RV infections and person-years of observation did not always match: during the observation period, stool samples were not always taken from all diarrhea episodes, and/or not all stool samples were tested for RV. When no adjustment is made for this, the incidence of symptomatic RV infections is likely to be underestimated. Therefore the incidence was adjusted by decreasing the person-years of observation by multiplying it by the proportion of diarrheal episodes tested for RV, when such information was given. For three of the papers evaluated not to have high risk of bias in their reported outcomes (and used in meta-analysis, see further) [41], [48], [56], the proportion of diarrheal episodes tested for RV was uncertain, however minimum and maximum proportions could be derived and/or assumed (for details, see Table S2). In base case analysis, midpoints of those minimum-maximum ranges were used for adjustment. When the proportion of diarrheal episodes tested for RV was given for only one age interval, we assumed the same proportion for other age intervals [42], [45], [54], [55], [57][59], for details see Table S2. Adjustment (when necessary) was achieved for 15 of the 21 studies, including all the studies without high risk of bias (see below).

Gurwith et al [18] provided outcomes per season so that we could adjust for the oversampling in winter (for details see Table S2).

Assessment of risk of bias in the reported outcomes

The assessors came to agreement on the risk of bias for all studies. Nine studies were evaluated to be without high risk of bias in the reported incidence of symptomatic RV infections and 7 studies to be with high risk of bias (the reasons are presented in Table S3). Another 5 studies were evaluated as having a possible high risk of bias in their reported outcomes. In 3 of them, information was lacking so that validity assessment was not possible. The two other studies presented the appropriate information, and based on this they were regarded to be ‘borderline’, i.e. with risk of bias, but unclear if this risk is high.

The nine ‘without high risk of bias’ studies all used ELISA for RV testing, followed children at least for one complete year and visited the child at least once a week, with the exception of one study, in which the child was visited each time (s)he had diarrhea [60].

Exploratory analysis

Incidence in children below 2 years of age varied between 0.06 and 0.84 symptomatic infections per person-year of observation (Table 1, Figure 2). When only considering studies without high risk of bias, the range stays the same, but the majority of studies shows an incidence between 0.20 and 0.25 (Table 1, Figure 2).

thumbnail
Figure 2. Incidence of symptomatic RV infections in children below age 2 for the 20 eligible studies.

Forest plot showing incidence (number of symptomatic RV infections per personyear of observation; boxes) and 95% credible intervals (horizontal lines), obtained from studies which were evaluated to be at respectively no high risk of bias (‘no bias’), possible high risk of bias (‘possible bias’), and high risk of bias (‘bias’). The size of each box is proportionate to the person-years of observation from each study.

https://doi.org/10.1371/journal.pone.0006060.g002

Figure 2 indicates heterogeneity, but variation between the studies seems not to be explained by differences in HDI, socioeconomic status of the study group or the year when the study was conducted, also not when only considering papers without high risk of bias (Table 1 and Figure S1). Age-specific incidences for yearly and 6-monthly intervals seem to vary even more between the studies, i.e. some papers report the peak incidence in the first year of life, whereas others found the incidence to peak in the second year of life (Figure 3). A peak incidence in the first year of life is due to a high incidence in the first 6 months of life (e.g. [46], [54]), or between 6 and 12 months of age (e.g. [56], [58], [59]). Only 2 papers [48], [52] with peak incidence in the second year of life had information on incidence in 6 monthly intervals, and report a high incidence between 12 and 18 months of age. The six papers from which 6-monthly data until 2 years of age could be derived [44][46], [48], [52], [55], all demonstrate a decrease in incidence for children aged 18–24 months.

thumbnail
Figure 3. Incidence of symptomatic RV infections by age (in years) obtained from different studies.

Incidence is number of symptomatic RV infections per personyear of observation. Black, grey and white bars represent incidences for children in their first, second and third year of life, respectively.

https://doi.org/10.1371/journal.pone.0006060.g003

Note that the variation in incidence between the studies without high risk of bias is very unlikely to be explained by differences in surveillance methods and/or RV tests, as these aspects were taken into account in the bias assessment: all studies without high risk of bias are considered to have used appropriate (i.e. unlikely leading to over- or underestimation) methodology to assess symptomatic RV episodes.

Quantitative data synthesis

As only few studies provided detailed information on incidence of symptomatic RV infections by age, quantifying the variation by age (by adding age as a covariate in the models) was not considered feasible. Hence, all analyses are done on incidence values for children below 2 years of age.

Base case analysis (9 studies without high risk of bias)

1. Global incidence estimate

The mean [95% credible interval] number of symptomatic RV infections per person-year of observation is estimated at 0.26 [0.24; 0.29] (median 0.26) by the study-homogeneous ‘fixed effects’ model and at 0.31 [0.19; 0.50] (median 0.30) by the study-heterogeneous ‘random effects’ model. The DIC value of 160.0 (study-homogeneous model) compared to 67.4 (study-heterogeneous model) suggests the model taking into account heterogeneity would best predict a replicate set of data of the same structure as the data included in the meta-analysis.

2. Incidence estimates for the studies included in the meta-analysis

The study-specific incidences estimated by the study-heterogeneous model and their 95% credible intervals are very close to the reported ones (Table 2). The smallest (Simhon et al [52]) and largest (Mata et al [48]) estimated values are most modified towards the pooled incidence estimate.

thumbnail
Table 2. Reported and estimated (study-heterogeneous meta-analysis model) incidence values of symptomatic RV infections in children <2 years.

https://doi.org/10.1371/journal.pone.0006060.t002

3. Incidence estimate for study populations not included in the meta-analysis

The 95% credible interval increases substantially due to the extra source of uncertainty involved: 0.31 [0.05; 0.72].

Sensitivity analysis

1. Meta-analysis on studies without high risk of bias: impact of excluding any particular study

The exclusion of any single study from the meta-analysis does not have a remarkable impact, with the exception of excluding the Mata et al paper [48]. The latter substantially reduces both the pooled incidence estimate and its credible interval (Figure 4).

thumbnail
Figure 4. Impact of excluding any particular study from meta-analysis.

Impact on the pooled estimate for the incidence of symptomatic RV infections in children below 2 years of age. Squares and horizontal lines represent means and 95% credible intervals of the pooled estimates. Only studies without high risk of bias are considered.

https://doi.org/10.1371/journal.pone.0006060.g004

2. Meta-analysis on studies without high risk of bias: re-analysis of data where uncertainties concerning values extracted exist.

From the papers of Mata et al [48], Naficy et al [56] and Velazquez et al [41] it is unclear if all diarrheal episodes are tested for RV (see Table S2). Impact of this uncertainty is investigated by comparing the pooled incidence estimate when 100% testing of diarrhea episodes is assumed for Mata et al [48] and Naficy et al [56], and 100% testing of stool samples is assumed for Velazquez et al [41], with the pooled incidence estimate when 85.5% and 80% testing of diarrhea episodes is assumed for Mata et al [48] and Naficy et al [56], respectively and 80% testing of stool samples is assumed for Velazquez et al [41].

The pooled incidence estimate varies then between 0.30 [0.19; 0.46] (100% testing assumed) and 0.33 [0.20; 0.56] (85.5/80% testing assumed).

3. Impact of including studies with possible high risk of bias and high risk of bias

Including the studies with possible high risk of bias renders a slightly smaller pooled incidence estimate with a smaller credible interval: 0.28 [0.20; 0.39]. The same occurs when including the studies with high risk of bias: 0.27 [0.19; 0.35] (Figure 5).

thumbnail
Figure 5. Impact of including/excluding studies from meta-analysis with possible high risk of bias, high risk of bias and the Mata et al paper.

Impact on the pooled estimate for incidence of symptomatic RV infections for children below 2 years of age. Squares and horizontal lines represent means and 95% credible intervals of the pooled estimates. Ho = study-homogeneous model, He = study-heterogeneous model, NR = only studies with no high risk of bias included, NPR = studies with no or possible high risk of bias included, ALL = studies with no, possible or high risk of bias included, n = number of studies included in meta-analysis.

https://doi.org/10.1371/journal.pone.0006060.g005

4. Impact of the Mata et al paper [48]

When excluding the Mata et al paper [48], some heterogeneity between the studies remains (DIC study-heterogeneous model is 60.7 compared to 82.4 for the study-homogeneous model). The pooled incidence estimate lies then between 0.23 [0.17; 0.32] (100% testing assumed for Naficy et al [56]and Velazquez et al [41]) and 0.25 [0.17; 0.37] (80% testing assumed). When excluding the Mata et al paper [48], the credible interval for study populations not included in this meta-analysis becomes smaller: 0.24 [0.09; 0.45]. Including the studies with possible high risk of bias does not change the pooled ‘global’ incidence estimate, but the credible interval decreases slightly: 0.24 [0.19; 0.30]. The same occurs when including the studies with high risk of bias: 0.24 [0.18; 0.31] (Figure 5).

Discussion

We estimated the number of laboratory-confirmed symptomatic RV infections per person-year of observation for children below 2 years of age, to be 0.31 [0.19; 0.50]. Excluding the high value (0.84) reported by Mata et al [48], reduces this to 0.24 [0.17; 0.34]. Mata et al's [48] estimate was based on a prospective follow-up study in Mayan Indians in Guatemala, living in poor, crowded areas. Other studies conducted in similar poor and crowded areas reported much lower values for the incidence of symptomatic RV infections (e.g. [41], [45], [55], [60]). This could be due to the local or ethnic pathogenicity of RV infections (e.g.: 39% versus 66% of RV infections were symptomatic in Velazquez et al [41] and Mata et al [48], respectively), or to a lower incidence of symptomatic and asymptomatic RV infections combined (e.g. 0.6 versus 1.1 RV infections per person-year for children <2 years of age in Fischer et al [45] and Mata et al [48], respectively). Also, the Mata et al [48] study was performed at least 10 years earlier than the other studies included, and RV tests were performed on faecal samples that were frozen for 13 to 18 years. However, it remains unclear whether these aspects explain the high incidence value.

The reported values of incidence of symptomatic RV infections apply to children below two years of age, and are based on data from different regions of the world (all continents, except for Australia and Europe), with different climates (from tropical to temperate), from populations with different socioeconomic status (from the slums of the City of Santiago in Chile to a middle-class suburban population in US), and at different times (1967–2003). Although it has already been shown that the proportion of gastroenteritis due to RV is seasonal, and that the extent of this seasonality depends on region [61], the meta analysis indicates region not to be an important determinant of the incidence. Incidence seems also independent of socioeconomic status and year of study, but one has to be aware of some limitations of the study:

Limitations

The number of studies involved in this review is restricted, and additional information is needed to confirm results, especially with respect to possible explanatory factors for observed differences in incidences. For instance, only four studies in developed countries and/or study groups not having a low socioeconomic status were admissible for meta-analysis [18], [50], [52], [54]. Therefore, it could be of value to investigate the incidence of symptomatic RV infections in the placebo groups of RCTs on RV vaccination, as many RCTs were performed in developed countries (e.g. [62][65]). Other factors possibly influencing the incidence of symptomatic RV infection are the effect of breastfeeding and maternal antibodies, virulence of the circulating strain, co-infections and co-morbidity, etc.. Breastfeeding is believed to postpone symptomatic RV infection to a later age, which could explain why in some papers the incidence was found to peak in the second year of life, and not in the first year of life as in the other studies. However, studies on the protective effect of breastfeeding against RV infection have yielded variable results [66].

Another limitation of this review is the nature of the outcome of interest: there is no such thing as a ‘universally accepted’ method to assess the number of symptomatic RV infections per person-year of observation. Consequently, a large variety of methodologies are described by the papers, which could also (partially) explain the variability in the reported outcomes between the studies, i.e. the different papers did not necessarily measure the same events. However, by conducting for each paper a very exhaustive assessment of risk of bias in the reported outcome (with respect to our outcome of interest), and by carefully extracting and adjusting (if necessary) the outcomes of interest, we believe our pooled estimates for the number of laboratory-confirmed symptomatic RV infections per person-year of observation are reliable. Furthermore, sensitivity analysis showed that these estimates were robust for different selections of studies included in the meta-analysis, with the exception of the study by Mata et al [48].

When one wants to estimate the incidence of symptomatic RV+ infections for a specific population for which no prospective studies exist, and for which the resemblance with any of the populations included in our meta-analysis is uncertain, one should use the incidence estimates incorporating this extra source of uncertainty (i.e. 0.31[0.05; 0.72] with and 0.24 [0.09; 0.45] without inclusion of the Mata et al paper). The credible intervals reflect the different sources of uncertainties involved. Therefore, despite being relatively large these intervals are preferable to incidence estimates derived from an ad-hoc selection of one or two prospective studies. Clearly, once information is available on the incidence of symptomatic RV+ infections for the specific population of interest, incidence estimates and their credible intervals should be updated using this new information.

Conclusion

In conclusion, given the currently available information, meta-analysis was shown to be a useful tool in getting an estimate for the incidence of symptomatic RV infections. Our study provides relevant information for disease burden estimates of RV. Furthermore the pooled (global) estimates, in combination with an extra measure of uncertainty to account for variability between studies (populations), should be used as an input in future CE analyses of RV vaccination rather than an ad-hoc selection of one or two of the studies we identified. As such, our meta-analysis fills one of the most important gaps for CE analyses on this subject and thus helps to reduce the uncertainty in the estimates they produce.

Supporting Information

Text S1.

Detailed description of developing the tool for assessing risk of bias.

https://doi.org/10.1371/journal.pone.0006060.s001

(0.03 MB DOC)

Table S1.

Tool for assessing risk of bias in each of the papers included in meta-analysis.

https://doi.org/10.1371/journal.pone.0006060.s002

(0.04 MB DOC)

Table S2.

Details on the way incidence of symptomatic RV infections in children <2 years of age were obtained from studies included in the meta-analysis.

https://doi.org/10.1371/journal.pone.0006060.s003

(0.11 MB DOC)

Table S3.

Assessment of risk of bias in the reported outcomes of the 21 prospective studies included in the meta-analysis.

https://doi.org/10.1371/journal.pone.0006060.s004

(0.10 MB DOC)

Reference List S1.

Studies excluded from bias assessment and meta-analysis.

https://doi.org/10.1371/journal.pone.0006060.s005

(1.43 MB DOC)

Figure S1.

Incidence of symptomatic RV infections by study characteristics. Incidence of symptomatic RV infections per personyear of observation in children below age 2 by Human Development Index (HDI) of the country where each study was conducted, socioeconomic status of the study group (0 = low; 1 = probably low; 2 = not low; 4 = unclear), and year in which the study was conducted (for multi-year studies, midpoint was taken). Black, grey and white circles represent incidences that were evaluated to be at respectively no high risk of bias, possible high risk of bias, and high risk of bias. The size of the circle is proportionate to the personyears of observation.

https://doi.org/10.1371/journal.pone.0006060.s006

(0.01 MB TIF)

Acknowledgments

We thank Zhu Qi for the translation of two Chinese papers, Olga Aleksinskaya and Tetyana Kadankova for the translation of two Russian papers. The study benefited of discussions held as part of 6th framework EC project POLYMOD, and discussion with Daniel Lévy-Bruhl (InVS, Paris).

Author Contributions

Analyzed the data: JB NH MA. Wrote the paper: JB. Conception and design of the review, acquisition of data, interpretation of data: JB. Substantial contribution to the acquisition of data: PVD MVR PB. Substantial contribution to conception and design of the review, interpretation of data, critical revision of the paper: PVD MVR MA NH PB.

References

  1. 1. Cooper N, Coyle D, Abrams K, Mugford M, Sutton A (2005) Use of evidence in decision models: an appraisal of health technology assessments in the UK since 1997. J Health Serv Res Policy 10: 245–250.
  2. 2. WorldHealthOrganization (WHO/IVB/08.04.2008)WHO Guide for standardization of economic evaluations of immunization programmes. Geneva.
  3. 3. Bilcke J, Van Damme P, Beutels P (2009) Cost-effectiveness of rotavirus vaccination: exploring caregiver(s) and “no medical care” disease impact in Belgium. Med Decis Making 29: 33–50.
  4. 4. de Soarez PC, Valentim J, Sartori AM, Novaes HM (2008) Cost-effectiveness analysis of routine rotavirus vaccination in Brazil. Rev Panam Salud Publica 23: 221–230.
  5. 5. Goossens LM, Standaert B, Hartwig N, Hovels AM, Al MJ (2008) The cost-utility of rotavirus vaccination with Rotarix (RIX4414) in the Netherlands. Vaccine 26: 1118–1127.
  6. 6. Lorgelly PK, Joshi D, Iturriza Gómara M, Gray J, Mugford M (2007) Exploring the cost-effectiveness of an immunisation programme for rotavirus gastroenteritis in the United Kingdom. Epidemiol Infect 136: 44–55.
  7. 7. Melliez H, Levybruhl D, Boelle PY, Dervaux B, Baron S, et al. (2008) Cost and cost-effectiveness of childhood vaccination against rotavirus in France. Vaccine 26: 706–715.
  8. 8. Widdowson MA, Meltzer MI, Zhang X, Bresee JS, Parashar UD, et al. (2007) Cost-effectiveness and potential impact of rotavirus vaccination in the United States. Pediatrics 119: 684–697.
  9. 9. Constenla D, Ortega-Barria E, Rheingans RD, Antil L, Saez-Llorens X (2008) [Economic impact of rotavirus vaccination in Panama]. An Pediatr (Barc) 68: 128–135.
  10. 10. Constenla D, O'Ryan M, Navarrete MS, Antil L, Rheingans RD (2006) [Potential cost effectiveness of a rotavirus vaccine in Chile]. Rev Med Chil 134: 679–688.
  11. 11. Fischer TK, Anh DD, Antil L, Cat ND, Kilgore PE, et al. (2005) Health care costs of diarrheal disease and estimates of the cost-effectiveness of rotavirus vaccination in Vietnam. J Infect Dis 192: 1720–1726.
  12. 12. Ho AM, Nelson EA, Walker DG (2008) Rotavirus vaccination for Hong Kong children: an economic evaluation from the Hong Kong Government perspective. Arch Dis Child 93: 52–58.
  13. 13. Isakbaeva ET, Musabaev E, Antil L, Rheingans R, Juraev R, et al. (2007) Rotavirus disease in Uzbekistan: cost-effectiveness of a new vaccine. Vaccine 25: 373–380.
  14. 14. Jit M, Edmunds WJ (2007) Evaluating rotavirus vaccination in England and Wales Part II. The potential cost-effectiveness of vaccination. Vaccine 25: 3971–3979.
  15. 15. Newall AT, Beutels P, Macartney K, Wood J, MacIntyre R (2007) The cost-effectiveness of rotavirus vaccination in Australia. Vaccine 25: 8851–8860.
  16. 16. Podewils LJ, Antil L, Hummelman E, Bresee J, Parashar UD, et al. (2005) Projected cost-effectiveness of rotavirus vaccination for children in Asia. J Infect Dis 192: Suppl 1S133–145.
  17. 17. de Zoysa I, Feachem RG (1985) Interventions for the control of diarrhoeal diseases among young children: rotavirus and cholera immunization. Bull World Health Organ 63: 569–583.
  18. 18. Gurwith M, Wenman W, Hinde D, Feltham S, Greenberg H (1981) A prospective study of rotavirus infection in infants and young children. J Infect Dis 144: 218–224.
  19. 19. Black RE, Merson MH, Huq I, Alim AR, Yunus M (1981) Incidence and severity of rotavirus and Escherichia coli diarrhoea in rural Bangladesh. Implications for vaccine development. Lancet 1: 141–143.
  20. 20. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, et al. (1999) Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses. Lancet 354: 1896–1900.
  21. 21. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, et al. (2000) Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. Jama 283: 2008–2012.
  22. 22. Higgins JP, Green Se (2008) Cochrane handbook for Systematic Reviews of Interventions Version 5.0.0 [updated February 2008]. The Cochrane Collaboration.
  23. 23. Sutton AJ, Abrams KR, Jones DR, T.A. S, Song F (2000) Methods for Meta-Analysis in Medical Research. West Sussex: John Wiley & Sons, Ltd.
  24. 24. Agresti A (2002) An Introduction to Categorical Data Analysis. New Jersey: John Wiley & Sons.
  25. 25. Fagbami AH, Oyejide CO, Enahoro F (1987) Neonatal rotavirus infection in urban and rural communities in Nigeria. Trop Geogr Med 39: 341–344.
  26. 26. Jayashree S, Bhan MK, Raj P, Kumar R, Svensson L, et al. (1988) Neonatal rotavirus infection and its relation to cord blood antibodies. Scand J Infect Dis 20: 249–253.
  27. 27. Tufvesson B, Polberger S, Svanberg L, Sveger T (1986) A prospective study of rotavirus infections in neonatal and maternity wards. Acta Paediatr Scand 75: 211–215.
  28. 28. Banerjee I, Ramani S, Primrose B, Moses P, Iturriza-Gomara M, et al. (2006) Comparative study of the epidemiology of rotavirus in children from a community-based birth cohort and a hospital in South India. J Clin Microbiol 44: 2468–2474.
  29. 29. Jiraphongsa C, Bresee JS, Pongsuwanna Y, Kluabwang P, Poonawagul U, et al. (2005) Epidemiology and burden of rotavirus diarrhea in Thailand: results of sentinel surveillance. J Infect Dis 192: Suppl 1S87–93.
  30. 30. Vernacchio L, Vezina RM, Mitchell AA, Lesko SM, Plaut AG, et al. (2006) Diarrhea in American infants and young children in the community setting: incidence, clinical presentation and microbiology. Pediatr Infect Dis J 25: 2–7.
  31. 31. Yachha SK, Singh V, Kanwar SS, Mehta S (1994) Epidemiology, subgroups and serotypes of rotavirus diarrhea in north Indian communities. Indian Pediatr 31: 27–33.
  32. 32. Haque R, Mondal D, Kirkpatrick BD, Akther S, Farr BM, et al. (2003) Epidemiologic and clinical characteristics of acute diarrhea with emphasis on Entamoeba histolytica infections in preschool children in an urban slum of Dhaka, Bangladesh. Am J Trop Med Hyg 69: 398–405.
  33. 33. Bhan MK, Bhandari N, Sazawal S, Clemens J, Raj P, et al. (1989) Descriptive epidemiology of persistent diarrhoea among young children in rural northern India. Bull World Health Organ 67: 281–288.
  34. 34. Yap KL, Yasmin AM, Wong YH, Ooi YE, Tan SC, et al. (1992) A one year community-based study on the incidence of diarrhoea and rotavirus infection in urban and suburban Malaysian children. Med J Malaysia 47: 303–308.
  35. 35. Panigrahi D, Agarwal KC, Kaur T, Ayyagari A, Walia BN (1985) A study of rotavirus diarrhoea in children in a north Indian community. J Diarrhoeal Dis Res 3: 20–23.
  36. 36. Molbak K, Wested N, Hojlyng N, Scheutz F, Gottschau A, et al. (1994) The etiology of early childhood diarrhea: a community study from Guinea-Bissau. J Infect Dis 169: 581–587.
  37. 37. Punyaratabandhu P, Vathanophas K, Varavithya W, Sangchai R, Athipanyakom S, et al. (1991) Childhood diarrhoea in a low-income urban community in Bangkok: incidence, clinical features, and child caretaker's behaviours. J Diarrhoeal Dis Res 9: 244–249.
  38. 38. Marquez Calderon S, Garcia Lopez JL, Alvarez-Dardet Diaz C, Perea Perez EJ (1990) [Incidence of diarrhea among groups of children in the city of Seville]. An Esp Pediatr 32: 114–118.
  39. 39. Yang CR, Meng ZD, Wang X, Li YL, Zhang YX, et al. (1990) Diarrhoea surveillance in children aged under 5 years in a rural area of Hebei Province, China. J Diarrhoeal Dis Res 8: 155–159.
  40. 40. Raul Velazquez F, Calva JJ, Lourdes Guerrero M, Mass D, Glass RI, et al. (1993) Cohort study of rotavirus serotype patterns in symptomatic and asymptomatic infections in Mexican children. Pediatr Infect Dis J 12: 54–61.
  41. 41. Velazquez FR, Matson DO, Calva JJ, Guerrero L, Morrow AL, et al. (1996) Rotavirus infections in infants as protection against subsequent infections. N Engl J Med 335: 1022–1028.
  42. 42. Oyejide CO, Fagbami AH (1988) An epidemiological study of rotavirus diarrhoea in a cohort of Nigerian infants: II. Incidence of diarrhoea in the first two years of life. Int J Epidemiol 17: 908–912.
  43. 43. Araya M, Figueroa G, Espinoza J, Montesinos N, Spencer E, et al. (1985) Acute diarrhoeal disease in children under 7 years of age in a peri-urban slum of Santiago, Chile. J Hyg (Lond) 95: 457–467.
  44. 44. Cravioto A, Reyes RE, Ortega R, Fernandez G, Hernandez R, et al. (1988) Prospective study of diarrhoeal disease in a cohort of rural Mexican children: incidence and isolated pathogens during the first two years of life. Epidemiol Infect 101: 123–134.
  45. 45. Fischer TK, Valentiner-Branth P, Steinsland H, Perch M, Santos G, et al. (2002) Protective immunity after natural rotavirus infection: a community cohort study of newborn children in Guinea-Bissau, west Africa. J Infect Dis 186: 593–597.
  46. 46. Georges-Courbot MC, Monges J, Beraud-Cassel AM, Gouandjika I, Georges AJ (1988) Prospective longitudinal study of rotavirus infections in children from birth to two years of age in Central Africa. Ann Inst Pasteur Virol 139: 421–428.
  47. 47. Grinstein S, Gomez JA, Bercovich JA, Biscotti EL (1989) Epidemiology of rotavirus infection and gastroenteritis in prospectively monitored Argentine families with young children. Am J Epidemiol 130: 300–308.
  48. 48. Mata L, Simhon A, Urrutia JJ, Kronmal RA, Fernandez R, et al. (1983) Epidemiology of rotaviruses in a cohort of 45 Guatamalan Mayan Indian children observed from birth to the age of three years. J Infect Dis 148: 452–461.
  49. 49. Qadri F, Saha A, Ahmed T, Al Tarique A, Begum YA, et al. (2007) Disease burden due to enterotoxigenic Escherichia coli in the first 2 years of life in an urban community in Bangladesh. Infect Immun 75: 3961–3968.
  50. 50. Rodriguez WJ, Kim HW, Brandt CD, Schwartz RH, Gardner MK, et al. (1987) Longitudinal study of rotavirus infection and gastroenteritis in families served by a pediatric medical practice: clinical and epidemiologic observations. Pediatr Infect Dis J 6: 170–176.
  51. 51. Simhon A, Abed Y, Schoub B, Lasch EE, Morag A (1990) Rotavirus infection and rotavirus serum antibody in a cohort of children from Gaza observed from birth to the age of one year. Int J Epidemiol 19: 160–163.
  52. 52. Simhon A, Mata L, Vives M, Rivera L, Vargas S, et al. (1985) Low endemicity and low pathogenicity of rotaviruses among rural children in Costa Rica. J Infect Dis 152: 1134–1142.
  53. 53. Zheng BJ, Lo SK, Tam JS, Lo M, Yeung CY, et al. (1989) Prospective study of community-acquired rotavirus infection. J Clin Microbiol 27: 2083–2090.
  54. 54. Espinoza F, Paniagua M, Hallander H, Svensson L, Strannegard O (1997) Rotavirus infections in young Nicaraguan children. Pediatr Infect Dis J 16: 564–571.
  55. 55. Hasan KZ, Pathela P, Alam K, Podder G, Faruque SM, et al. (2006) Aetiology of diarrhoea in a birth cohort of children aged 0–2 year(s) in rural Mirzapur, Bangladesh. J Health Popul Nutr 24: 25–35.
  56. 56. Naficy AB, Abu-Elyazeed R, Holmes JL, Rao MR, Savarino SJ, et al. (1999) Epidemiology of rotavirus diarrhea in Egyptian children and implications for disease control. Am J Epidemiol 150: 770–777.
  57. 57. Black RE, Brown KH, Becker S, Alim AR, Huq I (1982) Longitudinal studies of infectious diseases and physical growth of children in rural Bangladesh. II. Incidence of diarrhea and association with known pathogens. Am J Epidemiol 115: 315–324.
  58. 58. Reves RR, Hossain MM, Midthun K, Kapikian AZ, Naguib T, et al. (1989) An observational study of naturally acquired immunity to rotaviral diarrhea in a cohort of 363 Egyptian children. Calculation of risk for second episodes using age-specific person-years of observation. Am J Epidemiol 130: 981–988.
  59. 59. Rowland MG, Goh SG, Williams K, Campbell AD, Beards GM, et al. (1985) Epidemiological aspects of rotavirus infection in young Gambian children. Ann Trop Paediatr 5: 23–28.
  60. 60. Linhares AC, Gabbay YB, Freitas RB, da Rosa ES, Mascarenhas JD, et al. (1989) Longitudinal study of rotavirus infections among children from Belem, Brazil. Epidemiol Infect 102: 129–145.
  61. 61. Cook SM, Glass RI, LeBaron CW, Ho MS (1990) Global seasonality of rotavirus infections. Bull World Health Organ 68: 171–177.
  62. 62. Block SL, Vesikari T, Goveia MG, Rivers SB, Adeyi BA, et al. (2007) Efficacy, immunogenicity, and safety of a pentavalent human-bovine (WC3) reassortant rotavirus vaccine at the end of shelf life. Pediatrics 119: 11–18.
  63. 63. Vesikari T, Clark HF, Offit PA, Dallas MJ, DiStefano DJ, et al. (2006) Effects of the potency and composition of the multivalent human-bovine (WC3) reassortant rotavirus vaccine on efficacy, safety and immunogenicity in healthy infants. Vaccine 24: 4821–4829.
  64. 64. Vesikari T, Karvonen A, Puustinen L, Zeng SQ, Szakal ED, et al. (2004) Efficacy of RIX4414 live attenuated human rotavirus vaccine in Finnish infants. Pediatr Infect Dis J 23: 937–943.
  65. 65. Vesikari T, Matson DO, Dennehy P, Van Damme P, Santosham M, et al. (2006) Safety and efficacy of a pentavalent human-bovine (WC3) reassortant rotavirus vaccine. N Engl J Med 354: 23–33.
  66. 66. Mrukowicz J, Szajewska H, Vesikari T (2008) Options for the prevention of rotavirus disease other than vaccination. J Pediatr Gastroenterol Nutr 46: Suppl 2S32–37.
  67. 67. Oyejide CO, Fagbami AH (1988) An epidemiological study of rotavirus diarrhoea in a cohort of Nigerian infants: I. Methodology and experiences in the recruitment and follow-up of patients. Int J Epidemiol 17: 903–907.