Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Rotavirus vaccine coverage and factors associated with uptake using linked data: Ontario, Canada

  • Sarah E. Wilson ,

    Roles Funding acquisition, Methodology, Writing – original draft, Writing – review & editing

    sarah.wilson@oahpp.ca

    Affiliations Public Health Ontario, Toronto, Ontario, Canada, Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada

  • Hannah Chung,

    Roles Data curation, Formal analysis, Methodology, Writing – review & editing

    Affiliation Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada

  • Kevin L. Schwartz,

    Roles Funding acquisition, Methodology, Writing – review & editing

    Affiliations Public Health Ontario, Toronto, Ontario, Canada, Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada

  • Astrid Guttmann,

    Roles Funding acquisition, Methodology, Writing – review & editing

    Affiliations Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada, Department of Pediatrics, Hospital for Sick Children, Toronto, Ontario, Canada, Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada

  • Shelley L. Deeks,

    Roles Funding acquisition, Methodology, Writing – review & editing

    Affiliations Public Health Ontario, Toronto, Ontario, Canada, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada

  • Jeffrey C. Kwong,

    Roles Funding acquisition, Methodology, Writing – review & editing

    Affiliations Public Health Ontario, Toronto, Ontario, Canada, Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada

  • Natasha S. Crowcroft,

    Roles Funding acquisition, Methodology, Writing – review & editing

    Affiliations Public Health Ontario, Toronto, Ontario, Canada, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada, Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Ontario, Canada

  • Laura Wing,

    Roles Data curation, Methodology, Writing – review & editing

    Affiliation Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada

  • Karen Tu

    Roles Funding acquisition, Methodology, Writing – review & editing

    Affiliations Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada, Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada

Abstract

Background

In August 2011, Ontario, Canada introduced a rotavirus immunization program using Rotarix vaccine. No assessments of rotavirus vaccine coverage have been previously conducted in Ontario.

Methods

We assessed vaccine coverage (series initiation and completion) and factors associated with uptake using the Electronic Medical Record Administrative data Linked Database (EMRALD), a collection of family physician electronic medical records (EMR) linked to health administrative data. Series initiation (1 dose) and series completion (2 doses) before and after the program’s introduction were calculated. To identify factors associated with series initiation and completion, adjusted odds ratios (aOR) and 95% confidence intervals (95%CI) were calculated using logistic regression.

Results

A total of 12,525 children were included. Series completion increased each year of the program (73%, 79% and 84%, respectively). Factors associated with series initiation included high continuity of care (aOR = 2.15; 95%CI, 1.61–2.87), maternal influenza vaccination (aOR = 1.55; 95%CI,1.24–1.93), maternal immmigration to Canada in the last five years (aOR = 1.47; 95% CI, 1.05–2.04), and having no siblings (aOR = 1.62; 95%CI,1.30–2.03). Relative to the first program year, infants were more likely to initiate the series in the second year (aOR = 1.71; 95% CI 1.39–2.10) and third year (aOR = 2.02; 95% CI 1.56–2.61) of the program. Infants receiving care from physicians with large practices were less likely to initiate the series (aOR 0.91; 95%CI, 0.88–0.94, per 100 patients rostered) and less likely to complete the series (aOR 0.94; 95%CI, 0.91–0.97, per 100 patients rostered). Additional associations were identified for series completion.

Conclusions

Family physician delivery achieved moderately high coverage in the program’s first three years. This assessment demonstrates the usefulness of EMR data for evaluating vaccine coverage. Important insights into factors associated with initiation or completion (i.e. high continuity of care, smaller roster sizes, rural practice location) suggest areas for research and potential program supports.

Introduction

Prior to the implementation of vaccination programs, rotavirus was a common cause of childhood gastroenteritis, responsible for up to 40% of acute gastroenteritis presentations (depending on season) and a cause of substantial healthcare utilization [1,2]. In the pre-vaccine era in Canada, one-third of children with rotavirus gastroenteritis sought care in an outpatient setting, 15% used emergency department services and 7% required hospitalization [2]. Two live attenuated oral rotavirus vaccines are authorized for use in Canada: RotaTeq® (RV5, Merck Canada Inc.) since 2006 [3] and Rotarix (RV1, GlaxoSmithKline Inc.) as of 2007[4]. Canada’s National Advisory Committee on Immunization (NACI) issued recommendations for the use of rotavirus vaccines in 2008 and 2010[5,6]. In August 2011, Ontario implemented a universal publicly-funded rotavirus immunization program with RV1 vaccine at 2 and 4 months of age. Prior to the program, parents could purchase the vaccine with a physician prescription. The publicly-funded program has been associated with a 71% reduction in hospitalizations due to rotavirus infection [7]. However, a formal coverage evaluation has been challenged by two issues. First, the routine processes for coverage monitoring in Ontario delay assessment until the time of school entry. Second, physicians are not remunerated for the delivery of this oral vaccine (in contrast to parenteral vaccines); consequently there is no immunization delivery billing code available in health administrative data. The use of electronic medical records (EMRs) may help fill this information gap.

The objectives of this study were to: (1) assess rotavirus vaccine coverage in Ontario using EMR data as recorded in family physician offices; (2) assess compliance with age-based vaccine administration recommendations; and (3) identify factors associated with series initiation and completion.

Methods

Study population and setting

In Ontario, Canada’s most populous province (population 13.5 million in 2013)[8], infant and toddler immunizations are almost exclusively administered through physician offices, by family physicians, pediatricians and nurse practitioners. The majority of pediatric primary care health services are delivered by family physicians [9]. Medical services, including immunization delivery, are funded by the universal, single-payer Ontario Health Insurance Plan (OHIP).

We included pre-defined birth cohorts who receive primary care from family physicians who share their data with the Electronic Medical Record Administrative data Linked Database (EMRALD), a centralized repository of EMR data. EMRALD has been formally evaluated [10,11] and used for research using EMR data alone or, after linkage to health administrative data [1216]. It has also been used to validate the introduction of vaccine-specific billing codes in Ontario [17]. That study found that the data within EMRALD was more complete (i.e. had a greater number of immunization events) compared to billing claims data [17]. EMRALD contains EMR data from over 350 Ontario family physicians using PS Suite® EMR software, the most widely used EMR platform in Ontario. This represents approximately 3% of practicing family physicians [18]. Individual-level data from EMRALD are collected annually and linked to health administrative databases at the Institute for Clinical Evaluative Sciences (ICES).

We created six cohorts of children to evaluate coverage during the first three years of the program and to assess coverage during the preceding years when the vaccine was recommended by NACI, but not publicly-funded (i.e. not included within Ontario’s routine immunization schedule). Children with birth dates between August 1, 2011 and July 31, 2014 and who received care from an EMRALD physician who had submitted EMR data during the most recent round of data collection (summer of 2015) were included in the coverage assessment of the program period. Children born between January 1, 2008 and December 31, 2010 were included in the coverage assessment of privately purchased vaccine. We used the date of birth range of January 1 to July 31, 2011 as a wash-out period as children born during this period may have started the series with privately purchased vaccine and completed it as part of the public program.

We excluded children with fewer than 3 visits recorded in EMRALD, those who died during the first year of life, and those with an EMR start date >6 weeks after birth. We also excluded children with multiple identification numbers, missing sex or birthdate information, or in cases where there was discrepant demographic information between EMRALD and Ontario’s Registered Persons Database.

Data sources

Rotavirus immunization status.

We conducted text searches for rotavirus vaccine using generic terms and proprietary names in the immunizations field of the continuous patient profile (CPP) and in the “treatments/prescriptions” fields using a series of keywords (e.g., “rotavirus”, “Rotarix”, “Rotateq”). Most entries use structured terms but because free-text data entry is also possible, search terms also included keywords with spelling errors (e.g. “Rotarx”). S1 Appendix outlines the complete list of search terms. If multiple doses were recorded as administered on the same date, we assumed this reflected data entry error and only one dose was used for analyses. We assessed the completeness of our EMR search methodology to identify rotavirus immunization events in a post -hoc analysis, outlined further in S2 Appendix.

Covariates.

Several health administrative databases housed at ICES were linked using unique encoded identifiers to obtain covariate information for the cohort child, their mother and assigned physician.

Infant characteristics.

We used Ontario’s Registered Persons Database (RPDB) to identify the child’s sex, vital statistics, and postal code. The RPDB is a population-based repository of demographic information including unique health card number for all Ontario residents who are eligible for health services under OHIP. Postal code was linked to 2006 Statistic Canada Census postal code information to determine: (1) rural residence (community size < 10,000) and (2) mean household income quintile (adjusted for household and community size) of the enumeration or dissemination area as a proxy for socioeconomic status.

The MOMBABY database is comprised of admission records of delivering mothers and their newborn babies which are linked through a unique matching number on each hospitalization record. This dataset was used to identify low birth weight (< 2500 grams) and premature (< 37 weeks gestation) infants. We used the Canadian Institute of Health Information’s Discharge Abstract Database (CIHI-DAD) to identify chronic medical conditions among children, as described by Feudtner et al. [19] and those with congenital malformations and/or chromosomal abnormalities (using International Classification of Diseases-10 (ICD-10) codes Q00-Q99) in hospitalizations during the first year of life.

We defined receipt of other childhood vaccines as having received at least one dose of the multicomponent diphtheria, tetanus, acellular pertussis, inactivated polio, and Haemophilus influenzae type b (DTaP-IPV-Hib) vaccine or pneumococcal conjugate vaccine (PCV) administered between 6 weeks and 4 months of age, assessed in days (42–112 days). We accepted either vaccine documentation in EMRALD or the presence of a vaccine-specific OHIP billing code for administration (DTaP-IPV-Hib = G841 and PCV = G846).

OHIP data was also used to identify the number of primary care visits in the first year of life and to calculate a continuity of care (COC) score. COC is defined as the number of visits to an individual’s usual primary care physician divided by the total number of primary care visits during the first year of life. We defined a COC of less than 50% as low [20,21]. For the study cohort, the usual primary care physician was defined by physician information within EMRALD. For the Ontario reference cohort presented in Table 1, children were assigned to a usual primary care physician based on roster data within the Client Agency Program Enrolment (CAPE). If a child was not rostered, he or she was assigned to the physician who billed the most primary care OHIP visits in the first year of life, based on total cost (primary care codes available upon request).

thumbnail
Table 1. Child and maternal characteristics of the EMRALD study cohorts as compared to the 2013 Ontario birth cohort.

https://doi.org/10.1371/journal.pone.0192809.t001

Maternal and family characteristics.

We used the MOMBABY database and the CIHI-DAD to identify the mothers of the children in the study cohort and to determine maternal age at first delivery. MOMBABY was also used to determine the number of children in the household, based on the number of prior deliveries of the study cohort’s biological mother (i.e. previous stillbirths were excluded from the count).

We used the Immigration, Refugees and Citizenship Canada (IRCC) Permanent Resident database, containing information on individuals who have landed in Ontario since 1985, to determine recent maternal immigration; recent was defined by a landing date within the 5 years prior to the cohort child’s birth.

Finally, we used OHIP and Ontario Drug Benefit (ODB) databases to identify maternal influenza immunization during the year following delivery. The influenza-specific OHIP billing codes of G590 and G591 and the drug identification numbers (DIN#s) ‘02346850’, ‘02223929’, ‘02362384’, ‘02015986’ from ODB were used.

Physician characteristics.

The ICES Physician Database contains information on physician demographics and specialization. We obtained the following physician information: sex, rural practice, decade of graduation, and place of undergraduate medical training (Canada vs. outside of Canada). We used the CAPE database to determine total patient roster size effective July 1, 2013, by physician.

Analysis

Descriptive epidemiology of the study cohort and their physicians.

We compared the characteristics of our study cohort (private and public program periods combined) with the 2013 Ontario birth cohort and completed a similar comparison of EMRALD physicians represented in our study with the primary care providers (family physicians and pediatricians) for the reference birth cohort. We calculated standardized differences, a measure that is not as sensitive to sample size as traditional tests [22]. Standardized differences of greater than 0.1 are considered to be meaningful [23].

Coverage.

We defined full series coverage as 2 doses of RV1 or 3 doses of RV5. If a series of mixed products was used, 3 doses were required for completion [24]. If rotavirus vaccine was recorded without a trade name, it was assumed to be RV1. Coverage was calculated using two approaches. The first involved counting all immunization events, regardless of the timing between doses, whereas the second approach considered only doses that were separated by the recommended minimum interval (4 weeks). Cochrane-Armitage trend tests were used to determine whether there was a linear trend in coverage over time. We conducted a sensitivity analyses to explore if altering our inclusion criterion of requiring at least 3 EMR visits in the first year of life impacts immunization coverage.

Compliance.

We assessed compliance for birth cohorts eligible for publicly-funded RV1 vaccine. Children who received Rotateq® were excluded as our primary interest was implementation of the publicly-funded program. We assessed adherence to the age-based recommendations outlined in the Canadian Immunization Guide (CIG) [24] and RV1 product monograph [4] separately. As with coverage, we made the assumption that children for whom generic rotavirus vaccine was recorded in EMRALD received RV1.

Multivariable regression.

We assessed associations between covariates and series initiation and completion among the birth cohorts eligible for publicly-funded vaccine using logistic regression with the use of general estimating equations to account for clustering at the physician level. We excluded children with missing covariate information and patients assigned to one physician who did not initiate the series, as inclusion of these children (n = 39) caused errors in running the model. We assessed series initiation and completion separately. We accepted any first dose for our measure of series initiation and did not apply a minimum interval in defining series completion as we were interested in factors associated with vaccine uptake, rather than factors associated with children receiving a perfect schedule. Covariates were identified a priori for inclusion in each model and informed by Canadian rotavirus coverage research priorities [25], other studies in the coverage literature [2630] and supplemented with additional factors we felt operationalized domains relevant to the World Health Organization vaccine acceptance framework of: Complacency, Convenience and Confidence [31]. These included characteristics of the infant (sex, rural residence, neighbourhood income quintile, comorbidity, low birth weight, prematurity, number of primary care visits during the first year of life, continuity of care (> = 50% of visits to the same primary care physician), receipt of the first dose of DTaP-IPV-Hib vaccine or PCV; mother (recent immigration, age at first pregnancy, influenza vaccination in the year following delivery of the cohort child, number of siblings at the time of the cohort child’s birth); and physician (sex, rural practice, decade of graduation from medical school, foreign training, total patient roster size). Program year was included in the model to account for possible trends in program delivery over time (e.g., increased familiarity of providers with the vaccine program). Receipt of other childhood vaccinations and maternal influenza vaccination were hypothesized to be more relevant to initiation and were not included in the model examining series completion. We present unadjusted and adjusted odds ratios (aOR) and 95% confidence intervals (95% CI) for each covariate. All p-values are two-sided.

Ethics, consent and privacy statements.

This study was approved by the institutional review boards at Sunnybrook Health Sciences Centre and Public Health Ontario in Toronto, Canada. Similar to other studies using administrative data, subjects were not contacted to receive individual expressed consent. However, all analyses occurred following de-identification. Datasets were linked using unique encoded identifiers and analyzed at ICES using SAS software, version 9.4 (SAS Institute, Cary, NC).

Results

We identified 13,534 children who were born between January 1, 2008 to December 31, 2010, and August 1, 2011 to July 31, 2014 in EMRALD, of which 99% were successfully linked to administrative databases. After study exclusions, there were 12,525 children included in our coverage assessment: 5,039 born during the period of private vaccine eligibility and 7,486 eligible for publicly-funded vaccine (Fig 1). Characteristics of the study children and their mothers were compared to the 2013 Ontario birth cohort (Table 1). The two groups were similar across most characteristics with very few exceptions, as assessed by standardized differences. A greater proportion of study children lived in rural areas and had lower continuity of care. The 335 unique EMRALD family physicians providing care to study children were more likely to be women, less likely to be foreign-trained, with smaller roster sizes and with fewer years in practice compared to the usual primary care providers (family physicians and pediatricians) seen by the 2013 Ontario birth cohort (Table 2), as assessed using standardized differences.

thumbnail
Fig 1. Flow diagram of exclusions made to produce the final cohort for descriptive and multivariable analyses (please see attachment).

https://doi.org/10.1371/journal.pone.0192809.g001

thumbnail
Table 2. EMRALD study cohort physician characteristics compared to reference physicians who provide primary care to the 2013 Ontario birth cohort.

https://doi.org/10.1371/journal.pone.0192809.t002

Series coverage for infants born during the period of private purchase ranged from 3.0% to 7.2% (Table 3). Among the birth cohorts eligible for publicly-funded vaccine, series initiation ranged from 83.2% to 91.3%. Full series coverage significantly increased each year of the program, from 73.0%, to 78.5% and 84.2% (test for trend, p< 0.0001). Series completion among initiators also increased over time, and was higher in the public program period. Full series coverage decreased by 0.2% or less if coverage was calculated requiring a minimum interval of 28 days between doses. Our sensitivity analysis with modified inclusion criterion allowing fewer EMR visits resulted in minimal changes to the immunization coverage results. During the private purchase period, series coverage estimates were reduced by 0.4% or less, if the inclusion criteria were changed to require only one EMR visit. Series coverage estimates during the public program were reduced by 2.3% or less if a similar modification was made and by 4.0% or less if there was no EMR visit criterion factored into the creation of the analytic cohort (S3 Appendix).

thumbnail
Table 3. Rotavirus vaccine initiation and full series coverage, by birth cohort and program status.

https://doi.org/10.1371/journal.pone.0192809.t003

Compliance with age-based scheduling recommendations for publicly-funded rotavirus vaccine was high (Table 4). Nearly all subjects received the vaccine on/after 6 weeks of age (>99%) with a minimum interval of 4 weeks between doses (>99%). Among the 5,832 children who received at least two doses of RV1, 97.3% received the final dose of a multi-dose series on or before 24 weeks of age, as per product monograph. It was administered on or before 32 weeks of age (as per CIG guidance) in 99.7%. Three doses of RV1 or a generic term for rotavirus vaccine were documented in the EMR among twenty-six children in the public program period (<1%).

thumbnail
Table 4. Compliance and non-compliance with vaccine administration recommendations during the program period (n = 6527)a,b.

https://doi.org/10.1371/journal.pone.0192809.t004

Factors significantly associated with the odds of series initiation in multivariable modelling included high continuity of care (aOR = 2.15; 95%CI,1.61–2.87), maternal influenza vaccination in the year following delivery (aOR = 1.55; 95%CI,1.24–1.93), maternal immigration to Canada in the previous five years (aOR = 1.47, 95% CI 1.05–2.04), and having no siblings (aOR = 1.62; 95%CI,1.30–2.03) or only one sibling (aOR = 1.31; 95%CI, 1.04–1.65)(Table 5). Relative to the first program year, infants were more likely to initiate the series in the second year (aOR = 1.71; 95% CI 1.39–2.10) and third year (aOR = 2.02; 95% CI 1.56–2.61) of the program. Infants were less likely to initiate the series if they had not received other routine infant vaccines (aOR = 0.04; 95%CI, 0.03–0.07) or received care from a physician with a larger patient roster size (aOR 0.91; 95%CI, 0.88–0.94, per 100 patients rostered). Among initiators, those with a greater number of primary care visits in the first year of life: 7–11 visits (aOR = 1.61; 95%CI, 1.30–1.99), > = 12 visits (aOR = 1.43; 95%CI,1.10–1.85), high continuity of care (aOR = 1.61; 95%CI, 1.27–2.04), or receiving care from a physician in rural practice (aOR = 2.08; 95%CI, 1.29–3.35) were more likely to complete the series. Infants were also more likely to complete the series if they initiated the vaccine in the third program year (aOR = 1.49; 95% CI 1.15–1.92), relative to the first year of the program. Children born to a mother who was younger than 24 years of age at the time of her first pregnancy (aOR = 0.71; 95%CI, 0.58–0.86), and those receiving care from a physician trained outside of Canada (aOR = 0.60; 95%CI, 0.39–0.92) and from physicians with a larger patient roster size (aOR 0.94; 95%CI, 0.91–0.97, per 100 patients rostered) were less likely to complete the series. There was no association between series initiation or completion and neighbourhood income quintile, rural residence, prematurity or low birthweight.

thumbnail
Table 5. Unadjusted and adjusted ORs of rotavirus (RV) vaccine series initiation and series completion among children born during the public program years.

https://doi.org/10.1371/journal.pone.0192809.t005

Discussion

Despite the absence of a physician billing code specific to rotavirus vaccine and the challenges of timely assessment of infant vaccine programs using school-based coverage methods, we were able to conduct a detailed coverage assessment in Ontario by using family physician EMRs. Rotavirus vaccine uptake (series completion) increased each year of the first three years of the program from 73% to 84%, with excellent compliance with age-based dosing guidelines. Linkage to health administrative datasets allowed for factors associated with series initiation and completion to be identified.

Coverage estimates over Ontario’s first three program years are comparable to the early years of program implementation in other large Canadian provinces [32,33]. British Columbia implemented a routine RV program in 2012 and provincial two-dose coverage was estimated to be 70% and 75% among two-year olds in 2014 and 2015, respectively [32]. Two-dose coverage in Quebec, which implemented its routine program in November 2011, was 78% among 2-year old and 86% among 15-month old children when assessed as part of a routine, ongoing coverage survey in 2014 [33]. Higher coverage estimates (>90%) have been observed in Prince Edward Island where infant immunizations are delivered exclusively by public health nurses to the annual birth cohort of approximately 1400 children [34]. All publicly-funded programs implemented to date in Canada use RV1. A Canadian coverage target has not yet been set; not all jurisdictions currently offer rotavirus as part of their publicly funded immunization schedule.

In contrast to other childhood vaccines where un- or under-immunized children can get caught up at a later age, rotavirus vaccines have age-based scheduling recommendations due to a possible age-related association between intussusception and rotavirus vaccination [35]. Our assessment found that compliance with age-based recommendations was excellent; among the 6,527 children who initiated the series during the public program, nearly all children received the first dose before 20 weeks and >99% received the final dose before 32 weeks of age, reflecting NACI’s advice. US investigators have examined compliance with the Advisory Committee on Immunization Practices (ACIP) and product guidelines in distinct groups of infants (i.e. privately-insured infants, Medicaid recipients, separately) rather than through a population-based assessment. In addition, investigators have typically combined adherence with dosing guidelines and series completion into one measure, which reduces the proportion of children assessed as compliant [3639]. We were not able to identify any Canadian literature that examined compliance with NACI’s rotavirus schedule recommendations.

Identifying and understanding health equity gradients in rotavirus vaccine coverage is an important aspect of program evaluation. We found no association between series initiation or completion and neighbourhood income quintile, an important finding for a system with publicly-funded immunization delivery. Our findings are in alignment with a recent study from a region in the province of Quebec that examined rotavirus coverage by neighbourhood-level characteristics such as unemployment, low income households, households with single mothers, and households with mothers without a high school diploma. They found no significant difference in coverage by any of these measures of socioeconomic status [40]. However, it should be noted that other studies utilizing administrative data in Ontario have found an association between childhood vaccine uptake and neighbourhood income quintile, in contrast to our findings [20,21].

We did not have access to information on children’s ethnicity but were able to explore uptake among infants in newcomer families. Ontario has an ethnically diverse population with approximately 28% of residents born outside of Canada [41]. We found that infants of mothers who had immigrated to Canada within five years of the cohort child’s birth were more likely to initiate the series (aOR = 1.47; 95%CI, 1.05–2.04), consistent with other studies demonstrating a high degree of vaccine acceptance among new Canadians [42,43]. We are unable to explain the observation that children receiving care from a physician who trained outside of Canada were less likely to complete the series. This factor was not significant for series initiation. The proportion of physicians who trained outside of Canada and participate in EMRALD is relatively small and we strongly suggest caution in generalizing this finding to all physicians trained outside of Canada who comprise approximately one-third of practicing physicians in Ontario.

The 2014 CIC rotavirus vaccine recommendations [25] identified analyses of coverage among premature infants as a research priority. Preterm infants are at highest risk for severe rotavirus gastroenteritis [44] and may exceed the age limit recommended for timely administration of the first dose if rotavirus immunization is deferred until hospital discharge [45], which can result in reduced coverage among these vulnerable infants [46]. We found no association between series initiation or completion and prematurity or low birthweight. Although 6.2% of the study cohort eligible for the public program was born preterm (<37 weeks), our inclusion criterion of having an EMR start date within 6 weeks of birth would exclude very preterm infants requiring longer hospital admissions.

Finally, this study re-affirmed previously noted associations for immunization uptake such as the receipt of other routine childhood vaccinations [26,39], having no or fewer siblings [26,27], and attitudinal factors [31], which we assessed by examining maternal influenza vaccine uptake. It also confirmed the importance of health service delivery factors including the importance of continuity of care for immunization delivery [29] and that busy, large physician practices may be sub-optimal for coverage [30].

This study represents the first coverage assessment of rotavirus vaccine to be carried out in Canada’s largest province using a collection of comprehensive family physician EMRs. If immunization information had not been accessed in EMRALD, the first rotavirus coverage assessment would have been delayed until following the 2019–20 school year, when the first age-eligible cohort will be 7 years-of-age, the typical milestone used for coverage assessment in Ontario [47]. Despite these strengths, the reliance on EMR records poses some data quality caveats as the accuracy of our coverage estimate is dependent on the completeness of vaccine administration documentation within EMRALD. However, poor data quality would most likely underestimate vaccine coverage and we found relatively high vaccine uptake and the validation of our search methods suggest that we are unlikely to have missed immunization events. Furthermore, a previous validation study found that EMRALD data was more complete (i.e., contained more immunization data) compared to billing claims [17]. Finally, EMRALD is a voluntary sample of Ontario family physicians. Our study population was similar to the 2013 Ontario birth cohort in most respects, but the study physicians identified through EMRALD were younger, more likely to be female and less likely to have completed their medical training outside of Canada. These physician characteristics likely reflect the characteristics of physicians who have adopted EMR software within their practices and trends in the family physician workforce and it is difficult to comment on the extent to how these differences might influence the generalizability of our findings to the Ontario population. To address this question, a comparison of rotavirus coverage assessed using different data sources (EMRALD versus school-based coverage surveillance) will be feasible in 2020 once eligible children reach the age of routine coverage assessment in Ontario. Finally, our dataset on newcomers only includes immigrants who land in Ontario, and not those whose original point of entry within Canada is another province. This may have under-estimated the proportion of children we identified as having a newcomer mother.

Conclusions

Rotavirus vaccine uptake increased in the three years following the program’s launch in Ontario. Several maternal/family and physician characteristics were associated with series initiation and completion. This assessment demonstrates the usefulness of EMR data for evaluating vaccine coverage prior to school-entry in Ontario. Our ability to link EMR data to health administrative datasets generated important insights into factors associated with initiation or completion (i.e. continuity of care, roster size, practice location) which should be explored in future research and considered within potential program supports.

Supporting information

S1 Appendix. Search terms used to identify rotavirus vaccines in EMRALD.

https://doi.org/10.1371/journal.pone.0192809.s001

(DOCX)

S2 Appendix. Sensitivity analysis to determine completeness of EMR search strategy to identify rotavirus immunization events.

https://doi.org/10.1371/journal.pone.0192809.s002

(DOCX)

S3 Appendix. Sensitivity analyses on vaccine initiation and full series coverage estimates, by birth cohort and program status, using different criteria for the number of visits to an EMRALD physician within the first year of life exclusion criterion.

https://doi.org/10.1371/journal.pone.0192809.s003

(DOCX)

Acknowledgments

Parts of this material are based on data and/or information compiled and provided by CIHI. However, the analyses, conclusions, opinions and statements expressed in the material are those of the author(s), and not necessarily those of CIHI. The study team acknowledges Immigration, Refugees and Citizenship Canada (IRCC) for access to data within the Permanent Resident database. We thank IMS Brogan Inc. for use of their Drug Information Database.

References

  1. 1. National Advisory Committee on Immunization. Literature review on Rotavirus: disease and vaccine characteristics. Can Commun Dis Rep. 2010; 36(ACS-14):1–31
  2. 2. Senecal M, Quach C, Brisson M. The burden of rotavirus-associated gastroenteritis in young Canadian children: A cohort model. Poster session presented at: Canadian Public Health Association 97th Annual Conference; 2006 May 28–31; Vancouver, BC, Canada
  3. 3. RotaTeq® [product monograph]. Kirkland, QC, Canada: Merck Frosst Canada Ltd; 2013 [cited 2016 Dec 30]. http://www.merck.ca/assets/en/pdf/products/RotaTeq-PM_E.pdf.
  4. 4. ROTARIX™ [product monograph]. Mississauga, ON, Canada: GlaxoSmithKline Inc; 2016. [cited 2016 Dec 30]. http://www.gsk.ca/english/docs-pdf/product-monographs/Rotarix.pdf.
  5. 5. National Advisory Committee on Immunization (NACI). An Advisory Committee Statement (ACS) National Advisory Committee on Immunization (NACI) Statement on the recommended use of a pentavalent human-bovine reassortant rotavirus vaccine. Can Comm Dis Rep. 2008; 34(1):1–33.
  6. 6. National Advisory Committee on Immunization (NACI). An Advisory Committee Statement (ACS) National Advisory Committee on Immunization (NACI) updated statement on the use of rotavirus vaccines. Can Comm Dis Rep. 2010; 36(4):1–37.
  7. 7. Wilson SE, Rosella LC, Wang J, Le Saux N, Crowcroft NS, Harris T et al. Population-Level Impact of Ontario’s Infant Rotavirus Immunization Program: Evidence of Direct and Indirect Effects. PLoS One. 2016; 11(5):e0154340. pmid:27168335
  8. 8. Statistics Canada. Population by year, by province and territory [Internet]. Ottawa, ON: Statistics Canada; 2016 [cited 2016 Sep 23]. http://www.statcan.gc.ca/tables-tableaux/sum-som/l01/cst01/demo02a-eng.htm.
  9. 9. Guttmann A, Schultz SE, Jaakkimainen L. Primary Care for Children. In: Jaakkimainen L, Upshur R, Klein-Geltink JE, Leong A, Maaten S, Schultz SE, Wang L, editors. Primary Care in Ontario: ICES Atlas. Toronto, Canada: Institute for Clinical Evaluative Sciences; 2006: 35–52. http://www.ices.on.ca/~/media/Files/Atlases-Reports/2006/Primary-care-in-Ontario/Full%20report.ashx.
  10. 10. Tu K, Mitiku TF, Ivers NM, Guo H, Lu H, Jaakkimainen L. Evaluation of Electronic Medical Record Administrative data Linked Database (EMRALD). Am J Manag Care. 2014; 20:e15–21
  11. 11. Tu K, Widdifield J, Young J, Oud W, Ivers NM, Butt DA, et al. Are family physicians comprehensively using electronic medical records such that the data can be used for secondary purposes? A Canadian perspective. BMC Med Inform Decis Mak. 2015; 15:67. pmid:26268511
  12. 12. Krysko KM, Ivers NM, Young J, O’Connor P, Tu K. Identifying individuals with multiple sclerosis in an electronic medical record. Mult Scler. 2015; 21(2):217–24. pmid:24948683
  13. 13. Jaakkimainen L, Glazier R, Barnsley J, Salkeld E, Lu H, Tu K. Waiting to see the specialist: patient and provider characteristics of wait times from primary to specialty care. BMC Fam Pract. 2014; 15:16. pmid:24460619
  14. 14. Butt DA, Tu K, Young J, Green D, Wang M, Ivers N, et al. A validation study of administrative data algorithms to identify patients with Parkinsonism with prevalence and incidence trends. Neuroepidemiology. 2014; 43(1):28–37. pmid:25323155
  15. 15. Tu K, Wang M, Young J, Green D, Ivers NM, Butt D, et al. Validity of administrative data for identifying patients who have had a stroke or transient ischemic attack using EMRALD as a reference standard. Can J Cardiol. 2013; 29(11):1388–94. pmid:24075778
  16. 16. Tu K, Mitiku T, Lee DS, Guo H, Tu JV. Validation of physician billing and hospitalization data to identify patients with ischemic heart disease using data from the Electronic Medical Record Administrative data Linked Database (EMRALD). Can J Cardiol. 2010; 26(7):e225–8. pmid:20847968
  17. 17. Schwartz KL, Tu K, Wing L, Campitelli MA, Crowcroft NS, Deeks SL, et al. Validation of infant immunization billing codes in administrative data. Hum Vaccin Immunother. 2015; 11(7):1840–7. pmid:26075651
  18. 18. Ontario Physician Human Resources Data Center. Quick facts at a glance, Ontario active physicians, 2015. Hamilton, ON: McMaster University, 2015 [cited 2017 Sep 5].
  19. 19. Feudtner C, Christakis DA, Connell FA. Pediatric deaths attributable to complex chronic conditions: a population-based study of Washington State 1980–1997. Pediatrics. 2000;106 (1 Pt 2): 205–9 pmid:10888693
  20. 20. Campitelli MA, Inoue M, Calzavara AJ, Kwong JC, Guttmann A. Low rates of influenza immunization in young children under Ontario’s universal influenza immunization program. Pediatrics. 2012; 129(6):e1421–30. pmid:22585770
  21. 21. Guttmann A, Manuel D, Dick PT, To T, Lam K, Stukel TA. Volume matters: physician practice characteristics and immunization coverage among young children insured through a universal health plan. Pediatrics. 2006; 117(3):595–602. pmid:16510636
  22. 22. Mamdani M, Sykora K, Li P, Normand ST, Streiner DL, Austin PC, et al. Reader’s guide to critical appraisal of cohort studies: 2. Assessing potential for confounding. BMJ. 2005; 330: 960–2. https://doi.org/10.1136/bmj.330.7497.960 pmid:15845982
  23. 23. Cohen J. Statistical power analysis for the behavioural sciences. Hillsdale, NJ: Academic Press, 1988.
  24. 24. Public Health Agency of Canada. Canadian Immunization Guide: Rotavirus vaccine [Internet]. Ottawa, ON: Public Health Agency of Canada; 2014 Jan [cited 2016 Dec 30]. https://www.canada.ca/en/public-health/services/publications/healthy-living/canadian-immunization-guide-part-4-active-vaccines/page-19-rotavirus-vaccine.html
  25. 25. Canadian Immunization Committee, Public Health Agency of Canada. Recommendations for rotavirus immunization programs. Ottawa, ON: Her Majesty the Queen in Right of Canada, as represented by the Minister of Health, 2014. 2014 Jan [cited 2016 Sep 24]. http://publications.gc.ca/collections/collection_2014/aspc-phac/HP40-95-2014-eng.pdf
  26. 26. Panozzo CA, Becker-Dreps S, Pate V, Jonsson Funk M, Stürmer T, Weber DJ, et al. Patterns of rotavirus vaccine uptake and use in privately-insured US infants, 2006–2010. PLoS One. 2013;8(9):e73825. pmid:24066076
  27. 27. Braeckman T, Theeten H, Lernout T, Hens N, Roelants M, Hoppenbrouwers K, et al. Rotavirus vaccination coverage and adherence to recommended age among infants in Flanders (Belgium) in 2012. Euro Surveill. 2014; 19(20). pii: 20806. http://dx.doi.org/10.2807/1560-7917.ES2014.19.20.20806
  28. 28. Falagas ME, Zarkadoulia E. Factors associated with suboptimal compliance to vaccinations in children in developed countries: a systematic review. Curr Med Res Opin. 2008; 24(6):1719–41. pmid:18474148
  29. 29. Christakis DA, Mell L, Wright JA, Davis R, Connell FA. The association between greater continuity of care and timely measles-mumps-rubella vaccination. Am J Public Health. 2000; 90(6):962–5. pmid:10846516
  30. 30. Toback SL, Rothstein E, Bhatt P, Carr W, Ambrose CS. In-office influenza vaccination by US pediatric providers varies greatly and is higher among smaller offices. Clin Pediatr (Phila). 2012; 51(6):551–9. pmid:22589476
  31. 31. MacDonald NE; SAGE Working Group on Vaccine Hesitancy. Vaccine hesitancy: Definition, scope and determinants. Vaccine. 2015; 33(34):4161–4. pmid:25896383
  32. 32. BC Centre for Disease Control. Immunization uptake in children by the second birthday. Vancouver, BC: Provincial Health Service Authority; [cited 2016 Dec 30]. http://www.bccdc.ca/resource-gallery/Documents/Statistics%20and%20Research/Statistics%20and%20Reports/Immunization/Coverage/2_Year_Old_Coverage_20082012_Birth_Cohorts.pdf
  33. 33. Boulianne N, Audit D, Ouakki M of the Institut nationale de santé publique du Québec. Enquête sur la couverture vaccinale des enfants de 1 an et 2 ans au Québec en 2014. Québec City, QC: Government of Québec; 2015 Feb [cited 2016 Dec 30]. https://www.inspq.qc.ca/pdf/publications/1973_Enquete_Couverture_Vaccinale_Enfants.pdf
  34. 34. Zelman M, Sanford C, Neatby A, Halperin BA, MacDougall D, Rowswell C, et al. Implementation of a universal rotavirus vaccination program: comparison of two delivery systems. BMC Public Health. 2014; 14: 908. pmid:25182067
  35. 35. National Advisory Committee on Immunization. An Advisory Committee Statement (ACS) update, National Advisory Committee on Immunization MMWR Recomm Rep.(NACI), Statement on rotavirus vaccines and intussusception. Ottawa, ON: Her Majesty the Queen in Right of Canada, as represented by the Minister of Health, 2015. 2016 Apr [cited 2016 Dec 30]. http://www.healthycanadians.gc.ca/publications/healthy-living-vie-saine/statement-rotavirus-vaccines-intussusception-2016-declaration-vaccins-antirotavirus-intussusception/alt/Stmt_NACI_Rotavirus%20Vaccines_EN_WebPosting_Apr%202016.pdf
  36. 36. Eisenberg DF, Gu T, Krishnarajah G. Adherence to rotavirus vaccination quality measures in a commercially insured population. Hum Vaccin Immunother. 2013; 9(2):389–97. pmid:23291933
  37. 37. Krishnarajah G, Davis EJ, Fan Y, Standaert BA, Buikema AR. Rotavirus vaccine series completion and adherence to vaccination schedules among infants in managed care in the United States. Vaccine. 2012; 30(24):3717–22. pmid:22214886
  38. 38. Krishnarajah G, Landsman-Blumberg P, Eynullayeva E. Rotavirus vaccination compliance and completion in a Medicaid infant population. Vaccine. 2015; 33(3):479–86. pmid:24962753
  39. 39. Calnan M, Krishnarajah G, Duh MS, Haider BA, Yermakov S, Davis M, et al. Rotavirus vaccination in a Medicaid infant population from four US states: compliance, vaccination completion rate, and predictors of compliance. Hum Vaccin Immunother. 2016;12(5):1235–43. pmid:26900728
  40. 40. Gosselin V, Petit G, Gagneur A, Généreux M. Trends in severe gastroenteritis among young children according to socio-economic characteristics before and after implementation of a rotavirus vaccination program in Quebec. Can J Public Health. 2016; 107(2): e161–167. pmid:27526213
  41. 41. Statistics Canada. 2011 National Household Data Survey: Data tables [Internet]. Ottawa, ON: Statistics Canada [revised 2016 Jan 7; cited 2016 Dec 30]. https://www12.statcan.gc.ca/nhs-enm/2011/dp-pd/dt-td/Rp-eng.cfm?LANG=E&APATH=3&DETAIL=0&DIM=0&FL=A&FREE=0&GC=0&GID=1118302&GK=0&GRP=1&PID=105392&PRID=0&PTYPE=105277&S=0&SHOWALL=0&SUB=0&Temporal=2013&THEME=95&VID=0&VNAMEE=&VNAMEF=
  42. 42. Guttmann A, Manuel D, Stukel TA, Desmeules M, Cernat G, Glazier RH. Immunization coverage among young children of urban immigrant mothers: findings from a universal health care system. Ambul Pediatr. 2008 May-Jun;8(3):205–9. pmid:18501869
  43. 43. Foty RG, Guttmann A, Kwong JC, Maaten S, Manuel D, Stieb DM, et al. Predictors of universal influenza vaccination uptake in grades 1 and 2 Toronto school children: effective vaccination strategies should not end with at risk children. Vaccine. 2010 Sep 7;28(39):6518–22. pmid:20655400
  44. 44. Dennehy PH, Cortese MM, Bégué RE, Jaeger JL, Roberts NE, Zhang R, et al. A case-control study to determine risk factors for hospitalization for rotavirus gastroenteritis in U.S. children. Pediatr Infect Dis J. 2006; 25(12):1123–31. pmid:17133157
  45. 45. Thompson T, Sánchez PJ. Rotavirus vaccination of very low birth weight infants at discharge from the NICU. Pediatrics. 2013; 132(3):e662–5. pmid:23940248
  46. 46. Sahni LC, Tate JE, Payne DC, Parashar UD, Boom JA. Variation in rotavirus vaccine coverage by provider location and subsequent disease burden. Pediatrics. 2015; 135(2):e432–9. pmid:25583918
  47. 47. Public Health Ontario. Immunization coverage report for school pupils: 2012–13 school year. Toronto, ON: Queen’s Printer for Ontario. 2015 Sep [cited 2016 Dec 30]. http://www.publichealthontario.ca/en/eRepository/Immunization_coverage_report_2012-13.pdf.