http://orcid.org/0000-0002-6940-6450
Figures
Abstract
The present study aimed to evaluate the association between influenza vaccination and the secondary prevention of cardiovascular disease (CVD) among elderly persons. This retrospective cohort study used the Geriatric Dataset of Taiwan’s National Health Insurance Research Database (2000–2013). Patients aged ≥ 65 years who had been hospitalized for the first episodes of myocardial infarction were eligible. The vaccinated cohort comprised patients who received one dose of influenza vaccine within 180 days after discharge. The unvaccinated cohort included those who did not receive influenza vaccination and was propensity score–matched (1:1) for known CVD risk factors. All-cause death, acute myocardial infarction or cardiovascular death, and hospitalization for heart failure were assessed 1 year after the 181st day after hospital discharge. Compared with the matched cohort (n = 4,350), the vaccinated cohort (n = 4,350) had significantly lower incidences of all-cause death (hazard ratios [HR] 0.82, 95% CI [confidence interval] 0.73–0.92), myocardial infarction or cardiovascular death (HR 0.84, 95% CI 0.74–0.96), and hospitalization for heart failure (HR 0.83, 95% CI 0.74–0.92). The association between influenza vaccination and reduction of CVDs was similar across different subgroups. Cumulative incidence curves of the CVDs of interest for the two cohorts separated within the initial 3 months of follow-up (P < 0.05). Influenza vaccination was associated with a reduced risk of CVD in the elderly population with previous myocardial infarction.
Citation: Wu H-H, Chang Y-Y, Kuo S-C, Chen Y-T (2019) Influenza vaccination and secondary prevention of cardiovascular disease among Taiwanese elders—A propensity score-matched follow-up study. PLoS ONE 14(7): e0219172. https://doi.org/10.1371/journal.pone.0219172
Editor: Ole Frobert, Örebro University Hospital, SWEDEN
Received: April 10, 2018; Accepted: June 18, 2019; Published: July 1, 2019
Copyright: © 2019 Wu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying this study is from the National Health Insurance Research Database (NHIRD), which has been transferred to the Health and Welfare Data Science Center (HWDC). Taiwan government prohibits release of the NHI dataset to the public domain. All of the analyses should be performed in designated centers and only the results could be obtained by researchers after scrutiny by the committee. Interested researchers can obtain the data through formal application to the HWDC, Department of Statistics, Ministry of Health and Welfare, Taiwan (http://dep.mohw.gov.tw/DOS/np-2497-113.html). Additionally, interested researchers can contact Mr. Lin by telephone 886-2-85906826 or email: st-zylin@mohw.gov.tw for more detailed regulations.
Funding: Funder: National Health Research Institutes. Website: http://english.nhri.org.tw/NHRI_WEB/nhriw001Action.do. Grant Number: IV-106-PP-09. Recipient: SCK. Funder: National Science Council. Website: https://www.preventionweb.net/organizations/6407. Grant number: 105-2628-B-400 -002 -MY2. Recipient: SCK. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Cardiovascular disease (CVD) is the leading cause of mortality worldwide, including in Taiwan, where it accounts for approximately 11% of all deaths [1]. Patients with previous myocardial infarction (MI) are at the greatest risk of recurrent CVD and have six times the annual death rate compared with people without previous MI [2]. Given the high disease burden of CVD, secondary prevention through the identification and mitigation of risk factors is a priority. Several treatment modalities targeting traditional risk factors, including prescription of anti-hypertensive drugs or lipid-lowering medications, and control of blood sugars, have been demonstrated to prevent CVD recurrence [3, 4].
Interest remains in atypical cardiovascular risk factors, especially the potential association between influenza and subsequent CVD [5]. This association may be attributed to altered endothelial function incurred by influenza-related inflammatory and procoagulant stimulus, and vaccination theoretically mitigates the risk [5–8]. Several randomized clinical trials [9–11] and meta-analyses [12, 13] have demonstrated the benefits of influenza vaccination in the secondary prevention of overall mortality, cardiovascular events, cardiovascular death, and hospitalization. Although 60% of recurrent CVD cases are in elderly patients [14], few studies have examined whether influenza vaccination in the elderly population is beneficial with respect to CVD [9–11]. Two randomized clinical trials enrolled patients with a mean age of around 65 years, but these populations were heterogeneous in age [9, 11]. In one study, subgroup analysis showed that patients aged > 65 years benefited from influenza vaccination in terms of the secondary prevention of CVDs, but the number of cases was limited [11]. Results from the general population should not be extrapolated to the elderly population, as the protective effect of influenza vaccination has been shown to decrease with age [15].
Therefore, we performed a population-based, propensity score–matched cohort study to assess the association between influenza vaccination and the secondary prevention of cardiovascular disease (CVD) among elderly persons. Taiwan’s National Health Insurance Research Database (NHIRD, 2000–2013) was used to identify matched vaccinated and unvaccinated cohorts with histories of MI during a 14-year period.
Materials and methods
Data source
Taiwan’s National Health Insurance covers 99.6% of the population because of mandatory universal enrollment. All diagnoses [in accord with the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM)], procedures, and medications for patients enrolled in the insurance system are recorded and stored in the NHIRD, maintained by the National Health Research Institutes. The National Health Insurance Act prohibits the retrieval of data on all patients aged ≥ 65 years. The Geriatric Dataset contains complete data for a random sample of beneficiaries aged ≥ 65 years (sampling ratio 1:3) extracted from the original NHIRD. The study was approved and exempted from the informed consent requirement by the institutional review board of the National Health Research Institute (EC1030804-E) because the data set comprised deidentified secondary data.
Study population and design
Taiwanese patients aged ≥ 65 years who were admitted to hospitals with diagnoses of acute MI (ICD-9-CM 410.X) during 2000–2013 were eligible for enrollment. Data for each eligible individual were further extracted from Geriatric Dataset during 1995 to 1999 to ensure that all individuals were available for a 5-year follow-up before enrollment. Only patients who experienced the first episodes of MI were included. The index date was the 181st day after hospital discharge. The vaccinated cohort comprised patients who received one dose of intramuscular influenza vaccine within the period between the date of discharge and the index date, and the unvaccinated cohort comprised those who did not receive the influenza vaccine during the designated period. To control for potential confounding due to imbalance in clinical characteristics between the vaccinated and unvaccinated cohorts, we used propensity score matching [16] to assemble comparable cohorts. A logistic regression model including age, sex, socioeconomic status, pre-existing comorbidities, and concomitant medications as covariates was used to predict propensity scores. A propensity score [16, 17] was then used to identify a unique matched counterpart from the original unvaccinated cohort for each vaccinated patient (1:1 matching). Both cohorts were followed for 12 months after the index date or until loss to follow-up. The endpoints were all-cause death, hospitalization for cardiac failure (ICD-9-CM 428.XX), and a composite outcome consisting of MI (ICD-9-CM 410.XX) and cardiovascular death. To further evaluate the temporal relationship between influenza vaccination and outcome events, we performed sensitivity analyses for two timeframes: 12 months after vaccination and within the same influenza seasons. Hospitalization for upper gastrointestinal bleeding was used as a negative control event [18].
Definition of covariates
Pre-existing comorbidities associated with CVD or the prognoses of patients with CVD [4, 19–22] were defined according to the ICD-9-CM, and included hypertension, heart failure, diabetes, peptic ulcer disease, liver disease, chronic kidney disease, atrial fibrillation, cerebrovascular disease, dyslipidemia, valvular heart disease, cancer, autoimmune disease, and substance abuse. We also collected information on concomitant use of medications associated with CVD or the above-mentioned comorbidities, including antiplatelet agents (including aspirin, clopidogrel, and ticlopidine), angiotensin-converting enzyme inhibitors/angiotensin II receptor blockers, β blockers, calcium channel blockers, diuretics, insulin, oral anti-hyperglycemic agents, statins, and steroids [4, 22]. Previous studies have suggested that the prognosis of CVD is affected by the Charlson comorbidity score [21, 23] and socioeconomic status [24], and that the frequency of outpatient department use is associated with receipt of the influenza vaccination [25]. Therefore, these factors were also included in the logistic regression model for propensity score prediction.
Statistical analysis
We used the standardized difference (StD) to compare the means of continuous and binary variables between the vaccinated and unvaccinated cohorts [17]. Imbalance in the characteristics of the two cohorts was defined as an absolute StD > 0.04. The incidence rates of outcome events were calculated using Poisson distribution. Cumulative incidence curves were assessed using the Kaplan–Meier method and compared using the log-rank test. A Cox proportional hazards model was used to calculate hazard ratios (HRs) and 95% confidence intervals (CIs) to evaluate associations between outcomes and vaccination. Competing-risks regression using Fine and Gray’s model was also performed [26]. We assessed the terms of interaction between influenza vaccination and the variables to determine whether the effect of vaccination differed between groups. Two-sided tests were used to explore statistical significance, at the level of P < 0.05. For interaction terms, Bonferroni-corrected P values < 0.005 (0.05/10) were considered to be significant. The Microsoft SQL Server 2008 R2 (Microsoft) was used for data linkage, processing, and sampling. All analyses were performed using SAS software version 9.2 (SAS Institute, North Carolina, USA).
Results
During the study period, a total of 29,066 patients aged ≥ 65 years with first episodes of acute MI was eligible for inclusion. Among the 4,554 vaccinated patients, 204 patients could not be well matched according to propensity scores. Therefore, we enrolled 4,350 vaccinated patients and 4,350 unvaccinated patients. The mean age of the vaccinated cohort was 76.3 (standard deviation 6.5) years. The majority of these patients was male (64.9%) and had high Charlson Comorbidity Index scores. The characteristics of both cohorts are detailed in Table 1. The matched cohorts were well balanced in terms of all observed covariates.
The numbers and incidence rates of outcome events for the two propensity score–matched cohorts are presented in Table 2. About 11.6% of the vaccinated cohort and 13.9% of unvaccinated cohort died during the 1-year follow-up period. Compared with the unvaccinated cohort, the vaccinated cohort had significantly lower rates of all-cause mortality (HR 0.82, 95% CI 0.73–0.92), MI or cardiovascular death (HR 0.84, 95% CI 0.74–0.96), and hospitalization for cardiac failure (HR 0.83, 95% CI 0.74–0.92). In competing-risk survival analysis, the incidence rates of MI or cardiovascular death (HR 0.85, 95% CI 0.75–0.97) and hospitalization for cardiac failure (HR 0.84, 95% CI 0.75–0.94) were also significantly lower in the vaccinated cohort. The incidence rate of hospitalization for upper gastrointestinal bleeding did not differ significantly between groups in either model. Kaplan–Meier curves of cumulative incidence are shown in Fig 1. For all three endpoints, the curves of the two groups separated gradually during the first 3 months of the follow-up period and differed significantly at the end of follow-up. The effects of vaccination on all outcome events in patient subgroups are shown in Tables 3–5. The benefit of influenza vaccination in terms of all-cause death, recurrent MI or cardiovascular death, and hospitalization due to heart failure were consistent across different subgroups. The incidences of relevant cardiovascular events remained lower in the vaccinated cohort in both sensitivity analyses (S1 and S2 Tables).
(a) All-cause death. (b) Recurrent myocardial infarction or cardiovascular death. (c) Hospitalization due to heart failure.
Discussion
This population-based, retrospective study demonstrated significant reductions in all-cause mortality, recurrent MI or cardiovascular death, and hospitalization for heart failure among elderly patients with previous MI who received the influenza vaccine compared with their unvaccinated counterparts. On the contrary, the influenza vaccination was not associated with hospitalization for upper gastrointestinal bleeding.
Many authors have suggested that influenza infection plays a role in precipitating CVD [5–7, 12, 27]. The incidences of influenza and CVD peak in winter [5, 27]. A large self-controlled case-series study of more than 20,000 patients in the UK showed that the incidence ratio of MI was highest during the first 3 days after acute respiratory infection, with the risk declining gradually during subsequent weeks [7]. Influenza might act as an acute inflammatory and procoagulant stimulus, transiently altering endothelial function, which might lead to destabilization of vulnerable atherosclerotic plaques and, thus, coronary artery occlusion [6, 8]. A growing body of evidence also associates influenza vaccination with a reduction in the risk of CVD among patients with previous CVD [9–13]. The association between influenza vaccination and reduced CVD is probably related to the prevention of influenza infection and consequent triggering of CVD by the mechanism mentioned above. An additional postulated mechanism is that vaccine-induced antibodies cross-react with the human bradykinin receptor, leading to increased levels of nitric oxide, which subsequently increase blood flow, vasodilation, and possibly angiogenesis [28].
Patients with CVD often suffer from recurrent episodes and have higher mortality rates [2, 3]. The association between influenza and CVD is also strongest in elderly persons [27], and the correlation coefficients increase with age [5]. Therefore, elderly people with previous CVD are at greater risk of recurrent CVD related to influenza infection and may benefit more from vaccination. In terms of primary prevention of CVD, influenza vaccination of elderly persons has been shown to be associated with substantial reductions in the risk of hospitalization for ischemic heart disease and congestive heart failure in previous studies [29, 30]. Coincident with previous findings [9, 11], our results further support the beneficial role of influenza vaccination in the secondary prevention of CVD and reduction of all-cause death in the elderly population.
Although propensity score matching may reduce healthy user bias by balancing numerous crucial individual characteristics extracted from the NHIRD, we could not control for unobserved confounders, such as health behaviors (e.g., smoking and obesity) and beliefs about and attitudes toward vaccination. The healthy vaccine effect could be mitigated only by a randomized design. Currently, two clinical trials are ongoing to determine the protective effects of influenza vaccination in patients with CVD [31, 32]. The Influenza vaccination After Myocardial Infarction (IAMI) trial [31] is a double-blind, prospective, randomized clinical trial examining whether in-hospital influenza vaccination after acute coronary syndrome protects against future CVD. By only enrolling patients not intending to be vaccinated in the current influenza season, the IAMI trial increases vaccination coverage in the target population. The randomized, double-blind, clinical Influenza Vaccine to Effectively Stop Cardio Thoracic Events and Decompensated heart failure (INVESTED) trial [32] is being conducted to compare the cardioprotective effectiveness of a high-dose trivalent influenza vaccine with that of standard-dose quadrivalent influenza vaccine in patients with high cardiovascular risk. The INVESTED trial is employing an active control, rather than placebo, and leaves no participant unvaccinated. The results of both trials, which are avoiding the potential ethical dilemma associated with vaccination research using different strategies, will be of great interest.
This study has several limitations. First, some may argue that misclassification of vaccination was possible, e.g., that some patients received influenza vaccination at their own expense, which would not be recorded in the claims data. However, we believe that this number of patients would be small because government-funded influenza vaccination has been provided to patients aged ≥ 65 years with CVD since 1998, and the out-of-pocket expenditure has been considered to be a barrier to influenza vaccination [33]. Second, the accuracy of diagnoses in the Geriatric Dataset may be of concern. However, several studies have validated the accuracy of diagnoses of diabetes [34], cerebrovascular disease [35], and acute MI [36] in the NHIRD, with positive predictive values of about 75%–90%. As the Geriatric Dataset is derived from the original NHIRD, we believe that the quality of its data is equal to that of the original NHIRD.
Conclusion
Our study demonstrated that influenza vaccination was associated with reduced rates of secondary cardiovascular events, including all-cause mortality, recurrent MI or cardiovascular death, and hospitalization due to heart failure, in a population aged ≥ 65 years with MI.
Supporting information
S1 Table. Incidence and risk of outcomes among elderly participants with histories of myocardial infarction during the influenza season.
https://doi.org/10.1371/journal.pone.0219172.s001
(DOC)
S2 Table. Incidence and risk of outcomes among elderly participants with histories of myocardial infarction during the year after vaccination.
https://doi.org/10.1371/journal.pone.0219172.s002
(DOC)
Acknowledgments
The authors would like to thank the National Health Research Institutes for making their database available.
References
- 1. Hsiao AJ, Chen LH, Lu TH. Ten leading causes of death in Taiwan: A comparison of two grouping lists. J Formos Med Assoc. 2015;114(8):679–80. pmid:24457066
- 2. Law MR, Watt HC, Wald NJ. The underlying risk of death after myocardial infarction in the absence of treatment. Arch Intern Med. 2002;162(21):2405–10. pmid:12437397
- 3. Smith SC Jr., Benjamin EJ, Bonow RO, Braun LT, Creager MA, Franklin BA, et al. AHA/ACCF Secondary Prevention and Risk Reduction Therapy for Patients with Coronary and other Atherosclerotic Vascular Disease: 2011 update: a guideline from the American Heart Association and American College of Cardiology Foundation. Circulation. 2011;124(22):2458–73. pmid:22052934
- 4. Piepoli MF, Hoes AW, Agewall S, Albus C, Brotons C, Catapano AL, et al. 2016 European Guidelines on cardiovascular disease prevention in clinical practice: The Sixth Joint Task Force of the European Society of Cardiology and Other Societies on Cardiovascular Disease Prevention in Clinical Practice (constituted by representatives of 10 societies and by invited experts) Developed with the special contribution of the European Association for Cardiovascular Prevention & Rehabilitation (EACPR). Eur Heart J. 2016;37(29):2315–81. pmid:27222591
- 5. Warren-Gash C, Smeeth L, Hayward AC. Influenza as a trigger for acute myocardial infarction or death from cardiovascular disease: a systematic review. Lancet Infect Dis. 2009;9(10):601–10. pmid:19778762
- 6. Naghavi M, Wyde P, Litovsky S, Madjid M, Akhtar A, Naguib S, et al. Influenza infection exerts prominent inflammatory and thrombotic effects on the atherosclerotic plaques of apolipoprotein E-deficient mice. Circulation. 2003;107(5):762–8. pmid:12578882
- 7. Smeeth L, Thomas SL, Hall AJ, Hubbard R, Farrington P, Vallance P. Risk of myocardial infarction and stroke after acute infection or vaccination. N Engl J Med. 2004;351(25):2611–8. pmid:15602021
- 8. Madjid M, Awan I, Ali M, Frazier L, Casscells W. Influenza and atherosclerosis: vaccination for cardiovascular disease prevention. Expert Opin Biol Ther. 2005;5(1):91–6. pmid:15709912
- 9. Gurfinkel EP, Leon de la Fuente R, Mendiz O, Mautner B. Flu vaccination in acute coronary syndromes and planned percutaneous coronary interventions (FLUVACS) Study. Eur Heart J. 2004;25(1):25–31. pmid:14683739
- 10. Ciszewski A, Bilinska ZT, Brydak LB, Kepka C, Kruk M, Romanowska M, et al. Influenza vaccination in secondary prevention from coronary ischaemic events in coronary artery disease: FLUCAD study. Eur Heart J. 2008;29(11):1350–8. pmid:18187561
- 11. Phrommintikul A, Kuanprasert S, Wongcharoen W, Kanjanavanit R, Chaiwarith R, Sukonthasarn A. Influenza vaccination reduces cardiovascular events in patients with acute coronary syndrome. Eur Heart J. 2011;32(14):1730–5. pmid:21289042
- 12. Udell JA, Zawi R, Bhatt DL, Keshtkar-Jahromi M, Gaughran F, Phrommintikul A, et al. Association between influenza vaccination and cardiovascular outcomes in high-risk patients: a meta-analysis. JAMA. 2013;310(16):1711–20. pmid:24150467
- 13. Clar C, Oseni Z, Flowers N, Keshtkar-Jahromi M, Rees K. Influenza vaccines for preventing cardiovascular disease. Cochrane Database Syst Rev. 2015(5):CD005050. pmid:25940444
- 14. Dai X, Busby-Whitehead J, Alexander KP. Acute coronary syndrome in the older adults. J Geriatr Cardiol. 2016;13(2):101–8. pmid:27168733
- 15. Jackson LA, Yu O, Heckbert SR, Psaty BM, Malais D, Barlow WE, et al. Influenza vaccination is not associated with a reduction in the risk of recurrent coronary events. Am J Epidemiol. 2002;156(7):634–40. pmid:12244032
- 16. Shih CJ, Chu H, Chao PW, Lee YJ, Kuo SC, Li SY, et al. Long-term clinical outcome of major adverse cardiac events in survivors of infective endocarditis: a nationwide population-based study. Circulation. 2014;130(19):1684–91. pmid:25223982
- 17. Burden A, Roche N, Miglio C, Hillyer EV, Postma DS, Herings RM, et al. An evaluation of exact matching and propensity score methods as applied in a comparative effectiveness study of inhaled corticosteroids in asthma. Pragmat Obs Res. 2017;8:15–30. pmid:28356782
- 18. Wang YP, Chen YT, Tsai CF, Li SY, Luo JC, Wang SJ, et al. Short-term use of serotonin reuptake inhibitors and risk of upper gastrointestinal bleeding. Am J Psychiat. 2014;171(1):54–61. pmid:24030313
- 19. Agac MT, Korkmaz L, Cavusoglu G, Karadeniz AG, Agac S, Bektas H, et al. Association between nonalcoholic fatty liver disease and coronary artery disease complexity in patients with acute coronary syndrome: a pilot study. Angiology. 2013;64(8):604–8. pmid:23439214
- 20. O'Connor AD, Rusyniak DE, Bruno A. Cerebrovascular and cardiovascular complications of alcohol and sympathomimetic drug abuse. Med Clin North Am. 2005;89(6):1343–58. pmid:16227066
- 21. Sachdev M, Sun JL, Tsiatis AA, Nelson CL, Mark DB, Jollis JG. The prognostic importance of comorbidity for mortality in patients with stable coronary artery disease. J Am Coll Cardiol. 2004;43(4):576–82. pmid:14975466
- 22. Hasdai D, Lev EI, Behar S, Boyko V, Danchin N, Vahanian A, et al. Acute coronary syndromes in patients with pre-existing moderate to severe valvular disease of the heart: lessons from the Euro-Heart Survey of acute coronary syndromes. Eur Heart J. 2003;24(7):623–9. pmid:12657220
- 23. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83. pmid:3558716
- 24. Woodward M, Peters SA, Batty GD, Ueshima H, Woo J, Giles GG, et al. Socioeconomic status in relation to cardiovascular disease and cause-specific mortality: a comparison of Asian and Australasian populations in a pooled analysis. BMJ Open. 2015;5(3):e006408. pmid:25783421
- 25. Chang YC, Tung HJ, Hsu SW, Chen LS, Kung PT, Huang KH, et al. Use of Seasonal Influenza Vaccination and Its Associated Factors among Elderly People with Disabilities in Taiwan: A Population-Based Study. PLoS One. 2016;11(6):e0158075. pmid:27336627
- 26. Fine JP, Gray RJ. A proportional hazards model for the subdistribution of a competing risk. J Am Stat Assoc. 1999;94(446):496–509.
- 27. Warren-Gash C, Bhaskaran K, Hayward A, Leung GM, Lo SV, Wong CM, et al. Circulating influenza virus, climatic factors, and acute myocardial infarction: a time series study in England and Wales and Hong Kong. J Infect Dis. 2011;203(12):1710–8. pmid:21606529
- 28. Veljkovic V, Glisic S, Veljkovic N, Bojic T, Dietrich U, Perovic VR, et al. Influenza vaccine as prevention for cardiovascular diseases: possible molecular mechanism. Vaccine. 2014;32(48):6569–75. pmid:25045818
- 29. Nichol KL, Nordin J, Mullooly J, Lask R, Fillbrandt K, Iwane M. Influenza vaccination and reduction in hospitalizations for cardiac disease and stroke among the elderly. N Engl J Med. 2003;348(14):1322–32. pmid:12672859
- 30. Siriwardena AN, Gwini SM, Coupland CA. Influenza vaccination, pneumococcal vaccination and risk of acute myocardial infarction: matched case-control study. CMAJ. 2010;182(15):1617–23. pmid:20855479
- 31. Frobert O, Gotberg M, Angeras O, Jonasson L, Erlinge D, Engstrom T, et al. Design and rationale for the Influenza vaccination After Myocardial Infarction (IAMI) trial. A registry-based randomized clinical trial. Am Heart J. 2017;189:94–102. pmid:28625387
- 32. Vardeny O, Udell JA, Joseph J, Farkouh ME, Hernandez AF, McGeer AJ, et al. High-dose influenza vaccine to reduce clinical outcomes in high-risk cardiovascular patients: Rationale and design of the INVESTED trial. Am Heart J. 2018;202:97–103. pmid:29909156
- 33. Sato AP, Antunes JL, Moura RF, de Andrade FB, Duarte YA, Lebrao ML. Factors associated to vaccination against influenza among elderly in a large Brazilian metropolis. PLoS One. 2015;10(4):e0123840. pmid:25874953
- 34. Lin CC, Lai MS, Syu CY, Chang SC, Tseng FY. Accuracy of diabetes diagnosis in health insurance claims data in Taiwan. J Formos Med Assoc. 2005;104(3):157–63. pmid:15818428
- 35. Cheng CL, Kao YH, Lin SJ, Lee CH, Lai ML. Validation of the National Health Insurance Research Database with ischemic stroke cases in Taiwan. Pharmacoepidemiol Drug Saf. 2011;20(3):236–42. pmid:21351304
- 36. Cheng CL, Lee CH, Chen PS, Li YH, Lin SJ, Yang YH. Validation of acute myocardial infarction cases in the national health insurance research database in Taiwan. J Epidemiol. 2014;24(6):500–7. pmid:25174915