http://orcid.org/0000-0001-8219-9196
Figures
Abstract
Background
Clinical quality registries (CQRs) are playing an increasingly important role in improving health outcomes and reducing health care costs. CQRs are established with the purpose of monitoring quality of care, providing feedback, benchmarking performance, describing pattern of treatment, reducing variation and as a tool for conducting research.
Objectives
To synthesise the impact of clinical quality registries (CQRs) as an ‘intervention’ on (I) mortality/survival; (II) measures of outcome that reflect a process or outcome of health care; (III) health care utilisation; and (IV) healthcare-related costs.
Methods
The following electronic databases were searched: MEDLINE, EMBASE, CENTRAL, CINAHL and Google Scholar. In addition, a review of the grey literature and a reference check of citations and reference lists within articles was undertaken to identify relevant studies in English covering the period January 1980 to December 2016. The PRISMA-P methodology, checklist and standard search strategy using pre-defined inclusion and exclusion criteria and structured data extraction tools were used. Data on study design and methods, participant characteristics attributes of included registries and impact of the registry on outcome measures and/or processes of care were extracted.
Results
We identified 30102 abstracts from which 75 full text articles were assessed and finally 17 articles were selected for synthesis. Out of 17 studies, six focused on diabetes care, two on cardiac diseases, two on lung diseases and others on organ transplantations, rheumatoid arthritis, ulcer healing, surgical complications and kidney disease. The majority of studies were “before after” design (#11) followed by cohort design (#2), randomised controlled trial (#2), experimental non randomised study and one cross sectional comparison. The measures of impact of registries were multifarious and included change in processes of care, quality of care, treatment outcomes, adherence to guidelines and survival. Sixteen of 17 studies demonstrated positive findings in their outcomes after implementation of the registry.
Conclusions
Despite the large number of published articles using data derived from CQRs, few have rigorously evaluated the impact of the registry as an intervention on improving health outcomes. Those that have evaluated this impact have mostly found a positive impact on healthcare processes and outcomes.
Citation: Hoque DME, Kumari V, Hoque M, Ruseckaite R, Romero L, Evans SM (2017) Impact of clinical registries on quality of patient care and clinical outcomes: A systematic review. PLoS ONE 12(9): e0183667. https://doi.org/10.1371/journal.pone.0183667
Editor: Saravana Kumar, University of South Australia, AUSTRALIA
Received: February 15, 2017; Accepted: August 8, 2017; Published: September 8, 2017
Copyright: © 2017 Hoque et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: DEH has received MIPRS for tuition fees and MGS scholarship for living costs and Monash ID: 25762931 for PhD Programme. SE has received funding support from Monash Partners Academic Health Science Centre. No funding bodies had any role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Clinical registries play an important role in monitoring disease and healthcare delivery patterns and generating real world evidence of the impact of treatment and service delivery models on health outcomes [1–3]. Increasingly, clinical registries are being used in quality improvement projects to improve healthcare processes [4–11], adherence to clinical practice guidelines [9, 12–15] and standards [16–18]; and reduce the cost of delivering care [19–21]. Registries generally operate by providing details of clinical care, compliance with the evidence based guidelines and patient reported outcomes to participating hospitals [22–24] and to clinicians [1, 3, 25, 26].
Registries play an important role in medical research. Data within registries provide an ideal platform for randomized clinical trials, reducing both time and cost of prospective data collection [27]. The collection of real world data within registries supports research by generating research hypotheses [28–31], facilitating descriptive studies and health service research [29]. Research opportunities are enhanced when data from clinical registries are complemented with genomic, biomarker and imaging information [29, 32–35]. Registry data can be used to assist in answering research questions which are not practical or ethical to address by randomised controlled trials [36].
Gitt et al. [30] identified the following characteristics to be present in sophisticated clinical registries: standardized data collection methods and data definitions; integrated tools for rapid feedback to participating institutions/regulatory bodies; proper ethical review processes; electronic data capture; representativeness of the patient population under investigation; an audit process which assesses data accuracy; centralized data compilation and statistical analysis performed by professional statisticians; and appropriate and transparent reporting.
Health care systems costs in developed countries are rising, in part due to the introduction of advanced medical technology, pharmaceutical expenditure, hospital care and services as well as the high prevalence of chronic diseases and their financial consequence [37, 38]. One approach to address these challenges has been to invest in clinical quality registries (CQR). Sweden has established more than 100 national quality registries in the past decade [39]. A recent survey conducted by Lyu H et al [40] identified 153 national clinical registries in United States (US) of which 73 were health service registries, 66 were disease registries and 14 were combination of both health service and disease registries.
Examples of clinical quality registries can be found across most clinical specialities, monitoring both chronic and acute stages of illness. Acute stroke registries have been established in Sweden, Germany, Canada, Australia, the US, Argentina and many other countries [41–46]. The Cystic Fibrosis Foundation Patient registry has evolved from one built on an epidemiological and clinical research model to one which focuses also on fostering quality improvement processes [6]. The American Heart Association has a prolonged history of well-designed and successful implementation of different clinical registries and in their policy statement they highlight the importance expanding existing as well as developing new clinical registries [32].
Emilsson et al [39] recently reviewed 103 CQRs and concluded that Swedish quality registries contain comprehensive clinical data which complement information from government-administered registries and provide an important source for assessment and development of quality of care and research. CQRs help to identify variation in best practice treatments and in outcomes across treatment centres [47]. They provide feedback on performance, thereby encouraging quality improvement processes [48] and have been shown to identify factors that can impact survival across the countries [49, 50].
It is evident that the clinical registries, including CQRs, are being established as a tool to monitor and improve quality of care and as a platform for epidemiological research [51]. Yet, despite this, no systematic reviews have been undertaken to date to examine the impact of clinical registries as interventions on survival/mortality and on improving health outcomes. The objectives of this systematic review were therefore to understand the impact of CQRs on (I) mortality/ survival; (II) measures that reflects a process or outcome of health care; (III) healthcare utilisation; and (IV) healthcare-related costs.
Methods
Definition
A clinical registry is described as a system which collects a defined minimum data set from patients undergoing a particular procedure or therapy, diagnosed with a disease or using a health care resource [51].
In this systematic review we define CQR as a sub-group of clinical registries which systematically collect health-related information on the quality, safety and outcomes of care provided to individuals who are treated with a particular surgical procedure, device or drug; diagnosed with a particular illness; or managed via a specific healthcare resource [52]. CQRs are established primarily as tools for quality improvements and must provide feedback of data in reports to registry participants [51].
Study design
Based on a pilot search it was evident that there were likely to be insufficient randomised controlled trial (RCT) studies assessing registries as an intervention to enable a meta-analysis to be undertaken. Therefore, a decision was made to include before-after, case control, cohort and controlled clinical trial study designs in addition to RCT studies.
A description of the population, intervention, comparison and outcome (PICO) [53] of the systematic review and a summary of the inclusion and exclusion criteria are described in “Table 1”.
Comparator(s)/Control
Studies with and without comparators were eligible for inclusion. Comparators were considered contemporaneous data sources such as hospital administrative databases, insurance databases and clinical information systems measuring mortality/survival; processes of care; outcomes other than mortality/survival; healthcare utilisation and costs.
Context
Studies conducted in clinical environments which were considered acute care (inpatient and outpatient), sub-acute care (rehabilitation centre) and community (general practice and aged care) were included.
Outcome measures/Outcome of interest
The primary outcome measure was impact of clinical registries, including CQRs, on survival or mortality. Secondary outcome measures were those reflecting a process or outcome of health care (quality of care), health care utilization and costs. Quality of care measures included those assessing impact of the registry on patient safety (complications), timeliness (reduce waits and harmful delays), effectiveness (adherence to clinical guidelines-provide services based on scientific knowledge), efficiency (avoid waste), equitable access to the services (provide services that does not vary in quality), and patient centeredness (provide care that is respectful of and responsive to individual patient preference, needs and values) [2].
Search strategy
Before finalizing the search strategy, a pilot search strategy was developed, tested and amended as necessary across the different databases. Once the search strategy was finalized and agreed upon among the team, it was then refined by a senior medical librarian (LR). A database record was maintained at each stage of the review process including the detailing of how the search was undertaken and results of the search strategy.
The following electronic databases were searched: MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials (CENTRAL), CINAHL and Google Scholar to identify studies in English covering the period January 1980 to December 2016. The search strategy included keywords describing studies involving established registries as the intervention. The MeSH terms relating to registry or registries combined with the MeSH terms referring to mortality, morbidity, patient reported outcome, health care utilization, cost/economic evaluation and clinical competence were included in the search.
Additional searches were conducted of grey literature resources such as conference websites and government websites, searching without limiting by outcome, searching informal sources such as conference abstracts and PhD theses. Hand-searching and reference checking of citations and reference lists were also undertaken.
Study screening and selection
Titles and/or abstracts of studies identified using the search strategy and those from additional sources were distributed among four review authors. Two review team members independently retrieved and assessed the eligibility of the full text articles of potentially suitable studies. Any disagreement between the two reviewers was resolved through discussion with the third review author of the study team.
Data extraction and assessment of quality of the study
A standardised data extraction form was developed and piloted, based on the template of the Cochrane data abstraction form [54]. Data extraction forms were used to extract data on study design and methods; country setting; participant characteristics; intervention characteristics including the feedback provided; study outcomes; discussion points; limitations; recommendations and study funding sources. Attributes of included registries were recorded using the criteria described by Black et al [55], and the adapted Scottish Intercollegiate Guidelines Network (SIGN) check list [53] was used to evaluate the methodology of included studies.
The first author (DEH) extracted the data; and inconsistencies were discussed with the second review author (VK) and if necessary with the third author (SE).
Our study protocol has been registered on PROSPERO: the international prospective register of systematic reviews (ID: CRD42015017319) and the study protocol has been described elsewhere [56].
Data synthesis and analysis
Narrative synthesis.
We followed the guideline for narrative synthesis for systematic reviews proposed by Popay J et al [57] as appropriate and developed a conceptual framework for analysis of registry outcome measures [56]. We conducted narrative synthesis of the findings from the included studies with special focus on the attributes of registries described as the intervention. Attributes included the host organization operating the registry; the reference population; coverage (extent to which the eligible population was representative of the country); personnel involved in the management of register; how data were being collected (paper based or electronic); the source of data and linkage with other database; availability of a data dictionary; the quality assurance procedure; and involvement of professional organizations and industry. We also conducted synthesis of the findings based on study design and impact of the registry on mortality/survival, process, utilization and clinical outcome measures.
Statistical analysis.
Narrative synthesis of the selected articles was undertaken. It was not possible to conduct a meta-analysis because of heterogeneity among the study populations; coverage, duration and outcomes of interest, made it not possible to pool results. There was also variation among registries in follow-up, reporting mechanism, data management, quality assurance, audit mechanisms and processes; and feedback to stakeholders. Moreover, only two studies were RCT.
Results
The results of our search strategy and selection process are presented in “Fig 1”, following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram [58].
Through primary database screening, we identified 30102 articles. In addition, through hand searching, and reference searching of citations we identified an additional eight documents. After removal of duplications the numbers of abstracts reduced to 27856. Initially, 393 articles were screened after reviewing titles and abstracts. After reviewing 75 full text articles, a total of 17 articles were selected for final synthesis. All the selected journals were published between 2003 and 2015.
Details of the included studies and their Key characteristics are described in Table 2. Studies describe registries which were established in the US (n = 6), Australia (n = 2), the United Kingdom (n = 3), Denmark (n = 2), Sweden (n = 1), Germany (n = 1) and Israel (n = 1). Six studies described registries monitoring diabetes, two assessed stroke care, one each described care of patients with Chronic Obstructive Pulmonary Disease, lung cancer, colon cancer, rheumatoid arthritis, hard-to-heal ulcers, surgical complications, organ transplantation, Chronic Kidney Diseases; and one registry monitored patients undergoing smoking cessation therapy.
Table 3 describes the study design and impact of the registry on the primary and secondary outcomes and supplementary S1 Table summarises the limitations and conclusions/recommendations of the selected studies. Most used a “before-after” study design (n = 11, 65%) followed by RCT (n = 2, 12%) prospective cohort (n = 2, 12%), experimental non-randomised (n = 1, 6%) and cross sectional survey (n = 1, 6%). Each study except one study [61] assessing registries as interventions recorded some positive findings; however not all indicators of quality of care collected by the registry were positive.
Impact of the registry on mortality/survival
Four studies measured the registries association with either mortality or survival as the primary outcome [41, 69, 71, 72]; The registries established for lung cancer and colon cancer both demonstrated an association with improved survival after their development [71, 72]. Contrary to these findings, the registry established to monitor acute stroke care in Germany did not demonstrate any temporal trend on mortality [41]. Another study evaluated temporal trends in survival in patients diagnosed with rheumatoid arthritis (RA) [69]. The authors found that survival was significantly lower in the first seven years of RA than that was expected. The authors also found in the same population an excess mortality from cardiovascular diseases (31%) [75] and median survival time from RA-ILD was three years, with a five-year Kaplan-Meier survival function following diagnosis [76].
Impact of the registry on secondary outcomes
(I) Impact on processes of care.
With regard to the impact of the registry on process of care measures such as compliance with evidence-based guidelines, the findings were principally positive. The RCT by Thomas et al [59] assessing compliance with diabetes care using a registry versus normal care in internal medicine resident community clinics found that patients in the intervention arm were more likely to have HbA1c and LDL measured within the recommended time frame compared with those in the control arm (p<0.05). This did not, however, have a significant impact on overall control of HbA1c, LDL and blood pressure. The other RCT by Roski et al [60] investigating smoking cessation had three study arms; one provided financial incentives for reaching pre-set clinical performance targets (“incentive arm”); another provided financial incentives combined with access to a centralized smoker registry for reaching pre-set clinical performance targets (“registry arm”) while the third arm involved distribution of printed versions of the smoking cessation guidelines (“control arm”). The study demonstrated that the registry arm and the incentive arm were associated with greater documentation of tobacco use status (P < 0.01) than the control arm. Those patients visiting registry clinics reported accessing counselling programs significantly more often (P < 0.001) than patients receiving care in the control condition [60]. Jakobsen et al [71] demonstrated improvement in lung cancer survival rates, possibly due to improvement in the quality of care after introducing the registry.
Of six registries monitoring diabetes care assessed by HbA1c and lipid test results showed a positive benefit [59, 64–66, 74] of which two registries demonstrated positive impact on measurement of microalbuminuria [66, 74]. One registry monitoring diabetic care assessed by HbA1c did not find significant effects in lowering HbA1c values [61] and the study by Harris et al [64] did not show any significant change in processes of care for High- Density Lipoprotein (HDL), Body Mass Index (BMI), or frequency of renal and eye complications with registry use. A study by Pollard et al [65] reported significant improvements from baseline on 12 of 13 care processes indicators including foot, eye and dental examinations, and screening for depression, smoking, and substance abuse when a registry was used at a moderate level or higher. Diabetic registries including two in Australia and one in US [64, 65, 74], have clearly demonstrated a positive impact on patients enrolled in a registry compared to those who are not. This is thought to be due to the capacity of a registry to generate progress notes and summary reports to track patients’ care and monitor compliance with guidelines [65].
(II) Impact of healthcare utilization.
One study reported that use of a diabetic registry was associated with a higher average number of patients and attendances by patients with diabetes per GP compared to those not using a registry [74]. Öien et al [67] demonstrated that following the introduction of a registry for ulcer treatment, treatment with antibiotics reduced significantly from 76% in 2009 to 24% in 2012 (p = 0.001). Other studies have shown an association between registry use and higher rates of uptake of evidence based practice, [41] and that impact on practice improves over time [68].
(III) Impact on clinical outcome.
Öien et al found that there was a significant reduction of healing time for hard-to-heal ulcers when the registry was used 21 weeks in 2009 to 9 weeks in 2012. Geubbels et al [62], reported that surgical site infection was stable at 4.3% in initial 3 years then reduced to 3.3% in year 4 and to 1.8% in year 5. Good control of LDL<100mg dl increased from 26% to 59% has been reported by one registry [66].
(IV) Impact on healthcare costs.
None of the 17 studies included in this review rigorously evaluated the cost effectiveness of the clinical registry.
One registry has demonstrated significantly reduced regional difference of improving clinical practice and core results [71].
Discussion
In this review our primary objective was to establish the impact of registries, including CQRs, on mortality or survival. We identified four articles which reported on survival, of which two demonstrated a positive impact. Our secondary objectives were to assess impact on processes or outcome of health care other than survival or mortality, health care utilization, clinical outcome and cost. We identified 17 articles which assessed the impact of clinical registries on secondary outcomes of which all articles reported a positive impact except one [61] and few process indicators of two articles [59, 64]. Five out of six registries assessing diabetic care demonstrated at least one improvement in processes of care [59, 64–66, 74]. Most studies (n = 11) used a before-after study design [41, 64–73]; only two studies were experimental in design with one assessing the impact of a registry on diabetes management and the other on tobacco smoking. Both showed significant improvement in health outcomes after implementation of the registry [59, 60].
Our finding that few studies have rigorously evaluated the impact of clinical registries as interventions on improved health outcomes may be explained by a number of factors. Firstly, we found it difficult to disentangle registries as interventions from larger quality improvement projects which use registries to store data. For example, the Get with the Guidelines (GWTG) Stroke, Coronary Artery disease and Heart failure programs collect data on patients with these diseases and report performance measures back to hospitals as part of a quality improvement cycle [77, 78]. The Patient Management Tool (PMT) used in the GWTG program to collect data and provide decision support and reports back to hospitals might be considered a registry. However, it was only one element of the program, which also included organizational stakeholder and opinion leader meetings, hospital recruitment, collaborative learning sessions, hospital tool kits, local clinical champions, multidisciplinary teams, and hospital recognition. The program cannot disengage the effect of the PMT from other activities and, for this reason was not included in this review.
Another reason for the limited number of studies evaluating registries as interventions may be that researchers have not established them with quality improvement as an outcome in mind. Registries are often established to describe patterns of care, to understand variation in treatment and outcomes and predictors of prognosis and quality of life. Yet, many have not been set up to report quality of care data back to health services. Often population-based registries store data for reporting to government and for research purposes but fail to collect data which is meaningful to health services to assess their performance or, if they, do not make it available to the health services, so that they can see how they compare with others and with themselves over time.
Finally, it may be that there were few studies evaluating the impact of registries because researchers and sites investing heavily in the development of registries have been reluctant to formally assess their impact through rigorous trial design. Establishing a registry requires substantial resources, infrastructure and sustained funding [29].
While we found no studies during our study period of investigation to December 2016 comparing the cost effectiveness of registries, two articles have provided supportive evidence of cost-effectiveness of investing in the registry [20, 79] and a report has recently been released assessing the cost-effectiveness of five Australian CQRs [80]. Larsson et al [20] presented a case study for estimating the cost saving of a hip registry by calculating direct medical savings through reduction in complications and avoided revision operations. By comparing hip revision rates in the US against those achieved in Sweden, where a registry exists with a revision rate of 10%, Larsson concluded that the US could potentially save $2 billion or 8% of the total costs of an expected $24 billion in total costs for these surgeries in 2015. Another study extrapolated the costs of emergency care for diabetics [81] and reported that a registry for quality improvement of type-2 diabetics in eight Western New York counties might lead to an estimated annual savings of more than $700 million through a 20% reduction in emergency department visits [79]. The Australian Commission on Safety and Quality in Health Care study assessing the economic impact of five Australian CQRs, and concluded that they provided a significant net positive return on investment, with benefit to cost ratios ranging from 2:1 to 7:1 [80].
This is the first review which has rigorously evaluated the impact of registries as interventions on quality of care. We found that registries play an important role in care management processes through generating performance feedback reports to physicians [59, 66], helping to identify patients who are not receiving treatment in accordance with guidelines [69, 74], creating a trigger for action by physicians [65, 74], creating a reminder for patients [59, 64], identifying high-risk patients so they can be more closely monitored [82] and reducing regional differences [71]. Registries have provided demonstrable improvement in processes of care and clinical outcomes for patients with chronic diseases [73, 83, 84]. In our review five different studies demonstrated that use of registries as tools for physician’s reminder, patient recall, structured care, audit, and progress notes can improve documentation which, in turn, leads to improvement in diabetic care [59, 64–66, 74].
Our review has several limitations. These include the quality of the studies and the heterogeneity of the study populations, coverage, duration and outcomes of interest, making it impossible to pool results. We found variation in follow-up, reporting mechanism, data management and quality assurance, and audit of data within the registry. Reporting and feedback mechanisms of the registries to stakeholder were also diverse; an issue similar to other review findings [85].
Only two [59, 60] of the 17 studies used a randomised controlled clinical trial design. Both were adequately powered to assess the impact of a registry design on improving quality of care, yet details of the intervention were poorly described in one of the studies, making it difficult to ascribe the success to the registry. Two-thirds of studies evaluating registries used the less robust before-and after- quasi-experimental study design. Limitations of this design were discussed by authors and include inability to attribute causality to the registry [59, 68]. While most studies commented that the registry likely accounted for improvement in outcomes and processes of care, they also acknowledged that the design of the studies made it impossible to clearly quantify this impact (Supplementary S1 Table).
While effort was made to minimise publication bias by including a broad search strategy including both the academic and grey literature, it may be that further evidence exists on the impact of registries on health outcomes, care utilization and costs but is not yet published. As we limited our search by English language, we may have missed relevant article which published in other languages. However, the major shift towards publication of studies in English, the extent and effects of language bias may have recently been reduced.
As registries continue to proliferate, there is a need to more rigorously evaluate their impact within and across disease conditions. This includes identifying what attributes of registries are most effective and which have little or no impact. Registries should consider using progressive study designs such as stepped wedge RCTS. This provides the advantage of allocating all sites the intervention at some point in time [86]. Because most registries initially start as a pilot e and expand over time, this provides a good opportunity to consider a step wedge design intervention to assess impact more rigorously. Moreover, in evaluating costs and outcomes attributable to clinical registries sufficient time should be provided to allow hospitals to set up appropriate governance structures, collect enough data to generate meaningful reports and a number of feedback cycles to enable hospitals and clinicians to act on findings.
Conclusions
Despite the large number of published articles using data derived from clinical registries, few have rigorously evaluated the impact of the registry as an intervention on improving health outcomes; those that have evaluated this impact have mostly found that registries have improved healthcare processes and outcomes. No studies have evaluated the economic impact of registries as an intervention.
Supporting information
S1 Table. Study limitations, conclusions and recommendations.
https://doi.org/10.1371/journal.pone.0183667.s001
(DOCX)
Acknowledgments
We would like thank Ms. Kaye Lasserre, Manager, Strategy and Planning of the Monash University Library Administration for assisting us in developing the search strategy for the Systematic Review and Ms. Kelly Allen, Systematic Review Trainer at Cochrane Australia for assisting us in developing the protocol.
Ethics approval and consent to participate: Not applicable.
References
- 1.
Gliklich RE, Dreyer NA, Leavy MB. Registries for evaluating patient outcomes: a user’s guide. 3rd ed: Agency for Health Care Research and Quality; 2014.
- 2.
Madhok R, editor Crossing the quality chasm: lessons from health care quality improvement efforts in England. Baylor University Medical Center Proceedings; 2002: Baylor University Medical Center.
- 3. Dokholyan RS, Muhlbaier LH, Falletta JM, Jacobs JP, Shahian D, Haan CK, et al. Regulatory and ethical considerations for linking clinical and administrative databases. American heart journal. 2009;157(6):971–82. pmid:19464406
- 4. Peterson ED, Shah BR, Parsons L, Pollack CV, French WJ, Canto JG, et al. Trends in quality of care for patients with acute myocardial infarction in the National Registry of Myocardial Infarction from 1990 to 2006. American heart journal. 2008;156(6):1045–55. pmid:19032998
- 5. LIM TO, Goh A, LIM YN, Morad Z. Review article: Use of renal registry data for research, health-care planning and quality improvement: What can we learn from registry data in the Asia—Pacific region? Nephrology. 2008;13(8):745–52. pmid:19154324
- 6. Schechter MS, Fink AK, Homa K, Goss CH. The Cystic Fibrosis Foundation Patient Registry as a tool for use in quality improvement. BMJ quality & safety. 2014;23(Suppl 1):i9–i14.
- 7. Peterson ED, Roe MT, Mulgund J, DeLong ER, Lytle BL, Brindis RG, et al. Association between hospital process performance and outcomes among patients with acute coronary syndromes. Jama. 2006;295(16):1912–20. pmid:16639050
- 8. Hoekstra JW, Pollack CV, Roe MT, Peterson ED, Brindis R, Harrington RA, et al. Improving the Care of Patients with Non-ST-elevation Acute Coronary Syndromes in the Emergency Department: The CRUSADE Initiative. Academic Emergency Medicine. 2002;9(11):1146–55. pmid:12414463
- 9. CfD Control, Prevention. Use of a registry to improve acute stroke care—seven states, 2005–2009. MMWR Morbidity and mortality weekly report. 2011;60(7):206. pmid:21346707
- 10. Investigators CASPR. Prioritizing interventions to improve rates of thrombolysis for ischemic stroke. Neurology. 2005;64(4):654–9. pmid:15728287
- 11. Lundström M, Barry P, Brocato L, Fitzpatrick C, Henry Y, Rosen P, et al. European registry for quality improvement in cataract surgery. International journal of health care quality assurance. 2014;27(2):140–51. pmid:24745139
- 12. Carlhed R, Bojestig M, Wallentin L, Lindström G, Peterson A, Åberg C, et al. Improved adherence to Swedish national guidelines for acute myocardial infarction: the Quality Improvement in Coronary Care (QUICC) study. American heart journal. 2006;152(6):1175–81. pmid:17161072
- 13. Fonarow GC, Yancy CW, Heywood JT. Adherence to heart failure quality-of-care indicators in US hospitals: analysis of the ADHERE Registry. Archives of internal medicine. 2005;165(13):1469–77. pmid:16009861
- 14. Schwamm LH, Fonarow GC, Reeves MJ, Pan W, Frankel MR, Smith EE, et al. Get With the Guidelines—Stroke is associated with sustained improvement in care for patients hospitalized with acute stroke or transient ischemic attack. Circulation. 2009;119(1):107–15. pmid:19075103
- 15. Fonarow GC, Albert NM, Curtis AB, Stough WG, Gheorghiade M, Heywood JT, et al. Improving evidence-based care for heart failure in outpatient cardiology practices primary results of the registry to Improve the Use of Evidence-Based Heart Failure Therapies in the Outpatient Setting (IMPROVE HF). Circulation. 2010;122(6):585–96. pmid:20660805
- 16. Bradley EH, Herrin J, Wang Y, McNamara RL, Webster TR, Magid DJ, et al. Racial and ethnic differences in time to acute reperfusion therapy for patients hospitalized with myocardial infarction. Jama. 2004;292(13):1563–72. pmid:15467058
- 17. Barron HV, Bowlby LJ, Breen T, Rogers WJ, Canto JG, Zhang Y, et al. Use of reperfusion therapy for acute myocardial infarction in the United States Data from the National Registry of Myocardial Infarction 2. Circulation. 1998;97(12):1150–6. pmid:9537341
- 18. Gibson CM, Pride YB, Frederick PD, Pollack CV, Canto JG, Tiefenbrunn AJ, et al. Trends in reperfusion strategies, door-to-needle and door-to-balloon times, and in-hospital mortality among patients with ST-segment elevation myocardial infarction enrolled in the National Registry of Myocardial Infarction from 1990 to 2006. American heart journal. 2008;156(6):1035–44. pmid:19032997
- 19. McNeil JJ, Evans SM, Johnson NP, Cameron PA. Clinical-quality registries: their role in quality improvement. Medical Journal of Australia. 2010;192(5):244–5. pmid:20201755
- 20. Larsson S, Lawyer P, Garellick G, Lindahl B, Lundstrom M. Use of 13 disease registries in 5 countries demonstrates the potential to use outcome data to improve health care's value. Health Aff (Millwood). 2012;31(1):220–7.
- 21. Öien R, Ragnarson Tennvall G. Accurate diagnosis and effective treatment of leg ulcers reduce prevalence, care time and costs. Journal of wound care. 2006;15(6):259–62. pmid:16802562
- 22. Breckenridge K, Bekker HL, Gibbons E, van der Veer SN, Abbott D, Briançon S, et al. How to routinely collect data on patient-reported outcome and experience measures in renal registries in Europe: an expert consensus meeting. Nephrology Dialysis Transplantation. 2015;30(10):1605–14.
- 23. Franklin PD, Lewallen D, Bozic K, Hallstrom B, Jiranek W, Ayers DC. Implementation of patient-reported outcome measures in US total joint replacement registries: rationale, status, and plans. J Bone Joint Surg Am. 2014;96(Supplement 1):104–9.
- 24. Gabbe BJ, Sutherland AM, Hart MJ, Cameron PA. Population-based capture of long-term functional and quality of life outcomes after major trauma: the experiences of the Victorian State Trauma Registry. Journal of Trauma and Acute Care Surgery. 2010;69(3):532–6.
- 25. Bhatt DL. Advancing the care of cardiac patients using registry data: going where randomized clinical trials dare not. Jama. 2010;303(21):2188–9. pmid:20516422
- 26. Khuri SF, Daley J, Henderson W, Hur K, Demakis J, Aust JB, et al. The Department of Veterans Affairs' NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Annals of surgery. 1998;228(4):491. pmid:9790339
- 27. Sorensen HT. Regional administrative health registries as a resource in clinical epidemiology. International Journal of Risk and Safety in Medicine. 1996;10(1):1–22.
- 28. Jonsson Å, Edner M, Alehagen U, Dahlström U. Heart failure registry: a valuable tool for improving the management of patients with heart failure. European journal of heart failure. 2010;12(1):25–31. pmid:20023041
- 29. Hickey GL, Grant SW, Cosgriff R, Dimarakis I, Pagano D, Kappetein AP, et al. Clinical registries: governance, management, analysis and applications. European Journal of Cardio-Thoracic Surgery. 2013.
- 30. Gitt AK, Bueno H, Danchin N, Fox K, Hochadel M, Kearney P, et al. The role of cardiac registries in evidence-based medicine. European heart journal. 2010.
- 31. Mehra S, Tuttle RM, Milas M, Orloff L, Bergman D, Bernet V, et al. Database and registry research in thyroid cancer: striving for a new and improved national thyroid cancer database. Thyroid. 2015;25(2):157–68. pmid:25517683
- 32. Bufalino VJ, Masoudi FA, Stranne SK, Horton K, Albert NM, Beam C, et al. The American Heart Association's recommendations for expanding the applications of existing and future clinical registries a policy statement from the American Heart Association. Circulation. 2011;123(19):2167–79. pmid:21482960
- 33.
Peterson ED. Research methods to speed the development of better evidence—the registries example: Washington DC: National Academies Press; 2007.
- 34.
McClellan MB, McGinnis JM, Nabel EG, Olsen LM. Evidence-Based Medicine and the Changing Nature of Health Care:: Meeting Summary (IOM Roundtable on Evidence-Based Medicine): National Academies Press; 2008.
- 35. Spertus JA, Peterson E, Rumsfeld JS, Jones PG, Decker C, Krumholz H, et al. The Prospective Registry Evaluating Myocardial Infarction: Events and Recovery (PREMIER)—evaluating the impact of myocardial infarction on patient outcomes. American heart journal. 2006;151(3):589–97. pmid:16504619
- 36. French WJ, Reddy VS, Barron HV. Transforming quality of care and improving outcomes after acute MI: lessons from the National Registry of Myocardial Infarction. JAMA. 2012;308(8):771–2. pmid:22910752
- 37. Lorenzoni L, Belloni A, Sassi F. Health-care expenditure and health policy in the USA versus other high-spending OECD countries. The Lancet. 2014;384(9937):83–92.
- 38. Armstrong BK, Gillespie JA, Leeder SR, Rubin GL, Russell LM. Challenges in health and health care for Australia. Medical Journal of Australia. 2007;187(9):485. pmid:17979607
- 39. Emilsson L, Lindahl B, Koster M, Lambe M, Ludvigsson JF. Review of 103 Swedish Healthcare Quality Registries. Journal of Internal Medicine. 2015;277(1):94–136. pmid:25174800
- 40. Lyu H, Cooper M, Patel K, Daniel M, Makary MA. Prevalence and data transparency of national clinical registries in the United States. J Healthcare Qual. 2015.
- 41. Grau AJ, Eicke M, Biegler MK, Faldum A, Bamberg C, Haass A, et al. Quality monitoring of acute stroke care in Rhineland-Palatinate, Germany, 2001–2006. Stroke. 2010;41(7):1495–500. pmid:20522811
- 42. Asplund K, Hulter Åsberg K, Norrving B, Stegmayr B, Terént A. Riks-stroke—a Swedish national quality register for stroke care. Cerebrovascular diseases. 2003;15(Suppl. 1):5–7.
- 43. Kapral MK, Laupacis A, Phillips SJ, Silver FL, Hill MD, Fang J, et al. Stroke care delivery in institutions participating in the Registry of the Canadian Stroke Network. Stroke. 2004;35(7):1756–62. pmid:15143293
- 44.
Registry ASC. Annual Report. 2014.
- 45. George MG, Tong X, McGruder H, Yoon P, Rosamond W, Winquist A, et al. Paul Coverdell National Acute Stroke Registry Surveillance—four states, 2005–2007. MMWR Surveill Summ. 2009;58(7):1–23. pmid:19893482
- 46. Sposato LA, Esnaola MM, Zamora R, Zurrú MC, Fustinoni O, Saposnik G, et al. Quality of ischemic stroke care in emerging countries the Argentinian National Stroke Registry (ReNACer). Stroke. 2008;39(11):3036–41. pmid:18703802
- 47.
Australian Clinical Registries, Clinical Registries [cited 2015 13th October]. http://clinicalregistries.com.au/clinical-registries/.
- 48. Ferguson T Jr, Peterson E, Coombs L, Eiken M, Carey M, Grover F, et al. Society of Thoracic Surgeons and the National Cardiac Database. Use of continuous quality improvement to increase use of process measures in patients undergoing coronary artery bypass graft surgery: a randomized controlled trial. JAMA. 2003;290(1):49–56. pmid:12837711
- 49. Coleman M, Forman D, Bryant H, Butler J, Rachet B, Maringe C, et al. Cancer survival in Australia, Canada, Denmark, Norway, Sweden, and the UK, 1995–2007 (the International Cancer Benchmarking Partnership): an analysis of population-based cancer registry data. The Lancet. 2011;377(9760):127–38.
- 50. Autier P, Boniol M. Caution needed for country-specific cancer survival. The Lancet. 2011;377(9760):99–101.
- 51. Evans SM, Scott IA, Johnson NP, Cameron PA, McNeil JJ. Development of clinical-quality registries in Australia: the way forward. Med J Aust. 2011;194(7):360–3. pmid:21470087
- 52.
Australian Commission on Safety and Quality in Health Care (2012), Logical Design for Australian Clinical Quality Registries. ACSQHC, Sydney 2012 [cited 2015 6th March]. http://www.safetyandquality.gov.au/wp-content/uploads/2012/03/Logical-Design-for-CQR_v1.0_FINAL-DRAFT_March-2012_1.58MB.pdf
- 53.
Scottish Intercollegiate Guidelines Network for RCT, Cohort and Case Control studies [cited 2015 24th February]. http://www.sign.ac.uk/methodology/checklists.html
- 54.
Cochrane data abstraction form [cited 2015 16th February]. http://epoc.cochrane.org/epoc-specific-resources-review-authors
- 55. Black N, Barker M, Payne M. Cross sectional survey of multicentre clinical databases in the United Kingdom. Bmj. 2004;328(7454):1478. pmid:15205292
- 56. Hoque DME, Kumari V, Ruseckaite R, Romero L, Evans SM. Impact of clinical registries on quality of patient care and health outcomes: protocol for a systematic review. BMJ open. 2016;6(4):e010654. pmid:27118288
- 57. Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews. A product from the ESRC methods programme Version. 2006;1:b92.
- 58. Moher D, Liberati A, Tetzlaff J, Altman D. PRISMA 2009 Flow Diagram. PLoS Med. 2009;6(7).
- 59. Thomas KG, Thomas MR, Stroebel RJ, McDonald FS, Hanson GJ, Naessens JM, et al. Use of a registry-generated audit, feedback, and patient reminder intervention in an internal medicine resident clinic—a randomized trial. Journal of general internal medicine. 2007;22(12):1740–4. pmid:17973175
- 60. Roski J, Jeddeloh R, An L, Lando H, Hannan P, Hall C, et al. The impact of financial incentives and a patient registry on preventive care quality: increasing provider adherence to evidence-based smoking cessation practice guidelines. Preventive medicine. 2003;36(3):291–9. pmid:12634020
- 61. Shah NR, Webb FJ, Hannah LM, Smotherman CR, Kraemer DF. Diabetes registries in patient-centered medical homes. Journal of Registry Management. 2015;42(1):3–8. pmid:25961785
- 62. Geubbels EL, Nagelkerke NJ, Mintjes-De Groot AJ, Vandenbroucke-Grauls CM, Grobbee DE, De Boer AS. Reduced risk of surgical site infections through surveillance in a network. International Journal for Quality in Health Care. 2006;18(2):127–33. pmid:16484315
- 63. Tøttenborg SS, Thomsen RW, Nielsen H, Johnsen SP, Frausing Hansen E, Lange P. Improving quality of care among COPD outpatients in Denmark 2008–2011. The clinical respiratory journal. 2013;7(4):319–27. pmid:23163961
- 64. Harris M, Flack J, Georgiou A, McKenzie S, Penn D, Burns J. Monitoring change in diabetes care using diabetes registers: experience from Divisions of General Practice. Australian Family Physician. 2006;35(1–2):77. pmid:16489395
- 65. Pollard C, Bailey KA, Petitte T, Baus A, Swim M, Hendryx M. Electronic patient registries improve diabetes care and clinical outcomes in rural community health centers. J Rural Health. 2009;25(1):77–84. pmid:19166565
- 66. Goldfracht M, Levin D, Peled O, Poraz I, Stern E, Brami J-L, et al. Twelve-year follow-up of a population-based primary care diabetes program in Israel. International Journal for Quality in Health Care. 2011;23(6):674–81. pmid:21835829
- 67. Öien RF, Forssell HW. Ulcer healing time and antibiotic treatment before and after the introduction of the Registry of Ulcer Treatment: an improvement project in a national quality registry in Sweden. BMJ open. 2013;3(8):e003091. pmid:23959752
- 68. Hills NK, Johnston SC. Duration of hospital participation in a nationwide stroke registry is associated with improved quality of care. BMC neurology. 2006;6(1):20.
- 69. Young A, Dixey J, Williams P, Prouse P, Cox N, Kiely P, et al. An evaluation of the strengths and weaknesses of a register of newly diagnosed rheumatoid arthritis, 1986–2010. Rheumatology. 2010.
- 70. Salim A, Malinoski D, Schulman D, Desai C, Navarro S, Ley EJ. The combination of an online organ and tissue registry with a public education campaign can increase the number of organs available for transplantation. The Journal of trauma. 2010;69(2):451. pmid:20699756
- 71. Jakobsen E, Green A, Oesterlind K, Rasmussen TR, Iachina M, Palshof T. Nationwide quality improvement in lung cancer care: the role of the Danish Lung Cancer Group and Registry. Journal of Thoracic Oncology. 2013;8(10):1238–47. pmid:24457234
- 72. Mallinson E, Newton K, Bowen J, Lalloo F, Clancy T, Hill J, et al. The impact of screening and genetic registration on mortality and colorectal cancer incidence in familial adenomatous polyposis. Gut. 2010;59(10):1378–82. pmid:20660077
- 73. Harrison JK, Clipsham LE, Cooke CM, Warwick G, Burton JO. Establishing a supportive care register improves end-of-life care for patients with advanced chronic kidney disease. Nephron. 2015;129(3):209–13. pmid:25721712
- 74. Harris MF, Priddin D, Ruscoe W, Infante FA, O'Toole BI. Quality of care provided by general practitioners using or not using Division-based diabetes registers. The Medical Journal of Australia. 2002;177(5):250–2. pmid:12197819
- 75. Young A, Koduri G, Batley M, Kulinskaya E, Gough A, Norton S, et al. Mortality in rheumatoid arthritis. Increased in the early course of disease, in ischaemic heart disease and in pulmonary fibrosis. Rheumatology. 2007;46(2):350–7. pmid:16908509
- 76. Koduri G, Norton S, Young A, Cox N, Davies P, Devlin J, et al. Interstitial lung disease has a poor prognosis in rheumatoid arthritis: results from an inception cohort. Rheumatology. 2010;49(8):1483–9. pmid:20223814
- 77. LaBresh KA, Reeves MJ, Frankel MR, Albright D, Schwamm LH. Hospital treatment of patients with ischemic stroke or transient ischemic attack using the “Get With The Guidelines” program. Archives of Internal Medicine. 2008;168(4):411–7. pmid:18299497
- 78. Hong Y, LaBresh KA. Overview of the American Heart Association “Get with the Guidelines” programs: coronary heart disease, stroke, and heart failure. Critical pathways in cardiology. 2006;5(4):179–86. pmid:18340235
- 79. Han W, Sharman R, Heider A, Maloney N, Yang M, Singh R. Impact of electronic diabetes registry ‘Meaningful Use’on quality of care and hospital utilization. Journal of the American Medical Informatics Association. 2015.
- 80.
ACSQHC. Economic evaluation of clinical quality registries: Final report. Sydney: The Australian Commission on Safety and Quality in Health Care 2016.
- 81. Dall TM, Mann SE, Zhang Y, Quick WW, Seifert RF, Martin J, et al. Distinguishing the economic costs associated with type 1 and type 2 diabetes. Population Health Management. 2009;12(2):103–10. pmid:19361253
- 82. Schmittdiel J, Bodenheimer T, Solomon NA, Gillies RR, Shortell SM. Brief report: the prevalence and use of chronic disease registries in physician organizations. Journal of general internal medicine. 2005;20(9):855–8. pmid:16117756
- 83. Stroebel RJ, Scheitel SM, Fitz JS, Herman RA, Naessens JM, Scott CG, et al. A randomized trial of three diabetes registry implementation strategies in a community internal medicine practice. The Joint Commission Journal on Quality and Patient Safety. 2002;28(8):441–50.
- 84. Renders CM, Valk GD, Griffin SJ, Wagner EH, Assendelft WJ. Interventions to improve the management of diabetes in primary care, outpatient, and community settings a systematic review. Diabetes care. 2001;24(10):1821–33. pmid:11574449
- 85. van der Veer SN, de Keizer NF, Ravelli AC, Tenkink S, Jager KJ. Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers. International journal of medical informatics. 2010;79(5):305–23. pmid:20189451
- 86. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC medical research methodology. 2006;6(1):1.