http://orcid.org/0000-0003-3627-6925
Figures
Abstract
Aims/hypothesis
To develop a prediction model that can predict HbA1c levels after six years in the non-diabetic general population, including previously used readily available predictors.
Methods
Data from 5,762 initially non-diabetic subjects from three population-based cohorts (Hoorn Study, Inter99, KORA S4/F4) were combined to predict HbA1c levels at six year follow-up. Using backward selection, age, BMI, waist circumference, use of anti-hypertensive medication, current smoking and parental history of diabetes remained in sex-specific linear regression models. To minimize overfitting of coefficients, we performed internal validation using bootstrapping techniques. Explained variance, discrimination and calibration were assessed using R2, classification tables (comparing highest/lowest 50% HbA1c levels) and calibration graphs. The model was externally validated in 2,765 non-diabetic subjects of the population-based cohort METSIM.
Results
At baseline, mean HbA1c level was 5.6% (38 mmol/mol). After a mean follow-up of six years, mean HbA1c level was 5.7% (39 mmol/mol). Calibration graphs showed that predicted HbA1c levels were somewhat underestimated in the Inter99 cohort and overestimated in the Hoorn and KORA cohorts, indicating that the model’s intercept should be adjusted for each cohort to improve predictions. Sensitivity and specificity (95% CI) were 55.7% (53.9, 57.5) and 56.9% (55.1, 58.7) respectively, for women, and 54.6% (52.7, 56.5) and 54.3% (52.4, 56.2) for men. External validation showed similar performance in the METSIM cohort.
Conclusions/interpretation
In the non-diabetic population, our DIRECT-DETECT prediction model, including readily available predictors, has a relatively low explained variance and moderate discriminative performance, but can help to distinguish between future highest and lowest HbA1c levels. Absolute HbA1c values are cohort-dependent.
Citation: Rauh SP, Heymans MW, Koopman ADM, Nijpels G, Stehouwer CD, Thorand B, et al. (2017) Predicting glycated hemoglobin levels in the non-diabetic general population: Development and validation of the DIRECT-DETECT prediction model - a DIRECT study. PLoS ONE 12(2): e0171816. https://doi.org/10.1371/journal.pone.0171816
Editor: Stefan Kiechl, Medizinische Universitat Innsbruck, AUSTRIA
Received: June 9, 2016; Accepted: January 26, 2017; Published: February 10, 2017
Copyright: © 2017 Rauh et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The work leading to this publication has received support from the Innovative Medicines Initiative Joint Undertaking under grant agreement n°115317 (DIRECT), resources of which are composed of financial contribution from the European Union's Seventh Framework Programme (FP7/2007‐2013) and EFPIA companies’ in kind contribution (http://www.direct-diabetes.org/). The Hoorn Study was supported by Vrije Universiteit Amsterdam, the VU University Medical Center, the Dutch Diabetes Research Foundation, the Dutch Organization for Scientific Research, the Netherlands Heart Foundation, and the Health Research and Development Council of the Netherlands. The KORA research platform (KORA, Cooperative Research in the Region of Augsburg) was initiated and financed by the Helmholtz Zentrum München—German Research Center for Environmental Health, which is funded by the German Federal Ministry of Education and Research and by the State of Bavaria. The Diabetes Cohort Study was funded by a German Research Foundation project grant to W.R. (RA 459/2-1) from the German Diabetes Center. The German Diabetes Center is funded by the German Federal Ministry of Health and the Ministry of Innovation, Science, Research and Technology of the federal state of North Rhine Westfalia. The Inter99 Study was supported by the Danish Medical Research Council, the Danish Center for Evaluation and Health Technology Assessment, Novo Nordisk, Copenhagen County, the Danish Heart Foundation, the Danish Diabetes Association, the Danish Pharmaceutical Association, the Augustinus Foundation, the Ib Henriksen Foundation, and the Becket Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The Novo Nordisk funding did not influence the scientific work, or have any influence on design, data collection, analyses or interpretation of the results. We can confirm that this does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Lifestyle and drug interventions can prevent or delay the development of type 2 diabetes in those at risk for the disease [1–3]. Therefore, it is important that screening tools are developed to identify those at risk. To facilitate the use in clinical practice, such a prediction model should include predictors that are non-invasive and should thus not include laboratory-based predictors [4]. In addition, non-invasive screening models can be useful for research purposes, for application in large databases where blood assays are not available. In the DIabetes REsearCh on patient straTification (DIRECT) study [5], there was a need for such a prediction model to select participants for a prospective cohort study.
Several non-invasive screening models have been developed to predict the risk of type 2 diabetes development [4]. One of those non-invasive prediction models that is often used is the Finnish diabetes risk score [6]. This risk score was developed as a simple screening tool predicting the risk of developing drug-treated type 2 diabetes within the next 10 years, using age, body mass index (BMI), waist circumference, use of anti-hypertensive drugs, and history of high blood glucose (such as gestational diabetes) as predictors [6]. In the Evaluation of Screening and Early Detection Strategies for Type 2 Diabetes and Impaired Glucose Tolerance (DETECT-2) project, an international data-pooling collaboration, the Finnish diabetes risk score was updated by including clinically diagnosed and screen-detected type 2 diabetes as endpoint, and by considering additional predictors: history of gestational diabetes, sex, smoking, and family history of diabetes [7]. Both the Finnish diabetes risk score and the DETECT-2 model showed adequate discrimination [6,7].
The diagnosis of type 2 diabetes in these models was however based on fasting glucose levels and/or glucose levels after an oral glucose tolerance test (OGTT). In 2010, glycated hemoglobin (HbA1c) levels have been added to the diagnostic criteria for diabetes [8]. HbA1c levels are strongly related to the risk of diabetic complications and show less variability compared to fasting glucose levels and 2h OGTT glucose levels [9]. Using Hba1c or glucose as criteria for T2D has been shown to identify additional and different amounts of diabetes patients [10,11]. However, to our knowledge, no non-invasive models have previously been developed to predict HbA1c levels in the non-diabetic population.
The aim of the current study was therefore to develop a prediction model that predicts HbA1c levels after six years in the non-diabetic population, including readily available predictors that are part of the DETECT-2 diabetes risk score [7]. We combined data from three European population-based cohorts to develop our DIRECT-DETECT prediction model and a fourth cohort to externally validate the model.
Methods
Study population
Three European population-based cohorts were used to develop the prediction model: the Hoorn Study [12], the Inter99 Study [13] and the Cooperative Health Research in the Region of Augsburg (KORA S4/F4 Study) [14].
- In the Hoorn Study (The Netherlands), 2,484 men and women aged 50 to 75 years participated at baseline (between 1989 and 1992). After 4–8 years, 1,513 of these participants had a follow-up examination [15]. At baseline and follow-up, HbA1c levels were determined by ion-exchange high-performance liquid chromatography (HPLC) [16], using a Modular Diabetes Monitoring System (Bio-Rad, Veenendaal, The Netherlands), with an inter-assay coefficient of variation of 3.3%.
- In the Inter99 Study (Denmark), 6,906 men and women aged 30 to 60 years participated at baseline (between 1999 and 2001). After 5–6 years, 4,031 of these participants had a follow-up examination [17]. At baseline, HbA1c levels were determined by HPLC (Bio-Rad, USA), with intra-assay and inter-assay coefficients of variation of < 1.5% and < 2%, respectively. Also at follow-up, HbA1c levels were determined by HPLC (TOSOH, Minato, Japan) [18], with intra-assay and inter-assay coefficients of variation of < 1% and < 2%, respectively.
- In the KORA S4/F4 Study (Germany), 1,653 men and women aged 55–74 years participated at baseline (between 1999 and 2001, called KORA S4). After 6–8 years, 1,209 of these participants had a follow-up examination, called KORA F4 [19]. At baseline, HbA1c levels were determined by a turbidimetric immunological method (Tina-Quant HBA1C II; Roche Diagnostics GmbH, Mannheim, Germany) on a Hitachi 717 instrument, with inter-assay coefficients of variation of 3.9% at HbA1c levels of 5.7% and 5.2% at HbA1c levels of 9.7%. At follow-up, HbA1c levels were determined with a reverse-phase cation-exchange high performance liquid chromatographic, photometric assay (A. Menarini Diagnostics, Florence, Italy) on a HA 8160 Hemoglobin Analysis System, with inter-assay coefficients of variation of 1.2% at HbA1c levels of 5.95% and 1.2% at HbA1c levels of 10.6%. To correct for assay differences between baseline and follow-up, baseline measures were transformed using a previously published method [20].
In these three cohorts (from now on referred to as ‘the development dataset’), participants with type 2 diabetes at baseline were excluded based on the following criteria: known diabetes, fasting plasma glucose levels ≥7.0 mmol/l, 2h OGTT glucose levels ≥11.1 mmol/l, and/or HbA1c levels ≥6.5% (48 mmol/mol; N = 673) [21]. After exclusion, information on HbA1c levels at baseline and follow-up and on the relevant predictors was available for 5,762 participants: N = 1,337 from the Hoorn study; N = 3,526 form the Inter99 Study and N = 899 from the KORA S4/F4 Study.
Additionally, the prediction model was externally validated in a fourth population-based cohort: the METSIM Study [22]. In the METSIM Study (Finland), 10,197 men aged 45–73 years participated at baseline (2005–2010) [23]. For the current study, 5-year follow-up data was available for 3,255 participants. Excluding participants with type 2 diabetes at baseline resulted in 2,765 eligible participants. At baseline and follow-up, HbA1c levels were determined with a Tosoh G7 glycohemoglobin analyser (Tosoh Bioscience, San Francisco, CA, USA) [24], with an inter-assay coefficient of variation of 2.8%.
Participants provided written informed consent. The Hoorn Study was approved by the VU University Medical Centre Ethics Committee. The Inter99 Study was approved by the Scientific Ethics Committee of the Capital Region of Denmark. The KORA S4/F4 Study was approved by the Ethics Committee of the Bavarian Medical Association. The METSIM Study was approved by the Ethics Committee of the University of Eastern Finland and Kuopio University Hospital. This work was undertaken as part of the DIabetes REsearCh on patient straTification (DIRECT) study, an EU FP7 Innovative Medicines Inititative (http://www.direct-diabetes.org/) that is described elsewhere [5].
Data analysis
Developing the model predicting HbA1c levels at follow-up.
A prediction model was developed considering non-invasive measures, which are part of the DETECT-2 risk score, as potential predictors: age, BMI, waist circumference, use of anti-hypertensive drugs (yes or no), smoking (current, former, or no) and parental history of diabetes (yes or no; for the KORA S4/F4 Study, the answer category ‘unknown’ was considered as ‘no’). As age, BMI and waist circumference showed no linear relationship with HbA1c levels at follow-up, these variables were categorized consistent with the DETECT-2 model [7]: age <45, ≥45 to <55, ≥55 to <65, ≥65 years; BMI <25, ≥25 to <30, ≥30 kg/m2; and waist circumference in sex-specific categories: <94, ≥94 to <102, ≥102 cm for men, and <80, ≥80 to <88, ≥88 cm for women. History of gestational diabetes was included in the original DETECT-2 risk score, but not in the current analysis, because information on this variable was available in only one of the datasets resulting in missing data for this variable for 77% of the women. For the same reason, information on family history of diabetes was limited to parental history, as information on diabetes history of siblings was missing for 27% of the participants. Sex-specific models were constructed.
Starting with the full model (i.e. including age, BMI, waist circumference, use of anti-hypertensive drugs, smoking and parental history of diabetes), we used a backward selection procedure to exclude variables that did not contribute significantly to the model. Significance was set at p<0.157 according to Akaike’s information criterion [25].
Additionally, we evaluated whether a correction was necessary for cohort by including a categorical variable for cohort source. As cohort source had an effect on the estimated regression coefficients, the regression coefficients of all predictors were first estimated including the cohort variable. Next, all regression coefficients were fixed and the cohort variable was removed from the model. Finally, using the fixed regression coefficients for all predictors (i.e. using the linear predictor of this model as an offset variable), a new cohort-independent intercept was calculated. This way, the regression coefficients for all predictors were corrected for the effect of cohort source without having a variable for cohort source in the model, making it possible to apply this model to new cohorts.
Internal and external validation.
The prediction model was validated both internally and externally. Because prediction models typically perform better in the dataset that was used to develop the model compared to other datasets (owing to overfitting), validation is an important step after the development of a prediction model. Internal validation was performed using bootstrapping techniques: 500 bootstrap samples with replacement were taken from the original dataset. These bootstrap samples had the same size as the original dataset, and because the sampling included replacement, participants from the original dataset could appear in the bootstrap several times. In these bootstrap samples, the modelling process was repeated: regression coefficients were calculated and a backward selection was performed, resulting in a model for each bootstrap sample. These 'bootstrap models' were then applied to the original dataset. Next, the performance of the bootstrap models was evaluated both in the bootstrap sample and in the original dataset. For each bootstrap sample, the difference between the performance in the bootstrap sample and in the original dataset is called the optimism, which is a measure for model overfitting. The mean of these values is the optimism of the original prediction model [26,27]. Subsequently, the regression coefficients of our prediction model were adjusted for this optimism.
After this internal validation step, the optimism-corrected model was externally validated in the METSIM Study: the coefficients were applied to this external dataset and the external performance of the model was evaluated.
In the external dataset, no information was available on parental history of diabetes. However, information was available on family history, which was defined as either parents, siblings, or children with diabetes. To evaluate whether this difference could affect the performance of the model, we applied all regression coefficients of the prediction model to the METSIM Study, which included applying the parental history coefficient to the family history variable in the METSIM Study. Next, we applied all coefficients except the one for parental history to the METSIM Study and allowed the model to estimate the coefficient for family history. Finally, we compared the performance of these two models.
Performance.
The performance of the prediction model was assessed in the development dataset and in the external validation dataset. We evaluated the explained variation of the models, which can be considered as an overall measure of the predictive ability of a model [26,28]. To assess calibration, i.e. the agreement between predicted and observed HbA1c levels, predicted HbA1c levels were divided in percentiles, and for each percentile the mean predicted and the mean observed HbA1c levels were displayed in a calibration graph.
To be able to evaluate the discriminative performance of the model, i.e. the ability of the model to discriminate between high and low HbA1c levels at follow-up, HbA1c levels were dichotomized. Within the Direct Study, the purpose of this prediction model was to select about half of the population of these existing cohort studies for inclusion in a new prospective study, and therefore, this dichotomization was performed using the median HbA1c level (HbA1c-levels < / ≥ 5.643% (38 mmol/mol) for men and < / ≥ 5.654% (38 mmol/mol) for women). Additionally, sensitivity and specificity were calculated, where sensitivity indicates the percentage of participants that were correctly classified as having high HbA1c levels among the total number of participants with high observed HbA1c levels, and specificity indicates the percentage of correctly classified participants among the participants with low observed HbA1c levels.
Sensitivity analysis.
As a sensitivity analysis, we assessed the discriminative performance of the model when it is used to predict the incidence of pre-diabetes, defined as HbA1c levels ≥ 5.7% (mmol/mol) [21].
Secondly, we assessed the performance of the model when, next to the non-invasive predictors, baseline HbA1c levels were considered to predict HbA1c levels at follow-up.
Results
Population characteristics
Table 1 shows the characteristics of the total development dataset and stratified per cohort: the Hoorn Study, the Inter99 Study, and the KORA S4/F4 Study. Furthermore, the table shows the characteristics of the external validation dataset: the METSIM Study. The mean HbA1c level at baseline was 5.6% (38 mmol/mol) in the development dataset and 5.7% (39 mmol/mol) in the external validation dataset. After a mean follow-up of 5.9 and 4.7 years, respectively, mean HbA1c levels were 5.7% (39 mmol/mol) in the development dataset and 5.8% (40 mmol/mol) in the external validation dataset.
Participants of the METSIM Study were on average older, had a larger waist circumference, used antihypertensive drugs more often, and smoked less often compared to the development dataset. Further, the prevalence of a positive family history in the external validation dataset was higher than the prevalence of a positive parental history of diabetes in the development dataset, and the external validation dataset only consisted of men (compared to 49% men in the development dataset).
Predicting HbA1c levels at follow-up
For both men and women, age, BMI, waist circumference, use of anti-hypertensive medication, current smoking, and parental history of diabetes were significant predictors of HbA1c levels at follow-up. Table 2 shows the prediction model for men and women before and after correction for cohort source, and the final model after internal validation.
Explained variance of the final model after internal validation was 2% for women and 1.3% for men (Table 3). When assessed separately in the different cohorts, explained variance was 6.1%, 4.1%, and 14.7% for women and 7.1%, 9.7% and 5.2% for men from the Hoorn Study, KORA S4/F4 Study and Inter99 Study, respectively.
Regarding calibration, the prediction model somewhat underestimated the lower observed HbA1c levels and somewhat overestimated the higher observed HbA1c levels, in both men (Fig 1A) and women (Fig 1C). Stratifying the calibration graphs for the different cohorts (Fig 1B and 1D) showed that the predictions were systematically overestimated in the Hoorn Study and the KORA S4/F4 Study, while they were systematically underestimated in the Inter99 Study. This indicates that absolute HbA1c levels were cohort specific, and updating the intercept for each cohort would improve calibration [26].
(A) For men, in the development dataset (The Hoorn Study, The KORA S4/F4 Study and the Inter99 Study combined). (B) For men, in the development dataset, stratified per cohort: Hoorn Study (dots), KORA F4/S4 Study (squares), Inter99 Study (triangles). (C) For women, in the development dataset (The Hoorn Study, The KORA S4/F4 Study and the Inter99 Study combined). (D) For women, in the development dataset, stratified per cohort: Hoorn Study (dots), KORA F4/S4 Study (squares), Inter99 Study (triangles). (E) For men, in the external validation dataset (The METSIM Study). The diagonal line indicates perfect calibration.
Table 4 shows the sensitivity and specificity of the prediction models for women and men when HbA1c levels were dichotomized using the median HbA1c level. Sensitivity (95% CI) was 55.7% (53.9, 57.5) for women and 54.6% (52.7, 56.5) for men, specificity (95% CI) was 56.9% (55.1, 58.7) and 54.3% (52.4, 56.2), respectively.
External validation
External validation of the model showed an explained variance of 4.3% in the METSIM Study. The calibration graph (Fig 1E) indicates that the predictions were systematically underestimated in the METSIM Study.
In the external validation in the METSIM Study, sensitivity was 56.4% (95% CI 54.6, 58.2) and specificity was 57.7% (95% CI 55.9, 59.5), while 54.3% had observed ‘high’ HbA1c levels. Allowing for estimation of the regression coefficient for family history of diabetes did not considerably change the performance of the model, compared to applying the coefficient for parental history of diabetes to this variable (results not shown).
Sensitivity analyses
When the model was used to predict the incidence of pre-diabetes, sensitivity (95% CI) was 55.6% (53.8, 57.4) for women and 36% (34.2, 37.8) for men and specificity (95% CI) was 65.3% (63.6, 67.0) and 71.3% (69.6, 73.0), respectively.
As expected, adding baseline HbA1c levels as a predictor next to the non-invasive predictors considerably improved model performance. Explained variance was 34% for women and 39% for men. Sensitivity (95% CI) of this model was 75.1% (73.6, 76.6) for women and 76.3% (74.7, 77.9) for men, and specificity (95% CI) was 72.2% (70.6, 73.8) and 74.6% (73.0, 76.2), respectively, when follow-up HbA1c levels were dichotomized using the median HbA1c level. When this model was used to predict the incidence of pre-diabetes, sensitivity (95% CI) was 69.3% (67.6, 71.0) and 71.4% (69.7, 73.1), and specificity (95% CI) was 79.1% (77.6, 80.6) and 78.8% (77.3, 80.3) for women and men, respectively.
Discussion
Our aim was to develop a prediction model for HbA1c levels after six years of follow-up in a non-diabetic general population, using a sex-specific model and including readily available predictors that are part of the DETECT-2 diabetes risk score [7]. We showed that for men and women, age, BMI, waist circumference, use of anti-hypertensive medication, current smoking and parental history of diabetes were relevant predictors of HbA1c levels at follow-up, although these predictors could only explain 4–15% of the observed variance in HbA1c levels within each cohort. In addition, the discriminative performance of the DIRECT-DETECT prediction model was moderate. Calibration of the model could be improved by using different intercepts for each cohort.
Previous studies on non-invasive prediction models predicted the risk of developing type 2 diabetes, either drug-treated, clinically diagnosed, self-reported and/or screen-detected [6,7,29–38]. However, none of these models included HbA1c levels as a diagnostic criterion to define type 2 diabetes. We showed that non-invasive predictors can also be used to predict HbA1c levels after six years, although with moderate performance. Predictors for higher HbA1c levels in our study were also associated with a higher risk of developing type 2 diabetes in previous non-invasive models: higher age [6,7,29–32,35–37], higher waist circumference [6,7,29–31,33,37], use of anti-hypertensive medication [7,31,32,36,38], current smoking [7,30–32,36–38], and parental history of diabetes [7,29–31,35,36]. In line with previous studies, we observed higher HbA1c levels with a higher BMI [6,7,32,35,36]. Only for men, a small and not statistically significant negative regression coefficient was found for the middle BMI category. As the total BMI-variable did contribute to the model, it was kept in the model. Finally, previous prediction models that included former smoking had inconclusive results [7,32,36,37]. In our study, we included former smoking as a potential predictor, but this factor was excluded after backward selection.
A limitation of our study is that our development dataset included data from three cohorts with some population differences between the cohorts, and different assays were used to measure HbA1c levels. We corrected for these differences by correcting for cohort source. We observed that predicted HbA1c levels were systematically overestimated in the Hoorn Study and the KORA S4/F4 Study, and underestimated in the Inter99 Study and in the external validation in the METSIM Study. This indicates that calibration of the model could be improved by applying cohort-specific intercepts. We therefore advise to estimate a new intercept when applying this model to new populations. In addition, we evaluated whether differences in follow-up duration between participants affected the results, which they did not do. A second limitation is that the cohorts that were used in this study contain predominantly Caucasians. While racial differences are observed in HbA1c levels [39,40], future research might evaluate the performance of the prediction model for other ethnic groups. A third limitation is the possibility of attrition bias: in the cohort studies that we used to develop our prediction model, participants at follow-up were on average more healthy at baseline compared to those only participating at baseline [15,17]. This could have led to an underestimation of the association between predictors at baseline and HbA1c levels at follow-up. Finally, our external validation cohort, the METSIM Study, only consisted of men. This way, we were able to externally validate the prediction model for men, but not for women.
A strength of our study is that four large international population-based cohort studies were used to develop this prediction model, thus, results of this study are expected to be valid for Caucasian non-diabetic populations. Secondly, to our knowledge, we were the first to develop a non-invasive prediction model to predict HbA1c levels in the non-diabetic population.
The low explained variance and the moderate discriminative performance of the DIRECT-DETECT prediction model limit its use as a screening tool in clinical practice. Previous studies showed that additional information on blood lipid and glycaemic levels can improve the performance of a model [29]. In addition, our sensitivity analyses showed that adding baseline HbA1c levels to the prediction model, considerably improved model performance. Future research might therefore focus on developing a model including biomarkers that can predict change in HbA1c levels. However, the current prediction model can be used for purposes for which it was originally designed: as a first step in large databases where blood assays are not available, to select participants at risk of glycaemic deterioration for prevention or inclusion in clinical trials [5].
In conclusion, we found that non-invasive measurements—age, BMI, waist circumference, use of anti-hypertensive medication, current smoking and parental history of diabetes—were relevant predictors of HbA1c levels at follow-up both for men and women, although the explained variance and the discriminative performance of the model were moderate.
Author Contributions
- Conceptualization: SPR MWH ERP PWF FR JMD.
- Formal analysis: SPR HC.
- Investigation: HC ADMK GN CDS BT WR CM AP TdlHG CG OP JK ML JMD.
- Writing – original draft: SPR.
- Writing – review & editing: MWH ERP PWF FR HC ADMK GN CDS BT WR CM AP TdlHG CG OP JK ML JMD.
References
- 1. Gillies CL, Abrams KR, Lambert PC, Cooper NJ, Sutton AJ, Hsu RT, et al. Pharmacological and lifestyle interventions to prevent or delay type 2 diabetes in people with impaired glucose tolerance: systematic review and meta-analysis. BMJ 2007 Feb 8;334(7588):299. pmid:17237299
- 2. Tuomilehto J. Nonpharmacologic Therapy and Exercise in the Prevention of Type 2 Diabetes. Diabetes Care 2009 Nov 1;32(suppl 2):S189–S193.
- 3. Diabetes Prevention Program Research Group. 10-year follow-up of diabetes incidence and weight loss in the Diabetes Prevention Program Outcomes Study. The Lancet 2014;374(9702):1677–86.
- 4. Kengne AP, Beulens JW, Peelen LM, Moons KG, van der Schouw YT, Schulze MB, et al. Non-invasive risk scores for prediction of type 2 diabetes (EPIC-InterAct): a validation of existing models. Lancet Diabetes Endocrinol 2014 Jan;2(1):19–29. pmid:24622666
- 5. Koivula R, Heggie A, Barnett A, Cederberg H, Hansen T, Koopman A, et al. Discovery of biomarkers for glycaemic deterioration before and after the onset of type 2 diabetes: rationale and design of the epidemiological studies within the IMI DIRECT Consortium. Diabetologia 2014;57(6):1132–42. pmid:24695864
- 6. Lindström J, Tuomilehto J. The Diabetes Risk Score: A practical tool to predict type 2 diabetes risk. Diabetes Care 2003 Mar 1;26(3):725–31. pmid:12610029
- 7. Alssema M, Vistisen D, Heymans MW, Nijpels G, Glümer C, Zimmet PZ, et al. The Evaluation of Screening and Early Detection Strategies for Type 2 Diabetes and Impaired Glucose Tolerance (DETECT-2) update of the Finnish diabetes risk score for prediction of incident type 2 diabetes. Diabetologia 2011;54(5):1004–12. pmid:21153531
- 8. American Diabetes Association. Diagnosis and Classification of Diabetes Mellitus. Diabetes Care 2010 Jan 1;33(Supplement 1):S62–S69.
- 9. The International Expert Committee. International Expert Committee Report on the Role of the A1C Assay in the Diagnosis of Diabetes. Diabetes Care 2009 Jul 1;32(7):1327–34. pmid:19502545
- 10. van 't Riet E, Alssema M, Rijkelijkhuizen JM, Kostense PJ, Nijpels G, Dekker JM. Relationship between A1C and glucose levels in the general Dutch population: the new Hoorn study. Diabetes Care 2010 Jan;33(1):61–6. pmid:19808928
- 11. Rathmann W, Kowall B, Tamayo T, Giani G, Holle R, Thorand B, et al. Hemoglobin A1c and glucose criteria identify different subjects as having type 2 diabetes in middle-aged and older populations: the KORA S4/F4 Study. Ann Med 2012 Mar;44(2):170–7. pmid:21091229
- 12. Mooy JM, Grootenhuis PA, Vries Hd, Valkenburg HA, Bouter LM, Kostense PJ, et al. Prevalence and Determinants of Glucose Intolerance in a Dutch Caucasian Population: The Hoorn Study. Diabetes Care 1995 Sep 1;18(9):1270–3. pmid:8612442
- 13. Harder MN, Ribel-Madsen R, Justesen JM, Sparso T, Andersson EA, Grarup N, et al. Type 2 diabetes risk alleles near BCAR1 and in ANK1 associate with decreased beta-cell function whereas risk alleles near ANKRD55 and GRB14 associate with decreased insulin sensitivity in the Danish Inter99 cohort. J Clin Endocrinol Metab 2013 Apr;98(4):E801–E806. pmid:23457408
- 14. Rathmann W, Strassburger K, Heier M, Holle R, Thorand B, Giani G, et al. Incidence of Type 2 diabetes in the elderly German population and the effect of clinical and lifestyle risk factors: KORA S4/F4 cohort study. Diabet Med 2009 Dec;26(12):1212–9. pmid:20002472
- 15. De Vegt F. Relation of impaired fasting and postload glucose with incident type 2 diabetes in a dutch population: The hoorn study. JAMA 2001 Apr 25;285(16):2109–13. pmid:11311100
- 16. van 't Riet E, Rijkelijkhuizen JM, Alssema M, Nijpels G, Stehouwer CDA, Heine RJ, et al. HbA1c is an independent predictor of non-fatal cardiovascular disease in a Caucasian population without diabetes: a 10-year follow-up of the Hoorn Study. Eur J Prev Cardiol 2012 Feb;19(1):23–31.pmid:20517157
- 17. Engberg S, Vistisen D, Lau C, Glümer C, Jørgensen T, Pedersen O, et al. Progression to Impaired Glucose Regulation and Diabetes in the Population-Based Inter99 Study. Diabetes Care 2009 Apr 1;32(4):606–11. pmid:19114617
- 18. Soulimane S, Simon D, Shaw JE, Zimmet PZ, Vol S, Vistisen D, et al. Comparing incident diabetes as defined by fasting plasma glucose or by HbA(1c). The AusDiab, Inter99 and DESIR studies. Diabet Med 2011 Nov;28(11):1311–8. pmid:21824186
- 19. Bongaerts BWC, Rathmann W, Heier M, Kowall B, Herder C, Stöckl D, et al. Older Subjects With Diabetes and Prediabetes Are Frequently Unaware of Having Distal Sensorimotor Polyneuropathy: The KORA F4 Study. Diabetes Care 2013 May 1;36(5):1141–6. pmid:23275355
- 20. Klüppelholz B, Thorand B, Koenig W, de Las Heras Gala T, Meisinger C, Huth C, et al. Association of subclinical inflammation with deterioration of glycaemia before the diagnosis of type 2 diabetes: the KORA S4/F4 study. Diabetologia 2015 Oct;58(10):2269–77. pmid:26155746
- 21. American Diabetes Association. Diagnosis and Classification of Diabetes Mellitus. Diabetes Care 2014 Jan 1;37(Supplement 1):S81–S90.
- 22. Stancáková A, Javorsky M, Kuulasmaa T, Haffner SM, Kuusisto J, Laakso M. Changes in Insulin Sensitivity and Insulin Release in Relation to Glycemia and Glucose Tolerance in 6,414 Finnish Men. Diabetes 2009 May 1;58(5):1212–21. pmid:19223598
- 23. Fízel'ová M, Cederberg H, Stancáková A, Jauhiainen R, Vangipurapu J, Kuusisto J, et al. Markers of Tissue-Specific Insulin Resistance Predict the Worsening of Hyperglycemia, Incident Type 2 Diabetes and Cardiovascular Disease. PLoS One 2014 Oct 13;9(10):e109772. pmid:25310839
- 24. Cederberg H, Stancakova A, Yaluri N, Modi S, Kuusisto J, Laakso M. Increased risk of diabetes with statin treatment is associated with impaired insulin sensitivity and insulin secretion: a 6 year follow-up study of the METSIM cohort. Diabetologia 2015 May;58(5):1109–17. pmid:25754552
- 25. Sauerbrei W. The Use of Resampling Methods to Simplify Regression Models in Medical Statistics. Journal of the Royal Statistical Society: Series C (Applied Statistics) 1999 Jan 1;48(3):313–29.
- 26.
Steyerberg EW. Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating. New York: Springer; 2009.
- 27. Harrell FE Jr., Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996 Feb 28;15(4):361–87. pmid:8668867
- 28.
Harrell FE. Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis. Springer; 2001.
- 29. Schmidt MIs, Duncan BB, Bang H, Pankow JS, Ballantyne CM, Golden SH, et al. Identifying Individuals at High Risk for Diabetes: The Atherosclerosis Risk in Communities study. Diabetes Care 2005 Aug 1;28(8):2013–8. pmid:16043747
- 30. Kahn HS, Cheng YJ, Thompson TJ, Imperatore G, Gregg EW. Two risk-scoring systems for predicting incident diabetes mellitus in U.S. adults age 45 to 64 years. Ann Intern Med 2009 Jun 2;150(11):741–51. pmid:19487709
- 31. Chen L, Magliano DJ, Balkau B, Colagiuri S, Zimmet PZ, Tonkin AM, et al. AUSDRISK: an Australian Type 2 Diabetes Risk Assessment Tool based on demographic, lifestyle and simple anthropometric measures. Med J Aust 2010 Feb 15;192(4):197–202. pmid:20170456
- 32. Griffin SJ, Little PS, Hales CN, Kinmonth AL, Wareham NJ. Diabetes risk score: towards earlier detection of Type 2 diabetes in general practice. Diabetes Metab Res Rev 2000 May 1;16(3):164–71. pmid:10867715
- 33. Balkau B, Lange C, Fezeu L, Tichet J, de Lauzon-Guillain B, Czernichow S, et al. Predicting Diabetes: Clinical, Biological, and Genetic Approaches: Data from the Epidemiological Study on the Insulin Resistance Syndrome (DESIR). Diabetes Care 2008 Oct 1;31(10):2056–61. pmid:18689695
- 34. Rosella LC, Manuel DG, Burchill C, Stukel TrsA, for the PHIAT-DM team. A population-based risk algorithm for the development of diabetes: development and validation of the Diabetes Population Risk Tool (DPoRT). Journal of Epidemiology and Community Health 2011 Jul 1;65(7):613–20. pmid:20515896
- 35. Wilson PW, Meigs JB, Sullivan L, Fox CS, Nathan DM, D'Agostino RB Sr. Prediction of incident diabetes mellitus in middle-aged adults: the Framingham Offspring Study. Arch Intern Med 2007 May 28;167(10):1068–74. pmid:17533210
- 36. Rathmann W, Kowall B, Heier M, Herder C, Holle R, Thorand B, et al. Prediction models for incident Type 2 diabetes mellitus in the older population: KORA S4/F4 cohort study. Diabetic Medicine 2010 Oct 1;27(10):1116–23. pmid:20854378
- 37. Schulze MB, Hoffmann K, Boeing H, Linseisen J, Rohrmann S, M+Âhlig M, et al. An Accurate Risk Score Based on Anthropometric, Dietary, and Lifestyle Factors to Predict the Development of Type 2 Diabetes. Diabetes Care 2007 Mar 1;30(3):510–5. pmid:17327313
- 38. Hippisley-Cox J, Coupland C, Robson J, Sheikh A, Brindle P. Predicting risk of type 2 diabetes in England and Wales: prospective derivation and validation of QDScore. BMJ 2009 Mar 18;338.
- 39. Kirk JK, Passmore LV, Bell RA, Narayan KMV, D'Agostino RBJ, Arcury TA, et al. Disparities in A1C levels between Hispanic and non-Hispanic white adults with diabetes: a meta-analysis. Diabetes Care 2008 Feb;31(2):240–6. pmid:17977939
- 40. Kirk JK, D'Agostino RBJ, Bell RA, Passmore LV, Bonds DE, Karter AJ, et al. Disparities in HbA1c levels between African-American and non-Hispanic white adults with diabetes: a meta-analysis. Diabetes Care 2006 Sep;29(9):2130–6. pmid:16936167