DOI: 10.2337/dc05-1911 © 2006 by the American Diabetes Association
Derivation and Validation of a Prediction Score for Major Coronary Heart Disease Events in a U.K. Type 2 Diabetic Population
1 Tayside Centre for General Practice, Health Informatics Centre, Community Health Sciences, University of Dundee, Dundee, U.K. Address correspondence and reprint requests to Dr. Peter T. Donnan, University of Dundee, Tayside Centre for General Practice, Health Informatics Centre, Community Health Sciences, Mckenzie Building, Dundee DD2 4BF, U.K. E-mail: p.t.donnan{at}chs.dundee.ac.uk
OBJECTIVETo derive and validate an absolute risk algorithm for major coronary heart disease (CHD) events in the U.K. population with type 2 diabetes. RESEARCH DESIGN AND METHODSA population cohort with type 2 diabetes was constructed in Tayside, Scotland, U.K., and longitudinally followed-up to June 2004. Participants were all people with type 2 diabetes registered with general practices and the Diabetes Audit and Research in Tayside, Scotland, database (97% sensitive) with no previous CHD event and with complete measurements (n = 4,569). The main outcome measure was risk of CHD defined as fatal or nonfatal myocardial infarction or CHD death, derived from the Weibull accelerated failure-time model. Validation of the algorithm was performed on an independent dataset from Salford, England, U.K. RESULTSThere were a total of 243 subjects (5.3%) with a fatal or nonfatal myocardial infarction or CHD death over the follow-up period from 1 January 1995 to 30 June 2004 (maximum follow-up 9.5 years). The final Weibull model included the significant predictors of age at diagnosis, duration of diabetes, HbA1c, smoking (current, past, never), sex, systolic blood pressure, treated hypertension, total cholesterol, and height. Assessment of discrimination and calibration in the Salford validation dataset demonstrated a good fit (c = 0.71 [95% CI 0.630.79]). CONCLUSIONSThis study provides the first validated, population-derived model for prediction of absolute risk of CHD in people with type 2 diabetes. It provides a useful additional decision aid for the clinician treating type 2 diabetes by indicating appropriate early action to decrease the risk of adverse outcomes.
Abbreviations: AMI, acute myocardial infarction CHD, coronary heart disease DARTS, Diabetes Audit and Research in Tayside, Scotland DIS, Salford Diabetes Information System SBP, systolic blood pressure UKPDS, U.K. Prospective Diabetes Study
Patients with type 2 diabetes have a significantly increased risk of developing coronary heart disease (CHD), in part due to the clustering of numerous risk factors including hypertension and dyslipidemia (1,2). In diabetic individuals with no previous history, the risk of developing an acute myocardial infarction (AMI) may be equivalent to that of a nondiabetic individual with a previous event (3). Following AMI, diabetic patients are more likely to develop cardiac failure and cardiogenic shock, resulting in a greater short- and long-term mortality (4). The primary and secondary prevention of CHD in patients with diabetes is therefore key to successful diabetes management. There is convincing evidence that blood pressureand cholesterol-lowering treatment is effective for both the primary and secondary prevention of CHD (1,5,6), and recent large primary prevention studies including the Heart Protection Study have demonstrated that treatment with statins was also effective and safe for diabetic patients at high risk of vascular events (7). In the Hypertension Optimal Treatment study (8), aspirin was shown to lower risk of cardiovascular events by lowering blood pressure, and aspirin therapy has also been endorsed by the American Diabetes Association for high-risk patients (9).
A recent review (10) suggested that separate management guidelines for blood pressure and blood cholesterol should be replaced by integrated cardiovascular risk management and the routine use of absolute cardiovascular risk prediction scores. However, the use of algorithms that estimate the risk of cardiovascular disease in the important subgroup of people with diabetes is controversial (11). Most risk equations are based on the Framingham Study, which only included 337 people with diabetes in their cohort of Most U.K. and European recommendations on the primary prevention of CHD in the general population (16) have based a decision on treatment with lipid-lowering therapy upon an estimate of the absolute risk from Framingham data (13). For secondary prevention, it is recommended that total cholesterol concentrations should be <5.0 mmol/l in individuals aged <75 years with documented vascular disease (1618).
In light of the excess CHD risk in people with diabetes, there is a need for a robust algorithm that reliably estimates the risk of CHD for individuals in the population with type 2 diabetes. A previous risk equation derived from the U.K. Prospective Diabetes Study (UKPDS) attempted to provide this (18). However, this risk equation was derived from a randomized, controlled trial sample with age restrictions and exclusions for comorbidity. The authors also acknowledged selection bias and did not recommend its use for predictions of <4 years or for people aged >65 years (19), thereby excluding
The study population consisted of all subjects with a diagnosis of type 2 diabetes residing in Tayside, Scotland (population 400,000), and registered with a Tayside general practice from 1 January 1995 to 30 June 2004. Ascertainment of type 2 diabetes was achieved through the Diabetes Audit and Research in Tayside, Scotland (DARTS), database, which has been described in detail elsewhere (20). In brief, record linkage of multiple data sources has been used to create a web-based regional diabetes information system for all residents in Tayside. The sensitivity and positive predictive value of DARTS are both 97% for ascertainment of diagnosis of diabetes (20). For the purpose of this study, subjects with type 2 diabetes were defined as those of any age treated with diet or oral hypoglycemic agents or those aged >35 years at diagnosis. Approximately 15% of those with type 2 diabetes in the database are treated with insulin, while <1% were of nonwhite origin.
Baseline measurements
Exclusions
Outcome
Validation dataset
Statistical methods Factors for potential inclusion in the model were initially considered with univariate significance of P < 0.20 and/or judged to be of clinical importance. In fitting the regression model, the main factors used in the Framingham prediction equations, namely age; sex; smoking; SBP; and total, LDL, and HDL cholesterol, were simultaneously assessed in the model (13). In addition, the potential predictors of duration of diabetes (or time from diagnosis), age at diagnosis, A1C, BMI, triglycerides, and height were also added, if P was <0.05 or of clinical importance. Tests for interactions between risk factors were performed at the P < 0.05 level of significance. Finally, rejected variables were added again to the final model to confirm that they were not statistically significant, clinically important, or potential confounders. Treatment for hypertension was recorded in the DARTS database, and this was also assessed as a risk factor. The assumption of proportional hazards was assessed by plotting the log-negative-log plot for individual factors, fitting time-dependent variables, and by trend tests using the Schonfeld residuals (25). The estimated probabilities of CHD were obtained from the final model with 95% CIs using the delta method (26).
Model performance
A total of 4,569 individuals with type 2 diabetes were included, after exclusion of those with previous cardiovascular events and/or with incomplete measurements. Table 1 shows the characteristics of the study population. The study population consisted of 52.6% men and 47.4% women, with a mean ± SD age at baseline of 59.5 ± 12.1 years. Those individuals with type 2 diabetes who were excluded from the study were on average older (mean age 65 vs. 55 years), but their clinical measurements were very similar to the study population. For example, in Table 1, mean A1C is 8.0 vs. 7.9%, SBP 144 vs. 145 mmHg, and total cholesterol 5.4 vs. 5.5 mmol/l.
There were a total of 18,831 person-years of follow-up in the study. A total of 243 subjects (5.3%) suffered a fatal or nonfatal AMI or CHD death over the maximum follow-up period from 1 January 1995 to 30 June 2004 (median 4.1 years [range 9.5]). In the standard Weibull model, longer duration of diabetes was highly significantly associated with increased risk of CHD, along with and independently of age at diagnosis (Table 2). Men had significantly greater risk of CHD compared with women. High cholesterol and high SBP were also strongly associated with increased risk. There was a significant interaction between SBP and treated hypertension with higher risk of CHD in untreated patients with high SBP. Current smoking was significantly associated with increased risk, while ex-smokers had a higher risk compared with nonsmokers but lower than current smokers. A1C as a log-transformed factor was associated with increased risk. Shorter stature was univariately associated with increased risk, while BMI, triglycerides, and HDL cholesterol showed no significant univariate association.
All variables, where univariately P < 0.2, were considered for entry in a multivariate model. The test for slope of the time-varying coefficient was significant for A1C, indicating nonproportional hazards for this factor. The nonproportional hazards Weibull model was applied with one additional parameter, but the improvement in fit over the standard Weibull model was not significant (likelihood ratio test, P = 0.054). The hazard plots for A1C were approximately proportional in the first 5 years. Consequently, a final model with interactions of a binary indicator for <5 years of follow-up (yes/no) with log-transformed A1C was added, which significantly improved the goodness of fit (Table 2). As an example of the calculation of risk, consider a male current smoker, with 6 years duration of diabetes and diagnosis at the age of 59 years, SBP 160 mmHg with no treatment, total cholesterol 5.8 mmol/l, A1C 8%, and height 1.7 m, giving a 5-year risk of a CHD event of 54% (95% CI 4267).
The discriminatory power for the prediction algorithm on the Tayside data were c = 0.71 (95% CI 0.630.79). When the Tayside algorithm was applied to the Salford data, discrimination was still good with c = 0.69 (0.580.78). When the differences between the regression coefficients for the Tayside algorithm and the regression coefficients when applied to the Salford data were tested, there was only one factor that showed a difference. The difference for the log of duration of diabetes reached statistical significance (P = 0.04), although if significance levels were adjusted for multiple testing this would not be considered significant. When nine design variables for the deciles of predicted risk based on the Tayside algorithm were added to the model when applied to the validation dataset, the partial likelihood test gave G = 7.94 (
This study provides the first population-derived model for prediction of risk of major CHD events in people with type 2 diabetes who are initially free of cardiovascular disease and validated on an independent dataset. The estimates are based on routine measurements of known risk factors for CHD, along with glycemic control and duration of diabetes, which are specific to type 2 diabetes. These factors were also found to be important in the UKPDS algorithm (19). The model also included height, which is consistent with the Prospective Cardiovascular Munster Study algorithm (12). The estimates are easily calculated from the Weibull accelerated failure time model compared with the Cox proportional hazards model (28). This model not only allows the estimation of survival probabilities and event rates for health service planning, and clinical trial design, but also allows the prediction of risk in individual patients to guide decision making on the use of cholesterol and blood pressurelowering drugs. The recent British Hypertension Society guidelines (29) for patients with type 2 diabetes and hypertension and American College of Physicians guidelines (30) for those with cardiovascular risk factors apply fairly blanket criteria for selection of statins, while an estimate of absolute risk of CHD allows a more focused guide to selection of lipid-lowering therapy. Before this study, most CHD predictions relied on the Framingham cohort containing only 337 people with diabetes (1113), which only has a single indicator for the presence of diabetes. Several studies (13) have indicated a greater risk of CHD and long-term mortality in people with diabetes. The Framingham equations also lack diabetes-specific factors such as A1C and duration of diabetes, which have been shown to be associated with risk of CHD (19). Validation studies (3133) of the Framingham equations have yielded mixed results. Recently, a diabetes-specific equation was derived from a sample enrolled in the UKPDS randomized controlled trial, and they also found that A1C and duration of diabetes were important predictors of risk (19). However, the subjects in this study differed from the Tayside diabetic population cohort in a number of important ways. First, the mean age was 52 years compared with a mean age of 61 years in this study. Second, 60% of subjects in the UKPDS study were male compared with 52% male subjects in our population, the latter figure being more consistent with that found in diabetic populationbased registers in the U.K. Third, baseline levels of A1C, blood pressure, and cholesterol were all higher in our population. Finally, perhaps the most important difference relates to the observed mortality. During the first 4 years of the UKPDS, the standardized mortality ratio was less than that observed in the general population at 0.94 and 0.96 for male and female subjects, respectively, possibly because patients with life-threatening illnesses were excluded from the study. This led to the UKPDS risk engine excluding individuals with <4 years follow-up as well as those aged >65 years, giving an equation conditional on surviving 4 years initially. In contrast, no one was excluded from the Tayside population cohort due to comorbidity, and all ages were included. Consequently, this algorithm can be applied to all patients with type 2 diabetes who are typical of patients seen in clinics throughout the U.K. A1C is an important clinical measurement of glycemic control, which is generally available and which previously has been demonstrated an association of poor control with adverse outcomes (19). In addition, the interaction with time clearly demonstrates increased risk associated with poorer control, especially in the following 5 years, but it is clear in a population where A1C is being monitored that if a patient with poor glycemic control survives 5 years, baseline A1C is not a good predictor over the long term. However, from a patient and clinical perspective, 5-year predictions would be extremely useful. There is some evidence that patients with diabetes find difficulties in relating current behavior and medication with what are seen as possible events in the far future (34). Clearly, the communication of risk to influence behavior is also important (35). Strength of the Tayside cohort is the relatively long follow-up period with a maximum of 9.5 years with good ascertainment of events. All prognostic equations may suffer from overfitting to the data from which they were derived and hence need to be validated on different populations (31). The algorithm had good discrimination; that is, the probability that the model gives a high risk to those who develop CHD in 5 years compared with those who do not was 0.71. For comparative purposes, the Framingham equation gave a discrimination of c = 0.79 (31). In addition, the algorithm derived in the Tayside population transported well to an independent population in Salford, England, with good calibration (36). A limitation of our study is that we did not include nonmajor coronary events such as angina. However, we concentrated on major coronary events for consistency with previous studies and for ease of transportability (19,37). In conclusion, this study provides for the first time a type 2 diabetesspecific risk validated equation for CHD derived from an unselected population. It provides a useful tool for the clinician faced with the increasing prevalence of a chronic condition (38) associated with the high risk of CHD. It will aid decision making to provide early appropriate action to decrease the risk of adverse outcomes as well as aid health service planning and design of clinical trials.
This study was supported by a research grant from Diabetes UK and Pfizer UK. We thank Douglas Boyle, who set up the DARTS database, and data facilitators Ritchie MacAlpine, Janice Broomhall, and Karen Hunter.
J.P.N. has received honoraria and grant/research support from Pfizer. A table elsewhere in this issue shows conventional and Système International (SI) units and conversion factors for many substances. The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked "advertisement" in accordance with 18 U.S.C. Section 1734 solely to indicate this fact. Received for publication October 7, 2005. Accepted for publication February 21, 2006.
This article has been cited by other articles:
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||