|
 |
|
|||||||
|
|||||||||
DOI: 10.2337/dc06-1407
© 2007 by the American Diabetes Association
Emerging Treatments and Technologies |
The Accuracy of the FreeStyle Navigator Continuous Glucose Monitoring System in Children With Type 1 Diabetes
From the DirecNet Coordinating Center, Jaeb Center for Health Research, Tampa, Florida
Address correspondence and reprint requests to Darrell M. Wilson, MD, DirecNet Coordinating Center, Jaeb Center for Health Research, 15310 Amberly Dr., Suite 350, Tampa, FL 33647. E-mail: direcnet{at}jaeb.org
 |
ABSTRACT |
|---|
 TOP ABSTRACT INTRODUCTIONRESEARCH DESIGN AND METHODS--RESULTS--CONCLUSIONS--APPENDIXReferences |
|---|
OBJECTIVE—To evaluate the accuracy and precision of the FreeStyle Navigator continuous glucose monitoring system in children with type 1 diabetes.
RESEARCH DESIGN AND METHODS—In 30 children with type 1 diabetes (mean age 11.2 ± 4.1 years), the Navigator glucose values were compared with reference serum glucose values of blood samples obtained in an inpatient clinical research center and measured in a central laboratory using a hexokinase enzymatic method and in an outpatient setting with a FreeStyle meter. Median absolute difference (AD) and median relative absolute difference (RAD) were computed for sensor-reference and sensor-sensor pairs.
RESULTS—The median AD and RAD were 17 mg/dl and 12%, respectively, for 1,811 inpatient sensor-reference pairs and 20 mg/dl and 14%, respectively, for 8,639 outpatient pairs. The median RAD between two simultaneous Navigator measurements (n = 1,971) was 13%. Ninety-one percent of sensors in the inpatient setting and 81% of sensors in the outpatient setting had a median RAD 
20%.
CONCLUSIONS—The Navigator’s accuracy does not yet approach the accuracy of current-generation home glucose meters, but it is sufficient to believe that the device has the potential to be an important adjunct to treatment of youth with type 1 diabetes.
Abbreviations: AD, absolute difference • CGMS, continuous glucose monitoring system • CRC, clinical research center • ISO, International Organisation for Standardization • RAD, relative absolute difference
|
INTRODUCTION |
|---|
|
TOPABSTRACTINTRODUCTIONRESEARCH DESIGN AND METHODS--RESULTS--CONCLUSIONS--APPENDIXReferences |
|---|
Direct reading, near-continuous, minimally invasive glucose sensors hold great promise for improving the care of patients with diabetes and other abnormalities of glucose metabolism. These sensors can provide both a measure of the current glucose concentration as well as glucose trends, with alarms for high and low thresholds and predicted hypo- and hyperglycemia. With the recent demonstration that good glycemic control reduces mortality and morbidity in acutely ill nondiabetic patients (1,2), glucose sensors could have an even more expanded role outside the realm of diabetes.
A major issue in evaluating the utility of a real-time continuous glucose monitor is its accuracy across a wide range of glucose levels. Previously, we reported on the accuracy of the GlucoWatch G2 Biographer (Cygnus, Redwood City, CA) (3) and the continuous glucose monitoring system (CGMS; Medtronic Minimed, Northridge, CA) (4) in children with type 1 diabetes. The purpose of this article is to report on the accuracy of the FreeStyle Navigator CGMS in children.
|
RESEARCH DESIGN AND METHODS— |
|---|
|
TOPABSTRACTINTRODUCTIONRESEARCH DESIGN AND METHODS--RESULTS--CONCLUSIONS--APPENDIXReferences |
|---|
The study was conducted by the Diabetes Research in Children Network (DirecNet) at five clinical centers. A data and safety monitoring board and the institutional review boards at each center approved the study protocol, consent form, and assent form. A parent or guardian and each subject aged
7 years gave written consent and assent, respectively.
Eligible subjects were between 3 and 18 years old with a clinical diagnosis of type 1 diabetes of 1-year duration. Subjects initially used a Navigator that was blinded so that glucose values could not be seen for approximately 1 week at home. During this time, glucose levels were checked with the built-in FreeStyle blood glucose meter (FreeStyle meter) at least four times per day, including the three meter measurements during the first 24 h that were used for calibration of the Navigator.
Each subject was then hospitalized for 24 h in a clinical research center (CRC), where a second Navigator sensor was inserted. Venous blood samples for laboratory serum glucose concentration determinations were taken every 30 min during the hospitalization. Additional samples were taken every 20 min during a session in which subjects >7 years of age exercised on a treadmill for four 15-min sessions of moderate intensity interspersed with three 5-min rest periods (75 min total) and every 10 min following breakfast (during which time the breakfast insulin dose was delayed) for subjects whose age and weight permitted additional blood samples. Serum glucose concentrations from these samples were measured at the DirecNet Central Biochemistry Laboratory at the University of Minnesota using a hexokinase enzymatic method (5).
Following the CRC admission, the Navigator was used at home for 13 weeks. Subjects were instructed to use the Navigator continuously. During the first 2 weeks, subjects were to check the glucose level with the FreeStyle meter whenever the Navigator alarmed; thereafter, meter glucose checks were at the discretion of the subject and parent. Navigator and FreeStyle glucose data were downloaded weekly to the subject’s home computer and e-mailed to the study coordinating center.
Statistical methods
Accuracy analyses were performed separately for inpatient and outpatient Navigator use. For the inpatient analysis, accuracy was evaluated separately for the half-hour measurements and for the exercise and breakfast testing. Laboratory serum glucose values were used as the reference during the inpatient CRC visit, and FreeStyle glucose measurements (excluding those used to calibrate the Navigator) were used as the reference during home use. In a prior study, we found that the FreeStyle meter had a high degree of accuracy (6). Each reference glucose value was paired to the closest Navigator reading within ±5 min. The following were computed for each Navigator reference pair: difference (Navigator value minus reference value), absolute difference (AD; absolute value of difference), and relative absolute difference (RAD; AD divided by reference value, expressed as a percentage). The difference measure incorporates the direction of the error so that pairs with the sensor reading "high " cancel out pairs with the sensor reading "low." The median difference therefore evaluates whether there is any bias for the sensor to read systematically high or low. The AD and RAD values use the absolute value of the difference between the sensor value and the reference value, ignoring the direction of the error. These measures reflect the magnitude of the error without regard to whether the sensor value was higher or lower than the reference value. Each pair was also evaluated to determine whether the sensor value met the International Organisation for Standardization (ISO) criteria for home glucose meters (for reference glucose value 75 mg/dl, meter value within ±15 mg/dl and for reference glucose value >75 mg/dl, meter value within ±20%, hereafter referred to as the ISO criteria) (7). Summary statistics (e.g., median and percentages) were calculated by pooling all paired values. Median values were reported instead of means because of the skewed distribution. The bootstrap technique (resampling subjects with replacement) (8) was used to account for the within-subject correlation in the statistical comparisons and calculation of CIs.
Since point-to-point measures of accuracy do not capture the temporal dimension of near-continuous data, we supplemented these with "event-based" analyses. The glucose excursion during the exercise session (drop from baseline to nadir) for the laboratory reference values and the Navigator were compared. The Navigator nadir glucose was defined as the lowest glucose value from baseline until 30 min following the laboratory nadir (to allow for a possible lag). The rate of change was defined from baseline until the nadir. An analogous analysis was not performed for the postbreakfast period because many subjects still had not reached their peak glucose when reference sampling was stopped 1 h after breakfast.
|
RESULTS— |
|---|
|
TOPABSTRACTINTRODUCTIONRESEARCH DESIGN AND METHODS--RESULTS--CONCLUSIONS--APPENDIXReferences |
|---|
The average age of the 30 subjects was 11.2 ± 4.1 years (range 4–17), 40% were female, and 93% were Caucasian, 3% Hispanic, and 3% Asian. The mean duration of diabetes was 5.8 ± 3.0 years, and the mean A1C was 7.1 ± 0.6%.
Inpatient accuracy assessment
During the CRC admission, there were 1,811 half-hour laboratory glucose measurements paired with glucose measurements from 58 Navigator sensors (not including the exercise session or the postbreakfast assessment). The median number of paired values per subject was 66 (interquartile range 53–69) ranging from 25 to 79. As shown in Table 1, there was no tendency for the Navigator to read systematically higher or lower than the reference glucose (median difference –2 mg/dl [95% CI –7 to +5]; P = 0.34). Overall, the median AD was 17 mg/dl (interquartile range 8–31; 90th percentile, 53 mg/dl), and the median RAD was 12% (6–21%; 90th percentile, 33%), with 74% of sensor values meeting ISO home glucose meter criteria. When the reference glucose was 70 mg/dl, the median absolute difference was 14 mg/dl (8–22; 90th percentile, 44 mg/dl). When the reference glucose was 71–180 mg/dl, the median RAD was 13% (6–22%; 90th percentile, 36%). When the reference glucose was >180 mg/dl, the median RAD was 10% (5–18%; 90th percentile, 25%). As would be expected, the AD was greater at higher glucose levels and the RAD was greater at lower glucose levels. Accuracy measures improved slightly when incorporating a 10-min sensor lag (P < 0.001; Table 1). Among the 53 sensors with at least 10 navigator reference pairs, 19 (36%) had a median RAD 10%, 23 (43%) a median RAD of 10.1–15%, 6 (11%) a median RAD of 15.1–20%, and 5 (9%) a median RAD of >20%.
|
Before starting exercise, the median Navigator glucose concentration was 161 mg/dl (interquartile range 118–220) and median reference glucose concentration was 172 mg/dl (122–239). As shown in Fig. 1A, the Navigator accurately measured the magnitude of glucose falls during exercise. The median fall in reference glucose was 91 mg/dl (51–129), and the median absolute difference in this fall between the Navigator and reference was 16 mg/dl (8–29). Although the drop in glucose was generally well tracked by the Navigator, the sensor glucose values lagged behind the reference values causing the Navigator to underestimate the rate of change, particularly in subjects with a rapid fall in glucose during exercise (Fig. 1B). The median time to the nadir was 100 min for the Navigator and 78 min for the reference (Table 2). The reference glucose fell to
70 mg/dl during exercise for four subjects (lab values 56, 60, 68, and 70 mg/dl) with corresponding sensor glucose nadirs of 70, 146, 71, and 62 mg/dl, respectively. The sensor with the glucose nadir of 146 mg/dl tracked the drop in the glucose level during exercise, but it provided erroneously high glucose readings throughout. Point-to-point accuracy showed a median (25th–75th percentiles) RAD of 17% (9–27) during exercise (Table 1), which improved to 11% (7–22) when a 10-min lag was assumed.
|
|
Outpatient accuracy assessment
At home, subjects averaged 137 ± 30 h of Navigator use per week. Excluding calibration values, there were 8,639 paired sensor–FreeStyle meter values from 607 Navigator sensors. As shown in Table 1, the outpatient accuracy results were similar to the inpatient results. Among the 347 sensors with at least 10 navigator reference paired values, 68 (20%) had a median RAD
10%, 115 (33%) a median RAD of 10.1–15%, 99 (29%) a median RAD of 15.1–20%, and 65 (19%) a median RAD of >20%.
Factors affecting accuracy
Accuracy was fairly consistent over 5 days of use in both the inpatient and outpatient settings. Accuracy did not substantially vary according to insertion site (location data only available in inpatient setting) or sex (Table 1). After adjustment for glucose level, accuracy was significantly better at night for both inpatient (RAD P < 0.001; ISO P = 0.002) and outpatient (RAD and ISO P < 0.001) settings. Accuracy was also significantly better for children 14–18 years of age during home use (RAD P = 0.005; ISO P = 0.01) but was not impacted by age during the inpatient visit (RAD P = 0.28; ISO P = 0.16).
Precision
During the CRC admission, subjects simultaneously used two Navigator sensors resulting in 1,971 Navigator-Navigator pairs. The median (25th–75th percentiles) RAD between two simultaneous (within ±5 min) Navigator measurements was 13% (interquartile range 6–21), 15% for values 70 mg/dl (average of the two Navigator values), 13% for values 71–180 mg/dl, and 13% for values >180 mg/dl.
|
CONCLUSIONS— |
|---|
|
TOPABSTRACTINTRODUCTIONRESEARCH DESIGN AND METHODS--RESULTS--CONCLUSIONS--APPENDIXReferences |
|---|
We found that the overall RAD between Navigator measurements of interstitial glucose concentrations and reference serum glucose levels was similar during inpatient and outpatient assessments with median values of 12 and 14%, respectively. The AD was greater at higher glucose levels, and the RAD was greater at lower glucose levels.
In previous studies, we evaluated the accuracy of the GlucoWatch and CGMS during inpatient use. The median RAD with the GlucoWatch was 16 and 60% of values meeting ISO criteria (3). With the CGMS, the median RAD was 19% with the original sensor and 11% with a newer modified sensor; 53 and 72% of values, respectively, met ISO criteria (4). It is particularly noteworthy that the Navigator, which gives values in real time, was as accurate as the CGMS, which calculates values retrospectively. All other things being equal, retrospective analysis of sensor data generally enhances accuracy, since there are a larger number of meter values to use for calibration than with rolling, real-time calibration algorithms. Studies of other real-time sensors in adults reported a median RAD of 17% during outpatient use for the Guardian real-time CGMS (Medtronic Minimed) (9) and 16% (inpatient and outpatient data pooled) (10) to 20% (inpatient and outpatient data pooled) (11) for the DexCom STS CGMS (DexCom, San Diego, CA).
The Navigator system tracked the drop in blood glucose induced by exercise well, especially with respect to the magnitude of fall in glucose concentration. However, sensor glucose levels lagged behind the blood glucose levels, causing the device to underestimate the true rate of fall in glucose during exercise in some subjects. Navigator readings were as accurate on the 5th day of use as they were on the 1st day. Exploratory analyses within subgroups controlling for the reference glucose concentration found that the Navigator was more accurate at night than during the day. In past studies, we and others (4,12,13) observed that the CGMS, in contrast, was less accurate during the night than during the day, leading to overestimation of the frequency of nocturnal hypoglycemia. This might be due to the potential for biofouling to occur when there is decreased movement or to changes in the subcutaneous circulation or oxygen availability overnight. The Navigator does not appear to have the same susceptibility to low glucose readings overnight, which could be due to differences in the sensor chemistry (the Navigator is less oxygen dependent) or to difference in the biocompatibility or diffusion characteristics of the membranes coating the sensor. During the day, a large number of glucose values were obtained when there were rapid rates of change of the blood glucose, which makes point-to-point comparisons less accurate because of the physiologic lag between interstitial and blood glucose levels. At night there was a much slower rate of change of blood glucose levels, which allowed the interstitial glucose levels to be equilibrated with blood glucose levels at the time the point-to-point comparisons were determined.
The Navigator’s accuracy does not yet approach the accuracy of current-generation home glucose meters but is sufficient to believe that the device has the potential to be an important adjunct to treatment of youth with type 1 diabetes. Clinical trials are needed, however, to truly demonstrate the clinical utility of the Navigator as well as other glucose sensors.
|
APPENDIX |
|---|
|
TOPABSTRACTINTRODUCTIONRESEARCH DESIGN AND METHODS--RESULTS--CONCLUSIONS--APPENDIXReferences |
|---|
The DirecNet Study Group
Clinical centers.
(Listed in alphabetical order with clinical center name, city, and state. Personnel are listed as principal investigator [PI], coinvestigator [I], and coordinators [C].) 1) The Barbara Davis Center for Childhood Diabetes, University of Colorado, Denver, CO: P.C. (PI), Rosanna Fiallo-Scharer (I), Laurel Messer (C), and Barbara Tallant (C); 2) The Department of Pediatrics, University of Iowa Carver College of Medicine, Iowa City, IA: E.T. (PI), Michael J. Tansey (I), Linda F. Larson (C), Julie Coffey (C), and Joanne Cabbage (C); 3) Nemours Children’s Clinic, Jacksonville, FL: Tim Wysocki (PI), Nelly Mauras (I), Larry A. Fox (I), Keisha Bird (C), and Kim Englert (C); 4) The Division of Pediatric Endocrinology and Diabetes, Stanford University, Stanford, CA: Bruce A. Buckingham (PI), D.M.W. (I), Jennifer M. Block (C), Paula Clinton (C), and Kimberly Caswell; 5) The Department of Pediatrics, Yale University School of Medicine, New Haven, CT: S.A.W. (PI), W.V.T. (I), Elizabeth A. Doyle (C), Heather Mokotoff (C), and Amy Steffen (C).
Coordinating center.
Jaeb Center for Health Research, Tampa, FL: R.W.B., K.J.R., C.K., Dongyuan Xing, M.J.D., Cynthia R. Stockdale, and Judy Jackson.
University of Minnesota Central Laboratory.
Michael W. Steffes, Jean M. Bucksa, Maren L. Nowicki, Carol A. Van Hale, and Vicky Makky.
National Institutes of Health.
Gilman D. Grave, Mary Horlick, Karen Teff, and Karen K. Winer.
Data and Safety Monitoring Board.
Dorothy M. Becker, Patricia Cleary, Christopher M. Ryan, Neil H. White, and Perrin C. White.
|
Acknowledgments |
|---|
This research was supported by the following National Institutes of Health/National Institute of Child Health and Human Development Grants: HD041919-01, HD041915-01, HD041890, HD041918-01, HD041908-01, and HD041906-01. Clinical centers also received funding through the following General Clinical Research Center Grants: M01 RR00069, RR00059, RR 06022, and RR00070-41. Abbott Diabetes Care, Alameda, California, provided the FreeStyle Navigator CGMS and the FreeStyle blood glucose meter test strips.
Appreciation is expressed for the work performed by the CRC Nurses at the five clinical centers.
|
Footnotes |
|---|
A table elsewhere in this issue shows conventional and Système International (SI) units and conversion factors for many substances.
The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked "advertisement" in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.
Received for publication July 5, 2006. Accepted for publication September 23, 2006.
|
References |
|---|
|
TOPABSTRACTINTRODUCTIONRESEARCH DESIGN AND METHODS--RESULTS--CONCLUSIONS--APPENDIXReferences |
|---|
- Van den Berghe G, Wilmer A, Hermans G, Meersseman W, Wouters PJ, Milants I, Van Wijngaerden E, Bobbaers H, Bouillon R: Intensive insulin therapy in the medical ICU. N Engl J Med 354:449–461, 2006
[Abstract/Free Full Text] - Van den Berghe G, Wouters P, Weekers F, Verwaest C, Bruyninckx F, Schetz M, Vlasselaers D, Ferdinande P, Lauwers P, Bouillon R: Intensive insulin therapy in critically ill patients. N Engl J Med 345:1359–1367, 2001
[Abstract/Free Full Text] - Diabetes Research in Children Network (DirecNet) Study Group: The accuracy of the GlucoWatch G2 Biographer in children with type 1 diabetes: results of the Diabetes Research in Children Network (DirecNet) accuracy study. Diabetes Technol Ther 5:791–800, 2003[Medline]
- Diabetes Research in Children Network (DirecNet) Study Group: The accuracy of the CGMS in children with type 1 diabetes: results of the Diabetes Research in Children Network (DirecNet) accuracy study. Diabetes Technol Ther 5:781–789, 2003[Medline]
- Passey RB, Gillum RL, Fuller JB, Urry FM, Giles ML: Evaluation and comparison of 10 glucose methods and the reference method recommended in the proposed product class standard: 1974. Clin Chem 23:131–139, 1977
[Free Full Text] - Diabetes Research in Children Network (DirecNet) Study Group: Accuracy of newer-generation home blood glucose meters in a Diabetes Research in Children Network (DirecNet) inpatient exercise study. Diabetes Technol Ther 7:675–680, 2005[Medline]
- International Organisation for Standardization: In Vitro Diagnostic Test Systems: Requirements for Blood-Glucose Monitoring Systems for Self-Testing in Managing Diabetes Mellitus. Geneva, ISO, 2003 (no. 15197)
- Efron B, Tibshirani R: An Introduction to the Bootstrap. New York, Chapman & Hall, 1993
- Bode B, Gross K, Rikalo N, Schwartz S, Wahl T, Page C, Gross T, Mastrototaro J: Alarms based on real-time sensor glucose values alert patients to hypo- and hyperglycemia: the Guardian Continuous Monitoring System. Diabetes Technol Ther 6:105–113, 2004[Medline]
- Garg S, Zisser H, Schwartz S, Bailey T, Kaplan R, Ellis S, Jovanovic L: Improvement in glycemic excursions with a transcutaneous, real-time continuous glucose sensor. Diabetes Care 29:44–50, 2006
[Abstract/Free Full Text] - DexCom: DexCom STS Continuous Glucose Monitoring System User’s Guide. San Diego, CA, DexCom, 2006, p. 86–102
- Diabetes Research in Children Network (DirecNet) Study Group: Evaluation of factors affecting CGMS calibration. Diabetes Technol Ther 8:318–325, 2006[Medline]
- McGowan K, Thomas W, Moran A: Spurious reporting of nocturnal hypoglycemia by CGMS in patients with tightly controlled type 1 diabetes. Diabetes Care 25:1499–1503, 2002
[Abstract/Free Full Text] - Centers for Disease Control and Prevention: National Health and Nutrition Examination Survey: BMI-for-age charts, 2 to 20 years, LMS parameters and selected smoothed BMI percentiles, by sex and age, 2000 [article online]. Available at http://www.cdc.gov/nchs/about/major/nhanes/growthcharts/datafiles.htm. Accessed 21 February 2003
CiteULike 
Del.icio.us 
Digg 
Reddit 
Technorati What's this?
This article has been cited by other articles:
|
|
 |
|
  The Juvenile Diabetes Research Foundation Continuo Continuous Glucose Monitoring and Intensive Treatment of Type 1 Diabetes N. Engl. J. Med., October 2, 2008; 359(14): 1464 - 1476. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. A. Weinzimer, G. M. Steil, K. L. Swan, J. Dziura, N. Kurtz, and W. V. Tamborlane Fully Automated Closed-Loop Insulin Delivery Versus Semiautomated Hybrid Control in Pediatric Patients With Type 1 Diabetes Using an Artificial Pancreas Diabetes Care, May 1, 2008; 31(5): 934 - 939. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
E. Dassau, B. W. Bequette, B. A. Buckingham, and F. J. Doyle III Detection of a Meal Using Continuous Glucose Monitoring: Implications for an artificial {beta}-cell Diabetes Care, February 1, 2008; 31(2): 295 - 300. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Z. T. Bloomgarden Type 1 Diabetes and Glucose Monitoring Diabetes Care, November 1, 2007; 30(11): 2965 - 2971. [Full Text] [PDF]
|
|
|
|
 |
|
 Continuous Glucose Monitoring Obstet. Gynecol., July 1, 2007; 110(1): 175 - 177. [Full Text] [PDF]
|
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Diabetes | Diabetes Care | Clinical Diabetes | Diabetes Spectrum |