https://orcid.org/0000-0002-7538-2205
Figures
Abstract
Context
Diabetic retinopathy (DR) is the leading cause of incident blindness among working-age adults in the United States. Federally designated safety-net clinics (FDSC) often serve as point-of-contact for patients least likely to receive recommended DR screenings, creating opportunity for targeted interventions to increase screening access and compliance.
Study design and methods
With such a goal, we implemented and assessed the longitudinal performance of an FDSC-based telemedicine DR screening (TDRS) network of 22 clinical sites providing nonmydriatic fundus photography with remote interpretation and reporting. Retrospective analysis of patient encounters between February 2014 and January 2019 was performed to assess rates of pathology and referral. A generalized estimating equation logistic regression model was used for subset analysis from audits of pre- and post-implementation screening rates. Finally, patient surveys were conducted and assessed as a measure of intervention acceptability.
Results
Of the 13,923 individual telescreening encounters (4327 female, 4220 male, and 5376 unspecified; mean [SD] age, 54.9 [12.5] years) studied, 10,540 were of adequate quality to identify 3532 (33.5%) patients with ocular pathology: 2319 (22.0%) patients had some level of DR with 1604 (15.2%) requiring specialist referral, and 808 (7.7%) patients required referral for other ocular pathologies. The mean screening rate for audited clinics in the year prior to program implementation was 29.9% (641/2147), which increased to 47.7% (1012/2124) in the program’s first year, doubling patients’ odds of being screened (OR 2.2; 95% CI: 1.3–3.7; P = .003). These gains were sustained over four years following implementation (OR 1.9; 95% CI: 1.1–3.1; P = .018) despite varied clinic screening performance (4-year averaged range, 22.9–55.1%). Odds of early detection likewise doubled for patients with consecutive screenings (OR 2.2, 95% CI: 2.0–2.4; P < .001). Finally, surveyed patients preferred TDRS to specialist exams (82.5%; 776/941) and would recommend the service to friends (92.7%; 868/936).
Conclusion and relevance
A statewide, FDSC-centered TDRS network was successfully established and sustained in a medically underserved region of the United States. Our results suggest that large TDRS networks in FDSCs can increase screening access and compliance for otherwise unscreened populations, but outcomes can vary greatly among clinics. Further work to optimize program implementation is needed to maximize this model’s impact.
Citation: Bastos de Carvalho A, Ware SL, Lei F, Bush HM, Sprang R, Higgins EB (2020) Implementation and sustainment of a statewide telemedicine diabetic retinopathy screening network for federally designated safety-net clinics. PLoS ONE 15(11): e0241767. https://doi.org/10.1371/journal.pone.0241767
Editor: Jim P. Stimpson, Drexel University School of Public Health, UNITED STATES
Received: August 12, 2020; Accepted: October 20, 2020; Published: November 4, 2020
Copyright: © 2020 Bastos de Carvalho et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data has been scrubbed of identifiers and presented in anonymized form within the manuscript and its Supporting information files.
Funding: The Health Resources and Services Administration (https://www.hrsa.gov/) supported RRS, EBH with grant number H2ARH260330304. The National Center for Advancing Translational Sciences (https://ncats.nih.gov/) supported ABC, FL, HMB with grant number UL1TR001998. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Diabetic retinopathy (DR), a common microvascular complication of diabetes mellitus, is the leading cause of incident blindness among working-age adults [1]. Annual DR screening with early intervention can reduce the risk of severe DR-related vision loss by 90% [2–7] and is recommended by the American Academy of Ophthalmology for all diabetic patients [8]. Yet DR screening rates in the US remain low [9,10], especially among vulnerable populations [11–14]. These missed opportunities for secondary prevention decrease productivity [15], increase morbidity [16,17], and increase healthcare expenditures [18,19]. With effective treatments for DR available, the more intractable challenge has been consistent screening for early identification of those requiring closer monitoring or therapeutic intervention.
An estimated 88% of diabetic patients in the US visit their primary care provider (PCP) at least once per year [20], creating a consistent point of contact for leveraging nonmydriatic fundus photography (nFP) and cloud-based telemedicine to provide DR screenings embedded in the primary care setting [21]. Telemedicine DR screening (TDRS) may mitigate several of the known barriers to conventional DR exams, including socioeconomic factors [22–24], geographic and logistic obstacles [22,25], lack of motivation [22,25], absence of PCP referral [22,26], inconveniences associated with pupil dilation [27], and specialist availability [24,25]. Images taken in the primary care setting during provision of routine care can be uploaded to remote specialists for interpretation and as-needed referral. This evidence-based intervention (EBI) [28] has high sensitivity and specificity,[29,30] making it clinically comparable to the criterion standard for DR screening (in-person specialist-performed dilated fundus exam) [21,22], and superior to direct ophthalmoscopy performed by PCPs [28,31,32].
Federally designated safety-net clinics (FDSC), including Federally Qualified Health Centers (FQHC) and rural health clinics (RHC), are cornerstones of the primary care safety-net in the United States (US), providing vulnerable populations with primary health services and care coordination. FDSCs are often the only accessible point of care for underserved diabetic patients [33,34]. To our knowledge, the effectiveness of the TDRS model to increase DR screening rates in a statewide network of FDSCs exposed to the diverse patient and payer dynamics of the US health system has not been explored.
With these facts in mind, we began building a statewide TDRS network in 2013. The partnership connected FDSCs across Kentucky to an academic medical center providing low-cost telemedicine services (image interpretation, reporting, and referral). We herein present and analyze the network’s implementation process and results, including surveillance data on rates of DR and non-DR pathologies and effects of continuity of care, from the first five years of the program. Further, we assess pre- and post-implementation screening rates from a subset of clinic sites and discuss results of patient surveys intended to assess intervention acceptability.
Methods
The Appalachia Diabetic Eye Network (ADEN) was established as a blindness prevention initiative to extend DR screening access for underserved populations in Kentucky via primary care-embedded telemedicine. A collaboration between the Department of Ophthalmology and Visual Sciences at the University of Kentucky (UKY) and multiple FDSCs across the state, the ADEN reaches both rural and urban populations.
Both national and state-targeted needs assessments were conducted to establish the justification and intervention strategy for the program, and findings were crosswalked to objectives defined by the World Health Organization’s Healthy People 2020 initiative.
This study conformed to the tenets of the Declaration of Helsinki, was approved by the University of Kentucky’s institutional review board, and was conducted in compliance with the Health Insurance Portability and Accountability Act.
TDRS program implementation
Clinic recruitment and program integration.
During the Pilot phase, FDSC administrators were contacted by a program director (RS) and invited to participate in the program. Clinics were offered nFP cameras, interpretation and reporting services, staff training, and ongoing technical support free of charge for three years (through grant funding), after which a nominal fee was charged per screening for interpretation.
An unfunded Expansion phase was opened to meet demand. Clinics were required to independently finance the purchase of cameras and were charged the interpretation fee beginning with their first screening.
The same model nFP camera (Centervue DRS® desktop nonmydriatic autofocus camera; Centervue S.p.A, Padova, Italy) was used by all participating clinics of both phases.
As network study sites were recruited, retrospective baseline data was collected from each regarding their diabetic patient population. Patients were surveyed to assess pre-implementation patient-perspective attitudes regarding the proposed intervention.
Participating FDSCs were independent or belonged to multi-clinic systems. In some cases, all clinics in an FDSC system participated in the program, but often not. Such decisions were left to FDSC leadership and based on the resource constraints, priorities, patient needs, and provider buy-in idiosyncratic to each site. A model workflow (Fig 1) was developed by program directors and distributed to each administration as part of the implementation package of resources.
The clinical workflow distributed to ADEN sites begins with the identification of diabetic patients, and walks through the key questions (white), actions (green), and end-points (red) to be completed for each encounter. Abbreviations: TDRS, Telemedicine diabetic retinopathy screening; EMR, Electronic medical record; nFP, Nonmydriatic fundus photography; DR, Diabetic retinopathy.
To accommodate the heterogeneous administrative and workflow characteristics of network sites, TDRS integration was intentionally made flexible, allowing each site latitude in adapting the protocols and processes that would govern day-to-day operation of the TDRS service.
During the study period, all FDSCs provided TDRS to patients as a free service (i.e., not billed to insurance and triggered no out-of-pocket cost) since cost of care is among the most significant patient-perceived barriers to TDRS utilization [22].
Patient recruitment.
We performed a retrospective electronic chart review of all patients who participated in the ADEN program between February 01, 2014 and January 31, 2019. According to the screening protocol, all nonpregnant adults with types 1 or 2 diabetes and without a complete eye exam or DR screening documented during the prior 12 months should be offered TDRS in clinic during regularly scheduled appointments (Fig 1).
Imaging
Pre-existing clinic staff were trained to use the screening protocol (Fig 1). nFP training was completed in single sessions simultaneous with installation of the camera systems on site by company (Centervue) representatives and trainers.
Staff performed image captures using a 45° field of view centered between the optic disc and fovea (Central Nasal) to include the optic disc, macula, and vascular arcades. One image per eye was uploaded to a secure cloud storage server. The interpretations were performed by the partner institution (UKY) utilizing REDCap software (Research Electronic Data Capture; Vanderbilt University, Nashville, Tennessee, USA).
Image interpretation
Images were reviewed and interpreted by UKY retina specialists without access to clinics’ electronic medical record (EMR) systems. Specialists noted whether each image was gradable or ungradable, the absence or presence and severity of DR, the absence or presence of diabetic macular edema, as well as findings concerning for nondiabetic pathologies considered by the grading ophthalmologist to be life- or sight-threatening. DR severity was graded according to the International Clinical Disease Severity Scales for DR and DME (Table 1) [35]. When evidence of DR was observed in both eyes, the patient’s overall severity was defined by the more severe grade. If at least one image showed referable pathology, a referral for that purpose was made. An image was considered ungradable if both 1) no signs of pathology were discernible in viewable areas, and 2) subtle pathology could not be ruled out for at least 60% of the macula. The program met the American Telemedicine Association’s criteria for Validation Category 3 [36].
Reading center reporting and recommendations
Reports with follow-up and referral recommendations were sent to point-of-care clinics. Referrals were based on the presence and level of DR, the presence of non-DR findings (or both, when appropriate), and if one or both of the images were ungradable.
Patients without pathology or with mild nonproliferative diabetic retinopathy (NPDR) were recommended for repeat exam in 12 months. Patients with moderate NPDR were referred to an eye care provider to be seen within 3 months, while those with severe NPDR, proliferative DR, or diabetic macular edema (DME) were referred to a retina specialist to be seen within 1 month. Urgency of referral for other pathologies was determined case-by-case. For patients with ungradable or missing images, a referral for dilated ocular examination by an eye care specialist within three months was recommended.
Screening rates
Pre- and post-implementation screening rates were provided by a subgroup of six Pilot phase clinics. Screening rates per year were calculated using clinic electronic medical record (EMR) queries as: number of diabetic patients with documented DR screening within 12 months / total number of diabetic patients with at least one clinical encounter during the same period.
Patient survey
Patient acceptability of TDRS was assessed using a questionnaire offered to all screened patients at Pilot phase clinics between March 2014 and March 2017, along with a waiver of informed consent. Patient participation was voluntary. The instrument was developed by program directors (RS and EBH) and reviewed by program staff for clarity. The survey instrument was optionally presented in paper and web-based modes depending on clinic and patient preference(s), captured no identifying information, and was submitted anonymously. Electronic versions were uploaded directly and stored using REDCap software on UKY secure servers; paper versions were shredded after being transcoded to the research database.
Analysis
Descriptive analyses were conducted for frequencies and percentages of pathologies. Because pathology could not be ruled out for ungradable images, the screening positive rate was calculated using the number of adequate screenings in the denominator, which may provide a more accurate estimate of disease burden in the screened population.
A univariate logistic regression model was used to determine the odds ratios (ORs) and 95% confidence intervals (CIs) for the association between patients’ age and adequate imaging (gradeability). A generalized estimating equation logistic regression model was used to analyze repeated screening rate measures for pre- and post-intervention periods. From patient surveys, patients’ self-reported characteristics and satisfaction responses were analyzed, with p-values calculated using Chi-square and Fisher’s exact tests, as appropriate. Missing observations were excluded on an analysis-by-analysis basis. Statistical significance was determined as p-values < .05 (two-tailed) for all tests. All analyses were performed using Statistical Analysis Software (SAS), version 9.4 (SAS Institute, Cary, NC, USA).
Results
Program implementation
Two FDSC systems constituting 11 clinical sites were initially recruited and signed grant contracts. All sites received the implementation package, nFP cameras, and image interpretation services as the Pilot phase cohort of clinics (Table 2). Subsequently, 11 more FDSC clinics petitioned for participation in the network. All qualified and were included in the Expansion phase (Table 2). Over the period studied, all 22 clinics remained in the network, registering a 100% clinic retention rate, and all clinics continued to offer the service free-of-charge to patients throughout and following the study period. In many clinics, costs were offset by gains in performance-based bundled-care bonuses.
This network of 22 FDSCs was comprised of 6 FQHC and 1 RHC multi-site systems, with an average of 3 participating clinics each, and 1 single-site FQHC. Clinics averaged 5.9 providers per site (range: 3–12), and all but the 5 urban sites served rural populations. All clinics had EMR systems and broadband access.
Demographics
During the program’s first five years, a total of 13,923 TDRS exams were completed (Table 3), serving 10,056 unique patients (dataset available as a S1 Dataset). Mean patient age was 54.9 years (SD 12.5 for 13,767 records), and gender was evenly balanced (male 49.4%, female 50.6% of 8547 records).
Gradeability
Of the 13,923 exams performed, 10,540 were of sufficient quality to either rule out DR, or identify a life- or sight-threatening pathology requiring referral. We therefore report a practical gradeability (adequacy) rate of 75.7%, with annual gradable exam rates among individual clinics ranging between 65.7% and 92.7%. As expected, a significant correlation was observed between odds of gradeability and age. Probability that a screening would result in referral due to ungradable image(s) increased 5% for every 1 year increase in patient age (odds ratio: 1.1; 95% CI: 1.0–1.1).
Pathology
Sixty-six percent (7008/10,540) of adequate exams had no discernible pathology. Diabetic retinopathy was identified in 22.0% of adequate exams (2319/10,540; 2276 with DR and 536 with DME, 499 of which overlapped) (Table 4). When defined by degree of retinopathy in the worst affected eye, 66.9% (1523/2276) of those with DR had mild NPDR; 18.1% (411/2276) had moderate NPDR; 10.5% (238/2,276) had severe NPDR; and 4.6% (104/2276) had proliferative DR. DME was present in 5.1% (536/10,540) of adequate screenings.
Incidental findings nonspecific to diabetes were observed in 11.5% (1213/10,540) of adequate screenings. AMD suspect (5.0%; 530/10,540) and glaucomatous findings (2.5%; 268/10,540) were most commonly observed, followed by vascular occlusion (0.6%), macular scarring (0.6%), and epiretinal membrane (0.5%) (Fig 2).
*Other less common findings included cataract or media opacity, macular dystrophy, Hollenhorst plaque, macular hole, crystalline maculopathy, choroid scar, myelinated nerve fiber layer, asteroid hyalosis or vitreous debris, hypertensive retinopathy, myopic degeneration, optic nerve head elevation, retinal degeneration, and more. Abbreviations: AMD, Age-related macular degeneration; RPE, Retinal pigment epithelium.
Referrals
In total, 5709 patients were recommended for follow-up or specialist referral (Fig 3). The overall rate of referral was 41.0% (5709 of 13,923 exams). The most common reason for referral was insufficient image quality (59.3%; 3383/5709), followed by diabetic pathology (28.1%; 1604/5709) and non-diabetic pathology (14.2%; 808/5709), with 86 overlapping.
Abbreviations: DR, Diabetic retinopathy.
Regarding urgency of referral, less than 1% of referrals were considered urgent (0.8%; 45/5709), 12.5% of referred patients were to be seen within 1 month (711/5709), and 86.8% (4953/5709) were to be seen within 3 months of screening (Fig 4).
Of the 5709 referrals analyzed, 8.9% were to retina specialists (509/5709), and 1.9% (110/5709) designated general ophthalmologist as the appropriate provider type. The remaining were for any eye care provider (ophthalmologist or optometrist; 89.2%; 5090/5709) (Fig 5).
Care continuity
During the 5-year timeframe analyzed, 2699 patients (26.8%) received two or more in-clinic screenings, accounting for 47.2% (6577/13,923) of all TDRS performed.
There was a significant difference in the proportion of referable DR pathology between single- and multiple-visit groups (12.9% and 24.3%, respectively; (P < .001)), suggesting that continuity of screening services doubled the odds of early detection of referable DR pathology (OR 2.2, 95% CI: 2.0–2.4; P < .001). Interestingly, the odds of future in-network screenings increased following the second TDRS encounter (OR 1.3, 95% CI: 1.2, 1.4; P < .001).
Screening rates
DR screening rates increased in all audited clinics following TDRS implementation, though not all clinics sustained their initial gains (Fig 6). Screening rates in the year prior to implementation averaged 29.9% and ranged from 16.8% to 47.4%. The mean first-year screening rate increase was 18.5%, which, in a generalized estimating equation logistic regression model, doubled patients’ odds of being screened over the previous year (OR 2.2; 95% CI: 1.3–3.7; P = .003). Sustained screening rate gains averaged 14.0% (Table 5) and diabetic patients were 87% more likely to be screened for DR during the four years following implementation than they had been before TDRS implementation (OR 1.9; 95% CI: 1.1–3.1; P = .018).
Six audited ADEN clinics are shown, with time of TDRS program implementation represented by time 0 for all clinics. Actual implementation was on a rolling basis covering a 2 year period between February 2014 and February 2016. Abbreviations: DR, Diabetic retinopathy; TDRS, Telemedicine diabetic retinopathy screening.
Patient satisfaction
Nine hundred fifty-two patients completed a TDRS satisfaction survey post-screening. Three quarters of those responding (73.2%; 522/713) were in their first decade since diagnosis, and approximately half (48.3%; 263/545) self-reported that their diabetes was well-controlled. Regarding TDRS, 92% (869/941) were satisfied with the screening experience; 82.5% (776/941) preferred the primary-care based TDRS service over visiting an eye care specialist; and 92.7% (868/936) would recommend TDRS to friends with diabetes. Similar large majorities rated the service convenient (94.5%; 885/937), comfortable (90.2%; 847/939), quick (94.0%; 877/933), and easy (93.8%; 879/937; Table 6). We observed a significant inverse correlation between duration of diabetes and HbA1c control (P = .002), and a positive correlation between HbA1c control and overall satisfaction with the TDRS experience (P = .02).
Discussion
DR screening rates in the US remain low due to patient-, provider-, clinic-, and system-level barriers. Many such barriers may be mitigated through convenient primary care-based telescreening [29,37], which has been shown to increase DR screening rates [21].
In this analysis of nearly fourteen thousand TDRS encounters during the first 5 years of an academic-community partnership of 22 FDSC sites serving rural and urban poor communities in Kentucky, the need for over 8000 specialist exams was eliminated; more than 2000 referable pathologies were detected; odds of patients’ being screened doubled, and gains were sustained over years; care continuity doubled the odds of early detection of referable pathology and increased odds of future screening compliance; and most patients preferred and endorsed the intervention over traditional specialist exams.
Regarding TDRS image gradeability, over ten thousand screenings adequate for detection of DR and other pathologies were performed, for a gradeability rate above 75%. This is just below the range observed in some similar studies of nFP screenings. For example, Gao et al., in a study of an urban primary care practice network with academic affiliations, observed a practical gradeability rate of 76.7% after accounting for both missing and inadequate images [38]. Chin et al., in comparing TDRS outcomes between a rural Native American Indian population and patients of an urban family practice identified 82.4 and 85.7% of images adequate for evaluation, respectively [39]. The inverse correlation between age and gradeability (observed here and corroborated elsewhere) [40] may explain some proportion of the ungradable images in this study, but given the wide range of rates over time and among clinics, we hypothesize that inconsistent image quality is at least partly due to multilevel barriers and inadequate implementation strategies that warrant further elucidation.
Diabetic pathology was found in 22% of adequate screenings. Other studies of TDRS programs in the US have reported similar DR rates [27,38,39,41–45], with rate variations likely tracking with variations in socioecological determinants [46].
More than 95% of screenings positive for DR were for non-proliferative DR (NPDR), suggesting an exceptional opportunity for providers to forestall disease progression before irreversible vision loss occurs. The proportion of adequately screened patients with proliferative DR (PDR; 1.0%, 95% CI: 0.8–1.2) was higher than that observed by Gao et al. (0.2%, 95% CI: 0.2–0.4) [38]. Evidence of diabetic macular edema (DME) was more common still (5.1%, 95% CI: 4.7–5.5), present in 23.0% of pathology-positive referrals. This DME rate is higher than that reported by Gao et al. (0.4%, 95% CI: 0.3–0.5) [38], but similar to rates observed by Gu et al. (4.4%, 95% CI: 2.4–7.4) and Varma et al. (3.8%, 95% CI: 2.7–4.9) [27,47]. These disparities may be the result of study population differences in diabetes duration, glycemic control, and screening compliance.
Almost 12% of adequate screenings revealed non-diabetic pathology, including intermediate stage or higher AMD and glaucoma. Such incidental findings of potentially disabling diseases increase the value of DR screening generally, and TDRS specifically, by reaching patients not otherwise receiving appropriate eye care.
Our observation that the odds for early detection of referable DR pathology were doubled by screening service continuity (OR 2.2, P < .001) reinforces both the value of the annual screening schedule and the importance of TDRS program sustainment. In concert, our observation that the odds of future in-network screenings increased following the second annual visit (OR 1.3, P < .001) suggests a small but significant cumulative effect of patient education and expectation on service utilization. Nevertheless, aggregate rates never approached the National Committee for Quality Assurance’s Diabetes Recognition threshold of 60%, pointing to higher level and upstream factors barring greater implementation effectiveness. Unfortunately, few studies of TDRS report follow-up screening rates over the large timeframe herein described [48], limiting opportunities for relevant comparison.
In contrast, a wide range of results have been published on the impact of TDRS for overall screening rates [42,49–53]. Of note, very few of these studies report on as large a network of clinics, or span both rural and urban poor populations, or surveille an equivalent timeframe. Taking our network in aggregate, the 1-year doubling of odds for being screened (OR 2.2; 95% CI: 1.3–3.7; P = .003) was similar to the increase described by Daskivich et al. for a safety-net system (OR 1.9; 95% CI: 1.3–2.9; P = .002) [54]. Our study also found a sustained pooled screening rate gain of 14% (95% CI: 11.7–16.1; P < 0.001) over four years, similar to the improvement observed by Jani et al. (15.8%; 95% CI: 13.0–16.6) [41], though that increase was reported only for the first year after implementation and regarded a smaller cohort of five clinics.
Despite large increases in screening rates for some of our clinics, others improved little. Further, gains were sustained in some clinics, whereas others’ performance regressed over time. These differences in TDRS adoption and sustainment reflect the challenges to implementation across disparate contexts and practices and point to unidentified upstream, multi-level variables affecting program success. Prior research on TDRS has mainly focused on patient-level factors influencing screening compliance, with scarce data on higher-level barriers.[55] Addressing this paucity, Liu et al. recently used content analysis methods with open-ended interviews of rural PCPs involved in TDRS delivery to identify several perceived provider-level barriers, including difficulty identifying when patients are due for screening, time constraints, and difficulty of referrals.[56] Barriers anecdotally observed during implementation of TDRS in a large urban safety-net system were reported by Ogunyemi et al. to include poor workflow integration, inadequate patient education, inconsistent image quality, and staff diversion.[57] Any, all, or none of these may explain the range of program outcomes we observed, and the identification of factors determining TDRS program success is a priority of our ongoing work.
One potential barrier that our patient survey data refutes is patient objection. Surveyed patients preferred TDRS to specialist exam and endorsed TDRS to friends, indicating a high patient valuation of the TDRS model [22].
Our study provides novel insights for state-scale TDRS implementation targeting underserved populations. To our knowledge, no other longitudinal studies in the US have described a TDRS network as geographically and administratively diverse, nor demonstrated sustained multi-year impact on screening rates, nor quantified patient-level effects of care continuity for odds of early detection and odds of future screening compliance. Combined, our findings provide a useful framework for other stakeholders to implement sustainable large-scale TDRS programs compatible with social distancing, appropriate for vulnerable populations, and synergistic with care continuity.
Limitations
Though very few patients refused the TDRS service when offered, the studied pool was necessarily limited to those attending a network clinic for care, creating a potential selection bias by exclusion. Image quality, media opacities, and peripheral exclusion due to limited field of view each contributed to potential underestimates of pathologies.
The structure of our academic-community network prevented the efficient sharing of medical record data. The resulting paucity in demographic and clinical data is a limitation that precluded regression analysis to identify patient-level predictors of screening outcomes. Further, because most clinics served communities far from our academic system and referrals were therefore directed to outside specialists, we were unable to assess whether patients sought or received referred eye care—a target of our ongoing studies.
These limitations reflect the intrinsic nature of studies involving low-resource community partnerships. While they may limit generalizability, our study describes a strategy for large-scale TDRS implementation in FDSCs; advances understanding of outcomes of TDRS services for underserved populations; and lays the foundation for future research on barriers and facilitators of optimal TDRS implementation in the safety-net primary care setting.
Conclusions
This report demonstrates that TDRS embedded in FDSCs can reduce the need for specialist appointments, increase patients’ odds of screening and early detection of vision-threatening pathology, and achieve sustained increases in screening rates for underserved populations. Despite high patient acceptability, screening rates across our clinics were variable and aggregate performance lagged the national DR screening rate, suggesting that to achieve full intervention potential, optimal implementation is essential.
Future studies should address poorly understood barriers to TDRS implementation at the level of professionals, healthcare institutions, and payer systems.
Acknowledgments
The authors would like to thank Drs. Andrew Pearson and Claire Fraser for their insightful suggestions for this manuscript. We also thank the ADEN clinic administrators, providers, and staff for their collaboration on this project.
References
- 1. Lee R, Wong TY, Sabanayagam C. Epidemiology of diabetic retinopathy, diabetic macular edema and related vision loss. Eye and Vision. 2015;2: 17. pmid:26605370
- 2.
Group TDC and CTR. The Effect of Intensive Treatment of Diabetes on the Development and Progression of Long-Term Complications in Insulin-Dependent Diabetes Mellitus. In: http://dx.doi.org/10.1056/NEJM199309303291401 [Internet]. Massachusetts Medical Society; 15 Jan 2010 [cited 10 Jun 2020].
- 3. Klein R, Klein BE, Moss SE, Cruickshanks KJ. The Wisconsin Epidemiologic Study of Diabetic Retinopathy: XVII. The 14-year incidence and progression of diabetic retinopathy and associated risk factors in type 1 diabetes. Ophthalmology. 1998;105: 1801–1815. pmid:9787347
- 4. Photocoagulation treatment of proliferative diabetic retinopathy. Clinical application of Diabetic Retinopathy Study (DRS) findings, DRS Report Number 8. The Diabetic Retinopathy Study Research Group. Ophthalmology. 1981;88: 583–600. pmid:7196564
- 5. Early Photocoagulation for Diabetic Retinopathy: ETDRS Report Number 9. Ophthalmology. 1991;98: 766–785. pmid:2062512
- 6. Wells JA, Glassman AR, Ayala AR, Jampol LM, Bressler NM, Bressler SB, et al. Aflibercept, Bevacizumab, or Ranibizumab for Diabetic Macular Edema: Two-year Results from a Comparative Effectiveness Randomized Clinical Trial. Ophthalmology. 2016;123: 1351–1359. pmid:26935357
- 7. Gross JG, Glassman AR, Jampol LM, Inusah S, Aiello LP, Antoszyk AN, et al. Panretinal Photocoagulation vs Intravitreous Ranibizumab for Proliferative Diabetic Retinopathy: A Randomized Clinical Trial. JAMA. 2015;314: 2137–2146. pmid:26565927
- 8.
Diabetic Retinopathy PPP 2019. In: American Academy of Ophthalmology [Internet]. 11 Oct 2019 [cited 10 Jun 2020]. https://www.aao.org/preferred-practice-pattern/diabetic-retinopathy-ppp
- 9.
Comprehensive Diabetes Care. In: NCQA [Internet]. [cited 18 Mar 2020]. https://www.ncqa.org/hedis/measures/comprehensive-diabetes-care/
- 10. Benoit SR, Swenor B, Geiss LS, Gregg EW, Saaddine JB. Eye Care Utilization Among Insured People With Diabetes in the U.S., 2010–2014. Diabetes Care. 2019;42: 427–433. pmid:30679304
- 11. Fathy C, Patel S, Sternberg P, Kohanim S. Disparities in Adherence to Screening Guidelines for Diabetic Retinopathy in the United States: A Comprehensive Review and Guide for Future Directions. Semin Ophthalmol. 2016;31: 364–377. pmid:27116205
- 12. Lu Y, Serpas L, Genter P, Mehranbod C, Campa D, Ipp E. Disparities in Diabetic Retinopathy Screening Rates Within Minority Populations: Differences in Reported Screening Rates Among African American and Hispanic Patients. Diabetes Care. 2016;39: e31–e32. pmid:26721811
- 13. Shi Q, Zhao Y, Fonseca V, Krousel-Wood M, Shi L. Racial Disparity of Eye Examinations Among the U.S. Working-Age Population With Diabetes: 2002–2009. Diabetes Care. 2014;37: 1321–1328. pmid:24574354
- 14. Lundeen EA. Disparities in Receipt of Eye Exams Among Medicare Part B Fee-for-Service Beneficiaries with Diabetes—United States, 2017. MMWR Morb Mortal Wkly Rep. 2019;68. pmid:31725705
- 15. Association AD. Economic Costs of Diabetes in the U.S. in 2012. Diabetes Care. 2013;36: 1033–1046. pmid:23468086
- 16. Venkatesh P, Tibrewal S, Bhowmik D, Tripathi M, Ramakrishnan S, Vashist N, et al. Prevalence of systemic co-morbidities in patients with various grades of diabetic retinopathy. Indian J Med Res. 2014;140: 77–83. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4181164/ pmid:25222781
- 17. Shah VA, Gupta SK, Shah KV, Vinjamaram S, Chalam KV. TTO utility scores measure quality of life in patients with visual morbidity due to diabetic retinopathy or ARMD. Ophthalmic Epidemiology. 2004;11: 43–51. pmid:14977496
- 18. Schmier JK, Covert DW, Lau EC, Matthews GP. Medicare expenditures associated with diabetes and diabetic retinopathy. Retina (Philadelphia, Pa). 2009;29: 199–206. pmid:18854789
- 19. Zhang X, Low S, Kumari N, Wang J, Ang K, Yeo D, et al. Direct medical cost associated with diabetic retinopathy severity in type 2 diabetes in Singapore. PLoS ONE. 2017;12: e0180949. pmid:28700742
- 20. Gibson DM. Estimates of the Percentage of US Adults With Diabetes Who Could Be Screened for Diabetic Retinopathy in Primary Care Settings. JAMA Ophthalmol. 2019;137: 440–444. pmid:30703202
- 21. Zimmer-Galler IE, Kimura AE, Gupta S. Diabetic retinopathy screening and the use of telemedicine. Curr Opin Ophthalmol. 2015;26: 167–172. pmid:25759962
- 22. Ramchandran RS, Yilmaz S, Greaux E, Dozier A. Patient perceived value of teleophthalmology in an urban, low income US population with diabetes. PLoS ONE. 2020;15: e0225300. pmid:31917793
- 23. Lu Y, Serpas L, Genter P, Anderson B, Campa D, Ipp E. Divergent Perceptions of Barriers to Diabetic Retinopathy Screening Among Patients and Care Providers, Los Angeles, California, 2014–2015. Prev Chronic Dis. 2016;13: E140–E140. pmid:27710765
- 24. Hartnett ME, Key IJ, Loyacano NM, Horswell RL, DeSalvo KB. Perceived Barriers to Diabetic Eye Care: Qualitative Study of Patients and Physicians. Arch Ophthalmol. 2005;123: 387–391. pmid:15767483
- 25. Graham‐Rowe E, Lorencatto F, Lawrenson JG, Burr JM, Grimshaw JM, Ivers NM, et al. Barriers to and enablers of diabetic retinopathy screening attendance: a systematic review of published and grey literature. Diabetic Medicine. 2018;35: 1308–1319. pmid:29790594
- 26. van Eijk KND, Blom JW, Gussekloo J, Polak BCP, Groeneveld Y. Diabetic retinopathy screening in patients with diabetes mellitus in primary care: Incentives and barriers to screening attendance. Diabetes Res Clin Pract. 2012;96: 10–16. pmid:22137363
- 27. Gu D, Agron S, May LN, Mirza RG, Bryar PJ. Nonmydriatic Retinal Diabetic Screening in the Primary Care Setting: Assessing Degree of Retinopathy and Incidence of Nondiabetic Ocular Diagnoses. Telemed J E Health. 2020. pmid:32083513
- 28. Gupta A, Cavallerano J, Sun JK, Silva PS. Evidence for Telemedicine for Diabetic Retinal Disease. Semin Ophthalmol. 2017;32: 22–28. pmid:27748634
- 29. Shi L, Wu H, Dong J, Jiang K, Lu X, Shi J. Telemedicine for detecting diabetic retinopathy: a systematic review and meta-analysis. Br J Ophthalmol. 2015;99: 823–831. pmid:25563767
- 30. Bedard C, (Sherry) Liu S, Patterson C, Gerstein H, Griffith L. Systematic review: Can non-mydriatic cameras accurately detect diabetic retinopathy? Diabetes Research and Clinical Practice. 2017;129: 154–159. pmid:28528076
- 31. O’Hare JP, Hopper A, Madhaven C, Charny M, Purewal TS, Harney B, et al. Adding retinal photography to screening for diabetic retinopathy: a prospective study in primary care. BMJ. 1996;312: 679–682. pmid:8597737
- 32. Owens DR, Gibbins RL, Lewis PA, Wall S, Allen JC, Morton R. Screening for diabetic retinopathy by general practitioners: ophthalmoscopy or retinal photography as 35 mm colour transparencies? Diabetic Medicine. 1998;15: 170–175. pmid:9507921
- 33.
Federally Qualified Health Centers? Importance in the Safety Net Continues for Many as Affordable Care Act Implementation Moves Ahead. [cited 26 May 2020]. http://hrms.urban.org/briefs/federally-qualified-health-centers-importance-aca.html
- 34. Nichols GA, McBurnie M, Paul L, Potter JE, McCann S, Mayer K, et al. The High Prevalence of Diabetes in a Large Cohort of Patients Drawn From Safety Net Clinics. Prev Chronic Dis. 2016;13: E78. pmid:27309415
- 35. Wilkinson CP, Ferris FL, Klein RE, Lee PP, Agardh CD, Davis M, et al. Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. Ophthalmology. 2003;110: 1677–1682. pmid:13129861
- 36. Li HK, Horton M, Bursell S-E, Cavallerano J, Zimmer-Galler I, Tennant M, et al. Telehealth Practice Recommendations for Diabetic Retinopathy, Second Edition. Telemed J E Health. 2011;17: 814–837. pmid:21970573
- 37. Bragge P, Gruen RL, Chau M, Forbes A, Taylor HR. Screening for Presence or Absence of Diabetic Retinopathy: A Meta-analysis. Arch Ophthalmol. 2011;129: 435–444. pmid:21149748
- 38. Gao X, Park CH, Dedrick K, Borkar DS, Obeid A, Reber S, et al. Use of Telehealth Screening to Detect Diabetic Retinopathy and Other Ocular Findings in Primary Care Settings. Telemed J E Health. 2019;25: 802–807. pmid:30481134
- 39. Chin EK, Ventura BV, See K-Y, Seibles J, Park SS. Nonmydriatic Fundus Photography for Teleophthalmology Diabetic Retinopathy Screening in Rural and Urban Clinics. Telemedicine and e-Health. 2013;20: 102–108. pmid:24219153
- 40. Scanlon PH, Foy C, Malhotra R, Aldington SJ. The Influence of Age, Duration of Diabetes, Cataract, and Pupil Size on Image Quality in Digital Photographic Retinal Screening. Diabetes Care. 2005;28: 2448–2453. pmid:16186278
- 41. Jani PD, Forbes L, Choudhury A, Preisser JS, Viera AJ, Garg S. Evaluation of Diabetic Retinal Screening and Factors for Ophthalmology Referral in a Telemedicine Network. JAMA Ophthalmol. 2017;135: 706–714. pmid:28520833
- 42. Mansberger SL, Gleitsmann K, Gardiner S, Sheppler C, Demirel S, Wooten K, et al. Comparing the Effectiveness of Telemedicine and Traditional Surveillance in Providing Diabetic Retinopathy Screening Examinations: A Randomized Controlled Trial. Telemedicine and e-Health. 2013;19: 942–948. pmid:24102102
- 43. Owsley C, McGwin G, Lee DJ, Lam BL, Friedman DS, Gower EW, et al. Diabetes Eye Screening in Urban Settings Serving Minority Populations: Detection of Diabetic Retinopathy and Other Ocular Findings Using Telemedicine. JAMA Ophthalmol. 2015;133: 174–181. pmid:25393129
- 44. Cavallerano AA, Cavallerano JD, Katalinic P, Blake B, Rynne M, Conlin PR, et al. A telemedicine program for diabetic retinopathy in a Veterans Affairs Medical Center—the Joslin Vision Network Eye Health Care Model. Am J Ophthalmol. 2005;139: 597–604. pmid:15808153
- 45. Toy BC, Aguinaldo T, Eliason J, Egbert J. Non-Mydriatic Fundus Camera Screening for Referral-Warranted Diabetic Retinopathy in a Northern California Safety-Net Setting. Ophthalmic Surg Lasers Imaging Retina. 2016;47: 636–642. pmid:27434895
- 46. Hill JO, Galloway JM, Goley A, Marrero DG, Minners R, Montgomery B, et al. Scientific Statement: Socioecological Determinants of Prediabetes and Type 2 Diabetes. Diabetes Care. 2013;36: 2430–2439. pmid:23788649
- 47. Varma R, Bressler NM, Doan QV, Gleeson M, Danese M, Bower JK, et al. Prevalence of and risk factors for diabetic macular edema in the United States. JAMA Ophthalmol. 2014;132: 1334–1340. pmid:25125075
- 48. Mansberger SL, Sheppler C, Barker G, Gardiner SK, Demirel S, Wooten K, et al. Long-term Comparative Effectiveness of Telemedicine in Providing Diabetic Retinopathy Screening Examinations: A Randomized Clinical Trial. JAMA Ophthalmol. 2015;133: 518–525. pmid:25741666
- 49. Wilson C, Horton M, Cavallerano J, Aiello LM. Addition of Primary Care–Based Retinal Imaging Technology to an Existing Eye Care Professional Referral Program Increased the Rate of Surveillance and Treatment of Diabetic Retinopathy. Diabetes Care. 2005;28: 318–322. pmid:15677786
- 50. Taylor CR, Merin LM, Salunga AM, Hepworth JT, Crutcher TD, O’Day DM, et al. Improving Diabetic Retinopathy Screening Ratios Using Telemedicine-Based Digital Retinal Imaging Technology: The Vine Hill Study. Diabetes Care. 2007;30: 574–578. pmid:17327323
- 51. Pr C, Bm F, Aa C, Jd C, Se B, Lm A. Nonmydriatic teleretinal imaging improves adherence to annual eye examinations in patients with diabetes. J Rehabil Res Dev. 2006;43: 733–740. pmid:17310422
- 52. Davis RM, Fowler S, Bellis K, Pockl J, Pakalnis V al, Woldorf A. Telemedicine Improves Eye Examination Rates in Individuals With Diabetes: A model for eye-care delivery in underserved communities. Diabetes Care. 2003;26: 2476–2476. pmid:12882889
- 53. Hatef E, Alexander M, Vanderver BG, Fagan P, Albert M. Assessment of Annual Diabetic Eye Examination Using Telemedicine Technology Among Underserved Patients in Primary Care Setting. Middle East Afr J Ophthalmol. 2017;24: 207–212. pmid:29422756
- 54. Daskivich LP, Vasquez C, Martinez C, Tseng CH, Mangione CM. Implementation and evaluation of a large-scale teleretinal diabetic retinopathy screening program in the los angeles county department of health services. JAMA Internal Medicine. 2017;177: 642–649. pmid:28346590
- 55. Piyasena MMPN, Murthy GVS, Yip JLY, Gilbert C, Zuurmond M, Peto T, et al. Systematic review on barriers and enablers for access to diabetic retinopathy screening services in different income settings. PLOS ONE. 2019;14: e0198979. pmid:31013274
- 56. Liu Y, Zupan NJ, Swearingen R, Jacobson N, Carlson JN, Mahoney JE, et al. Identification of barriers, facilitators and system-based implementation strategies to increase teleophthalmology use for diabetic eye screening in a rural US primary care clinic: a qualitative study. BMJ Open. 2019;9: e022594. pmid:30782868
- 57. Ogunyemi O, George S, Patty L, Teklehaimanot S, Baker R. Teleretinal Screening for Diabetic Retinopathy in Six Los Angeles Urban Safety-Net Clinics: Final Study Results. AMIA Annu Symp Proc. 2013;2013: 1082–1088. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3900130/ pmid:24551394