Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The HIV Care Continuum: Changes over Time in Retention in Care and Viral Suppression

  • Baligh R. Yehia ,

    byehia@upenn.edu

    Affiliations Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America, Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, United States of America, Center for Biostatistics and Epidemiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America

  • Alisa J. Stephens-Shields,

    Affiliation Center for Biostatistics and Epidemiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America

  • John A. Fleishman,

    Affiliation Center for Financing, Access, and Cost Trends, Agency for Healthcare Research and Quality, Rockville, MD, United States of America

  • Stephen A. Berry,

    Affiliation Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, United States of America

  • Allison L. Agwu,

    Affiliation Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, United States of America

  • Joshua P. Metlay,

    Affiliation General Medicine Division, Massachusetts General Hospital, Boston, MA, United States of America

  • Richard D. Moore,

    Affiliation Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, United States of America

  • W. Christopher Mathews,

    Affiliation Department of Medicine, University of California San Diego, San Diego, CA, United States of America

  • Ank Nijhawan,

    Affiliation Department of Medicine, University of Texas Southwestern, Dallas, TX, United States of America

  • Richard Rutstein,

    Affiliation Division of General Pediatrics, Children's Hospital of Philadelphia, Philadelphia, PA, United States of America

  • Aditya H. Gaur,

    Affiliation Department of Infectious Diseases, St. Jude’s Children's Hospital, Memphis, TN, United States of America

  • Kelly A. Gebo,

    Affiliation Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, United States of America

  • HIV Research Network

    Membership of the HIV Research Network is listed in the Acknowledgments.

Abstract

Background

The HIV care continuum (diagnosis, linkage to care, retention in care, receipt of antiretroviral therapy (ART), viral suppression) has been used to identify opportunities for improving the delivery of HIV care. Continuum steps are typically calculated in a conditional manner, with the number of persons completing the prior step serving as the base population for the next step. This approach may underestimate the prevalence of viral suppression by excluding patients who are suppressed but do not meet standard definitions of retention in care. Understanding how retention in care and viral suppression interact and change over time may improve our ability to intervene on these steps in the continuum.

Methods

We followed 17,140 patients at 11 U.S. HIV clinics between 2010-2012. For each calendar year, patients were classified into one of five categories: (1) retained/suppressed, (2) retained/not-suppressed, (3) not-retained/suppressed, (4) not-retained/not-suppressed, and (5) lost to follow-up (for calendar years 2011 and 2012 only). Retained individuals were those completing ≥2 HIV medical visits separated by ≥90 days in the year. Persons not retained completed ≥1 HIV medical visit during the year, but did not meet the retention definition. Persons lost to follow-up had no HIV medical visits in the year. HIV viral suppression was defined as HIV-1 RNA ≤200 copies/mL at the last measure in the year. Multinomial logistic regression was used to determine the probability of patients’ transitioning between retention/suppression categories from 2010 to 2011 and 2010 to 2012, adjusting for age, sex, race/ethnicity, HIV risk factor, insurance status, CD4 count, and use of ART.

Results

Overall, 65.8% of patients were retained/suppressed, 17.4% retained/not-suppressed, 10.0% not-retained/suppressed, and 6.8% not-retained/not-suppressed in 2010. 59.5% of patients maintained the same status in 2011 (kappa=0.458) and 53.3% maintained the same status in 2012 (kappa=0.437).

Conclusions

Not counting patients not-retained/suppressed as virally suppressed, as is commonly done in the HIV care continuum, underestimated the proportion suppressed by 13%. Applying the care continuum in a longitudinal manner will enhance its utility.

Introduction

Advances in the treatment of HIV infection have led to the development of effective, more convenient antiretroviral therapy (ART).[1,2] Better therapies have improved adherence to ART, reduced HIV-related complications, and increased survival.[37] However, to benefit fully from ART, HIV-infected individuals must fulfill several steps along the HIV care continuum—HIV diagnosis, linkage to care, retention in care, receipt of ART, and HIV viral suppression.[8,9] Yet in the United States (U.S.), only 25% of HIV-infected adults complete all of these steps.[8]

The HIV care continuum has been used by federal, state, and local agencies to identify gaps and opportunities for improving the delivery of HIV care.[811] While the continuum is a useful framework for monitoring HIV care, it has a number of limitations. First, continuum steps are typically calculated in a conditional manner, with the number of persons completing the prior step serving as the base population for the next step. This may not be problematic for early stages in the continuum but may be an issue for the final steps of retention in care and viral suppression. Specifically, this approach may underestimate the prevalence of viral suppression by excluding patients who are suppressed but do not meet standard definitions of retention in care; few studies have estimated the size of this group.[12,13] Second, the continuum is largely static, providing a snapshot of HIV testing, engagement in care, and viral suppression at a specific time point or during a set time period. Third, the continuum focuses on populations, not individuals. As such, data are presented in the aggregate and may not accurately capture changes across time for individual patients.

Retention in care is associated with HIV viral suppression,[14] but the proportion of patients remaining retained and suppressed over time is not known. Understanding how individuals move between states of retention/non-retention and suppression/non-suppression over time may improve our ability to intervene on these steps in the continuum. Using data from a large, U.S. multisite cohort, we followed individual patients over a three-year period to determine how retention in care and viral suppression statuses interact and change over time.

Methods

Study Sample and Data Collection

We analyzed prospectively collected data from the HIV Research Network (HIVRN), a consortium of clinics that provide care to HIV-infected patients.[15] All patients presenting for care were offered enrollment in the HIVRN, excluding one-time consultations and incarcerated individuals. Data were abstracted from medical records at each site and sent to a data coordinating center after removing personal identifying information. After quality control and verification, data were combined across sites to produce a uniform database. Institutional review boards (IRBs) at each site (complete list of sites can be found in supplemental file 1) and the data coordinating center at Johns Hopkins University approved the collection and analyses of these data. IRBs at some clinics required written informed consents, while others waived the requirement because only existing anonymized and de-identified data were collected.

Data from 11 HIVRN sites, located in the Northeastern (5), Midwestern (1), Southern (2), and Western (3) sections of the U.S., were included in analyses. Adult patients (age ≥18 years) with at least one primary HIV outpatient visit and one HIV-1 RNA level between January 1 and December 31, 2010 were eligible for inclusion. Patients newly enrolled at HIVRN sites between July 1 and December 31, 2010 were excluded, as they did not provide adequate time to measure retention in care. Eligible patients were followed at these 11 HIVRN sites through December 31, 2012. Patients who died, transferred their care outside of the HIVRN, and who had no recorded viral load tests after 2010 were excluded from subsequent years’ analyses.

Definitions of Variables

Retention in care was based on the U.S. National HIV/AIDS Strategy metric.[16] Individuals “retained in care” were those completing 2 or more HIV medical visits separated by ≥90 days in a calendar year. Persons “not retained in care” completed at least one HIV medical visit during the calendar year, but did not meet the retention definition (e.g. only attended one visit or attended multiple visits within a single 90-day period). These individuals were distinguished from patients lost to follow-up (LTFU), who had no HIV medical visits in a calendar year. HIV viral suppression was categorized as suppressed (HIV-1 RNA ≤ 200 copies/mL) and not suppressed (HIV-1 RNA > 200 copies/mL) at the last measure in the calendar year.

For each patient, age as of January 1, 2010 was divided into four groups: 18–29, 30–39, 40–49, and over 50 years old. Race/ethnicity was categorized as non-Hispanic White, non-Hispanic Black, Hispanic, and other/unknown. HIV transmission risk factor was grouped into men who had sex with men (MSM), heterosexual transmission (HET), injection drug use (IDU), and other/unknown. Patients who had IDU in combination with another risk factor (e.g. MSM, heterosexual transmission) were classified as IDU. Insurance coverage in 2010 was categorized as private, Medicaid, Medicare (including dual eligibles), uninsured, or other/unknown. Patients whose care was funded by Ryan White, those recorded as self-pay, and those covered by local governmental programs were classified as uninsured. First CD4 count recorded in 2010 was grouped as ≤ 200, 201–350, 351–500, > 500 cells/mm3, and missing. Use of ART was defined as receiving 3 antiretroviral drugs from two or more classes for ≥ 6 months in 2010.

Statistical Analyses

Standard descriptive analyses of demographic and clinical characteristics of the sample were conducted. For each calendar year, patients were classified into one of five categories: (1) retained in care and virally suppressed (retained/suppressed), (2) retained in care and not virally suppressed (retained/not-suppressed), (3) not retained in care and virally suppressed (not-retained/suppressed), (4) not retained in care and not virally suppressed (not-retained/not-suppressed), and (5) LFTU (for calendar years 2011 and 2012 only). Patients LTFU in 2011 could re-enter the analysis for 2012 if they had a HIV medical visit in 2012. Retention/suppression status in 2010 was cross-classified with retention/suppression status in 2011 to observe one-year transitions, and with retention/suppression status in 2012 to observe two-year transitions. Kappa statistics were calculated to assess the agreement in retention/suppression classifications over time (2010 to 2011 and 2010 to 2012).[17]

Multinomial logistic regression was used to determine the probability of patients’ transitioning between the retention/suppression categories from 2010 to 2011 and 2010 to 2012, adjusting for differences in age, sex, race/ethnicity, HIV risk factor, insurance status, CD4 count, and use of ART. To account for differences across sites, we included indicator variables for each site. Based on regression results, we calculated marginal predicted probabilities for transitioning from one retention/suppression category to another over 1-year and 2-year periods.[18] Statistical analyses were performed using Stata 12.1 (Stata Corporation, College Station, TX).

Results

A total of 17,140 eligible adults were in care at HIVRN clinics in 2010 (Table 1). In that year, most patients were male (73.6%), between 40–49 years old (38.4%), racial/ethnic minorities (67.1%), and had Medicaid (34.0%) or no health insurance (27.9%); 34.8% had a first CD4 count ≤350 cells/mm3 and 79.1% were on ART. Overall, 65.3% of patients were retained/suppressed, 17.7% were retained/not-suppressed, 10.0% were not-retained/suppressed, and 6.9% were not-retained/not-suppressed in 2010. The HIV care continuum would typically not count patients in the not-retained/suppressed group, who comprised 13% of all individuals achieving viral suppression, as virally suppressed. Younger individuals, females, blacks, those with IDU or MSM risk, individuals with Medicaid or no insurance, persons with lower CD4 counts, and those not receiving ART were relatively less likely to be retained/suppressed compared to their respective counterparts (P <0.001). (Table 1).

thumbnail
Table 1. Demographic and Clinical Characteristics of the Sample and Association with Retention/Suppression Status in 2010.

https://doi.org/10.1371/journal.pone.0129376.t001

Tables 2 and 3 presents observed transitions in retention/suppression status between calendar years 2010–2011 and 2010–2012. For analysis of retention/suppression in 2010–2011, patients who died (n = 175), transferred their care outside of the HIVRN (n = 107), and who had no recorded viral load test (n = 483) were excluded, leaving a sample of 16,375. Analysis of retention/suppression in 2010–2012 excluded those who died or transferred their care in 2011 (n = 282), died in 2012 (n = 173), transferred their care in 2012 (n = 40), or had no recorded viral load test in 2012 (n = 407), leaving 16,238 observations. In total, 59.5% of patients maintained the same retention/suppression status in 2011 as in 2010 (kappa = 0.458) and 53.3% maintained the same status in 2012 as in 2010 (kappa = 0.437). In multinomial logistic regression models (Tables A and B in S1 File), the pattern of predicted transitions in retention/suppression status over time remained similar to the unadjusted results (Tables 4 and 5).

thumbnail
Table 2. Retention/Suppression Status in Calendar-Years 2011 by Retention/Suppression Status in Calendar-Year 2010.

https://doi.org/10.1371/journal.pone.0129376.t002

thumbnail
Table 3. Retention/Suppression Status in Calendar-Years 2012 by Retention/Suppression Status in Calendar-Year 2010.

https://doi.org/10.1371/journal.pone.0129376.t003

thumbnail
Table 4. Predicted Probabilities for Retention in Care and Viral Suppression Status in Calendar-Years 2011 by Retention/Suppression Status in Calendar-Year 2010, from Multinomial Regression Models.

https://doi.org/10.1371/journal.pone.0129376.t004

thumbnail
Table 5. Predicted Probabilities for Retention in Care and Viral Suppression Status in Calendar-Years 2012 by Retention/Suppression Status in Calendar-Year 2010, from Multinomial Regression Models.

https://doi.org/10.1371/journal.pone.0129376.t005

There were wide variations in individuals’ future retention/suppression status based on their original classification in 2010. Those retained/suppressed in 2010 were relatively stable, with 76.7% remaining in the same group in 2011 and 71.7% in 2012. In contrast, relatively few individuals not-retained/not-suppressed in 2010 remained in the same category in 2011 (13.9%) and 2012 (7.8%). Approximately half of individuals not-retained/not-suppressed in 2010 were subsequently LTFU in 2012, and one-fifth transitioned to the retained/suppressed category in 2012.

A high proportion (44.7–49.6%) of patients not-retained/suppressed in 2010 moved to the retained/suppressed category in subsequent years; 12.6–12.7% remained unchanged and 29.9–34.7% were LFTU. Of those retained/not-suppressed in 2010, 39.1% and 25.2% remained in the same category in 2011 and 2012, respectively. However, over 30% moved to retained/suppressed and between 16.9–26.4% were LTFU in subsequent years.

Over the study period, 1.7% of persons retained/suppressed died, compared to 3.2% of retained/not suppressed, 1.5% of not-retained/suppressed, and 2.7% of those not-retained/not-suppressed.

Discussion

These results highlight certain patient experiences currently not captured by the HIV care continuum. First, many individuals had transitions in their retention/suppression status over time, with only 60% of patients maintaining the same status over a 1-year period and 53% over a 2-year period. Fortunately, patients retained/suppressed in 2010 were the most stable group. Second, excluding patients who did not meet standard definitions of retention in care underestimated the proportion virally suppressed by 13%. Understanding how individuals engage in outpatient care over time and developing monitoring systems to better capture these experiences is essential to improving HIV outcomes and care delivery.

Transitions from one retention/suppression category to another were common, especially for individuals not-retained/suppressed, retained/not-suppressed, and not-retained/not-suppressed. Among those virally suppressed, approximately 20–25% had viral failure or were LTFU in subsequent years. Conversely, approximately one-third of patients not-retained and/or not-suppressed moved into the retained/suppressed group over time. These transitions are likely influenced by multiple factors at the patient (e.g. health literacy, co-morbid conditions, support system, ART adherence), clinic/health system (e.g. patient-provider relationship, co-location of multiple services, ART receipt), and environmental (e.g. competing life activities, distance to clinic) levels.[19,20]

Individuals virally suppressed but not retained in care are commonly counted as not suppressed in the HIV care continuum. These patients may be receiving care at multiple clinics, transitioning from one clinic to another, or newly incarcerated, and thus may not meet retention criteria at each individual site of care. For example, among 12,759 HIV-infected adults seen at Ryan White-funded clinics in Philadelphia, PA in 2008–2010, 8% received care at more than one clinic.[21] Alternatively, this group may represent persons with excellent self-management skills.[2224] HIV treatment guidelines now recommend ART for all HIV-infected individuals, regardless of CD4 count, and less frequent laboratory monitoring in adherent patients with a suppressed viral load and stable immunologic status.[25] As the proportion of HIV-infected individuals on ART increases, the number of persons who are not-retained/suppressed is likely to grow. Moreover, less frequent laboratory monitoring may translate to fewer outpatient visits among the subset of patients with well-controlled HIV. These changes underscore the importance of counting not-retained/suppressed individuals as suppressed when monitoring the HIV care continuum. Lastly, this not-retained/suppressed group may represent individuals with work and/or family conflicts or inconvenient care (e.g. long wait times, lengthy travel time) that result in missed clinic appointments but not compromised medication adherence.[26] Additional data are needed to better understand adherence practices and long-term outcomes of this group.

This study is limited by its retrospective nature and inability to capture visits to clinics outside the HIVRN. It is possible that the HIV-1 RNA measure could have occurred relatively early in the calendar year; thus failure to be retained in care may have occurred after viral load measurement. Results may vary depending on the definition of retention in care used; yet, multiple studies have shown that retention measures are moderately correlated.[27,28] It is possible that clinical factors (e.g., CD4 count) at ART initiation may affect subsequent retention. However, this study did not use an ART-naive cohort and could not examine this possibility. Additional research evaluating associations between patient factors at time of first ART prescription and the outcomes is needed. Although HIVRN sites encompass a broad geographic distribution and include patients with a variety of demographic and clinical characteristics, our findings may not generalize to all HIV-infected patients in care but rather to those in care at large, urban HIV clinics with highly experienced providers.

The HIV care continuum is a helpful framework for monitoring HIV care. However, applying it in a longitudinal framework will enhance its utility. Strictly requiring retention in care criteria be met in order to consider individuals virally suppressed may underestimate the proportion of patients achieving viral suppression. These findings have important implications for monitoring the quality of HIV care and for meeting targets established by the U.S. National HIV/AIDS Strategy.[29,30] A better understanding of how HIV-infected persons use outpatient HIV services is essential to improving the assessment and design of HIV care delivery.

Supporting Information

S1 File. Multivariate Multinomial Logistic Regression Model of Retention in Care and Viral Suppression.

(Table A) Multivariate Multinomial Logistic Regression Model of Retention in Care and Viral Suppression, 2010–2011. (Table B) Multivariate Multinomial Logistic Regression Model of Retention in Care and Viral Suppression, 2010–2012.

https://doi.org/10.1371/journal.pone.0129376.s001

(DOCX)

Acknowledgments

Participating Sites

Alameda County Medical Center, Oakland, California (Howard Edelstein, M.D.)

Children's Hospital of Philadelphia, Philadelphia, Pennsylvania (Richard Rutstein, M.D.)

Community Health Network, Rochester, New York (Roberto Corales, D.O.)

Drexel University, Philadelphia, Pennsylvania (Jeffrey Jacobson, M.D., Sara Allen, C.R.N.P.)

Fenway Health, Boston, Massachusetts (Stephen Boswell, MD)

Johns Hopkins University, Baltimore, Maryland (Kelly Gebo, M.D., Richard Moore, M.D., Allison Agwu M.D.)

Montefiore Medical Group, Bronx, New York (Robert Beil, M.D., Carolyn Chu, M.D.)

Montefiore Medical Center, Bronx, New York (Lawrence Hanau, M.D.)

Oregon Health and Science University, Portland, Oregon (P. Todd Korthuis, M.D.)

Parkland Health and Hospital System, Dallas, Texas (Muhammad Akbar, M.D., Laura Armas-Kolostroubis, M.D.)

St. Jude's Children's Hospital and University of Tennessee, Memphis, Tennessee (Aditya Gaur, M.D.)

St. Luke's Roosevelt Hospital Center, New York, New York (Victoria Sharp, M.D., Stephen Arpadi, M.D.)

Tampa General Health Care, Tampa, Florida (Charurut Somboonwit, M.D.)

University of California, San Diego, California (W. Christopher Mathews, M.D.)

Wayne State University, Detroit, Michigan (Jonathan Cohn, M.D.)

Sponsoring Agencies

Agency for Healthcare Research and Quality, Rockville, Maryland (Fred Hellinger, Ph.D., John Fleishman, Ph.D., Irene Fraser, Ph.D.)

Health Resources and Services Administration, Rockville, Maryland (Robert Mills, Ph.D., Faye Malitz, M.S.)

Data Coordinating Center

Johns Hopkins University (Richard Moore, M.D., Jeanne Keruly, C.R.N.P., Kelly Gebo, M.D., Cindy Voss, M.A., Nikki Balding, M.S.)

Disclaimer

The views expressed in this paper are those of the authors. No official endorsement by the National Institutes of Health or the Agency for Healthcare Research and Quality is intended or should be inferred.

Author Contributions

Conceived and designed the experiments: BRY AJS JAF SAB ALA JPM KAG. Analyzed the data: BRY AJS JAF KAG. Contributed reagents/materials/analysis tools: SAB ALA RDM WCM AN RR AHG KAG. Wrote the paper: BRY AJS JAF SAB ALA JPM RDM WCM AN RR AHG KAG.

References

  1. 1. Rodger AJ, Lodwick R, Schechter M, Deeks S, Amin J, Gilson R, et al. Mortality in well controlled HIV in the continuous antiretroviral therapy arms of the SMART and ESPRIT trials compared with the general population. AIDS. 2013 Mar 27; 27(6):973–979. pmid:23698063
  2. 2. Arribas JR, Eron J. Advances in antiretroviral therapy. Curr Opin HIV AIDS. Jul 2013;8(4):341–349. pmid:23666392
  3. 3. Cohen CJ, Meyers JL, Davis KL. Association between daily antiretroviral pill burden and treatment adherence, hospitalisation risk, and other healthcare utilisation and costs in a US medicaid population with HIV. BMJ Open. 2013;3(8).
  4. 4. Berry SA, Fleishman JA, Moore RD, Gebo KA. Trends in reasons for hospitalization in a multisite United States cohort of persons living with HIV, 2001–2008. J Acquir Immune Defic Syndr. 2012 April 1;59(4):368–375. pmid:22240460
  5. 5. Bangsberg DR, Ragland K, Monk A, Deeks SG. A single tablet regimen is associated with higher adherence and viral suppression than multiple tablet regimens in HIV+ homeless and marginally housed people. AIDS. 2010 Nov 27;24(18):2835–2840. pmid:21045636
  6. 6. Yehia BR, Fleishman JA, Hicks PL, Ridore M, Moore RD, Gebo KA. Inpatient health services utilization among HIV-infected adult patients in care 2002–2007. J Acquir Immune Defic Syndr. 2010 Mar;53(3):397–404. pmid:19841589
  7. 7. Althoff KN, Buchacz K, Hall HI, Zhang J, Hanna DB, Rebeiro P, et al. U.S. trends in antiretroviral therapy use, HIV RNA plasma viral loads, and CD4 T-lymphocyte cell counts among HIV-infected persons, 2000 to 2008. Ann Intern Med. 2012 Sep 4;157(5):325–335. pmid:22944874
  8. 8. Vital signs: HIV prevention through care and treatment--United States. Morb Mortal Wkly Rep. 2011 Dec 2;60(47):1618–1623. pmid:22129997
  9. 9. Fleishman JA, Yehia BR, Moore RD, Korthuis PT, Gebo KA. Establishment, retention, and loss to follow-up in outpatient HIV care. J Acquir Immune Defic Syndr. 2012 Jul 1;60(3):249–259. pmid:22531758
  10. 10. Mugavero MJ, Amico KR, Horn T, Thompson MA. The state of engagement in HIV care in the United States: from cascade to continuum to control. Clin Infect Dis. 2013; 57(8):1164–1171. pmid:23797289
  11. 11. Eberhart MG, Yehia BR, Hillier A, Voytek CD, Blank MB, Frank I, et al. Behind the cascade: analyzing spatial patterns along the HIV care continuum. J Acquir Immune Defic Syndr. 2013 Nov 1;64 Suppl 1:S42–51. pmid:24126447
  12. 12. Wiewel EW, Braunstein SL, Xia Q, Shepard CW, Torian LV. Monitoring Outcomes for Newly Diagnosed and Prevalent HIV Cases Using a Care Continuum Created With New York City Surveillance Data. J Acquir Immune Defic Syndr. 2015 Feb 1;68(2):217–226. pmid:25394192
  13. 13. Horberg M, Hurly L, Klein D, Towner W, Kadlecik P, Finnegan C, et al. The HIV Care Cascade ("Cascade") Measured Over Multiple Time Periods Varies by Time Period and Method. Paper presented at: 20th International AIDS Conference 2014; Melbourne, Australia.
  14. 14. Mugavero MJ, Amico KR, Westfall AO, Crane HM, Zinski A, Willig JH, et al. Early retention in HIV care and viral load suppression: implications for a test and treat approach to HIV prevention. J Acquir Immune Defic Syndr. 2012 Jan 1;59(1):86–93. pmid:21937921
  15. 15. Yehia BR, Gebo KA, Hicks PB, Korthuis PT, Moore RD, Ridore M, et al. Structures of care in the clinics of the HIV Research Network. AIDS Patient Care STDs. 2008;22(12):1007–1013. pmid:19072107
  16. 16. The White House Office of National AIDS Policy. The National HIV/AIDS Strategy of the United States. 2010.
  17. 17. Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005 May; 37(5):360–363. pmid:15883903
  18. 18. Kleinman LC, Norton EC. What's the Risk? A simple approach for estimating adjusted risk measures from nonlinear models including logistic regression. Health Serv Res. Feb 2009;44(1):288–302. pmid:18793213
  19. 19. Ulett KB, Willig JH, Lin HY, Routman JS, Abroms S, Allison J, et al. The therapeutic implications of timely linkage and early retention in HIV care. AIDS Patient Care STDs. 2009 Jan;23(1):41–49. pmid:19055408
  20. 20. Andersen RM. Revisiting the behavioral model and access to medical care: does it matter? J Health Soc Behav. 1995 Mar;36(1):1–10. pmid:7738325
  21. 21. Yehia BR, Schranz AJ, Momplaisir F, Keller SC, Gross R, Frank I, et al. Outcomes of HIV-Infected Patients Receiving Care at Multiple Clinics. AIDS Behavior. 2014 Aug;18(8):1511–22. pmid:24077931
  22. 22. Lorig KR, Ritter P, Stewart AL, et al. Chronic disease self-management program: 2-year health status and health care utilization outcomes. Medical Care. 2001 Nov;39(11):1217–1223. pmid:11606875
  23. 23. Chodosh J, Morton SC, Mojica W, Maglione M, Suttorp MJ, Hilton L, et al. Meta-analysis: chronic disease self-management programs for older adults. Ann Intern Med. 2005 Sep 20;143(6):427–438. pmid:16172441
  24. 24. Bodenheimer T, Lorig K, Holman H, Grumbach K. Patient self-management of chronic disease in primary care. JAMA. 2002 Nov 20;288(19):2469–2475. pmid:12435261
  25. 25. Department of Health and Human Services. Guidelines for the Use of Antiretroviral Agents in HIV-1-Infected Adults and Adolescents. Available: http://www.aidsinfo.nih.gov.
  26. 26. Holtzman CW, Shea JA, Glanz K, Jacobs LM, Gross R, Hines J, et al. Mapping Patient-Identified Barriers and Facilitators to Retention in HIV Care and Antiretroviral Therapy Adherence to Anderson’s Behavioral Model. AIDS Care. 2015 27(7):817–28. pmid:25671515
  27. 27. Mugavero MJ, Westfall AO, Zinski A, Davila J, Drainoni ML, Gardner LI, et al. Measuring retention in HIV care: the elusive gold standard. J Acquir Immune Defic Syndr. 2012 Dec 15;61(5):574–580. pmid:23011397
  28. 28. Yehia BR, Fleishman JA, Metlay JP, Korthuis PT, Agwu AL, Berry SA, et al. Comparing different measures of retention in outpatient HIV care. AIDS. 2012 Jun 1;26(9):1131–1139. pmid:22382143
  29. 29. Yehia B, Frank I. Battling AIDS in America: an evaluation of the National HIV/AIDS Strategy. Am J Public Health. 2011 Sep;101(9):e4–8. pmid:21778507
  30. 30. Mahle Gray K, Tang T, Shouse L, Li J, Mermin J, Hall HI. Using the HIV surveillance system to monitor the National HIV/AIDS Strategy. Am J Public Health. 2013 Jan;103(1):141–147. pmid:23153150