Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Effectiveness of mobile phone text message reminder interventions to improve adherence to antiretroviral therapy among adolescents living with HIV: A systematic review and meta-analysis

  • Nishant Mehra ,

    Roles Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    drnishantmehra16@gmail.com

    Affiliation Child and Family Health Unit, Department of Health Science, Faculty of Medicine, Lund University, Lund, Sweden

  • Abayneh Tunje,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliations Child and Family Health Unit, Department of Health Science, Faculty of Medicine, Lund University, Lund, Sweden, School of Public Health, College of Medicine and Health Sciences, Arba Minch University, Arba Minch, Ethiopia

  • Inger Kristensson Hallström,

    Roles Conceptualization, Funding acquisition, Project administration, Supervision, Writing – review & editing

    Affiliation Child and Family Health Unit, Department of Health Science, Faculty of Medicine, Lund University, Lund, Sweden

  • Degu Jerene

    Roles Funding acquisition, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation KNCV Tuberculosis Foundation, The Hague, Netherlands

Abstract

Background

Poor adherence to antiretroviral therapy in adolescents living with HIV is a global challenge. One of the key strategies to improve adherence is believed to be the use of digital adherence tools. However, evidence is limited in this area. Our objective was to investigate the effectiveness of mobile phone text message reminders in improving ART adherence for adolescents.

Methods

The preferred reporting item for systematic review and meta-analysis guideline was followed. A literature search was done in five databases (PubMed, Web of Science, Embase, Global Health and Cochrane) in August 2020. Additional searches for studies and grey literature were performed manually. We included studies with quantitative design exploring the effectiveness of text message reminders, targeting adolescents aged 10–19 years. Studies were excluded if the intervention involved phone calls, phone-based applications, or other complex tech services. Mean differences between intervention and standard of care were computed using a random effects model. Subgroup analyses were performed to identify sources of heterogeneity between one-way and two-way text messages.

Results

Of 2517 study titles screened, seven eligible studies were included in the systematic review. The total number of participants in the included studies was 987, and the study sample varied from 14 to 332. Five studies showed a positive impact of text messaging in improving adherence, while no significant difference was found between the intervention and the control (standard of care) group in the remaining two studies. The pooled mean difference between the intervention and the control group was 0.05 (95% CI: –0.08 to 0.17). There was considerable heterogeneity among the studies (I2 = 78%).

Conclusion and recommendation

The meta-analysis of text message reminder interventions did not show a statistically significant difference in the improvement of ART adherence among adolescents living with HIV. The included studies were heterogeneous in the reported clinical outcomes, where the effectiveness of the intervention was identified in small studies which had a short follow-up period. Studies with bigger sample size and a longer follow-up period are needed.

Introduction

Human Immunodeficiency Virus (HIV), which causes Acquired Immunodeficiency Syndrome (AIDS), is one of the world’s most serious health and development challenges. Since the beginning of the HIV pandemic, more than 76 million people have been infected with HIV [1], and about 38 million people are currently living with HIV [2]. More than half of the disease burden for HIV is in East and Southern Africa, with an estimated 730,000 new cases in 2019. The latest estimates suggest that approximately 1.7 million adolescents have HIV, accounting for about 5% of all people living with HIV (PLHIV) [3, 4]. The definition of an adolescent used in this study is a person aged 10–19 years [5]. The adolescent age group is further subcategorised into early adolescents (10–15 years), middle adolescents (14–17 years) and late adolescents (16–19 years) [6].

With an emphasis on viral suppression, the Joint United Nations Programme on HIV/AIDS launched a 90-90-90 initiative in 2014 [7]. A target was set for 2020 that 90% of people living with HIV know their status, 90% of those who know their status start treatment, and 90% of those on treatment achieve viral suppression [7]. At the end of 2019, 12.6 million people (33% of people living with HIV) did not have access to antiretroviral therapy (ART) [8]. An estimated 840,000 children did not have access to ART at the end of 2019, amounting to 47% of all children living with HIV [8]. Even though ART has achieved great success, the 2020 treatment targets seem unachievable for many countries. Because of significant improvements in access to ART over the last decade, the annual AIDS-related death rate has declined significantly since 2003, with over 70% decrease in the age range of 0–9 years, but the decline in adolescents is a mere six percentage points [9, 10]. In 2019, global AIDS-related deaths among those aged below 15 years numbered 95,000 [8]. Also, retention in care and adherence to ART regimens have been increasingly seen as a challenge in the global fight against this pandemic. Treatment adherence is defined as how patients’ medication-taking behaviour corresponds to their health care professionals’ recommendations, including taking medications daily at roughly the same time without missing doses [11]. It is the key to better health outcomes in chronic diseases like HIV, and it also helps to limit onward transmission, thus helping to reduce the burden of disease [10, 12]. For optimal viral suppression, an adherence rate of more than 95% is widely cited [13]. However, recent studies suggest that even moderate adherence to potent ART regimens can achieve viral suppression [14]. Parienti et al. point to sustained treatment interruptions leading to viral rebound rather than interspersed missed doses [15]. Studies suggest that globally about 60% of adolescents adhere to ART [16]. Poor ART adherence leads to accelerated progression of PLHIV to AIDS [17], resulting in increased morbidity and mortality [18].

Frequently reported barriers to adherence to ART among adolescents are forgetfulness [1921], stigmatisation of status disclosure [19, 21, 22], adverse effects of medication [19], anxiety, depression and substance abuse [1922], financial constraints [21] and accessibility issues [19]. For these reasons, the World Health Organization (WHO) asserts the need for a better support system for adolescents to improve their adherence to ART [23].

Since the beginning of the 21st century, access to the internet and mobile phones among adolescents has improved globally [24]. This has stimulated an interest in exploring the role of information, communication, and technology in health, also known as eHealth [25]. The WHO Global Observatory for eHealth defines eHealth as “the use of information and communication technologies (ICT) for health” [26]. This involves the delivery of health information by using mobile phones’ short message service (SMS), patient monitoring devices, and internet-based components (social media, computer software, websites, mobile apps, games, and chat rooms) [27]. Mobile health (mHealth) technology is a specific kind of eHealth service that is defined by the Healthcare Information and Management Systems Society (HIMSS) as the use of small, portable computers or telecommunication equipment to meet the needs of health care and improve the quality of clinical research and healthcare on a global scale.

In the past decade, several studies have explored the acceptability, feasibility, and utility of eHealth and mHealth interventions to improve adherence among patients living with chronic diseases [2831]. The advantages of using mHealth interventions are their low cost, making them suitable for use in low- and middle-income countries (LMIC), along with their convenience and accessibility. Besides, mHealth can provide users with a private space to curb the discrimination and stigma associated with HIV [3235]. However, the path to mHealth incorporation into clinical care is fraught with many challenges [36].

In this study, the effect of a text message reminder intervention on ART adherence in adolescents living with HIV is explored by performing a systematic review and a meta-analysis. A text message is a simple mHealth service where patients receive an SMS reminding them to take their medication on time. The SMS is sent at a predetermined time, usually before the scheduled medication intake time for the patient as recommended by their doctors. Commonly the service can be categorised as either a one-way text message (patient receiving an SMS from the care provider) or a two-way text message (patient having the opportunity to respond to the SMS). A text message can be received on a mobile phone with basic features. This intervention avoids stigma and can be rolled out in a resource-limited setting. Previous studies have shown the effectiveness of mHealth interventions in improving treatment adherence among adults living with HIV [3740], and the evidence is emerging in the adolescent age group.

This study therefore aims to identify and investigate the current literature looking into the effectiveness of mobile phone text message reminders in improving ART adherence among adolescents.

Methods

The preferred reporting item for systematic review and meta-analysis (PRISMA) guidelines was followed [41]. The search was based on a PICO (Population/Problem, Intervention, Control and Outcome) question with explicit inclusion and exclusion criteria: Does targeted mobile text messaging improve adherence to antiretroviral treatment among adolescents living with HIV compared to a “standard of care”?

Criteria for study selection

The inclusion criteria were: all peer-reviewed articles, registered trials and conference abstracts and posters available in English where the search for the records was not restricted to a time limit; HIV as the primary focus of the study; mobile phone text messaging (SMS) reminder as an intervention to improve adherence; using either adherence to ART (measured in different ways) or viral load as the study outcome; quantitative study design investigating the impact of text message reminders (cohort studies and randomised control trials (RCT)).

Studies were excluded if: phone calls or sophisticated mHealth or eHealth interventions such as smartphone applications, social media, internet etc.; the majority of study participants (more than 50%) do not belong to the adolescent age group as ascertained by reported mean age and standard deviation; qualitative study design, systematic reviews and meta-analysis and quantitative study design that do not account for effectiveness (cross-sectional studies etc.).

Source of data and search strategy

Under the guidance of a librarian, a comprehensive search strategy was developed. The search was performed using a combination of keywords and truncated terms in two sets using Boolean search strategy (intervention and disease): “mobile phone*”, “cell phone*”, “text reminder*”, “text messages*”, “phone based*” and “HIV”, “AIDS”, “ART”, “Antiretroviral therap*”. The literature search was done on PubMed, Embase, Web of Science, Global Health (CABI) and Cochrane databases on 18 August 2020. In the Embase database search, citations unique to this database were only included using the “Source” function. Additional articles were identified by hand searching the reference list of the screened articles, www.clinicaltrials.gov, Grey Literature Report, International AIDS Society–conference abstracts, Conferences on Retroviruses and Opportunistic Infections [42]. Citations of all studies were downloaded to EndNote 8 citation manager software [43], where they were further sorted.

Study selection

After removing the duplicates from the search hits, first titles and then abstracts were screened by NM based on the inclusion criteria. Later, full texts were read by two authors (NM and AT) and assessed based on the exclusion criteria. Fig 1 shows the detailed process of the screening and selection process. Disagreement concerning the inclusion of a study was resolved by the third and fourth researcher (IKH and DJ).

Data extraction and quality assessment

For each study, data on demographics, interventions and outcomes were extracted independently by two authors (NM and AT). This process was guided by Cochrane’s data collection recommendations [44]. Later data were tabulated into two tables: (1) study characteristics and (2) interventions and adherence results. Cochrane’s risk assessment tool was used to assess the quality of the included randomised studies at the level of individual studies [45]. Studies with a non-randomised study design were assessed using the Risk of Bias in Non-randomised Studies of Interventions (ROBINS-I) tool [46].

Quantitative analysis

A meta-analysis was undertaken where pooled mean differences in adherence for the intervention versus standard of care was calculated. Most studies included in this systematic review reported adherence to ART as a continuous outcome (mean adherence). Therefore, mean adherence was chosen as the outcome measure for quantitative analysis. For the meta-analysis, adherence is defined as how a participants’ pill count or MEMS data corresponds to their doctor’s prescription regimen during the period of trial. Mean adherence is a continuous variable that can take a value from 0–1, where 0 represents nil adherence, and 1 represent perfect adherence. The data used in the analysis were mean adherence rates, standard deviation, and the number of participants in each intervention arm. Where standard deviation was not available, other effect measures such as confidence intervals were converted to fit the model. If it was not possible to transform the effect measures without access to raw data, studies were excluded from the meta-analysis. Due to the anticipated heterogeneity of the structure of intervention, a random effects model was used to estimate the pooled mean difference between the intervention arms with a 95% confidence interval. Studies with a similar intervention (one-way text message, two-way text message and short follow-up (<6 months)) were further analysed in sub-groups using a fixed effects model. All statistical analyses were performed using Review Manager (version 5.4; The Nordic Cochrane Centre, The Cochrane Collaboration, Copenhagen, Denmark).

Results

Study characteristics

A total of 2517 study titles were screened based on the study selection criteria. Seven studies were included in the review; five RCTs (two in the USA and one each in Uganda, Nigeria, and Cameroon) and two cohort studies (one each in USA and Argentina) analysing the effect of mobile text reminders for improving adherence to ART among adolescents living with HIV were included (Fig 1). The total number of participants in the included studies was 987, and the study sample varied from 14 to 332 (Table 1). Of the seven studies included, four were peer-reviewed articles [4750], two studies were registered trials with available results [51, 52] and a conference poster with results [53].

The mean age of the participants in most studies was in the late adolescent age group (16–19 years). One study had over 80% male participants [47], another had 69% females [50]. The remaining studies were more gender-equal. Six studies reported sub-optimal baseline adherence levels among recruited participants. Three studies [47, 48, 51] mentioned recruiting patients with experience of treatment (patient started ART at least six months before recruitment to trial) (Table 1). One study mentioned speaking English as a criterion for inclusion [53]. Access to mobile phones was an inclusion criterion in all the included studies. The study participants in all studies received text messages. In the study by Stankievich et al., about 30% of the participants’ parents received the text message [50].

Quality assessment and risk of bias

Of the five RCTs that were analysed using the Cochrane risk assessment tool, three–Linnemayr (2017), Abiodun (2019), and Ketchaji (2019)–were deemed to have a low risk of bias (Fig 2). The main concern with these studies was that the participants in different intervention arms were not blinded due to the unique nature of the intervention. Mimiaga’s (2019) study was judged to be at high risk of bias due to incomplete and selective reporting of outcomes compared with their research protocol [49, 55]. Jeffries’ (2016) study was judged to have an unclear risk of bias as this was a poster study and raw data could not be accessed. The two cohort studies by Hailey (2013), and Stankievich (2014), were assessed based on the ROBINS-I tool and judged to be at serious risk of bias as they lacked a control group. Overall, studies with a bigger sample size were found to be at low risk of bias [48, 52].

thumbnail
Fig 2. Quality assessment of included studies that were randomised.

https://doi.org/10.1371/journal.pone.0254890.g002

Summary of included studies

Overall, four studies had only text messages as their intervention, while the others included counselling or peer support as a part of both intervention and standard of care (Table 2). The primary outcome was reported either as medication adherence or viral load. Three studies (Hailey 2013, Abiodun 2019, and Ketchaji 2019) used self-reported data for outcome assessment, while two studies (Linnemayr 2014 and Mimiaga 2019) documented using a medication event monitoring system (MEMS) in addition to self-reported data. Medication adherence was reported as a mean adherence rate, odds ratio, or using a visual analogue scale (VAS) score. A laboratory test was used to report viral load, and this was reported as number of copies/ml. The follow-up period ranged from 4 months to 24 months. Most studies had a drop-out rate of less than 5% [47, 49, 52], while two studies had a drop-out of up to 19% [48, 54].

Assessment of the effectiveness of text messaging

Of the total seven reviews, five reported a positive impact of text messaging in improving treatment adherence: 3 RCTs (Jeffries 2016, Ketchaji 2019, and Mimiaga 2019) and 2 cohort studies (Hailey 2013 and Stankievich 2014) (Table 2). RCTs by Linnemayr (2014) and Abiodun (2019) showed no significant difference between the comparison groups. The unit of analysis in the meta-analysis was mean adherence, and this was the reported effect measure in the 3 RCTs: Abiodun et al. (2019), Linnemayr et al. (2014), and Mimiaga et al. (2019).

The pooled mean adherence difference was found to be 0.05 (Fig 3). However, these studies showed statistical heterogeneity (I2 = 78%). Sub-group analysis of studies found no difference in mean ART adherence (mean difference = 0.00) among adolescents who receive only text message (one way) (Fig 4). For a sub-group analysis of a two-way text message intervention, the pooled mean difference was –0.03 (Fig 5).

thumbnail
Fig 3. Forest plot of text message reminder versus standard of care for ART adherence.

https://doi.org/10.1371/journal.pone.0254890.g003

thumbnail
Fig 4. Forest plot of a sub-group analysis of one-way text message versus standard of care for ART adherence.

https://doi.org/10.1371/journal.pone.0254890.g004

thumbnail
Fig 5. Forest plot of a sub-group analysis of two-way text message versus standard of care for ART adherence.

https://doi.org/10.1371/journal.pone.0254890.g005

A third subgroup analysis focusing on studies with a short follow-up period suggests that the overall effect of the intervention is insignificant (p-value = 0.15) (Fig 6).

thumbnail
Fig 6. Forest plot of a sub-group analysis of text message versus standard of care of studies with short follow-up period.

https://doi.org/10.1371/journal.pone.0254890.g006

Discussion

This systematic review identified seven eligible studies, which consisted of five RCTs and two cohort studies. The cohort studies showed a positive effect of the intervention but were judged to be at serious risk of bias as they lacked a control group. Of the five RCTs, three [47, 49, 51] demonstrated the effectiveness of mobile text messaging in improving ART treatment adherence among adolescents. However, the remaining two RCTs [48, 52] did not significantly differ between the intervention and comparison groups. A meta-analysis of three studies [48, 49, 52] showed considerable heterogeneity among the included studies and no significant pooled mean difference between the intervention arms. The meta-analysis findings were further affirmed by sub-group analyses, where no significant effect of the intervention was found compared to the standard of care.

To our knowledge, this is the first adolescent-specific systematic review of the effectiveness of mobile text messaging in improving adherence to ART. Several previous reviews assessing the effectiveness of text message reminders and other mobile phone-based interventions in improving ART adherence found the intervention to be effective among adults [37, 38, 56]. A meta-analysis study performed in the USA among adults revealed that mobile text message reminders significantly improved antiretroviral therapy adherence and viral load and/or CD4+count [57]. This was not evident in the present meta-analysis, which may be attributed to the heterogeneity of the studies included. However, a sub-group analysis for a one-way text message with no statistical heterogeneity also lacked an effect in improving adherence.

Studies in the adult age group in LMIC countries showed improved adherence in small samples and short follow-up [58, 59]. In the present review, findings from LMIC are unclear as the study from Cameroon [54] found improved adherence among adolescents, but this was contrary to the findings from studies conducted in Nigeria [52] and Uganda [48]. Most studies with a positive impact of text messaging in the current review were from high-income countries and had a small sample size [47, 49, 50]. However, these were judged to be at high risk of bias. Additionally, a small study effect cannot be ruled out in this case. These findings highlight the differences between adults and adolescents in their response to mobile phone text messaging regarding adherence to ART and the quality of evidence currently available. Fewer studies focusing on the adolescent age group may be a reason behind the differing findings.

Most of the studies included in the present review enrolled participants in the late adolescent age group [4749, 5153]. This may be because, in most countries, the legal age of consent for medical intervention is in the late adolescent years. Thus, age may be a deterrent for conducting trials with the early adolescent age group because obtaining a guardian’s consent may affect privacy. Accessibility to mobile phones was an inclusion criterion in all the studies, and this may have discouraged researchers from enrolling early age adolescents as they are comparatively less likely to have access to a mobile phone. Although adolescents’ access to mobile phones has increased in the past couple of decades, it still varies between countries depending on individuals’ socioeconomic status and the cultural norms of the society [60]. A recent study showed the acceptability of a text message reminder intervention to patients in urban and rural settings [60]. However, a study by Rana et al. [61] asserts the need to maintain confidentiality, which can be challenging if participants do not own a mobile phone or share it with other people at home [61]. Therefore, the feasibility of implementing such interventions in adolescents needs to be explored further at a community level.

Though eHealth and mHealth interventions are increasingly being used for chronic health conditions, this review found that few studies have looked at the late adolescent age group (16–19 years). The current evidence base is particularly meagre in resource-limited settings where we expect patients to benefit more from low-cost mHealth interventions. Therefore, more trials with larger study populations in LMIC are called for, and more evidence for the early adolescent age group is required.

Based on the overall assessment, the effectiveness of text reminders in improving adherence to ART remains inconclusive due to small studies that enrolled non-adherent treatment initiators. This might be due to the lower power of the included studies and the fact that few interventional studies have been conducted in the adolescent age group. There is a need to explore the potential of text messaging interventions further, especially with multi-component elements such as two-way messaging in adolescents. Future trials should have a larger sample size and a more extended follow-up period to have more power in the findings. The potential of text messages beyond reminders needs to be further explored.

The present study has both strengths and limitations. This is a comprehensive review of text message reminder interventions to improve ART adherence in the adolescent age group. In the process, a thorough search strategy was implemented under the guidance of an expert librarian, strengthening the validity of our findings. Further attempts were made to reach out to the authors of the included studies to gain access to raw data. Another strength of this study was the use of a mean age of participants in the included studies as a criterion, which contributes to the credibility of our findings as we intended to investigate a specific population. Since adolescent-specific systematic reviews are lacking on this topic, it makes this study a pioneering contribution to the field.

We also acknowledge some limitations in our study. Of the seven studies included in the current review, three were not published in peer-reviewed journals. This raises concerns about the overall quality of the evidence produced by these studies, and therefore entails the limitation that the results are based on data with questionable credibility. Moreover, five studies used self-reported data, which is considered a less sensitive measure of adherence than MEMS and tends to overestimate adherence [62]. We think that the inclusion of self-reported data in our meta-analysis may affect the validity of our findings, and this is therefore a limitation of the present study. Finally, variation in reported outcome (continuous or binary) and units posed a challenge to include most studies in the meta-analysis. Odds ratio is a more common outcome measure for adherence in a meta-analysis that evaluates a binary outcome. In the current study, the included studies dichotomised adherence at different points that posed a challenge to have odds ratio as an outcome measure. Nevertheless, the findings of this meta-analysis can guide the research potential of text messaging in adolescents.

Conclusion

There is a limited number of studies assessing the effectiveness of mobile phone text reminders in improving adherence to ART among adolescents. Adolescents were the sole recipients of the text messages in most of the studies. The few available studies have critical methodological weaknesses, including a lack of control groups and small sample sizes. Our review of the available evidence nevertheless suggests a positive impact of mobile phone text reminders on adherence to ART among adolescents. The included studies were heterogeneous in the reported clinical outcome. The meta-analysis showed no significant improvement in adherence. Further studies with a more rigorous design are needed to assess the effectiveness of mobile phone text messaging in improving ART adherence in the adolescent age group.

Acknowledgments

The authors would like to thank Ms. Maria Bjorklund for her guidance in developing the literature search strategy.

References

  1. 1. UNAIDS. Global HIV & AIDS statistics—2020 fact sheet 2020 [Available from: www.unaids.org/en/resources/fact-sheet].
  2. 2. UNAIDS. 2020 Global AIDS Update: Seizing the Moment AIDSinfo website: UNAIDS; 2020 [Available from: http://aidsinfo.unaids.org/].
  3. 3. UNICEF. HIV and AIDS in adolescents 2020 [Available from: https://data.unicef.org/topic/adolescents/hiv-aids/].
  4. 4. World Health Organization Guideline on when to start antiretroviral therapy and on pre-exposure prophylaxis for HIV. World Health Organization, editor: World Health Organization; 2015.
  5. 5. World Health Organization. Consolidated Guidelines on the use of Antiretroviral Drugs for treating and preventing HIV infection Recommendations for a public health approach Switzerland: WHO; 2013 [Available from: https://apps.who.int/iris/rest/bitstreams/304490/retrieve].
  6. 6. World Health Organization. Stages of Adolescent Development 2010 [Available from: https://apps.who.int/adolescent/second-decade/section/section_2/level2_2.php].
  7. 7. Joint United Nations Programme on HIV/AIDS (UNAIDS). Ending AIDS Progress towards the 90–90–90 targets: UNAIDS; 2020 [Available from: https://www.unaids.org/en/resources/documents/2017/20170720_Global_AIDS_update_2017].
  8. 8. UNAIDS. Seizing the Moment 2020 [Available from: https://aids2020.unaids.org/report/].
  9. 9. UNICEF. While there has been promising progress in the HIV response, children continue to be affected by the epidemic 2020 [Available from: https://data.unicef.org/topic/hivaids/global-regional-trends/].
  10. 10. World Health Organization. Global HIV/AIDS response: epidemic update and health sector progress towards universal access: progress report 2011 2011 [Available from: https://apps.who.int/iris/handle/10665/44787].
  11. 11. World Health Organization. Adherence to long-term therapies: evidence for action Switzerland2003 [Available from: https://apps.who.int/iris/bitstream/handle/10665/42682/9241545992.pdf].
  12. 12. Cohen M. S., Chen Y. Q., McCauley M., Gamble T., Hosseinipour M. C., Kumarasamy N. et al. Prevention of HIV-1 infection with early antiretroviral therapy. The New England journal of medicine. 2011;365(6):493–505. pmid:21767103
  13. 13. Paterson D. L., Swindells S., Mohr J., Brester M., Vergis E., Squier C. et al. Adherence to Protease Inhibitor Therapy and Outcomes in Patients with HIV Infection. Annals of internal medicine. 2000;133:21–30. pmid:10877736
  14. 14. Bangsberg D. R. Less Than 95% Adherence to Nonnucleoside Reverse-Transcriptase Inhibitor Therapy Can Lead to Viral Suppression. Clinical Infectious Diseases. 2006;43(7):939–41. pmid:16941380
  15. 15. Parienti J. J., Das-Douglas M., Massari V., Guzman D., Deeks S. G., Verdon R. et al. Not all missed doses are the same: sustained NNRTI treatment interruptions predict HIV rebound at low-to-moderate adherence levels. PLoS One. 2008;3(7):e2783. pmid:18665246
  16. 16. Kim S.-H., Gerver S. M., Fidler S., Ward H. Adherence to antiretroviral therapy in adolescents living with HIV: systematic review and meta-analysis. AIDS. 2014;28(13). pmid:24845154
  17. 17. Hamine S., Gerth-Guyette E., Faulx D., Green B. B., Ginsburg A. S. Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review. Journal of medical Internet research. 2015;17(2):e52–e. pmid:25803266
  18. 18. Paterson D. L., Swindells S., Mohr J., Brester M., Vergis E. N., Squier C. et al. Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Annals of internal medicine. 2000;133(1):21–30. pmid:10877736
  19. 19. World Health Organization. Chapter 9: Guidance on operations and service delivery: WHO; 2013 [Available from: https://www.who.int/publications/i/item/9789241505727].
  20. 20. MacDonell K., Naar-King S., Huszti H., Belzer M. Barriers to medication adherence in behaviorally and perinatally infected youth living with HIV. AIDS and behavior. 2013;17(1):86–93. pmid:23142855
  21. 21. Achappa B., Madi D., Bhaskaran U., Ramapuram J. T., Rao S., Mahalingam S. Adherence to Antiretroviral Therapy Among People Living with HIV. N Am J Med Sci. 2013;5(3):220–3. pmid:23626959
  22. 22. Kuhns L. M., Hotton A. L., Garofalo R., Muldoon A. L., Jaffe K., Bouris A. et al. An Index of Multiple Psychosocial, Syndemic Conditions Is Associated with Antiretroviral Medication Adherence Among HIV-Positive Youth. AIDS patient care and STDs. 2016;30(4):185–92. pmid:27028184
  23. 23. World Health Organization. HIV and adolescents: guidance for HIV testing and counselling and care for adolescents living with HIV: recommendations for a public health approach and considerations for policy-makers and managers 2013 [Available from: https://www.who.int/publications/i/item/9789241506168].
  24. 24. Pew Research Centre. Smartphone Ownership and Internet Usage Continues to Climb in Emerging Economies Washinton DC, USA2016 [Available from: https://www.pewresearch.org/global/2016/02/22/smartphone-ownership-and-internet-usage-continues-to-climb-in-emerging-economies/].
  25. 25. World Health Organization. mhealth New horizons for health through mobile technologies Geneva, Switzerland2011 [1–102]. Available from: https://www.who.int/goe/publications/goe_mhealth_web.pdf].
  26. 26. World Health Organization. Global diffusion of eHealth: Making universal health coverage achievable. Report of the third global survey on eHealth: WHO; 2016 [Available from: https://www.who.int/publications/i/item/9789241511780].
  27. 27. Ventola C. L. Mobile devices and apps for health care professionals: uses and benefits. P T. 2014;39(5):356–64. pmid:24883008
  28. 28. Ybarra M. L., Bull S. S. Current trends in internet-and cell phone-based HIV prevention and intervention programs. Current HIV/AIDS Reports. 2007;4(4):201–7. pmid:18366952
  29. 29. Mulawa M. I., LeGrand S., Hightow-Weidman L. B. eHealth to Enhance Treatment Adherence Among Youth Living with HIV. Current HIV/AIDS reports. 2018;15(4):336–49. pmid:29959649
  30. 30. Belzer M. E., Kolmodin MacDonell K., Clark L. F., Huang J., Olson J., Kahana S. Y. et al. Acceptability and Feasibility of a Cell Phone Support Intervention for Youth Living with HIV with Nonadherence to Antiretroviral Therapy. AIDS patient care and STDs. 2015;29(6):338–45. pmid:25928772
  31. 31. Déglise C., Suggs L. S., Odermatt P. SMS for disease control in developing countries: a systematic review of mobile health applications. Journal of telemedicine and telecare. 2012;18(5):273–81. pmid:22826375
  32. 32. Daher J., Vijh R., Linthwaite B., Dave S., Kim J., Dheda K. et al. Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996–2017). BMJ open. 2017;7(11):e017604–e. pmid:29101138
  33. 33. Rao D., Frey S., Ramaiya M. eHealth for Stigma Reduction Efforts Designed to Improve Engagement in Care for People Living with HIV. Current HIV/AIDS reports. 2018;15(6):397–402. pmid:30232579
  34. 34. Ronen K., Unger J. A., Drake A. L., Perrier T., Akinyi P., Osborn L. et al. SMS messaging to improve ART adherence: perspectives of pregnant HIV-infected women in Kenya on HIV-related message content. AIDS Care—Psychological and Socio-Medical Aspects of AIDS/HIV. 2018;30(4):500–5. pmid:29254362
  35. 35. Sidney K., Antony J., Rodrigues R., Arumugam K., Krishnamurthy S., D’Souza G. et al. Supporting patient adherence to antiretrovirals using mobile phone reminders: Patient responses from South India. Aids Care-Psychological and Socio-Medical Aspects of Aids/Hiv. 2012;24(5):612–7. pmid:22150088
  36. 36. Steinhubl S. R., Muse E. D., Topol E. J. The emerging field of mobile health. Science translational medicine. 2015;7(283):283rv3-rv3. pmid:25877894
  37. 37. Amankwaa I., Boateng D., Quansah D. Y., Akuoko C. P., Evans C. Effectiveness of short message services and voice call interventions for antiretroviral therapy adherence and other outcomes: A systematic review and meta-analysis. PLoS ONE. 2018;13(9). pmid:30240417
  38. 38. Free C., Phillips G., Galli L., Watson L., Felix L., Edwards P. et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS medicine. 2013;10(1):e1001362. pmid:23349621
  39. 39. Lester R. T., Mills E. J., Kariri A., Ritvo P., Chung M., Jack W. et al. The HAART cell phone adherence trial (WelTel Kenya1): A randomized controlled trial protocol. Trials. 2009;10:87. pmid:19772596
  40. 40. Pop-Eleches C., Thirumurthy H., Habyarimana J. P., Zivin J. G., Goldstein M. P., de Walque D. et al. Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. Aids. 2011;25(6):825–34. pmid:21252632
  41. 41. Moher D., Liberati A., Tetzlaff J., Altman D. G., The P. G. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLOS Medicine. 2009;6(7):e1000097. pmid:19621072
  42. 42. Jones R., Hoover D. R., Lacroix L. J. A randomized controlled trial of soap opera videos streamed to smartphones to reduce risk of sexually transmitted human immunodeficiency virus (HIV) in young urban African American women. Nursing outlook. 2013;61(4):205-15.e3. pmid:23743482
  43. 43. Reuters T. EndNote X8.2 for Windows. Clarivate Analytics; 2018.
  44. 44. Higgins J., MyiLibrary, Green S. P. Cochrane handbook for systematic reviews of interventions. [electronic resource]: Cochrane Collaboration; 2008.
  45. 45. Higgins J. P. T., Altman D. G., Gøtzsche P. C., Jüni P., Moher D., Oxman A. D. et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ (Clinical research ed). 2011;343:d5928. pmid:22008217
  46. 46. Sterne J. A., Hernán M. A., Reeves B. C., Savović J., Berkman N. D., Viswanathan M. et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ (Clinical research ed). 2016;355:i4919–i. pmid:27733354
  47. 47. Hailey J., Arscott J. Using Technology to Effectively Engage Adolescents and Young Adults into Care: STAR TRACK Adherence Program. The Journal of the Association of Nurses in AIDS Care: JANAC. 2013;24. pmid:23809658
  48. 48. Linnemayr S., Huang H., Luoto J., Kambugu A., Thirumurthy H., Haberer J. E. et al. Text Messaging for Improving Antiretroviral Therapy Adherence: No Effects After 1 Year in a Randomized Controlled Trial Among Adolescents and Young Adults. American journal of public health. 2017;107(12):1944–50. pmid:29048966
  49. 49. Mimiaga M. J., Bogart L. M., Thurston I. B., Santostefano C. M., Closson E. F., Skeer M. R. et al. Positive Strategies to Enhance Problem-Solving Skills (STEPS): A Pilot Randomized, Controlled Trial of a Multicomponent, Technology-Enhanced, Customizable Antiretroviral Adherence Intervention for HIV-Infected Adolescents and Young Adults. AIDS patient care and STDs. 2019;33(1):21–4. pmid:30601059
  50. 50. Stankievich E., Malanca A., Foradori I., Ivalo S., Losso M. Utility of Mobile Communication Devices as a Tool to Improve Adherence to Antiretroviral Treatment in HIV-Infected Children and Young Adults in Argentina. The Pediatric Infectious Disease Journal. 2017;37:1. pmid:29023355
  51. 51. Ketchaji. Retention and adherence among adolescents living with HIV: an overview of the Centre region of Cameroon: Pan African Clinical Trial Registry; 2019 [Available from: https://pactr.samrc.ac.za/TrialDisplay.aspx?TrialID=5757].
  52. 52. Abiodun et al. The Effectiveness of SMS in Improving Antiretroviral Medication Adherence Among Adolescents Living With HIV in Nigeria (STARTA) [Clinical trial]. Nigeria: Babcock University; 2019 [updated 15 November. Available from: https://clinicaltrials.gov/ct2/show/results/NCT03394391?term=mobile+phone+reminders&cond=HIV+Infections&draw=2&rank=4&view=results].
  53. 53. Jeffries C., Ross P., Matoff-Stepp S., Thompson R., Harris J. L., Uhrig J. D. et al. UCARE4LIFE: Mobile Texting to Improve HIV Care Continuum Outcomes for Minority Youth. Conference on Retroviruses and Opportunistic Infections; February 22–25; Boston, Massachusetts2016.
  54. 54. Ketchaji et al. Text messaging and peer mentorship interventions to improve adherence and achieve viral load suppression among Adolescents living with HIV in the Centre region of Cameroon International Workshop on HIV & Adolescence 20192019 [Available from: http://regist2.virology-education.com/digital_abstracts/2019/HIVAdolescence/Abstract_10.pdf].
  55. 55. Mimiaga M. J., Kuhns L. M., Biello K. B., Olson J., Hoehnle S., Santostefano C. M. et al. Positive STEPS—a randomized controlled efficacy trial of an adaptive intervention for strengthening adherence to antiretroviral HIV treatment among youth: study protocol. BMC Public Health. 2018;18(1):867. pmid:30001703
  56. 56. Horvath T., Azman H., Kennedy G. E., Rutherford G. W. Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. The Cochrane database of systematic reviews. 2012;2012(3):Cd009756. pmid:22419345
  57. 57. Finitsis D. J., Pellowski J. A., Johnson B. T. Text message intervention designs to promote adherence to antiretroviral therapy (ART): a meta-analysis of randomized controlled trials. PLoS One. 2014;9(2):e88166. pmid:24505411
  58. 58. Demena B. A., Artavia-Mora L., Ouedraogo D., Thiombiano B. A., Wagner N. A Systematic Review of Mobile Phone Interventions (SMS/IVR/Calls) to Improve Adherence and Retention to Antiretroviral Treatment in Low-and Middle-Income Countries. AIDS patient care and STDs. 2020;34(2):59–71. pmid:32049555
  59. 59. Bärnighausen T., Chaiyachati K., Chimbindi N., Peoples A., Haberer J., Newell M. L. Interventions to increase antiretroviral adherence in sub-Saharan Africa: A systematic review of evaluation studies. The Lancet Infectious Diseases. 2011;11(12):942–51. pmid:22030332
  60. 60. Cele M. A., Archary M. Acceptability of short text messages to support treatment adherence among adolescents living with HIV in a rural and urban clinic in KwaZulu-Natal. Southern African Journal of Hiv Medicine. 2019;20(1). pmid:31616573
  61. 61. Rana Y., Haberer J., Huang H., Kambugu A., Mukasa B., Thirumurthy H. et al. Short message service (SMS)-based intervention to improve treatment adherence among HIV-positive youth in Uganda: focus group findings. PLoS One. 2015;10(4):e0125187. pmid:25881059
  62. 62. Arnsten J. H., Demas P. A., Farzadegan H., Grant R. W., Gourevitch M. N., Chang C. J. et al. Antiretroviral therapy adherence and viral suppression in HIV-infected drug users: comparison of self-report and electronic monitoring. Clinical infectious diseases: an official publication of the Infectious Diseases Society of America. 2001;33(8):1417–23. pmid:11550118