Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Assessing private provider perceptions and the acceptability of video observed treatment technology for tuberculosis treatment adherence in three cities across Viet Nam

  • Lan Huu Nguyen,

    Roles Conceptualization, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Pham Ngoc Thach Hospital, Ho Chi Minh City, Viet Nam

  • Phuong Thi Minh Tran,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Friends for International TB Relief, Hanoi, Viet Nam

  • Thu Anh Dam,

    Roles Conceptualization, Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    Affiliation Friends for International TB Relief, Hanoi, Viet Nam

  • Rachel Jeanette Forse,

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Friends for International TB Relief, Hanoi, Viet Nam

  • Andrew James Codlin,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Friends for International TB Relief, Hanoi, Viet Nam

  • Huy Ba Huynh,

    Roles Data curation, Investigation, Validation, Writing – review & editing

    Affiliation Friends for International TB Relief, Hanoi, Viet Nam

  • Thuy Thi Thu Dong,

    Roles Data curation, Investigation, Validation, Writing – review & editing

    Affiliation Friends for International TB Relief, Hanoi, Viet Nam

  • Giang Hoai Nguyen,

    Roles Supervision, Writing – review & editing

    Affiliation IRD VN, Hanoi, Viet Nam

  • Vinh Van Truong,

    Roles Supervision, Writing – review & editing

    Affiliation Pham Ngoc Thach Hospital, Ho Chi Minh City, Viet Nam

  • Ha Thi Minh Dang,

    Roles Supervision, Writing – review & editing

    Affiliation Pham Ngoc Thach Hospital, Ho Chi Minh City, Viet Nam

  • Tuan Dinh Nguyen,

    Roles Supervision, Writing – review & editing

    Affiliation National Lung Hospital, Hanoi, Viet Nam

  • Hoa Binh Nguyen,

    Roles Supervision, Writing – review & editing

    Affiliation National Lung Hospital, Hanoi, Viet Nam

  • Nhung Viet Nguyen,

    Roles Supervision, Writing – review & editing

    Affiliation National Lung Hospital, Hanoi, Viet Nam

  • Amera Khan,

    Roles Supervision, Writing – review & editing

    Affiliation Stop TB Partnership, Geneva, Switzerland

  • Jacob Creswell,

    Roles Supervision, Writing – review & editing

    Affiliation Stop TB Partnership, Geneva, Switzerland

  •  [ ... ],
  • Luan Nguyen Quang Vo

    Roles Formal analysis, Funding acquisition, Methodology, Project administration, Supervision, Writing – review & editing

    luan.vo@tbhelp.org

    Affiliations Friends for International TB Relief, Hanoi, Viet Nam, IRD VN, Hanoi, Viet Nam

  • [ view all ]
  • [ view less ]

Abstract

Background

The World Health Organization recently recommended Video Observed Therapy (VOT) as one option for monitoring tuberculosis (TB) treatment adherence. There is evidence that private sector TB treatment has substandard treatment follow-up, which could be improved using VOT. However, acceptability of VOT in the private sector has not yet been evaluated.

Methods

We conducted a cross-sectional survey employing a theoretical framework for healthcare intervention acceptability to measure private provider perceptions of VOT across seven constructs in three cities of Viet Nam: Ha Noi, Ho Chi Minh City, and Hai Phong. We investigated the differences in private providers’ attitudes and perceptions of VOT using mixed ordinal models to test for significant differences in responses between groups of providers stratified by their willingness to use VOT.

Results

A total of 79 private providers completed the survey. Sixty-two providers (75%) indicated they would use VOT if given the opportunity. Between private providers who would and would not use VOT, there were statistically significant differences (p≤0.001) in the providers’ beliefs that VOT would help identify side effects faster and in their confidence to monitor treatment and provide differentiated care with VOT. There were also significant differences in providers’ beliefs that VOT would save them time and money, address problems faced by their patients, benefit their practice and patients, and be relevant for all their patients.

Conclusion

Private providers who completed the survey have positive views towards using VOT and specific subpopulations acknowledge the value of integrating VOT into their practice. Future VOT implementation in the private sector should focus on emphasizing the benefits and relevance of VOT during recruitment and provide programmatic support for implementing differentiated care with the technology.

Introduction

In Viet Nam, an estimated 174,000 people developed tuberculosis (TB) in 2019 and there were 13,200 deaths from the disease, despite free treatment being readily available at government health facilities [1]. The country’s National TB Control Program (NTP) has successfully increased the number of TB cases notified, linked more individuals to treatment, and achieved high treatment success rates. The NTP attributes these achievements to robust nationwide coverage of treatment services that included quality-assured diagnostics and standardized treatment regimen with supervision and patient support as well as facility-based directly observed treatment (DOT) as per national treatment guidelines [2].

While studies have found DOT can improve treatment outcomes [3], a more nuanced understanding of treatment observation has emerged in recent years. There are often conflicting views on whether DOT actually results in better treatment outcomes as compared to unsupervised, self-administered treatment. In an attempt to reproduce previous findings on the impact of DOT, McKay et al. found a small, non-statistically significant difference between DOT and self-administered treatment, along with a lack of high-quality evidence to compare these TB treatment methods in the form of prospective cohort or randomized trials [4]. A recent patient costing survey in Viet Nam showed that 63% of people being treated for drug-susceptible TB experienced catastrophic costs (>20% of annual household income spent on the patient’s episode of TB), and the majority of out-of-pocket spending occurred during TB treatment [5]. In recent years, WHO has endorsed a more “patient-centered approach to TB care” and recommended that TB interventions explore other treatment administration options, such as digital technologies to provide more individualized treatment support [6,7].

The implementation of DOT in high-TB burden, low-resource settings also often faces limitations; facility-based DOT requires patients to regularly travel to health facilities, resulting in high costs [8] and the loss of autonomy, privacy and time [9]. Consequently, almost all private-sector treatment sites offer patients self-administration of their medication as an incremental value proposition over NTP’s services [10]. This presents a particular challenge for TB management, as irregular TB treatment adherence—even among patients who achieve treatment completion—is associated with disease relapse and the development of drug resistance [11,12].

In an attempt to address these barriers, recent innovations in technology have sought to make treatment and adherence support more people-centered. Video observed treatment (VOT) is a derivation of DOT in which the observation of dose taking is achieved with either real-time video (synchronous) or recorded (asynchronous) video upload [13]. The asynchronous method of treatment management allows patients to record and transmit a video of themselves ingesting their medication to a central platform. These videos are later reviewed by healthcare workers. This technology eliminates the need for healthcare workers and patients to be in the same physical space and allows for virtual observation at times that are convenient for both the patient and the treatment supporter. These digital approaches have been shown to reduce costs and barriers associated with treatment adherence for patients and has resulted in a higher percentage of completed treatment doses [14,15]. Recent studies comparing DOT to VOT have found the latter to be more effective (achieves higher treatment completion rates) and acceptable (achieves higher patient satisfaction) as a treatment observation tool for both active and latent TB [1618].

VOT implementation in various countries has been shown to be acceptable and feasible in programmatic settings [19,20] and patients enrolled in VOT have similar treatment outcomes compared to those enrolled on DOT [14,18,21]. A number of studies have also found VOT to be effective among patients with drug-resistant TB strains who typically suffer poorer treatment outcomes and require closer monitoring [2224]. One study on VOT was conducted in Viet Nam with patients from NTP clinics in Hanoi. It utilized an asynchronous platform (SureAdhere) and showed that VOT was feasible and resulted in high treatment adherence in a resource-limited setting [21]. Based on the evidence from these studies, the WHO recommended VOT as a viable alternative to DOT [25]. In light of these recommendations and the successful use of VOT in groups with higher risk of being lost to follow-up, such as drug-resistant TB patients, there is an opportunity to expand its use to other areas with consistently poor treatment outcomes.

One of these areas is the private sector. Studies in Viet Nam have found that less than half of TB patients complete treatment in the private sector, compared to about 90% in the public sector [1,26]. Commonly cited reasons are lack of follow-up and case holding [2628]. As a consequence, the private sector is thought to be one of the main sources of the development of drug-resistant forms of TB [29]. This emphasizes the necessity of improving patient care and treatment adherence within the private sector.

Past studies in Viet Nam suggested that more than half of the people with TB ‘missed’ by the NTP in urban areas are seeking care in the private sector [30]. The private sector represents the first point of contact for 70% of persons with TB, and 40% of TB patients are treated exclusively by the private sector [31]. A private provider interface agency model piloted in Ho Chi Minh City (HCMC) between October 2017 and March 2019 discovered 1,112 TB patients being treated in the private sector in two districts of the city [32]. As such, alongside case management, VOT may have the secondary benefit of elucidating the TB burden managed by the private sector through documented treatment monitoring.

VOT can offer tangible public health benefits to TB programs if successfully employed in the private sector. There are many studies that explore patient experiences and attitudes towards mobile health innovations; however, a patient’s initial exposure and attitude towards a new program or intervention is greatly influenced by the way a provider presents the opportunity [33,34]. However, our literature review produced no published studies on provider perceptions of VOT for TB patients, particularly for those in the private sector. As such, this study aimed to conduct formative research to assess the acceptability of VOT among private providers for improved case management and follow-up of their clientele.

Methods

Study design

This was a cross-sectional study implemented from January to September 2019 in three cities across Viet Nam: Ha Noi, Ho Chi Minh City (HCMC), and Hai Phong.

Participant eligibility and recruitment

The target population consisted of private providers actively engaged in TB care activities. Providers were eligible to participate if they worked in private practice, treated TB patients, and provided informed consent. The calculated sample size was 70 based on a 2-sample, 2-sided comparison of mean scores on a 5-point Likert scale with a 95% confidence level and 80% power. We estimated an average rating difference between private providers of 0.9 and a population variance of 4 based on initial results from piloting the survey instrument and intentionally oversampled for the eventuality of post-hoc exclusion of unclear or invalid responses. We invited all eligible private providers who were partnering with Friends for International Tuberculosis Relief (FIT) on the scale-up of the private provider interface agency model [32]. We additionally used chain-sampling; interviewees and other health care workers who were recruited for our study referred us to other private providers who might be eligible to participate. We approached clinicians who either themselves confirmed, or whom other doctors indicated, provided private TB treatment in their clinics. Directors and owners of private clinics with decision-making power regarding the use of VOT in their clinics were also included in the study.

Data collection and processing

We developed a VOT acceptability survey consisting of 29 questions in English (Survey in S1 Survey) and translated it into Vietnamese (Survey in S2 Survey). The development of the survey is based on Sekhon et al’s theoretical framework of acceptability (TFA) [35]. This framework measures acceptability of healthcare interventions along eight constructs including: 1) ethicality; 2) intervention coherence; 3) burden; 4) opportunity cost; 5) perceived effectiveness; 6) self-efficacy; 7) usability/ implementation; and 8) affective attitude [36]. We chose to develop our own survey due to the absence of any internationally validated instrument on the acceptability of mobile health technologies for TB. The survey questions utilized a 5-point Likert scale ranging from strongly disagree to strongly agree or from very difficult to very easy.

To test the reliability of the survey instrument, we calculated Cronbach’s alpha for internal consistency. The coefficient rate of more than 0.70 is generally considered to be acceptable. We found a high degree of internal consistency for each survey question (α ≥ 0.859; detailed results included in the Table in S1 Table).

Besides assessing each acceptability construct, the survey bifurcated respondents through a dichotomous question around willingness to try VOT and collected demographic information on age, gender, years since the completion of medical training, length of time working in a private clinic and whether the provider also worked in the public sector.

A medical doctor and study staff familiar with treating TB in the private sector both verified the questions and piloted the survey. All staff conducting the interviews were trained on survey methods and good clinical practices before interviewing participants.

Prior to fielding the survey, participants were introduced to the SureAdhere VOT platform (San Diego, USA), an asynchronous smartphone application, and were shown a 2-minute video demonstrating how VOT is used by patients (https://youtu.be/DiE-3a1GTn0). The survey was fielded using the open-source ONA platform on Android tablets (https://ona.io/).

After survey responses were collected in ONA, the data were cleaned and checked for completeness at the end of each week. We conducted additional follow-up interviews in the event of missing data. When a participant did not know or refused to answer a question, the response was excluded from the analysis.

Statistical analyses

We calculated means, medians, or proportions with corresponding 95% confidence intervals scores for each response. We then used the Chi-squared and Fisher’s exact tests to identify significant differences in the demographic factors and responses to acceptability constructs between the three cities. If these tests were statistically significant, the Holm-Bonferroni sequential correction was applied to account for multiple comparisons. The medians and means of the Likert-scale responses were stratified by the providers’ willingness to use VOT. We fitted mixed ordinal proportional odds models [37] to explore the association between individual acceptability constructs and providers’ willingness to use VOT as the fixed effect variables, and city as the random effect. In the event of small or empty cells in individual groups, we aggregated individual 5-point Likert scale responses into three categories to stabilize the model: 1) Disagree, 2) Neither disagree nor agree, and 3) Agree. When the assumption of proportional odds was violated based on comparing models both assuming and relaxing the proportional odds assumption, we used mixed non-proportional odds models. When we compared the willingness to use VOT among private providers across the three cities, a stratification by city was not possible due to homogeneity in responses from participants in Hai Phong. Therefore, we conducted additional Mann-Whitney U tests using the varied acceptance data in HCMC only (Table in S3 Table), as well as for the combined data from Ha Noi and Hai Phong (Table in S5 Table). Statistical analyses were performed using Stata v14 (College Station, TX: StataCorp).

Ethical considerations

Ethical approval for this study was granted by the Ethics Committee for Biomedical Research of the Ha Noi School of Public Health (324/2019/YTCC-HD3). All participating providers were given a participant information sheet and signed an informed consent form prior to completing the survey. We removed all personally identifiable information from the survey responses prior to the analyses.

Results

We invited 101 eligible private providers to participate, which included 85 single-doctor clinics and eight private hospitals or multi-clinics. Overall, 79 (78%) private providers agreed to participate in the study, with 65 of these providers working in both the private and public sectors. Of the 79 study participants, 28 out of 31 eligible private doctors (90%) were located in Hai Phong, 17 of 25 eligible private doctors (68%) were located in Ha Noi, and 34 of 50 eligible private doctors (68%) were located in HCMC. Across the three cities, 17 (22%) participants had pre-existing relationships with FIT: 8 (24%) in HCMC, 2 (11%) in Ha Noi and 7 (25%) in Hai Phong. Reasons for declining to participate included worries about confidentiality, having insufficient time for an interview, and being uninterested in VOT implementation.

Demographics

Table 1 below provides demographic information on private providers who completed the survey. 63% (n = 50) of private providers surveyed were male, 66% (n = 52) of private providers were 40 years or older, and 60% (n = 47) graduated from medical school more than 15 years ago. Of participants surveyed, 59% (n = 47) had practiced in the private sector for more than 5 years, and 82% (n = 65) of providers worked in both the private and public sectors.

thumbnail
Table 1. Characteristics of private providers in the survey stratified by city.

https://doi.org/10.1371/journal.pone.0250644.t001

There was a significant difference in the distribution of gender and age of private providers between the three cities. While 82% (n = 28) of providers surveyed in HCMC were male, only 41% (n = 7) and 54% (n = 15) of respondents were male in Ha Noi and Hai Phong, respectively. Over two-thirds of private providers in HCMC were aged 40 years or older; the proportion was about 50% in Ha Noi and Hai Phong.

Acceptability

Table 2 presents the results on whether private providers agreed with survey statements according to the acceptability constructs. A high proportion of total private providers in all cities expressed that they were willing to test new approaches (86%) and agreed or strongly agreed that observation is the best strategy for adherence (86%). Many providers agreed that VOT could identify individuals at risk for stopping treatment faster (82%) and help patients adhere to treatment (82%). Only 16% (n = 13) of private providers thought that VOT is relevant to all patients in their practice. They believed VOT was relevant only to specific populations such as young or educated patients (n = 14) or individuals who often use a smartphone in their daily lives (n = 11).

thumbnail
Table 2. Overall attitudes of private providers towards VOT.

https://doi.org/10.1371/journal.pone.0250644.t002

Across 79 participants, 75% (n = 62) indicated their willingness to use VOT if given the opportunity. Responses to questions under all acceptability constructs except for perceived effectiveness were significantly different across private providers in different cities. Detailed results using the Holm-Bonferroni sequential correction are provided in the supplemental information (S6 Table). While 100% (n = 28) of providers in Hai Phong were willing to use VOT, 88% (n = 18) of providers in Ha Noi and 56% (n = 19) of providers in HCMC were willing. Across all constructs, private providers in Hai Phong had more positive attitudes towards VOT use than in the other cities. About half of the private providers in HCMC agreed that using VOT would save them time (opportunity cost; 53%), address problems which patients face (50%), and be beneficial for their practice and patients (affective attitude; 50%). The percentage of Ha Noi participants who responded ‘Agree’ to all questions under all constructs was consistently higher than the percentage of participants in HCMC, but lower than the proportion measured among Hai Phong participants. While patient confidentiality was a concern for many providers in HCMC (71%), a lower proportion of providers in Hai Phong (32%) and Ha Noi (41%) expressed these concerns.

VOT acceptance and private provider attitudes

Table 3 below shows that between private providers who would and would not use VOT, there are statistically significant differences in the majority of acceptability constructs. The three notable factors on which no significant difference was measured were the perceptions that VOT would help identify people at risk of stopping treatment faster (p = 0.555), time requirement from doctors (p = 0.413) and the doctors’ concerns about patient confidentiality (p = 0.544). We have provided stratified analyses for HCMC (Table in S3 Table) and Ha Noi & Hai Phong (Table in S5 Table) in the Supporting information.

thumbnail
Table 3. Constructs of acceptability associated with the willingness to use VOT in all three cities.

https://doi.org/10.1371/journal.pone.0250644.t003

Discussion

Our study provides insight on private providers’ perceptions and acceptance of using VOT for providing TB treatment support and to monitor adherence in their practices. The survey tool based on the TFA allows for an understanding of acceptability of the intervention prior to its implementation. In the context of three cities in Viet Nam, 78% of providers responded they would be willing to use VOT if given the opportunity. This suggests that the use of VOT in the private sector was acceptable for a subpopulation of providers depending on the value perception for their individual practice.

When bifurcated by providers who would and would not use VOT if given the opportunity across the entire sample, provider responses were consistently positive about the ethicality acceptability construct, highlighting that VOT technology fits well with the providers’ value system. Respondents were willing to test new approaches, comfortable receiving support from the program and believed they could implement these technologies successfully given adequate programmatic guidance. Providers saw VOT as effective for aiding patients to adhere to and complete treatment, specifically for patient populations in which mobile phone usage is common.

While all providers in Hai Phong were willing to use VOT, this proportion was 88% in Ha Noi and 56% in HCMC. As such, there seemed to be regional variance in the acceptance of VOT. Private providers in Hai Phong tended to be younger than in the other cities, particularly HCMC, which may have been a reason for the higher willingness to use VOT [38,39]. Additionally, FIT and other organizations have engaged with many of these private providers in Hai Phong, establishing trust and rapport [40]. This suggests that VOT implementation may be more acceptable in areas where extensive public-private mix (PPM) networks have already been established based on anecdotal evidence as the value proposition of VOT explained by study staff may have been more readily accepted by the private providers.

Meanwhile, provider responses in HCMC showed the highest level of heterogeneity. One factor may have been the share of male participants in HCMC, which was significantly higher than in the other two cities. It has been observed that gender can have a moderating effect on technology acceptance in a developing country setting and that acceptance among men tended to be more associated with perceived usefulness [41]. Meanwhile, women were reportedly more influenced by ease of use and subjective norm [41]. Particularly the latter may have contributed to the higher relative VOT acceptance in Hai Phong. From January–May 2020, we carried out a private provider mapping exercise across Viet Nam and discovered that while there are a substantial number of private providers in the larger cities of Ha Noi and HCMC, the number of private providers in Hai Phong is more limited (200 in Ha Noi, 1,356 in HCMC, and 104 in Hai Phong, unpublished data).

When assessing differences between private providers willing and unwilling to use VOT in HCMC only, the factors that showed a significant difference related to opportunity cost, self-efficacy, and affective attitude. The construct of opportunity cost focuses on the extent to which providers’ time and money are affected while engaging in the intervention. Since VOT is an alternative to patients self-administering their treatment, the perception of VOT as efficient and cost-effective within their specific practice was particularly polarizing. Several studies have stated that additional benefits such as laboratory services, free anti-TB drugs, and supporting healthcare workers need to be provided if providers are to adopt a system that requires more effort and is more time-consuming than self-administration [42,43]. Self-efficacy within our study examined providers’ confidence in monitoring treatment and providing differentiated care. When providers are comfortable in their ability to use new technology to facilitate achieving their goals, they are more willing to overcome the initial learning curve. The third significant construct of affective attitude encapsulates how an individual feels about an intervention. If providers feel that VOT is beneficial and will help solve a problem in which they face in their clinic, they are more willing to test out the intervention and see more value in the technology.

Providers are fully responsible for managing TB patients in the private sector; thus, the attitudes of private providers play an important role in successfully implementing the intervention. As such, it is important to consider providers’ specific obstacles and priorities. This is concordant with studies from other settings, in which private providers were engaged to participate in new approaches in mHealth technology. A study of private providers in India found that worries about confidentiality and lack of computer knowledge demotivated providers from engaging with technological innovations, while proper training on the technology and regular programmatic support acted as enablers [44,45]. Ultimately, the providers’ outlook on utilizing mHealth innovations influenced patient adoption of the technology [44].

Our study found that the provider’s choice to accept or reject a technological innovation was based on the value proposition of the innovation for their specific practice. Appropriately emphasizing the benefits to their clientele would be critical since several participating private providers raised concern about the relevance of VOT to their patients. Another success factor could be the development of a differentiated care model with clearly defined eligibility criteria under which VOT would be provided to their patients. This is consistent with a qualitative study involving TB patients which suggests that VOT may not be suitable to all TB patients as the ability to use VOT is limited in some specific groups such as older people who may not be familiar with smartphone technologies [46].

Lastly, acceptability is a dynamic construct subject to current events. Like many other industries, our ongoing private sector engagement has shown that private provider businesses, particularly those treating TB and respiratory illnesses, have suffered heavily from the government’s rigorous contact tracing, social distancing and forced quarantine efforts due to the SARS-CoV-2 pandemic. While these efforts have led to Viet Nam’s relative success in managing SARS-CoV-2, the deleterious economic impact may have also changed perceptions among private providers to be more accepting of remote care and telemedicine solutions such as VOT. This may particularly be the case in outbreak areas such as Da Nang in July 2020, when patient consultation and follow-up was provided via mobile chat applications during community-wide shut downs.

Studying private provider perceptions has shown us that VOT requires thoughtful planning and application to be successful. The implementation of VOT in a setting where self-administered therapy is the standard of care was reported to be challenging, as half of the TB patients did not want to participate in a pilot VOT study in northern Viet Nam despite the availability of free smartphones and technical support [21]. Considering the low rates of TB treatment completion in the private sector, many organizations through the WHO have partnered with National TB Programs to engage with the private sector and encourage the adoption of PPM-DOTS by offering free anti-TB drugs and support personnel [47]. The outcomes of these studies showed that PPM-DOTS was accepted by many private providers and was successful in improving treatment outcomes; however, challenges with using PPM-DOTS included large-scale implementation costs, increased burden on private providers and uncertainties about sustainability [42,4851]. From a programmatic perspective, increasing performance-based incentives to prioritize treatment adherence and completion through continued PPM projects may raise provider interest in VOT utilization [52,53]. As PPM VOT projects have never been piloted, our study suggests that the widespread use of VOT can act as a facilitator for standardized treatment monitoring, convenient patient follow up, and improved treatment outcomes in the private sector [18].

Our study had several limitations. The policy environment for private sector TB treatment in Viet Nam is highly restricted and providers are expected to refer TB patients to the public sector. Currently, there are no published data on private provider perceptions of VOT for TB treatment in Viet Nam or elsewhere, so we were unable to verify the validity of the mean difference and population variance estimates in our sample size calculation and therefore may have underpowered the study. Practicing in the private sector, especially for TB treatment, is sensitive and many private providers do not want to be identified. Therefore, recruitment of private providers who were actively treating TB patients was a challenge given that many of these providers exposed themselves to further investigation by local authorities through their participation. As such, this may have resulted in selection bias. Specifically, participating providers may have had a greater risk appetite, which could have translated to greater acceptability of novel and unproven technologies. Conversely, the substantial proportion (22%) of the private providers we approached that refused to be surveyed would likely have had less favorable attitudes toward VOT including those who may not be open to new technology, unknown to our network, or would not like others to know about their practice. In addition, we employed chain-sampling which has an inherent social desirability bias based on the individual who introduced the interviewer to the provider. As such, our results likely overestimate the acceptability of VOT and may not be representative of all private practitioners providing TB care in Viet Nam as a whole. Nevertheless, we were able to approach private providers with a large volume of patients, whom we consider the target population for VOT implementation. We believe that the ability to engage these high-volume private providers enhances the generalizability of these findings at least in the Vietnamese context, as these often also represent key opinion leaders in the local context. Our surveys were not conducted by the same individual in each city; thus, an interviewer bias may have caused varying levels of acceptance across different cities. We attempted to minimize this bias by conducting joint training sessions for study staff of all three cities. Finally, we believe that the inclusion of a qualitative component would have strengthened our study. Although we included a space in several of our questions for write-in explanations, these were seldom utilized. Future studies could benefit from conducting a qualitative study to better understand specific causes of provider attitudes towards VOT.

Despite the aforementioned challenges and limitations, studies examining provider attitudes towards mobile or telehealth technologies are sparse. The findings from our study are relatively specific to private health care in Viet Nam; however, this information is still very relevant to other high-TB burden countries with a large proportion of patients seeking care in the private sector [54]. As such, we believe these results have further elucidated the inherent potential of this technology and may inform its potential to improve quality of care across all stakeholders in TB care and prevention.

Conclusions

Private providers surveyed across three different cities in Viet Nam expressed positive attitudes towards VOT technology and perceived value in using the VOT within their practice. While our survey captures private provider attitudes about their willingness to use VOT, it does not assess their actual use of the technology. We suggest that further studies examine the feasibility of using VOT in the private sector, as the potential public health impacts of private-sector VOT use could be very beneficial for both programs and TB patients. However, in order for VOT to be feasible, challenges in implementation should be considered such as effectively engaging with private sector doctors and targeting an appropriate patient population.

Supporting information

S1 Table. Cronbach’s alpha (reliability coefficient).

https://doi.org/10.1371/journal.pone.0250644.s001

(PDF)

S2 Table. Constructs of acceptability associated with the willingness to use VOT in Ha Noi.

https://doi.org/10.1371/journal.pone.0250644.s002

(PDF)

S3 Table. Constructs of acceptability associated with the willingness to use VOT in Ho Chi Minh City.

https://doi.org/10.1371/journal.pone.0250644.s003

(PDF)

S4 Table. Comparison of VOT acceptability among private-sector doctors for Ho Chi Minh City and Ha Noi.

https://doi.org/10.1371/journal.pone.0250644.s004

(PDF)

S5 Table. Comparison of VOT acceptability among private-sector doctors for Ha Noi and Hai Phong.

https://doi.org/10.1371/journal.pone.0250644.s005

(PDF)

S6 Table. Adjusting for multiple comparisons using the Holm-Bonferroni sequential correction.

https://doi.org/10.1371/journal.pone.0250644.s006

(PDF)

S1 Dataset. Private provider VOT survey responses.

https://doi.org/10.1371/journal.pone.0250644.s007

(XLS)

S1 Survey. Private provider acceptability survey in English.

https://doi.org/10.1371/journal.pone.0250644.s008

(PDF)

S2 Survey. Private provider acceptability survey in Vietnamese.

https://doi.org/10.1371/journal.pone.0250644.s009

(PDF)

Acknowledgments

The authors express their sincere gratitude to the Viet Nam National Tuberculosis Control Programme, the Provincial TB Hospitals of the three cities and the staff working at the District TB Units for their support and referral of potential participants. The authors also wish to thank Dr. Giang T. Le, Dr. Thanh N. Vu and the Ho Chi Minh City Public Health Association and all participating private providers. We further acknowledge the contributions of Dr Tran Thi Thuy Dung in interviewing participants and the assistance of Kelly M. Collins from SureAdhere Mobile Technology.

References

  1. 1. WHO | Global tuberculosis report 2020 [Internet]. WHO. World Health Organization; [cited 2020 Nov 3]. http://www.who.int/tb/publications/global_report/en/.
  2. 2. Viet Nam Ministry of Health. Decision on the promulgation of the Guidelines on the diagnosis, treatment and prevention of tuberculosis [vietnamese]. 1314/QD-BYT Viet Nam; 2020.
  3. 3. Zhang H, Ehiri J, Yang H, Tang S, Li Y. Impact of Community-Based DOT on Tuberculosis Treatment Outcomes: A Systematic Review and Meta-Analysis. PloS One. 2016 Feb 5;11:e0147744. pmid:26849656
  4. 4. McKay B, Castellanos M, Ebell M, Whalen CC, Handel A. An attempt to reproduce a previous meta-analysis and a new analysis regarding the impact of directly observed therapy on tuberculosis treatment outcomes. PLOS ONE. 2019 May 23;14(5):e0217219. pmid:31120965
  5. 5. Nhung NV, Hoa NB, Anh NT, Anh LTN, Siroka A, Lönnroth K, et al. Measuring catastrophic costs due to tuberculosis in Viet Nam. Int J Tuberc Lung Dis Off J Int Union Tuberc Lung Dis. 2018 1;22(9):983–90. pmid:30092862
  6. 6. World Health Organization. A patient-centred approach to TB care. World Health Organization. 2018;
  7. 7. World Health Organization. Guidelines for treatment of drug-susceptible tuberculosis and patient care: 2017 update. 2017.
  8. 8. Laurence YV, Griffiths UK, Vassall A. Costs to Health Services and the Patient of Treating Tuberculosis: A Systematic Literature Review. Pharmacoeconomics. 2015;33(9):939–55. pmid:25939501
  9. 9. Fiseha D, Demissie M. Assessment of Directly Observed Therapy (DOT) following tuberculosis regimen change in Addis Ababa, Ethiopia: a qualitative study. BMC Infect Dis [Internet]. 2015 Sep 30 [cited 2020 Jan 21];15. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4590704/.
  10. 10. Steel BS. Science and Politics: An A-to-Z Guide to Issues and Controversies. CQ Press; 2014. 633 p.
  11. 11. Espinal MA, Kim SJ, Suarez PG, Kam KM, Khomenko AG, Migliori GB, et al. Standard Short-Course Chemotherapy for Drug-Resistant Tuberculosis: Treatment Outcomes in 6 Countries. JAMA. 2000 May 17;283(19):2537–45. pmid:10815117
  12. 12. Centers for Disease Control and Prevention (CDC). Emergence of Mycobacterium tuberculosis with extensive resistance to second-line drugs—worldwide, 2000–2004. MMWR Morb Mortal Wkly Rep. 2006 Mar 24;55(11):301–5. pmid:16557213
  13. 13. Garfein RS, Collins K, Muñoz F, Moser K, Cerecer-Callu P, Raab F, et al. Feasibility of Tuberculosis Treatment Monitoring by Video Directly Observed Therapy: A Binational Pilot Study. Int J Tuberc Lung Dis Off J Int Union Tuberc Lung Dis. 2015 Sep;19(9):1057–64. pmid:26260824
  14. 14. Holzman SB, Zenilman A, Shah M. Advancing Patient-Centered Care in Tuberculosis Management: A Mixed-Methods Appraisal of Video Directly Observed Therapy. Open Forum Infect Dis [Internet]. 2018 Apr 1 [cited 2019 Apr 18];5(4). Available from: https://academic.oup.com/ofid/article/doi/10.1093/ofid/ofy046/4924819 pmid:29732378
  15. 15. Devi BR, Syed-Abdul S, Kumar A, Iqbal U, Nguyen P-A, Li Y-C (Jack), et al. mHealth: An updated systematic review with a focus on HIV/AIDS and tuberculosis long term management using mobile phones. Comput Methods Programs Biomed. 2015 Nov;122(2):257–65. pmid:26304621
  16. 16. Story A, Aldridge RW, Smith CM, Garber E, Hall J, Ferenando G, et al. Smartphone-enabled video-observed versus directly observed treatment for tuberculosis: a multicentre, analyst-blinded, randomised, controlled superiority trial. The Lancet. 2019 Mar 23;393(10177):1216–24. pmid:30799062
  17. 17. Chen S-H, Wang I, Hsu H-L, Huang C-C, Liu Y-J, Putri DU, et al. Advantage in privacy protection by using synchronous video observed treatment enhances treatment adherence among patients with latent tuberculosis infection. J Infect Public Health. 2020 Sep 1;13(9):1354–9. pmid:32376234
  18. 18. Garfein RS, Doshi RP. Synchronous and asynchronous video observed therapy (VOT) for tuberculosis treatment adherence monitoring and support. J Clin Tuberc Mycobact Dis. 2019 Dec 1;17:100098. pmid:31867442
  19. 19. Sekandi JN, Buregyeya E, Zalwango S, Dobbin KK, Atuyambe L, Nakkonde D, et al. Video directly observed therapy for supporting and monitoring adherence to tuberculosis treatment in Uganda: a pilot cohort study. ERJ Open Res [Internet]. 2020 Apr 6 [cited 2020 Jul 29];6(1). Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7132038/. pmid:32280670
  20. 20. Kumar AA, Costa AD, Das A, Srinivasa GA, D’Souza G, Rodrigues R. Mobile Health for Tuberculosis Management in South India: Is Video-Based Directly Observed Treatment an Acceptable Alternative? JMIR MHealth UHealth. 2019 Apr 3;7(4):e11687. pmid:30942696
  21. 21. Nguyen TA, Pham MT, Nguyen TL, Nguyen VN, Pham DC, Nguyen BH, et al. Video Directly Observed Therapy to support adherence with treatment for tuberculosis in Vietnam: A prospective cohort study. Int J Infect Dis IJID Off Publ Int Soc Infect Dis. 2017 Dec;65:85–9. pmid:29030137
  22. 22. Sinkou H, Hurevich H, Rusovich V, Zhylevich L, Falzon D, de Colombani P, et al. Video-observed treatment for tuberculosis patients in Belarus: findings from the first programmatic experience. Eur Respir J [Internet]. 2017 Mar 23 [cited 2020 Jan 22];49(3). Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5380873/. pmid:28331042
  23. 23. Hoffman JA, Cunningham JR, Suleh AJ, Sundsmo A, Dekker D, Vago F, et al. Mobile Direct Observation Treatment for Tuberculosis Patients: A Technical Feasibility Pilot Using Mobile Phones in Nairobi, Kenya. Am J Prev Med. 2010 Jul 1;39(1):78–80. pmid:20537846
  24. 24. Mirsaeidi M, Farshidpour M, Banks-Tripp D, Hashmi S, Kujoth C, Schraufnagel D. Video directly observed therapy for treatment of tuberculosis is patient-oriented and cost-effective. Eur Respir J. 2015 Sep;46(3):871–4. pmid:25792632
  25. 25. Maximizing Resources | 2016 | TB Elimination Champions | World TB Day | TB | CDC [Internet]. 2018 [cited 2019 Apr 18]. https://www.cdc.gov/tb/worldtbday/maximizingresources.htm.
  26. 26. Lönnroth K, Thuong L. M, Lambregts K, Quy H. T, Diwan V. K. Private tuberculosis care provision associated with poor treatment outcome: comparative study of a semi-private lung clinic and the NTP in two urban districts in Ho Chi Minh City, Vietnam. Int J Tuberc Lung Dis. 2003 Feb 1;7(2):165–71. pmid:12588018
  27. 27. Quy HT, Lönnroth K, Lan NTN, Buu TN. Treatment results among tuberculosis patients treated by private lung specialists involved in a public-private mix project in Vietnam. Int J Tuberc Lung Dis. 2003 Dec 1;7(12):1139–46. pmid:14677888
  28. 28. Uplekar M, Pathania V, Raviglione M. Private practitioners and public health: weak links in tuberculosis control. The Lancet. 2001 Sep 15;358(9285):912–6. pmid:11567729
  29. 29. Hoang TTT, Nguyen NV, Dinh SN, Nguyen HB, Cobelens F, Thwaites G, et al. Challenges in detection and treatment of multidrug resistant tuberculosis patients in Vietnam. BMC Public Health [Internet]. 2015 Sep 29 [cited 2020 May 25];15. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4587724/. pmid:26415893
  30. 30. Hoa NB, Cobelens FGJ, Sy DN, Nhung NV, Borgdorff MW, Tiemersma EW. Diagnosis and Treatment of Tuberculosis in the Private Sector, Vietnam. Emerg Infect Dis. 2011 Mar;17(3):562–6. pmid:21392464
  31. 31. Lönnroth K, Thuong LM, Linh PD, Diwan VK. Utilization of private and public health-care providers for tuberculosis symptoms in Ho Chi Minh City, Vietnam. Health Policy Plan. 2001 Mar 1;16(1):47–54. pmid:11238430
  32. 32. Vo LNQ, Codlin AJ, Huynh HB, Mai TDT, Forse RJ, Truong VV, et al. Enhanced Private Sector Engagement for Tuberculosis Diagnosis and Reporting through an Intermediary Agency in Ho Chi Minh City, Viet Nam. Trop Med Infect Dis. 2020 Sep;5(3):143. pmid:32937757
  33. 33. Greenlund KJ, Giles WH, Keenan NL, Croft JB, Mensah GA. Physician advice, patient actions, and health-related quality of life in secondary prevention of stroke through diet and exercise. Stroke. 2002 Feb;33(2):565–70. pmid:11823671
  34. 34. Johansson E, Long NH, Diwan VK, Winkvist A. Attitudes to compliance with tuberculosis treatment among women and men in Vietnam. Int J Tuberc Lung Dis. 1999 Oct 1;3(10):862–8. pmid:10524582
  35. 35. Sekhon M, Cartwright M, Francis JJ. Acceptability of health care interventions: A theoretical framework and proposed research agenda. Br J Health Psychol. 2018;23(3):519–31. pmid:29453791
  36. 36. Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017 Jan 26;17(1):88. pmid:28126032
  37. 37. Hedeker D. Methods for Multilevel Ordinal Data in Prevention Research. Prev Sci Off J Soc Prev Res. 2015 Oct;16(7):997–1006. pmid:24939751
  38. 38. Leigh S, Ashall-Payne L, Andrews T. Barriers and Facilitators to the Adoption of Mobile Health Among Health Care Professionals From the United Kingdom: Discrete Choice Experiment. JMIR MHealth UHealth. 2020;8(7):e17704. pmid:32628118
  39. 39. Ha J, Park HK. Factors Affecting the Acceptability of Technology in Health Care Among Older Korean Adults with Multiple Chronic Conditions: A Cross-Sectional Study Adopting the Senior Technology Acceptance Model. Clin Interv Aging. 2020 Oct 2;15:1873–81. pmid:33061336
  40. 40. Public-Private Mix for Tuberculosis and HIV Lesso.pdf [Internet]. [cited 2020 May 27]. https://path.azureedge.net/media/documents/HIV-TB_ppm_vietnam_br.pdf.
  41. 41. Hoque MR. An empirical study of mHealth adoption in a developing country: the moderating effect of gender concern. BMC Med Inform Decis Mak. 2016 May 3;16(1):51.
  42. 42. Chaudhury RR, Thatte U. Beyond DOTS: Avenues ahead in the management of tuberculosis. Natl Med J INDIA. 2003;16(6):7. pmid:14765625
  43. 43. Lönnroth K, Tran T-U, Thuong LM, Quy HT, Diwan V. Can I afford free treatment?: Perceived consequences of health care provider choices among people with tuberculosis in Ho Chi Minh City, Vietnam. Soc Sci Med. 2001 Mar;52(6):935–48. pmid:11234866
  44. 44. Singh Chadha S, Burugina Nagaraja S, Trivedi A, Satapathy S, N MD, Devi Sagili K. Mandatory TB notification in Mysore city, India: Have we heard the private practitioner’s plea? BMC Health Serv Res. 2017 Jan 3;17(1):1. pmid:28049468
  45. 45. Satpati M, Burugina Nagaraja S, Shewade HD, Aslesh PO, Samuel B, Khanna A, et al. TB Notification from Private Health Sector in Delhi, India: Challenges Encountered by Programme Personnel and Private Health Care Providers [Internet]. Vol. 2017, Tuberculosis Research and Treatment. Hindawi; 2017 [cited 2020 May 26]. p. e6346892. https://www.hindawi.com/journals/trt/2017/6346892/. pmid:28845306
  46. 46. Zúñiga ML, Collins K, Muñoz F, Moser K, Rangel G, Cuevas-Mota J, et al. A Qualitative Study Exploring Stakeholder Perceptions of Video Directly Observed Therapy for Monitoring Tuberculosis Treatment in the US-Mexico Border Region. J Mob Technol Med. 2016 Jul 31;5(2):12–23.
  47. 47. WHO_CDS_TB_2001.285.pdf [Internet]. [cited 2020 May 28]. https://apps.who.int/iris/bitstream/handle/10665/66733/WHO_CDS_TB_2001.285.pdf?sequence=1&isAllowed=y.
  48. 48. Lönnroth K, Uplekar M, Arora VK, Juvekar S, Lan NTN, Mwaniki D, et al. Public-private mix for DOTS implementation: what makes it work? Bull World Health Organ. 2004 Aug;82:580–6. pmid:15375447
  49. 49. Floyd K, Arora V, Murthy K, Lonnroth K, Singla N, Akbar Y, et al. Cost and cost-effectiveness of PPM-DOTS for tuberculosis control: evidence from India. Bull World Health Organ. 2006 Jun 1;84:437–45. pmid:16799727
  50. 50. Mantala MJ. Public–private mix DOTS in the Philippines. Tuberculosis. 2003 Feb;83(1–3):173–6. pmid:12758208
  51. 51. Saw S, Thida , Lwin T, Mi T, Khaing M, Myint B, et al. Success and challenges of Public-Private Mix DOTS initiatives in Myanmar: a process evaluation for partnership approach of non-governmental organizations. Myanmar Health Sci Res J. 2009 Jan 1;21:186–93.
  52. 52. Beith A, Eichler R, Weil D. Performance-Based Incentives for Health: A Way to Improve Tuberculosis Detection and Treatment Completion? SSRN Electron J [Internet]. 2007 [cited 2020 May 27]; http://www.ssrn.com/abstract=1003247.
  53. 53. Eichler R, Levine R, Group C for GDP-BIW. Performance Incentives for Global Health: Potential and Pitfalls. CGD Books; 2009. 290 p.
  54. 54. Stallworthy G, Dias HM, Pai M. Quality of tuberculosis care in the private health sector. J Clin Tuberc Mycobact Dis. 2020 Aug 1;20:100171. pmid:32642560