Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Disseminated disease due to non-tuberculous mycobacteria in HIV positive patients: A retrospective case control study

  • Nils Wetzstein ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    nils.wetzstein@kgu.de

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Ari Geil,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Resources, Software, Visualization, Writing – review & editing

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Gerrit Kann,

    Roles Writing – review & editing

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Annette Lehn,

    Roles Formal analysis, Methodology, Validation, Writing – review & editing

    Affiliation Institute of Biostatistics and Mathematical Modeling, Goethe University, Frankfurt am Main, Germany

  • Gundolf Schüttfort,

    Roles Writing – review & editing

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Johanna Kessel,

    Roles Writing – review & editing

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Tobias M. Bingold,

    Roles Methodology, Writing – review & editing

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Claus P. Küpper-Tetzel,

    Roles Writing – review & editing

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Annette Haberl,

    Roles Writing – review & editing

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Christiana Graf,

    Roles Writing – review & editing

    Affiliation Department of Internal Medicine, Gastroenterology and Hepatology, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Maria J. G. T. Vehreschild,

    Roles Resources, Writing – review & editing

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Christoph Stephan,

    Roles Writing – review & editing

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Michael Hogardt,

    Roles Writing – review & editing

    Affiliation Institute of Medical Microbiology and Infection Control, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Thomas A. Wichelhaus,

    Roles Methodology, Writing – review & editing

    Affiliation Institute of Medical Microbiology and Infection Control, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

  • Timo Wolf

    Roles Conceptualization, Methodology, Resources, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Department of Internal Medicine, Infectious Diseases, University Hospital Frankfurt, Goethe University, Frankfurt am Main, Germany

Abstract

Introduction

Disseminated infection due to non-tuberculous mycobacteria has been a major factor of mortality and comorbidity in HIV patients. Until 2018, U.S. American guidelines have recommended antimycobacterial prophylaxis in patients with low CD4 cell counts, a practice that has not been adopted in Europe. This study aimed at examining the impact of disseminated NTM disease on clinical outcome in German HIV patients with a severe immunodeficiency.

Materials and methods

In this retrospective case control study, HIV patients with disseminated NTM disease were identified by retrospective chart review and matched by their CD4 cell counts to HIV patients without NTM infection in a 1:1 alocation. Primary endpoints were mortality and time to first rehospitalisation. In addition, other opportunistic diseases, as well as antimycobacterial and antiretroviral treatments were examined.

Results

Between 2006 and 2016, we identified 37 HIV patients with disseminated NTM disease. Most of them were suffering from infections due to M. avium complex (n = 31, 77.5%). Time to event analysis showed a non-significant trend to higher mortality in patients with disseminated NTM disease (p = 0.24). Rehospitalisation took place significantly earlier in patients with disseminated NTM infections (median 40.5 days vs. 109 days, p<0.0001).

Conclusion

In this retrospective case control study, we could demonstrate that mortality is not significantly higher in HIV patients with disseminated NTM disease in the ART era, but that they require specialised medical attention in the first months following discharge.

Introduction

Infections due to non-tuberculous mycobacteria (NTM) have been observed in HIV patients since the advent of the AIDS pandemic in the 1980s [1]. The widespread administration of antiretroviral therapy (ART) has led to a decrease in morbidity and mortality due to opportunistic infections in HIV-positive patients and an increase in life expectancy [2,3]. Nevertheless, patients with low CD4 cell counts at first diagnosis are still suffering from a variety of opportunistic infections and/or AIDS related malignancies [4]. Among those, disseminated disease due to non-tuberculous mycobacteria is a major cause of morbidity [5].

Mainly, species of the M. avium complex (MAC, formerly called MAI–M. avium-intracellulare- complex) have been involved in disseminated infections in severely immunocompromised patients. Other NTM (as for example M. genavense), have also been described [1,6,7]. In disseminated disease, NTM can be cultured from different specimens such as citrate or EDTA blood, organ biopsies, sputum, bronchoalveolar lavage fluid and others. This clinical entity has to be distinguished from mere pulmonary colonisation or NTM pulmonary disease (NTM-PD).

Until recently, primary prophylaxis against MAC disease was generally recommended in patients with HIV and CD4 cell counts below 50/μl in the United States [8]. Since 2018, only patients who cannot begin ART immediately should receive mycobacterial prophylaxis [9]. In Europe, NTM prophylaxis has never been adopted, as MAC infections have been described more rarely [10,11].

Disseminated NTM infections are now frequently diagnosed in relation to an immune-reconstitution-syndrome due to NTM (NTM-IRIS) causing severe symptoms such as multiple abscesses, lymphadenopathy and fever of unknown origin after the initiation of ART [12,13]. Those cases can be especially difficult to treat [12]. Whereas the recommended antimicrobial regimen for disseminated M. avium complex disease consists of a macrolide, ethambutol and a rifamycin, there is little data on the treatment of rare NTM like M. genavense or M. xenopi [1,9].

The aim of this study was to examine the impact of disseminated NTM disease on clinical outcome in HIV patients with a severe immunodeficiency in a healthcare environment without recommendation for antimycobacterial prophylaxis. In addition, we intended to identify clinical characteristics associated with NTM infections in HIV patients and a possible influence of antimycobacterial treatment on their clinical course.

Materials and methods

Ethical consent was obtained under file number 473/16 from our local ethics committee at University Hospital Frankfurt. For the period between 2006 and 2016, all patients treated at our centre with coded HIV infection (ICD codes B20-B24), coded NTM infection (ICD code A31) and positive microbiological results for NTM were identified and doubles excluded. Patient data was then collected by retrospective chart review of our local patient management system (ORBIS, Dedalus Health Care Systems Group, Bonn Germany). Medical records were accessed between October 2018 and December 2020. As this is a retrospective study, no informed consent was required. Before further statistical analysis, all patient data were anonymised.

Patients were grouped into two clinical cohorts: patients with HIV infection and diagnosed disseminated NTM infection (disseminated NTM disease) and patients with HIV infection but without NTM infection (controls). Disseminated NTM infection was defined by positive culture or PCR result for NTM in either a blood specimen (EDTA or citrate culture) or more than one specimen from different body sites. Patients, in which NTM were cultured from respiratory specimens only, were excluded (NTM-PD or colonisation).

Case control matching was then conducted using the MatchIt package in R [14,15]. In a first step, CD4 cell-counts at the time of first diagnosis of NTM in disseminated NTM disease and the nadir (lowest CD4 cell count measured during the observation period) in controls were recorded. Then, patients were matched with regard to CD4 cell count with a 1:1 ratio, while only controls were discarded.

For the resulting groups the following outcome variables were recorded: mycobacterial species as identified by our clinical microbiology laboratory (case group, disseminated NTM disease), fatal events, reason of death and possible time to death, hospitalisation rate and time to first rehospitalisation, total observation time, Charlson Comorbidity Index (CCI) [16,17], behavioral risk factors (such as smoking, intravenous drug use–IVDU—and alcohol abuse), opportunistic infections and AIDS related malignancies. NTM treatment was recorded and divided into the following antimicrobial groups: macrolides, rifamycin, ethambutol, fluoroquinolones and others. HIV treatment was grouped into NRTIs, NNRTIs, protease inhibitors, integrase inhibitors, fusion inhibitor and CC motif chemokine receptor 5-(CCR5) inhibitor.

In patients, in whom MAC isolates were still available, isolates were cultivated as described previously [18] and species identification was reevaluated using the NTM DR genotype line probe as recommended by the manufacturer [19]. MAC could thus be specified into M. avium, M. chimaera and M. intracellulare.

All statistical analyses were performed in R v. 3.4.4, Someone to Lean On”[14] and LibreOffice (The Document Foundation). All graphs were drawn using the ggplot package [20]. Continuous variables are presented as median and interquartile range (IQR) for non-normally distributed data or mean and standard deviation (SD) for normally distributed data. Frequencies for categorical variables are presented as number and percentage. The Shapiro-Wilk-Test was used to test for normality. For non-normally distributed data, significance tests were performed using the Wilcoxon-Mann-Whitney test, for normally distributed data the student‘s t-test. Significant differences of categorical variables were evaluated using the Fisher exact test or chi-squared test. All tests were performed two-sided at a significance level of alpha = 0.05.

Kaplan-Meier method with log-rank test was used for time to event analysis using the survival and survminer packages in R [21,22].

Results

Patients and matching process

In total, we could identify 398 patients with an HIV infection available for further analysis (Fig 1). Forty of those were excluded, because NTM were cultivated only from respiratory specimens (NTM-PD or colonisation). Thirty-seven patients met our definition of disseminated disease due to NTM and formed the case group (disseminated NTM disease). Matching excluded 284 patients, delivering a control group of 37 patients, as well (controls). Median CD4 cell count at first diagnosis was 5/μl (IQR = 22/μl) in patients with disseminated NTM disease, 198/μl (IQR = 273/μl) in controls before matching and 11/μl (IQR = 26/μl) in controls after matching (Fig 2). There was no significant difference in CD4 cell count between the case and the control group after the matching process (p = 0.33).

thumbnail
Fig 2. Boxplot of CD4 cell counts [/μl] in patients with disseminated NTM disease (n = 37), controls before matching (n = 321) and controls after matching (n = 37).

https://doi.org/10.1371/journal.pone.0254607.g002

General characteristics and mycobacterial species distribution

MAC was the most frequent mycobacterial species group causing disseminated infection (n = 31, 83.8%). Other mycobacterial species were: M. genavense (n = 2, 5.4%), M. kansasii, M. celatum, M. simiae and M. mycogenicum (n = 1, 2.7% each) (Table 1). In 26 patients, MAC isolates were available. Among those, we identified M. avium only, but no representatives of M. chimaera, or M. intracellulare by the line probe assay.

thumbnail
Table 1. General characteristics and mycobacterial species in patients with disseminated NTM disease and controls.

CD4-cell counts refer to baseline in patients with disseminated NTM disease and the nadir in controls.

https://doi.org/10.1371/journal.pone.0254607.t001

There were no significant differences between the case and control group regarding age, BMI, CCI, ethnicity and gender. Viral load was significantly higher and the observation period significantly longer in patients of the control group.

Opportunistic infections and other clinical attributes

All opportunistic infections were equally distributed among patients with disseminated NTM disease and the control group except for infections due to cytomegalovirus (CMV) (p<0.01), and a trend to higher frequency of Pneumocystis jirovecii pneumonia (PCP) in the case group (p = 0.07) (Tables 2 and 3). Fever, night sweat and weight loss were significantly more frequent in patients suffering from disseminated NTM infections (75.0% vs 32.4%, p<0.001; 54.2% vs 16.2%, p<0.01; 85.3% vs 27%, p<0.001). Blood samples for mycobacterial culture were drawn significantly more often in patients with disseminated NTM disease than in controls (89.2% vs. 46.0%, p<0.001). In the case group, there was a trend to more documented cases of IRIS (18.9% vs. 2.7%, p = 0.06) and wasting syndrome (21.6% vs.5.4%. p = 0.09).

thumbnail
Table 2. Opportunistic infections, AIDS related malignancies, vegetative symptoms, NTM related diagnostics and complications in patients with disseminated NTM disease and controls.

Opportunistic infections or comorbidities that did neither occur in the case nor in the control group are not shown.

https://doi.org/10.1371/journal.pone.0254607.t002

thumbnail
Table 3. Other infections, comorbidities and behavioral risk factors in patients with disseminated NTM disease and controls.

https://doi.org/10.1371/journal.pone.0254607.t003

Mortality and hospitalisation rates

There was a non-significant trend to higher mortality in patients with disseminated NTM disease in the time to event analysis (p = 0.24): During the observation period, 8/37 or 29.1% of patients deceased in the case group (disseminated NTM disease) vs. 6/37 or 18.3% in controls.

28/37 (75.7%) patients with disseminated NTM infections were rehospitalised with a median duration to first rehospitalisation of 40.5 days, whereas 21 control patients were rehospitalised (64.9%). The time to event analysis showed that rehospitalisation took place significantly earlier after first admission in disseminated NTM disease (median 40.5 days vs. 109 days, p<0.001) (Fig 3).

thumbnail
Fig 3. Survival analysis (A) and time to first rehospitalisation (B) in patients with disseminated NTM disease and controls.

There was a non-significant trend to higher mortality in patients with disseminated NTM disease (p = 0.24). Time to rehospitalisation was significantly shorter in those patients (p<0.001).

https://doi.org/10.1371/journal.pone.0254607.g003

A total of 123.61 patient years were observed in disseminated NTM disease and 221.52 patient years in controls. Extrapolation gave 21.77 days of hospitalisation per patient year (PPY) in disseminated NTM disease and 8.75 days PPY in controls. Mean length of stay in hospital was significantly longer in disseminated NTM disease than in controls (21.69 days vs. 10.14 days, p<0.001).

Treatment and influence on clinical course

In patients with disseminated infection due to NTM, 86.5% received ART. 87.5% of those received regimens containing NRTI, 6.3% NNRTI, 68.8% protease inhibitors, 28.1% integrase inhibitors, and 3.1% a fusion inhibitor (Table 4). Of the five patients that did not receive ART during the observation period, three died before a possible initiation of ART. In controls, 89.2% received ART, of those 96.2% a NRTI containing regimen, 3.1% NNRTI, 75.0% protease inhibitors, 78.1% integrase inhibitors, 0.0% fusion inhibitors and 6.3% CCR5-inhibitors. Integrase inhibitors were prescribed significantly more often in controls (p<0.001).

thumbnail
Table 4. Antiretroviral and antimycobacterial treatment in the case group and controls.

https://doi.org/10.1371/journal.pone.0254607.t004

Within patients with disseminated NTM infection, 29/37 (78.4%) received antimycobacterial treatment, which consisted mainly of macrolides (89.7% of drug regimens), ethambutol (93.1%), rifamycins (37.9%), aminoglycosides (13.8%) or fluoroquinolones (3.4%). There was a trend to better survival in patients with antimycobacterial treatment within the case group but significance was not reached (p = 0.1). NTM treatment did not postpone rehospitalisation within the case group (p = 0.41).

NTM effective antibiotic treatment was administered significantly more often in patients with disseminated NTM disease than in controls (78.4% vs. 27%, p<0.001). Also, the choice of antimycobacterial agents differed significantly. Five of the ten control patients who received antimycobacterial treatment received a monotherapy with a fluoroquinolone for another indication. No patient within the control group received a second course of NTM-effective treatment.

Discussion

To the best of our knowledge, this is the first study that has examined the clinical course and outcome of disseminated NTM disease in HIV patients in the ART era using a retrospective case control study design.

As previously described, disseminated NTM disease affects patients with very low CD4 cell counts [1]. This was also true for our case group. Nevertheless, there were no significant differences between groups regarding baseline characteristics, including CD4 cell count, after matching. We therefore compared two groups in a similar immunological state. Fever, night sweat and weight loss were significantly more frequent in the case group. These simple clinical parameters seem to remain good predictors of mycobacterial disease in these patients.

Interestingly, blood cultures for mycobacterial culture were taken significantly more often in the case group, so that there might be unrecognized cases of disseminated NTM disease in the control group and the statistical effects shown in our study would be slightly underestimated. Additionally, CMV infection was more frequent in those with disseminated NTM disease. Most probably, this is due to the diagnostic work-up in fever of unknown origin that includes mycobacterial cultures and CMV-PCR from the blood.

We could not demonstrate a significant difference in mortality between patients with disseminated NTM disease and controls. This could be linked to low case numbers but underlines the benefit of improvements in the clinical care these patients receive since the introduction of antiretroviral therapy. On the other hand, rehospitalisation took place significantly earlier in disseminated NTM disease than in controls and IRIS was more frequently diagnosed. Taken together, this confirms the clinical observation, that patients suffering from disseminated NTM disease are severely ill, but can achieve convalescence through adequate antimycobacterial and antiretroviral therapy. We therefore argue that those patients require specialised medical attention in an outpatient setting.

Antimycobacterial treatment did not have a significant effect on mortality nor on time to rehospitalisation in disseminated NTM disease. These results should be interpreted with care, as case numbers for time to event analysis within the group of disseminated NTM disease were considerably low. In addition, most patients who did not receive NTM treatment were those who died before its possible initiation. The results do not allow any interpretation regarding current guidelines of NTM prophylaxis in patients with low CD4 counts.

One of the strengths of this study is the relatively large case group which included 37 patients. Using a retrospective case control study design, we compared two groups in similar states of immunosuppression and were therefore able to examine effects attributable to disseminated NTM disease. On the other hand, it has several limitations: First, matching was only possible in a 1:1 manner, as we could not acquire enough controls with equally low CD4 cell counts. Second, this is a monocentric study. Third, a retrospective study design always bears the risk of inaccurate documentation and therefore missing data.

Conclusion

In this retrospective case control study, we showed that even in the era of highly effective ART, there are differences in clinical course and outcome attributable to disseminated NTM disease in HIV patients. Although mortality was not significantly increased in disseminated NTM disease, we observed significantly earlier rehospitalisation and longer mean hospital stays in those patients. In conclusion, HIV patients with disseminated NTM disease require particularly close monitoring after discharge.

References

  1. 1. Griffith DE, Aksamit T, Brown-Elliott BA, Catanzaro A, Daley C, Gordin F, et al. An Official ATS/IDSA Statement: Diagnosis, Treatment, and Prevention of Nontuberculous Mycobacterial Diseases. Am J Respir Crit Care Med. 2007;175: 367–416. pmid:17277290
  2. 2. Gueler A, Moser A, Calmy A, Günthard HF, Bernasconi E, Furrer H, et al. Life expectancy in HIV-positive persons in Switzerland: Matched comparison with general population. AIDS. 2017;31: 427–436. pmid:27831953
  3. 3. Teeraananchai S, Kerr SJ, Amin J, Ruxrungtham K, Law MG. Life expectancy of HIV-positive people after starting combination antiretroviral therapy: a meta-analysis. HIV Med. 2017;18: 256–266. pmid:27578404
  4. 4. Tominski D, Katchanov J, Driesch D, Daley MB, Liedtke A, Schneider A, et al. The late-presenting HIV-infected patient 30 years after the introduction of HIV testing: spectrum of opportunistic diseases and missed opportunities for early diagnosis. HIV Med. 2017;18: 125–132. pmid:27478058
  5. 5. Kobayashi T, Nishijima T, Teruya K, Aoki T, Kikuchi Y, Oka S, et al. High Mortality of Disseminated Non-Tuberculous Mycobacterial Infection in HIV-Infected Patients in the Antiretroviral Therapy Era. PLoS One. 2016;11: e0151682. pmid:26985832
  6. 6. Yeh Y-K, Ding J-Y, Ku C-L, Chen W-C. Disseminated Mycobacterium avium complex infection mimicking malignancy in a patient with anti-IFN-γ autoantibodies: a case report. BMC Infect Dis. 2019;19: 909. pmid:31664931
  7. 7. Wetzstein N, Hügel C, Wichelhaus TA, Hogardt M, Eickmeier O, Küpper-Tetzel C-P, et al. Species distribution and clinical features of infection and colonisation with non-tuberculous mycobacteria in a tertiary care centre, central Germany, 2006–2016. Infection. 2019; 1–9. pmid:31093923
  8. 8. Jonathan E. Kaplan, Constance Benson, King K. Holmes, John T. Brooks, Alice Pau, Henry Masur. Guidelines for Prevention and Treatment of Opportunistic Infections in HIV-Infected Adults and Adolescents Recommendations from CDC, the National Institutes of Health, and the HIV Medicine Association of the Infectious Diseases Society of America. [cited 16 Oct 2018]. https://www.cdc.gov/mmwr/preview/mmwrhtml/rr58e324a1.htm.
  9. 9. Guidelines for the Prevention and Treatment of Opportunistic Infections in Adults and Adolescents with HIV How to Cite the Adult and Adolescent Opportunistic Infection Guidelines: Panel on Opportunistic Infections in Adults and Adolescents with HIV.2018. http://aidsinfo.nih.gov/contentfiles/lvguidelines/adult_oi.pdf.
  10. 10. DAIG. Deutsch-Österreichische Leitlinien zur Therapie und Prophylaxe opportunistischer Infektionen bei HIV-infizierten erwachsenen Patienten. 2014.
  11. 11. Lange CG, Woolley IJ, Brodt RH. Disseminated Mycobacterium avium-intracellulare Complex (MAC) Infection in the Era of Effective Antiretroviral Therapy. Drugs. 2004;64: 679–692. pmid:15025543
  12. 12. Manion M, Lynn N, Pei L, Hammoud DA, Laidlaw E, Roby G, et al. To Induce Immune Reconstitution Inflammatory Syndrome or Suppress It: The Spectrum of Mycobacterium genavense in the Antiretroviral Era. Clin Infect Dis. 2020 [cited 4 Dec 2020]. pmid:33501968
  13. 13. Breglio KF, Vinhaes CL, Arriaga MB, Nason M, Roby G, Adelsberger J, et al. Clinical and immunologic predictors of Mycobacterium avium complex immune reconstitution inflammatory syndrome in a contemporary cohort of patients with HIV. J Infect Dis. 2020 [cited 4 Dec 2020]. pmid:33104218
  14. 14. R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria; 2018. https://www.r-project.org/.
  15. 15. Ho DE, Imai K, King G, Stuart EA. MatchIt: Nonparametric Preprocessing for Parametric Causal Inference. J Stat Softw. 2011;42: 1–28. Available: http://www.jstatsoft.org/v42/i08/.
  16. 16. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. J Chronic Dis. 1987;40: 373–383. pmid:3558716
  17. 17. Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, et al. Updating and validating the charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173: 676–682. pmid:21330339
  18. 18. Wetzstein N, Kohl TA, Andres S, Schultze TG, Geil A, Kim E, et al. Comparative analysis of phenotypic and genotypic antibiotic susceptibility patterns in Mycobacterium avium complex. Int J Infect Dis. 2020;93: 320–328. pmid:32147539
  19. 19. GenoType NTM-DR | Detection of NTM resistances. [cited 2 Jul 2019]. https://www.hain-lifescience.de/en/products/microbiology/mycobacteria/ntm/genotype-ntm-dr.html.
  20. 20. Wickham H. ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag New York; 2016. https://ggplot2.tidyverse.org.
  21. 21. Kassambara A, Kosinski M, Biecek P. survminer: Drawing Survival Curves using “ggplot2.” 2019. https://cran.r-project.org/package=survminer.
  22. 22. Therneau TM. A Package for Survival Analysis in S. 2015. https://cran.r-project.org/package=survival.