Figures
Abstract
Background
Human papillomavirus (HPV) types 16 and 18 cause invasive cervical cancer and most invasive anal cancers (IACs). Overall, IAC rates are highest among men who have sex with men (MSM), especially MSM with HIV infection. Testosterone is prescribed for men showing hypogonadism and HIV-related wasting. While there are direct and indirect physiological effects of testosterone in males, its role in anal HPV16/18 infections in men is unknown.
Methods
Free testosterone (FT) was measured in serum from 340 Multicenter AIDS Cohort Study (MACS) participants who were tested for anal HPV16/18-DNA approximately 36 months later. The effect of log10-transformed current FT level on anal HPV16/18 prevalence was modeled using Poisson regression with robust error variance. Multivariate models controlled for other HPV types, cumulative years of exogenous testosterone use, race, age, lifetime number of receptive anal intercourse partnerships, body mass index, tobacco smoking, HIV-infection and CD4+ T-cell counts among HIV-infected, and blood draw timing.
Results
Participants were, on average, 60 (+5.4) years of age, White (86%), and HIV-uninfected (56%); Twenty-four percent tested positive for anal HPV16 and/or 18-DNA (HPV16 prevalence=17.1%, HPV18=9.1%). In adjusted analysis, each half-log10 increase of FT was associated with a 1.9-fold (95% Confidence Interval: 1.11, 3.24) higher HPV16/18 prevalence. Additionally, other Group 1 high-risk HPVs were associated with a 1.56-fold (1.03, 2.37) higher HPV16/18 prevalence. Traditional risk factors for HPV16/18 infection (age, tobacco smoking; lifetime number of sexual partners, including the number of receptive anal intercourse partnerships within 24 months preceding HPV testing) were poorly correlated with one another and not statistically significantly associated with higher prevalence of HPV16/18 infection in unadjusted and adjusted analyses.
Citation: Hsu HK, Brown TT, Li X, Young S, Cranston RD, D’Souza G, et al. (2015) Association between Free Testosterone Levels and Anal Human Papillomavirus Types 16/18 Infections in a Cohort of Men Who Have Sex with Men. PLoS ONE 10(3): e0119447. https://doi.org/10.1371/journal.pone.0119447
Academic Editor: Craig Meyers, Penn State University School of Medicine, UNITED STATES
Received: April 25, 2014; Accepted: January 26, 2015; Published: March 20, 2015
Copyright: © 2015 Hsu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: Data from these analyses may be requested from the Multicenter AIDS Cohort Study Executive Committee (MACS-EC). A summary of requested data and its intended use should be submitted in writing to: Lisa Jacobson, PhD, Chair, MACS-EC. Johns Hopkins University, Bloomberg School of Public Health; Department of Epidemiology; 615 N. Wolfe Street, E7646; Baltimore, MD 21205-2179. Individual-level MACS data are available from Dr. Wiley (email, dwiley@ucla.edu) after a review of a concept sheet by the MACS executive committee. Our current material transfer agreement with the MACS does not allow us to distribute this dataset. Distribution to others must be individually requested from the MACS.
Funding: The MACS is funded primarily by the National Institute of Allergy and Infectious Diseases (NIAID, http://www.niaid.nih.gov/Pages/default.aspx), with additional cofunding from the National Cancer Institute (NCI, www.cancer.gov). Grant numbers: Baltimore (U01-AI-35042), Chicago (U01-AI-35039), Los Angeles (U01-AI-35040), Pittsburgh (U01-AI-35041), and Data Coordinating Center (UM1-AI-35043). Targeted supplemental funding for specific projects was also provided by the National Heart, Lung, and Blood Institute (NHLBI, http://www.nhlbi.nih.gov), and the National Institute on Deafness and Communication Disorders (NIDCD, http://www.nidcd.nih.gov/Pages/default.aspx). MACS data collection is also supported by the Johns Hopkins University Clinical and Translational Science Awards: UL1TR000424(JHU CTSA,http://ictr.johnshopkins.edu). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: Drs. Wiley, Cranston and D’Souza receive research funding from Merck, Sharp, & Dohme (Merck & Co., Inc). Dr. Wiley has been paid for educational lectures to healthcare providers by Merck & Co., Inc. Dr. Cranston has received honoraria for published works for Wolters Kluwer, publishers of UptoDate.com. Dr. Young is a member of a scientific advisory board for RocheDiagnostic Corporation & Quidel Corporation. Dr. Jacobson has participated on an advisory panel on outcomes for Bristol Myers Squibb. Dr. Brown has served a consultant to EMD-Serono, Merck, Abbvie, Gilead, ViiV Healthcare and had received research support from Merck and GSK. None of these agencies funded this work. Other authors have declared that no competing interests exist.
Introduction
Gay, bisexual and other men who have sex with men (MSM) are at high risk for both human immunodeficiency virus (HIV) and human papillomavirus (HPV) infections [1–3]. Over 100 different HPVs are well characterized, of which 12–25 are sexually transmitted between partners and are associated with high risk for cancers, including HPV types 16 (HPV16) and 18 (HPV18) [4, 5]. Experts classify HPV16 and 18 together with HPV31, 33, 35, 39, 45, 51, 52, 56, 58, and 59 as strongly carcinogenic (Group 1) high-risk HPVs (hrHPVs) because of associations with cervical cancers. HPV26, 30, 34, 53, 66, 67, 68, 69, 70, 73, 82, 85, and 97 show more limited associations with human cancers and are classified as weakly carcinogenic (Group 2) hrHPVs [4]. Nearly 72–90% of HPV-associated anal malignancies and over 70% of cervical malignancies are causally related to HPV16 and 18 alone, making them of special interest [6–9]. Other genital-tropic HPVs are classified as lower risk HPVs (lrHPVs) and are associated with low-grade dysplasia including genital warts [4].
Sex hormones have been linked to HPV-related cervical cancers through the association between oral contraceptive (OC) use and parity in women [10]. For example, large human case-control studies show OC use ≥5 years increases risk for in situ and invasive cervical carcinoma by approximately 3.4-fold [11–18]. Although few studies have explored sex hormone receptor distribution in anal tissues, data suggest that androgen and estrogen receptors (AR, ER) are detectable in stratified anal epithelium, with deeper strata showing greater abundance than more superficial epithelium [19]. ERs and ARs are additionally detected in connective tissues underlying the anal epithelium [19]. Histological similarity suggest that the ectocervix and anus may both support (HPV) carcinogenesis, but no data associate HPV infections and cancers with exposures to androgens such as endogenous and exogenous testosterone, pharmacological equivalents, and their downstream metabolites.
Available data suggest that frailty, hypogonadism, and wasting disease symptoms; as well as age and obesity are associated with lower circulating serum testosterone levels [20–25]. In HIV-infected men, especially in those who develop AIDS-defining illnesses, testosterone levels are lower than in HIV-uninfected men [20, 26]. Our goal was to evaluate the association between serum free testosterone (FT) and the prevalence of anal HPV16 and/or 18 (HPV16/18) infections in a well-described cohort of MSM, and to identify possible risk factors for anal HPV infection which may affect invasive anal cancer (IAC) risk.
Methods
Subjects
The Multicenter AIDS Cohort Study (MACS) protocol and its substudies, including the Anal Health Study (AHS), were approved locally by institutional review boards at each of four U.S. MACS study sites: (Baltimore) Johns Hopkins Bloomberg School of Public Health, (Chicago) Northwestern University, (Los Angeles) UCLA, and (Pittsburgh) University of Pittsburgh. Written informed consent for study procedures, specimen collection and testing were provided by the sample of 340 men evaluated for this study.
Overall, the MACS has enrolled 6,972 HIV-infected and -uninfected MSM in its lifetime: 4,954 men were enrolled between 1984–1985, 668 men between 1987–1991, and 1,350 men between 2001–03 1,350 [27, 28]. By the year 2012, 2,291 MSM remained enrolled and active in the MACS, of which 49% (1131/2291) were HIV-infected, and 61% (1389/2291) had been enrolled before 2001 [1]. Physical examination data, self- and interviewer-administered questionnaires for sociodemographic, sexual and other behavior characteristics, and laboratory specimens, including blood serum and cells, are collected semi-annually.
Sample/Specimen Selection
These analyses reflect data from two separately conducted MACS sub-studies that evaluated serum testosterone and anal HPVs among HIV-infected and -uninfected men. The testosterone study (parent study) evaluated the hypothesis that HIV-infection affected serum FT levels using a nested case-control study design. Specifically, serum specimens for 542 HIV-infected and -uninfected men ≥45 years of age were retrospectively selected from the MACS repository and tested for testosterone. Peripheral blood specimens collected from all men evaluated at each study visit were separated into cells and serum at local sites and aliquots of varying volumes were cryopreserved for long-term storage. Frozen serum specimens were shipped monthly on dry ice to the national MACS repository for all men completing a study visit. For these analyses, testosterone-tested specimens for the parent study had been frozen and thawed once, at most, prior to (testosterone) testing. Bolelli, et al. and others suggest testosterone analytes are stable in frozen serum 10 or more years [29–31] and the specimens in this study had an average interval of 3.3 years (±2.2) between collection and testing.
Case and control specimens tested for the parent study were selected from repository samples and up to six serum specimens/subject were evaluated. Controls were matched to cases based upon gender, race, enrollment period, study site, and specimen-collection (calendar) time, and age (±5 years). HIV-infected men (cases) were selected if ≥3 specimens were available, with ≥1 samples collected ≤3 years before beginning highly active antiretroviral therapy (HAART), and ≥2 samples collected within 10 years following HAART initiation. The availability and initiation of HAART varied among cases, and accordingly, temporally-matched test specimens ranged widely. For men who later enrolled in the Anal Health Study, first specimens tested for testosterone were collected between May, 1993 and February, 2006; similarly, the last specimens tested in each subject’s specimen set were collected between June 1997 and January 2010. For each man, testosterone data for only one visit were included in the analysis (as described in the “exposure of interest” section below).
HPV data were collected as part of a second sub-study that began active enrollment of 1,504 men in March 2010. Anal swab specimens were collected using a standardized clinical protocol and all active MACS men were eligible to participate [1, 32]. DNA extracted from swab specimens were tested for HPV and samples were stored for 42 days on average before HPV testing [1]; importantly, PreservCyt specimens may be stored at 2°- 30°C for up to 6 months before HPV testing (Hologic, Inc., Bedford, MA) [33].
Thus, this study is best conceptualized as a voluntary follow-up study of 340 HIV-infected and—uninfected men who were tested for FT as part of a passive, nested case-control analysis of associations between serum FT, HIV-infection and HAART (S1 Fig., S1 Table). Specifically, 340 of 542 (63%) FT-tested men from the parent study were alive and elected to undergo anal HPV testing. Non participants included 6% (33/542) of men who were lost to follow-up, 10% (54/542) of whom died before the first HPV test visit, and 21% (115/542) of whom were eligible but opted out of (HPV/cytology) testing. Together, sociodemographic, sexual and behavioral data, and the FT measurement proximal to the HPV genotyping test visit were analyzed to test the hypothesis that FT increased the probability of HPV16/18 infection.
The outcome of interest was HPV Type 16 or 18 DNA detected in anal swab specimens. Each specimen was collected using a standard clinical protocol: A Dacron swab was inserted approximately 2 inches beyond the anal verge, approximated to the wall and withdrawn, while rotated, over ~30 seconds before being placed into 20 mL of preservative (PreservCyt, Cytyc Corporation, Marlborough, MA) [1, 32]. A vortex mixer was used for several minutes to dislodge the collected material from swabs within the preservative containers. DNA was extracted from 250 μL of the cytology sample (Qiagen MinElute PCR Purification kit, Qiagen, Valencia, CA), 50 μL was amplified (for HPV-DNA) using the PGMY09/11 primer system [34]. Denatured PCR-products were hybridized to a probe array and were tested for 37 different HPVs types, including HPV16 and-18, 18 other Group 1 and 2, strongly and weakly carcinogenic, hrHPVs and 16 lrHPVs (Linear Array (HPV-LA) Roche Diagnostic Laboratories, Pleasanton, California) [4, 35, 36]. To evaluate contamination, positive and negative controls are run with each HPV-LA assay; data suggest the assay detects both single and multi-type infections more sensitively than earlier technologies and target amplification assays [35, 36]. Less than 1% (3/340) of first drawn cytology specimens were inadequate using HPV-LA; for those, findings from the second visit were evaluated in these analyses.
FT, the exposure of interest, was derived from total testosterone measured in cryopreserved serum using liquid chromatography-tandem mass spectrometry, and sex-hormone binding globulin estimated from radioimmunoassay [26]. The Vermeulen equation was used to estimate FT which closely approximates exact measures of FT obtained from equilibrium dialysis methods [37]. For this assay, the lower threshold for normal specimens drawn in the morning (AM) is 50 pg/mL [38, 39]. The FT measurement selected for these analyses was based on a focused preliminary assessment of the FT data. HAART initiation varied across the study group and the series of FT measurements for each case and matched control straddled the first visit where HAART use was reported by the index (matched) case in the parent study. Consequently, the first and last FT in the series of estimates from the parent study was collected, on average, 11.4 (+4.3) and 3.3 (+2.3) years before HPV testing, respectively. When considered together, the average slope for each subject’s FT measurements over the observation period was small, decreasing over time, and closely approximated for HIV-infected and -uninfected men: i.e., for log10-transformed data, β = -0.003 (+0.06) and β = -0.007 (+0.03), respectively. FT measured in serum was not statistically significantly associated with the time lapse between the last FT measurement and the first HPV test visit (for log10-transformed data, β = 0.014, p = 0.175). Thus, the FT measurement closest to the HPV test visit was selected and evaluated for these analyses.
Other covariates
We evaluated demographic characteristics that were collected at semiannual visits, including age, race (White non-Hispanic vs. others); other Group 1, Group 2 and low risk HPVs; tobacco smoking, alcohol use, body mass index (kg/m2, BMI), HIV-infection characteristics at the HPV test visit, and Hepatitis C virus (HCV) infection, known to be associated with FT [26]. Also, men who tested positive for ≥1 of 9 other Group 1 strongly carcinogenic hrHPVs (HPV31, 33, 35, 39, 45, 51, 52, 58, or 59), for any of 9 Group 2 weakly carcinogenic hrHPVs (HPV26, 53, 66, 67, 68, 69, 70, 73, and 82), or for ≥1 of 16 lrHPVs (HPV 6, 11, 40, 42, 54, 55, 61, 62, 64, 71, 72, 81, 83, 84, IS39, or CP6108) detected by the HPV-LA assay were compared to men that tested negative, respectively [4, 35, 36]. The number of sexual partnerships and smoking and alcohol use characteristics were evaluated over three periods: (1) lifetime exposure up until the first ever MACS visit (MACS Visit 1), (2) cumulative exposure between each man’s first MACS visit and the visit 24 months before HPV testing, and (3) the last 24 months before HPV testing. Levels of alcohol and tobacco use showed no associations with HPV; thus, ever-users of alcohol and tobacco during each period were compared to non-users. Associations between cumulative pack-years of tobacco use at visit 1, between visit 1 and the FT visit, and during the last 24 months were poorly to modestly correlated (r = 0.40–0.65, p-values<0.001) and poorly associated with HPV16/18 DNA detection in exploratory univariate and multivariate analyses. However, ever having smoked prior to MACS visit 1, between the baseline MACS visit and the FT visit, and during the last 24 months of observation were strongly correlated (r = 0.64–0.97, p-values<0.001); for this reason, only smoking closest to the HPV test visit was included in the final model. Those with BMI ≥25 kg/m2 were compared to subjects with BMI <25 kg/m2 men. For 32 men missing BMI measures at the testosterone visit, BMI measured at the closest MACS visit was used. Men reporting >500, 201–500, and 51–200 lifetime sex partners at MACS Visit 1 were compared to men who reported ≤50 sex partners at MACS Visit 1. Men who reported ≥355, 133–354, and 63–132 partners, representing quartile cutoffs, between MACS Visit 1 and the visit 24 months before HPV testing were compared to men who reported <63 partners over the same interval. Men who reported ≥4 and 1–3 receptive anal intercourse (RAI) partners for the last 24 months prior to HPV testing were compared to those who reported none. For 5 men missing RAI partnership data for ≥1 study visits during the last 24 months of observation, the number reported at each of the last four visits with complete RAI data before HPV testing were included. Lifetime cumulative duration of exogenous testosterone use in years was calculated for men who reported ever using exogenous testosterone. For these analyses, exogenous testosterone products included Androderm (Actavis, Inc., Salt Lake City, UT), AndroGel (AbbVie Inc., North Chicago, IL), Delatestryl (SAB-Pharma Inc., Boucherville, QC, Canada), Striant (Mipharm S.p.A, Milan, Italy), Testoderm (Alza Corporation, Mountain View, CA), and Virilon (Star Pharmaceuticals, Inc., North Miami Beach, FL). Data for three MACS study sites were compared to data from the site with the largest population, and men who enrolled early in the MACS, before 2001, were compared to those enrolled in 2001–2003 to control for sociodemographic differences. Time of phlebotomy was included in the analysis to control for differences associated with diurnal variation in testosterone secretion: before vs. after noon.
Statistical analysis
Participant characteristics were described overall, stratified by HPV16/18 infection and HIV-status, using chi-squared and Fisher’s exact test. Risk factors for HPV16/18 positivity were assessed in univariate and multivariate analysis using Poisson regression with robust error variance analyses, and prevalence ratios (PR) and 95% confidence intervals (95% CI) are reported [40]. The effect of testosterone level on HPV prevalence used half log10-transformed FT. Cochran-Armitage tests for trend and Pearson correlation coefficients described associations between continuous variables. Variables were eliminated from the full model using quasi-likelihood under the independence model criterion statistics over four iterations.
Results
At the HPV study visit, on average, men were 60 (Standard Deviation (+): 5.4) years of age, White (86%, 294/340), and more than half were HIV-uninfected (56%, 189/340; Table 1). The FT measurement for the visit most closely preceding the HPV test visit varied widely (μ = 76.3 (+ 54.7) pg/mL), especially among HIV-infected men: 82.9 (+78.3) vs. 70.9 (+21.2), for HIV-uninfected men (Table 2, S2 Fig.). Only 10% (34/340) of men reported ever using exogenous testosterone and, among them, all were HIV-infected and 62% (21/34) showed BMI <25 kg/m2. Smoking at the first MACS visit, at the FT and the HPV test visits were correlated with one another, but not the number and character of sexual partnerships reported at these three visits or with age or detection of HPV16/18 DNA. Median FT levels between HPV16/18-infected and-uninfected men (75.2 vs. 65.5 pg/mL, p = 0.006) (Table 1), and HIV-infected and-uninfected men (69.1 vs. 70.2 pg/mL, p = 0.04) (Table 2) differed. Although 21% (72/340) of men showed clinically low FT (<50 pg/mL), HIV-infected men showed an almost 2-fold higher odds of having FT below 50 pg/mL than HIV-uninfected men in the unadjusted analysis: 28% (41/151) vs. 15% (30/189); OR = 2.04 (1.20, 3.46).
Nearly 24% (80/340) of participants tested HPV16/18-positive; of these, 17% (58/340) tested positive for HPV16 and 9% (31/340) showed HPV18-DNA. Only 41% (33/80) tested positive for HPV16 or-18 alone from among the 12 Group 1 hrHPVs [4]. Nearly 31% (105/340) of all men tested positive for Group 1 hrHPVs other than HPV16/18, and men who tested positive for Group 2 hrHPVs showed 1.6 times higher prevalence of HPV16/18-DNA than did men who tested negative for Group 2 hrHPVs, 31% vs. 19% (p = 0.02). The prevalence of HPV16/18 was nearly as common among men testing positive for ≥1 lrHPVs than not: 26% vs. 20% (Table 1). HIV-infected men having ≤500 CD4+ T-cells/mm3 had a higher prevalence of HPV16/18 infection than HIV-infected men with >500 cells/mm3 and HIV-uninfected men: 37% (23/63) vs. 24% (21/88) vs. 19% (36/189), respectively (Cochran-Armitage Test for Trend, p<0.01; Table 2). Men whose FT visit was more closely approximated to the HPV DNA test visit were no more likely to test positive for HPV16/18 than those with longer intervals, measured in years (PR = 0.99 (0.92, 1.07)), and the time interval between FT and HPV test visits was poorly correlated with FT (r2 = 0.04, p = 0.40). Additionally, the mean and variation of FT levels for HPV16/18-infected men was greater than that for men that tested positive for other Group 1 hrHPVs and those who tested negative for all Group 1 viruses (S3 Fig.).
The multivariate analysis showed that the prevalence of HPV16/18-DNA detected in anal specimens increased 1.9-fold for each half log10 increase in FT (PR = 1.90 (95% CI: 1.11, 3.24)), even after controlling for age, race, cumulative years of exogenous testosterone use, self-reported lifetime number of sexual partnerships, BMI, tobacco smoking, HIV-infection and CD4+ T-cell count, among the HIV-infected men, and the timing of blood draws (Table 3). Non-Whites showed 2.3-fold higher prevalence of HPV16/18-DNA, though the estimate in the final model was not statistically significant (p ≥0.05) (Table 3). Prevalence of other Group 1 hrHPVs showed a 1.6-fold higher prevalence of HPV16/18 compared to those uninfected with other Group 1 viruses; however, adjusted analyses showed no statistically significant associations between HPV16/18 infection and Group 2 hrHPVs or lrHPVs (i.e., PR = 1.26 (0.81, 1.96) and 1.14 (0.74, 1.77)). Although not statistically significant, the adjusted model showed HIV-infected men with ≤500 CD4+ cells/mm3 had a 1.6-fold higher prevalence of HPV16/18 than did HIV-uninfected men; and, the HPV16/18 prevalence was 1.2-times higher for HIV-infected men showing >500 CD4+ cells/mm3. The fully-adjusted analysis suggested that the number of receptive anal intercourse partnerships within the 24 months preceding the HPV test visit did not statistically significantly affect the prevalence of HPV16/18 DNA detected in anal swab specimens (e.g., for 1–3 and ≥4 partners: PR = 1.42 (0.89, 2.28) and 1.23 (0.76, 1.98), respectively), nor did partnerships reported earlier in the study period (Table 3).
Discussion
HPV16/18 infections are extremely relevant in clinical practices where HIV-infected and -uninfected MSM are treated. Finding that higher serum FT, measured approximately 3 years before testing, increased risk for detecting HPV16/18-DNA in anal swab specimens suggests a causal temporal relationship. These findings support our hypothesis that testosterone, a sex steroid hormone, will affect productive HPV infections. In this study group, only HIV-infected men reported exogenous testosterone use but also showed statistically significantly lower FT levels, on average. These phenomenon are similarly reported by other investigators [20, 26], suggesting that in the absence of treatment, mean levels may have been even lower in HIV-infected than -uninfected men. Nonetheless, finding that higher FT increases risk for HPV16/18 infections some three years after its measurement may be important to carcinogenesis. HPV16/18 and 10 other hrHPVs are necessary but alone insufficient causes of human cancer [4], and persistent HPV16/18-DNA has been detected in both anal high-grade squamous intraepithelial lesions (HSIL) and IACs using worldwide samples. For example, 75–81% of HSIL and IAC lesions test positive for HPV16 DNA alone [41]. However, some might propose associations between FT and HPV16/18 infections are irrelevant because some data suggest persistent anal infections are uncommon and clearance is relatively rapid among high-risk MSM [42]. HPV-clearance may be more difficult to measure because small, persistent focal infections with low-copy number may be undetectable, even using sensitive molecular assays [5]. Nonetheless, clearance of HPV is less frequently observed for HPV16 [5, 43] than among other hrHPVs: e.g., 12.2 vs. 19.5–57.2/1000 person months in one large study [42, 44].
Most men in this study showed higher serum FT values when compared to the lower threshold for clinically normal values [38, 39]. Sex hormones have long been associated with HPV-malignancies in women [5]. For example, in vitro studies show 17β-estradiol stimulates the promoter and increases HPV oncogene expression in well-described cancer cell lines [45]. Others report estrogen and androgen receptors alike are detectable in anal squamous epithelium, making a biological association between focal anal HPV16/18 infections and FT more plausible [19]. However, we find no prior studies have evaluated the associations between FT and either HPV16/18 infections or IAC incidence. However, these data suggest that the prevalence of anal HPV16/18 infection in men nearly doubles with each half log10 increase of serum FT, even after controlling for the effects of other covariates, including age and exogenous testosterone use.
Like others, while some early analyses herein showed HIV-infection and lower CD4+ T-cell counts showed higher risk of HPV16/18 infection, the association was not statistically significant in the final model [46]. Nonetheless, some investigators report a positive association between CD4+ T-cell counts and infection risk at levels lower than the 500 CD4+ T-cells/mm3 cut-point reported here [46, 47]. Together, the direction and magnitude of our point estimates suggest that we may have lacked the power to detect a positive association between HIV and HPV16/18 infections as well as higher risk for men with lower CD4+ cell counts over men with higher values. Tobacco smoking [46, 48, 49], the number of sexual partners [32, 47, 50], and age [47, 50] have been positively associated with hrHPV infections and IACs. For example, current smokers vs. non- or never-smokers may show 1.23 to 2.59-fold higher risk for hrHPV infections and IACs [46, 48, 49]. Reports for some show that men with >100 lifetime male sex partners have a 30–40% higher risk for hrHPV seropositivity than men reporting fewer partners [47]; however, others report risk for anal hrHPVs is only elevated among HIV-uninfected MSM reporting >100 lifetime sexual partners, with no measurable effect among HIV-infected MSM [50]. Comparatively, when data described herein are stratified, we found a similar proportional distribution of men with <100, 100–500, and >500 lifetime sexual partnerships (data not shown). However, exploratory analyses still showed no statistically significant associations between the number of lifetime sexual partners and a more narrowly defined hrHPV subset, HPV16/18-DNA, either overall or among HIV-uninfected men alone. While these relationships may indicate associations between FT may more strongly influence prevalence of HPV16/18, they also suggest MACS men may have been more highly exposed to hrHPVs over their lifetimes than other MSM groups reported in the literature. Some differences may be related to differences in methodological approaches. For example, some published comparisons showing associations evaluated HPV16/18 outcomes using serology [47, 51]; however, some also reported associations between HPV16/18 and traditional risk factors such as tobacco smoking and sexual partnerships, when employing PCR-based (HPV) DNA assays similar to those reported herein [32, 46, 48–50].
HIV-infection increases the risk of hypogonadism and wasting, increasing the chances of prescribed testosterone replacement therapy [20, 23]. While as few as 15–16% of HIV-infected and -uninfected males show measurably low serum testosterone, low serum values are positively associated with higher risk of muscle wasting [20, 39, 52, 53]. Testosterone use in the absence of wasting or hypogonadism may not be recommended but would be relevant to our findings. For example, HIV-treatment guidelines suggest many MSM may be eligible for screening and treatment using testosterone: those with lower libido or erectile dysfunction, reduced bone mass or non-traumatic fractures; hot flashes, night-sweats, or fatigue and depression [54]. However, despite the relatively narrow screening and treatment recommendation, regardless of HIV-infection [39, 54], recent domestic and worldwide estimates suggest therapeutic use is increasing dramatically. For example, a 12-fold increase in testosterone prescription occurred between 2000 and 2011, with rates increasing >9-fold, from 10.3 to 98.5 monthly doses/1000 U.S. males [23, 55]. Together, these data suggest that testosterone use, therapeutically indicated or not, may be increasing and that older MSM who use testosterone may be at higher risk for HPV16/18 infections that are often linked to IACs [1, 41].
These analyses may be limited. For example, the sample size may be insufficient to detect associations between smoking, age, and sexual risk factors commonly associated with hrHPV infections in adults. Men evaluated for testosterone were unaware of their inclusion in the original investigation. Selection bias may limit our findings; for example, specimens for HIV-infected men selected from the repository for FT testing may not reflect a random sample of HIV-positive participants from the baseline cohort to which controls were matched. Further HIV-infected men surviving into the HAART era may not reflect the on-average experience or biological characteristics of the original cohort. Exogenous testosterone use, dose, route and source are not fully captured in these data, as use is recorded dichotomously at each semi-annual visit. Dichotomizing the phlebotomy time (before vs. after noon) may not adequately control for fluctuations in testosterone associated with physiologic diurnal variation. Also, other sex hormones were not measured; for example, we cannot evaluate the effect that testosterone conversion to estradiol, through the aromatase pathway, might have on HPV16/18 prevalence in these men [56]. Nonetheless, when polychotomous variables (e.g., number of sex partners) are misclassified or when misclassification varies for one variable across levels of covariates, the direction and magnitude of confounding cannot be estimated [57]. Additionally, the HPV-LA assay cannot distinguish between HPV52 and HPV33, 35, and 38, suggesting some conditions may be ambiguous; however, for these analyses, HPV33, 35, 38 and 52 are evaluated as a single categorical variable with 6 other Group 1 viruses [58]. Last, only 9 of 13 Group 2 HPVs are characterized by the HPV-LA and while the assay still reports findings for HPV-CP6108, the virus is also referred to as HPV89, a lrHPV [59].
Ideal use of testosterone-replacement therapy returns testosterone levels to age-appropriate norms, relieves symptoms, and prevents disease for deficient men without harmful side-effects [39, 60, 61]. Clinically, the results from these analyses suggest some risk may be associated with therapeutic and off-label use of testosterone in MSM who are at high risk for exposure to HPV16/18 [1, 32, 62]. A cautious approach to testosterone use in HIV-infected MSM may be indicated. Understanding associations between FT and persistent anal HPV16/18 infections will improve scientific understanding and inform therapeutic strategies.
Supporting Information
S1 Table. Disposition of 542 HIV-Infected and -Uninfected Men, Aged 45 Years and Older, Whose Specimens Were Selected from the MACS Specimen Repository for Testosterone Testing as Part of an Initial Matched-Design Longitudinal Study Evaluating Testosterone and HIV Infection; of these, 340 Men Participated in the Anal Health Study for HPV Genotyping Nearly Three Years Later.
https://doi.org/10.1371/journal.pone.0119447.s001
(DOCX)
S1 Fig. Flow Diagram for 542 HIV-Infected and -Uninfected Men, Aged 45 Years and Older, Whose Specimens were Selected from the MACS Specimen Repository for Testosterone Testing as Part of an Initial Matched-Design Longitudinal Study Evaluating Testosterone and HIV Infection.
Three Hundred and Forty Men Participated in the Anal Health Study for HPV Genotyping Nearly Three Years Later.
https://doi.org/10.1371/journal.pone.0119447.s002
(TIF)
S2 Fig. Two-Dimensional Plots of Free Testosterone Measurements for 340 Men Who Were Evaluated 3 Years before HPV Genotyping, Stratified by HIV-Serostatus and HPV Types 16/18 Infection Positivity.
https://doi.org/10.1371/journal.pone.0119447.s003
(TIF)
S3 Fig. Frequency of Free Testosterone Measurements for 340 Men Who Tested Positive for HPV16/18-DNA and for Other Group 1, Strongly Carcinogenic hrHPVs, Versus Those that Tested hrHPV-Group 1-DNA Negative.
https://doi.org/10.1371/journal.pone.0119447.s004
(TIF)
Acknowledgments
Data in this manuscript were collected by the Multicenter AIDS Cohort Study (MACS) with centers at Baltimore: The Johns Hopkins University Bloomberg School of Public Health: Joseph B. Margolick (PI), Barbara Crain, Adrian Dobs, Homayoon Farzadegan, Joel Gallant, Lisette Johnson-Hill, Michael W. Plankey, Ned Sacktor, Ola Selnes, James Shepard, Chloe Thio; Chicago: Feinberg School of Medicine, Northwestern University, and Cook County Bureau of Health Services: Steven M. Wolinsky (PI), John P. Phair, Sheila Badri, Maurice O'Gorman, David Ostrow, Frank Palella, Ann Ragin; Los Angeles: University of California, UCLA Schools of Public Health and Medicine: Roger Detels (PI), Otoniel Martínez-Maza (Co-P I), Aaron Aronow, Robert Bolan, Elizabeth Breen, Anthony Butch, Beth Jamieson, Eric N. Miller, John Oishi, Harry Vinters, Dorothy Wiley, Mallory Witt, Otto Yang, Stephen Young, Zuo Feng Zhang; Pittsburgh: University of Pittsburgh, Graduate School of Public Health: Charles R. Rinaldo (PI), Lawrence A. Kingsley (Co-PI), James T. Becker, Ross D. Cranston, Jeremy J. Martinson, John W. Mellors, Anthony J. Silvestre, Ronald D. Stall; and the Data Coordinating Center: The Johns Hopkins University Bloomberg School of Public Health: Lisa P. Jacobson (PI), Alvaro Munoz (Co-PI), Alison, Abraham, Keri Althoff, Christopher Cox, Jennifer Deal, Gypsyamber D’Souza, Priya Duggal, Janet Schollenberger, Eric C. Seaberg, Sol Su, Pamela Surkan. Website located at http://www.statepi.jhsph.edu/macs/macs.html. The contents of this publication are solely the responsibility of the authors and do not represent the official views of the National Institutes of Health (NIH).
Author Contributions
Conceived and designed the experiments: HKH TTB DJW. Performed the experiments: TTB SY. Analyzed the data: HKH SY RDC GD LPJ OMM ECS JBM FJJ MGM KC RKB RD DJW. Contributed reagents/materials/analysis tools: SY. Wrote the paper: HKH TTB XL SY RDC GD LPJ OMM ECS JBM FJJ MGM KC RKB RD DJW.
References
- 1. Wiley DJ, Li X, Hsu H, Seaberg EC, Cranston RD, Young S, et al. Factors Affecting the Prevalence of Strongly and Weakly Carcinogenic and Lower-Risk Human Papillomaviruses in Anal Specimens in a Cohort of Men Who Have Sex with Men (MSM). PLoS One. 2013;8(11):e79492. pmid:24278140
- 2. Glick SN, Feng Q, Popov V, Koutsky LA, Golden MR. High Rates of Incident and Prevalent Anal Human Papillomavirus Infection Among Young Men Who Have Sex With Men. J Infect Dis. 2013. Epub Sep 1, 2013.
- 3. Centers for Disease Control and Prevention (CDC). Monitoring selected national HIV prevention and care objectives by using HIV surveillance data—United States and 6 dependent areas—2011. MMWR Morb Mortal Wkly Rep. 2013;18(5):2–47.
- 4. Bouvard V, Baan R, Straif K, Grosse Y, Secretan B, El Ghissassi F, et al. A review of human carcinogens—Part B: biological agents. Lancet Oncology. 2009;10(4):321–2. Epub 2009/04/08. pmid:19350698
- 5.
International Agency for Research on Cancer (IARC) Working Group on Evaluation of Carcinogenic Risks to Humans. IARC Monographs on the Evaluation of Carcinogenic Risks to Humans: Human Papillomaviruses. Lyon, France: World Health Organization, International Agency for Research on Cancer; 2005. 670 p.
- 6. Hoots BE, Palefsky JM, Pimenta JM, Smith JS. Human papillomavirus type distribution in anal cancer and anal intraepithelial lesions. Int J Cancer. 2009;124(10):2375–83. pmid:19189402
- 7. Abramowitz L, Jacquard AC, Jaroud F, Haesebaert J, Siproudhis L, Pradat P, et al. Human papillomavirus genotype distribution in anal cancer in France: the EDiTH V study. International Journal of Cancer. 2011;129(2):433–9. Epub 2010/09/15. pmid:20839262
- 8. Valmary-Degano S, Jacquin E, Prétet JL, Monnien F, Girardo B, Arbez-Gindre F, et al. Signature patterns of human papillomavirus type 16 in invasive anal carcinoma. Human Pathology. 2013;44(6):11. Epub 2012 Dec 23.
- 9. FDA licensure of bivalent human papillomavirus vaccine (HPV2, Cervarix) for use in females and updated HPV vaccination recommendations from the Advisory Committee on Immunization Practices (ACIP). MMWR Morb Mortal Wkly Rep. 2010;59(20):626–9. pmid:20508593
- 10. International Collaboration of Epidemiological Studies of Cervical C. Comparison of risk factors for invasive squamous cell carcinoma and adenocarcinoma of the cervix: collaborative reanalysis of individual data on 8,097 women with squamous cell carcinoma and 1,374 women with adenocarcinoma from 12 epidemiological studies. Int J Cancer. 2007;120(4):885–91. pmid:17131323
- 11. Chung SH, Franceschi S, Lambert PF. Estrogen and ERalpha: culprits in cervical cancer? Trends Endocrinol Metab. 2010;21(8):8.
- 12. Elson DA, Riley RR, Lacey A, Thordarson G, Talamantes FJ, Arbeit JM. Sensitivity of the cervical transformation zone to estrogen-induced squamous carcinogenesis. Cancer Res. 2000;60(5):1267–75. pmid:10728686
- 13. Kaushic C, Roth KL, Anipindi V, Xiu F. Increased prevalence of sexually transmitted viral infections in women: the role of female sex hormones in regulating susceptibility and immune responses. Journal of Reproductive Immunology. 2011;88:6. Epub 2011 Feb 5.
- 14. Kwasniewska A, Postawski K, Gozdzicka-Jozefiak A, Kwasniewski W, Grywalska E, Zdunek M, et al. Estrogen and progesterone receptor expression in HPV-positive and HPV-negative cervical carcinomas. Oncol Rep. 2011;26(1):8. Epub 2011 Apr 12.
- 15. Yan X, Shah W, Li X, Wang Y. Estrogen contributes to non-pRb targeted HPV18 E7-caused cell proliferation and transformation. Cancer Biol Ther. 2010;9(3):10. Epub 2010 Feb 16.
- 16. International Collaboration of Epidemiological Studies of Cervical Cancer, Appleby P, Beral V, Berrington de Gonzalez A, Colin D, Franceschi S, et al. Cervical cancer and hormonal contraceptives: collaborative reanalysis of individual data for 16,573 women with cervical cancer and 35,509 women without cervical cancer from 24 epidemiological studies. Lancet. 2007;370(9599):13.
- 17. Madeleine MM, Daling JR, Schwartz SM, Shera K, McKnight B, Carter JJ, et al. Human papillomavirus and long-term oral contraceptive use increase the risk of adenocarcinoma in situ of the cervix. Cancer Epidemiol Biomarkers Prev. 2001;10(3):171–7. pmid:11303584
- 18. Moreno V, Bosch FX, Munoz N, Meijer CJ, Shah KV, Walboomers JM, et al. Effect of oral contraceptives on risk of cervical cancer in women with human papillomavirus infection: the IARC multicentric case-control study. Lancet. 2002;359(9312):1085–92. pmid:11943255
- 19. Oettling G, Franz HB. Mapping of androgen, estrogen and progesterone receptors in the anal continence organ. Eur J Obstet Gynecol Reprod Biol. 1998;77(2):211–6. pmid:9578281
- 20. Rochira V, Zirilli L, Orlando G, Santi D, Brigante G, Diazzi C, et al. Premature Decline of Serum Total Testosterone in HIV-Infected Men in the HAART-Era. PLoS One. 2011;6(12):e28512. Epub 2011/12/17. pmid:22174826
- 21. Bhattacharya RK, Khera M, Blick G, Kushner H, Miner MM. Testosterone replacement therapy among elderly males: the Testim Registry in the US (TRiUS). Clin Interv Aging. 2012;7:321–30. Epub 2012 Aug 24. pmid:22956867
- 22. Yeap BB, Araujo AB, Wittert GA. Do low testosterone levels contribute to ill-health during male ageing? Critical Reviews in Clinical Laboratory Sciences. 2012;49(5–6):168–82. pmid:22339380
- 23. Zirkin BR, Tenover JL. Aging and declining testosterone: past, present, and hopes for the future. J Androl. 2012;33(6):1111–8. Epub 2012 Aug 9. pmid:22879528
- 24. Sartorius G, Spasevska S, Idan A, Turner L, Forbes E, Zamojska A, et al. Serum testosterone, dihydrotestosterone and estradiol concentrations in older men self-reporting very good health: the healthy man study. Clin Endocrinol (Oxf). 2012;77(5):755–63. pmid:22563890
- 25. Borst SE, Mulligan T. Testosterone replacement therapy for older men. Clin Interv Aging. 2007;2(4):561–6. pmid:18225456
- 26. Monroe AK, Dobs AS, Xu X, Palella FJ, Kingsley LA, Witt MD, et al. Sex hormones, insulin resistance, and diabetes mellitus among men with or at risk for HIV infection. J Acquir Immune Defic Syndr. 2011;58(2):173–80. pmid:21705912
- 27. Kaslow RA, Ostrow DG, Detels R, Phair JP, Polk BF, Rinaldo CR Jr. The Multicenter AIDS Cohort Study: rationale, organization, and selected characteristics of the participants. American Journal of Epidemiology. 1987;126(2):310–8. pmid:3300281
- 28.
Konig J. MACS Public Data Set MultiCenter AIDS Cohort Study Group website2011 [cited 2015 January 7]. Available from: http://www.statepi.jhsph.edu/macs/pdt.html.
- 29. Svartberg J, Midtby M, Bonaa KH, Sundsfjord J, Joakimsen RM, Jorde R. The associations of age, lifestyle factors and chronic disease with testosterone in men: the Tromso Study. Eur J Endocrinol. 2003;149(2):145–52. pmid:12887292
- 30. Bolelli G, Muti P, Micheli A, Sciajno R, Franceschetti F, Krogh V, et al. Validity for epidemiological studies of long-term cryoconservation of steroid and protein hormones in serum and plasma. Cancer Epidemiol Biomarkers Prev. 1995;4(5):509–13. pmid:7549807
- 31. Kley HK, Schlaghecke R, Kruskemper HL. [Stability of steroids in plasma over a 10-year period]. Journal of clinical chemistry and clinical biochemistry Zeitschrift fur klinische Chemie und klinische Biochemie. 1985;23(12):875–8. pmid:3831227
- 32. Chin-Hong PV, Vittinghoff E, Cranston RD, Browne L, Buchbinder S, Colfax G, et al. Age-related prevalence of anal cancer precursors in homosexual men: the EXPLORE study. J Natl Cancer Inst. 2005;97(12):896–905. pmid:15956651
- 33.
COBAS HPV Test [Internet]. U.S. Food and Drug Administration: Labeling. 2011 [cited 07/28/2014]. Available from: http://www.accessdata.fda.gov/cdrh_docs/pdf10/P100020c.pdf.
- 34. Gravitt PE, Peyton CL, Alessi TQ, Wheeler CM, Coutlee F, Hildesheim A, et al. Improved amplification of genital human papillomaviruses. J Clin Microbiol. 2000;38(1):357–61. pmid:10618116
- 35. Castle PE, Gravitt PE, Solomon D, Wheeler CM, Schiffman M. Comparison of linear array and line blot assay for detection of human papillomavirus and diagnosis of cervical precancer and cancer in the atypical squamous cell of undetermined significance and low-grade squamous intraepithelial lesion triage study. J Clin Microbiol. 2008;46(1):109–17. pmid:17989194
- 36. Castle PE, Porras C, Quint WG, Rodriguez AC, Schiffman M, Gravitt PE, et al. Comparison of two PCR-based human papillomavirus genotyping methods. J Clin Microbiol. 2008;46(10):3437–45. pmid:18716224
- 37. Vermeulen A, Verdonck L, Kaufman JM. A critical evaluation of simple methods for the estimation of free testosterone in serum. J Clin Endocrinol Metab. 1999;84(10):3666–72. pmid:10523012
- 38. Monroe AK, Dobs AS, Palella FJ, Kingsley LA, Witt MD, Brown TT. Morning free and total testosterone in HIV-infected men: implications for the assessment of hypogonadism. AIDS research and therapy. 2014;11(1):6. pmid:24450960
- 39. Bhasin S, Cunningham GR, Hayes FJ, Matsumoto AM, Snyder PJ, Swerdloff RS, et al. Testosterone therapy in men with androgen deficiency syndromes: an Endocrine Society clinical practice guideline. J Clin Endocrinol Metab. 2010;95(6):2536–59. pmid:20525905
- 40. Zou G. A modified poisson regression approach to prospective studies with binary data. Am J Epidemiol. 2004;159(7):702–6. pmid:15033648
- 41. Alemany L, Saunier M, Alvarado-Cabrero I, Quiros B, Salmeron J, Shin HR, et al. Human papillomavirus DNA prevalence and type distribution in anal carcinomas worldwide. Int J Cancer. 2014.
- 42. de Pokomandy A, Rouleau D, Ghattas G, Vezina S, Cote P, Macleod J, et al. Prevalence, clearance, and incidence of anal human papillomavirus infection in HIV-infected men: the HIPVIRG cohort study. J Infect Dis. 2009;199(7):965–73. pmid:19239366
- 43. Yoshikawa H, Ebihara K, Tanaka Y, Noda K. Efficacy of quadrivalent human papillomavirus (types 6, 11, 16 and 18) vaccine (GARDASIL) in Japanese women aged 18–26 years. Cancer Sci. 2013;104(4):465–72. pmid:23331518
- 44. Villa LL, Costa RL, Petta CA, Andrade RP, Ault KA, Giuliano AR, et al. Prophylactic quadrivalent human papillomavirus (types 6, 11, 16, and 18) L1 virus-like particle vaccine in young women: a randomised double-blind placebo-controlled multicentre phase II efficacy trial. Lancet Oncol. 2005;6(5):271–8. Epub 2005/05/03. pmid:15863374
- 45. Kim CJ, Um SJ, Kim TY, Kim EJ, Park TC, Kim SJ, et al. Regulation of cell growth and HPV genes by exogenous estrogen in cervical cancer cells. Int J Gynecol Cancer. 2000;10(2):157–64. pmid:11240668
- 46. Schwartz LM, Castle PE, Follansbee S, Borgonovo S, Fetterman B, Tokugawa D, et al. Risk Factors for Anal HPV Infection and Anal Precancer in HIV-Infected Men Who Have Sex With Men. J Infect Dis. 2013. Epub 2013 Sep 4.
- 47. Mooij SH, van der Klis FR, van der Sande MA, Schepp RM, Speksnijder AG, Bogaards JA, et al. Seroepidemiology of high-risk HPV in HIV-negative and HIV-infected MSM: the H2M study. Cancer Epidemiol Biomarkers Prev. 2013;22(10):1698–708. pmid:24097197
- 48. Schabath MB, Villa LL, Lin HY, Fulp WJ, Lazcano-Ponce E, Salmeron J, et al. A prospective analysis of smoking and human papillomavirus infection among men in the HPV in Men Study. Int J Cancer. 2014;134(10):2448–57. Epub Nov 13, 2013. pmid:24222514
- 49. Bertisch B, Franceschi S, Lise M, Vernazza P, Keiser O, Schoni-Affolter F, et al. Risk factors for anal cancer in persons infected with HIV: a nested case-control study in the Swiss HIV Cohort Study. Am J Epidemiol. 2013;178(6):877–84. pmid:23900553
- 50. Van Aar F, Mooij SH, Van Der Sande MA, Speksnijder AG, Stolte IG, Meijer CJ, et al. Anal and penile high-risk human papillomavirus prevalence in HIV-negative and HIV-infected MSM. AIDS. 2013.
- 51. Heiligenberg M, Alberts CJ, Waterboer T, Speksnijder AG, De Vries HJ, Pawlita M, et al. Route of sexual exposure is independently associated with seropositivity to HPV-16 and HPV-18 among clients of an STI clinic in the Netherlands. J Infect Dis. 2013;208(7):1081–5. pmid:23861551
- 52. Yuki A, Otsuka R, Kozakai R, Kitamura I, Okura T, Ando F, et al. Relationship between Low Free Testosterone Levels and Loss of Muscle Mass. Sci Rep. 2013;3(1818):5.
- 53. Rabkin JG, Wagner GJ, Rabkin R. A double-blind, placebo-controlled trial of testosterone therapy for HIV-positive men with hypogonadal symptoms. Arch Gen Psychiatry. 2000;57(2):141–7. pmid:10665616
- 54. Aberg JA, Gallant JE, Ghanem KG, Emmanuel P, Zingman BS, Horberg MA, et al. Primary care guidelines for the management of persons infected with HIV: 2013 update by the HIV Medicine Association of the Infectious Diseases Society of America. Clin Infect Dis. 2014;58(1):1–10. pmid:24343580
- 55. Handelsman DJ. Global trends in testosterone prescribing, 2000–2011: expanding the spectrum of prescription drug misuse. Med J Aust. 2013;199(8):548–51. pmid:24138381
- 56. Lakshman KM, Kaplan B, Travison TG, Basaria S, Knapp PE, Singh AB, et al. The effects of injected testosterone dose and age on the conversion of testosterone to estradiol and dihydrotestosterone in young and older men. J Clin Endocrinol Metab. 2010;95(8):3955–64. pmid:20534765
- 57. Dosemeci M, Wacholder S, Lubin JH. Does nondifferential misclassification of exposure always bias a true effect toward the null value? American Journal of Epidemiology. 1990;132(4):746–8. pmid:2403115
- 58. Markowitz LE, Hariri S, Lin C, Dunne EF, Steinau M, McQuillan G, et al. Reduction in Human Papillomavirus (HPV) Prevalence Among YoungWomen Following HPV Vaccine Introduction in the United States, National Health and Nutrition Examination Surveys, 2003–2010. J Infect Dis. 2013;208(3):9. Epub 2013 Jun 9.
- 59. Villa LL. Chapter 1 Biology of genital human papillomaviruses. Int J Gynaecol Obstet. 2006;94(Supplement 1):5.
- 60. Dudgeon WD, Phillips KD, Carson JA, Brewer RB, Durstine JL, Hand GA. Counteracting muscle wasting in HIV-infected individuals. HIV medicine. 2006;7(5):299–310. pmid:16945075
- 61. Bhasin S, Storer TW, Asbel-Sethi N, Kilbourne A, Hays R, Sinha-Hikim I, et al. Effects of testosterone replacement with a nongenital, transdermal system, Androderm, in human immunodeficiency virus-infected men with low testosterone levels. J Clin Endocrinol Metab. 1998;83(9):3155–62. pmid:9745419
- 62. Nyitray AG, Carvalho da Silva RJ, Baggio ML, Lu B, Smith D, Abrahamsen M, et al. Age-specific prevalence of and risk factors for anal human papillomavirus (HPV) among men who have sex with women and men who have sex with men: the HPV in men (HIM) study. J Infect Dis. 2011;203(1):49–57. Epub 2010/12/15. pmid:21148496