Skip to main content
Advertisement
  • Loading metrics

Potential effectiveness of prophylactic HPV immunization for men who have sex with men in the Netherlands: A multi-model approach

  • Johannes A. Bogaards ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Visualization, Writing – original draft, Writing – review & editing

    hans.bogaards@rivm.nl

    Affiliations Centre for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Bilthoven, The Netherlands, Department of Epidemiology & Biostatistics, Amsterdam UMC, location VUmc, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands

  • Sofie H. Mooij,

    Roles Data curation, Writing – review & editing

    Affiliations Centre for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Bilthoven, The Netherlands, Cluster of Infectious Diseases, Public Health Service of Amsterdam (GGD), Amsterdam, The Netherlands

  • Maria Xiridou,

    Roles Conceptualization, Writing – review & editing

    Affiliation Centre for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Bilthoven, The Netherlands

  • Maarten F. Schim van der Loeff

    Roles Data curation, Funding acquisition, Supervision, Validation, Writing – review & editing

    Affiliations Cluster of Infectious Diseases, Public Health Service of Amsterdam (GGD), Amsterdam, The Netherlands, Amsterdam Infection & Immunity Institute, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands

Abstract

Background

Men who have sex with men (MSM) are at high risk for anal cancer, primarily related to human papillomavirus genotype 16 (HPV16) infections. At 8.5 per 100,000 per year, the incidence rate of anal cancer among MSM is similar to that of cervical cancer among adult women in the Netherlands. However, MSM are not included in most HPV vaccination programs. We explored the potential effectiveness of prophylactic immunization in reducing anogenital HPV16 transmission among MSM in the Netherlands.

Methods and findings

We developed a range of mathematical models for penile–anal HPV16 transmission, varying in sexual contact structure and natural history of infection, to provide robust and plausible predictions about the effectiveness of targeted vaccination. Models were informed by an observational cohort study among MSM in Amsterdam, 2010–2013. Parameters on sexual behavior and HPV16 infections were obtained by fitting the models to data from 461 HIV-negative study participants, considered representative of the local MSM population. We assumed 85% efficacy of vaccination against future HPV16 infections as reported for HIV-negative MSM, and age-specific uptake rates similar to those for hepatitis B vaccination among MSM in the Netherlands. Targeted vaccination was contrasted with vaccination of 12-year-old boys at 40% uptake in base-case scenarios, and we also considered the effectiveness of a combined strategy. Offering vaccine to MSM without age restrictions resulted in a model-averaged 27.3% reduction (90% prediction interval [PI] 11.9%–37.5%) in prevalence of anal HPV16 infections, assuming similar uptake among MSM as achieved for hepatitis B vaccination. The predicted reduction improved to 46.1% (90% PI 21.8%–62.4%) if uptake rates among MSM were doubled. The reductions in HPV16 infection prevalence were mostly achieved within 30 years of a targeted immunization campaign, during which they exceeded those induced by vaccinating 40% of preadolescent boys, if started simultaneously. The reduction in anal HPV16 prevalence amounted to 74.8% (90% PI 59.8%–93.0%) under a combined vaccination strategy. HPV16 prevalence reductions mostly exceeded vaccine coverage projections among MSM, illustrating the efficiency of prophylactic immunization even when the HPV vaccine is given after sexual debut. Mode of protection was identified as the key limitation to potential effectiveness of targeted vaccination, as the projected reductions were strongly reduced if we assumed no protection against future infections in recipients with prevalent infection or infection-derived immunity at the time of immunization. Unverified limitations of our study include the sparsity of data to inform the models, the omission of oral sex in transmission to the penile or anal site, and the restriction that our modeling results apply primarily to HIV-negative MSM.

Conclusions

Our findings suggest that targeted vaccination may generate considerable reductions in anogenital HPV16 infections among MSM, and has the potential to accelerate anal cancer prevention, especially when combined with sex-neutral vaccination in preadolescence.

Author summary

Why was this study done?

  • Anal and genital human papillomavirus (HPV) infections are sexually transmitted and may cause cancer in the anogenital area.
  • HPV vaccines protect against cancer by lowering the risk of getting infected with HPV, and are especially effective when given before becoming sexually active.
  • Men who have sex with men (MSM) are at high risk for anal cancer, but are not included in most HPV vaccination programs.
  • Decisions about their inclusion need to be informed by transmission models, but this is a challenge due to uncertainties regarding vaccine efficacy in those already exposed to HPV, and regarding HPV infection dynamics among MSM.

What did the researchers do and find?

  • To give robust and plausible predictions about the effectiveness of targeted vaccination, we developed various models for HPV transmission among MSM that were parameterized using data from a Dutch cohort study.
  • We assessed the effectiveness of various vaccination strategies targeting MSM or 12-year-old boys or a combination thereof, and assuming vaccine uptake in targeted campaigns comparable to that of hepatitis B vaccine among MSM in the Netherlands.
  • In the models, targeted vaccination reduced the occurrence of anogenital HPV infections by around 30% after 40 years, with a range from 10% to 50%, depending on the recruitment of MSM into targeted campaigns and on the assumed mode of vaccine protection.
  • This figure increased to 75% after 60 years when targeted vaccination was combined with sex-neutral vaccination in preadolescence, assuming 40% uptake among 12-year-old boys and 85% efficacy against future HPV16 infections in MSM.

What do these findings mean?

  • Our results are helpful for prioritizing male HPV vaccination, especially when deciding on the implementation of a selective campaign among MSM.
  • Offering HPV vaccine to sexually experienced MSM need not impede the efficiency of targeted vaccination, if vaccination protects against future HPV16 infections.
  • Targeted vaccination deserves consideration, at least temporarily, to protect adult MSM at high risk for anal cancer.

Introduction

Sexually transmitted oncogenic types of human papillomavirus (HPV) are known as the causative agents of cervical cancer [13]. They may also cause cancers in males, notably penile cancer, anal cancer, and a subset of head and neck cancers [2]. Relative to heterosexual males, men who have sex with men (MSM) are at increased risk for HPV-related cancers, especially for anal cancer [3]. With an estimated incidence of 8.5 per 100,000 per year, the incidence rate of anal cancer among MSM is similar to that of cervical cancer among adult women in the Netherlands [4].

In many countries, including the Netherlands, HPV-related disease prevention efforts are still entirely directed at females, through vaccination of preadolescent girls and screening for cervical cancer [2,4,5]. Over time, heterosexual males may receive indirect benefit from female vaccination through herd immunity, but MSM will not [6,7]. Vaccination of preadolescent boys along with girls can ultimately lead to control of HPV-related diseases in men and women alike, but might not constitute the most efficient use of resources [810]. Moreover, preadolescent vaccination will not protect currently active MSM, who might benefit from a targeted immunization campaign [1114]. However, the effectiveness of selective vaccination targeting MSM past sexual debut could be hampered by prior exposure to HPV vaccine types [15,16].

Extrapolating the population-level effectiveness of selective vaccination from vaccine trials is difficult, for several reasons. First, it is not clear which estimates of vaccine efficacy to use; intention-to-treat estimates are difficult to apply outside the specific study settings (e.g., to age groups other than those included in a trial), whereas per-protocol estimates require a correct interpretation outside the protocol conditions. Additionally, the population-level effectiveness of a selective vaccination program targeting high-risk individuals strongly depends on the infrastructure by which vaccines can be delivered to this group, and the implications in terms of vaccine coverage by age. Finally, herd effects are expected to play a major role in determining the ultimate impact of targeted prevention efforts, and their assessment typically relies on mathematical modeling.

The purpose of this paper is to explore, by means of mathematical modeling, the potential effectiveness of a targeted immunization campaign among MSM in the Netherlands. We focus on reductions in anogenital HPV genotype 16 (HPV16) infections, as HPV16 causes the majority of anogenital cancers in males—i.e., around 85% of anal HPV-related cancers [17] and over 60% of penile HPV-related cancers [18]—and is included in all registered HPV vaccines [2]. To assess the temporal benefit of targeted vaccination, post-vaccination dynamics in HPV16 prevalence among MSM are contrasted to those induced by sex-neutral vaccination (i.e., vaccination of boys in addition to girls) in preadolescence.

Methods

We developed a range of mathematical models for penile–anal HPV16 transmission to assess the potential effectiveness of selective vaccination of MSM. Throughout we assumed that MSM acquire penile infections via insertive anal intercourse, whereas anal infections are acquired through receptive anal intercourse. The models differed in terms of sexual contact structure of the MSM population and assumptions regarding the natural history of HPV16 infection. Sexual contact parameters were estimated, whenever possible, from self-administered questionnaire data regarding sociodemographic characteristics and recent sexual behavior among 778 MSM (median age: 40 years, 5th–95th percentile 28–61 years) participating in the H2M study [19]. This is an observational cohort study on HIV and HPV infections in MSM recruited in Amsterdam in 2010–2011 and followed every 3–6 months for at least 2 years.

Dynamic population model

We constructed a deterministic dynamic population model of MSM by estimating age-specific rates of entering and exiting the population of individuals forming same-sex male partnerships (S1S4 Figs). To account for penile-to-anal and anal-to-penile transmission, we incorporated sexual behavior by distinguishing insertive anal intercourse from receptive anal intercourse. The probabilities of engaging in either insertive, receptive, or both insertive and receptive anal sex within a partnership were obtained by fitting a mixture model to self-reported activities with anal sex partners in the last 6 months (S5 Fig). We modeled partner acquisition on the basis of self-reported numbers of anal sex partners in the last 6 months by HIV-negative H2M study participants, considered representative of the MSM population as validated by comparison to HIV incidence rates in the local community and an internet survey on sexual behavior among MSM throughout the Netherlands (S1 Text). To account for heterogeneity in partner acquisition rates in the model population, we considered 18 distinct settings of sexual contact structure for penile–anal HPV16 transmission, namely 3 distributions according to level of sexual activity (conditional on the age-specific mean and variance in age-specific contact rates) times 3 degrees of assortative mixing with respect to sexual activity times 2 degrees of assortative mixing with respect to preference for insertive/receptive anal sex (Table 1).

thumbnail
Table 1. Dynamic population model parameters and vaccine efficacy assumptions.

https://doi.org/10.1371/journal.pmed.1002756.t001

Natural history of HPV16 infection

We stratified the model population into separate compartments by penile and anal HPV16 infection status. Individuals could be susceptible or infected at either or both anatomic sites separately, yielding a minimum of 4 compartments: {SS,SI,IS,II}, with SS denoting the proportion of the population susceptible for both penile and anal infection, SI denoting the proportion susceptible for penile infection while infected at the anal site, and so forth. We defined separate (age- and time-dependent) infection hazards for acquiring HPV16 infection at the penile site only, at the anal site only, and at both sites from the same partner. We distinguished between penile-to-anal transmissibility, β01, defined as the per-partnership probability of HPV16 transmission from the penis to the anus when engaging in insertive anal sex, and anal-to-penile transmissibility, β10, defined as the per-partnership probability of HPV16 transmission from the anus to the penis when engaging in receptive anal sex (S2 Text).

In order to provide robust and plausible predictions about the effectiveness of targeted vaccination in light of structural model uncertainties, we constructed several models for the natural history of penile and anal HPV16 infections. The simplest model included only the minimum of 4 compartments {SS,SI,IS,II}, with independent clearance of penile and anal infections at a constant rate γ10 and γ01, respectively. In a modified version, we considered separate compartments with persistent infections developing at a rate ζ10 and ζ01 and clearing at a rate ξ10 < γ10 and ξ01 < γ01 for penile and anal infections, respectively.

Further modifications were obtained by considering natural immunity or latency. For natural immunity, we considered both the possibility of systemic and local immunity, and in the latter case we also considered the options that immunity would only be induced at the penile or anal site. In addition, we considered separate scenarios for immunity following clearance in all instances, in 1:3 instances, or in 1:10 instances. In all scenarios, natural immunity could be lost at a constant rate κ, assumed similar for the penile and anal site in case of local immunity. Latency was incorporated in a similar fashion; either all, 1:3, or 1:10 incident infections would turn into latent infections, with the remainder becoming either susceptible again or systemically immune. Reactivation of latent infections was modeled at a rate ϱ, assumed to be similar for both anatomic sites.

Parameters related to HPV16 infection and transmission were obtained by fitting the models to HPV16 prevalence and clearance among the 461 H2M study participants who provided penile and anal samples and were HIV-negative for the entire follow-up [20]. An overview of the models used in prediction is given in Table 2, with mathematical descriptions in S2 Text. For each model, parameter estimates were obtained by an approximate maximum-likelihood procedure (S3 Text), consisting of separate optimization of progression and clearance parameters from longitudinal data, and conditional optimization of other parameters from site-specific HPV16 infection prevalence at study baseline.

thumbnail
Table 2. Descriptions of the HPV16 natural history models included in predictions.

https://doi.org/10.1371/journal.pmed.1002756.t002

Vaccination scenarios

In evaluating the potential effectiveness of targeted vaccination, we considered offering vaccine to MSM in the following age groups: ≤26 years (based on evidence from vaccine trials) [15,16], ≤40 years (recommended for selective vaccination of MSM in the UK) [13], and all ages (without an upper age for eligibility). In base-case analysis, we assumed age-specific uptake rates similar to those for hepatitis B (HepB) vaccine among MSM throughout the Netherlands [21]. In 2002, the Netherlands initiated a selective vaccination program targeting groups at high risk for HepB infection, including MSM. Because HepB vaccination was added to the childhood vaccination program in 2011, we restricted estimates of age-specific annual vaccination rate to estimated HepB vaccine uptake rates among 15- to 70-year-old MSM over the period up to 2010 (S4 Text). We also considered a scenario where HPV vaccine acceptance among MSM was double that of HepB vaccine, by using 2-fold increased age-specific uptake rates (S9 Fig). Effectiveness of targeted vaccination was contrasted with sex-neutral preadolescent vaccination by assuming 40% of MSM were vaccinated against HPV16 upon entrance into the sexually active population. The value 40% was based on the estimated uptake among boys in countries with sex-neutral HPV immunization programs [22]. In sensitivity analyses, we also examined a combined strategy of preadolescent and targeted vaccination under base-case assumptions—i.e., 40% uptake among boys and uptake among MSM similar to that for the HepB vaccine—and a scenario of 80% uptake among 12-year-old boys (S4 Text).

Prophylactic efficacy was taken from a quadrivalent HPV vaccine trial conducted among 16- to 26-year-old males [15]. We based our analysis on the 85.6% (97.5% CI 73.4–92.9) incidence rate reduction of infection detected for ≥6 months with vaccine-type HPV in the per-protocol population, consisting of participants who were seronegative on day 1 and PCR-negative from day 1 through month 7 for the relevant vaccine types. Prophylactic efficacy was incorporated in the transmission models by assuming that 85% of vaccinees became fully protected against future HPV16 infections and 15% were unaffected by vaccination. In the latter category, vaccine recipients remained fully susceptible if so at the time of immunization, or reverted back to susceptibility upon loss of natural immunity. This interpretation of vaccine efficacy by “take” rather than “degree” has also been used in assessing the population-level impact of sex-neutral vaccination by heterosexual HPV transmission models [10,23]. In sensitivity analysis, we considered the conservative scenario of restricted efficacy, where HPV16 infection hazards were reduced by 85%, i.e., “leaky” protection by degree, and only if vaccinees were fully susceptible at the time of immunization (Table 1). Following previous models, we assumed 98% efficacy in the scenario of preadolescent boys’ vaccination [9,10]. Note that vaccine efficacy against reactivation of latent infections was not assumed in any scenario.

Model-averaged predictions

For each vaccination scenario, we formed a model-averaged prediction of the reduction in anogenital HPV16 prevalence among MSM that may be achieved via prophylactic immunization. This started by calculating Akaike weights for each model under consideration [24], based on the relative quality of all candidate models with respect to H2M study data (S4 Text). As some natural history models can be viewed as a subset of more generic models (e.g., models with natural immunity converge to those without in case of short-lasting immunity), we employed upper bounds on parameter estimates for loss of immunity κ and reactivation rate ϱ in order to avoid duplicates in the set of candidate models. Models with negligible weight, i.e., without empirical support, were omitted from further consideration.

Eventually, we included 360 models (20 natural history models combined with 18 settings of sexual contact structure) per vaccination scenario in assessing the effectiveness of vaccination. We calculated the site-specific HPV16 prevalence prior to vaccination and its (relative) reduction, specifically after 25 years and at the post-vaccination equilibrium, and summarized results using the Akaike-weighted predictions with 90% prediction intervals (PIs), defined as the 5th–95th percentile range of the 360 models.

Results

Patterns of site-specific HPV16 infection prevalence and clearance among HIV-negative H2M study participants were compatible with a range of mathematical models for penile–anal HPV16 transmission (Fig 1). Site-specific transmission probabilities varied widely across the models (Table 2), but penile-to-anal transmissibility almost invariably exceeded anal-to-penile transmissibility. Models that assumed a higher degree of natural immunity generally required increased transmissibility to reproduce the observed prevalence of penile and anal HPV16 infections. In addition, penile-to-anal transmissibility was higher when presuming a stronger degree of assortative mixing with respect to sexual activity (S7 Fig).

thumbnail
Fig 1. Outcomes of approximate maximum-likelihood fitting procedure.

This procedure consisted of separate likelihood optimization of progression and clearance parameters from event times of (A) penile and (B) anal infection clearance (time in days), and conditional estimation of remaining model parameters from multinomial likelihood optimization of (C) site-specific infection prevalence. Non-parametric survival functions (black lines; grey boxes) with 95% confidence limits (grey lines) in (A) and (B) are from a generalization of Kaplan–Meier estimates to interval-censored data [25]. Colored lines refer to various model-based survival functions fitted to interval-censored data (S3 Text). H2M baseline data in (C) are summarized as means with 95% binomial confidence intervals from 461 HIV-negative MSM. Model predictions (age-matched to H2M study participants) are given as Akaike-weighted averages with the minimum–maximum range across 360 models. HPV16, human papillomavirus genotype 16.

https://doi.org/10.1371/journal.pmed.1002756.g001

The relative quality of each model with respect to H2M study data was more dependent on the assumed natural history of HPV16 infection than on the sexual contact structure of the model (S8 Fig). In models that allowed for reactivation of latent infections, HPV16 prevalence mostly increased with increasing age, whereas HPV16 prevalence peaked around 40 years in models without latency (Fig 2). Likewise, models without latency predicted most sexually active HPV16-positive MSM to be in their 30s, whereas models with latency predicted this group to be somewhat older (S10 Fig). The model-averaged prevalence in the total MSM population prior to vaccination was 3.9% (90% PI 3.8%–4.1%) for penile HPV16 infection and 12.6% (90% PI 12.1%–13.1%) for anal HPV16 infection.

thumbnail
Fig 2. Prevalence of HPV16 infections among men who have sex with men.

Age-specific predictions of (A) penile and (B) anal HPV16 infection are derived from 20 natural history models combined with 18 settings of sexual contact structure; predictions from models with latency (see Table 2) are shown in dark green, models without in light green. Observed age-specific proportions among HIV-negative H2M study participants (circles) are given as moving averages for 10-year age groups (11,21), (12,22), etc. Vertical lines reflect 95% binomial confidence intervals for the observed proportions. HPV16, human papillomavirus genotype 16.

https://doi.org/10.1371/journal.pmed.1002756.g002

Offering vaccine to MSM aged ≤26 years achieved 9.4% vaccine coverage among MSM at the post-vaccination equilibrium in the base-case analysis (Table 3). This figure improved to 19.2% by extending vaccine eligibility to 40 years, and to 21.2% if the upper age for vaccine eligibility was discarded. Overall, the vaccine coverage among MSM achieved by targeted vaccination surpassed that of preadolescent boys’ vaccination in the first 12, 22, and 24 years of vaccination when offered to ≤26-year-old, ≤40-year-old, and all MSM, respectively, assuming similar HPV vaccine acceptance to that of HepB vaccine among MSM (Fig 3A). The combined strategy was projected to achieve 52.3% vaccine coverage among MSM. Adopting 2-fold increased uptake rates led to 17.6% vaccine coverage when vaccination was offered to MSM aged ≤26 years, 33.8% when offered until 40 years of age, and 36.5% if there was no age restriction. With doubled uptake, the vaccine coverage among MSM achieved by targeted vaccination surpassed that of preadolescent boys’ vaccination in the first 11, 20, and 22 years after initiating the vaccination strategy, respectively (Fig 3B).

thumbnail
Fig 3. Projected coverage of HPV vaccination in MSM.

The proportion of MSM vaccinated when assuming (A) similar uptake (base-case) or (B) 2-fold increased uptake (improved) as realized for hepatitis B vaccine among MSM, contrasted to the proportion of MSM vaccinated given sex-neutral vaccination in preadolescence, assuming (A) 40% or (B) 80% uptake among 12-year-old boys. In both panels, the combined strategy of vaccination at the age of 12 years with 40% uptake together with a targeted campaign among all MSM with base-case uptake is shown for comparison. HPV, human papillomavirus; MSM, men who have sex with men.

https://doi.org/10.1371/journal.pmed.1002756.g003

thumbnail
Table 3. Projected reductions in anogenital HPV16 infection prevalence among MSM from prophylactic vaccination.

https://doi.org/10.1371/journal.pmed.1002756.t003

With base-case uptake, offering vaccine to MSM aged ≤26 years resulted in a model-averaged reduction of 14.3% (90% PI 9.4%–18.8%) in equilibrium penile HPV16 infection, and a 13.4% reduction (90% PI 7.5%–17.8%) in equilibrium anal HPV16 infection, compared to the pre-vaccine prevalence of anogenital HPV16 infections among MSM. The predicted reductions improved to 27.2% (90% PI 15.3%–37.2%) and 25.5% (90% PI 11.6%–34.8%) in penile and anal HPV16 infections, respectively, if vaccine eligibility was extended to 40 years, and to 29.2% (90% PI 15.9%–40.2%) and 27.3% (90% PI 11.9%–37.5%), respectively, without an upper age for eligibility. HPV16 prevalence reductions in the post-vaccination equilibrium exceeded vaccine coverage projections (S11 Fig), and most of these reductions were realized within the first 30 years of a targeted immunization campaign, during which they exceeded those induced by vaccinating 40% of 12-year-old boys (Fig 4A). Moreover, the reductions in anogenital HPV16 prevalence from preadolescent boys’ vaccination were largely confined to younger MSM as compared to the reductions achieved by targeted vaccination (S12 Fig). However, the declines induced by preadolescent boys’ vaccination were sustained for much longer, ultimately leading to a 64.1% (90% PI 53.2%–79.7%) reduction in penile HPV16 infection among MSM, and a 61.6% (90% PI 48.4%–75.7%) reduction in anal HPV16 infection (S13 Fig). The combined strategy resulted in a 77.1% (90% PI 64.9%–95.2%) reduction in penile HPV16 infection and a 74.8% (90% PI 59.8%–93.0%) reduction in anal HPV16 infection among MSM (Table 3). Post-vaccination equilibria were achieved after 40 years in the case of targeted vaccination, but only after 60 years in scenarios involving preadolescent boys’ vaccination (S13S15 Figs).

thumbnail
Fig 4. Projected impact of HPV vaccination in MSM.

The model-averaged population prevalence of anal HPV16 infection among MSM by vaccination scenario with 90% prediction intervals (dotted lines), under (A) base-case and (B) improved HPV vaccine uptake in targeted vaccination. In both panels, the combined strategy of vaccination at the age of 12 years with 40% uptake together with a targeted campaign among all MSM with base-case uptake is shown for comparison. HPV, human papillomavirus; HPV16, human papillomavirus genotype 16; MSM, men who have sex with men.

https://doi.org/10.1371/journal.pmed.1002756.g004

With doubled uptake, offering vaccine to MSM aged ≤26 years resulted in a model-averaged reduction of 26.2% (90% PI 17.4%–34.4%) in penile HPV16 infection and a 24.6% reduction (90% PI 14.1%–32.3%) in anal HPV16 infection. The corresponding reductions amounted to 46.2% (90% PI 27.4%–63.0%) and 43.6% (90% PI 21.4%–58.7%) in penile and anal HPV16 infections, respectively, if vaccine eligibility was extended to 40 years, and to 48.8% (90% PI 28.1%–66.9%) and 46.1% (90% PI 21.8%–62.4%), respectively, if no upper age for eligibility was considered. The reductions in anogenital HPV16 prevalence were sustained for over 40 years (S14 Fig), again exceeding vaccine coverage projections in the post-vaccination equilibrium (S11 Fig). Assuming 80% vaccine uptake among preadolescent boys resulted in the near elimination of anogenital HPV16 infections among MSM, with ≥90% reductions in anal HPV16 infection in 95% of model projections (Table 3). However, for the first 30 years of the vaccination strategies, the reductions induced by 80% preadolescent boys’ vaccination were smaller than those induced by vaccinating 40% of preadolescent boys in combination with offering selective vaccination to MSM without age restrictions, with base-case uptake (Fig 4B).

Targeted vaccination was only marginally effective if prophylactic efficacy was restricted to those fully susceptible at the time of immunization, while assuming similar uptake as realized for HepB vaccine. In this conservative scenario, offering vaccine to ≤26-year-old, ≤40-year-old, or all MSM resulted in penile HPV16 prevalence reductions of only 5.9% (90% PI 2.5%–9.9%), 10.4% (90% PI 3.9%–16.9%), and 11.1% (90% PI 4.2%–18.1%), respectively (Table 3). The corresponding reductions in anal HPV16 prevalence were 6.1% (90% PI 2.6%–9.5%), 11.0% (90% PI 4.8%–17.4%), and 11.7% (90% PI 5.1%–18.6%), respectively (S15 Fig). In these scenarios, HPV16 prevalence reductions remained below vaccine coverage projections (S11 Fig). The reductions induced by preadolescent boys’ vaccination were more robust, being only marginally reduced when vaccination provided “leaky” protection against infection.

Models with neither natural immunity nor latency predicted the highest reductions in anogenital HPV16 infections among MSM, whereas models with latency predicted the lowest reductions from a targeted immunization campaign (Figs 5 and S16). Likewise, the effectiveness of preadolescent boys’ vaccination in reducing HPV16 prevalence among MSM was weakest in models that assumed latency in combination with natural immunity. These differences were maintained under improved vaccine uptake, but reductions from targeted immunization became less dependent on latency assumptions when prophylactic efficacy was restricted to those fully susceptible (S17 Fig). Estimated reductions in HPV16 prevalence among MSM increased with sexual contact heterogeneity and decreased with assortative mixing, irrespective of vaccination scenario (Fig 5). The findings were similar with improved vaccine uptake and with restricted efficacy (S17 Fig).

thumbnail
Fig 5. Effect of modeling assumptions on projected impact of vaccination.

The base-case estimates of ultimate reductions in anal HPV16 infection prevalence among MSM by vaccination scenario. Data are summarized as Tukey boxplots (i.e., interquartile range [IQR], with whiskers extending to at most 1.5 times IQR from the box, and outliers shown separately) according to presumed natural history (upper panels; models ordered as in Table 2) and sexual contact structure (lower panels) of the models included in predictions. The various sexual contact structures are grouped according to sexual activity distribution, assortative mixing with respect to sexual activity, and assortative mixing with respect to preference for insertive/receptive anal sex. Note the differences in scale for the vaccination scenarios. HPV16, human papillomavirus genotype 16; MSM, men who have sex with men; SIS, susceptible-infected-susceptible model.

https://doi.org/10.1371/journal.pmed.1002756.g005

Discussion

This study explored the potential effectiveness of HPV vaccination for MSM in the Netherlands. Based on predictions from a range of penile–anal HPV16 transmission models, we estimated that around 30% of anogenital infections might be prevented after 40 years if uptake similar to that of HepB vaccine among MSM throughout the Netherlands were realized. This figure increased to 75% after 60 years when targeted vaccination was combined with sex-neutral vaccination in preadolescence, assuming 40% uptake among 12-year-old boys. HPV16 prevalence reductions among MSM mostly exceeded vaccine coverage projections, illustrating the efficiency of prophylactic immunization even when HPV vaccine is given after sexual debut.

Our work suggests that HPV vaccination could be effective when delivered to MSM utilizing the infrastructure available for targeted HepB vaccination. Our analysis also shows that, while vaccinating young MSM is important, inclusion of older MSM is likely needed to achieve substantial vaccine coverage and impact. The predicted reductions improved to around 50% with doubled vaccination uptake rates and no upper age for eligibility. This scenario represents a vaccine coverage projection that resembles the estimated HepB vaccination coverage in Amsterdam [26], where most MSM were actively recruited from specialist sexual health services and outreach locations such as saunas and gay bars. The scope for improved prevention is thus considerable, offering key opportunities for raising awareness about HPV-related cancer and promoting HPV vaccine acceptance among MSM [27,28].

Several caveats should be taken into consideration when assessing the potential impact of HPV vaccination of MSM. First, our work indicates that it may take several decades before reductions in HPV infection level are fully achieved, and another 15–30 years before the full impact on cancer incidence is reached [29]. The models may have overestimated the time scale at which the effects of vaccination become apparent if assortative mixing with respect to age is strong. However, data suggest that for MSM partnerships, age-assortative mixing is much less present than for heterosexual partnerships [3034]. The modest and slow reductions in HPV16 prevalence are partly due to the assumption that uptake of HPV vaccine among MSM would resemble that of HepB vaccine, where it took more than a decade before the effects on transmission and incidence could be demonstrated [26]. In addition, HPV16 is characterized by a relatively high reproduction potential as compared to other vaccine-protected HPV types [35]. Consequently, one should expect modest herd effects from vaccinating against HPV16 in comparison to other HPV types, as demonstrated in a community-randomized HPV vaccine trial [36]. An Australian study also predicted a long duration for targeted vaccination effects to become fully apparent in vaccine-type HPV prevalence among MSM [14]. This long duration may influence willingness to participate in a selective vaccination program, and will also negatively affect the cost-effectiveness profile of targeted vaccination. Both issues may be alleviated by vaccine inclusion of low-risk HPV types associated with anogenital warts, as vaccination has been shown to induce rapid declines in wart incidence [6,7]. Presumably, the favorable cost-effectiveness profile of selectively vaccinating MSM in the UK was driven by the inclusion of anogenital wart prevention, as the favorable profile only applied to the use of quadrivalent HPV vaccine (including low-risk types 6 and 11), and not to HPV16/18 vaccination [13].

Second, the validity of the base-case scenarios strongly depends on the assumption of 85% efficacy against future HPV16 infections, irrespective of HPV16 infection status at the time of immunization. Thus, we assumed that prophylactic efficacy would also apply to recipients already infected with (or immune to) HPV16 at the time of immunization. While conceivable, this assumption has yet to be tested empirically. The effectiveness of targeted vaccination is profoundly reduced if prophylactic efficacy applies only when vaccine recipients are fully susceptible at the time of immunization, as in per-protocol analyses of vaccine trials [15,16]. Yet, HPV vaccine has demonstrated high efficacy and immunogenicity in adult women 24–45 years of age, regardless of previous exposure to HPV vaccine type [37], likely making this latter scenario overly conservative.

Third, the effectiveness of targeted vaccination varied considerably between the models included in the analysis, with lower reductions predicted in models that assumed naturally acquired immunity or reactivation of latent infections. As the mechanisms of immunity and latency become better understood [38,39], models will need to be revised to adequately capture the interactions of vaccine-induced protection and naturally acquired immunity or latency. Likewise, more data on the occurrence, acquisition, and duration of anogenital HPV infections in MSM would help to narrow down the range of transmission models compatible with data, and increase the precision of model-averaged prediction. In the meantime, well-calibrated dynamic models should be equipped to simulate and explore various assumptions around age specificity in HPV16 infection prevalence. A multi-modeling approach [24], as employed in this analysis, is valuable when evaluating the impact of an intervention in light of many structural model uncertainties.

Our dynamic model is the first to our knowledge to explicitly incorporate site-specific HPV infection and transmission among MSM. Previous models of HPV transmission in MSM remained ambiguous about the routes of transmission being considered, and circumvented the need to explicate site-specific transmissibility by considering general transmission probabilities in same-sex partnerships [13,14]. While such an approach greatly reduces model complexity, it goes at the expense of essential detail as the risks of penile and anal HPV infections are mediated by different behaviors (i.e., insertive versus receptive anal intercourse). Moreover, it has been suggested that probabilities of HPV transmission from the penis to the anus are likely to be significantly higher than those from the anus to the penis [40]. This supposition is borne out by our analysis. The overall reproduction number of penile–anal transmission is a composite of both site-specific reproduction numbers, analogous to transmission from men to women and back to men [41]. Therefore, leaving site-specific transmissibility unspecified could lead to biased predictions about the prevention of anogenital HPV16 infections in MSM through prophylactic immunization.

We did not consider condom use in our HPV16 transmission models. While some studies have found that consistent condom use may provide some degree of protection against HPV infection among high-risk men [42], systematic reviews provide no consistent evidence that condom use reduces the risk of becoming HPV DNA-positive [43,44]. Likewise, we found no clear relation in the H2M study between condom use during anal sex in the preceding 6 months and transition from uninfected to infected HPV16 or HPV18 states [45]. Nevertheless, our estimates of site-specific transmissibility could be biased as they are not adjusted for condom use. Moreover, our projections are sensitive to changes in sexual risk behavior, including the possibility of decreased condom use, e.g., in response to the introduction of HIV pre-exposure prophylaxis in the Netherlands [46]. Indirect effects on HPV transmission due to factors unrelated to HPV vaccination were beyond the scope of this study, but should be considered before planning selective vaccination of MSM.

We also did not incorporate transmission to the penile or anal site via oral sex. A recent study concluded that traditional heterosexual HPV transmission models (concerned with cervicovaginal and penile infections) may underestimate the population-level effectiveness of vaccination if a high proportion of genital infections originate from extragenital sites, whereas vaccination effectiveness may be overestimated if natural immunity to genital infections can occur following extragenital infections [47]. Currently, there is no strong evidence that oral infections are a reservoir for anogenital infections in MSM, or that clearance of oral infections can induce systemic immunity [48]. Moreover, the prevalence of oral HPV16 infection was below 2% in the HIV-negative H2M study participants, with a 5-fold lower incidence of oral HPV16 infection compared to anogenital HPV16 infection [49]. Hence, a substantial bias due to using only penile–anal transmission models to assess the potential effectiveness of HPV16 vaccination of MSM is not likely.

Finally, we did not incorporate the direct effect of HIV on HPV transmission dynamics. HIV is a strong and independent determinant of penile and anal HPV infections [3,20,49], but likely has a limited role in driving HPV transmission given the ubiquity of HPV infections among MSM in the Netherlands and the comparatively low prevalence of HIV. Nevertheless, HIV is one of the strongest risk factors for anal cancer, suggesting an important role of HIV in disease progression [50]. The policy in the UK of vaccinating HIV-positive MSM up to age 45 years against HPV [51], informed by a health economic study [13], is challenged by recent empirical data on the lack of efficacy in HIV-positive MSM aged 27 years or older [52]. Our modeling results apply primarily to HIV-negative MSM, for whom the HPV vaccine has shown prophylactic efficacy in preventing type-specific infections [16], genital warts [53], and lesion recurrence [54]. More research is needed on the role of HIV in HPV-induced neoplasia before more detailed predictions can be made with regard to anal cancer prevention. In any case, inclusion of MSM at high risk for HIV is paramount to achieve meaningful impact in selective vaccination programs.

The comparison of targeted vaccination with sex-neutral vaccination in preadolescence serves to illustrate the temporal benefit derived from a targeted immunization campaign among MSM. In addition, the comparison also serves as a benchmark to judge the potential effectiveness of targeted vaccination. The result, that vaccinating preadolescent boys would ultimately be more effective than offering HPV vaccine to MSM, partly depends on the supposedly moderate uptake of HPV vaccine among MSM in the Netherlands. However, even a targeted campaign that could reach a similar proportion of MSM as preadolescent vaccination would not be as effective, given the reduced efficacy of HPV vaccine when given after sexual debut. Therefore, the benefit of targeting interventions to MSM lies in a faster effectiveness of HPV vaccination regarding cancer prevention in males, and—possibly—in a lower number needed to vaccinate to prevent disease in males [9]. Besides, a sizeable proportion of the Dutch MSM population is not born in the Netherlands and may be missed by preadolescent vaccination.

Our work suggests that selective vaccination of MSM would be especially effective when combined with sex-neutral vaccination in preadolescence. Even a moderate uptake among preadolescent boys would already generate a substantially increased yield when combined with targeted vaccination, as it would render MSM immune against HPV16 upon entrance into the sexually active population. Conversely, a combined strategy could also safeguard against disappointing or unstable uptake in preadolescent vaccination programs, in the sense that it may be more feasible and sustainable to reach 40% of 12-year-old boys and MSM through a targeted campaign than it is to achieve 80% uptake among 12-year-old boys. While vaccinating 80% of preadolescent boys would be needed to achieve near elimination of HPV16 among MSM, our findings suggest stronger effectiveness from a combined strategy of vaccinating 40% of boys in preadolescence together with a targeted campaign among MSM for the first 30 years of vaccination.

In conclusion, this study suggests that a targeted immunization campaign among MSM in the Netherlands may generate considerable reductions in anogenital HPV16 infections in a high-risk population. Sex-neutral vaccination in preadolescence is likely needed to eliminate HPV-related diseases as a public health problem in men and women alike, but targeted vaccination deserves consideration, at least temporarily, to protect currently active MSM at high risk for anal cancer.

Supporting information

S1 Fig. Entrance into the population at risk for anogenital HPV16 infection.

https://doi.org/10.1371/journal.pmed.1002756.s001

(EPS)

S2 Fig. Age distribution of population at risk for anogenital HPV16 infection.

https://doi.org/10.1371/journal.pmed.1002756.s002

(EPS)

S3 Fig. Under-recruitment of MSM with recent sexual debut in the H2M study population.

https://doi.org/10.1371/journal.pmed.1002756.s003

(EPS)

S4 Fig. Acquisition of anal sex partners.

https://doi.org/10.1371/journal.pmed.1002756.s004

(EPS)

S5 Fig. Distribution according to preference for insertive/receptive anal sex.

https://doi.org/10.1371/journal.pmed.1002756.s005

(EPS)

S6 Fig. Sensitivity analyses on HPV16 infection clearance.

https://doi.org/10.1371/journal.pmed.1002756.s006

(EPS)

S7 Fig. Site-specific HPV16 transmissibility estimates.

https://doi.org/10.1371/journal.pmed.1002756.s007

(EPS)

S8 Fig. Relative quality of models used in prediction.

https://doi.org/10.1371/journal.pmed.1002756.s008

(EPS)

S9 Fig. Age-specific vaccine uptake among MSM.

https://doi.org/10.1371/journal.pmed.1002756.s009

(EPS)

S10 Fig. Age distribution of anogenital HPV16 infection prevalence.

The age distribution of HPV16 infections among MSM is obtained as the age-specific proportion of (A) penile or (B) anal HPV16 infection (Fig 2) from the stable age distribution of the modeled at-risk population (S2 Fig). Predictions from models with latency are shown in dark green, and those from models without latency in light green.

https://doi.org/10.1371/journal.pmed.1002756.s010

(EPS)

S11 Fig. Projected prevalence reductions against vaccine coverage among MSM.

Percentage reductions in the prevalence of anal HPV16 infection in the post-vaccination equilibrium compared to pre-vaccination prevalence, plotted against HPV vaccine coverage among MSM. Colors relate to various vaccination strategies, as explained in the legend. Closed circles denote base-case scenarios regarding uptake and efficacy. Squares denote scenarios of improved uptake (80% in preadolescence, doubled uptake among MSM), and open circles denote scenarios of “leaky” efficacy restricted to those fully susceptible at immunization.

https://doi.org/10.1371/journal.pmed.1002756.s011

(EPS)

S12 Fig. Projected impact on the age distribution of HPV16 infections.

The age distribution of penile (upper) and anal (lower) HPV16 infections among MSM after 25 years of vaccination strategy implementation (blue lines). Age distributions prior to vaccination (green lines) are as in S10 Fig. Left panels show results of targeted vaccination with similar uptake as realized for HepB vaccine among MSM. Right panels show results of preadolescent boys’ vaccination with 40% uptake at age 12 years.

https://doi.org/10.1371/journal.pmed.1002756.s012

(EPS)

S13 Fig. Projected impact of HPV vaccination in base-case analysis.

The population prevalence of penile (upper) and anal (lower) HPV16 infections. Results are shown for targeted vaccination with different age-specific eligibilities (assuming similar uptake as realized for HepB vaccine among MSM and “all-or-nothing” efficacy irrespective of infection status at immunization), for vaccination of 12-year-old boys at 40% uptake annually, and for a combination thereof. Individual model projections are shown in grey; red lines denote model-averaged predictions with 90% PIs.

https://doi.org/10.1371/journal.pmed.1002756.s013

(TIFF)

S14 Fig. Projected impact of HPV vaccination with improved uptake.

The population prevalence of penile (upper) and anal (lower) HPV16 infections. Results are shown for targeted vaccination with different age-specific eligibilities—assuming doubled uptake as compared to HepB vaccine among MSM and “all-or-nothing” efficacy irrespective of infection status at immunization—and for vaccination of 12-year-old boys at 80% uptake annually. Individual model projections are shown in grey; red lines denote model-averaged predictions with 90% PIs. The combined strategy still assumed base base-case uptake and is given for comparison.

https://doi.org/10.1371/journal.pmed.1002756.s014

(TIFF)

S15 Fig. Projected impact of HPV vaccination with restricted efficacy.

The population prevalence of penile (upper) and anal (lower) HPV16 infections. Results are shown for targeted vaccination with different age-specific eligibilities—assuming similar uptake as realized for HepB vaccine among MSM and “leaky” efficacy restricted to those fully susceptible at immunization—and for vaccination of 12-year-old boys at 40% uptake. Individual model projections are shown in grey; red lines denote model-averaged predictions with 90% PIs.

https://doi.org/10.1371/journal.pmed.1002756.s015

(TIFF)

S16 Fig. Effect of modeling assumptions on projected impact of vaccination.

The base-case estimates of ultimate reductions in penile HPV16 infection prevalence among MSM by vaccination scenario. Data are summarized as Tukey boxplots (i.e., interquartile range [IQR], with whiskers extending to at most 1.5 times IQR from the box, and outliers shown separately) according to the presumed natural history (upper panel; models ordered as in Table 2) and sexual contact structure (lower panel) of the models included in predictions. The various sexual contact structures are grouped according to sexual activity distribution, assortative mixing with respect to sexual activity, and assortative mixing with respect to preference for insertive/receptive anal sex.

https://doi.org/10.1371/journal.pmed.1002756.s016

(EPS)

S17 Fig. Effect of modeling assumptions on projected impact of vaccination in sensitivity analyses.

The ultimate reductions in anal HPV16 infection prevalence among MSM by vaccination scenario, assuming doubled uptake as compared to HepB vaccine among MSM (left panels), 80% uptake among 12-year-old boys and “all-or-nothing” efficacy irrespective of infection status at immunization (middle panels), or “leaky” efficacy restricted to those fully susceptible at immunization and base-case uptake (right panels). Data are summarized (with similar colors) as in Fig 5. Note the differences in scale for the vaccination scenarios.

https://doi.org/10.1371/journal.pmed.1002756.s017

(EPS)

Acknowledgments

The authors thank all H2M study participants and personnel and the steering committee for the use of valuable data.

References

  1. 1. Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, et al. Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J Pathol. 1999;189(1):12–9. pmid:10451482
  2. 2. Roden RBS, Stern PL. Opportunities and challenges for human papillomavirus vaccination in cancer. Nat Rev Cancer. 2018;18(4):240–54. pmid:29497146
  3. 3. Machalek DA, Poynten M, Jin F, Fairley CK, Farnsworth A, Garland SM, et al. Anal human papillomavirus infection and associated neoplastic lesions in men who have sex with men: a systematic review and meta‐analysis. Lancet Oncol. 2012;13(5):487–500. pmid:22445259
  4. 4. Marra E, Berkhof J, de Vries HJC, Schim van der Loeff MF. [Is vaccination of boys or men against HPV useful?] Ned Tijdschr Geneeskd. 2018;162:D1200.
  5. 5. Qendri V, Schurink-Van ‘t Klooster TM, Bogaards JA, Berkhof J. Ten years of HPV vaccination in the Netherlands: current evidence and future challenges in HPV-related disease prevention. Expert Rev Vaccines. 2018;17(12):1093–104. pmid:30417704
  6. 6. Donovan B, Franklin N, Guy R, Grulich AE, Regan DG, Ali H, et al. Quadrivalent human papillomavirus vaccination and trends in genital warts in Australia: analysis of national sentinel surveillance data. Lancet Infect Dis. 2011;11(1):39–44. pmid:21067976
  7. 7. Chow EPF, Machalek DA, Tabrizi SN, Danielewski JA, Fehler G, Bradshaw CS, et al. Quadrivalent vaccine-targeted human papillomavirus genotypes in heterosexual men after the Australian female human papillomavirus vaccination programme: a retrospective observational study. Lancet Infect Dis. 2017;17(1):68–77. pmid:27282422
  8. 8. Seto K, Marra F, Raymakers A, Marra CA. The cost effectiveness of human papillomavirus vaccines: a systematic review. Drugs. 2012;72(5):715–43. pmid:22413761
  9. 9. Bogaards JA, Wallinga J, Brakenhoff RH, Meijer CJ, Berkhof J. Direct benefit of vaccinating boys along with girls against oncogenic human papillomavirus: Bayesian evidence synthesis. BMJ. 2015;350:h2016. pmid:25985328
  10. 10. Qendri V, Bogaards JA, Berkhof J. Health and economic impact of a tender-based, sex-neutral human papillomavirus 16/18 vaccination program in the Netherlands. J Infect Dis. 2017;216(2):210–9. pmid:28586466
  11. 11. Kim JJ. Targeted human papillomavirus vaccination of men who have sex with men in the USA: a cost-effectiveness modelling analysis. Lancet Infect Dis. 2010;10(12):845–52. pmid:21051295
  12. 12. Vargas Parada C, Lennert Veerman J. Cost-effectiveness study of HPV vaccination as a primary prevention strategy for anal cancer in HIV-positive men in Chile. Value Health Reg Issues. 2016;11:17–23. pmid:27986194
  13. 13. Lin A, Ong KJ, Hobbelen P, King E, Mesher D, Edmunds WJ, et al. Impact and cost-effectiveness of selective human papillomavirus vaccination of men who have sex with men. Clin Infect Dis. 2017;64(5):580–88. pmid:28011615
  14. 14. Zhang L, Regan DG, Ong JJ, Gambhir M, Chow EPF, Zou H, et al. Targeted human papillomavirus vaccination for young men who have sex with men in Australia yields significant population benefits and is cost-effective. Vaccine. 2017;35(37):4923–29. pmid:28789853
  15. 15. Giuliano AR, Palefsky JM, Goldstone S, Moreira ED Jr, Penny ME, Aranda C, et al. Efficacy of quadrivalent HPV vaccine against HPV infection and disease in males. N Engl J Med. 2011;364(5):401–11. pmid:21288094
  16. 16. Palefsky JM, Giuliano AR, Goldstone S, Moreira ED Jr, Aranda C, Jessen H, et al. HPV vaccine against anal HPV infection and anal intraepithelial neoplasia. N Engl J Med. 2011;365(17):1576–85. pmid:22029979
  17. 17. Hoots BE, Palefsky JM, Pimenta JM, Smith JS. Human papillomavirus type distribution in anal cancer and anal intraepithelial lesions. Int J Cancer. 2009;124(10):2375–83. pmid:19189402
  18. 18. Alemany L, Cubilla A, Halec G, Kasamatsu E, Quirós B, Masferrer E, et al. Role of human papillomavirus in penile carcinomas worldwide. Eur Urol. 2016;69(5):953–61. pmid:26762611
  19. 19. van Aar F, Mooij SH, van der Sande MA, Speksnijder AG, Stolte IG, Meijer CJ, et al. Anal and penile high-risk human papillomavirus prevalence in HIV-negative and HIV-infected MSM. AIDS. 2013;27(18):2921–31. pmid:23921617
  20. 20. Mooij SH, van Santen DK, Geskus RB, van der Sande MA, Coutinho RA, Stolte IG, et al. The effect of HIV infection on anal and penile human papillomavirus incidence and clearance: a cohort study among MSM. AIDS. 2016;30(1):121–32. pmid:26474302
  21. 21. Xiridou M, van Houdt R, Hahné S, Coutinho R, van Steenbergen J, Kretzschmar M. Hepatitis B vaccination of men who have sex with men in the Netherlands: should we vaccinate more men, younger men or high-risk men? Sex Transm Infect. 2013;89(8):666–71. pmid:23812794
  22. 22. Reagan-Steiner S, Yankey D, Jeyarajah J, Elam-Evans LD, Curtis CR, MacNeil J, et al. National, regional, state, and selected local area vaccination coverage among adolescents aged 13–17 years—United States, 2015. MMWR Morb Mortal Wkly Rep. 2016;65(33):850–58. pmid:27561081
  23. 23. Brisson M, Bénard É, Drolet M, Bogaards JA, Baussano I, Vänskä S, et al. Population-level impact, herd immunity, and elimination after human papillomavirus vaccination: a systematic review and meta-analysis of predictions from transmission-dynamic models. Lancet Public Health. 2016;1(1):e8–17. pmid:29253379
  24. 24. Burnham KP, Anderson DR. Model selection and multimodel inference: a practical information-theoretic approach. 2nd ed. New York: Springer-Verlag; 2002.
  25. 25. Fay MP, Shaw PA. Exact and asymptotic weighted logrank tests for interval censored data: the interval R package. J Stat Softw. 2010;36(2):i02. pmid:25285054
  26. 26. van Rijckevorsel G, Whelan J, Kretzschmar M, Siedenburg E, Sonder G, Geskus R, et al. Targeted vaccination programme successful in reducing acute hepatitis B in men having sex with men in Amsterdam, the Netherlands. J Hepatol. 2013;59(6):1177–83. pmid:23954670
  27. 27. Nadarzynski T, Smith H, Richardson D, Pollard A, Llewellyn C. Perceptions of HPV and attitudes towards HPV vaccination amongst men who have sex with men: a qualitative analysis. Br J Health Psychol. 2017;22(2):345–61. pmid:28191723
  28. 28. Marra E, Alberts CJ, Zimet GD, Paulussen TG, Heijman T, Hogewoning AA, et al. HPV vaccination intention among male clients of a large STI outpatient clinic in Amsterdam, the Netherlands. Papillomavirus Res. 2016;2:178–84. pmid:29074179
  29. 29. Wilting SM, Steenbergen RDM. Molecular events leading to HPV-induced high grade neoplasia. Papillomavirus Res. 2016;2:85–8. pmid:29074190
  30. 30. Donà MG, Latini A, Benevolo M, Moretto D, Cristaudo A, Giuliani M. Anal human papillomavirus infection prevalence in men who have sex with men is age-independent: a role for recent sexual behavior? Future Microbiol. 2014;9(7):837–44. pmid:25156373
  31. 31. Ruan Y, Pan SW, Chamot E, Qian HZ, Li D, Li QC, et al. Sexual mixing patterns among social networks of HIV-positive and HIV-negative Beijing men who have sex with men: a multilevel comparison using roundtable network mapping. AIDS Care. 2011;23(8):1014–25. pmid:21400315
  32. 32. Glick SN, Morris M, Foxman B, Aral SO, Manhart LE, Holmes KK, et al. A comparison of sexual behavior patterns among men who have sex with men and heterosexual men and women. J Acquir Immune Defic Syndr. 2012;60(1):83–90. pmid:22522237
  33. 33. Beck EC, Birkett M, Armbruster B, Mustanski B. A data-driven simulation of HIV spread among young men who have sex with men: role of age and race mixing and STIs. J Acquir Immune Defic Syndr. 2015;70(2):186–94. pmid:26102448
  34. 34. Grey JA, Rothenberg RB, Sullivan PS, Rosenberg ES. Disassortative age-mixing does not explain differences in HIV prevalence between young white and black MSM: findings from four studies. PLoS ONE. 2015;10(6):e0129877. pmid:26090814
  35. 35. Baussano I, Lazzarato F, Ronco G, Lehtinen M, Dillner J, Franceschi S. Different challenges in eliminating HPV16 compared to other types: a modeling study. J Infect Dis. 2017;216(3):336–44. pmid:28859431
  36. 36. Lehtinen M, Luostarinen T, Vänskä S, Söderlund-Strand A, Eriksson T, Natunen K, et al. Gender-neutral vaccination provides improved control of human papillomavirus types 18/31/33/35 through herd immunity: results of a community randomized trial (III), Int J Cancer. 2018;143(9):2299–310. pmid:29845626
  37. 37. Castellsagué X, Muñoz N, Pitisuttithum P, Ferris D, Monsonego J, Ault K, et al. End-of-study safety, immunogenicity, and efficacy of quadrivalent HPV (types 6, 11, 16, 18) recombinant vaccine in adult women 24–45 years of age. Br J Cancer. 2011;105(1):28–37. pmid:21629249
  38. 38. Gravitt PE. The known unknowns of HPV natural history. J Clin Invest. 2011;121(12):4593–9. pmid:22133884
  39. 39. Twisk DE, van der Sande MAB, van Eeden A, Heideman DAM, van der Klis FRM, de Vries HJC, et al. Detection of incident anal high-risk HPV-DNA in MSM: incidence or reactivation? J Infect Dis. 2018;218(7):1018–26. pmid:29771378
  40. 40. Zou H, Tabrizi SN, Grulich AE, Hocking JS, Bradshaw CS, Cornall AM, et al. Site-specific human papillomavirus infection in adolescent men who have sex with men (HYPER): an observational cohort study. Lancet Infect Dis. 2015;15(1):65–73. pmid:25435055
  41. 41. Bogaards JA, Kretzschmar M, Xiridou M, Meijer CJ, Berkhof J, Wallinga J. Sex-specific immunization for sexually transmitted infections such as human papillomavirus: insights from mathematical models. PLoS Med. 2011;8(12):e1001147. pmid:22205887
  42. 42. Pierce Campbell CM, Lin HY, Fulp W, Papenfuss MR, Salmerón JJ, Quiterio MM, et al. Consistent condom use reduces the genital human papillomavirus burden among high-risk men: the HPV infection in men study. J Infect Dis. 2013;208(3):373–84. pmid:23644283
  43. 43. Lam JU, Rebolj M, Dugué PA, Bonde J, von Euler-Chelpin M, Lynge E. Condom use in prevention of human papillomavirus infections and cervical neoplasia: systematic review of longitudinal studies. J Med Screen. 2014;21(1):38–50. pmid:24488594
  44. 44. Manhart LE, Koutsky LA. Do condoms prevent genital HPV infection, external genital warts, or cervical neoplasia? A meta-analysis. Sex Transm Dis. 2002;29(11):725–35. pmid:12438912
  45. 45. Marra E, Kovaleva A, Bruisten SM, Vermeulen W, Boyd A, Schim van der Loeff MF. Incidence and clearance of anal high-risk HPV infection and their determinants among HIV-negative men who have sex with men over a period up to five-years. Clin Infect Dis. 2018 Aug 30. pmid:30169621
  46. 46. Hoornenborg E, Coyer L, van Laarhoven A, Achterbergh R, de Vries H, Prins M, et al. Change in sexual risk behaviour after 6 months of pre-exposure prophylaxis use: results from the Amsterdam pre-exposure prophylaxis demonstration project. AIDS. 2018;32(11):1527–32. pmid:29762169
  47. 47. Lemieux-Mellouki P, Drolet M, Jit M, Gingras G, Brisson M. Modelling multi-site transmission of the human papillomavirus and its impact on vaccination effectiveness. Epidemics. 2017;21:80–7. pmid:28916210
  48. 48. Chung CH, Bagheri A, D’Souza G. Epidemiology of oral human papillomavirus infection. Oral Oncol. 2014;50(5):364–9. pmid:24080455
  49. 49. van Aar F, Mooij SH, van der Sande MAB, Meijer CJ, King AJ, Verhagen DW, et al. Twelve-month incidence and clearance of oral HPV infection in HIV-negative and HIV-infected men who have sex with men: the H2M cohort study. BMC Infect Dis. 2014;14:668. pmid:25551194
  50. 50. Schim van der Loeff MF, Mooij SH, Richel O, de Vries HJ, Prins JM. HPV and anal cancer in HIV-infected individuals: a review. Curr HIV/AIDS Rep. 2014;11(3):250–62. pmid:24990810
  51. 51. Kirby T. MSM in England to be offered free HPV vaccination. Lancet Oncol. 2018;19(3):e148. pmid:29456089
  52. 52. Wilkin TJ, Chen H, Cespedes MS, Leon-Cruz JT, Godfrey C, Chiao EY, et al. A randomized, placebo-controlled trial of the quadrivalent HPV vaccine in HIV-infected adults age 27 years or older. Clin Infect Dis. 2018;67(9):1339–46. pmid:29659751
  53. 53. Swedish KA, Goldstone SE. Prevention of anal condyloma with quadrivalent human papillomavirus vaccination of older men who have sex with men. PLoS ONE. 2014;9(4):e933937.
  54. 54. Swedish KA, Factor SH, Goldstone SE. Prevention of recurrent high-grade anal neoplasia with quadrivalent human papillomavirus vaccination of men who have sex with men: a nonconcurrent cohort study. Clin Infect Dis. 2012;54(7):891–8. pmid:22291111