Figures
Abstract
Analytically distinct estimators have been proposed for the calculation of population-based estimates derived from respondent-driven sampling (RDS), yet there have been few comparisons of the inferences from these estimators using empirical data. We compared estimates produced by unweighted analysis used to calculate sample proportions and by three available estimators that are used to calculate population proportions, RDS-I, RDS-II (Volz-Heckathorn), and Gile’s RDS-SS. Data were derived from a cross-sectional, RDS study of men who have sex with men (MSM) conducted from October 2010 to April 2013 in Moscow, Russia (N = 1,376, recruitment depth: 31 waves). Analyses investigated the influence of key parameters: recruitment depth, homophily, and network size on sample and population estimates. Variability in results produced by the estimators and recruitment depth were statistically compared using the coefficient of variation (CV). Sample proportions had the least variability across different recruitment depths, compared to the RDS estimators. Population estimates tended to differ at lower recruitment depth but were approximately equal after reaching sampling equilibrium, highlighting the importance of sampling to greater recruitment depth. All estimators incorporate inverse probability weighting using self-reported network size, explaining the similarities in across population estimates and the difference of these estimates relative to sample proportions. Current biases and limitations associated with RDS estimators are discussed.
Citation: Wirtz AL, Mehta SH, Latkin C, Zelaya CE, Galai N, Peryshkina A, et al. (2016) Comparison of Respondent Driven Sampling Estimators to Determine HIV Prevalence and Population Characteristics among Men Who Have Sex with Men in Moscow, Russia. PLoS ONE 11(6): e0155519. https://doi.org/10.1371/journal.pone.0155519
Editor: Jesse Lawton Clark, David Geffen School of Medicine at UCLA, UNITED STATES
Received: February 26, 2016; Accepted: April 30, 2016; Published: June 1, 2016
Copyright: © 2016 Wirtz et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data include sensitive information related to HIV infection and sexual behaviors. Therefore data are available upon request at awirtz1@jhu.edu.
Funding: Funding for this research came from the National Institute of Mental Health (NIMH R01 MH085574-01A2) “High Risk Men: Identity, Health Risks, HIV and Stigma,” funded from 2009 – 2014. This research has been facilitated by the infrastructure and resources provided by the Johns Hopkins University Center for AIDS Research, an NIH funded program (P30AI094189), which is supported by the following NIH Co-Funding and Participating Institutes and Centers: NIAID, NCI, NICHD, NHLBI, NIDA, NIMH, NIA, FIC, NIGMS, NIDDK, and OAR. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Respondent-driven sampling (RDS) has emerged as a common method in HIV research to recruit hidden populations including men who have sex with men (MSM), sex workers, and people who inject drugs.[1, 2] These groups may be criminalized, stigmatized, difficult to reach, and generally lack sampling frames needed for probability-based sampling methods.[3] RDS attempts to overcome these limitations through two innovations: providing a means to reach hidden populations through peer networks and generating population estimates using specialized estimation methods.
RDS recruitment begins with ‘seeds’—well-networked individuals from the target population who are purposively selected and represent a range of characteristics. Seeds participate in study activities and are asked to recruit a limited number of peers to participate. Recruited peers who participate, in turn, become recruiters and are requested to invite a new selection of peers to participate. This process continues through successive waves of recruitment until the target sample size is reached.[4] The reliance on peer trust, allowance of limited peer recruitment by each participant, and use of double incentive system, in which participants are incentivized for both participation in the study and for recruitment of peers, aid in driving recruitment further into the target population than would typically be achieved through convenience or snowball sampling techniques.[2]
The second benefit of RDS is the ability to generate population estimates based on the underlying network from which the sample was derived. Estimation methods build on Markov chain theory and assume that after several waves of recruitment the total sample is no longer influenced by the initial sample (seeds) and begins to represent the underlying population.[5] Inherent in this are several assumptions that influence either recruitment or inference. With respect to statistical inference, assumptions include: 1) Sampling is with replacement, in which selected peers may be recruited multiple times; 2) Network size: that participants can accurately report personal network size; 3) Random recruitment: peer recruitment is a random selection from recruiter’s network.[6] Despite widespread use of RDS, these conditions are often not be met in practice. Most research relies on sampling without replacement, preventing individuals from participating more than once. Additionally, it is not known how accurately individuals can report their network size within the target population. Finally, secondary incentives may reduce the randomness of peer recruitment as participants preferentially recruit peers based on their relationship and/or assumptions of who will participate.[7]
Several estimators have been proposed to produce theoretically unbiased population-based estimates for RDS data. One of the earlier estimators, RDS-I, developed by Salganik and Heckathorn (also called the Salganik-Heckathorn estimator) incorporated the use of referral patterns, network size, and the number of cross-relation ties between subgroups of interest.[8, 9] A standalone software, Respondent Driven Sampling Analysis Tool (RDSAT), was developed that included RDS-I, leading to widespread use of this estimator.[10] RDS-II, the Volz-Heckathorn (V-H) estimator was subsequently proposed as an improvement upon and address biases associated with RDS-I.[11] The RDS-II estimator, like RDS-I, relies on sampling probabilities and incorporates individual degree, or network size, to create sampling weights, but does not rely on cross-group relations.[11] Schonlau and Liebau later developed a package for the implementation of RDS-I and RDS-II within Stata statistical software.[12] To address concerns related to the use of sampling without replacement in RDS studies, Gile and colleagues developed the RDS successive sampling estimator (RDS-SS) and a corresponding implementation package, RDS Analyst (RDSA) for use in R, which also includes RDS-I and RDS-II estimators.[13, 14]
Despite on-going improvements in these estimators, debates continue on how accurately these estimators capture true population values and to-date there is no consensus on which estimator is optimal.[15] Among hidden populations the true population values are difficult, if not impossible, to measure, so validation of population estimates has been explored in more general population samples. McCreesh and colleagues carried out an RDS survey in a community in Uganda to compare sample, RDS-I, and RDS-II estimates to known populations. The authors found that only 31–37% of the population estimates were closer to the true population proportions, compared to the sample proportions. In some cases, sample estimates more accurately captured the true population values.[16] Other concerns relate to the potential biases associated with the practice of sampling without replacement and Gile and Handcock add that RDS-II is sensitive to preferential referral among participants.[17] Other sensitivities of RDS demonstrated by simulation studies include biases induced by errors in self-reported network size and biases induced by the initiation sample (seeds).[13, 18]
In practice, reporting of RDS data has been inconsistent. Often, sample proportions are not reported, nor are recruitment depth or total sample size, limiting critical review or reanalysis of data.[19] There is no accepted convention on which estimator should be used, nor whether sample estimates (unweighted) or population estimates (RDS-weighted) or both should be presented. The reason for estimator selection is often absent or vague in descriptions of methods; [19] in many cases, selection may be based more on preference for a statistical software than consideration for estimator itself. General understanding of the use and sensitivities of RDS comes from statistical simulations with less frequent examination of the variability of RDS estimators in field research.
The analysis presented here is derived from a study of HIV among MSM in Moscow, Russia where RDS was used as a means to recruit hidden populations of MSM into an epidemiologic study and engage MSM in safe HIV testing opportunities. This analysis aimed to demonstrate the performance of the RDS estimators in population inference of HIV prevalence and behavioral characteristics as they relate to natural variations of key parameters within the empirical dataset.
Methods
Data were collected as part of a cross-sectional study to characterize the HIV epidemic among gay, bisexual, and other MSM from October 2010 and April 2013. Details of the sample, study site, recruitment, and measurement methods have been described elsewhere.[20, 21] To protect the confidentiality of participants, all participants provided oral consent to participate in the study activities and all data were anonymously collected. The study was approved by the Ethics Committee of the State Medical University, IP Pavlov, St. Petersburg, Russia and The Johns Hopkins Bloomberg School of Public Health Institutional Review Board, Baltimore, Maryland.
RDS-recruitment
Recruitment began with 14 purposively selected seeds. These individuals were recruited in a staggered fashion over the course of the study and were given four study coupons with which to recruit peer MSM. Eligible and participating peers were in turn provided with three study coupons for peer recruitment and this process was repeated until the target sample size of 1,370 was reached.
Measures
Participation in the study included a sociobehavioral survey and biological assessment of HIV and syphilis. All participants were asked personal network size questions used for RDS weighting (“How many people do you know personally who are men who have sex with men, live in the Moscow region, and who are 18 years old or older?” and “Of these men, how many have you seen in person at least once in the last 6 months?”).[3, 4]
Survey measures included demographic characteristics; sexual identity and relationships; substance use; and depression symptoms. Key variables for this analysis were selected to capture demographic, sexual identity and behavior, and infectious disease domains. We present the results pertaining to four variables: self-reported country of birth, sexual identity, consistent condom use during anal intercourse, and HIV infection. These variables were selected to represent high or low homophily, differences in average network size among variable subgroups, and included both self-reported characteristics and clinically determined outcomes. Country of birth was defined as being born in or outside of Russia. Sexual identity included three categories: homosexual, bisexual, or heterosexual/other. Condom use consistency during anal sex (last 6 months) was a binary self-reported measure: inconsistent (use of condoms only half the time, rarely, or never) and consistent condom (always or almost always). HIV infection status was determined via OraQuick Rapid HIV 1/2 test (OraSure Technologies, Bethlehem, PA, USA) and either confirmatory testing at the local reference laboratory (Lages Laboratory, Moscow) or self-reported HIV infection without confirmatory testing. Participants were offered HIV testing, but were allowed to decline testing and still participate in the survey, resulting in a greater response rate for the other variables included in the analysis.
RDS-estimators and analysis
Sample proportions without sampling weights were calculated for each variable. Population (RDS- proportions weighted) were separately calculated using the RDS-I, RDS-II, and RDS-SS estimators. Seeds were excluded from all analyses. RDS-I and RDS-II (Volz-Heckathorn) population proportions were calculated using weights derived from individual self-reported network size. Unlike RDS-I, RDS-II does not rely on the use of recruitment chains for estimation, though all statistical packages still require the underlying recruitment structure for estimation.[10, 12, 14] RDS-SS also requires the input of the population size.[13] For unknown MSM populations, an assumption of 1–3% of the adult male, general population is used to estimate the MSM population size.[13] An estimate in the range of 34,678–104,035 MSM in Moscow City was calculated assuming MSM represented 1–3% of the 3,467,836 adult men aged 18–54 residing in Moscow city in 2012.[22] The model assisted estimator (RDS-MA) has recently been proposed as a means to address seed bias that may be present in existing estimators; however, we did not examine its use given limited availability at the time of the analysis.[23]
Analysis of sample proportions, RDS-I, and RDS-II estimates were implemented in Stata 13 (College Station, TX) using the RDS statistical implementation package developed by Schonlau and Liebau.[24] Non-parametric bootstrapping of RDS-I and RDS-II estimates with 1,000 iterations was implemented to produce 95% confidence intervals (95%CI). Analysis of RDS-SS estimates was conducted using RDS-A within R software with 1,000 bootstrap iterations to produce 95% CIs.[14] To assess the sensitivity of the estimator to variation in population size, RDS-SS estimation was run twice using both population sizes that were based on 1% and 3% of the male population, rather than using the mid-point of the estimate, which is the RDS-SS default. RDS-I and RDS-II estimates produced by Stata with RDSA were also cross-checked to identify differences across software.
To assess the role of RDS parameters on sample and population estimates, homophily, recruitment depth, and average network size were estimated for each subgroup of the variables of interest. These parameters were calculated using the Stata implementation package.[12] Calculated homophily values can fall within the range of– 1 to 1, with estimates close to 1 indicating a strong likelihood to recruit from the same subgroup. Low homophily values are those that are close to 0, representing fairly neutral recruitment by one subgroup across other subgroups.[12] Variables with higher levels of homophily were selected for analysis of the role of homophily; these included country of birth and sexual identity. High levels of homophily range between 0.7–1.0; however, none of the variables in this data set were above 0.45, limiting the assessment of the influence of homophily. Recruitment depth is the number of waves of participants reached through RDS. RDS studies report typically reaching an average of about 6–10 waves of recruitment.[19] Convergence was also calculated for each variable and denotes the required recruitment depth necessary for a transition matrix to reach sampling equilibrium to the Markov process.[11] Individual network size is calculated by the number of other MSM the participants report knowing; these values are then averaged for each subgroup of each variable the individuals endorse.[12]
RDS estimators were compared using both graphical and statistical comparison methods. To analyze the role of recruitment depth (numbers of waves recruited), sample and population prevalence estimates were calculated for each variable of interest and recalculated when data were restricted to depths ≤5, ≤10, ≤20, and ≤31 waves, the last being the maximum recruitment of the sample. Estimates were plotted graphically with 95%CIs to compare the sample and population estimates of key subgroups of interest for each variable across specified recruitment depths. Graphs are displayed with Y-axis spanning a difference of 25% (i.e. they do not begin at 0%) for the purposes of displaying relatively small differences in estimates. The coefficient of variation was used to statistically compare the variability of estimates produced by the different RDS estimators.[25] CV was used to assess the variability in estimates produced by the RDS estimators in two forms: 1) the distribution of estimates produced with each estimator for each variable at full recruitment, and 2) the distribution of estimates produced at each specified recruitment depth across the RDS estimators.
Results
Six of 14 seeds successfully propagated five or more waves of recruitment. One seed that was initiated early in the study recruited 74% of the sample. A total of 3,997 coupons were distributed, yielding 31 waves of recruitment with 1,429 recruits and an overall coupon return rate of 0.36. Of these recruits, 1,362 were eligible for the study (1,376 including seeds). Table 1 presents RDS recruitment process indicators and seed descriptions.
Table 2 presents basic demographics of the study sample.
Recruitment Depth
All convergence estimates reported to reach sampling equilibrium by a depth of 3 to 4 waves for each variable. For most variables, except inconsistent condom use, sample and population proportion estimates appeared to stabilize after 5–10 waves of recruitment (Figs 1–4). Sample proportions were higher than calculated population proportions for all subgroups depicted. This difference was found for estimates produced across almost all analyzed recruitment depths, with the exception of inconsistent condom use which crossed the RDS estimators above a recruitment depth of wave 30. At full recruitment (31 waves), the sample and population proportions for inconsistent condom use were approximately equal (Fig 1).
Table includes average network size and homophily at each recruitment depth; RDS-II and RDS-SS estimates overlap; dashed lines represent 95%CIsConsistently, the variability of population estimates produced at higher waves of recruitment tended to be lower compared to the variability of estimates produced at lower waves of recruitment (Table 3). For example, CV estimates for inconsistent condom use range from a high of CVwave 5 = 0.013 at recruitment depth ≤5 waves and drop to CVwave 31 = 0.003 by wave 31.
Table includes average network size and homophily at each recruitment depth; with exception of the upper confidence interval, RDS-II and RDS-SS estimates overlap; dashed lines represent 95%CIs.
Table includes average network size and homophily at each recruitment depth; with exception of 95%CIs, RDS-II and RDS-SS estimates overlap; dashed lines represent 95%CIs.
Table includes average network size and homophily at each recruitment depth; with exception of upper 95CIs, RDS-I, RDS-II, and RDS-S estimates overlap; dashed lines represent 95%CIs.
Sample proportions of all variables had the lowest variability in estimates produced across all variables. The variability in HIV prevalence estimates illustrates this case in which the CVSP = 0.043, compared to higher variability among the other RDS estimators (CVRDS-I = 0.074; CVRDS-II = 0.093; CVRDS-SS = 0.092; Table 3). Among the RDS estimators, however, variability was similar. All 95% confidence intervals became more precise with increasing sample size, which may be reflective of increasing sample size rather than a reflection of the estimator. However, at higher recruitment depths, the confidence intervals no longer captured the sample proportion for HIV infection and sexual identity (Figs 2 and 3).
Average Network Size
There was little difference in average network size for the two condom use subcategories across waves: at recruitment depths ≤5 waves, the average network size was 30.80 and 34.35 for consistent and inconsistent condom use, respectively, and increased to 39.60 and 37.55 by a recruitment depth of ≤31 waves (Fig 1). With generally low and similar network size across both subgroups, both sample and population proportions track closely together after about 15 waves (Fig 1). Contrary to the prior example, the average network size among HIV infected MSM was substantially higher than among HIV uninfected MSM, with average network size among HIV uninfected men estimated at 30.54 and 52.00 among HIV infected men at wave≤5. At recruitment depth ≤31 waves, the average network sizes for these two groups were 37.67 and 52.55, respectively (Fig 2). There are visible differences between the sample and population proportions for HIV infection in which estimates for HIV infected participants with higher network sizes are down-weighted (Fig 2). This is a similar case for homosexual identity (Fig 3).
Homophily
Among variables with low homophily, inconsistent condom use and HIV infection, RDS estimators produced fairly similar results, though with greater variability at lower recruitment depth. This was most apparent for inconsistent condom use estimation when recruitment depth was equal to or less than 5 or 10 waves (CVwave5 = 0.013; CVwave10 = 0.013) compared to when recruitment depth was equal to or less than 20 and 31 waves (CVwave20 = 0.005; CVwave31 = 0.003; Table 1). For HIV infection, population proportions produced by RDS estimators were approximately equivalent after 10 waves of recruitment and variance was substantially lower in later waves (CVwave5 = 0.033; CVwave20 = 0.005; CVwave31 = 0.004; Table 3).
Similar results among the RDS estimators were observed for variables with higher homophily: homosexual identity and country of birth (homophily = 0.30–0.42; Figs 3 and 4). Estimated proportions of self-reported birth in the Russian Federation were approximately equal for all estimators, though with an intersection prior to wave 10 in which the RDS estimators began producing lower proportions relative to the sample proportions. In this example, homophily is low during early waves (-0.01) and increases to 0.21 in wave 15, but with likely little influence on the estimators due to the number of waves reached (Fig 4). For the variable of sexual identity, the RDS-I estimator, because of its reliance on cross-group relationships, overestimated the other RDS estimators until recruitment depth reached wave 20, in which all estimators began to produce similar results (Fig 3).
Discussion
Beyond successful recruitment of hidden populations, use of RDS provides an additional innovation in providing inference to the target population through the use of weighting techniques. Past simulations have demonstrated reductions in bias with each new estimator that has been developed, suggesting that each estimator may produce different results.[5, 13] This analysis of data from a sample of MSM in Moscow, Russia, however, demonstrates little difference in results produced by the available estimators.[5, 13, 17] Differences in the RDS estimators tend to appear in early waves until estimates have stabilized, typically after 5 to 10 waves of recruitment, when seed bias is likely reduced. Greater variation during earlier phases of recruitment are most evident with the RDS-I estimator, which has been de-emphasized more recently as a method for weighting.[11, 17] Studies with low recruitment depth, either due to a small sample size or relatively large number of seeds, may take this into consideration when considering the type of estimator used and may consider continuing recruitment to extend chains to an appropriate depth.
Variability of the estimators at low recruitment depth may be explained by seed bias, in which non-random selection of seeds biases the population estimates.[17] It is worth noting, however, that concerns about seed bias and depth were derived from simulations of sampling depths with 4 or 6 waves.[17] A prime example in this study was the case for the country of birth variable, in which the higher proportion of seeds reporting birth in the Russian Federation (versus outside) appeared to bias the RDS estimates at low recruitment depth, prior to convergence to sampling equilibrium. With increased recruitment depth, these differences between the estimators tended to disappear, which is consistent with reports by Volz and Heckathorn in the original comparison of RDS-I and RDS-II.[11] While RDS-II is apparently more stable for analysis of studies with short recruitment chains, relative to RDS-I, it is unclear how RDS-II compares to RDS-SS for short recruitment chains. Early research on the use of RDS-MA, which is currently not in widespread use, has demonstrated that this estimator does account for the bias associated with seed selection and may be appropriate for such analysis in the future.[23] Despite demonstrated implications of seed bias, it is not recommended, however, to remove data from early waves to reduce seed bias, as simulations have demonstrated that the RDS estimators are robust against inclusion of out-of-equilibrium data (data produced by waves before sampling equilibrium has been reached) and removal of out-of-equilibrium data from analysis may potentially introduce greater bias.[17, 26]
RDS-I and RDS-II estimation methods are grounded in Markov chain theory and rely on the assumption of sampling with replacement. Because sampling with replacement is not generally practiced in survey research, these estimators then rely on a small sampling fraction so that the sampling with replacement solutions inherent in the estimators may be applied.[11] Therefore, it has been demonstrated that recruitment that results in a large sampling fraction can also lend to bias associated with the RDS-II estimator.[17] RDS-SS adjusts for this by considering the population size in the estimation process and may provide an improved alternative estimator in cases where the sampling fraction is large.[13] The disadvantage, however, is that RDS-SS requires knowledge of the population size, which is often not known for hidden populations or may be highly variable, depending on the estimation method(s) used.[13, 27] In this study, which was conducted in Moscow City, the sampling fraction is small and we observed little difference between RDS-II and RDS-SS. Surveillance and other research conducted in rural areas and low population density should be aware of potential limitations of recruiting a large sampling fraction in areas where the target population may be small.[17]. Consideration to appropriate recruitment depth and sampling fraction is important during the recruitment process as well as analysis.
Sample proportions, which are considered to be approximate to a convenience sample, tend to have the least variability across various recruitment depths. These proportions may be influenced by the recruitment process, in which well-networked participants may be oversampled, though the extent to which these are affected is unclear. Nonetheless, the development of the RDS estimators sought to address potential over-representation of well-networked individuals by providing weights, which in essence down- or up-weight individuals’ data, based on their self-reported network size.[1, 5, 13] Such down-weighting was also apparent in our analysis of HIV infection and sexual identity where average network size was higher among subgroups of HIV infected MSM and those reporting homosexual identity, relative to other subgroups, and population prevalence estimates were consistently lower than sample proportions. While these RDS estimators have purported to produce unbiased estimates in other research, recent simulation studies and empiric research have demonstrated bias resulting from errors in self-reported network size and other potential sensitivities.[16, 18] These findings caution against over-reliance on use of RDS estimators and give credence to the inclusion of unweighted sample proportions along with population estimates produced by RDS-estimators.
Findings should be viewed in light of several limitations. First, we used unmodified research data from one setting and the generalizability of the demonstrated variability is unknown. We did not run simulations of the estimators, as such studies have already been conducted for other non-hidden populations and a few hidden populations to assess a range of issues and sources of bias.[6, 17, 18, 26, 28] This study, on the other hand, attempts to present how the estimators perform with natural variations in empirical data. None of the variables under study reached homophily greater than 0.42 and we were unable to demonstrate the potential influences of extremely high homophily. We may not fully identify limitations of the RDS estimators, as weaknesses have been noted when the sampling fraction is large, which it was not in this study.[17] While other studies and this one appear to highlight benefits of reaching greater recruitment depths, we did note that the 95%CI of the RDS estimators failed to include the sample proportion for several variables at high recruitment depths and the implications of this remain unknown. Finally, as with all RDS research to-date, there is no way to determine which estimator is correct.
Statistical software also plays a role in the decision of the estimator. RDSAT is a standalone, open access software that has been widely taught and is easily implemented. RDSAT, however, does not allow for additional analysis, whereas the RDS weights can be easily calculated and implemented within regression analyses when such analyses are performed using Stata or RDSA (in R, which is also open access). There is still no consensus, however, for how and whether RDS estimates should be incorporated into regression analyses to estimate magnitudes of associations within RDS samples.[2, 12] With respect to population prevalence estimates, our study demonstrated that there are no substantial differences across estimators after an appropriate recruitment depth has been reached. As previously reported, formative research is critical to informing study-specific decisions related to RDS and well as to identifying seeds who represent a range of characteristics to reduce potential seed bias in subsequent inference.[2, 17] Given current debates, it is recommended that several key pieces of information are included in all peer reviewed publications and surveillance reports: reporting of the selected RDS estimator along with the statistical program used to calculate weights and proportions, samples size, sample proportion and recruitment depths.[15, 16, 29] These recommendations are also highlighted, amongst others, in the recently released Strobe-RDS.[29] In the evolving development of RDS estimation methods, providing this information supports future use and critical review of research findings that are drawn from RDS methodologies.
Acknowledgments
We wish to thank SANAM clinic and Tatiana Bondarenko for insight, support, and use of the SANAM clinic for conduct of qualitative research and the Be Safe study. We appreciate the efforts put forth by Irina Deobald and Konstantin Dyakonov in the formative phases of this project. We are deeply thankful to the participants who contributed their time and personal experiences to this study.
Author Contributions
Conceived and designed the experiments: CB ALW CEZ NG VM AP CL. Analyzed the data: ALW SM CL. Wrote the paper: ALW. Collected data: PD IK. Reviewed/edited the manuscript: CB SM CL CEZ.
References
- 1. Heckathorn DD. Respondent-driven sampling: A new approach to the study of hidden populations. Soc Probl. 1997 May;44(2):174–99. ISI:A1997XE13900003. English.
- 2. Johnston LG, Malekinejad M, Kendall C, Iuppa IM, Rutherford GW. Implementation challenges to using respondent-driven sampling methodology for HIV biological and behavioral surveillance: field experiences in international settings. AIDS and behavior. 2008 Jul;12(4 Suppl):S131–41. pmid:18535901.
- 3. Magnani R, Sabin K, Saidel T, Heckathorn D. Review of sampling hard-to-reach and hidden populations for HIV surveillance. Aids. 2005 May;19 Suppl 2:S67–72. pmid:15930843. Epub 2005/06/03. eng.
- 4. Malekinejad M, Johnston LG, Kendall C, Kerr LR, Rifkin MR, Rutherford GW. Using respondent-driven sampling methodology for HIV biological and behavioral surveillance in international settings: a systematic review. AIDS and behavior. 2008 Jul;12(4 Suppl):S105–30. pmid:18561018.
- 5. Heckathorn D. Respondent driven sampling II: deriving valid population estimates from chain-referral samples of hidden populations. Soc Probl. 2002;49(1):11–34.
- 6. Lu X, Bengtsson L, Britton T, Camitz M, Kim BJ, Thorson A, et al. The sensitivity of respondent-driven sampling. Journal of the Royal Statistical Society: Series A (Statistics in Society). 2012;175(1):191–216.
- 7. Young AM, Rudolph AE, Quillen D, Havens JR. Spatial, temporal and relational patterns in respondent-driven sampling: evidence from a social network study of rural drug users. Journal of Epidemiology and Community Health. 2014 August 1, 2014;68(8):792–8. pmid:24692631
- 8.
Salganik MJ, Heckathorn D. Sampling and estimation in hidden populations using respondent-driven sampling. In: Stolzenberg RM, editor. Sociological Methodology. 35. Boston, MA: Blackwell Publishing; 2004. p. 193–238.
- 9. Heckathorn D. Extensions of respondent-driven sampling: Analyzing continuous variables and controlling for differential recruitment. Sociol Methodol. 2007;37:151–207.
- 10.
Volz E, Wejnert C, Cameron C, Spiller M, Barash V, Degani I, et al. Respondent Driven Sampling Analysis Tool (RDSAT). Ithaca, NY: Cornell University,; 2012.
- 11. Volz E, Heckathorn D. Probability based estimation theory for respondent driven sampling. J Off Stat. 2008;24(79).
- 12. Schonlau M, Liebau E. Respondent-driven sampling. Stata Journal. 2012;12(1):72–93.
- 13. Gile KJ. Improved Inference for Respondent-Driven Sampling Data With Application to HIV Prevalence Estimation. J Am Stat Assoc. 2011 Mar;106(493):135–46. WOS:000289871200012. English.
- 14. Handcock MS, Fellows IE, Gile KJ. DeducerRDSAnalyst: Graphical User Interface to the RDS package for Respondent-Driven Sampling. Los Angeles, California 2012.
- 15. Salganik MJ. Commentary: Respondent-driven Sampling in the Real World. Epidemiology. 2012 Jan;23(1):148–50. pmid:22157310.
- 16. McCreesh N, Frost SD, Seeley J, Katongole J, Tarsh MN, Ndunguse R, et al. Evaluation of respondent-driven sampling. Epidemiology. 2012 Jan;23(1):138–47. pmid:22157309. Pubmed Central PMCID: 3277908.
- 17. Gile KJ, Handcock MS. Respondent-driven sampling: an assessment of current methodology Sociological Methodology. 2010;40(1):285–327. pmid:22969167
- 18. Mills HL, Johnson S, Hickman M, Jones NS, Colijn C. Errors in reported degrees and respondent driven sampling: implications for bias. Drug and alcohol dependence. 2014 Sep 1;142:120–6. pmid:24999062. Pubmed Central PMCID: 4150985.
- 19. Johnston LG, Chen YH, Silva-Santisteban A, Raymond HF. An empirical examination of respondent driven sampling design effects among HIV risk groups from studies conducted around the world. AIDS and behavior. 2013 Jul;17(6):2202–10. pmid:23297082.
- 20. Wirtz AL, Zelaya CE, Latkin C, Stall R, Peryshkina A, Galai N, et al. Alcohol Use and Associated Sexual and Substance Use Behaviors Among Men Who Have Sex with Men in Moscow, Russia. AIDS and behavior. 2015 2015/04/18:1–14. English.
- 21. Wirtz AL, Zelaya CE, Peryshkina A, McGowan I, Cranston RD, Latkin C, et al. Anal human papillomavirus and HIV: A cross-sectional study among men who have sex with men in Moscow, Russia, 2012–2013. Euro surveillance: bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin. 2015;20(15). pmid:25953132.
- 22.
Federal States Statistics Service (Rosstat). Population by age groups (2012). Moscow,: Federal Statistics Service, 2014.
- 23. Gile K, Handcock MS. Network Model-Assisted Inference from Respondent-Driven Sampling Data. arXiv. 2011 August.
- 24. Schonlau M, Liebau E. Respondent-driven sampling. The Stata Journal. 2012;12(1):72–93.
- 25. Martin JD, Gray LN. Measurement of Relative Variation: Sociological Examples. American Sociological Review. 1971;36(3):496–502.
- 26. Wejnert C. An Empirical Test of Respondent-Driven Sampling: Point Estimates, Variance, Degree Measures, and out-of-Equilibrium Data. Sociol Methodol. 2009 Aug 1;39(1):73–116. pmid:20161130. Pubmed Central PMCID: 2743108.
- 27. Abdul-Quader AS, Baughman AL, Hladik W. Estimating the size of key populations: current status and future possibilities. Current opinion in HIV and AIDS. 2014 Mar;9(2):107–14. pmid:24393694.
- 28. Gyarmathy VA, Johnston LG, Caplinskiene I, Caplinskas S, Latkin CA. A simulative comparison of respondent driven sampling with incentivized snowball sampling—the "strudel effect". Drug and alcohol dependence. 2014 Feb 1;135:71–7. pmid:24360650. Pubmed Central PMCID: 3941002.
- 29. White RG, Hakim AJ, Salganik MJ, Spiller MW, Johnston LG, Kerr LRFS, et al. Strengthening the Reporting of Observational Studies in Epidemiology for Respondent-Driven Sampling Studies: ‘STROBE-RDS’ Statement. Journal of Clinical Epidemiology. 2015 (0).