Figures
Abstract
As malaria is being pushed back on many frontiers and global case numbers are declining, accurate measurement and prediction of transmission becomes increasingly difficult. Low transmission settings are characterised by high levels of spatial heterogeneity, which stands in stark contrast to the widely used assumption of spatially homogeneous transmission used in mathematical transmission models for malaria. In the present study an individual-based mathematical malaria transmission model that incorporates multiple parasite clones, variable human exposure and duration of infection, limited mosquito flight distance and most importantly geographically heterogeneous human and mosquito population densities was used to illustrate the differences between homogeneous and heterogeneous transmission assumptions when aiming to predict surrogate indicators of transmission intensity such as population parasite prevalence or multiplicity of infection (MOI). In traditionally highly malaria endemic regions where most of the population harbours malaria parasites, humans are often infected with multiple parasite clones. However, studies have shown also in areas with low overall parasite prevalence, infection with multiple parasite clones is a common occurrence. Mathematical models assuming homogeneous transmission between humans and mosquitoes cannot explain these observations. Heterogeneity of transmission can arise from many factors including acquired immunity, body size and occupational exposure. In this study, we show that spatial heterogeneity has a profound effect on predictions of MOI and parasite prevalence. We illustrate, that models assuming homogeneous transmission underestimate average MOI in low transmission settings when compared to field data and that spatially heterogeneous models predict stable transmission at much lower overall parasite prevalence. Therefore it is very important that models used to guide malaria surveillance and control strategies in low transmission and elimination settings take into account the spatial features of the specific target area, including human and mosquito vector distribution.
Citation: Karl S, White MT, Milne GJ, Gurarie D, Hay SI, Barry AE, et al. (2016) Spatial Effects on the Multiplicity of Plasmodium falciparum Infections. PLoS ONE 11(10): e0164054. https://doi.org/10.1371/journal.pone.0164054
Editor: Claudio Romero Farias Marinho, Universidade de Sao Paulo Instituto de Ciencias Biomedicas, BRAZIL
Received: July 5, 2016; Accepted: September 19, 2016; Published: October 6, 2016
Copyright: © 2016 Karl et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: SK, AB and IM acknowledge support from the Victorian State Government Operational Infrastructure Support and Australian Government NHMRC IRIISS. SK was supported by an NHMRC (Australia) Early Career Fellowship (GNT 1052760). MTW was supported by an MRC (UK) Research Fellowship. The authors thank all researchers and study participants involved in the PNG studies. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Declining malaria transmission is associated with the formation of ‘hotspots’, which are geographical regions of limited extent, where infections cluster and transmission may remain persistent. [1] Such hotspots may not be easily identifiable by routine surveillance as much of the transmission within a hotspot is likely to occur between asymptomatic individuals. [2]
The primary reason for the occurrence of transmission hotspots is that malaria transmission is not homogeneous and humans can be exposed to substantially different levels of mosquito biting on the micro-scale (i.e., on a scale of a few meters, between neighbouring households or even within the same household). Most likely both vector population related factors such as productivity of breeding sites and distance of human dwellings from these sites as well as human related factors crucially affect micro-scale variation in transmission intensity and human exposure. [3] Although Anopheles mosquitoes are known to be able to fly considerable distances (several km) [4, 5], they will prefer available hosts close to their breeding sites. [6, 7] A wide variety of human factors such as body size, bed net usage, time spent outdoors, quality of housing and even beer-consumption has previously been shown to affect human susceptibility to mosquito bites. [8–11]
Another important factor contributing to the heterogeneity of transmission is the very variable and difficult-to-quantify duration of infection in humans. [12] Some aspects influencing duration of infection, such as acquired immunity and super-infection with new clones are directly related to exposure, others, such as treatment-seeking behaviour are less dependent on exposure. [13, 14] For example, people living a considerable distance from a health centre will seek malaria treatment less frequently leading to longer average durations of infection. [15] From the interplay of these different aspects complex patterns may arise: for example, infants, who still carry maternal antibodies (e.g., < 6 months of age) and very small children who stay mostly indoors and are closely monitored by their parents (e.g., < 2–3 yrs. of age) are often shown to harbour infections less frequently. [16] If they do get infected, they will receive treatment more often, especially since they will develop symptomatic infections more frequently leading to comparatively short durations of infection and thus a smaller overall contribution to onward transmission. [17–19] In contrast, older children and young adults (e.g., 5–15 yrs. of age) who spend more time outdoors are usually found to carry infections more frequently. However, due to a higher degree of immunity these infections are more often asymptomatic. [18, 20, 21]
Incorporation of heterogeneity in transmission represents a challenge for mathematical transmission models of vector borne diseases. Previous mathematical modelling studies have shown that heterogeneity of exposure, for example, based on the ‘80/20-rule’ (i.e., a scenario where 20% of the human population receives 80% of mosquito bites) may contribute considerably to sustaining transmission by leading to increased estimates of the basic reproduction number, R0. [3] However, few studies have modelled the spatial aspects, specifically the geographical distribution of humans and mosquitoes on the micro-scale (i.e., with a spatial resolution of a few meters), an important factor underlying this heterogeneity in transmission intensity. [22–26]
Infections with multiple parasite clones are common in high transmission settings and it has been hypothesized that the observed multiplicity of infection (number of clones per person, MOI) may be a good indicator of the level of transmission in a population. MOI is calculated by counting the number of genetically distinct clones detected in infected individuals. MOI must therefore take values of ≥1. Many studies report ‘mean MOI’, although it is unlikely that MOI follows a simple Poisson distribution in a population where transmission is heterogeneous. [3] Heterogeneity also impacts the relationship between MOI and parasite prevalence (another surrogate measure of transmission). Individuals residing within local transmission hotspots may be subject to much higher rates of infectious bites, therefore maintaining higher MOI levels even at very low (i.e., < 1%) overall parasite prevalence in the larger population. [27] Previous studies have shown that at low parasite prevalence average MOI is often higher than what can be explained by the random mixing of parasite clones, humans and mosquitoes in homogeneous transmission models (for a list of relevant studies describing MOI based on merozoite surface protein 2 (msp2) genotyping, see supporting information S1 Table). [28]
Using a spatial mathematical transmission model that allows for the transmission of multiple parasite clones, we therefore investigated whether spatially heterogeneous human and mosquito populations better explain the observed mean MOI vs. mean parasite prevalence relationship. [3, 7, 16, 23, 29] Based on the underlying spatial distributions of human and mosquito populations, limited mixing between these populations will arise from i) the constrained radius of mosquito flight and ii) the distance dependent movement of human individuals. [29, 30] Coupled with other factors (some mentioned above) that determine human exposure, this will inherently result in a small proportion of the population receiving most mosquito bites. As opposed to imposing an ‘80/20-rule’, these spatial features may better capture heterogeneous transmission and result in more versatile and realistic models.
Most currently used mathematical models for malaria and other vector borne infectious diseases do not explicitly consider spatial features of transmission but assume a homogeneous mixture of human individuals and mosquitoes. [23, 31–37] This may be appropriate for many aspects of transmission especially for scenarios of high transmission. However, in the modelling of very low transmission scenarios where the mosquito distribution is more heterogeneous, the actual spatial distribution of human and mosquito populations may need to be taken into account in order to provide reliable estimates. Such low transmission scenarios will be dominant in the future if malaria incidence continues to decline as expected.
The model presented here was calibrated using the spatial village structure, human age distribution and household composition (number of inhabitants and family structure) as present on the North Coast of Papua New Guinea (PNG) to ensure realistic simulations. [38] Our recent studies in this area also provided detailed data on the number circulating msp2 alleles, overall malaria prevalence and MOI. [18, 27, 39–41]
Materials and Methods
We used an individual based, spatially explicit model with individual humans and mosquitoes. [42] The human population in the model (n = 3461) was based on the age distribution and household structure of rural Madang Province, PNG. [38] We used a set of geo-referenced households (n = 663) in an area of approximately 35 km2 (Fig 1).
Panel A: Geographical distribution of households (black dots = households); Panel B: Age dependent exposure [9] and duration of infection [12, 43]; Panel C: Rural population age distribution in Madang Province, PNG based on the current census data. [38]
Anopheles farauti s.l. is the main vector in coastal Madang. [44] It has been shown that A. farauti generally fly less than 50 m after blood feeding and have a memorized home range, whereas the other, less abundant species in the area (e.g., A. punctulatus and A. koliensis) may disperse further. [45, 46]. Another circumstance that will limit mosquito dispersal in coastal PNG is the relative absence of non-human hosts as there are only few domestic animals (pigs, few cattle). These animals are usually kept next to, or under the houses at night in PNG. [46, 47] As in previous modelling approaches, we assumed that mosquitoes are confined to the households of a specific geographical area and predominantly feed on humans residing in households within this area. [48] Within household exposure and duration of infection are dependent on human age (Fig 1). [9] It is also possible for mosquitoes to bite humans outside their area, however this probability decreases with the square of the distance between individual human and mosquito locations (households).
The probability that a specific mosquito (Mj) bites a specific human (Hi) is:
(1)
In Eq (1), d is distance between a human and a mosquito (if human and mosquito are within the same household then d = 0), ea is a weight of human exposure related to age (a) based on [9] with a value ≤ 1, w is the biting rate and q is the scaling factor that determines the extent of human/mosquito mixing. Note that q does not represent the maximum distance that mosquitoes are physically able to fly but is related to the range of host seeking in the presence of an ample host reservoir in close proximity of the mosquito’s present location. We assume that for transmission from human to mosquito, clones are transmitted independently from each other with the same probability of transmission per bite a. [49] For transmission from mosquito to human it is assumed that all clones present in the salivary glands of the mosquito are transmitted simultaneously with a success rate b.
Multi-clone infections are acquired either by humans being bitten by one mosquito infected with multiple clones or infected humans being bitten again (on the same day, or a subsequent day), by different infected mosquitoes. If a human is superinfected with the same clone, duration of infection can be extended (a new independent infection process for the same clone is started parallel to the existing one). If a human is infected with multiple strains, these are cleared independently. Similarly, in theory, mosquitoes can bite other infected humans and acquire more infections however, due to the limited mosquito life-span, this occurs very infrequently.
On each simulation day, travellers can acquire single or multi-clone infections similar to humans that are present in the modelling area. The force of infection acting on travellers is assumed to be constant and independent of that within the modelling area. This causes infections to be occasionally introduced to the modelling area, and overall strain distribution to be maintained. The clone distribution used in the present study is shown in Fig 2.
This distribution resembles that in lowland coastal PNG based on msp2 genotyping data collected in a recent cohort study in the same region of PNG (data unpublished).
Humans remain infected for a duration that is dependent on age, based on previous field observations and modelling [12, 14, 43] and are assumed to remain infectious for the entire duration of infection. Mosquitoes undergo an extrinsic incubation period of the average duration 1/n (12 days) and live on average 1/μ of 10 days. [50]
The model is implemented as a simulation in which individual humans and mosquitoes are objects with properties such as geographic location and infection status (susceptible-S, infected-E, infective,-I). Transmission and progression between the infection states are stochastic processes, with fixed probabilities (as given in Table 1), and follow the standard approach (Fig 3). Mosquitoes are assumed to bite with a frequency w, meaning that at each day (simulation time-step), a proportion ~w of the mosquito population is randomly chosen (i.e., assuming an exponential distribution of biting frequency per mosquito) and assigned to bite humans (multiple bites per human are possible). The choices of the human/mosquito pairs are based on distance between humans and mosquitoes and on human exposure characteristics as specified by Eq (1) and shown in Fig 1. Only the adult, female mosquito population is modelled and ‘dead’ mosquitoes are replaced by new mosquitoes resulting in a constant mosquito population, equivalent to widely used approaches. [51]
Humans are either susceptible (S) or infected/infectious (I). Correspondingly, mosquitoes are either susceptible (S), within the extrinsic incubation period (E) or within the infectious period (I). Superscripts H and M refer to humans and mosquitoes, respectively. nM an nH refer to the total number of mosquitoes and humans, respectively. As in most previous models of malaria transmission, all durations of residence in these states are assumed to be exponentially distributed (constant transition probabilities). The indices i and j indicate that we use an individual based approach in which each human and each mosquito is represented as an individual object. P(SHj/IMi) and P(IHj/ SMi) denote the distance weighted probability (Eq 1) that a human (j) is bitten by a specific mosquito (i), whereas a and b are the probabilities of transmission given a potentially infectious bite.
To represent the integration of the modelling area into a wider geographical region with a similar parasite clone distribution, we allow for infections to be introduced into the modelling area by human migration/travel. We assume, that on average a 10% fraction of the adult population (>14 years) is currently travelling, resulting in a constant population within the modelling area. Average travelling time per person is 14 days. Humans outside the modelling area can be infected with a probability dependent on transmission within the modelling area, and the infecting clone(s) will be chosen based on the overall clone distribution in the modelling area at the start of the simulation. (Fig 2). If transmission within the modelling area is high, introductions through migration occur more frequently but decrease linearly with decreasing transmission. More complex models describing human movement and migration have previously been developed yet their implementation is only reasonable if local human migration and movement data for the modelling area is available, which was not the case for PNG. [23, 52, 53] All model parameters are shown in Table 1.
Different Transmission Environments
Following observations from the field, we assumed that in high transmission settings, mosquito density is more evenly distributed across households as compared to low transmission settings (this is further underpinned by the data analysis presented in Supporting Information S1 Text). In low transmission settings, mosquitoes were assumed to be clustered around specific breeding sites so that a smaller proportion of households sustained most of the mosquito population. In the present study 3 such mosquito population clusters were purposely generated to represent hotspots. These are represented by the circles in Fig 4A. We assumed that stable mosquito numbers exist in these clusters (e.g., related to stable bodies of water), and that mosquito numbers are decreasing with the square of the distance away from the centre of each of these hotspots (Fig 4A).
For the illustrative purposes of this work, we assumed 3 regions in the modelling area where mosquito density was higher than in the surrounding areas (indicated by circles in Fig 4A). The colour scale indicates the number of mosquitoes per household assumed for households located in the respective areas. Panel B shows the resulting overall proportion of mosquitoes found in the overall proportion of households. As observed in field studies, especially in low transmission settings, often a small proportion of households harbour most of the mosquitoes. A general experimental observation is that mosquito numbers become more evenly distributed as mosquito numbers increase (Supporting Information S1 Text). [57, 58] The numbers on the curves in 4B indicate the mosquito-to-human ratios resulting in the respective curves.
As transmission intensity increases, the areas away from these ‘hotspots’ are gradually and homogeneously populated with mosquitoes (e.g., by the formation of temporal, shallow water bodies during the rainy season) whereas within the hotspot area, mosquito numbers remain stable but not lower than the mosquito density of the surrounding landscape a characteristic e.g., observed by Ribeiro et al. in Ethiopia. [57] A Supporting Video File (S1 Video) was generated to illustrate this assumption graphically. Fig 4B shows the resulting proportion of mosquitoes vs proportion of households for various mosquito-to-human ratios. This resembles observations from the field (e.g., from Kenya and Ethiopia, for further analyses see Supporting Information S1 Text). [57–60]
The spatial model including heterogeneous biting based on geography, mosquito flight and age-dependent exposure was compared to two other models. Firstly, a ‘null model’, where exposure was homogeneous and parasite clones were Poisson distributed across the human population at a given prevalence, and secondly, a model with no spatial features but taking into account age-dependent within-human differences in exposure and duration of infection (shown in Fig 1B and 1C). The model was run for different mosquito-to-human ratios as shown in Fig 4A to achieve different parasite prevalence. Prevalence was then plotted against MOI. The resulting prevalence vs MOI pattern was compared to data compiled from a literature survey on msp2 based observations of MOI (S1 Table). Spatial estimates for average frequency of infected bites per person per unit time (entomological inoculation rate, EIR) where derived by running the model at an equilibrium state for 30 years, mapping the average number of infectious bites per person per year and applying an inverse distance weighted interpolation algorithm to derive EIR isolines using the QGis 2.0 software.
Model Limitations
Similarly to previous modelling studies, transmission of individual clones was regarded to be mutually independent and the present model does not account for genetic recombination in the mosquito vector. [61] Therefore, clones are not changed by passage through the mosquito. This simplistic assumption is sensible for a scenario where estimates of MOI are based on genotyping of a single marker gene such as pfmsp2, where new alleles will only arise through relatively rare events such as point mutations, crossing overs and /or replication errors changing the number of sequence repeats. [62] Similarly, the model does not account for clone specific acquisition of immunity in the human population. [43, 63] However, the aim of this study was to show the general effects of spatial heterogeneity on MOI and therefore these features were not considered essential.
As with previous vector borne disease models, the present model assumes a fixed spatial distribution of humans and mosquitoes in which humans and mosquitoes are predominantly associated with specific locations. [33, 48] Mixing due to human movement and mosquito flight are partially captured by the distance weighted biting given by Eq 1. [64] As with most other malaria transmission models, we do not explicitly model the mosquito life cycle (apart from the female adult stage). While epidemiological models aiming to describe vector control (e.g., [23, 65–67]) should include mosquito population dynamics, this was not within the scope of the present study.
The model is subject to the usual limitations of the widely used compartmental model systems including exponentially distributed transitions and fixed infectivity (gametocytes are not explicitly included in the model). [68, 69] Only P. falciparum transmission is considered. For P. vivax, additional considerations regarding the presence of a hypnozoite reservoir in the human population will need to be taken into account. [70] We do not explicitly account for treatment or other malaria control measures such as bed nets. Furthermore, we do not consider imperfect detectability of clones in multiple-clone infections, which is the main cause for the age vs. MOI relationship shown by several studies [43]. However we show that the present model can be expanded to realistically reproduce this relationship when incorporating additional data on age dependent detectability. (S1 Text)
In agent-based simulations, the number of modelled parasite clones, humans and mosquitoes is constrained by computational limitations and therefore a relatively confined modelling area and population size were chosen. [71]
Results
Spatial EIR estimates
The clustering of mosquitoes around persistent breeding sites leads to very variable EIR estimates across the landscape in low transmission settings. This is illustrated in Fig 5 showing estimated EIR isolines for low, medium and high transmission settings [3%,25% and 70% parasite prevalence in the overall population, respectively, based on the mosquito density distribution illustrated in Fig 4 (and S1 Video)]. Fig 5A, representing the low transmission scenario, shows clearly defined hotspots. As the mosquito-to-human ratio is increased and the overall mosquito distribution becomes more homogeneous, EIR estimates also become more evenly distributed. (Fig 5B and 5C).
At low transmission (3%) transmission is highly clustered based on mosquito and household density. The heterogeneity in EIR decreases as transmission increases (25% and 70%) and the hotspots lose their clear-cut edges. The isolines were derived from infection event counts when running the model for 30 years at the respective prevalence. It can be seen especially in Panel A, that the northernmost mosquito cluster does not result in sustained transmission due to lower mosquito numbers in this cluster as explained in the text.
Fig 5 shows that, with the spatial model, even at very low average prevalence in the entire population, individuals in a confined area determined by the mosquito clusters may still be exposed to >100 infectious bites per year, whereas in most of the remaining area the probability to receive an infectious bite is near zero. The individuals within the hotspot are therefore likely to maintain higher infection prevalence and MOI levels and the MOI population average is likely to be considerably above the lower limit value of 1. Importantly, this will also facilitate the generation of genetic diversity until transmission within the hotspot itself is targeted.
Especially Panel 5A shows, that the northernmost mosquito cluster (shown in Fig 4A) does not result in sustained transmission given the same assumptions about mosquito numbers and flight as in the other clusters. The reason for this is that the centre of the cluster (with the highest mosquito density) is around a relatively isolated household (only 1 other household is within 50 m, and 5 within 100 m). Since we assume decreasing mosquito numbers away from the cluster centre, this mosquito cluster contains overall fewer mosquitoes. The other mosquito clusters contain 15 and 11 households, respectively, within a 100 m radius from the centre leading to much higher mosquito numbers and a much higher rate of exchange of infections between households.
Average MOI with Changing Parasite Prevalence
Average MOI of the overall population in the spatially explicit simulations remained considerably above the lower limit of 1 for very low malaria prevalences (~ 1%). It should be noted that below a prevalence of around 1% (or ~35 infected individuals in the modelling area) the parasite population was not sustained, owing to the limited number of human individuals in the model. However, even if the modelling area would be much larger (e.g., containing many 10K or 100K people) it is really the size of the hotspot and the transmission intensity within the hotspot (e.g., Fig 5A) that determines prevalence. In other words, if the modelling area would be expanded but no new hotspots would be added, much lower overall prevalence would be possible, and MOI would asymptotically approach the limit value of 1. Fig 6 shows the MOI versus overall prevalence data compiled from the literature survey (S1 Table) in combination with the predictions from the spatially explicit model, the non-spatial model incorporating within-human differences and the homogeneous null model. Both, the null-model (homogeneous mixing) and also the model where only human attributes are heterogeneous but no spatial features are included, do not support field observations of MOI substantially >1 at low levels of overall parasite prevalence (e.g., at prevalence levels below 10% the null model and the non-spatial model both predict MOI levels of ~1).
Panel A shows the spatial model prediction (red, with 95% CI band), the null-model prediction (black), the model with no spatial features but age based exposure and infection duration (blue, dashed) and the field data (dots). Spatial model predictions were smoothened by appying a lowess algorithm. Panel B shows the data gathered in the literature review grouped into 10% prevalence ranges using box and whisker plots (boxes are median/interquartile ranges, whiskers are ranges).
MOI Estimates for Populations Inside and Outside of Hotspots
Fig 7 shows an example of predicted MOI distribution for the population living inside and outside the hotspots generated in the present model with an average mosquito-to-human ratio of 0.1, 1 and 1.5 (corresponding to the same scenarios as in Fig 5 with 3%, 25% and 70% prevalence in the spatial model). For the low transmission scenario (3% prevalence), there are stark differences in prevalence outside and inside the hotspots (0.4% outside, 13% inside and mean MOI: 1 outside and 2.1 inside). The differences decrease in the higher transmission scenarios, yet MOI is always higher in the population residing within the hotspots (2.7 vs. 1.4 for the 25% scenario and 3.6 vs. 1.9 for the 70% scenario).
Changing Average Prevalence with Mosquito-to-Human Ratio
Mosquito-to-human ratio is usually used to adjust the ‘transmission level’ in compartmental models. The spatial model and the null model exhibit different characteristics with regard to the relationship between mosquito-to-human ratio and the resulting equilibrium parasite prevalence as shown in Fig 8. Whereas in the non-spatial, homogeneous human population model, predicted prevalence increases within a narrow range from 0% to ~100%, the spatial model shows a slower increase but prevalence > 0% is sustained by lower mosquito-to-human ratios than in the null model. The reasons for this are i) the assumption that mosquitoes are clustered around specific households and ii) the resulting limited spatial mixing of mosquitoes and human populations.
While spatial transmission features lead to higher predicted prevalence in overall low transmission settings, these features result in a lower rise in predicted prevalence with increasing mosquito-to-human ratio (as transmission is still locally confined even at higher mosquito-to-human ratios).
Discussion
The present modelling study using a spatially explicit environment with realistic geographic household distribution underlines the importance of considering spatial heterogeneity when modelling malaria transmission, especially in low transmission settings. [71] We show that the relationship between MOI and parasite prevalence is not well captured by models with homogeneous transmission as field studies have shown that even in low transmission settings, MOI levels above the limiting value of 1 are a common occurrence. [27]
From a modelling perspective, the existence of ‘hotspots’ where stable transmission occurs only within a small, and geographically focused proportion of the population can explain these observations. Within the hotspot, transmission (e.g., as measured by local or household-based EIR) can be much higher than in the surrounding areas, causing a small proportion of the population to exhibit higher MOI levels. Fig 6A shows that MOI is a nonlinear function of prevalence and especially at low transmission intensities (e.g., as indicated by overall parasite prevalence of <10%), MOI changes very little with changing overall prevalence. This implies that average MOI is unlikely to be a very sensitive measure of the overall transmission intensity in low transmission settings and that local EIR variation will need to be taken into consideration when deducing transmission intensity based on MOI. Genotyping however, may also represent an opportunity to ‘triangulate’ hotspot locations and guide focalised malaria control in very low transmission settings.
It should be noted that spatial heterogeneity is not the only type of heterogeneity that determines human exposure and infection, and thus MOI distribution in a population. Several other important factors such as age-related exposure and occupational exposure, and the related degree of acquired (clone-specific) immunity will also influence the MOI distribution in a population.
It is very likely, that Anopheles flight and host seeking behaviour significantly influences the extent and focus of transmission hotspots. Different species of Anopheles mosquitoes exhibit very different behaviour. Although it has been shown that Anopheles mosquitoes are able to fly, or be carried by wind, for >10 km, recapture rates are often very low (<1%) making it difficult to estimate the distance naturally flown by an individual mosquito, especially when an ample host reservoir is present. [72, 73] We assume that the majority of mosquitoes stay in close proximity to suitable hosts and rarely fly long distance since Anopheles farauti s.l., which is the main vector in coastal lowlands on the North Coast of PNG has been shown to exhibit this behaviour. [74–77]
All models discussed here (the spatial model, the non-spatial model incorporating inter-human heterogeneity and the homogeneous null-model) exhibit a very steep increase in MOI at prevalence rates > 80%, whereas the data collected in the literature review as part of the present study, suggests a more moderate increase. It should be noted, that all available molecular techniques to determine MOI will underestimate true MOI due to the non-detection of minority clones. Therefore, due to the fact that the present model does not account for detectability (e.g., the probability to detect a clone based on different parasite density of clones in the blood of an individual), MOI is likely to be overestimated by the models [78]. At high transmission, an increasing proportion of people are infected with minority clones for which the probability of detection is lower. [41] Therefore, it is expected that detectability reduces observed MOI at high transmission levels much more than at low transmission levels. However, data on within-host clone distribution and related detectability are very sparse. In addition, it is likely that clone specific acquired immunity and the related clone specific clinical incidence shapes regional clone abundance profiles. Studies that relate parasite genotypes with clinical incidence are required to calibrate more complex multi-clone models which include clinical incidence and treatment. [79]
Challenges for the development of models such as the one presented here, are the requirements for much more detailed parasitological (clone specific growth, clinical incidence rates), entomological (mosquito dispersion and host seeking) and human behavioural (movement and migration) data, efficient programming and supercomputer facilities to minimize run time.
However, the current model, although subject to substantial limitations, illustrates clearly that individual-based, spatial approaches are required to capture important features of micro-scale malaria transmission, especially in low transmission settings. As these types of settings will become more and more common as malaria infection rates decline, it will be very beneficial to incorporate spatial approaches into prediction frameworks aimed at informing malaria control in low transmission and pre-elimination settings.
Supporting Information
S1 Table. Results from Literature Review on msp2 MOI vs. Malaria Prevalence.
The search query ‘falciparum multiplicity infection prevalence msp2’ resulted in 33 hits. Data for all ages was used.
https://doi.org/10.1371/journal.pone.0164054.s001
(XLSX)
S1 Text. Further Information Regarding the Relationship of MOI vs. Age and Heterogeneity of Mosquito Population in Low vs. High Transmission Settings.
https://doi.org/10.1371/journal.pone.0164054.s002
(DOC)
S1 Video. Graphical Illustration of our Assumptions Regarding the Expansion of the Mosquito Population.
The video shows a gradual increase of mosquito numbers based on our assumptions. At low transmission (low mosquito numbers), mosquitoes are clustered around specific sites inside the modelling area. As transmission increases, the mosquito populations in these sites expand. Further increase of mosquito numbers is assumed to occur homogeneously across the entire modelling area.
https://doi.org/10.1371/journal.pone.0164054.s003
(MP4)
Acknowledgments
SK, AB and IM acknowledge support from the Victorian State Government Operational Infrastructure Support and Australian Government NHMRC IRIISS. SK was supported by an NHMRC (Australia) Early Career Fellowship (GNT 1052760). MTW was supported by an MRC (UK) Research Fellowship. The authors thank all researchers and study participants involved in the PNG studies.
Author Contributions
- Conceptualization: SK MTW SIH IF AB IM.
- Data curation: SK IF AB MTW.
- Formal analysis: SK MTW.
- Funding acquisition: SK MTW IM AB IF.
- Investigation: SK MTW.
- Methodology: SK MTW GJM DG.
- Project administration: SK MTW IF AB IM.
- Resources: SK IM AB IF.
- Software: SK GJM DG.
- Supervision: SK MTW SIH IF AB IM.
- Validation: SK MTW DG IM.
- Visualization: SK MTW.
- Writing – original draft: SK MTW IF SIH AB IM.
- Writing – review & editing: SK MTW DG GJM SIH IF AB IM.
References
- 1. Bousema T, Drakeley C, Gesase S, Hashim R, Magesa S, Mosha F, et al. Identification of hot spots of malaria transmission for targeted malaria control. The Journal of infectious diseases. 2010;201(11):1764–74. pmid:20415536.
- 2. Bejon P, Williams TN, Liljander A, Noor AM, Wambua J, Ogada E, et al. Stable and unstable malaria hotspots in longitudinal cohort studies in Kenya. PLoS medicine. 2010;7(7):e1000304. pmid:20625549; PubMed Central PMCID: PMC2897769.
- 3. Bousema T, Griffin JT, Sauerwein RW, Smith DL, Churcher TS, Takken W, et al. Hitting hotspots: spatial targeting of malaria for control and elimination. PLoS medicine. 2012;9(1):e1001165. pmid:22303287; PubMed Central PMCID: PMC3269430.
- 4. Kaufmann C, Briegel H. Flight performance of the malaria vectors Anopheles gambiae and Anopheles atroparvus. Journal of vector ecology: Journal of the Society for Vector Ecology. 2004;29(1):140–53. pmid:15266751.
- 5. Guerra CA, Reiner RC Jr., Perkins TA, Lindsay SW, Midega JT, Brady OJ, et al. A global assembly of adult female mosquito mark-release-recapture data to inform the control of mosquito-borne pathogens. Parasites & vectors. 2014;7(1):276. pmid:24946878; PubMed Central PMCID: PMC4067626.
- 6. Reddy MR, Overgaard HJ, Abaga S, Reddy VP, Caccone A, Kiszewski AE, et al. Outdoor host seeking behaviour of Anopheles gambiae mosquitoes following initiation of malaria vector control on Bioko Island, Equatorial Guinea. Malaria journal. 2011;10:184. pmid:21736750; PubMed Central PMCID: PMC3146901.
- 7. Staedke SG, Nottingham EW, Cox J, Kamya MR, Rosenthal PJ, Dorsey G. Short report: proximity to mosquito breeding sites as a risk factor for clinical malaria episodes in an urban cohort of Ugandan children. The American journal of tropical medicine and hygiene. 2003;69(3):244–6. pmid:14628938.
- 8. Reuben R. Women and malaria—special risks and appropriate control strategy. Social science & medicine (1982). 1993;37(4):473–80. pmid:8211259.
- 9. Muirhead-Thomson . The distribution of Anopheline mosquito bites among different age groups: a new factor in malaria epidemiology. British Medical Journal. 1951;1(1114). pmid:14830852
- 10. Takken W, Klowden MJ, Chambers GM. Effect of body size on host seeking and blood meal utilization in Anopheles gambiae sensu stricto (Diptera: Culicidae): the disadvantage of being small. Journal of medical entomology. 1998;35(5):639–45. pmid:9775585.
- 11. Lefevre T, Gouagna LC, Dabire KR, Elguero E, Fontenille D, Renaud F, et al. Beer consumption increases human attractiveness to malaria mosquitoes. PloS one. 2010;5(3):e9546. pmid:20209056; PubMed Central PMCID: PMC2832015.
- 12. Bretscher MT, Maire N, Chitnis N, Felger I, Owusu-Agyei S, Smith T. The distribution of Plasmodium falciparum infection durations. Epidemics. 2011;3(2):109–18. pmid:21624782.
- 13. Parthasarathy PR. The effect of superinfection on the distribution of the infectious period—a continued fraction approximation. IMA journal of mathematics applied in medicine and biology. 1997;14(2):113–23. pmid:9216069.
- 14. Bruce MC, Donnelly CA, Packer M, Lagog M, Gibson N, Narara A, et al. Age- and species-specific duration of infection in asymptomatic malaria infections in Papua New Guinea. Parasitology. 2000;121 (Pt 3):247–56. pmid:11085245.
- 15. Muller I, Smith T, Mellor S, Rare L, Genton B. The effect of distance from home on attendance at a small rural health centre in Papua New Guinea. International journal of epidemiology. 1998;27(5):878–84. pmid:9839747.
- 16. Cattani JA, Tulloch JL, Vrbova H, Jolley D, Gibson FD, Moir JS, et al. The epidemiology of malaria in a population surrounding Madang, Papua New Guinea. The American journal of tropical medicine and hygiene. 1986;35(1):3–15. pmid:3511748.
- 17.
Wernsdorfer WH, McGregor I. Malaria: principles and practice of malariology. Edinburgh; New York: Churchill Livingstone; 1988. 2 v. (xv, 1818 p.) p.
- 18. Lin E, Kiniboro B, Gray L, Dobbie S, Robinson L, Laumaea A, et al. Differential patterns of infection and disease with P. falciparum and P. vivax in young Papua New Guinean children. PloS one. 2010;5(2):e9047. pmid:20140220; PubMed Central PMCID: PMC2816213.
- 19. Aguas R, White LJ, Snow RW, Gomes MG. Prospects for malaria eradication in sub-Saharan Africa. PloS one. 2008;3(3):e1767. Epub 2008/03/13. pmid:18335042; PubMed Central PMCID: PMC2262141.
- 20. Koram KA, Owusu-Agyei S, Fryauff DJ, Anto F, Atuguba F, Hodgson A, et al. Seasonal profiles of malaria infection, anaemia, and bednet use among age groups and communities in northern Ghana. Trop Med Int Health. 2003;8(9):793–802. pmid:12950665.
- 21. Michon P, Cole-Tobian JL, Dabod E, Schoepflin S, Igu J, Susapu M, et al. The risk of malarial infections and disease in Papua New Guinean children. The American journal of tropical medicine and hygiene. 2007;76(6):997–1008. pmid:17556601; PubMed Central PMCID: PMC3740942.
- 22. Bomblies A. Agent-based modeling of malaria vectors: the importance of spatial simulation. Parasites & Vectors. 2014;7:308. pmid:24992942; PubMed Central PMCID: PMC4088367.
- 23. Karl S, Halder N, Kelso JK, Ritchie SA, Milne GJ. A spatial simulation model for dengue virus infection in urban areas. BMC infectious diseases. 2014;14:447. Epub 2014/08/21. pmid:25139524; PubMed Central PMCID: PMC4152583.
- 24. Milne GJ, Baskaran P, Halder N, Karl S, Kelso J. Pandemic influenza in Papua New Guinea: a modelling study comparison with pandemic spread in a developed country. BMJ open. 2013;3(3). Epub 2013/03/29. pmid:23535701; PubMed Central PMCID: PMC3612822.
- 25. Carter R, Mendis KN, Roberts D. Spatial targeting of interventions against malaria. Bulletin of the World Health Organization. 2000;78(12):1401–11. pmid:11196487; PubMed Central PMCID: PMC2560653.
- 26. Perkins TA, Scott TW, Le Menach A, Smith DL. Heterogeneity, mixing, and the spatial scales of mosquito-borne pathogen transmission. PLoS Comput Biol. 2013;9(12):e1003327. pmid:24348223; PubMed Central PMCID: PMC3861021.
- 27. Barry AE, Schultz L, Senn N, Nale J, Kiniboro B, Siba PM, et al. High levels of genetic diversity of Plasmodium falciparum populations in Papua New Guinea despite variable infection prevalence. The American journal of tropical medicine and hygiene. 2013;88(4):718–25. pmid:23400571; PubMed Central PMCID: PMC3617858.
- 28. Ross A, Koepfli C, Li X, Schoepflin S, Siba P, Mueller I, et al. Estimating the numbers of malaria infections in blood samples using high-resolution genotyping data. PloS one. 2012;7(8):e42496. pmid:22952595; PubMed Central PMCID: PMC3430681.
- 29. Stoddard ST, Forshey BM, Morrison AC, Paz-Soldan VA, Vazquez-Prokopec GM, Astete H, et al. House-to-house human movement drives dengue virus transmission. Proceedings of the National Academy of Sciences of the United States of America. 2013;110(3):994–9. Epub 2013/01/02. pmid:23277539; PubMed Central PMCID: PMC3549073.
- 30. Liebman KA, Stoddard ST, Morrison AC, Rocha C, Minnick S, Sihuincha M, et al. Spatial dimensions of dengue virus transmission across interepidemic and epidemic periods in Iquitos, Peru (1999–2003). PLoS neglected tropical diseases. 2012;6(2):e1472. Epub 2012/03/01. pmid:22363822; PubMed Central PMCID: PMC3283551.
- 31.
Anderson RM, May R. Infectious diseases of humans. Oxford: Oxford University Press; 1991. 768 p.
- 32. Andraud M, Hens N, Marais C, Beutels P. Dynamic epidemiological models for dengue transmission: a systematic review of structural approaches. PloS one. 2012;7(11):e49085. Epub 2012/11/10. pmid:23139836; PubMed Central PMCID: PMC3490912.
- 33. Chao DL, Halstead SB, Halloran ME, Longini IM Jr. Controlling dengue with vaccines in Thailand. PLoS neglected tropical diseases. 2012;6(10):e1876. Epub 2012/11/13. pmid:23145197; PubMed Central PMCID: PMC3493390.
- 34. Focks DA, Haile DG, Daniels E, Mount GA. Dynamic life table model for Aedes aegypti (diptera: Culicidae): simulation results and validation. Journal of medical entomology. 1993;30(6):1018–28. Epub 1993/11/01. pmid:8271243.
- 35. Griffin JT, Hollingsworth TD, Okell LC, Churcher TS, White M, Hinsley W, et al. Reducing Plasmodium falciparum malaria transmission in Africa: a model-based evaluation of intervention strategies. PLoS medicine. 2010;7(8). Epub 2010/08/17. pmid:20711482; PubMed Central PMCID: PMC2919425.
- 36. Karl S, Gurarie D, Zimmerman PA, King CH, St Pierre TG, Davis TM. A sub-microscopic gametocyte reservoir can sustain malaria transmission. PloS one. 2011;6(6):e20805. pmid:21695129.
- 37. Maude RJ, Saralamba S, Lewis A, Sherwood D, White NJ, Day NP, et al. Modelling malaria elimination on the internet. Malaria journal. 2011;10:191. pmid:21756319; PubMed Central PMCID: PMC3160427.
- 38.
National Statistical Office of Papua New Guinea. Preliminary Figures Papua New Guinea Census 2011. 2013, Waigani, Papua New Guinea.
- 39. Betuela I, Rosanas-Urgell A, Kiniboro B, Stanisic DI, Samol L, de Lazzari E, et al. Relapses contribute significantly to the risk of Plasmodium vivax infection and disease in Papua New Guinean children 1–5 years of age. The Journal of infectious diseases. 2012;206(11):1771–80. pmid:22966124.
- 40. Hetzel MW, Choudhury AA, Pulford J, Ura Y, Whittaker M, Siba PM, et al. Progress in mosquito net coverage in Papua New Guinea. Malaria journal. 2014;13:242. Epub 2014/06/26. pmid:24961245; PubMed Central PMCID: PMC4077150.
- 41. Koepfli C, Ross A, Kiniboro B, Smith TA, Zimmerman PA, Siba P, et al. Multiplicity and diversity of Plasmodium vivax infections in a highly endemic region in Papua New Guinea. PLoS neglected tropical diseases. 2011;5(12):e1424. pmid:22206027; PubMed Central PMCID: PMC3243695.
- 42. Macdonald G. The analysis of equilibrium in malaria. Tropical diseases bulletin. 1952;49(9):813–29. pmid:12995455.
- 43. Felger I, Maire M, Bretscher MT, Falk N, Tiaden A, Sama W, et al. The dynamics of natural Plasmodium falciparum infections. PloS one. 2012;7(9):e45542. pmid:23029082; PubMed Central PMCID: PMC3445515.
- 44. Charlwood JD, Graves PM. The effect of permethrin-impregnated bednets on a population of Anopheles farauti in coastal Papua New Guinea. Medical and veterinary entomology. 1987;1(3):319–27. pmid:2979548.
- 45. Charlwood JD, Graves PM, Marshall TF. Evidence for a 'memorized' home range in Anopheles farauti females from Papua New Guinea. Medical and veterinary entomology. 1988;2(2):101–8. pmid:2980166.
- 46. Charlwood JD, Dagoro H, Paru R. Blood-Feeding and Resting Behavior in the Anopheles-Punctulatus Donitz Complex (Diptera, Cullicidae) from Coastal Papua-New-Guinea. Bulletin of entomological research. 1985;75(3):463–75. pmid:WOS:A1985ARU1200011.
- 47. Koinari M, Karl S, Ryan U, Lymbery AJ. Infection levels of gastrointestinal parasites in sheep and goats in Papua New Guinea. Journal of helminthology. 2013;87(4):409–15. pmid:WOS:000331847400004.
- 48. Gu WD, Novak RJ. Agent-based modelling of mosquito foraging behaviour for malaria control. Transactions of the Royal Society of Tropical Medicine and Hygiene. 2009;103(11):1105–12. pmid:WOS:000271776800006.
- 49. Gupta S, Swinton J, Anderson RM. Theoretical studies of the effects of heterogeneity in the parasite population on the transmission dynamics of malaria. Proceedings. 1994;256(1347):231–8. pmid:7914705.
- 50. Gething PW, Van Boeckel TP, Smith DL, Guerra CA, Patil AP, Snow RW, et al. Modelling the global constraints of temperature on transmission of Plasmodium falciparum and P. vivax. Parasites & Vectors. 2011;4. 92 pmid:WOS:000291869200001.
- 51.
May R, Anderson RM, Infectious diseases of humans: dynamics and control. Oxford: Oxford University Press; 1991.
- 52. Wesolowski A, Stresman G, Eagle N, Stevenson J, Owaga C, Marube E, et al. Quantifying travel behavior for infectious disease research: a comparison of data from surveys and mobile phones. Scientific reports. 2014;4:5678. pmid:25022440.
- 53. Perkins TA, Garcia AJ, Paz-Soldan VA, Stoddard ST, Reiner RC Jr., Vazquez-Prokopec G, et al. Theory and data for simulating fine-scale human movement in an urban environment. Journal of the Royal Society, Interface / the Royal Society. 2014;11(99). pmid:25142528.
- 54. Smith DL, Drakeley CJ, Chiyaka C, Hay SI. A quantitative analysis of transmission efficiency versus intensity for malaria. Nature Communications. 2010;1. PubMed PMID: WOS:000288224800006. pmid:21045826
- 55. Bharti AR, Chuquiyauri R, Brouwer KC, Stancil J, Lin J, Llanos-Cuentas A, et al. Experimental infection of the neotropical malaria vector Anopheles darlingi by human patient-derived Plasmodium vivax in the Peruvian Amazon. American Journal of Tropical Medicine and Hygiene. 2006;75(4):610–6. PubMed PMID: WOS:000241214100006. pmid:17038681
- 56. Garrett-Jones C. The human blood index of malaria vectors in relation to epidemiological assessment. Bulletin of the World Health Organization. 1964;30:241–61. pmid:MEDLINE:14153413.
- 57. Ribeiro JM, Seulu F, Abose T, Kidane G, Teklehaimanot A. Temporal and spatial distribution of anopheline mosquitos in an Ethiopian village: implications for malaria control strategies. Bulletin of the World Health Organization. 1996;74(3):299–305. pmid:8789928; PubMed Central PMCID: PMC2486923.
- 58. Keating J, Mbogo CM, Mwangangi J, Nzovu JG, Gu V, Regens JL, et al. Anopheles gambiae s.l. and Anopheles funestus mosquito distributions at 30 villages along the Kenyan coast. Journal of medical entomology. 2005;42(3):241–6. pmid:15962770; PubMed Central PMCID: PMC2673524.
- 59. Bejon P, Williams TN, Nyundo C, Hay SI, Benz D, Gething PW, et al. A micro-epidemiological analysis of febrile malaria in Coastal Kenya showing hotspots within hotspots. eLife. 2014;3:e02130. pmid:24843017; PubMed Central PMCID: PMC3999589.
- 60. Hii JL, Smith T, Mai A, Mellor S, Lewis D, Alexander N, et al. Spatial and temporal variation in abundance of Anopheles (Diptera:Culicidae) in a malaria endemic area in Papua New Guinea. Journal of medical entomology. 1997;34(2):193–205. pmid:9103763.
- 61. Kim Y, Escalante AA, Schneider KA. A Population Genetic Model for the Initial Spread of Partially Resistant Malaria Parasites under Anti-Malarial Combination Therapy and Weak Intrahost Competition. PloS one. 2014;9(7):e101601. pmid:25007207; PubMed Central PMCID: PMC4090191.
- 62. Tanabe K, Sakihama N, Kaneko A. Stable SNPs in malaria antigen genes in isolated populations. Science (New York, NY. 2004;303(5657):493. pmid:14739451.
- 63. Gurarie D, Karl S, Zimmerman PA, King CH, St Pierre TG, Davis TM. Mathematical modeling of malaria infection with innate and adaptive immunity in individuals and agent-based communities. PloS one. 2012;7(3):e34040. Epub 2012/04/04. pmid:22470511; PubMed Central PMCID: PMC3314696.
- 64. Thomas CJ, Cross DE, Bogh C. Landscape movements of Anopheles gambiae malaria vector mosquitoes in rural Gambia. PloS one. 2013;8(7):e68679. pmid:23874719; PubMed Central PMCID: PMC3715529.
- 65. Eckhoff PA. A malaria transmission-directed model of mosquito life cycle and ecology. Malaria journal. 2011;10:303. pmid:21999664; PubMed Central PMCID: PMC3224385.
- 66. Arifin SM, Zhou Y, Davis GJ, Gentile JE, Madey GR, Collins FH. An agent-based model of the population dynamics of Anopheles gambiae. Malaria journal. 2014;13:424. pmid:25373418; PubMed Central PMCID: PMC4233045.
- 67. White MT, Griffin JT, Churcher TS, Ferguson NM, Basanez MG, Ghani AC. Modelling the impact of vector control interventions on Anopheles gambiae population dynamics. Parasites & vectors. 2011;4:153. Epub 2011/07/30. pmid:21798055; PubMed Central PMCID: PMC3158753.
- 68. Smith DL, McKenzie FE. Statics and dynamics of malaria infection in Anopheles mosquitoes. Malaria journal. 2004;3:13. pmid:15180900; PubMed Central PMCID: PMC449722.
- 69. Wearing HJ, Rohani P, Keeling MJ. Appropriate models for the management of infectious diseases. PLoS medicine. 2005;2(7):e174. Epub 2005/07/15. pmid:16013892; PubMed Central PMCID: PMC1181873.
- 70. White M, Karl S, Battle KE, Hay SI, Mueller I, Ghani A. Modelling the contribution of the hypnozoite reservoir to Plasmodium vivax transmission. eLife. 2014; pmid:25406065
- 71. Smith DL, McKenzie FE, Snow RW, Hay SI. Revisiting the basic reproductive number for malaria and its implications for malaria control. PLoS biology. 2007;5(3):e42. pmid:17311470; PubMed Central PMCID: PMC1802755.
- 72. Midega JT, Mbogo CM, Mwambi H, Wilson MD, Ojwang G, Mwangangi JM, et al. Estimating dispersal and survival of Anopheles gambiae and Anopheles funestus along the Kenyan coast by using mark-release-recapture methods. Journal of medical entomology. 2007;44(6):923–9. pmid:WOS:000251034200003.
- 73. Toure YT, Dolo G, Petrarca V, Traore SF, Bouare M, Dao A, et al. Mark-release-recapture experiments with Anopheles gambiae sl in Banambani Village, Mali, to determine population size and structure. Medical and veterinary entomology. 1998;12(1):74–83. pmid:WOS:000072181000010.
- 74. Achee NL, Grieco JP, Andre RG, Rejmankova E, Roberts DR. A mark release-recapture study to define the flight behaviors of Anopheles vestitipennis and Anopheles albimanus in Belize, Central America. Journal of the American Mosquito Control Association. 2007;23(3):276–82. pmid:17939506.
- 75. Bailey SF, Baerg DC. The flight habits of Anopheles freeborni aitken. Proceedings and papers of the annual conference of the California Mosquito Control Association, inc. 1967;35:55–69. pmid:5629692.
- 76. abdel-Malek AA, abdel-Aal MA. Study of the dispersion and flight range of Anopheles sergenti Theo. in Siwa Oasis using radioactive isotopes as markers. Bulletin of the World Health Organization. 1966;35(6):968–73. pmid:4381759; PubMed Central PMCID: PMC2476271.
- 77. Ejerctto A, Urbino CM. Flight range of gravid and newly emerged Anopheles. Bulletin of the World Health Organization. 1951;3(4):663–71. pmid:14821773; PubMed Central PMCID: PMC2554024.
- 78. Koepfli C, Schoepflin S, Bretscher M, Lin E, Kiniboro B, Zimmerman PA, et al. How much remains undetected? Probability of molecular detection of human Plasmodia in the field. PloS one. 2011;6(4):e19010. Epub 2011/05/10. pmid:21552561; PubMed Central PMCID: PMC3084249.
- 79. Barry AE, Arnott A. Strategies for designing and monitoring malaria vaccines targeting diverse antigens. Frontiers in immunology. 2014;5:359. pmid:25120545; PubMed Central PMCID: PMC4112938.