Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Geospatial modeling of microcephaly and zika virus spread patterns in Brazil

  • Pedro Amaral ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Writing – original draft, Writing – review & editing

    pedroamaral@cedeplar.ufmg.br

    Affiliation CEDEPLAR/UFMG, Center for Development and Regional Planning, Federal University of Minas Gerais, Belo Horizonte, Minas Gerais, Brazil

  • Lucas Resende de Carvalho,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliation CEDEPLAR/UFMG, Center for Development and Regional Planning, Federal University of Minas Gerais, Belo Horizonte, Minas Gerais, Brazil

  • Thiago Augusto Hernandes Rocha,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliations PAHO/WHO, Brasília, Federal District, Brazil, CEPEAD/UFMG, Center of Higher Studies and Research in Administration, Federal University of Minas Gerais, Belo Horizonte, Minas Gerais, Brazil

  • Núbia Cristina da Silva,

    Roles Conceptualization, Formal analysis, Writing – original draft, Writing – review & editing

    Affiliation CEPEAD/UFMG, Center of Higher Studies and Research in Administration, Federal University of Minas Gerais, Belo Horizonte, Minas Gerais, Brazil

  • João Ricardo Nickenig Vissoci

    Roles Conceptualization, Formal analysis, Writing – original draft, Writing – review & editing

    Affiliation Duke University, Duke School of Medicine, Department of Surgery, Division of Emergency Medicine, Durham, North Carolina, United States of America

Abstract

Microcephaly and Zika Virus infection (ZIKV) were declared Public Health Emergencies of International Concern by the World Health Organization in 2016. Brazil was considered the epicenter of the outbreak. However, the occurrence of both ZIKV and microcephaly in Brazil was not evenly distributed across the country. To better understand this phenomenon, we investigate regional characteristics at the municipal level that can be associated with the incidence of microcephaly, our response variable, and its relationship with ZIKV and other predictors. All epidemiological data in this study was provided by the Ministry of Health official database (DATASUS). Microcephaly was only confirmed after birth and the diagnostic was made regardless of the mother’s ZIKV status. Using exploratory spatial data analysis and spatial autoregressive Tobit models, our results show that microcephaly incidence is significantly, at 95% confidence level, related not only to ZIKV, but also to access to primary care, population size, gross national product, mobility and environmental attributes of the municipalities. There is also a significant spatial autocorrelation of the dependent variable. The results indicate that municipalities that show a high incidence of microcephaly tend to be clustered in space and that incidence of microcephaly varies considerably across regions when correlated only with ZIKV, i.e. that ZIKV alone cannot explain the differences in microcephaly across regions and their correlation is mediated by regional attributes.

Introduction

The Zika virus infection (ZIKV) was declared a health emergency by the World Health Organization in 2016 [1]. In 2017, nearly all countries in the tropics were considered autochthonous regions of Zika virus transmission [2]. Brazil was considered the epicenter of the epidemic, with reports of 130,000 ZIKV in 2016 [3].

The fast increase in the number of reports prompted international attention and dedicated research increasingly suggested an association between ZIKV and neurological syndromes such as Guillain-Barré and microcephaly. In 2015 and 2016, 2,229 cases of microcephaly in infants were confirmed in Brazil, compared to a yearly average of only 157 cases between 2000 and 2014 [3].

Several studies of different backgrounds established the link between the ZIKV and microcephaly and other neurological disorders [49]. However, the occurrence of both ZIKV and microcephaly in Brazil was not evenly distributed across the country. As shown by Vissoci [10], the geospatial distribution of ZIKV in Brazil was diffuse, with scattered groups of municipalities with high incidence in the Midwest, North, Northeast and Southeast regions. On the other hand, patterns of microcephaly geospatial distribution, distinct from that of ZIKV, tended to be concentrated in the Northeast. Hotspots for microcephaly incidence varied less between the regions across all investigated bi-monthly periods in comparison with the varied locations of ZIKV incidence hotspots [10]. This spatial disparity in the co-occurrence of ZIKV and microcephaly suggests that there are other factors mediating the relationship between them. Hence, in this paper our objective is to investigate whether regional attributes such as deprivation, sanitation, mobility, environment and other socioeconomic characteristics of the municipalities play any significant role in the correlation between microcephaly and ZIKV. By using a framework of health geography, we can provide insights into disease spread patterns, high-risk areas, and correlated regional attributes that allow for inferences regarding the determinants of these outcomes [11].

The use of geospatial modeling techniques has proven its value for studying infections such as dengue fever [12] and chikungunya [13]. Health geography studies have been used to identify high-risk areas, considering the presence of elements capable to predict the levels associated with the incidence of arbovirus diseases. The geospatial approach is able to create insights to support health policies and surveillance strategies dedicated to minimizing the negative consequences of ZIKV. Despite this potential, few studies have examined the spatial patterns associated with ZIKV and the neurological conditions resulting from the infection [10].

The regional imbalances in the incidence of both microcephaly and ZIKV suggest that regional attributes have also played an important role in the spread of Zika virus and in mediating its association with microcephaly. Jaenisch et al. [14] found the estimated risk that a baby born to a woman infected by the Zika virus during pregnancy would have microcephaly varied substantially across Brazil. According to them, geographical area is one of the main factors affecting the risk. However, the investigation of geographical attributes related to the incidence of microcephaly was not one of the objectives of their study, an issue we address with this research.

Taking into consideration the lack of studies that evaluate the regional incidence of microcephaly and ZIKV, here we investigate the regional characteristics at the municipal level that can be associated with the incidence of microcephaly and the relation between the disease and ZIKV infection.

Methods

We designed an ex-post-facto ecological study based on routinely collected health data following the RECORD protocol [15]. Given the use of variables referring to past events that were not specifically collected for this study, there was no control by the researchers regarding the form of collection. The Brazilian Universal Health System (SUS) [16] is responsible for sharing all information collected regarding the epidemiological situation in the country. All epidemiological data used in this work was gathered from DATASUS, which is the department of the Ministry of Health (MoH) responsible for publicizing health system databases. The data was aggregated to the level of the Brazilian municipalities. Figures on confirmed ZIKV cases were obtained from the Disease Notification Information System [3]. A case is considered as confirmed if one of the following circumstances are met: viral RNA track, positive viral detection or IgM serology. The information on newborns with confirmed microcephaly was obtained from the System for Specialized Management Support [17]. To be considered as confirmed microcephaly case the following criteria should be met: infant with 37 or more weeks of gestation with a head circumference equal to or less than 31.9 cm for male infants, or equal to or less than 31.5 cm for female infants, in concurrence with WHO standards [1]. Microcephaly was only confirmed after birth and the diagnostic was made regardless of the ZIKV status of the mother. The volume of cases related to ZIKV and microcephaly were weighted by the population at the municipality level. The municipality’s population size was obtained from the Brazilian Institute of Geography and Statistics [18] repository and refers to all inhabitants living in each municipality in 2016. Data related to primary care coverage was obtained from the MoH. All data covering ZIKV and microcephaly was categorized by quarters in the period from January to December, 2016.

In addition to the data listed above, we used information on the urban structure of the Brazilian municipalities. This data was obtained from the Brazilian index of urban structure (IBEU) and refers to 2013. The IBEU is based on several dimensions associated with sanitation, urban structure and health conditions. Data on the IBEU was provided by the Observatory of the Metropoles of the National Institute of Science and Technology [19].

The IBEU covers five urban dimensions: mobility, environmental conditions, housing conditions, sanitation and infrastructure. The mobility dimension assesses the proportion of inhabitants who commute between home and work for at least one hour. The environmental aspect evaluates the lack of rubbish around residences, the existence of open sky sewage and afforestation index. Housing conditions are a composite score related to five indicators: proportion of people living in shanty towns, number of bedrooms with a maximum of two people, number of households with a maximum ratio of 4 people per restroom, proportion of households whose walls are made of bricks or appropriate wood and proportion of inadequate households. The sanitation dimension covers aspects related to four indicators: households with adequate sewage, homes with appropriate water and sewage services, coverage by garbage collection service, and availability of energy services. The last dimension regarding the urban structure comprises the infrastructure index with the following metrics: the proportion of people living in households covered by public illumination, streets made of asphalt or concrete paving, and household identification. The IBEU was calculated considering all indicators with the same weight and computing an average score covering all five dimensions. The final IBEU varied from 0 to 1. Finally, to better characterize the socioeconomic status of each municipality, we consider information on the Gross Domestic Product (GDP) per capita in 2013, provided by Brasil-IBGE [20].

The variable of interest in this study is the incidence of microcephaly in each municipality in Brazil. However, of the 5,560 municipalities in the sample, 4,831 (86.9%) did not register any incidence of microcephaly in the fourth quarter of 2016. Incidence rate mapping and the Getis-Ord-Gi cluster analysis [21] were performed in ARCGIS 10.3 [22]. Given distribution of the data, to estimate the correlation between regional attributes and incidence of microcephaly we used a Tobit model approach.

Censored regression models or Tobit models can be applied when the variable of interest is censored, i.e., its values are not observable beyond a given limit. The Tobit model, developed by James Tobin [23], estimates the relationship between a non-negative variable and independent variables. The generic specification of a Tobit model is described as follows: (1) where y* indicates a latent variable that depends on the matrix of explanatory variables (x) and a vector of parameters β and a normally distributed error term ε.

The choice of the Tobit estimator is justified by the statistical model that can generate the type of data used in this analysis. As stated by Amemiya [24], we cannot use any continuous density because a continuous density is inconsistent with the fact that there are several observations at 0, as is the case of the distribution of incidence of microcephaly. However, the observed values of incidence of microcephaly are continuous beyond zero and have no upper bound. Hence, we also rule out binary or count models. Another important characteristic of our model is that the exogenous variables are observable regardless of the value of y*, so the model can be labeled as a censored regression model [24].

The estimator presented in Eq (1) does not account for the presence of spatial correlation, which may render the Tobit model estimation inefficient or even inconsistent [25]. Given the spatial pattern of both microcephaly and ZIKV, this is a hypothesis that we must investigate. In order to incorporate spatial correlation, a SAR Tobit (spatial autoregressive Tobit) was estimated as presented in Eq 2. (2) where In indicates an identity matrix of order n, ρ is a spatial autoregressive parameter and W is a spatial weights matrix, assumed here as first-order Queen contiguity type.

Although these models have been implemented through maximum-likelihood (MLE), their estimation demands high computational costs. The Bayesian approach provides a less demanding computational alternative. In particular, a Monte Carlo Bayesian approach was applied based on the Markov Chain (MCMC) and the Gibbs algorithm. The implementation used for the SAR Tobit model was proposed by [26] and implemented in R by the spatialprobit package [27].

The potential presence of a significant spatial lag parameter implies that variations in the exogenous variables have not only direct effects on the dependent variable, but also indirect effects due to the spatial spillover. Therefore, the total effect of an explanatory variable x on the dependent variable y can be decomposed into direct effects and indirect effects. The direct effects refer to the predicted direct impact of variations in x on the variable of interest y in the same municipality. The indirect effects are the impacts due to spatial spillovers of the variations of y within the neighboring municipalities. The compound effect of variations of x on y are, therefore, the sum of both direct and indirect effects.

Results

Fig 1 shows the spatial autocorrelation of the main variables in this study, i.e. microcephaly incidence in the fourth quarter of 2016 and ZIKV in the first three quarters. In this study, the most important aspect of the spatial distribution of microcephaly and ZIKV is their spatial concentration, which indicates a possible spillover effect. The coincidence of areas, especially between ZIKV the second quarter of the year and microcephaly in the last quarter is also an important aspect to highlight which is further explored in this study.

thumbnail
Fig 1. Spatial autocorrelation measured by Getis-Ord Gi of ZIKV and microcephaly, Brazil– 2016.

Source: Own elaboration with SINAN, 2016 database.

https://doi.org/10.1371/journal.pone.0222668.g001

The results of the estimation of the spatial Tobit models are shown in the tables that follow. Given the presence of a significant spatial lag coefficient, the Tobit parameters cannot be directly interpreted as in a regular Tobit, due to the spatial multiplier effect. To allow for marginal interpretations, the main results are followed by direct, indirect and total effects on the dependent variable of marginal changes in the explanatory variables.

Tables 1 and 2 show the results of the regression of microcephaly incidence only on ZIKV incidence. These results are shown to provide comparability against those in Tables 3 and 4, which add regional attributes as explanatory variables. This way, we can evaluate how regional attributes mediate the relationship between ZIKV and microcephaly. Given that our model is based on Bayesian MCMC estimates, the significance inference was based on p-levels instead of standard t-statistics. For more information on inference based on Bayesian MCMC estimates, see [28].

thumbnail
Table 1. Results of SAR Tobit—Dependent variable: Microcephaly incidence (4th quarter), Brazil—2016.

https://doi.org/10.1371/journal.pone.0222668.t001

thumbnail
Table 2. Results of SAR Tobit—Direct and indirect effects—Dependent variable: Microcephaly incidence (4th quarter), Brazil—2016.

https://doi.org/10.1371/journal.pone.0222668.t002

thumbnail
Table 3. Results of SAR Tobit—Dependent variable: Microcephaly incidence (4th quarter), Brazil—2016.

https://doi.org/10.1371/journal.pone.0222668.t003

thumbnail
Table 4. Results of SAR Tobit—Direct and indirect effects—Dependent variable: Microcephaly incidence (4th quarter), Brazil—2016.

https://doi.org/10.1371/journal.pone.0222668.t004

The results presented in Tables 3 and 4 show that microcephaly incidence in Brazil is significantly and positively related to access to primary care, population size and mobility index of the municipalities. On the other hand, microcephaly incidence shows a negative significant association with GDP and environmental index of the municipalities.

There is also a significant positive spatial autocorrelation of the dependent variable. This spatial autocorrelation is measured by the coefficient ρ, which estimated mean is of 0.24. This value is more than 6 standard deviations away from zero, indicating that municipalities that have a high incidence of microcephaly tend to be significantly spatially clustered, even after controlling for their attributes and ZIKV incidence. To evaluate the evolution of the relationship between microcephaly and ZIKV across different time lapses between notifications, the incidence of ZIKV was considered separately for the first three quarters of 2016, while microcephaly incidence was considered for the fourth quarter only. The results show a significant positive relationship between ZIKV incidence in the second quarter of the year and microcephaly, a significant negative relationship between ZIKV incidence in the third quarter of the year and microcephaly, and a non-significant relationship between microcephaly and ZIKV in the first quarter.

The effect of each of the significant explanatory variables on the incidence of microcephaly can be seen in Table 4. Municipal GDP (logged) exerts a total effect of -37.4. In other words, for every 1% increase in the GDP, the incidence of microcephaly decreases by 0.37 points, being -0.095 points in direct effects and -0.279 in indirect effects. Primary care coverage exerts a compound effect of 0.229, i.e. for each additional percentage point of coverage, microcephaly incidence is raised 0.23 points, being 0.06 in direct effects and the remaining 0.17 in indirect effects. Large municipalities tend to present higher microcephaly incidence, so that a 1% increase in population size is related to a 0.73 increase in microcephaly, being 0.18 direct and 0.55 indirect effects. For the IBEU indices, mobility has a total impact of 35 points and environment of -22. Since these indices vary between 0 and 1, we have that an increase of 0.01 point in the indices is related to 0.35 increase in microcephaly for the mobility index and 0.22 decrease in microcephaly for the environmental index.

The total effect of ZIKV on microcephaly is of -0.10 for the third quarter and 0.12 for the second quarter. These mean results are different from those shown for the model considering only ZIKV as an explanatory variable and no measure of regional attributes. When no regional variable was considered, the results were -0.12 and 0.16, respectively. Hence, not controlling the relationship between ZIKV and microcephaly for different regional attributes may overestimate the correlation between ZIKV and microcephaly.

Discussion

Our results show that regional attributes can significantly contribute to explaining microcephaly incidence rates across Brazilian municipalities and that disregarding these attributes may lead to overestimation of the magnitude of the relationship between ZIKV and microcephaly. Municipalities with greater GDP per capita and with better environmental urban structures show a lower incidence of microcephaly. The effect of greater GDP per capita may be related to a smaller malnutrition rate and better knowledge of the effects of drug abuse during gestation, which are potential causes of microcephaly [29]. On its turn, a better environmental structure may lead to lower reproductive rates of mosquitoes, especially Aedes aegypti, potentially affecting the probability of infection of other viruses such as dengue or chikungunya, which may also cause microcephaly.

On the other hand, municipalities with larger population size and better mobility index show a greater incidence of microcephaly. This may be due to the easier spread of other infections that can also result in microcephaly, such as rubella, cytomegalovirus, toxoplasmosis meningitis and HIV. Primary care coverage was also found to be positively correlated with microcephaly incidence. This correlation may be linked to better diagnosis and information on microcephaly.

Regarding the relationship between ZIKV and microcephaly, the positive association between the notification of ZIKV in the second quarter of 2016 and confirmation of microcephaly in the fourth quarter is expected from previous literature given the higher risk of microcephaly when ZIKV infection occurs in the first trimester of pregnancy. However, the negative relationship between ZIKV in the third quarter of the year and microcephaly in the fourth quarter is intriguing. One possible explanation is a fast reduction of ZIKV in municipalities with high levels in the previous term. Given the time lapse between ZIKV and microcephaly notifications, municipalities with a significant drop of ZIKV in the third quarter should show a lower incidence of microcephaly only in the first quarter of the following year. As shown in Fig 1, the incidence rate of ZIKV changed very fast in Brazil, especially in the Western region of the country, which may be a conjoint result of public policies to reduce the population of A. aegypti and a decrease in average temperatures in the third quarter.

In sum, ZIKV incidence is very important to predict microcephaly incidence. However, regional attributes also play a significant role in explaining the differences in microcephaly incidence and, at least partially, may be cofactors that explain the varied risk ratio of microcephaly in pregnant women infected with ZIKV found by Jaenisch et al. [14].

Final remarks

The emergence of ZIKV and microcephaly was considered of global interest because of the quick increase in the number of countries facing an active circulation of ZIKV and the evidence linking this disease with microcephaly. Adequate monitoring of the spread patterns of ZIKV and incidence of microcephaly are essential to support actions aiming at an adequate response to this epidemiological crisis. Taking into consideration this challenge, the main objective of this work was to evaluate how past ZIKV incidence and regional cofactors can help to understand the spatial spread pattern of microcephaly.

The capability to anticipate future regions that might face a high volume of microcephaly cases resulting from a previous peak in ZIKV incidence can support the ability to provide appropriate emergency response interventions. Aiming at the minimization of the negative consequences of ZIKV and microcephaly, public policies can be better implemented once the right locations can be prioritized based on risk levels. The model developed in this study can act as a tool to support the formulation of responses to ZIKV and microcephaly health crisis in this new frontier.

References

  1. 1. World Health Organization. Zika virus and complications: Public Health Emergency of International Concern. World Heal. Organ.—Program. 2016. http://www.who.int/emergencies/zika-virus/en/
  2. 2. European Centre for Disease Prevention and Control. Current Zika transmission worldwide [Internet]. 2017. https://ecdc.europa.eu/en/publications-data/current-zika-transmission-worldwide
  3. 3. Brasil-SINAN/SUS. Ministry of Health. Sistema de informação de agravos de notificação (SINAN/SUS). 2019. Accessed 15 nov. 2018.
  4. 4. Brasil P, Sequeira PC, Freitas AD, Zogbi HE, Calvet GA, de Souza RV, et al. Guillain-Barré syndrome associated with Zika virus infection. Lancet [Internet]. 2016; (10026):1482. Available from: http://dx.doi.org/10.1016/S0140-6736(16)30058-7 pmid:27115821
  5. 5. França GVA, Schuler-Faccini L, Oliveira WK, Henriques CMP, Carmo EH, Pedi VD, et al. Congenital Zika virus syndrome in Brazil: a case series of the first 1501 livebirths with complete investigation. Lancet (London, England). 2016; 388(10047):891–897.
  6. 6. Garcez PP, Loiola EC, Madeiro da Costa R, Higa LM, Trindade P, Delvecchio R, et al. Zika virus impairs growth in human neurospheres and brain organoids. Science. 2016; 352(6287):816–818. Available from: http://www.sciencemag.org/cgi/doi/10.1126/science.aaf6116 pmid:27064148
  7. 7. Calvet G, Aguiar RS, Melo ASO, Sampaio SA, de Filippis I, Fabri A, et al. Detection and sequencing of Zika virus from amniotic fluid of fetuses with microcephaly in Brazil: a case study. Lancet Infect. Dis. [Internet]. Elsevier. 2017; 16(6):653–660. Available from: http://dx.doi.org/10.1016/S1473-3099(16)00095-5
  8. 8. Castro M. C., Han Q. C., Carvalho L. R., Victora C. G., & França G. V. Implications of Zika virus and congenital Zika syndrome for the number of live births in Brazil. Proceedings of the National Academy of Sciences, 2018; 115(24), 6177–6182.
  9. 9. Brady Oliver J., et al. “The association between Zika virus infection and microcephaly in Brazil 2015–2017: An observational analysis of over 4 million births.” PLoS medicine. 2019; 16(3), e1002755. pmid:30835728
  10. 10. Vissoci JRN, Rocha TAH, da Silva NC, de Sousa Queiroz RC, Thomaz EBAF, Amaral PVM, et al. Zika virus infection and microcephaly: Evidence regarding geospatial associations. PLoS Negl. Trop. Dis. 2018. 12(4):e0006392. Available from: http://dx.plos.org/10.1371/journal.pntd.0006392 pmid:29694351
  11. 11. Macintyre S, Ellaway A, Cummins S. Place effects on health: How can we conceptualise, operationalise and measure them? Soc. Sci. Med. 2002; 55(1):125–139. pmid:12137182
  12. 12. Xavier DR, Magalhães M de AFM, Gracie R, dos Reis IC, de Matos VP, Barcellos C. Difusão espaço-tempo do dengue no Município do Rio de Janeiro, Brasil, no período de 2000–2013. Cad. Saude Publica. 2017; 33(2). Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-311X2017000205006&lng=pt&tlng=pt
  13. 13. Nsoesie EO, Ricketts RP, Brown HE, Fish D, Durham DP, Ndeffo Mbah ML, et al. Spatial and temporal clustering of chikungunya virus transmission in dominica. PLoS Negl. Trop. Dis. 2015; 9(8): 1–11.
  14. 14. Jaenisch T, Rosenberger KD, Brito C, Brady O, Brasil P, Marques ET. Risk of microcephaly after Zika virus infection in Brazil, 2015 to 2016. Bull. World Health Organ. [Internet]. 2017; 95(3):191–198. Available from: http://www.who.int/entity/bulletin/volumes/95/3/16-178608.pdf pmid:28250532
  15. 15. Benchimol E. I., Smeeth L., Guttmann A., Harron K., Moher D., Petersen I., … & RECORD Working Committee. The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. PLoS medicine. 2015; 12(10), e1001885. pmid:26440803
  16. 16. Paim J, Travassos C, Almeida C, Bahia L, MacInko J. The Brazilian health system: History, advances, and challenges. Lancet. 2011; 377(9779):1778–97. pmid:21561655
  17. 17. Laguardia J, Domingues CMA, Carvalho C, Lauerman CR, Macário E, Glatt R. Sistema de Informação de Agravos de Notificação (Sinan): desafios no desenvolvimento de um sistema de informação em saúde. Epidemiol. e Serviços Saúde. 2004; 13(3):135–47.
  18. 18. Brasil-IBGE. Estimativas de População. Instituto Brasileiro de Geografia e Estatística. 2016. http://www.ibge.gov.br/home/estatistica/populacao/estimativa2016/default.shtm. Accessed 15 nov. 2018.
  19. 19. Ribeiro LC de Q, Ribeiro MG. IBEU Municipal—Índice de bem-estar urbano dos municípios brasileiros. Rio de Janeiro; 2013.
  20. 20. Brasil. IBGE. Produto interno bruto dos municípios. Instituto Brasileiro de Geografia e Estatística. 2013. https://ww2.ibge.gov.br/home/estatistica/economia/pibmunicipios/2014/default_base.shtm. Accessed 23 abr. 2018.
  21. 21. Ord J.K. and Getis A. Local Spatial Autocorrelation Statistics: distributional Issues and an Application. Geographical Analysis. 1995; 27(4): 286–306.
  22. 22. ESRI. ArcGIS Desktop: Release 10.3. Redlands CA. 2014. p. Environmental Systems Research Institute.
  23. 23. Tobin James. "Estimation of relationships for limited dependent variables." Econometrica: journal of the Econometric Society. 1958; 26(1): 24–36.
  24. 24. Amemiya T. Advanced econometrics. Harvard University Press; 1985.
  25. 25. Amaral P V., Anselin L. Finite sample properties of Moran’s I test for spatial autocorrelation in tobit models. Pap. Reg. Sci., 2014; 93(4):773–781.
  26. 26. LeSage J., & Pace R. K. Introduction to spatial econometrics. Chapman and Hall/CRC. 2009.
  27. 27. Wilhelm S, de Matos MG. Estimating Spatial Probit Models in R. R Journal. 2013; 5(1):130–144. Available from: https://journal.r-project.org/archive/2013/RJ-2013-013/RJ-2013-013.pdf
  28. 28. Gelman A., Carlin J., Stern H. and Rubin D. Bayesian Data Analysis, London:Chapman & Hall; 1995.
  29. 29. Kesrouani A, Fallet C, Vuillard E, Jacqz-Aigrain E, Sibony O, Oury JF, et al. Pathologic and laboratory correlation in microcephaly associated with prenatal cocaine exposure. Early Hum Dev. 2001; 63(2): 79–81 pmid:11408096