https://orcid.org/0000-0002-1170-1780
Figures
Abstract
Objectives
To examine the potential moderating effects of explicit racial attitudes and implicit racial attitudes on the relationship between percent of Black county residents and COVID-19 cases and deaths.
Methods
We collected data from a variety of publicly available sources for 817 counties in the US. (26% of all counties). Cumulative COVID-19 deaths and cases from January 22 to August 31, 2020 were the dependent variables; explicit racial attitudes and implicit racial attitudes served as the moderators; subjective poor or fair health, food insecurity, percent uninsured, percent unemployed, median family income, percent women, percent of Asian county resident, percent of Hispanic county residents, and percent of people 65 or older were controls.
Citation: Cunningham GB, Wigfall LT (2020) Race, explicit racial attitudes, implicit racial attitudes, and COVID-19 cases and deaths: An analysis of counties in the United States. PLoS ONE 15(11): e0242044. https://doi.org/10.1371/journal.pone.0242044
Editor: Natalie J. Shook, University of Connecticut, UNITED STATES
Received: July 24, 2020; Accepted: October 26, 2020; Published: November 18, 2020
Copyright: © 2020 Cunningham, Wigfall. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are deposited at https://doi.org/10.6084/m9.figshare.13166564 and included within the Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Whereas everyone has an exposure risk for COVID-19, the severity of illness varies.
There is a growing body of evidence that suggests racial and ethnic minorities are more affected by severe illness from COVID-19 compared to White people [1–4]. Even more alarming is the fact that some researchers have shown that Black individuals are at a higher risk than their White counterparts of having severe illness from COVID-19 that requires hospitalization [3,5]. In the United States (US), this is not surprising because Blacks/African American people were already disproportionately affected by underlying medical conditions such asthma, cardiovascular disease (CVD), chronic kidney disease, chronic obstructive pulmonary disease (COPD), diabetes, hypertension or high blood pressure (HBP), human immunodeficiency virus (HIV), obesity, and sickle cell disease before COVID-19 [6]. What is less clear to date, however, are the factors that may be associated with these racial disparities in adverse health outcomes from COVID-19 [7].
The purpose of this research was to extend the existing scholarship related to race and COVID-19 by empirically considering the role of explicit and implicit racial attitudes. In this study, we draw from publicly available data to examine the role of racial attitudes on COVID-19 cases and deaths, at the county level. Our results indicate that as the percent of Black county residents increases, so too do COVID-19 cases and deaths. We hypothesize that explicit and implicit racial attitudes uniquely explain COVID-19 cases and deaths, and serve to moderate the relationship between the percent of Black county residents and COVID-19 outcomes.
Theoretical framework
In the current study, we consider the influence of racial attitudes and how they might affect the relationship between the percent of Black county residents and COVID-19 cases and deaths. Moderators influence the relationship between predictor and outcome variables and, in doing so, offer unique information about when and under what conditions phenomena might occur [8]. Consistent with current social psychological research and public health scholarship [9,10], we consider the influences of both explicit and implicit attitudes toward racial minorities.
Explicit racial attitudes are those of which people are aware and that they consciously, deliberately maintain [11]. This form of bias is consistent with the notion that prejudice represents negative attitudes held toward a group of people or those presumed to be in that group (e.g., [12]). Explicit racial bias might take the form of racial slurs or holding negative attitudes toward racial minorities. In much of the US, publicly espousing explicit racial prejudice is contrary to social norms [13]; nevertheless, people still do harbor such attitudes and, in some cases, openly express them.
Implicit racial attitudes take a different form than do explicit attitudes. They reflect automatic responses that manifest when an external stimulus corresponds with an individual’s association set that link the stimulus and particular characteristics [14]. Though implicit attitudes represent automatic associations, people are aware of their own implicit biases and are able to predict their occurrence with some accuracy [15]. Several scholars have argued that implicit racial attitudes are more prevalent in society than are explicit attitudes [16] and might be a better predictor of less controllable behaviors [17], especially among those who are not motivated to avoid bias.
Racial attitudes at the at the community level.
To date, most of the research focusing on explicit and implicit racial attitudes has occurred at the individual level of analysis; however, the relationship with individual-level behaviors is tenuous [18]. On the other hand, Payne and colleagues [19,20] have shown that prejudice can take on a shared property at the community level. Members of a community—whether a city, metropolitan area, county, or even state—generally have similar social interactions, exposures to media, and collective experiences, all of which can shape their explicit and implicit attitudes. The collective experiences can influence how any one individual reacts to a particular situation, and therefore, contextual factors likely attenuate the relationship between bias and outcomes at the individual levels. However, when taken as a whole, aggregate responses should converge such that people within a given community respond in similar ways. In this way, prejudice represents a bias of the crowd [19,20].
Past researchers focusing on racial bias and health outcomes have predominantly done so at the individual level of analysis (for examples, see [21,22]). However, for many of the reasons articulated by Payne et al. [19,20]., bias captured at the community-level is likely to offer better explanatory power (see also [23]). Consistent with this position, community-level racial attitudes are linked with racial differences in infant health outcomes [24], Black individuals’ death rates due to cardiovascular disease [25], and mortality risk [26], as well as other important community outcomes, such as lethal force in policing [27], punishment of Black school children [28], and reactions to social justice movements [29], among others.
Hypotheses.
The collective evidence suggests that race is likely to influence COVID-19 risk, such that as the percent of racial minorities increases, so too do COVID-19-related cases and deaths [1–4]. Researchers have also shown that the unique effects of race and ethnicity remain even after taking into account individual and neighborhood factors [5], leading to calls for further research aimed at identifying underlying predictive mechanisms. Community-level racial attitudes might offer such predictive value, as they are related to a variety of negative health outcomes for Black residents [24–26].
Building from this evidence, we first predicted that explicit racial attitudes would predict COVID-19 cases (Hypothesis 1) and deaths (Hypothesis 2), such that as explicit racial attitudes increased, so too would the COVID-19 related outcomes. We hypothesized similar effects for implicit racial attitudes, such that we expected they would hold a significant, positive association with COVID-19 cases (Hypothesis 3) and deaths (Hypothesis 4). Finally, it is possible that explicit racial and implicit attitudes moderate the relationship between the percent of Black county residents and subsequent health outcomes. In this case, the aforementioned relationship might be stronger when explicit and implicit attitudes are high, relative to when they are low. This reasoning is consistent with other scholarship showing that racial attitudes and biases can interact with community demographics to predict health outcomes [30]. Given these possibilities, we hypothesized that explicit racial attitudes would moderate the relationship between the percent of Black county residents and COVID-19 cases (Hypothesis 5) and deaths (Hypothesis 6), such that the associations would be stronger when explicit racial attitudes are high. Turning to the next hypotheses, we predicted that implicit racial attitudes would moderate the relationship between the percent of Black county residents and COVID-19 cases (Hypothesis 7) and deaths (Hypothesis 8), such that the relationships will be stronger when implicit racial bias is high.
Method
Data sources and variables
We collected data at the county level in the United States. Of the 3143 county-equivalents (e.g., counties, parishes, boroughs) in the US, we had complete data for 817 (26% of all counties), with every state and the District of Columbia represented. As outlined in the following sections, we drew from a variety of publicly available sources.
COVID-19 cases and deaths.
We collected COVID-19 cases and deaths for each county for the USAFacts website (https://usafacts.org/visualizations/coronavirus-covid-19-spread-map/). This site uses a county-level tracker to collect data for each day. For the current analysis, we had cumulative cases and deaths observations from January 22, 2020 through August 31, 2020 (222 days). We converted each count to reflect the total the number of cases (Cases) or deaths (Deaths) per 100,000 county residents.
Black county residents.
We drew from the Robert Wood Johnson-supported County Health Rankings & Roadmaps website (www.countyhealthrankings.org) to determine the percent of Black county residents (Percent Black). This site draws from US Census Bureau estimates to provide the demographic characteristics for each county in the US, including the percentage of Black residents.
Racial attitudes.
We included two measures for racial attitudes: Explicit Racial Attitudes and Implicit Racial Attitudes, both of which were collected from Project Implicit. Harvard University researchers have, for years, collected bias and prejudice data from people around the world through the Project Implicit project (http://implicit.harvard.edu). After anonymizing the data, they then make it publicly available on the Center for Open Science website (https://osf.io/vp5m2/). It is from this website that we collected data for the 2019 year. The dataset includes information about the state and county of the participants.
We assessed Explicit Racial Attitudes using the Feelings Thermometer. Participants responded to two items: “please rate how warm or cold you feel towards White people” and “please rate how warm or cold you feel towards Black people.” Both items were anchored by a scale including 0 = coldest feelings, 5 = neutral, 10 = warmest feelings. Consistent with Hehman et al. [27], Leitner et al. [25], O’Shea, Watson, Brown, and Fincher [31], among others, we subtracted ratings toward Black people from the ratings toward White people to create a single measure of Explicit Racial Attitudes.
We examined Implicit Racial Attitudes through the Implicit Association test developed by Greenwald, McGhee, and Schwartz [32]. This measure “assesses strengths of associations between concepts by observing response latencies in computer-administered categorization tasks” ([33], p. 18). Researchers calculate participant responses times between various associations to determine the relative preference for or against Black people or White people. Thus, the focus is on automatic associations instead of an explicit response. Greenwald et al. [33] offered evidence for the test-retest reliability, internal consistency, and various forms of validity evidence.
Controls.
We included a number of control variables that might influence the residents’ health or that are related to COVID-19 prevalence. Data were gathered from the County Health Rankings & Roadmaps website, and we also list the data source from which they drew the data and formed their estimates. First, a number of pre-existing health conditions that are linked with greater COVID-19 risks and mortality [34]; thus, we controlled for the percent of county participants whose subjective ratings were Poor or Fair Health. Others have also used their measure to assess community-level health [35,36]. Next, food a lack of healthy food options is related to poor health outcomes [37] and a potential contributor to COVID-19 prevalence [38]. Thus, we controlled for the percent of county residents experiencing Food Insecurity using the data from the Map the Meal Gap. Third, a lack of insurance can negatively affect preventative health and disease treatment [39]. People who lack insurance might also face more negative COVID-19 outcomes [40]. Thus, we accounted for the percent of the county who are Uninsured, with data coming from the Small Area Health Insurance Estimates. Given the influence of economic stability on health [41] and COVID-19 risk [42], we included the percent of residents who were Unemployed, with data from the Bureau of Labor Statistics. Further, income is predictive of COVID-19 outcomes, as people in poor communities are countries bear a larger burden than do their wealthier counterparts [43]. As such, we controlled for the log of the median family income among county residents. Finally, race, gender, and age are reliably associated with COVID risks [44,45], so we controlled for the percent of county residents who were Percent Women, Percent Asian, Percent Hispanic, and Percent 65 or Older.
Empirical analysis
Previous researchers have aggregated data at various cutoff points (e.g., n = 20 for [24]; n = 100 for [46]; and n = 150 for [27]). In determining the most appropriate cutoff point, we ran preliminary analyses for a minimum of 20, 50, 100, and 150 respondents per county. To examine precision, we computed the coefficient of variation for the Explicit Racial Attitudes and Implicit Racial Attitudes at each cutoff point and then compared the percent increase in precision. The coefficient of variation scores were substantially smaller in counties with at least 50 respondents, relative to those with 20. The increased precision was only marginally better when to 100 and then to150. We then compared representativeness of the sample. When 20 respondents served as the cutoff point, multiple counties in each state were represented in the dataset. This was also the case when moving to a minimum of 50 respondent per county. When we moved to 100 cases, there were no counties from one state, and only a single county from other states. This also occurred when using 150 cases as the cutoff. Given these patterns, we chose 50 as the minimum number of respondents per county. As a result, the data were reduced from 875,209 individual responses to the aggregate responses representing 817 US counties.
Next, there was considerable variability in the number of Project Implicit respondents per county (50 to 13,003). To account for this unevenness in the responses per county, we followed Nosek et al. [46] by constructing the log of the inverse weights based on standard errors. Consistent with Nosek et al. [46], we averaged the weights for the three racial attitudes measures to create a single weighting variable. This approach allows for more reliable estimates in the counties with more respondents.
We computed bivariate correlations for all variables. We standardized the predictor and moderating variables (consistent with [46]) and tested the hypotheses through moderated regression analysis, following Cohen et al.’s [47] guidelines. Where significant interactions existed, we computed simple slopes and plotted the nature of the interactions. Cases and Deaths served as the dependent variables, respectively, in the analyses. Preliminary analyses indicated that when all controls, first-order effects, and the interaction terms were entered into the regression analysis simultaneously, the variance inflation factor was 18.45. This is greater than the 10.00 cutoff point recommended by Hair, Black, Babin, Anderson, and Tatham [48], thereby signaling multicollinearity was a concern. Thus, we ran separate analyses for Explicit Racial Attitudes and Implicit Racial Attitudes. This approach is also consistent with Riddle and Sinclair [28].
Results
Descriptive statistics
The means, standard deviations, and bivariate correlations are available in Table 1. Overall, the counties included in the sample averaged 1466.37 (SD = 941.35) total COVID-19 Cases and 38.12 (SD = 42.20) total Deaths through the end of August 2020. Both COVID-19 variables held statistically significant associations with most of the control and predictor variables. Of note was the positive bivariate associations between Percent Black and both Cases (r = .47) and Deaths (r = .32). These associations were higher than the corresponding relationships observed for Percent Asian or Percent Hispanic. Finally, Explicit and Implicit Racial Attitudes held a significant, positive association (r = .72).
Hypothesis testing
Results related to Cases are presented in Table 2. The controls accounted for 53% of the variance, as shown in Model 1. The effects of Explicit Racial Attitudes are captured in Model 2, explaining a unique 2% of the variance beyond the effects of the controls. Consistent with Hypothesis 1, Explicit Racial Attitudes were positively related to Cases. Similarly, as seen in Model 4, Implicit Racial Attitudes held a significant, positive association with Cases, explaining 1% unique variance; thus, Hypothesis 3 was also supported.
Table 1 also provides the tests for the moderating effects of explicit and implicit racial attitudes. As seen in Model 4, the Percent Black × Explicit Racial Attitudes interaction was significant. We then plotted the interaction (Fig 1A) and computed simple slopes, following Cohen et al.’s [47] guidelines. Results demonstrate that the relationship between Percent Black and Cases was stronger when Explicit Racial Attitudes were high (B = 994.56, SE = 93.06, p < .001) relative to when they were low (B = 630.14, SE = 42.25, p < .001). Thus, Hypothesis 5 was supported. We observed similar support for Hypothesis 6 (see Model 5 of Table 1). The relationship between Percent Black and Cases was stronger when Implicit Racial Attitudes were high (B = 994.56, SE = 93.06, p < .001) relative to when they were low (B = 630.14, SE = 42.25, p < .001). The relationship is illustrated in Fig 1B.
A. Explicit racial attitudes. B. Implicit racial attitudes.
Table 3 provides the results for Deaths. The controls accounted for 33% of the variance. The main effects of Explicit Racial Attitudes were not significant (see Model 2), nor were the Percent Black × Explicit Racial Attitudes (see Model 4). Thus, Hypotheses 2 and 6 were rejected. On the other hand, Hypothesis 4 was supported, as Implicit Racial Attitudes held a positive, significant association with Deaths (see Model 3). Finally, the Percent Black × Implicit Racial Attitudes interaction term was not significant (see Model 5), so Hypothesis 8 was rejected.
We offer a summary of the findings in Table 4. Finally, we conducted a series of analyses to examine whether our decisions about the number of participants per county, the use of weights, or potential outliers impacted the pattern of results. As previously noted, we examined the hypotheses under several stipulations, as we: (a) limited the data aggregation of county-level data to those counties with at least 50 respondents; and (b) weighted the analyses using the log of the invariance variance weights on standard errors of the IAT and Thermometer scores. To determine whether these choices impacted the variance explained or interpretation of the results, we conducted additional analyses with different county participation cutoffs with the weights applied (n ≥ 100, and n ≥ 150), as well as analyses at the n ≥ 50 without the weights applied. Though there were slight variations, the overall pattern of results and variance explained was consistent across the cutoff points for participants per county. Further, unweighted regression analyses—that is, those not taking into account the differences in participants per county—resulted in less explanatory power. Table 1 also shows considerable variability in the number Cases. A Boxplot in SPSS showed four extreme outliers, or values more than three times the interquartile range. There were no such cases for Deaths. We computed a separate analysis for Cases excluding the extreme outliers, and the interpretation of the results remained the same.
Discussion
The purpose of this research was to extend the existing scholarship related to race and COVID-19 by empirically considering the role of explicit and implicit racial attitudes. Results of the study showed that counties with high percentages of Black and Hispanic residents were also those that experienced more COVID-19 cases and deaths. These findings are consistent with previous researchers who have shown that a link between race and COVID-19 risk [1–4]. We observed as much from a bivariate perspective, and the relationships remained even after taking into account other control variables, including county demographics, subjective well-being, median household income, food security, percent uninsured, and percent unemployed. Results align with those from Lassale et al. [5], who observed racial differences in COVID-19-related hospitalizations even after taking into account personal and neighborhood factors.
These findings, though important, only tell part of the story, however. We also found that even after taking into account race and other county-level factors, aggregate measures of explicit racial attitudes and implicit racial bias provided additional explanatory evidence. The main effects of both racial attitudes variables were evident, as both were significant, positive predictors of COVID-19 cases. Importantly, however, these effects were qualified by a significant interaction with the percent of Black count residents. Specifically, the relationship between the percent of Black county residents and COVID-19 cases was stronger when explicit racial attitudes and implicit racial attitudes, respectively, were high relative to when they were low.
For COVID-19 deaths, however, the results were more equivocal. An increase in county-level implicit racial attitudes was linked with more COVID-19 deaths. However, the effects of explicit racial attitudes and the interaction of either racial attitudes term with the percent of Black county residents were not significant.
These collective findings point to the importance of county-level measures of racial attitudes and biases, especially when it comes to predicting COVID-19 deaths. Results buttress Payne et al.’s [19,20] arguments that aggregate measures of prejudice and bias can take on a shared property at the community level and effectively explain racial disparities. They also reinforce Blair and Brondolo’s [23] argument that community-level measures of racial attitudes and biases are likely to offer new insights into factors that predict health outcomes. Whereas others have identified direct effects [24–26], our results suggest county-level racial attitudes and biases can play important moderating roles. Put another way, a high percentage of Black residents is more likely to be associated with COVID-19 cases under some conditions (i.e., high levels of explicit racial attitudes and implicit racial attitudes) than others.
The next question is: why do these effects occur? Our controls accounted for a large portion of the variance in both COVID-19 cases and deaths. They also help rule out some potential explanations, including demographics, the health of the residents, the levels to which they are insured, have access to food, employed, and have financial resources. After taking into account these possibilities, it is possible that county-level racial attitudes are reflective of systemic forms of racism [49]. From this perspective, racial attitudes captured at the aggregate level represent the bias of crowds [20] and are emblematic of deeper biases that are embedded into systems within society. From this perspective, collective racial attitudes might give rise to racially biased societal arrangements, including those in the area of religion, business, education, criminal justice, and of particular importance to this study, healthcare. Payne et al. further argued that “In addition to functioning as a marker of systemic prejudice, implicit bias can also serve as a mechanism that translates systemic prejudice into individual discrimination” (p. 239). These dynamics would explain why, for example, implicit racial attitudes at the aggregate level are linked with racial differences in police shootings [27], punishments of Black school children [28], and various health-related outcomes [24–26]. The biases are learned and maintained over time such that the inequalities perpetuate. One apt illustration comes in the area of machine learning, where racial inequalities in healthcare over time have resulted in racially biased algorithms used to manage population health [50].
Public health implications
There is still much to learn about the impact of COVID-19 on our nation’s health and wellbeing, which spans multiple dimensions and include more than just our physical health. COVID-19 illness and death continue to illuminate underlying structural inequalities that disproportionately affect racial and ethnic minorities. This pandemic further exposes interpersonal factors that may further exacerbate the disproportionate burden of chronic disease and premature death among US Black people. Our findings underscore the importance of raising awareness about the negative health consequences of explicit racial attitudes and implicit racial attitudes. We contribute to the evidence-base needed to support the need for and inform the development of training programs that will be aimed at increasing culture awareness and sensitivity among health care professionals.
Limitations and future directions
Though our study makes several important contributions, we also note potential limitations. First, the direct effects of explicit racial attitudes and implicit racial attitudes explained 1–2% unique variance beyond the controls, and the interaction terms explained 1% unique variance. Some might consider the effects small. We acknowledge that possibility and also note (a) the direct and interactive effects of explicit racial attitudes and implicit racial bias were on top of a sizeable portion of variance explained by the controls (ranging from 33% to 53%), and (b) the percent variance explained by the moderators is consistent with social science researchers [51]. Second, we had complete data for 26% of the counties in the US, but this also means than we do not have information about the other 74%. The results could, therefore, vary if the additional cases were considered.
Finally, we note several opportunities for future research. First, the scholarship related to and understanding of COVID-19 continues to advance [34], but there is still much to learn. Our county-level approach proved to be efficacious, as we identified factors that contributed to more cases and deaths. The alternative approach is also needed, where researchers identify county- and community-level factors that help mitigate the number of COVID-19 cases and deaths. From a general public health standpoint, we echo Blair and Brondolo’s [23] sentiments, encouraging continued research related to the community-level effects of explicit racial attitudes and implicit racial biases.
References
- 1. Bowleg L. We're not all in this together: On COVID-19, intersectionality, and structural inequality. Am J Public Health. 2020;110(7):917. pmid:32463703
- 2. Coughlin SS, Moore JX, George V, Johnson JA, Hobbs J. COVID-19 Among African Americans: From preliminary epidemiological surveillance data to public health action. Am J Public Health. 2020;110(8):1157–1159. pmid:32639918
- 3. Hsu HE, Ashe EM, Silverstein M, et al. Race/Ethnicity, Underlying Medical Conditions, Homelessness, and Hospitalization Status of Adult Patients with COVID-19 at an Urban Safety-Net Medical Center—Boston, Massachusetts, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(27):864–869. Published 2020 Jul 10. pmid:32644981
- 4. Selden TM, Berdahl TA. COVID-19 And Racial/Ethnic Disparities In Health Risk, Employment, And Household Composition [published online ahead of print, 2020 Jul 14]. Health Aff (Millwood). 2020;101377hlthaff202000897. pmid:32663045
- 5. Lassale C, Gaye B, Hamer M, Gale CR, Batty GD. Ethnic disparities in hospitalisation for COVID-19 in England: The role of socioeconomic factors, mental health, and inflammatory and pro-inflammatory factors in a community-based cohort study [published online ahead of print, 2020 Jun 1]. Brain Behav Immun. 2020;S0889-1591(20)31101-6.
- 6. O'Brien R, Neman T, Seltzer N, Evans L, Venkataramani A. Structural racism, economic opportunity and racial health disparities: Evidence from U.S. counties. SSM Popul Health. 2020;11:100564. Published 2020 Mar 9. pmid:32195315
- 7. Shah M, Sachdeva M, Dodiuk-Gad RP. COVID-19 and racial disparities. Journal of the American Academy of Dermatology. 2020 Jul 1;83(1):e35. pmid:32305444
- 8. Cunningham GB, Ahn NY. Moderation in sport management research: Room for growth. Measurement in Physical Education and Exercise Science. 2019 Oct 2;23(4):301–13.
- 9. Harris RB, Stanley J, Cormack DM. Racism and health in New Zealand: Prevalence over time and associations between recent experience of racism and health and wellbeing measures using national survey data. PLoS One. 2018;13(5):e0196476. Published 2018 May 3. pmid:29723240
- 10. Williams DR, Lawrence JA, Davis BA. Racism and Health: Evidence and Needed Research. Annu Rev Public Health. 2019;40:105–125. pmid:30601726
- 11. Crandall CS, Eshleman A, O'Brien L. Social norms and the expression and suppression of prejudice: the struggle for internalization. J Pers Soc Psychol. 2002;82(3):359–378. pmid:11902622
- 12.
Allport GW. The Nature of Prejudice. New York: Addison. 1954. https://doi.org/10.1037/h0062678 pmid:13204492
- 13.
Stephens-Davidowitz S. Everybody lies: Big data, new data, and what the Internet reveals about who we really are. 2017. New York, NY: Dey Street Books. https://doi.org/10.1016/j.socscimed.2017.04.019 pmid:28454665
- 14.
Blair IV, Dasgupta N, & Glaser J. Implicit attitudes. In Mikulincer M. & Shaver P. R. (Eds.), APA handbook of personality and social psychology (pp. 665–691). 2015. Washington DC: American Psychological Association.
- 15. Hahn A, Judd CM, Hirsh HK, Blair IV. Awareness of implicit attitudes. Journal of Experimental Psychology: General. 2014 Jun;143(3):1369. pmid:24294868
- 16. Son Hing LS, Chung-Yan GA, Hamilton LK, & Zanna MP. A two-dimensional model that employs explicit and implicit attitudes to characterize prejudice. Journal of Personality and Social Psychology. 2008; 94(6): 971–987. pmid:18505312
- 17. Pearson AR, Dovidio JF, & Gaertner SL. The nature of contemporary prejudice: Insights from aversive racism. Social and Personality Psychology Compass. 2009; 3(3): 314–338. https://doi.org/10.1111/j.1751-9004.2009.00183.x
- 18. Oswald FL, Mitchell G, Blanton H, Jaccard J, Tetlock PE. Predicting ethnic and racial discrimination: a meta-analysis of IAT criterion studies. J Pers Soc Psychol. 2013;105(2):171–192. pmid:23773046
- 19. Payne BK, Vuletich HA, Lundberg KB. Flipping the script on implicit bias research with the bias of crowds. Psychological Inquiry. 2017a;28(4):306–311. https://doi.org/10.1080/1047840x.2017.1380460
- 20. Payne BK, Vuletich HA, & Lundberg KB. The bias of crowds: How implicit bias bridges personal and systemic prejudice. Psychological Inquiry. 2017b; 28(4): 233–248. https://doi.org/10.1080/1047840x.2017.1335568
- 21. Hall WJ, Chapman MV, Lee KM, et al. Implicit Racial/Ethnic Bias Among Health Care Professionals and Its Influence on Health Care Outcomes: A Systematic Review. Am J Public Health. 2015;105(12):e60–e76. pmid:26469668
- 22. Zestcott CA, Blair IV, Stone J. Examining the Presence, Consequences, and Reduction of Implicit Bias in Health Care: A Narrative Review. Group Process Intergroup Relat. 2016;19(4):528–542. pmid:27547105
- 23. Blair IV, Brondolo E. Moving beyond the individual: Community-level prejudice and health. Soc Sci Med. 2017;183:169–172. pmid:28473163
- 24. Orchard J, Price J. County-level racial prejudice and the black-white gap in infant health outcomes. Soc Sci Med. 2017;181:191–198. pmid:28404321
- 25. Leitner JB, Hehman E, Ayduk O, Mendoza-Denton R. Blacks' Death Rate Due to Circulatory Diseases Is Positively Related to Whites' Explicit Racial Bias. Psychol Sci. 2016a;27(10):1299–1311. pmid:27557618
- 26. Lee Y, Muennig P, Kawachi I, Hatzenbuehler ML. Effects of Racial Prejudice on the Health of Communities: A Multilevel Survival Analysis. Am J Public Health. 2015;105(11):2349–2355. pmid:26378850
- 27. Hehman E, Flake JK, Calanchini J. Disproportionate use of lethal force in policing is associated with regional racial biases of residents. Social Psychological and Personality Science. 2018 May;9(4):393–401.
- 28. Riddle T, Sinclair S. Racial disparities in school-based disciplinary actions are associated with county-level rates of racial bias. Proceedings of the National Academy of Sciences. 2019 Apr 23;116(17):8255–60. pmid:30940747
- 29. Watanabe NM, Cunningham GB. The impact of race relations on NFL attendance: An econometric analysis. Plos one. 2020 Jan 24;15(1):e0226938. pmid:31978050
- 30. Leitner JB, Hehman E, Ayduk O, Mendoza-Denton R. Racial bias is associated with ingroup death rate for Blacks and Whites: Insights from Project Implicit. 2016b; Soc Sci Med. 2016;S0277-9536(16)30566-4. pmid:28029402
- 31. O’Shea BA, Watson DG, Brown GD, Fincher CL. Infectious disease prevalence, not race exposure, predicts both implicit and explicit racial prejudice across the United States. Social Psychological and Personality Science. 2020 Apr;11(3):345–55.
- 32. Greenwald AG, McGhee DE, Schwartz JL. Measuring individual differences in implicit cognition: the implicit association test. J Pers Soc Psychol. 1998;74(6):1464–1480. pmid:9654756
- 33. Greenwald AG, Poehlman TA, Uhlmann EL, Banaji MR. Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity. J Pers Soc Psychol. 2009;97(1):17–41. pmid:19586237
- 34. Ssentongo P, Ssentongo AE, Heilbrunn ES, Ba DM, Chinchilli VM. Association of cardiovascular disease and 10 other pre-existing comorbidities with COVID-19 mortality: A systematic review and meta-analysis. PloS one. 2020 Aug 26;15(8):e0238215. pmid:32845926
- 35. Cunningham GB, Wicker P, McCullough BP. Pollution, health, and the moderating role of physical activity opportunities. International Journal of Environmental Research and Public Health. 2020 Jan;17(17):6272.
- 36. Liu J.; Rozelle S.; Xu Q.; Yu N.; Zhou T. Social Engagement and Elderly Health in China: Evidence from the China Health and Retirement Longitudinal Survey (CHARLS). Int. J. Environ. Res. Public Health 2019; 16: 278.
- 37. Gundersen C, Ziliak JP. Food Insecurity and Health Outcomes. Health Aff (Millwood). 2015;34(11):1830–1839. pmid:26526240
- 38. Alkon AH, Bowen S, Kato Y et al. Unequally vulnerable: A food justice approach to racial disparities in COVID-19 cases [published ahead of print]. Agriculture and Human Values. 2020. https://doi.org/10.1007/s10460-020-10110-z
- 39. Sommers BD, Gawande AA, Baicker K. Health Insurance Coverage and Health—What the Recent Evidence Tells Us. N Engl J Med. 2017;377(6):586–593. pmid:28636831
- 40. Woolhandler S, Himmelstein DU. Intersecting U.S. Epidemics: COVID-19 and Lack of Health Insurance. Ann Intern Med. 2020;173(1):63–64. pmid:32259195
- 41. Chen E, Miller GE. Socioeconomic status and health: mediating and moderating factors. Annu Rev Clin Psychol. 2013;9:723–749. pmid:23245339
- 42. Kawohl W, Nordt C. COVID-19, unemployment, and suicide. Lancet Psychiatry. 2020;7(5):389–390. pmid:32353269
- 43. Hopman J, Allegranzi B, Mehtar S. Managing COVID-19 in low-and middle-income countries. Jama. 2020 Apr 28;323(16):1549–50. pmid:32176764
- 44. Liu K, Chen Y, Lin R, Han K. Clinical features of COVID-19 in elderly patients: A comparison with young and middle-aged patients. J Infect. 2020;80(6):e14–e18. pmid:32171866
- 45. Wenham C, Smith J, Morgan R. COVID-19: the gendered impacts of the outbreak. The Lancet. 2020 Mar 14;395(10227):846–8. pmid:32151325
- 46. Nosek B. A., Smyth F. L., Sriram N., Lindner N. M., Devos T., Ayala A., et al. (2009). National differences in gender–science stereotypes predict national sex differences in science and math achievement. Proceedings of the National Academy of Sciences, 106(26), 10593–10597.
- 47.
Cohen J, Cohen P, West SG, & Aiken LS. Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Lawrence Erlbaum. 2003.
- 48.
Hair J., Black W., Babin B., Anderson R.E., Tatham R.L. Multivariate Data Analysis, 6th ed.; Pearson Prentice Hall: Upper Saddle River, NJ, USA, 2010
- 49. Feagin J., 2006. Systemic racism: A theory of oppression. Routledge.
- 50. Obermeyer Z., Powers B., Vogeli C. and Mullainathan S., 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science, 366(6464), pp.447–453. pmid:31649194
- 51. Aguinis H, Beaty JC, Boik RJ, Pierce CA. Effect size and power in assessing moderating effects of categorical variables using multiple regression: a 30-year review. Journal of applied psychology. 2005 Jan;90(1):94. pmid:15641892