Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Perspectives on using decision-making nudges in physician-patient communications

  • Ilona Fridman ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Software, Supervision, Visualization, Writing – original draft

    if2185@columbia.edu

    Affiliation Columbia Business School, Columbia University, New York, NY, United States of America

  • Joanna L. Hart,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Writing – review & editing

    Affiliations Palliative and Advanced Illness Research (PAIR) Center, University of Pennsylvania, Philadelphia, PA, United States of America, Fostering Improvement in End-of-Life Decision Science (FIELDS) Program, University of Pennsylvania, Philadelphia, PA, United States of America, Center of Health Incentives and Behavioral Economics (CHIBE), University of Pennsylvania, Philadelphia, PA, United States of America, Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, United States of America, Division of Pulmonary, Allergy, and Critical Care Medicine, University of Pennsylvania, Philadelphia, PA, United States of America, Department of Medical Ethics and Health Policy, University of Pennsylvania, Philadelphia, PA, United States of America

  • Kuldeep N. Yadav,

    Roles Data curation, Formal analysis, Validation, Visualization, Writing – review & editing

    Affiliations Palliative and Advanced Illness Research (PAIR) Center, University of Pennsylvania, Philadelphia, PA, United States of America, Fostering Improvement in End-of-Life Decision Science (FIELDS) Program, University of Pennsylvania, Philadelphia, PA, United States of America, Center of Health Incentives and Behavioral Economics (CHIBE), University of Pennsylvania, Philadelphia, PA, United States of America, Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, United States of America

  • E. Tory Higgins

    Roles Data curation, Funding acquisition, Resources, Supervision, Validation, Writing – review & editing

    Affiliations Columbia Business School, Columbia University, New York, NY, United States of America, Department of Psychology, Columbia University, New York, NY, United States of America

Abstract

Patients engaging in shared decision making must weigh the likelihood of positive and negative outcomes and deal with uncertainty and negative emotions in the situations where desirable options might not be available. The use of “nudges,” or communication techniques that influence patients’ choices in a predictable direction, may assist patients in making complex decisions. However, nudging patients may be perceived as inappropriate influence on patients’ choices. We sought to determine whether key stakeholders, physicians, and laypersons without clinical training consider the use of nudges to be ethical and appropriate in medical decision making. Eighty-nine resident-physicians and 336 Mechanical-Turk workers (i.e., non-clinicians) evaluated two hypothetical preference-sensitive situations, in which a patient with advanced cancer chooses between chemotherapy and hospice care. We varied the following: (1) whether or not the patient’s decision was influenced by a mistaken judgment (i.e., decision-making bias) and (2) whether or not the physician used a nudge. Each participant reported the extent to which the communication was ethical, appropriate, and desirable. Both physicians and non-clinicians considered using nudges more positively than not using them, regardless of an initial decision-making bias in patients’ considerations. Decomposing this effect, we found that physicians viewed the nudge that endorsed hospice care more favorably than the nudge that endorsed chemotherapy, while non-clinicians viewed the nudge that endorsed chemotherapy more favorably than the nudge that endorsed hospice care. We discuss implications and propose exploring further physicians’ and patients’ differences in the perception of nudges; the differences may suggest limitations for using nudges in medical decisions.

Introduction

Patients engaging in shared decision making often struggle to match available treatment options with their own goals and preferences. These decisions may be influenced by predictable cognitive errors that negatively impact patient well-being. Research in behavior economics has demonstrated that, while making decisions, individuals can assign different weights to losses and corresponding gains, imperfectly predict future preferences, and inaccurately remember their past experiences [1]. Providing relevant information might not be enough to prevent harmful decisions. For example, studies have demonstrated that calorie labeling was not effective in reducing calories intake [2]. To assist patients in navigating decision-making processes and counteract cognitive errors, physicians may be able to use “nudges,” or communication strategies with predictable effects on the resulting patient choice, [3].

Nudges are the aspects of choice architecture or a communication that alters behavior in a predictable way without changing the outcomes of available options or restricting individual’s ability to choose [4]. A well-explored nudge is setting default options. Default enrollment means that individuals are automatically included in a program. At the same time, they may quit the program easily if they want. For example, in some DMV offices in the U.S., individuals are enrolled in an organ donation program automatically when they receive a driving license. To ensure individuals’ freedom of choice, DMV officers inform everyone that they are free to dis-enroll from the program. This and other default nudges substantially increase participation in various programs [59]. However, given the influential power of nudges, physicians’ use of such communication strategies that influence patients’ choice in a predictable way may be evaluated as unethical persuasion [1013]. Specifically, some might consider nudges as adversely influencing patients’ ability to choose according to their own preferences.

Researchers argue that nudges relating to preventive medicine might be acceptable because it is often clear which option has a positive outcome for patients. Nonetheless, the use of nudges in preference-sensitive decisions, such as end-of-life care, raises strong ethical concerns and requires empirical investigation [14]. Evidence of how key stakeholders, such as patients and physicians, view physicians’ use of nudges is limited. In this study, we aim to investigate how non-clinicians (i.e., potential patients) and physicians perceive the use of nudges in preference-sensitive, end-of-life decisions.

Additionally, nudges often are considered as a tool to correct individuals’ biases [15, 16]. It might be that, when biases (i.e., cognitive error) are present in patients’ judgments, physicians and non-clinicians would consider nudging to be more ethical, appropriate and desirable. To explore this possibility, we randomly informed some participants that a patient had a bias in the initial judgment. We expected that participants who were informed about the bias might perceive nudges more positively than these who were not informed about the bias.

Methods

We conducted an experimental study among non-clinicians and resident-physicians. Non-clinicians were reached via a Mechanical Turk (Mturk) online panel in July 2016. Mturk is an online labor market in which participants produce psychometrical data [17, 18] . Recent studies have shown that up to 85% Mturk workers produce valid responses [19].

Physicians in their final year of residency at a single health care system were identified through the websites and staff directories. They received a link to the electronic survey via their professional emails, followed by three reminders at the most, from September 2016 to November 2016. Both Mturk participants and resident physicians received compensation for their participation. The study was approved by the University of Pennsylvania Institutional Review Board. Participants were 18 years of age or older. A written form of informed consent was waived by IRB. Participants instead read an informational sheet online before entering the survey. They were informed about study procedures, confidentiality of individual responses and that their participation was voluntary. After reading the information about the study, participants were asked if they agree to take part in the survey. These who agreed were allowed to proceed to the survey.

Designed in Qualtrics, the survey consisted of two decision-making vignettes describing patients deciding between chemotherapy and hospice care for incurable cancer. Two attributes of each vignette varied randomly among participants, see Table 1: (1) whether or not the patient initially made a choice based on a mistaken judgment (decision-making bias) and (2) whether or not the physician used a decision-making nudge (e.g., information framing and social comparisons) when communicating with the patient (for details see Table 1). Both vignettes stated explicitly that if the physician uses a decision-making nudge it will increase the likelihood that the patient would follow the advice. After each vignette, participants evaluated the ethics of the communications in several dimensions including, desirability, appropriateness, patients’ autonomy and others, described below. Both vignettes and dependent variables are reported verbatim in supplementary materials (see S1 and S2 Tables)

Materials and measures

Nudges.

We chose to explore the nudges that influence individuals’ without their conscious awareness about the nudge or influence. These nudges are considered to be more controversial than nudges that appeal to individuals’ deliberative thinking [20]. In the first vignette, we used an information framing to nudge a person to reconsider his initial opinion [3]. In the second vignette, we used social comparison to nudge the patient to agree for chemotherapy [21]. In both vignettes, if patients experienced a nudge, they were neither informed nor aware that the nudge would increase the probability that they would agree with physicians’ advice.

Decision-making bias.

In Vignette 1, for those participants who we informed about the patient’s bias, we stated that patients’ judgments are based on an optimistic bias, which is patients’ tendency to be overly optimistic about treatments’ outcomes [22]. Participants were randomly assigned either to a “no information” condition (no bias condition) or to read the following (informed bias condition): “overestimating the power of chemotherapy, the patient fully believes that chemotherapy will help him live longer and even cure his cancer.” In Vignette 2, we utilized availability bias that is patients’ tendency to base their judgments on one single event in the past [11, 23]. Participants were randomly assigned either to no information (no bias condition) or to read the following (informed bias condition): “During the consultation, she [patient] tells her physician that she did not choose chemotherapy because she is afraid of its “horrible” side effects. She explains that her friend told her that chemotherapy causes terrible pain and a burning sensation in the blood vessels”.

Evaluation of communications.

Participants’ evaluation of communications included several components, reported in Table 2. Participants rated their agreement with each statement on a 7-point Likert scale (1 = strongly disagree, 7 = strongly agree). The first component included ethics of communications. It consisted of a statement: “the physician communication was ethical.” The second component measured the acceptability of communications (reversed), “the physician communication was unacceptable (reversed).” The desirability component was measured with the following question for non-clinicians, “I would prefer that my physician acts this way,” and with the following question for clinicians, “I would use this approach in a similar situation” Ethics, acceptability and desirability components were adopted from a prior study that evaluated ethics of clinical communications [24].

The effectiveness of nudges has been shown to be an important aspect in how individuals evaluate behavioral nudges [25]. Thus, another component in the study assessed the effectiveness of communications, with the following two statements: “The physician did the best she/he could for this patient,” and “The physician should have tried harder to help the patient make a decision (reversed)”.

Participants also rated to what extent the patient in the vignette would trust his/her physician after the described communication. This component was included following the work of Tannenbaum [26], who demonstrated that trust in the source of a nudge influences how individuals evaluate the nudge. Finally, we included four statements that reflected principles of medical ethics: autonomy (2-items, one reversed), respect to a patient, and benevolence (American Medical Association Code of Ethics).

The list of the questions and Cronbach’s α are included in Table 2.

Data analysis

Comparing evaluations within each population.

We used comparative statistics to examine physicians’ and non-clinicians’ evaluations of each vignette. The ratings by physicians and non-clinicians were analyzed separately with MANOVA analysis. This method allowed us to test several dependent variables accounting for multiple comparison and interrelations between the variables. The following interaction was tested 2 (patient’s initial bias: present; absent) x 2 (physician’s decision about nudge use: yes; no). We repeated the same analysis for each population separately.

Comparing evaluations between participants’ populations.

We included the ratings by both the physicians and the non-clinicians to compare whether their evaluations were different within each vignette. To reduce the complexity of the analysis, only participants who were randomized to read the vignettes describing the physician using the nudge were included in this analysis. The following interaction 2 (patient’s initial bias: present; absent) x 2 (participants: physicians; non-clinicians) was tested with the MANOVA procedure. It is important to note that the same analysis among those who read the vignettes without the nudge revealed the patterns supporting the finding of this analysis.

Results

Sample

In total, 336 non-clinicians and 89 resident physicians completed the survey. The response rate among resident physicians was 56%. The participants’ demographics are in Table 3; physicians’ specialties are included in Table 4.

thumbnail
Table 3. Demographic characteristics of physicians and non-clinicians.

https://doi.org/10.1371/journal.pone.0202874.t003

Comparing evaluations within each population

Non-clinicians’ judgment.

First, we ran the analysis for each component separately by vignette and by population. The MANOVA results indicated a non-significant main effect of the presence/absence of decision-making bias in the non-clinicians’ judgments (Vignette 1: p = .68; Vignette 2: p = .77) and the non-significant effect of the interaction between bias x nudge (Vignette 1: p = .07; Vignette 2: p = .76). However, there was a significant effect of whether nudge was present (Vignette 1: F(8, 325) = 16.10, p < .001; Vignette 2: F(8, 325) = 33.81, p < .001), suggesting that non-clinicians perceived using decision-making nudges more positively than not using them, regardless of whether the patient in the vignette demonstrated a decision-making bias. Importantly, in the vignette1 (hospice endorsement), there was no difference in patients’ evaluations of autonomy. If the nudge was present, participants evaluated patients’ autonomy the same as participants in our baseline group, which did include nudge or bias. The results for both vignettes are presented in Table 5.

thumbnail
Table 5. Non-clinicians’ evaluations of communications by domain.

https://doi.org/10.1371/journal.pone.0202874.t005

Physicians’ judgments.

Second, we ran the same analysis for the physician population. Similarly, as in non-clinician population, the MANOVA test revealed a non-significant main effect of the interaction between bias and nudge (Vignette 1: p = .83; Vignette 2: p = .45). In the analysis of Vignette 1, we found a significant effect of bias (F(8, 78) = 2.15, p = .04). These results indicated that physicians evaluated communications as more acceptable and trustworthy if bias was absent. These relationships were not influenced by presence or absence of the nudge. This effect was not observed in the second Vignette (p = .73).

Like the non-clinician population, physicians evaluated the communications more positively when they used decision-making nudges than when they did not use them, (Vignette 1: F(8, 78) = 16.09, p < .001; Vignette 2: F(8, 78) = 7.42, p < .001), regardless of whether the patient in the vignette demonstrated a decision-making bias. Results for both vignettes are presented in Table 6.

thumbnail
Table 6. Physicians’ evaluations of communications by domain.

https://doi.org/10.1371/journal.pone.0202874.t006

Comparing evaluations between participants’ populations

Vignette 1.

To compare physicians’ and patients’ evaluations of nudges, we included the data from both physicians and non-clinicians. In the first analysis, we included physicians and non-clinicians who read Vignette 1 with the nudge and hospice endorsement. MANOVA analysis revealed that there was no effect of the decision-making bias on participants’ evaluations (Vignette 1: p = .35) and there was no effect of the interaction between bias and populations of non-clinicians/physicians (Vignette 1: p = .58). However, there was the main effect of the populations’ evaluations (Vignette 1: F(8, 203) = 2.16, p = .032), indicating that physicians evaluated nudges endorsing hospice more positively than non-clinicians, independently of whether a decision-making bias was present. Uncovering this analysis, we found that physicians evaluated nudges more favorably in 6 out of 8 domains. In two domains, benevolence and effectiveness, the ratings of the non-clinicians and the physicians did not differ. Table 7 summarizes the statics by all domains.

thumbnail
Table 7. Comparing physicians’ and patients’ evaluations of the communication, in which hospice care was endorsed.

https://doi.org/10.1371/journal.pone.0202874.t007

At the next step, we included age and gender as covariates. MANOVA showed non-significant impact of age (p = .13) and gender (p = .14) on the dependent variables. After we included covariates the analysis showed similar results to the main analysis reported above. There was no significant main effect of a bias or bias x population interaction. However the main effect of populations remained significant (F(8, 201) = 2.99, p < .01), suggesting that physicians evaluate the nudge more positively in this situation.

Vignette 2.

In the next analysis, we included physicians and non-clinicians who read Vignette 2 with the nudge and chemotherapy endorsement. The MANOVA analysis revealed that there was no effect of the bias on participants’ evaluations (Vignette 2: p = .41), and there was no effect of the interaction between bias and population of non-clinicians/physicians (Vignette 2: p = .59). However, there was the main effect of the populations’ evaluations (Vignette 2: F(8, 201) = 3.25, p = .002), indicating that non-clinicians evaluated nudges endorsing chemotherapy more positively than physicians. Non-clinicians evaluated 6 out of 8 domains more favorably than clinicians. Both populations evaluated acceptability and trust similarly. Table 7 summarizes the results by domain.

In the next analysis, we included age and gender as covariates. MANOVA showed a marginal effect of age (F(8, 199) = 1.91, p = .07). Uncovering, this effect we found that older individuals tended to evaluate nudges more positively. The gender covariate significantly influenced the dependent variables (F(8, 199) = 2.27, p = .02), suggesting that male participants evaluated nudges more positively than female participants. Notably, when we included age and gender as covariates, the analysis showed similar results to the main analysis reported above. There was no significant main effect of a bias or bias x population interaction. However the main effect of populations remained significant (F(8, 199) = 3.09, p < .01) suggesting that in this case, non-clinicians evaluated nudges more positively.

Discussion

These results demonstrate that physicians and non-clinicians generally view physicians’ use of decision-making nudges to be ethical, acceptable, and desirable in end-of-life decision making. These findings add to prior evidence that stakeholders view nudges as ethical, acceptable, and desirable [13, 25] by expanding this evidence to clinical situations in which there is a less clear “best choice” for patients. Both physicians and non-clinicians evaluated nudges positively even in the absence of patients’ having a decision-making bias. In practice, key stakeholders will likely perceive nudges in complex and preference-sensitive clinical decisions to be helpful and appropriate.

Beyond this general conclusion, our research suggest several important steps that could contribute to ensuring that physicians and patients would consider behavioral nudges favorably in clinical settings.

First, while assessing the perceptions of nudges, patients’ autonomy should be evaluated as a standalone concept. We found that non-clinicians and physicians perceived autonomy of communications differently than other components of ethics. Non-clinicians in Vignette 1 and physicians in Vignette 2 rated patients’ autonomy similarly when there was or was not nudging. Nudging was not perceived as a threat to patients’ autonomy in our study. However, in other cases, nudges might be evaluated as ethical and acceptable but still be perceived as a threat to individuals’ autonomy (e.g., nudging Jehovah's Witnesses for blood transfusion). To identify such cases, it is important to include the autonomy component in future research that aims to access patients and physicians’ perceptions of nudges.

Second, before nudges are implemented, it is important to obtain the perspectives on nudging among all communicators. The comparison of views between those who influence (physicians) and those who experience the influence (non-clinicians) did reveal important differences in the degree to which each population endorsed the use of nudges as a function of the particular kind of clinical option that was being considered. Physicians supported nudges that promoted hospice care more than did non-clinicians, whereas non-clinicians supported nudges that promoted chemotherapy more than did physicians. These findings are consistent with two lines of prior research. First, physicians are more likely than patients to choose less aggressive care in the setting of advancing illness [27]. Second, individuals support nudges more when they are consistent with their views [13]. Physicians’ greater support of nudges that endorse hopsice care and patients’ greater support of nudges that endorse chemotherapy provides additional evidence that individuals tend to favor nudges if their influence is consistent with their values. Further research should explore whether physicians would consistently support nudges promoting comfort-oriented care more strongly than non-clinicians, as this may be an important limitation to the use of nudges in clinical care.

Third, decision-making bias in patients’ judgments might have little or no influence on the evaluation of nudges in communications. We expected that participants would evaluate nudges more positively if nudges counteract a decision-making bias in patients’ judgments. However, we did not find this to be the case. Providing information about patients’ biases did not influence participants’ evaluations of nudges. However, one possibility is that most participants’ assumed such bias was present, regardless of this information. Thus, inherent in the reported perception of nudges may be the role of nudges in overcoming bias. More research is needed to deepen our understanding of the theoretical relation between the inferred decision-making bias of patients and viewing favorably the nudging of patients. Perceptions of nudges might be less favorable if participants learn that patients carefully weighed the pros and cons of each option, while formulated their preferences.

This study has several limitations. First, we tested only the nudges of information framing and social comparison. Stakeholders’ views of nudges are known to vary by type, although the types of nudges we tested have been viewed as more controversial than others [20]. Second, participants evaluated vignettes sequentially, which may have influenced their ratings of the second vignette. To address this problem, we randomized aspects of each vignette independently within each participant. The difference in the vignette evaluations between the participants’ populations signals that the sequence has a minimal impact on participants’ rating. Third, this study includes hypothetical vignettes that reduces the complexity of actual decision making. Fourth, responses from the non-clinician population were collected via the Mturk on-line panel. While there is evidence to suggest that Mturk participants provide reliable behavioral data [17, 18, 28], further research should address both the third and fourth limitations by collecting data among people who are actually dealing with the decisions described in our vignettes. Fifth, “effectiveness” and “autonomy” variables consisted of two averaged items each. The alfa coefficients were relatively low, suggesting that there is potential noise in the responses. That requires additional caution in interpreting results and further research to address this limitation.

Comparing participants’ populations, we found that age and gender were significant predictors of participants’ evaluations in the second vignette. While these results did not influence our main story, further investigation is needed. It would be interesting to address the issue of why and when older participants are more likely to evaluate nudges more positively. Considering gender, it might be that female participants for the second vignette view nudges less favorably than male participants because the gender of the patients was explicitly female. It is difficult to know, but there was not some simple “similarity” effect because the gender of the patients in the first vignette was explicitly male, and there was no evidence that the male participants viewed nudges less favorably than female participants. Nonetheless, in future studies the gender of participants should be taken into account.

Conclusion

We found that key stakeholders in medical decision making support the use of nudges by physicians to promote choices that are intended to serve patients’ best interests. Our findings expand prior research supporting the use of nudges by confirming positive views of communication nudges even in complex, end-of-life decision making. Further research should explore stakeholders’ views of nudges when applied to actual clinical settings and examine the effects of nudges on choices and patient outcomes. If acceptable and effective, nudges may be an important decision-making tool to improve the alignment of treatment choices with true patient preferences.

References

  1. 1. Redelmeier DA, Rozin P, Kahneman D. Understanding patients' decisions: cognitive and emotional perspectives. JAMA, 1993;270(1): 72–76. pmid:8510300
  2. 2. Elbel B, Kersh R, Brescoll VL, Dixon LB., Calorie labeling and food choices: a first look at the effects on low-income people in New York City. Health affairs, 2009;28(6): 1110–1121.
  3. 3. Fridman I, Scherr KA, Glare PA, Higgins ET. Using a non-fit message helps to de-intensify negative reactions to tough advice. Personality and Social Psychology Bulletin. 2016;42(8): 1025–1044. pmid:27341845
  4. 4. Thaler RH, Sunstein CR. Nudge: Improving decisions about health, wealth, and happiness Yale University Press, New Haven, CT, 2008. p.6.
  5. 5. Halpern SD, Loewenstein G, Volpp KG, Cooney E, Vranas K, Quill CM, et al. Default options in advance directives influence how patients set goals for end-of-life care. Health Affairs. 2013;32(2): 408–417. pmid:23381535
  6. 6. Rolls BJ, Roe LS, Meengs JS. Reductions in portion size and energy density of foods are additive and lead to sustained decreases in energy intake. The American journal of clinical nutrition, 2006;83(1): 11–17. pmid:16400043
  7. 7. Johnson EJ, Goldstein D. Do defaults save lives? Science, 2003;302(5649): 1338–1339. pmid:14631022
  8. 8. Madrian BC, Shea DF. The power of suggestion: Inertia in 401 (k) participation and savings behavior. The Quarterly journal of economics. 2001;116(4): 1149–1187.
  9. 9. Dinner I, Johnson EJ, Goldstein DG, Liu K. Partitioning default effects: Why people choose not to choose. Journal of Experimental Psychology: Applied. 2011;17(4): 332–341. pmid:21707203
  10. 10. Ploug T, Holm S. Doctors, patients, and nudging in the clinical context—four views on nudging and informed consent. The American Journal of Bioethics. 2015;15(10): 28–38. pmid:26479099
  11. 11. Blumenthal-Barby J. Biases and heuristics in decision making and their impact on autonomy. The American Journal of Bioethics, 2016;16(5): 5–15. pmid:27111357
  12. 12. Halpern SD. Judging nudges. The American Journal of Bioethics, 2016;16(5): 16–18. pmid:27111358
  13. 13. Sunstein, CR. Do people like nudges? 2016. Available from: https://dash.harvard.edu/bitstream/handle/1/16147874/likenudges5_8%5B2%5D.pdf?sequence=1
  14. 14. Matjasko JL, Cawley JH, Baker-Goering MM, Yokum DV. Applying behavioral economics to public health policy: illustrative examples and promising directions. American journal of preventive medicine. 2016;50(5): 13–19.
  15. 15. Loewenstein G, Brennan T, Volpp KG. Asymmetric paternalism to improve health behaviors. Jama. 2007;298(20): 2415–2417. pmid:18042920
  16. 16. Blumenthal-Barby JS, Cantor SB, Russell HV, Naik AD, Volk RJ. Decision aids: when ‘nudging’patients to make a particular choice is more ethical than balanced, nondirective content. Health Affairs. 2013;32(2): 303–310. pmid:23381523
  17. 17. Buhrmester M, Kwang T, Gosling SD. Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on psychological science. 2011;6(1): 3–5. pmid:26162106
  18. 18. Paolacci G, Chandler J. Inside the Turk: Understanding Mechanical Turk as a participant pool. Current Directions in Psychological Science. 2014;23(3): 184–188.
  19. 19. Kim HS, Hodgins DC. Reliability and validity of data obtained from alcohol, cannabis, and gambling populations on Amazon’s Mechanical Turk. Psychology of Addictive Behaviors. 2017;31(1): 85–94. pmid:27893213
  20. 20. Felsen G, Castelo N, Reiner PB. Decisional enhancement and autonomy: public attitudes towards overt and covert nudges. Judgment & Decision Making. 2013;8(3): 202–213.
  21. 21. Goldstein NJ, Cialdini RB, Griskevicius V. A room with a viewpoint: Using social norms to motivate environmental conservation in hotels. Journal of consumer Research. 2008;35(3): 472–482.
  22. 22. Temel JS, Greer JA, Admane S, Gallagher ER, Jackson VA, Lynch TJ, Lennes IT, Dahlin CM, Pirl WF. Longitudinal perceptions of prognosis and goals of therapy in patients with metastatic non–small-cell lung cancer: Results of a randomized study of early palliative care. Journal of Clinical Oncology. 2011;29(17):2319–2326. pmid:21555700
  23. 23. Dawson NV, Arkes HR. Systematic errors in medical decision making. Journal of General Internal Medicine, 1987;2(3): 183–187. pmid:3295150
  24. 24. Levine E, Hart J, Moore K, Rubin E, Yadav K, Halpern S. The surprising costs of silence: Asymmetric preferences for prosocial lies of commission and omission. Journal of personality and social psychology. 2018;114(1): 29–51. pmid:29094962
  25. 25. Jung JY, Mellers BA. American attitudes toward nudges. Judgment & Decision Making. 2016;11(1): 62–74.
  26. 26. Tannenbaum D, Fox CR, Rogers T. On the misplaced politics of behavioral policy interventions. Nature Human Behavior. 2017;1(7): 0130.
  27. 27. Gramelspacher GP, Zhou XH, Hanna MP, Tierney WM. Preferences of physicians and their patients for end‐of‐life care. Journal of General Internal Medicine. 1997;12(6):346–351. pmid:9192251
  28. 28. Paolacci G, Chandler J, Ipeirotis PG. Running experiments on amazon mechanical turk. Judgment and Decision making, 2010;5(5): 411–419.