https://orcid.org/0000-0003-0655-3047
Figures
Abstract
Aims
This study aims to identify critically important features of digital type two diabetes mellitus (T2DM) prevention interventions.
Methods
A stakeholder mapping exercise was undertaken to identify key end-user and professional stakeholders, followed by a three-round Delphi procedure to generate and evaluate evidence statements related to the critical elements of digital T2DM prevention interventions in terms of product (intervention), price (funding models/financial cost), place (distribution/delivery channels), and promotion (target audiences).
Results
End-user (n = 38) and professional (n = 38) stakeholders including patients, dietitians, credentialed diabetes educators, nurses, medical doctors, research scientists, and exercise physiologists participated in the Delphi study. Fifty-two critical intervention characteristics were identified. Future interventions should address diet, physical activity, mental health (e.g. stress, diabetes-related distress), and functional health literacy, while advancing behaviour change support. Programs should be delivered digitally or used multiple delivery modes, target a range of population subgroups including children, and be based on collaborative efforts between national and local and government and non-government funded organisations.
Citation: Ryan JC, Wiggins B, Edney S, Brinkworth GD, Luscombe-March ND, Carson-Chahhoud KV, et al. (2021) Identifying critical features of type two diabetes prevention interventions: A Delphi study with key stakeholders. PLoS ONE 16(8): e0255625. https://doi.org/10.1371/journal.pone.0255625
Editor: Simone Borsci, Universiteit Twente, NETHERLANDS
Received: February 28, 2021; Accepted: July 20, 2021; Published: August 5, 2021
Copyright: © 2021 Ryan et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data cannot be shared publicly due to the conditions of the ethics approval and potentially identifiable nature of the qualitative data. Interested researchers may apply for access to the data by contacting The Commonwealth Scientific and Industrial Research Organisation Human Research Ethics Committee (chmhrec@csiro.au).
Funding: This work was funded by an internal seed-funding grant provided by the Commonwealth Scientific and Industrial Research Organisation (CSIRO), www.csiro.au and awarded to all authors. The funders played no role in the study design, data collection and analysis, decision to publish, or preparation of this manuscript.
Competing interests: The authors have declared that no competing interests exist.
Background
Growing prevalence of lifestyle-related chronic diseases including Type 2 Diabetes Mellitus (T2DM) has created an enormous need for innovative and effective ways to support people to proactively manage their health [1, 2]. T2DM directly affects about 1 million Australian adults, while a further 2 million are estimated to have pre-diabetes, indicating that they are at significant risk of developing T2DM in the near future [3]. While T2DM can be prevented or reversed by addressing its lifestyle-based antecedents, primarily, overweight or obesity, poor diet, and physical inactivity [4], translating this advice into actionable and effective behaviour change support is an ongoing public health challenge. Health-related behaviours are difficult to change and furthermore, sustaining health behaviour change is even harder, with behavioural changes often reverting to baseline levels over time [5].
Health interventions that harness digital delivery and technologies, such as smartphone apps and wearable trackers, are increasingly used to deliver health behaviour change support for people at risk or with T2DM and other chronic diseases [6]. Such digital approaches offer significant benefits. For example, digital interventions are able to integrate principles of ‘persuasive design’ such as personalisation, gamification, and social influence; as well as behaviour change techniques such as self-monitoring to encourage users to take up behavioural change [7–9]. They also piggyback on existing habitual smartphone and internet use to deliver intense behaviour change support programs. Furthermore, digital health interventions are highly scalable, able to be disseminated to large audiences at minimal cost-per-user, which is of critical importance in context of the growing need for such tools [10]. Taken together, digital health offers enormous potential as a cost-effective means to expand access to care among populations with access to digital technologies which may help to meet some of the growing need for chronic disease support and prevention [6].
Research and development related to digital health solutions for chronic disease is rapidly expanding. Interventions draw upon a wide range of health information technologies, including smartphone apps, intelligent algorithms (e.g. artificial intelligence or AI), continuous glucose monitoring, social media, and the internet more broadly [11]. They may be delivered via websites, smartphones, or text messages, and often seek to supplement clinical care options (e.g. telehealth) or change behaviours through self-monitoring of diet, activity, or glucose levels or through personalised health advice generated using AI [11]. To date, research has generated promising evidence for the efficacy of digital health interventions in controlled trial settings [12]. For example, one study by Spring and colleagues found an m-health intervention targeting multiple behavioural health risk factors was effective in improving activity and diet behaviours to recommended levels, with effects sustained to a 9-month follow up [13]. Digital translations based on the landmark Diabetes Prevention Program intervention [4] have also been shown to be effective in clinical trial conditions, with results sustained for several years in some cases [14, 15].
On the other hand, less is understood about how to best translate digital health solutions into real-world conditions and in ways that engage and meet the needs of diverse stakeholders [6]. Translating and implementing health evidence involves the design of programs that are highly acceptable, effective, and relevant to key stakeholders, including end-user and clinical stakeholders [16]. Achieving this is inhibited by a key limitation of digital health, which is that it is more easily abandoned by the user [17, 18]. Research by Vaghefi and Tulu identified a number of factors that drive abandonment of m-health programs, which included users’ perceptions of design elements (e.g. interface, navigation, and notifications), the depth of knowledge or content available in the app, and clarity of system rules [19]. Furthermore, changes in the individuals’ motivation and persistence also played an important role, with these factors tending to wane over time, leading to abandonment or reduced engagement with the program [19]. From the perspective of clinicians, factors affecting engagement with mobile health (m-health) tools relate more to the usability of such tools including interoperability with current work systems, as well as the influence of peers and whether tools are championed by others and the organisations themselves [20]. The range and complexity of factors affecting engagement with m-health highlight the need for stakeholder engagement in their design and evaluation. These challenges represent the next frontier for digital health, as we move towards the implementation of digital health for chronic disease into policy and practice [21].
Since effective implementation of health evidence is reliant on active support from the target audience, the broad inclusion of relevant stakeholders in multiple stages of research development and translation (i.e. participatory research) can increase the implementation potential of health interventions [22]. As a result, participatory research practices are strongly advocated by leading health authorities as a best-practice approach to evidence translation and implementation [23, 24]. Although full integration of participatory practices into health research is still limited, some studies have highlighted a range of benefits to service provision (e.g. shifts in organisational change, achieving collaboration and mutual learning, capacity building) [20] and translation outcomes [25, 26]. These include more novel and innovative idea generation and creativity and more support and enthusiasm for innovation [27]. Risks associated with failing to engage stakeholders have also been documented, which is considered to be a contributing factor towards high rates of research ‘waste’, including an estimated 50% of clinical trial results being unpublished and duplication of studies including the perpetuation of avoidable design flaws [28]. Participatory research practices can help to address challenges associated with engaging and retaining users and are therefore critical to progressing the impact of digital health into practice and policy [22].
In this participatory study, we worked with key stakeholders to identify key characteristics and needs associated with digital T2DM prevention and self-management solutions in the Australian context. We describe the process of identifying key stakeholders and engaging them in the initial steps of co-generating intervention ideas through a Delphi consensus study. Because T2DM is a serious medical condition that requires clinical support, we placed strong emphasis on the views of both end-user stakeholders (i.e. patients or those at risk of or diagnosed with T2DM) and professional stakeholders (i.e. health practitioners, T2DM managers, scientists and researchers, etc). This study represents the first step in a broader program of research that seeks to demonstrate how co-design can be used to develop interventions and translate them into community and practice. More specifically, the study aims to:
- Stage 1 Stakeholder Mapping. Examine who are the key stakeholders for T2DM prevention and management in Australia and how can they be identified and recruited.
- Stage 2 Delphi Study. Generate innovative ideas and identify key characteristics of future digital health interventions designed to help people with T2DM or pre-diabetes to adopt and sustain health behaviour change.
Methods
This study was approved by the Commonwealth Scientific and Industrial Research Organisation Human Research Ethics Committee (Application #CSIRO_2019_102_LR) and conducted and reported in accordance with Guidance on Conducting and Reporting Delphi Studies [29]. All participants provided informed consent to take part in the study via the online survey. The study took place between September 2019 and June 2020.
Stage 1. Stakeholder mapping and engagement
We followed the stakeholder mapping process described by Schiller et al. [30] in order to identify and recruit a panel of relevant stakeholders. First, two members of the authorship team (J.R. and B.W.) created a list of disciplines relevant to T2DM prevention by collating the academic affiliations of authors and MESH headings of studies included in key relevant systematic reviews [31–34]. Once relevant academic disciplines and topics had been identified, these were extrapolated into professional, clinical, and policy-related roles, following Concannon et al.’s health stakeholder taxonomy structure (see Fig 1); Patients and the Public, Providers, Purchasers, Payers, Policy Makers, Product Makers, and Principal Investigators [35].
Relative importance of each stakeholder was then evaluated based on the perceived likelihood of interest (i.e. how determined an individual in this role is to address T2DM) and perceived strength of influence [30]. Each study author separately rated each stakeholder-type based on these criteria (interested/influential: yes/no) and then came together to discuss which stakeholder-types were of greatest priority.
Stakeholder engagement.
Next, we sought to recruit stakeholders as Delphi study participants. Previous Delphi studies have reported a median of 17 (IQR: 11–31) participants, typically representing 2–3 stakeholder groups [36]. Smaller panels are vulnerable to significant influence from any one panel member and it is important to consider the weight of each respondents’ influence against the criteria for consensus (e.g. 80% must agree, in a panel of ten, one person = 10% of consensus) [37]. Anticipating dropout rates of approximately 20% over three rounds [38], we therefore aimed to recruit 76 stakeholders to ensure we would maintain the minimum sample size required for the study. We targeted two stakeholder categories, end-users (e.g. people at risk of T2DM or diagnosed with pre-diabetes or T2DM) and professional stakeholders (e.g. health practitioners, managers, scientists, etc with at least two years’ experience working in a diabetes-related field). Potential stakeholders were contacted via personalised emails that contained an invitation to take part and a weblink to an online registration survey. All stakeholders were offered an honorarium of $50 AUD upon completion of all three rounds of data collection.
To develop the list of professional stakeholder contacts, a template was prepared outlining all key stakeholder categories and types/roles. Authors were invited to populate the template based on their experience, which was supplemented by online searches as well as searches of the author list of relevant systematic reviews to create a broad list of stakeholders. End-user stakeholders were recruited from a database of previous research participants who had indicated that they would be interested in participating in future studies. To be eligible, end-user stakeholders had to self-identify as having T2DM or pre-diabetes. On the other hand, professional stakeholders were required to have at least two years’ experience working in a diabetes-related role but were not restricted based on any health-related criteria. All eligible participants were at least 18 years old.
Stakeholders.
The stakeholder mapping procedure identified 171 potential participants (121 professional and 50 end-user stakeholders) who were eligible to participate in the Delphi study. A weblink to an initial Expression of Interest (EOI) to participate was emailed to all 171 stakeholders. In total, 112 stakeholders clicked on the EOI and of these, 76 completed the study enrolment procedure and Round One survey instrument (68% acceptance rate). Of these, 61 stakeholders participated in the three Delphi rounds (80% completion rate).
Stage 3: Stakeholder consultation via Delphi study
Stakeholders were consulted on their perceptions of the ideal characteristics of future digital health programs via a three-round classical Delphi study (Fig 3). Delphi studies are a systematic approach to achieving consensus among key stakeholders, to gain insight or clarity in an area of challenge or complexity. The Delphi study was administered via online survey using Survey Gizmo software and each round had a pre-determined and specific purpose (described subsequently). Prior to commencing each survey, stakeholders were instructed to read context-setting information explaining the purpose of the study and to provide definition of key terminology such as pre-diabetes.
Delphi Round One.
The purpose of the Delphi Round One was to generate evidence statements about preferred characteristics of digital T2DM interventions. Via an online survey, participants answered open-ended questions related to the marketing mix (i.e. product, price, place, and promotion, [39]), for example, ‘how should (a digital health T2DM program) be delivered?’. No pre-specified ideas were provided to participants. These were followed by nine questions to capture the respondents’ age, sex, education level; employment status, occupation, and income; diabetes status, and contact information.
Round 1 data was analysed using inductive thematic analysis to group responses in themes [40]. First the data were exported into Microsoft Excel. Following data familiarisation, one author analysed the data by placing each response into broad themes. These categorisations were validated by another author to establish inter-rater reliability. Finally, the remainder of the dataset was categorised, and the evidence statements were then presented to the broader research team for feedback and refinement.
Round Two.
In Round Two stakeholders rated each of the themes or evidence statements generated in Round One using the 9-point Grading of Recommendations, Assessment, Development and Evaluations (GRADE) scale with three categories: not important (1–3), important but not critical (4–6), and critically important (7–9) [41]. Stakeholders were also able to suggest new items or comment on existing items in Round Two.
Definition of consensus. Round Two data were analysed descriptively to determine which evidence statements reached consensus. Evidence statements that reached consensus were automatically passed through to the final round while statements that did not reach consensus were passed through to Round Three for further evaluation. Statements were deemed to have reached consensus when a certain level of group agreement was reached, more specifically, at least 70% of respondents rated an item as ‘critically important’ and no more than 15% of respondents rated that same item as ‘not important’ [42]. Conversely, in the instance that at least 70% of respondents rated an item as ‘not important’ and no more than 15% rated the item as ‘critically important’, items could be deemed unimportant by consensus. Responses and the level of agreement for each statement were analysed separately for the two stakeholder groups.
Round Three.
The aim of Round Three was to provide an opportunity for participants to re-rate statements that did not reach consensus with the objective to increase group consensus about its importance (while recognising that only a small increase in consensus is likely) and to further clarify respondents’ appraisal and importance of each statement [43]. Stakeholders were presented with the statements that had not reached consensus in Round Two as well as additional information about how their participant group (end-user or professional stakeholders) rated each statement. More specifically, the median and range scores and a frequency histogram depicting the spread of scores were provided. An example presented in Fig 2 displays professionals’ ratings of the importance of including supermarket tours in digital T2DM programs (a ‘product’ variable).
Flow of evidence statements throughout study.
Round One identified 66 evidence statements (end-user stakeholders) and 63 statements (professional stakeholders). The flow of evidence statements through Rounds One to Three is depicted in Fig 3. By Round Three, 52 (end-user stakeholders) and 49 (professional stakeholders) statements met group consensus of critical importance while no statements in either group met the criteria for consensus of non-importance.
Results
Participants
A total of 76 stakeholders enrolled in the study. Of these, 38 were end-user stakeholders, 32% of whom were female and 84% of whom were at least 50 years old (see Table 1). Twenty-four percent of the end-user stakeholder group had pre-diabetes while 63% had T2DM and 13% were not sure whether they currently had T2DM or pre-diabetes. In the professional stakeholder group, 76% were female and 47% were at least 50 years old. Occupations of the stakeholders in the scientific/clinical stakeholders group included dietitians (n = 9, 23.7%) managers in relevant organisations (e.g. CEO; n = 6, 15.8%), credentialed diabetes educators (n = 4, 10.5%), data analysts (3, 7.9%), nurses (n = 4, 10.5%), medical doctors/physicians (n = 4, 10.5%), research scientists (n = 4, 10.5%), social workers (n = 2, 5.3%), an exercise physiologist (n = 1, 2.6%), and a pharmacist (n = 1, 2.6%).
Product
The product variable considers what features digital T2DM health interventions should include. Features that promote positive change in the areas of physical activity, diet, mental health (e.g. stress, diabetes-related distress), health literacy, access to health care services, and behaviour change success reached consensus agreement of critical importance in both participant groups (see Table 2). Several additional statements reached consensus agreement of importance in only one of the participant groups. By consensus, end-user stakeholders reported meal plans as critically important to achieving diet change and reported additional funding to cover the cost of medical treatment of critical importance while scientific/clinical stakeholders did not.
Promotion (target audience)
Promotion considers the target audience of the product. End-user and professional stakeholders agreed that specific programs should be developed for the different target audiences, in particular.
- people with pre-diabetes or at high risk,
- people with T2DM,
- adults in general,
- families of people with diabetes, and
- people who live in regional, rural, or remote areas specifically.
Early intervention/health promotion for both children and adults were also identified as critically important by both participant groups.
Place
Place considers where and how the product should be delivered. All groups agreed that programs should be delivered via digital platforms (e.g. website, mobile phone application) and/or via a mixture of delivery approaches, depending on context. In addition, professional, but not end-user stakeholders, considered it critically important that interventions have face-to-face components. Conversely, end-user stakeholders, but not professional stakeholders, considered it critically important that interventions are delivered via school-based programs.
Price
Stakeholders were asked who should fund the provision of T2DM prevention programs. Both groups agreed that such programs should be funded by a combination of stakeholders, reflecting demand for co-funded arrangements that include input from both the Federal and State governments and the contribution of in-kind provision of evidence (e.g. by scientific organisations and universities) or program delivery (e.g. non-governmental organisations like Diabetes Australia). Furthermore, the end-user but not professional stakeholder group considered that programs should be funded by a range of other entities including not-for-profit organisations, universities, and stakeholders; while scientific/clinical stakeholders thought that local government and councils should fund such programs.
Discussion
This study used stakeholder mapping combined with a three-round Delphi study to identify critically important characteristics of digital T2DM prevention interventions. The Delphi consultation process identified at least 52 characteristics considered critically important by consensus within the two groups of stakeholders. Key findings include firstly, that digital tools are needed to help the target population to improve their physical activity levels, diet, mental health, and functional health literacy, which includes their ability to manage their health and knowledge of health care systems. Secondly, programs are needed that incorporate behaviour change techniques that seek to increase self-efficacy for change, as well as measures to address environmental limitations on health behaviours (e.g. lack of walking paths). Thirdly, it is critically important that programs target people who are at-risk of T2DM before they develop T2DM (primary prevention). In addition, vulnerable groups such as those who live in rural and regional remote areas require tailored programs that differ from those targeting the general population. Finally, programs are needed that are entirely or partially delivered via digital means.
Comparison with previous literature
Similar to previous research [44] this study uncovered some novel findings while also confirming some commonly-accepted arguments within chronic disease prevention. Our finding that future T2DM prevention programs should target physical activity, diet, psychological health, health literacy, access to healthcare services and behavioural change was consistent with a similar study conducted in the UK. In that research, participants living with T2DM sought assistance with diet and physical activity, support for self-management strategies, assistance in understanding in-depth or complex information in an intervention [44].
A strong theme that ran through participant responses was the need for tools that help to boost health literacy in patients with pre-diabetes. Previous research has similarly highlighted uncertainty associated with the diagnosis of pre-diabetes and what was going to happen to patients as a major source of stress for people with pre-diabetes [45]. Although health literacy is a well-known determinant of health and predictor of chronic diseases, conventional operationalisations of health literacy within diabetes interventions have had a strong focus on health education about disease self-management and lifestyle factors [46] as well as health literacy and numeracy [47], without addressing the broader contextual, practical, and functional aspects of health literacy identified in this study, which are also part of more contemporary health literacy frameworks [48]. Functional health literacy, as described by Osborne and colleagues, contains nine conceptually distinct areas of health literacy, such as ‘having sufficient information to manage my health’, ’feeling understood and supported by healthcare providers’, and ’ability to actively engage with healthcare providers’ [48]. Educational interventions are essential to patients’ ability to seek further support, understand the health care system, and take steps to change their lifestyles, which have significant implications for health outcomes.
In Australia, pre-diabetes is often approached in a watch-and-wait approach with limited health behaviour change support offered, which is contributing to high rates of progression to T2DM. A limited set of national and state-based T2DM education tools are available, many of which are based upon evidence-based interventions such as the DESMOND model [46]. The National Diabetes Services Scheme (NDSS), for example, offers a ‘Type 2 Diabetes and Me’ free online course (https://www.ndss.com.au/services/support-programs/), as well as support programs and information sessions. However, few of these programs are specific to pre-diabetes and furthermore it is not clear or visible to the end-user stakeholder whether current offerings were developed on a foundation of meaningful community engagement, which can limit community uptake of such programs [49]. Community-driven initiatives that support the unique health literacy support needs of people with pre-diabetes and are visibly stakeholder-driven remain a promising area for research to improve the translational impact of T2DM prevention education initiatives.
In terms of program delivery, our results indicate that while professional stakeholders group considered face-to-face interactions (either group-based or one on one) as critically important, end-user stakeholders did not. This is interesting in comparison with previous research where adults with T2DM in Europe expressed a desire for interactive, face-to-face treatment and lifestyle support intervention [50]. It is possible that the COVID-19 pandemic has accelerated clinical implementation and subsequent adoption and acceptance of e-health and telephone clinical services, which may have also contributed to high demand for digital services detected in our study. In the future, digital and face-to-face clinical services need to co-exist in blended models as one is not a complete solution.
Stakeholder engagement: Lessons learned
Study acceptance and completion rates were high, both from a practical perspective (80% of participants completed the study to the end) and relative to previous Delphi studies [36, 51]. As this process was delivered via an entirely hands-off and online protocol the study demonstrates an efficient and potentially cost-effective method of meaningfully engaging with stakeholders in the co-design of digital health for chronic disease interventions [36, 51]. Similar to previous research [51], anecdotally it was noted that the use of personalised contact including phone calls to each participant likely contributed to the high-quality engagement achieved. A number of pragmatic benefits to participating in Delphi studies were also mentioned in participant communication. An honorarium that approached fair compensation for stakeholders’ time was appreciated, while it was reminded that participation in this type of research and stakeholder engagement activities can count towards continuing professional development points for certain roles. In future, these benefits might be communicated clearly in recruitment materials to facilitate participant recruitment and retention.
Directions for future research
This study provides some direction on the design of digital health prevention programs for T2DM. Currently, few evidence-based, disease-specific programs are widely available in Australia to help people to adopt healthier lifestyles. Further research is needed to identify how evidence-based solutions can be effectively translated into the community and clinical practice. User-centred methodologies including Delphi studies and other co-design strategies will be key to overcoming the complex challenge of designing interventions that are appealing and engaging for end users.
Further research is needed to identify needs and preferences among under-served, minority, elderly, and other vulnerable groups. While our findings may be generalisable to the majority of the Australian population, they have also highlighted the need for unique solutions tailored towards people living in remote and rural areas, people from culturally and linguistically diverse backgrounds, and other under-served, minority, and vulnerable groups. In addition, as digital health continues to spread through our health systems, further work is needed to understand and address the growing ‘digital divide’ including who and in what ways people may be disadvantaged by the digital revolution. Digital health is evolving rapidly, with a stream of new technologies entering the market each year, making it difficult to keep abreast of the latest innovation. To maximise returns on investment, attention should focus on technologies that are succeeding in other fields, such as education or gaming, to identify overlaps for health. More research investment is needed in this area.
Study strengths and limitations
This study applied strict adherence to the classical 3-round Delphi Study approach. This approach was effectively implemented and able to demonstrate the value of acquiring consensus in complex health issues, namely T2DM. Finally, this study sought the involvement of both professional stakeholders actively working in the field of T2DM, and potential end-user stakeholders of a T2DM prevention programme, and therefore gained insights from two distinct but equally relevant stakeholder groups. This extends previous work assessing a singular stakeholder group [44] and that enabled the analysis of consensus achieved in either groups, or as a total sample, and assisted in identifying similarities and differences what each group values in an intervention.
In addition to study strengths it is also important to consider the limitations. Study findings are based on a sample of stakeholders and may not necessarily be representative of all end-user or professional stakeholders’ views. While thorough consideration was given to the selection of stakeholder groups, it is possible that some key professions were underrepresented in the professional stakeholder group. For example, it was noted during data analysis that educators including teachers and those involved in establishing the school curriculum are relevant stakeholders, however, these were not considered in our stakeholder map and only emerged from the results. In terms of the socio-demographic profiles of stakeholders there is also a gender bias with end-user and professional stakeholder groups skewed towards males and females, respectively. Finally, the specific T2DM outcomes of this study are specific to the Australian health landscape as the content is specific to the Australian population and perhaps other countries with freely available universal healthcare, though the methodological contributions may have more general application.
Conclusions
This 3-round classical Delphi study confirm the need for further evidence- and theory- based tools that support improvements in physical activity, diet, and mental health as core targets, as well as an expanded definition of functional health literacy that encompasses the skills and knowledge needed to access health care services. The broader field of public health would benefit from further use of stakeholder engagement through rigorous research designs, such as Delphi studies, to analyse complex and multi-faceted areas of health management and disease prevention.
Acknowledgments
The authors would like to extend our sincere thanks to each Delphi panellist who shared their time, stories, and expertise with us: Adeline Lau, Anthony Webster, Mr Brian Tate, Ms Carolyn Turner, Mrs Chelsea Haywood, Mr Colin Cowan, Mr David Brassington, Mr Derek Hooper, Mrs Diana Morison, Dianne DeLaine, Ed Brown, Jeanette Richards, Mrs Jennifer Pietsch, Mr John Inkson, Professor Jonathan Shaw, Mr Josh Brown, Julie Davie, Mrs Julie Rockliff, Justin Dorigo, Ms Kate Upton, Ms Kathy Usic, Ms Kim Hider, Mrs Kylie Robinson, Linda Farrugia, Lindsay Barton, Ms Marina Chan, Mr Martin Baker, Dr Merilyn Lock, Mr Myles Dobinson, Mrs Nicole McClure, Mr Paul Fuller, Dr Phil Ohman, Mrs Purva Gulyani, Mr Robert Ikin, Rodney Blake, Ms Ronda Fethers, Ms Susanne Baxandall, Tara Stevens, and many other panellists who are not named here individually. Thank you all.
References
- 1.
World Health Organisation. Deaths by Cause, Age, Sex, by Country and by Region, 2000–2016. Geneva: World Health Organization. 2018.
- 2. Khan MAB, Hashim MJ, King JK, Govender RD, Mustafa H, Al Kaabi J. Epidemiology of type 2 diabetes–global burden of disease and forecasted trends. Journal of Epidemiology and Global Health. 2020;10(1):107. pmid:32175717
- 3.
Australian Institute of Health and Welfare. Diabetes Canberra, Australian Capital Territory: Australian Government; 2020 [https://www.aihw.gov.au/reports/risk-factors/insufficient-physical-activity/contents/physical-inactivity.
- 4. Diabetes Prevention Program Research Group. 10-year follow-up of diabetes incidence and weight loss in the Diabetes Prevention Program Outcomes Study. The Lancet. 2009;374(9702):1677–86. pmid:19878986
- 5. Hall KD, Kahan S. Maintenance of lost weight and long-term management of obesity. Medical Clinics. 2018;102(1):183–97. pmid:29156185
- 6. Shan R, Sarkar S, Martin SS. Digital health technology and mobile devices for the management of diabetes mellitus: state of the art. Diabetologia. 2019;62(6):877–87. pmid:30963188
- 7. Khoury MJ, Iademarco MF, Riley WT. Precision Public Health for the Era of Precision Medicine. American Journal of Preventive Medicine. 2016;50(3):398–401. pmid:26547538
- 8. Direito A, Dale LP, Shields E, Dobson R, Whittaker R, Maddison R. Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health. 2014;14(1):646. pmid:24965805
- 9.
Oyebode O, Ndulue C, Alhasani M, Orji R, editors. Persuasive Mobile Apps for Health and Wellness: A Comparative Systematic Review. Persuasive Technology Designing for Future Change; 2020 2020//; Cham: Springer International Publishing.
- 10. Marcolino MS, Oliveira JAQ, D’Agostino M, Ribeiro AL, Alkmim MBM, Novillo-Ortiz D. The impact of mHealth interventions: systematic review of systematic reviews. JMIR mHealth and uHealth. 2018;6(1):e23. pmid:29343463
- 11. Fagherazzi G, Ravaud P. Digital diabetes: Perspectives for diabetes prevention, management and research. Diabetes & Metabolism. 2019;45(4):322–9. pmid:30243616
- 12. Wu X, Guo X, Zhang Z. The efficacy of mobile phone apps for lifestyle modification in diabetes: systematic review and meta-analysis. JMIR mHealth and uHealth. 2019;7(1):e12297. pmid:30664494
- 13. Spring B, Pellegrini C, McFadden H, Pfammatter AF, Stump TK, Siddique J, et al. Multicomponent mHealth intervention for large, sustained change in multiple diet and activity risk behaviors: the make better choices 2 randomized controlled trial. Journal of Medical Internet Research. 2018;20(6):e10528. pmid:29921561
- 14. Sepah SC, Jiang L, Ellis RJ, McDermott K, Peters AL. Engagement and outcomes in a digital Diabetes Prevention Program: 3-year update. BMJ Open Diabetes Research and Care. 2017;5(1).
- 15. Van Rhoon L, Byrne M, Morrissey E, Murphy J, McSharry J. A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions. Digital Health. 2020;6:2055207620914427. pmid:32269830
- 16. Birnbaum F, Lewis DM, Rosen R, Ranney ML. Patient engagement and the design of digital health. Academic Emergency Medicine: Official Journal of the Society for Academic Emergency Medicine. 2015;22(6):754. pmid:25997375
- 17. Van Velthoven MH, Cordon C. Sustainable adoption of digital health innovations: perspectives from a stakeholder workshop. Journal of Medical Internet Research. 2019;21(3):e11922. pmid:30907734
- 18. Edney S, Ryan JC, Olds T, Monroe C, Fraysse F, Vandelanotte C, et al. User Engagement and Attrition in an App-Based Physical Activity Intervention: Secondary Analysis of a Randomized Controlled Trial. J Med Internet Res. 2019;21(11):e14645. pmid:31774402
- 19. Vaghefi I, Tulu B. The Continued Use of Mobile Health Apps: Insights From a Longitudinal Study. JMIR Mhealth Uhealth. 2019;7(8):e12983. pmid:31469081
- 20. Wallis L, Hasselberg M, Barkman C, Bogoch I, Broomhead S, Dumont G, et al. A roadmap for the implementation of mHealth innovations for image-based diagnostic support in clinical and public-health settings: a focus on front-line health workers and health-system organizations. Global Health Action. 2017;10(sup3):1340254. pmid:28838310
- 21. Tabak RG, Sinclair KA, Baumann AA, Racette SB, Sebert Kuhlmann A, Johnson-Jennings MD, et al. A review of diabetes prevention program translations: use of cultural adaptation and implementation research. Translational Behavioral Medicine. 2015;5(4):401–14. pmid:26622913
- 22. Morton E, Barnes SJ, Michalak EE. Participatory digital health research: A new paradigm for mHealth tool development. Gen Hosp Psychiatry. 2020;66:67–9. pmid:32702489
- 23.
World Health Organization. WHO community engagement framework for quality, people-centred and resilient health services. World Health Organization; 2017.
- 24.
National Center for Advancing Translation Sciences. Patient/Community Engagement & Health Information. 2020.
- 25. Shelef DQ, Rand C, Streisand R, Horn IB, Yadav K, Stewart L, et al. Using stakeholder engagement to develop a patient-centered pediatric asthma intervention. Journal of Allergy and Clinical Immunology. 2016;138(6):1512–7. pmid:27744029
- 26. Bombard Y, Baker GR, Orlando E, Fancott C, Bhatia P, Casalino S, et al. Engaging patients to improve quality of care: a systematic review. Implementation Science. 2018;13(1):98. pmid:30045735
- 27. Steen M, Manschot M, De Koning N. Benefits of co-design in service design projects. International Journal of Design. 2011;5(2).
- 28. Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. The Lancet. 2009;374(9683):86–9.
- 29. Juenger S, Payne SA, Brine J, Radbruch L, Brearley SG. Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliative Medicine. 2017;31(8):684–706. pmid:28190381
- 30. Schiller C, Winters M, Hanson HM, Ashe MC. A framework for stakeholder identification in concept mapping and health research: a novel process and its application to older adult mobility and the built environment. BMC Public Health. 2013;13(1):1–9. pmid:23639179
- 31. Aziz Z, Absetz P, Oldroyd J, Pronk NP, Oldenburg B. A systematic review of real-world diabetes prevention programs: learnings from the last 15 years. Implementation Science. 2015;10(1):172. pmid:26670418
- 32. Cappuccio FP, D’Elia L, Strazzullo P, Miller MA. Quantity and quality of sleep and incidence of type 2 diabetes: a systematic review and meta-analysis. Diabetes Care. 2010;33(2):414–20. pmid:19910503
- 33. Fisher EB, Boothroyd RI, Elstad EA, Hays L, Henes A, Maslow GR, et al. Peer support of complex health behaviors in prevention and disease management with special reference to diabetes: systematic reviews. Clinical Diabetes and Endocrinology. 2017;3(1):4. pmid:28702258
- 34. Li R, Zhang P, Barker LE, Chowdhury FM, Zhang X. Cost-effectiveness of interventions to prevent and control diabetes mellitus: a systematic review. Diabetes Care. 2010;33(8):1872–94. pmid:20668156
- 35. Concannon TW, Meissner P, Grunbaum JA, McElwee N, Guise J-M, Santa J, et al. A new taxonomy for stakeholder engagement in patient-centered outcomes research. Journal of General Internal Medicine. 2012;27(8):985–91. pmid:22528615
- 36. Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PloS One. 2011;6(6):e20476. pmid:21694759
- 37. Jorm AF. Using the Delphi expert consensus method in mental health research. Australian & New Zealand Journal of Psychiatry. 2015;49(10):887–97. pmid:26296368
- 38. Balasubramanian R, Agarwal D. Delphi technique-A review. International Journal of Public Health Dentistry. 2013;3(2):16–25.
- 39.
McCarthy EJ, Shapiro SJ, Perreault WD. Basic marketing: Irwin-Dorsey Ontario; 1979.
- 40. Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology. 2006;3(2):77–101.
- 41. Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ. What is “quality of evidence” and why is it important to clinicians? BMJ. 2008;336(7651):995–8. pmid:18456631
- 42. Heiko A. Consensus measurement in Delphi studies: review and implications for future quality assurance. Technological Forecasting and Social Change. 2012;79(8):1525–36.
- 43. Hsu C-C, Sandford BA. The Delphi technique: making sense of consensus. Practical Assessment, Research, and Evaluation. 2007;12(1):10.
- 44. Pal K, Dack C, Ross J, Michie S, May C, Stevenson F, et al. Digital health interventions for adults with type 2 diabetes: qualitative study of patient perspectives on diabetes self-management education and support. Journal of Medical Internet Research. 2018;20(2):e40. pmid:29463488
- 45. Troughton J, Jarvis J, Skinner C, Robertson N, Khunti K, Davies M. Waiting for diabetes: perceptions of people with pre-diabetes: a qualitative study. Patient Education and Counseling. 2008;72(1):88–93. pmid:18367365
- 46. Davies MJ, Heller S, Skinner T, Campbell M, Carey M, Cradock S, et al. Effectiveness of the diabetes education and self management for ongoing and newly diagnosed (DESMOND) programme for people with newly diagnosed type 2 diabetes: cluster randomised controlled trial. BMJ. 2008;336(7642):491–5. pmid:18276664
- 47. Wolff K, Cavanaugh K, Malone R, Hawk V, Gregory BP, Davis D, et al. The Diabetes Literacy and Numeracy Education Toolkit (DLNET). The Diabetes Educator. 2009;35(2):233–45. pmid:19240246
- 48. Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13(1):658.
- 49. de Freitas C. Public and patient participation in health policy, care and research. Porto Biomed J. 2017;2(2):31–2. pmid:32258582
- 50. van Dongen EJ, Duijzer G, Jansen SC, ter Beek J, Huijg JM, Leerlooijer JN, et al. Process evaluation of a randomised controlled trial of a diabetes prevention intervention in Dutch primary health care: the SLIMMER study. Public Health Nutrition. 2016;19(16):3027–38. pmid:27256153
- 51. Gargon E, Crew R, Burnside G, Williamson PR. Higher number of items associated with significantly lower response rates in COS Delphi surveys. Journal of Clinical Epidemiology. 2019;108:110–20. pmid:30557677