Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The role of intervention mapping in designing disease prevention interventions: A systematic review of the literature

Abstract

Objective

To assess the role of Intervention Mapping (IM) in designing disease prevention interventions worldwide.

Methods

Systematic search and review of the relevant literature—peer-reviewed and grey—was conducted using the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) guidelines.

Findings

Only five of the twenty two included studies reviewed were RCTs that compared intervention using IM protocol with placebo intervention, and provided the outcomes in terms of percentage increase in the uptake of disease-prevention programmes, and only one of the five studies provided an effect measure in the form of relative risk (RR = 1.59, 95% CI = 1.08–2.34, p = 0.02). Of the five RCTs, three were rated as strong evidences, one as a medium evidence and one as a weak evidence, and they all reported statistically significant difference between the two study groups, with disease prevention interventions that have used the intervention mapping approach generally reported significant increases in the uptake of disease-prevention interventions, ranging from 9% to 28.5% (0.0001 ≤ p ≤ 0.02), On the other hand, all the 22 studies have successfully identified the determinants of the uptake of disease prevention interventions that is essential to the success of disease prevention programmes.

Conclusion

Intervention Mapping has been successfully used to plan, implement and evaluate interventions that showed significant increase in uptake of disease prevention programmes. This study has provided a good understanding of the role of intervention mapping in designing disease prevention interventions, and a good foundation upon which subsequent reviews can be guided.

Introduction

Background

Health promotion entails the use of both educational and environmental interventions to improve conditions of living favourable to health.[1] Different health promotion intervention models have been used in the past, such as the logic model described by Kirby and associates[2] and the PRECEDE/PROCEED model described by Green and Kreuter.[1] The logic model provides a background of risk behaviours and their determinants in the at-risk groups. It also depicts the environmental factors and their determinants that impact directly or indirectly on the risk behaviours, as well as identifying characteristics that distinguish between effective and ineffective programmes.[2] The PRECEDE component involves an analysis of the behavioural and environmental determinants of health and their correlates. While the PROCEED component involves the development, implementation and evaluation of a health promotion programme.[1] Intervention mapping (IM) is a health promotion protocol for selecting and applying social and behavioural science theories, such as theories of health psychology, to the planning, implementation and evaluation of health promotion programmes.[3]

Intervention mapping is not a new health promotion theory, it is a framework that tries to bridge the gap between theories and practice, because despite the wide range of social and behavioural science theories, their use in the development and implementation of health promotion programmes has been a constraint to planners.[4] According to Kok and Mesters, the concept of intervention mapping, came into practice because of the problems encountered from using existing models such as:[5]

trying to change behaviour that was not related to the problem, trying to change determinants for behaviours that were not relevant to the behaviour, trying to change individual behaviour while environmental factors were responsible, trying to apply change methods that were never shown to be effective, trying to implement programmes by health professionals that were inadequately trained to do so, and so forth”.

These led to a retrospective review of prototype health promotion programmes to come up with the intervention mapping protocol which describes a health promotion intervention in six steps as shown in Table 1. Although the process is defined by a series of steps, the planning process is iterative and cumulative rather than linear, with programmers moving in both directions as new themes and concepts are evolving, and each step depends on findings of the preceding step.[3]

thumbnail
Table 1. Intervention mapping steps, adapted from Bartholomew et al.[3].

https://doi.org/10.1371/journal.pone.0174438.t001

Step one above is based on the PRECEDE model described by Green and Kreuter[1] and is done before starting the actual intervention plan. It entails an assessment of the at risk population by reviewing all relevant literature related to the problem area, as well as collecting new information from the community though interviews and focus groups to have a better understanding of attitudes, beliefs and behaviours.[3] Step two forms the basis for the intervention by stating who and what is expected to change at both individual and ecological levels by stating the performance objectives and their determinants to produce the matrices of proximal performance objectives.[3] Each of the performance objectives has determinants, for example, self-efficacy is a determinant for choosing not to have sex and confidence is a determinant for negotiating condom use.[6] Step three entails the selection of theory informed methods and practical strategies. An intervention method is a process of using theory-based approach to change behaviour or environmental conditions,[3] for example, social learning theory (Bandura) has been used as the basis for methods improving self-efficacy and skills, theory of reasoned action (Fishbein & Ajzen) for changing subjective normative belief and behavioural beliefs, health belief model (Rosenstock) for changing knowledge, and risk perception.[6] Step four basically involves description of the programme protocols and contexts by participants, as well as pilot-testing the strategies and materials. It provides the vehicles for conveying the program design to producers.[3] In step five, programme sustainability is also considered in addition to adoption and implementation. In step six, the evaluation plan (which starts in step one, and developed together with the intervention map) is finalized.[3] This involves both process and effect evaluation. Process evaluation basically assess the fidelity of implementation, while effect evaluation assesses the impact of the intervention in the target population.[3] This can be done by randomizing intervention population with non-intervention populations to assess the effect of the intervention.[3,7]

The intervention mapping framework has been used to successfully adapt health promotion programmes.[6,8] When adapting a programme from one population to another using the intervention mapping protocol, each of the tasks of all the steps described in Table 1 must be considered in terms of the following: what is still relevant to and can be maintained in the new population, what needs to be added for the new population, what needs to be deleted as inappropriate for the new population and what needs to be deleted or adapted as impractical in the new population.[6] This is also achieved by reviewing all the relevant literature, collecting new data from the new population through individual interviews and focus groups, as well as key informant interviews with major stakeholders.[6]

Despite its widespread use in designing health promotion and disease prevention programmes, little evidence exists on the magnitude of the role IM plays in promoting uptake of disease prevention interventions. Therefore, this review aims at critically appraising the literature to assess the role of intervention mapping in designing disease prevention interventions worldwide.

Methods

Search strategy and selection criteria

The selection criteria was jointly decided and agreed by the two reviewers based on the study objective. This research is limited to studies that used intervention mapping in disease-specific prevention interventions, as shown in Table 2.

The PRISMA guidelines for reporting systematic reviews was followed to allow for systematic reporting. The PRISMA checklist is shown as File A in S1 Supporting Information.[9] Search for published literature was conducted in three main electronic databases: MEDLINE, EMBASE and Web of Science. It was initially designed using MEDLINE on 8th August 2014 and then adapted to the other databases on the same date using their specific terms. This allowed for testing of precision and sensitivity. The Campbell Collaboration and the Cochrane Library were also searched for any available and/or on-going systematic reviews on the topic. Search for grey literature (mainly unpublished research) was carried out on the following databases: OpenGrey and NYAM Grey Literature Report.

A very broad search was initially conducted, which aimed at identifying all intervention mapping studies on health promotion and disease prevention programmes. The titles and abstracts of all the identified studies were read to select those that used intervention mapping in disease-specific prevention interventions. After going through series of modifications, two main search categories were identified; “intervention mapping” related and “disease prevention” related. This gave the broadest search that captured all the relevant studies. The choice of disease prevention related terms was guided by a listing of areas of health promotion that intervention mapping has been applied, as stated on the intervention mapping website.[10] However, this underwent a series of iterative process leading to modifications as recommended in the PRISMA guidelines.[11] The Boolean operators AND/OR and truncation were used to link words and to identify all the possible endings of the search terms respectively as shown below:

Intervention mapping AND (HIV OR human immunodeficiency virus OR AIDS OR acquired immune deficiency syndrome OR hepatitis B virus OR HBV OR human papilloma virus OR HPV OR chlamydia OR influenza OR infect* OR injur* OR breast cancer OR cervical cancer OR prostate cancer OR colon cancer OR cancer OR drug* OR sex* OR smoking OR cigarette OR alcohol OR drinking OR binge OR wine OR bear OR behavi#r OR physical activity OR exercise OR sedentary OR inactivity OR psychiatr* OR psycholog* OR mental OR fruit OR vegetable OR diet OR nutrition* OR eat* OR feed* OR low calorie* OR low energy OR low fat OR low salt OR obes* OR weight gain OR overweight OR worker* OR student* OR depress* OR dementia OR stress OR chronic disease OR diabetes OR hypertension OR vaccin* OR stroke OR disabilit* OR asthma OR gynecolog* OR health promotion OR health education OR prevention OR ehealth OR family-based OR family OR school-based OR school OR web-based OR workplace OR work related).

Both indexed and free-text terms for intervention mapping were searched for. Details of the search strategy are attached as File B in S1 Supporting Information.

Data extraction and quality of studies

All the identified studies were transferred to Endnote X7 and duplicates were removed. Ineligible studies were removed after reading the abstracts, while the full texts of the eligible studies were obtained and read for further ascertainment of eligibility or otherwise. Data extraction was carried out independently by the two authors, and compared for consistencies.

Critical appraisal.

This involved an assessment of methodological quality as well as the risk of bias in the eligible studies. The appraisal status was not meant to ascertain eligibility status of the studies, but to identify strengths and weaknesses. Since the intervention mapping protocol designs and assesses the effect of an intervention, a combination of (mainly) the quality assessment tool for quantitative studies developed by the Effective Public Health Practice Project (EPHPP) and (to a lesser extent) the Centre for Evidence-Based management (CEBMa) checklist for surveys were considered appropriate, because the last step of the intervention mapping framework involves an evaluation of the intervention effect in quantitative terms. The EPHPP tool uses eight items to assess the quality of quantitative studies.[12] Each of these eight items is rated as strong, moderate or weak to collectively give rise to an overall methodological ratings of strong (four strong ratings with no weak ratings), moderate (less than four strong ratings and one weak rating) or weak (two or more weak ratings) evidence.[13] Details of the quality appraisal are attached as File C in S1 Supporting Information. Results of the critical appraisal were used to guide construction of the tool for data extraction and synthesisAuthors were contacted where information was not clear or when documents were not available.

Results

Literature search and study selection

Outcome of the literature search and selection of studies is summarized in Fig 1. The Cochrane library and the Campbell collaborations were searched for existing systematic reviews but none was found. Since most of the studies did not provide information on the effects of the interventions, authors were contacted to obtain that information. Out of the 16 authors contacted, only 6 responded at the time of compiling his review. Two authors provided the documents,[14,15] while the other four said the intervention effect trials were not yet published.[1619]

Study characteristics

A total of 22 studies were included in this review. Three studies were cluster RCTs,[2022] and two are individual RCT.[23,24] Twelve studies were conducted in the Netherlands,[14,17,21,22,2531] five were conducted in the U.S.A,[15,16,19,32,33] two were conducted in Taiwan,[23,34] one was conducted in Tanzania,[35] and one was conducted in both Tanzania and South Africa.[18]

Seven studies were on HIV/STI prevention,[18,19,2528,35] one was on chlamydia prevention,[30] one was on Hepatitis B virus (HBV) prevention,[29] four were on influenza prevention,[17,21,22,31] four were on cervical cancer prevention,[15,16,23,34] one was on breast & cervical cancer prevention,[33] one was on secondary stroke prevention,[32] and one was on physical activity related injury prevention.[14]

Byrd et al (2013), Collard et al (2010), Looijmans-van den Akker et al (2010) and Hou et al (2002) were effect evaluation trials for Byrd et al (2012), Collard et al (2009), Looijmans-van den Akker et al (2011) and Hou et al (2004) respectively. Thus, they reported findings on different components of the same studies.

Assessment of risk of bias

Since only five studies were RCTs out of which only one provided an effect estimate in form of relative risk, and also considering the high possibility of heterogeneity, the risk of publication bias could not be assessed using funnel plot. However, the possibility of selection bias, the study design, possibility of confounders, blinding, data collection methods, withdrawal rate, intervention integrity and robustness of analysis, as contained in the EPHPP tool, were assessed to rate the methodological qualities of the studies as described in Appendix 3.

Heterogeneity

Even though all the studies used intervention mapping to design the respective disease prevention interventions, there is still a high possibility of heterogeneity (both clinical, methodological and statistical) because most of them differ in the following ways; epidemiologic design, sampling technique, study population, disease categories, methods of data collections and methods/robustness of data analysis. However, heterogeneity was not formally assessed because meta-regression could not be performed due to incomplete data, and sub-group analysis stands the danger of over interpretation.

Results of individual studies and synthesis of results

A summary of study characteristics is presented in Table 3, and the summary of findings is provided afterwards, while the adapted appraisal tool is summarized in Table 4.

Summary of findings

Only five of the twenty two included studies provided the effects in terms of percentage increase in the uptake of prevention programmes, and only one of the five studies provided an effect measure (between interventions using IM protocol and interventions using placebo with standard care) in the form of relative risk (RR = 1.59, 95%CI = 1.08–2.34, p = 0.02). All the five studies were RCTs, three of which were rated as strong evidences, one as a medium evidence and one as a weak evidence. These studies are: 9% increase in the uptake of influenza vaccine (RR = 1.59, 95%CI = 1.08–2.34, p = 0.02),[22] 10.9% increase in the uptake of mammography & a 15.9% increase in the uptake of pap-smear test,[33] 19.7% increase in the uptake of pap-smear test (p = 0.002),[23] 28.5% increase in the uptake of pap-smear screening test (p<0.0001),[24] and a 50% reduction in physical activity-related injury among low active children (HR, 0.47; 95% CI, 0.21–1.06).[20] However, all the studies have identified the participants-tailored and theory-driven determinants of uptake of the respective disease prevention interventions, which is essential (or even a pre-requisite) to the success of any disease prevention programme. Results are presented by intervention/disease type:

HIV/STI prevention.

Uptake of screening tests was found to be associated with attitude, self-efficacy, perceived norms of partners/friends/parents, perceived susceptibility, shame, pros, and characteristic test site accessibility. While the performance objectives for condom use were found to be; decide to use condom, obtain/buy condom, always carry condom along, be confident to negotiate using condom with your partner by communicating and persuading, agree to use condom or not to have sex, use condom correctly and persist on using condom for every act of sexual intercourse.[18,19,2530,35]

Influenza prevention.

The most important determinants of influenza vaccine uptake among HCWs were found to be: longer opening hours, more test locations, use of mobile carts, written policy, active request, working for more than 15 years, perceived personal risks, perceived reduction of risk to patients, awareness of the existence of guidelines and the influence of media attention on avian influenza.[17,21,31]

Cervical and breast cancer prevention.

The determinants of screening uptake were found to be; knowledge, perception of susceptibility, perceived pros and cons, cultural norms, physician referral, insurance coverage, access & regularity of care, cost, flexibility of place-of work policy, embarrassment & discomfort, fatalism, language barrier and fear of outcome & confidentiality.[15,16,33,34]

Secondary stroke prevention.

Determinants of prevention were found to be; the need for provider (discharge) check-off list, clinical reminders, training and education on risk factors & local resources, stroke support groups, IEC materials and administration support.[32]

Physical activity-related injury prevention.

Determinants were found to be; type of sport played (contact/no contact), weather, time of season/time of day, playing surface, equipment (protective/footwear), rules, previous injury, age, sex, fitness level and psycho-social factors.[14]

Discussion

Intervention mapping is now widely being used to design disease prevention interventions worldwide. It has been applied in a wide range of health promotion programmes including communicable and non-communicable disease preventions, as well as general health promotion. Most studies on intervention mapping reported that it has been found to be useful in designing disease prevention programmes, with varying degrees across different disease categories and populations. While some of the variations could be explained by differences in study designs and study populations, they also portray the need for methodological improvements in the use of intervention mapping to design prevention programmes.

Even though a meta-analysis could not be performed because only one study reported an effect estimate with confidence interval, an attempt is made to summarise the findings of the reviewed literature. All the five randomised controlled studies reported statistically significant difference between the IM intervention and placebo control groups, with the IM group associated with an increase in the uptake of disease-prevention intervention ranging from 9% to 28.5% (0.0001≤p≤0.02), and one study reported a 50% decrease in the incidence of physical activity-related injury among low active children (HR, 0.47; 95% CI, 0.21–1.06) in the IM group. On the other hand, all the 22 studies have successfully identified the determinants of the uptake of disease prevention interventions, which is essential to the success of disease prevention programmes.

The findings of this review show that uptakes of influenza vaccine among healthcare workers, mammography for breast cancer screening and pap-smear test for cervical cancer screening among sexually active women, as well as reduction in physical activity related injury among low active school children can be improved by designing disease prevention programmes using the intervention mapping protocol.[20,2224,33] Since most of the identified determinants of the uptake of these prevention programmes are potentially modifiable, health planners can target to encourage (or discourage) their uptake through all the known effective ways, such as education, training and even incentives. This can be said with some level of certainty for pap-smear screening for breast cancer because three of the reviewed studies conducted in different populations are significantly associated with increased uptake. In the case influenza vaccine uptake, mammography for breast cancer and prevention of physical activity related injuries that were reported by only one study each, more work needs to be done to increase reliability of the findings. In the study on the prevention of physical activity related injury, the overall finding shows no statistically significant difference between the intervention (IM) and control groups, but a sub group analysis showed a 50% reduction in the incidence of injuries among the low active students in the intervention group. This shows that the outcome of interventions can be influenced by some specific characteristics of the study population, hence the need to design participants’ tailored interventions with detailed sub-group analyses.

Restricting the literature search to only English language published literature was a limitation, as this may limit the inclusion of useful evidence, thus possibly introducing some form of selection bias which makes generalization difficult. The study was also limited by the fact that 15 of the 22 studies reviewed were rated as weak evidences and 4 as medium evidences, thus making the evidence less reliable. The possibility of publication bias resulting in over-representation of the positive effects of interventions could not be ruled out, because studies with positive effects are more likely to be published and vice versa. However, this could not be assessed because only one study provided an effect estimate.

Implications for practice, future research and policy

Even though the review process has some limitations, and the methodological qualities of most of the reviewed literature was also low, recommendations can be made to improve the design and implementation of intervention mapping on disease prevention programmes:

Most of the studies only described the development of disease prevention interventions using intervention mapping, but did not provide details of the epidemiological processes such as sampling techniques, methods of data collection and analysis, study design etc. Therefore, future studies on intervention mapping should take these into account in order to improve the methodological quality and validity of the studies. As much as possible, quantitative outcomes and effect estimates should be provided and where they are published in different articles, titles should refer to the previous articles. This is because the two articles obtained by contacting authors did not contain the key search term ‘intervention mapping’ in their titles and abstracts, hence, not captured by the search. Subsequent reviews on the effects of intervention mapping on disease prevention should, at the onset, focus on evaluation trials of interventions developed using intervention mapping (because they provide the effects needed) not on studies that just described how intervention mapping is used to develop a disease prevention intervention. However, there may be need to contact authors of the latter to get information on the former. There is need for larger reviews that would include all the relevant literature, which should be conducted in a more ideal setting and following all the principles and guidelines for conducting a systematic review. This will be needed to make some policy recommendations. There is a need to create global awareness and training on the use of intervention mapping in disease prevention, so that more research would be conducted in different parts of the world, which would add to the existing database. This is because most of the published studies were conducted in Europe and USA.

Conclusion

Despite the widespread use of intervention mapping in designing disease prevention interventions, little evidence exist on magnitude of the role IM plays in promoting uptake of disease prevention interventions. IM has been successfully used to plan, implement and evaluate interventions that showed significant increase in uptake of disease prevention programmes. This study has found that disease prevention interventions that have used the intervention mapping approach have generally reported significant increases in the uptake of disease prevention programs.

This implies that it can be recommended for designing such interventions with some level of certainty. However, these findings should be interpreted with caution in making generalization because of the limitations of this review. Nonetheless, this has provided an insight on the role of intervention mapping in designing disease prevention interventions, and a good foundation upon which subsequent reviews can be planned and conducted. It is also recommended that the use of IM to promote primordial and secondary prevention should be reviewed.

Author Contributions

  1. Conceptualization: RMG MAG.
  2. Data curation: RMG MAG.
  3. Formal analysis: RMG MAG.
  4. Funding acquisition: RMG MAG.
  5. Investigation: RMG MAG.
  6. Methodology: RMG MAG.
  7. Project administration: RMG MAG.
  8. Resources: RMG MAG.
  9. Software: RMG MAG.
  10. Supervision: RMG MAG.
  11. Validation: RMG MAG.
  12. Visualization: RMG MAG.
  13. Writing – original draft: RMG MAG.
  14. Writing – review & editing: RMG MAG.

References

  1. 1. Green LW, Kreuter MW. Health Promotion and Planning: An educational and ecological approach. 3rd ed. Mayfield: Mountain view, CA; 1999.
  2. 2. Kirbi D. Emerging Answers: Research finding on programs to reduce teen pregnancy. National Campaign to Prevent Teen Pregnancy, Washington DC. 2001
  3. 3. Bartholomew LK, Parcel GS, Kok G, Gottlieb NH, Fernandez ME. Planning Health Promotion Programs: An Intervention Mapping Approach. 3rd ed. San Francisco: Jossy-Bass; 2011.
  4. 4. Kok G, Schaalma H, Ruiter RA, van Empelen P, Brug J. Intervention mapping: protocol for applying health psychology theory to prevention programmes. Journal of health psychology. 2004 Jan;9(1):85–98 pmid:14683571
  5. 5. Kok G, Mesters I. Getting inside the black box of health promotion programmes using intervention Mapping. Chronic illness. 2011 Sep;7(3):176–80 pmid:21900338
  6. 6. Tortolero SR, Markham CM, Parcel GS, Peters RJ Jr., Escobar-Chaves SL, Basen-Engquist K, et al. Using intervention mapping to adapt an effective HIV, sexually transmitted disease, and pregnancy prevention program for high-risk minority youth. Health promotion practice. 2005 Jul;6(3):286–98 pmid:16020623
  7. 7. Godin G, Gagnon H, Alary M, Levy JJ, Otis J. The degree of planning: an indicator of the potential success of health education programs. IUHPE—Promotion & Education. 2007;14(3):138–42
  8. 8. Leerlooijer JN, Ruiter RCA, Reinders J, Darwisyah W, Kok G, Bartholomew LK. The World Starts With Me: Using intervention mapping for the systematic adaptation and transfer of school-based sexuality education from Uganda to Indonesia. Translational Behavioral Medicine Practice, Policy, Research. 2011;s13142(11):41–3
  9. 9. Liberati A, Altman DG, Tetzlaff J, et al. The PRIMA statement for reporting systematic reviews and meta-analysis of studies that evaluate health care intervention: exoplanation and elaboration. BMJ. 2009;339:b2700 pmid:19622552
  10. 10. [21/06/2014]. http://interventionmapping.com/?q=node/1712.
  11. 11. Moher D, et al. Preferred reporting items for systematic reviews and meta-analysis: the PRISMA statement. PLoS Med. 2009;6(7)
  12. 12. National Collaborating Centre for Methods and Tools. Quality Assessment Tool for Quantitative Studies2008. http://www.nccmt.ca/registry/view/eng/14.html.
  13. 13. http://www.cebma.org/wp-content/uploads/Critical-Appraisal-Questions-for-a-Survey.pdf.
  14. 14. Collard DC, Chinapaw MJ, Mechelen WV, Verhagen EA. Design of the iPaly study: Systematic development of a physical activity injury prevention programme for primary school children. Sport med. 2009;39(11):889–901
  15. 15. Byrd TL, Wilson KM, Smith JL, Heckert A, Orians CE, Vernon SW, et al. Using intervention mapping as a participatory strategy: development of a cervical cancer screening intervention for Hispanic women. Health education & behavior: the official publication of the Society for Public Health Education. 2012 Oct;39(5):603–11
  16. 16. Scarinci IC, Bandura L, Hidalgo B, Cherrington A. Development of a theory-based (PEN-3 and Health Belief Model), culturally relevant intervention on cervical cancer prevention among Latina immigrants using intervention mapping. Health promotion practice. 2012 Jan;13(1):29–40 pmid:21422254
  17. 17. Kok G, van Essen GA, Wicker S, Llupia A, Mena G, Correia R, et al. Planning for influenza vaccination in health care workers: an Intervention Mapping approach. Vaccine. 2011 Nov 3;29(47):8512–9 pmid:21939722
  18. 18. Aaro LE, Flisher AJ, Kaaya S, Onya H, Fuglesang M, Klepp KI, et al. Promoting sexual and reproductive health in early adolescence in South Africa and Tanzania: development of a theory- and evidence-based intervention programme. Scandinavian journal of public health. 2006;34(2):150–8 pmid:16581707
  19. 19. Corbie-Smith G, Akers A, Blumenthal C, Council B, Wynn M, Muhammad M, et al. Intervention mapping as a participatory approach to developing an HIV prevention intervention in rural African American communities. AIDS education and prevention: official publication of the International Society for AIDS Education. 2010 Jun;22(3):184–202
  20. 20. Collard DC, Verhagen EA, Chinapaw MJ, et al. Effectiveness of a school-based physical activity injury prevention programme. Arch Pediatr Adolesc Med. 2010;164(2):145–50 pmid:20124143
  21. 21. Riphagen-Dalhuisen J, Frijstein G, van der Geest-Blankert N, Danhof-Pont M, de Jager H, Bos N, et al. Planning and process evaluation of a multi-faceted influenza vaccination implementation strategy for health care workers in acute health care settings. BMC infectious diseases. 2013;13:235 pmid:23701921
  22. 22. Looijmans-van den Akker I, van Delden JJ, Verheij TJ, van der Sande MA, van Essen GA, Riphagen-Dalhuisen J, et al. Effects of a multi-faceted program to increase influenza vaccine uptake among health care workers in nursing homes: A cluster randomised controlled trial. Vaccine. 2010 Jul 12;28(31):5086–92 pmid:20580740
  23. 23. Hou SI, Fernandez ME, Baumler E, Parcel GS. Effectiveness of an intervention to increase pap test screening among chinese women in Taiwan. Journal of Community Health. 2002;27(4):277 pmid:12190056
  24. 24. Byrd TL, Wilson KM, Smith JL, Coronado G, Vernon SW, Fernandez-Esquer ME, et al. AMIGAS: a multicity, multicomponent cervical cancer prevention trial among Mexican American women. Cancer. 2013 Apr 1;119(7):1365–72 pmid:23280399
  25. 25. Wolfers ME, van den Hoek C, Brug J, de Zwart O. Using Intervention Mapping to develop a programme to prevent sexually transmittable infections, including HIV, among heterosexual migrant men. BMC Public Health. 2007;7:141 pmid:17615052
  26. 26. Van Kesteren NC, Kok G, Hospers HJ, Schippers J, Wencke De Wildt MA. systematic development of a Self-Help and motivational enhancement intervention to promote sexual health in HIV-positve men who have sex with men. AIDS PATIENT CARE and STDs. 2006;20(12):858–75 pmid:17192151
  27. 27. van Empelen P, Kok G, Schaalma HP, Bartholomew LK. An AIDS risk reduction program for Dutch drug users: an intervention mapping approach to planning. Health promotion practice. 2003 Oct;4(4):402–12 pmid:14611025
  28. 28. Wolfers M, de Zwart O, Kok G. The systematic development of ROsafe: an intervention to promote STI testing among vocational school students. Health promotion practice. 2012 May;13(3):378–87 pmid:21447749
  29. 29. Van Der Veen YJ, Van Empelen P, Richardus JH. Development of a culturally tailored Internet intervention promoting hepatitis B screening in the Turkish community in the Netherlands. Health promotion international. 2012 Sep;27(3):342–55 pmid:21795303
  30. 30. Theunissen KA, Hoebe CJ, Crutzen R, Et al. Using intervention mapping for the development of a targeted secure web-based outreach strategy named SafeFriend, for Chlamydia trachomatis testing in young people at risk. BMC Public Health. 2013;13:996 pmid:24148656
  31. 31. Looijmans-van den Akker , Hulscher ME, Verheij T, J., Et al. How to develop a programme to increase influenza vaccine uptake among workers in health care settiings. Implementation science. 2011;6:47 pmid:21595877
  32. 32. Schmid AA, Andersen J, Kent T, Williams LS, Damush TM. Using intervention mapping to develop and adapt a secondary stroke prevention program in Veterans Health Administration medical centers. Implementation science: IS. 2010;5:97 pmid:21159171
  33. 33. Fernandez ME, Gonzales A, Tortolero-Luna G, Partida S, Bartholomew LK. Using intervention mapping to develop a Breast and Cervical cancer screening program for Hispanic farmworkers: Cultivando La Salud Health promotion practice. 2005;6:394 pmid:16210681
  34. 34. Hou SI, Fernandez ME, Parcel GS. Development of a cervical cancer educational program for Chinese women using intervention mapping. Health promotion practice. 2004 Jan;5(1):80–7 pmid:14965438
  35. 35. Mkumbo K, Schaalma H, Kaaya S, Leerlooijer J, Mbwambo J, Kilonzo G. The application of Intervention Mapping in developing and implementing school-based sexuality and HIV/AIDS education in a developing country context: the case of Tanzania. Scandinavian journal of public health. 2009 Jun;37 Suppl 2:28–36