Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Effects of an Internet-Based Cognitive Behavioral Therapy (iCBT) Program in Manga Format on Improving Subthreshold Depressive Symptoms among Healthy Workers: A Randomized Controlled Trial

  • Kotaro Imamura,

    Affiliation Department of Mental Health, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan

  • Norito Kawakami ,

    nkawakami@m.u-tokyo.ac.jp

    Affiliation Department of Mental Health, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan

  • Toshi A. Furukawa,

    Affiliation Departments of Health Promotion and Human Behavior and of Clinical Epidemiology, Graduate School of Medicine/School of Public Health, Kyoto University, Kyoto, Japan

  • Yutaka Matsuyama,

    Affiliation Department of Biostatistics, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan

  • Akihito Shimazu,

    Affiliation Department of Mental Health, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan

  • Rino Umanodan,

    Affiliation Kyoto Office, Health Wave Co., Ltd., Kyoto, Japan

  • Sonoko Kawakami,

    Affiliation Nippon University College of the Arts, Tokyo, Japan

  • Kiyoto Kasai

    Affiliation Department of Neuropsychiatry, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan

Abstract

Objective

The purpose of this study was to develop a new Internet-based computerized cognitive behavior therapy (iCBT) program in Manga format, the Japanese cartoon, for workers and to examine the effects of the iCBT program on improving subthreshold depression using a randomized controlled trial (RCT) design among workers employed in private companies in Japan.

Method

All workers in a company (n = 290) and all workers in three departments (n = 1,500) at the headquarters of another large company were recruited by an invitation e-mail. Participants who fulfilled the inclusion criteria were randomly allocated to intervention or control groups (N = 381 for each group). A six-week, six-lesson iCBT program using Manga (Japanese comic) story was developed. The program included several CBT skills: self-monitoring, cognitive restructuring, assertiveness, problem solving, and relaxation. The intervention group studied the iCBT program at a frequency of one lesson per week. Depression (Beck Depression Inventory II; BDI-II) was assessed as a primary outcome at baseline, and three- and six-month follow-ups for both intervention and control groups were performed.

Results

The iCBT program showed a significant intervention effect on BDI-II (t = −1.99, p<0.05) with small effect sizes (Cohen's d: −0.16, 95% Confidence Interval: −0.32 to 0.00, at six-month follow-up).

Conclusions

The present study first demonstrated that a computerized cognitive behavior therapy delivered via the Internet was effective in improving depression in the general working population. It seems critical to improve program involvement of participants in order to enhance the effect size of an iCBT program.

Trial Registration

UMIN Clinical Trials Registry UMIN000006210

Introduction

Occupational stress has been considered a major risk factor for a wide range of health outcomes [1], [2]. To reduce work-related stress and its negative effect on health among workers, more attention has been paid to the primary prevention strategy. Among other measures, stress management interventions (SMI) have recently become frequently applied in the workplace [3]. A growing body of literature has shown that SMIs based on cognitive behavioral therapy (CBT) [4], [5] and relaxation therapy [6] are effective in reducing work-related stress and improving depression and anxiety among workers. A meta-analysis reported that the estimated effects of CBT and relaxation therapy were Cohen's d = 0.68 and 0.35, respectively [7]. Another meta-analysis reported that the estimated effects of CBT and relaxation therapy were Cohen's d = 1.16 and 0.50, respectively [6]. However, the implementation of these interventions was still limited, because such a program requires professionals well trained in CBT [8][10]. In addition, even if a service is provided, the time, cost, and stigma related to mental health treatment could serve as barriers to access to the effective treatment [11].

An innovative way to deliver CBT-based treatment widely is with a computerized CBT (CCBT). CCBT programs can teach information and techniques based on the same CBT principles as face-to-face CBT programs do, with a highly structured format comprising educational lessons, homework assignments, and supplementary resources [12]. Spurgeon and Wright (2010) claimed that there were three major platforms on which to deliver the CCBT programs: 1) multimedia computer programs, 2) virtual reality programs, and 3) Smartphone or handheld device applications. Some programs are delivered in a clinic, and others are accessed at home or through other venues, such as the Internet [13]. The mode of application is an Internet-based cognitive behavioral therapy (iCBT): i.e., a CCBT delivered via the Internet. In addition to the features of CCBT, iCBT has a special feature of high anonymity and high accessibility. In terms of anonymity, iCBT is suitable for addressing psychological problems because it can enable users to avoid the stigma incurred by seeing a therapist [14]. In terms of accessibility, iCBT provides users with the opportunity to obtain treatment at any time and at any place, such as in the workplace or at home, and study the content as much as they want [15]. The level of therapist involvement in iCBT can vary among programs; they could provide no assistance, minimal therapist contact by email or telephone, or a contact similar to face-to-face therapy [15]. However, a complete online iCBT may have merit since it can provide a viable alternate mental health resource for people who have geographical, physical, psychological, and/or financial barriers to seeking traditional, face-to-face care [11].

Previous iCBT programs have been shown to have a significant positive treatment effect on depression and anxiety mostly in the clinical setting. A meta-analysis of RCT reported that iCBT can improve depressive symptoms of patients who have major depressive disorder (Hedges' g = 0.56–0.99) and anxiety disorders (Hedges' g values were 0.92 for social phobia, 0.83 for panic disorder, and 1.12 for generalized anxiety disorder) more effectively compared with TAU or waiting list [16]. The treatment effects of iCBT varied by the extent of therapist involvement. Another meta-analysis reported that the effect size (about 0.6 in Cohen's d on average) of iCBT with therapist support was greater than the effect size (about 0.25) of self-guided program without therapist support [15], [17]. However, these self-guided-only programs showed small to medium effects, and thus a self-guided iCBT program is still considered to be helpful for people who have mild to moderate symptoms but cannot (or do not wish to) see a clinician [12]. Most critical problem within self-guided programs that might have resulted in a smaller effect was high dropout rates [12].

Despite a number of benefits of using CCBT and iCBT, the application of these programs in the workplace setting has been limited. Grime (2004) conducted a randomized controlled trial (RCT) to evaluate the effect of an eight-week CCBT program to improve emotional distress among employees who had recently experienced stress-related absenteeism. A month before the end of the intervention, the depression and anxiety among the participants in the intervention group improved significantly compared to that of the TAU group [18]. Grime (2004) also reported reasons for non-participation [18]. Non-participation in this study was common and related to a number of barriers, such as access problems, preference for other treatments (especially face-to-face counseling), time commitment, skepticism about the intervention, and employer connection. An online or Internet-based CCBT program might be effective in reducing concerns about travel and time off work, confidentiality, and connection with the employer; thus it appears to improve workers' participation more than a CCBT program. However, no iCBT program is available that would target specifically the general working population, the effectiveness of which would be tested with an RCT.

The purpose of this study was to develop a new six-week iCBT program for workers in Japan and to examine the effects of the iCBT program on improving the symptoms of depression at three- and six-month follow-ups using a randomized controlled trial design among workers employed in private companies in Japan. In the iCBT program, we applied a “Manga” (the Japanese cartoon or comic story) format, that is now frequently used to communicate medical information in Japan[19], expecting participants' greater commitment to and better understanding of the contents of the program with using this communicative medium[20], [21].

Methods

Trial design

The study was a randomized controlled trial. The allocation ratio of the intervention group to the control group was 1 to 1. The study protocol was registered at the UMIN Clinical Trials Registry (UMIN-CTR) (ID = UMIN000006210). The protocol for this trial and supporting CONSORT checklist are available as supporting information; see Checklist S1, Protocol S1 and Protocol S2.

Participants

All workers in company A (N = 290) and all workers who belonged to three selected departments (N = about 1,500) at the headquarter of company B (the total employee size, c.a. 11,000) were recruited by an invitation e-mail. Both companies developed information technology systems and related services as their products. Those who were interested in participating in the study were asked to go to a research website to obtain full explanation of the study's aim and procedure and to input their baseline information if they agreed to participate. The inclusion criteria stated that participants could 1) not be diagnosed with a major depressive disorder in the past month (using the web-version of the WHO-Composite International Diagnostic Interview version 3.0 (WHO-CIDI 3.0) [22], 2) not be diagnosed with lifetime bipolar disorder (WHO-CIDI 3.0), 3) not have taken 15 sick leave days or more in total due to their own health problems during the past three months, and 4) not have received medical treatment for mental health problems during the past month.

Intervention

Participants who were allocated to the intervention group studied the new iCBT program called the Internet CBT program; Useful mental health solutions series for business. The program was a six-week web-based training course to provide stress management skills. This program was structured into six lessons, with one lesson given per week. Learning one lesson required about 30 minutes, including homework. This program can be used anywhere the Internet is available.

One of the unique features of the program was that the training was provided along with a Manga (Japanese comic) story of a psychologist and a client worker to facilitate the understanding of the participants (Figure 1). Several merits of using a comic story and comic characters in education have been acknowledged through research. First, these materials help motivate individuals, and high motivation is useful to keep participants in the program [23]. Second, they facilitate easy learning. A program with text combined with comic stories would be easier for a learner to understand compared to a text-only program [23], [24]. Third, comic stories foster learners' interest in the program [24]. These merits might be applicable to education in the workplace, because most Japanese people of working age are familiar with comics.

thumbnail
Figure 1. A screen shot of an Internet-based cognitive behavioral therapy (iCBT) program developed in “Manga” (the Japanese cartoon or comic story) format in this study.

https://doi.org/10.1371/journal.pone.0097167.g001

In terms of the CBT components of the program, included were self-monitoring skills, cognitive restructuring skills, assertiveness, problem-solving skills, and relaxation skills. At the end of each lesson, participants were asked to submit homework to facilitate their understanding, although it was voluntary. Participants who submitted their homework received feedback from trained staff (clinical psychologists).

The iCBT program included self-monitoring skills (in lesson 2), cognitive restructuring skills (in lessons 3 and 4), assertiveness (in lesson 5), problem-solving skills (in lesson 6), and relaxation skills (in lesson 4). In this study, a cognitive restructuring method was adopted as the primary outcome and main cognitive approach, and this has been shown to be effective in reducing depression [25]. Assertiveness and problem-solving training as well as relaxation skills were chosen as supplementary behavioral approaches to enhance the effect of the program.

Intervention group

Participants completed six weekly lessons and homework within the iCBT program. They were allowed to complete the six lessons within 10 weeks after the baseline survey. Participants were reminded by e-mail to complete each lesson and/or to submit homework if they had not already done so. Reminders were sent from the research office to the participants every Monday.

Control group

Participants in the control group received an e-mail message once a month titled “Useful information for stress management.” Each e-mail message consisted of about 500 words in Japanese and included stress management tips. The contents were as follows: 1) How to have a good sleep, 2) The effects of your diet and ingesting alcohol for stress, 3) How to have a good holiday, 4) Relaxing by listening to music and taking a bath, and 5) The effects of exercise on stress. Participants were also able to use an internal employee assistance program service. In addition, an e-learning program on stress and stress management was provided to all employees at company B. This e-learning program contained only a few descriptions of CB-based approaches.

Outcomes measures

Beck Depression Inventory II (BDI-II).

The BDI-II is a 21-item self-report inventory that measures depressive symptoms such as sadness, pessimism, suicidal thoughts or wishes, tiredness or fatigue, loss of energy, and loss of pleasure, among others [26], [27]. Each item is scored on a scale ranging from 0 to 3, with a higher score indicating more serious depressive symptoms.

Kessler's psychological distress scale (K6).

Psychological distress was measured with the Japanese version of the K6 scale [28], [29]. K6 consists of six items assessing the frequency with which respondents have experienced symptoms of psychological distress during the past 30 days. The response options range from 0 (none of the time) to 4 (all of the time). The internal reliability and validity found in previous studies are acceptable [28].

Japanese version of Dysfunctional Attitude Scale 24 (DAS24-J).

The 24-item Dysfunctional Attitude Scale (DAS-24) is a short version of the Dysfunctional Attitude Scale, which is a self-report inventory measuring depressogenic schemata. Each item is scored on a scale ranging from one (totally disagree) to seven (totally agree), with a higher score indicating a more dysfunctional attitude [30]. The Japanese version has been developed and tested, and its reliability and validity have been established [31].

Improvement of knowledge and self-efficacy.

Respondents were asked to rate their improvement of knowledge and self-efficacy regarding five components of the iCBT program (Stress management, Cognitive restructuring, Assertive communication, Problem-solving, Relaxation training). Knowledge improvement was assessed by asking participants, “How much knowledge do you have about…” and self-efficacy improvement was assessed by asking respondents “How confident are you that you can do….” Both items were scored on 5-point scale ranging from 0 (none) to 4 (enough).

Demographic characteristics.

Demographic data, such as age, gender, marital status, occupation, education, chronic disease, and overtime hours during the past month were also collected.

Sample size calculation

A systematic review of psychological treatments, mostly CBT for subthreshold depression, yielded a Cohen's d of 0.42 (95%CI: 0.23 to 0.60) at post-test [32]. On the other hand, it was reported that the effect of preventive interventions on the incidence of major depressive disorders was smaller in the universal setting than that in the selective or indicated setting [33]. In order to detect an effect size of 0.30 or greater at an alpha error rate of 0.05 and a beta error rate of 0.10, the estimated sample size was 235 participants per arm. With the anticipated dropout rate of 30%, the necessary sample size was 336 participants per arm. The statistical power analysis was conducted using the G*Power 3 program [34], [35].

Randomization

Participants who fulfilled the inclusion criteria were randomly allocated to intervention or control groups (N = 381 for each group). Stratified permuted-block randomization was conducted. Participants were stratified into four strata according to two factors: K6 score (5 or greater or less than 5) at baseline survey and company (A or B) to which they belonged. A stratified permuted-block random table was generated by an independent biostatistician. Enrollment was conducted by a clinical research coordinator, and assignment was conducted by an independent research assistant. The stratified permuted-block random table was password-protected and blinded to the researcher. Only the research assistant had access to it during the work of random allocation.

Statistical analyses

A mixed-model for repeated measures conditional growth model analyses were conducted using a group (intervention and control) * time (baseline, three-month, and six-month follow-up) interaction as an indicator of intervention effect. Intention-to-treat analysis (ITT) was conducted. The Linear Mixed Model in the PASW Statistics 18.0 was used. The Number Needed to Treat (NNT) to reduce depressive symptoms or psychological distress to achieve one improvement from subthreshold depression was calculated. Referencing the cutoff scores of BDI-II and K6 of previous studies [26], [36], the improvement was defined to change the scores from 14 or higher to 13 or less on the BDI-II or to change the scores from 5 or higher to 4 or less on the K6. Effect sizes and 95% Confidence Interval (95% CI) were calculated using Cohen's d among those who completed the questionnaire at baseline and at a follow-up. The values of 0.2, 0.5, and 0.8 are generally interpreted as being suggestive of small, medium, and large effects, respectively [37]. Subgroup analyses were conducted separately among respondents who had high (5 or higher score of K6) and low (4 or less score) scores at baseline, with the cutoff score for K6 selected based on a previous report, which suggested that 4/5 is the optimal cutoff point for K6 in terms of discriminating community residents and patients with mood and anxiety disorders [36].

Ethics

The Research Ethics Review Board of Graduate School of Medicine, the University of Tokyo (No. 3083) approved the study procedures. We prepared a website which contained full explanation of the study. Before the baseline survey, participants were invited to read the explanation on the website, and asked to click an “agree” button to show their consent to participate in the study; then they proceeded to the baseline questionnaire page. Written consent was not required by the National Ethical Guidelines for Epidemiologic Research, Japan; the Research Ethics Review Board of Graduate School of Medicine, the University of Tokyo approved this procedure to obtain participant's consent.

Changes to the protocol

One major change made to the protocol is the inclusion criteria. Originally it was planned that the participants who scored 5 or more for the K6 on the baseline survey would be allocated. Before the commencement of this study, this criterion was canceled due to the anticipation of a low participation rate. With this, sample size was recalculated. Another change made to the protocol is the method of statistical analysis. Originally the per-protocol analysis was planned, but the ITT analysis was conducted in the present study due to the expectation to be conservative in superiority trials. In addition, NNT was calculated due to the description of the difference between a treatment and a control in achieving a particular outcome.

Results

Participant flowchart

Participant flowchart is shown in Figure 2. Participants were recruited from 2 companies (N = 1790), and 850 (47.5%) of them completed a baseline survey. Out of those, 88 had to be excluded because 20 did not fulfill criterion #1 (not diagnosed as major depressive disorder in the past 1 month), and 2 did not fulfill criterion #2 (not diagnosed as lifetime bipolar disorder), which were assessed using the web-version of WHO-CIDI 3.0. An additional 35 did not fulfill criterion #3 (not having taken 15 or more sick leave days in total due to their own health problems during the past 3 months), and 42 did not fulfill criterion #4 (not having gone to the hospital during the past 1 month). Seven of them did not fulfill criteria #1 and #4, and four of them did not fulfill criteria #3 and #4. The remaining 762 participants were randomly allocated to an intervention or control group (N = 381 for each).

At 3-month follow-up, 270 (70.9%) participants in the intervention group and 336 (88.2%) in the control group completed the follow-up survey. At the 6-month follow-up, 272 (71.4%) participants in the intervention group and 320 (84.0%) in the control group completed the follow-up survey. At each follow-up, the response rate of the control group was higher compared to that of the intervention group. Reasons for dropping out were not assessed in this study.

Recruitment

Recruitment and the baseline survey were conducted during the period from September to October 2011. The intervention and control groups were assessed at approximately three months (from December 2011 to January 2012) and approximately six months (from March to April 2012) after the baseline survey.

Baseline characteristics

Demographic characteristics are presented in Table 1. There were no significant differences in demographic characteristics between the intervention and control groups. In both groups, most participants were males, professionals, and university graduates with no chronic disease.

thumbnail
Table 1. Baseline characteristics of participants in the intervention and control groups.

https://doi.org/10.1371/journal.pone.0097167.t001

Effects of the iCBT program on each outcome variable

Table 2 shows the means and SDs of the outcome variables at baseline, three-month, and six-month follow-ups in the intervention and control groups. Table 3 shows the estimated effects of the iCBT program on the outcome variables based on the mixed-model analyses as well as the effect sizes (Cohen's d). The iCBT program showed a significant effect on BDI-II (t = −1.99, p<0.05). The effect sizes were small. For BDI-II, the effect size was −0.14 (95% CI: −0.30 to 0.02) at the 3-month follow-up and −0.16 (95% CI: −0.32 to 0.00) at the 6-month follow-up.

thumbnail
Table 2. Means (SDs) of outcome variables at baseline, 3- and 6-month follow-up in the intervention and control groups for the whole sample.

https://doi.org/10.1371/journal.pone.0097167.t002

thumbnail
Table 3. Effect of the internet-based computerized cognitive behavioral therapy (iCBT) program on primary and secondary outcome variables for the whole sample.

https://doi.org/10.1371/journal.pone.0097167.t003

Secondary outcomes.

The iCBT program showed a significant effect on DAS (t = -2.43, p = 0.02) and all knowledge and efficacy variables (p<0.05) except for the efficacy of problem solving. The program showed a marginally statistically significant effect on K6 (t = −1.72, p = 0.09) and efficacy of problem-solving (t = 1.82, p = 0.07). Effect sizes for K6, DAS, and improvement of self-efficacy were small, while effect sizes for knowledge variables were medium.

NNT for improving subthreshold depression.

Among respondents at the 3-month follow-up, 32.1% and 20.2% had a remission from subthreshold depression defined by BDI-II and K6, respectively. At the 6-month follow-up, 30.1% and 19.7% of respondents had a remission from subthreshold depression on BDI-II and K6, respectively. No significant difference was observed in the remission based on BDI-II between the intervention and control groups: relative risk (RR) of having subthreshold depression in the intervention group were 0.79 (p = 0.22) at the 3-month follow-up and 0.77 (p = 0.20) at the 6-month follow-up; the NNTs to achieve one remission from subthreshold depression were 14 at the 3-month follow-up and 13 at the 6-month follow-up. The probability of the remission based on K6 was not significantly different between the groups at the 3-month follow-up (RR = 1.02, p = 0.94) and was marginally significantly higher in the intervention group than in the control group at the 6-month follow-up (RR = 0.63, p = 0.06); the NNTs were -279 at the 3-month follow-up and 12 at the 6-month follow-up.

Subgroup analyses

Respondents with high psychological distress.

The subgroup analysis was conducted for participants who scored 5 or more on K6 at the baseline. Table 4 shows the means and SDs of outcome variables at baseline, 3-month, and 6-month follow-ups for the intervention and control groups who scored 5 or more on the K6 at the baseline (N = 194 for each group). Table 5 shows the estimated effects of the iCBT program on outcomes variables as well as the effect sizes (Cohen's d). The iCBT program showed a significant effect on BDI-II (t = −2.12, p = 0.04). The effect size for BDI-II was small, −0.16 at the 3-month follow-up and −0.25 at the 6-month follow-up.

thumbnail
Table 4. Means (SDs) of outcome variables at baseline, 3- and 6-month follow-up in the intervention and control groups: Analysis of participants with high psychological distress at baseline (K6≧5).

https://doi.org/10.1371/journal.pone.0097167.t004

thumbnail
Table 5. Effect of the iCBT program on primary and secondary outcome variables: Analysis of participants with high psychological distress at baseline (K6≧5).

https://doi.org/10.1371/journal.pone.0097167.t005

The iCBT program showed a significant effect on DAS (t = −2.36, p = 0.02), all knowledge variables, efficacy of stress management, assertive communication, and relaxation training (p<0.05). While the effect sizes of DAS and self-efficacy were small, those for variables on knowledge were medium.

Process evaluation.

Table 6 shows the process evaluation indicators of the iCBT programs only for the intervention group. Most (89%) participants in the intervention group completed Lesson 1, and 65% submitted their homework after completing this lesson. The proportion of those who completed lessons and submitted homework gradually decreased during the later lessons. About two thirds of the intervention group completed all six lessons, while only a quarter of them submitted all six homework assignments. The average number of lessons that the respondents received was 4.5. The average number of homework assignments submitted was 2.7. Three quarters of the intervention group completed at least three lessons, and about half (45%) submitted at least three homework assignments.

thumbnail
Table 6. Progress of learning in the iCBT program among the intervention group participants: the whole sample.

https://doi.org/10.1371/journal.pone.0097167.t006

Discussion

The present RCT examined the effects of a newly developed iCBT program for improving the symptoms of depression and other outcomes at three- and six-month follow-ups among workers employed in private companies in Japan. In the total sample, the iCBT program showed a significant intervention effect on depression, as measured by BDI-II, with the effect sizes of −0.16 at the six-month follow-up. The iCBT program also showed a marginally statistically significant intervention effect on psychological distress measured by K6 and significant intervention effects on improving dysfunctional attitude, knowledge, and self-efficacy of most components of CBT. This iCBT program may effectively improve depressive symptoms among workers with the universal approach (i.e., targeting the whole working population), even though the effect size may be modest.

To our knowledge, the present study first demonstrated that an Internet-based computerized CBT was effective in improving depression in a non-clinical working population. In the intervention group, BDI-II scores improved at the three-month follow-up and returned to the baseline level at the six-month follow-up. In the control group, BDI-II scores stayed at almost the same level at the three-month follow-up and increased slightly by the six-month follow-up. This difference yielded effect sizes of −0.14 and −0.16 on BDI-II scores at the three- and six-month follow-ups, respectively. After the baseline survey, one of the two companies that participated in the study merged with another company. The observed increase in depression in the control group was partly attributable to the increased workload associated with the organizational change. The current iCBT program seems to improve depression to some extent under severe working conditions. With consideration for the fact that an iCBT can be delivered to many workers at a low cost, this iCBT may be a promisingly cost-effective approach for improving depression among workers. The effect size of the current iCBT program for improving depression was small (around 0.15). Grime (2004) reported that the effect sizes (Cohen's d) of CCBT on depression among workers who recently had stress-related absenteeism were −0.25 (p = 0.04) at one month after the end of intervention and −0.1 (p = 0.56) at the three-month follow-up [18]. The current iCBT program might be effective in improving depression among workers to a similar or greater extent compared to the ordinary CCBT program. The small effect sizes in the present study could be attributable to the non-clinical sample and the lower degree of therapist involvement in this iCBT program [16], [17]. In fact, the iCBT program showed a better intervention effect on BDI-II, when the analysis was limited to those who have high depression score at baseline (−0.16 and −0.25 at the three- and six-month follow-ups, respectively), which is concordant with a previous meta-analysis that the effect of CBT programs in preventing major depressive disorder was greater for selective and indicated interventions than the universal one [33].

In the present study, the NNTs to achieve one remission from subthreshold depression were 14 at the 3-month follow-up and 13 at the 6-month follow-up for BDI-II. These were −279 at the 3-month follow-up and 12 at the 6-month follow-up for K6. These figures were larger than those of the previously reported NNTs of iCBT for improving depression among patients with major depressive disorder (2 to 4), when compared with TAU or waiting list [32]. However, these were lower (thus better) than a NNT that reported a RCT using the automated e-mails containing general information and advice about self-help strategies for depression to achieve one remission from subthreshold depression (26) [38]. The NNTs of the present iCBT program fall between these studies of clinical and non-clinical populations.

The iCBT program showed a significant intervention effect on dysfunctional attitude measured by the DAS in terms of knowledge and efficacy of most CBT components except for self-efficacy of problem solving. Dysfunctional attitude is one of major targets of cognitive restructuring, a component of the current program. The present findings are consistent with previous ones that a CCBT program was effective in improving dysfunctional attitudes among medication-free participants with major depressive disorder [39], while the present study observed a larger effect size than that of the previous study (0.5). The effect sizes for knowledge were better than the one reported by a previous worksite-based study [40]. In addition, improved levels of knowledge and self-efficacy were maintained at the six-month follow-up. Downloadable PDF summaries of sessions of the iCBT program may have helped participants maintain their knowledge and self-efficacy. This may also be a benefit of using Manga story as a part of the iCBT program, while we did not systematically assess it.

The process evaluation of the iCBT program indicated that proportions of those who completed lessons and submitted homework decreased for the later lessons. About two-thirds of the intervention group completed all six lessons, while only a quarter of them submitted all six homework assignments. The completion rates of self-help programs without clinician contact were generally low [13]. The average number of completed lessons per respondent (4.5) in this six-lesson iCBT program was very close to that of a previous seven-chapter self-help iCBT program [41], [42]. The low rates of completing the lessons and submitting homework may have resulted in a smaller effect size in this study. It would be critical to increase completion rates to improve the effect of an iCBT program.

Limitations

This study has several limitations. First, participants were recruited from two IT companies in Japan. Most participants were males, working as professionals, and university graduates. They had their own PCs in their offices or homes. The participants were also supposed to have experience using a PC and studying through online programs. Higher education level may also help participants learn from the iCBT program. The generalization of the present findings to the general working population is limited. Second, the rate of completing lessons and homework was low. Only 93 participants submitted all homework assignments, and the average number of homework assignments submitted was 2.7 per respondent. This may weaken the findings. Third, the dropout rates in the present study were 29.1% and 28.6% at the three- and six-month follow-ups, respectively. In their systematic review, Kaltenthaler et al. (2008) reported that average CCBT dropout rates were 18–35% [43]. Wantland et al. (2004) reported that an average dropout rate was 21% [44]. The dropout rates in the present study were within the range. However, the dropouts may cause a selection bias, particularly if the intervention group participants with higher levels of depression were more likely to quit the program. Fourth, the present study provided the participants in the control group with e-mails providing stress management tips. This may weaken the intervention effect. Fifth, there was the possibility that participants in the control group could have information about the iCBT program from participants in the intervention group at same workplace. This contamination may weaken the intervention effect. Sixth, all outcomes in the present study were measured by self-report, which may be affected by the perception of participants or situational factors at work. A further RCT should be conducted to examine whether the iCBT program is effective in a larger sample of workers with diverse characteristics, particularly in terms of occupation and education.

Supporting Information

Checklist S1.

CONSORT 2010 checklist of information to include when reporting a randomized trial.

https://doi.org/10.1371/journal.pone.0097167.s001

(DOCX)

Protocol S1.

The original protocol in Japanese.

https://doi.org/10.1371/journal.pone.0097167.s002

(DOCX)

Protocol S2.

English translation of the original Japanese protocol.

https://doi.org/10.1371/journal.pone.0097167.s003

(DOCX)

Acknowledgments

We appreciate the help of the following persons in completing this project: Takayuki Narumi, Jun Naoi, Keisuke Kito, Chinatsu Narumi, Fukiko Ueda, And Mizuho Yamagishi.

Author Contributions

Conceived and designed the experiments: KI NK TAF. Performed the experiments: KI NK YM KK. Analyzed the data: KI NK YM. Contributed reagents/materials/analysis tools: KI NK RU SK. Wrote the paper: KI NK TAF AS.

References

  1. 1. Kivimäki M, Virtanen M, Elovainio M, Kouvonen A, Väänänen A, et al. (2006) Work stress in the etiology of coronary heart disease—a meta-analysis. Scand J Work Environ Health 32: 431–442.
  2. 2. Stansfeld S, Candy B (2006) Psychosocial work environment and mental health—a meta-analytic review. Scand J Work Environ Health 32: 443–462.
  3. 3. Limm H, Gündel H, Heinmüller M, Marten-Mittag B, Nater UM, et al. (2011) Stress management interventions in the workplace improve stress reactivity: a randomised controlled trial. Occup Environ Med 68: 126–133.
  4. 4. Beck AT (1967) Depression: clinical, experimental, and theoretical aspects. New York: Hoeber Medical Division. xiv, 370 p. p.
  5. 5. Beck AT (1979) Cognitive therapy of depression. New York: Guilford Press. 425 p. p.
  6. 6. Richardson KM, Rothstein HR (2008) Effects of occupational stress management intervention programs: a meta-analysis. J Occup Health Psychol 13: 69–93.
  7. 7. van der Klink JJ, Blonk RW, Schene AH, van Dijk FJ (2001) The benefits of interventions for work-related stress. Am J Public Health 91: 270–276.
  8. 8. World Health Organization, Department of Mental Health and Substance Abuse (2005) Mental health atlas 2005. Geneva: World Health Organization. 540 p. p.
  9. 9. World Health Organization, Department of Mental Health and Substance Abuse (2011) Mental health atlas 2011. Geneva: World Health Organization. 82 p. p.
  10. 10. World Health Organization, Department of Mental Health and Substance Abuse (2001) Atlas: Mental Health Resources in the World 2001. Geneva: World Health Organization.
  11. 11. Ruwaard J, Lange A, Bouwman M, Broeksteeg J, Schrieken B (2007) E-mailed standardized cognitive behavioural treatment of work-related stress: a randomized controlled trial. Cogn Behav Ther 36: 179–192.
  12. 12. Titov N, Andrews G, Sachdev P (2010) Computer-delivered cognitive behavioural therapy: effective and getting ready for dissemination. F1000 Med Rep 2..
  13. 13. Spurgeon JA, Wright JH (2010) Computer-assisted cognitive-behavioral therapy. Curr Psychiatry Rep 12: 547–552.
  14. 14. Gega L, Marks I, Mataix-Cols D (2004) Computer-aided CBT self-help for anxiety and depressive disorders: experience of a London clinic and future directions. J Clin Psychol 60: 147–157.
  15. 15. Spek V, Cuijpers P, Nyklicek I, Riper H, Keyzer J, et al. (2007) Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med 37: 319–328.
  16. 16. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N (2010) Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 5: e13196.
  17. 17. Andersson G, Cuijpers P (2009) Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther 38: 196–205.
  18. 18. Grime PR (2004) Computerized cognitive behavioural therapy at work: a randomized controlled trial in employees with recent stress-related absenteeism. Occup Med (Lond) 54: 353–359.
  19. 19. Kishi Y, Matsumura T, Murishige N, Kodama Y, Hatanaka N, et al. (2011) Internet-based survey on medical manga in Japan. Health Commun 26: 676–678.
  20. 20. Delp C, Jones J (1996) Communicating information to patients: The use of cartoon illustrations to improve comprehension of instructions. Academic Emergency Medicine 3: 264–270.
  21. 21. McDermott TJ (1989) Cartooning: a humorous approach to medical and health education. J Biocommun 16: 20–27.
  22. 22. Peters L, Clark D, Carroll F (1998) Are computerized interviews equivalent to human interviewers? CIDI-Auto versus CIDI in anxiety and depressive disorders. Psychol Med 28: 893–901.
  23. 23. Hutchinson KH (1949) An Experiment in the Use of Comics as Instructional Material. Journal of Educational Sociology 23: 236–245.
  24. 24. Sones WWD (1944) The Comics and Instructional Method. Journal of Educational Sociology 18: 232–240.
  25. 25. Jakobsen JC, Hansen JL, Storebø OJ, Simonsen E, Gluud C (2011) The effects of cognitive therapy versus ‘no intervention’ for major depressive disorder. PLoS One 6: e28299.
  26. 26. Beck AT, Steer RA, Brown GK (1996) BDI-II, Beck depression inventory: manual. San Antonio, Tex. Boston: Psychological Corp.; Harcourt Brace. vi, 38 p. p.
  27. 27. Hiroe T, Kojima M, Yamamoto I, Nojima S, Kinoshita Y, et al. (2005) Gradations of clinical severity and sensitivity to change assessed with the Beck Depression Inventory-II in Japanese patients with depression. Psychiatry Res 135: 229–235.
  28. 28. Furukawa TA, Kawakami N, Saitoh M, Ono Y, Nakane Y, et al. (2008) The performance of the Japanese version of the K6 and K10 in the World Mental Health Survey Japan. Int J Methods Psychiatr Res 17: 152–158.
  29. 29. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, et al. (2002) Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med 32: 959–976.
  30. 30. Power MJ, Katz R, McGuffin P, Duggan CF, Lam D, et al. (1994) The Dysfunctional Attitude Scale (DAS): A Comparison of Forms A and B and Proposals for a New Subscaled Version. Journal of Research in Personality 28: 263–276.
  31. 31. Tajima M, Akiyama T, Numa H, Kawamura Y, Okada Y, et al. (2007) Reliability and validity of the Japanese version of the 24-item Dysfunctional Attitude Scale. Acta Neuropsychiatrica 19: 362–367.
  32. 32. Cuijpers P, Smit F, van Straten A (2007) Psychological treatments of subthreshold depression: a meta-analytic review. Acta Psychiatr Scand 115: 434–441.
  33. 33. Cuijpers P, van Straten A, Smit F, Mihalopoulos C, Beekman A (2008) Preventing the onset of depressive disorders: a meta-analytic review of psychological interventions. Am J Psychiatry 165: 1272–1280.
  34. 34. Faul F, Erdfelder E, Buchner A, Lang AG (2009) Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods 41: 1149–1160.
  35. 35. Faul F, Erdfelder E, Lang AG, Buchner A (2007) G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods 39: 175–191.
  36. 36. Sakurai K, Nishi A, Kondo K, Yanagida K, Kawakami N (2011) Screening performance of K6/K10 and other screening instruments for mood and anxiety disorders in Japan. Psychiatry Clin Neurosci 65: 434–441.
  37. 37. Cohen J (1992) A Power Primer. Psychological Bulletin 112: 155–159.
  38. 38. Morgan AJ, Jorm AF, Mackinnon AJ (2012) Email-based promotion of self-help for subthreshold depression: Mood Memos randomised controlled trial. Br J Psychiatry 200: 412–418.
  39. 39. Wright JH, Wright AS, Albano AM, Basco MR, Goldsmith LJ, et al. (2005) Computer-assisted cognitive therapy for depression: maintaining efficacy while reducing therapist time. Am J Psychiatry 162: 1158–1164.
  40. 40. Billings DW, Cook RF, Hendrickson A, Dove DC (2008) A web-based approach to managing stress and mood disorders in the workforce. J Occup Environ Med 50: 960–968.
  41. 41. Clarke G, Eubanks D, Reid E, Kelleher C, O'Connor E, et al. (2005) Overcoming Depression on the Internet (ODIN) (2): a randomized trial of a self-help depression skills program with reminders. J Med Internet Res 7: e16.
  42. 42. Clarke G, Reid E, Eubanks D, O'Connor E, DeBar LL, et al. (2002) Overcoming depression on the Internet (ODIN): a randomized controlled trial of an Internet depression skills intervention program. J Med Internet Res 4: E14.
  43. 43. Kaltenthaler E, Sutcliffe P, Parry G, Beverley C, Rees A, et al. (2008) The acceptability to patients of computerized cognitive behaviour therapy for depression: a systematic review. Psychol Med 38: 1521–1530.
  44. 44. Wantland DJ, Portillo CJ, Holzemer WL, Slaughter R, McGhee EM (2004) The effectiveness of Web-based vs. non-Web-based interventions: a meta-analysis of behavioral change outcomes. J Med Internet Res 6: e40.