Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A RCT of a Transdiagnostic Internet-Delivered Treatment for Three Anxiety Disorders: Examination of Support Roles and Disorder-Specific Outcomes

  • Luke Johnston ,

    luke.johnston@mq.edu.au

    Affiliation CRUfAD, School of Psychiatry, University of New South Wales at St Vincent's Hospital, Sydney, Australia

  • Nickolai Titov,

    Affiliation eCentreClinic, Department of Psychology, Centre for Emotional Health, Macquarie University, Sydney, Australia

  • Gavin Andrews,

    Affiliation CRUfAD, School of Psychiatry, University of New South Wales at St Vincent's Hospital, Sydney, Australia

  • Jay Spence,

    Affiliation eCentreClinic, Department of Psychology, Centre for Emotional Health, Macquarie University, Sydney, Australia

  • Blake F. Dear

    Affiliation eCentreClinic, Department of Psychology, Centre for Emotional Health, Macquarie University, Sydney, Australia

Abstract

Background

Anxiety disorders share common vulnerabilities and symptoms. Disorder-specific treatment is efficacious, but few access evidence-based care. Administering transdiagnostic cognitive-behavioral therapy via the internet (iCBT) may increase access to evidence-based treatment, with a recent randomized controlled trial (RCT) providing preliminary support for this approach. This study extends those findings and aims to answer three questions: Is a transdiagnostic iCBT program for anxiety disorders efficacious and acceptable? Does it result in change for specific disorders? Can good clinical outcomes be obtained when guidance is provided via a Coach rather than a Clinician?

Method

RCT (N = 131) comparing three groups: Clinician-supported (CL) vs. Coach-supported (CO) vs. waitlist control (Control). Individuals met DSM-IV criteria for a principal diagnosis of generalized anxiety disorder (GAD), social phobia (SP) or panic disorder with or without agoraphobia (Pan/Ag). Treatment consisted of an 8-lesson/10 week iCBT program with weekly contact from a Clinician or Coach, and follow-up at 3-months post-treatment.

Results

Outcomes for the pooled treatment groups (CL+CO) were superior to the Control group on measures of anxiety, depression and disability, were associated with medium to large effect sizes (Cohen's d = .76 – 1.44) (response rate = 89–100%), and were maintained at follow-up. Significant reductions were found on disorder-specific outcomes for each of the target diagnoses, and were associated with large effect sizes. CO participants achieved similar outcomes to CL participants at post-treatment, yet had significantly lower symptom severity scores on general anxiety, panic-disorder, depression and disability at follow-up (d = .45 – .46). Seventy-four percent of CO and 76% of CL participants completed the program. Less than 70 minutes of Clinician or Coach time was required per participant during the program.

Discussion

This transdiagnostic iCBT course for anxiety appears to be efficacious, associated with significant change for three target disorders, and is efficacious when guided by either a Clinician or Coach.

Trial Registration

Australian New Zealand Clinical Trials Registry ACTRN12610000242022

Introduction

The anxiety disorders frequently co-occur and share similar vulnerability factors and symptoms [1]. Disorder-specific treatment protocols for anxiety are effective [2], however, less than 40% of people with anxiety access mental health services [3]. There is growing interest in improving access and availability of treatment by integrating low-intensity treatments, aimed at balancing minimal intervention to maximum clinical gain, into routine care for common mental disorders such as anxiety and depression [4], [5]. Two innovative approaches that have the potential to improve the proportion treated are Internet-delivered cognitive behavioral therapy (iCBT) and transdiagnostic treatments.

iCBT programs teach the techniques of CBT in a highly structured format and involve the delivery of online lessons with remote support from a clinician. Meta-analyses of iCBT and computerized CBT for anxiety disorders and depression indicate that these treatments produce superior effect sizes over control conditions and are comparable to face-to-face treatments [6], [7], [8]. Moreover, three studies compared clinical and non-clinical support roles for guided iCBT and revealed no difference in efficacy [9], [10], [11].

The second innovative approach is the use of transdiagnostic protocols, also described as unified [12] or broad spectrum [13] treatments. Transdiagnostic protocols can be considered as those that apply treatment principles that are common to similar mental disorders without being tailored to, or requiring knowledge of, a specific diagnosis to be effective [14], [15], [16]. While these protocols have been created for the treatment of similar disorders, an unresolved issue in this area concerns which disorders are suitable for transdiagnostic treatment, particularly regarding PTSD and OCD relative to other anxiety disorders [17]. Despite this, meta-analyses of a relatively small number of studies indicate that face-to-face transdiagnostic treatments may result in similar outcomes on generic anxiety measures to disorder-specific treatments [16], [18].

Evidence for the effectiveness of computer-delivered transdiagnostic treatments was provided by two early studies that used computerized CBT to treat panic and phobias, and anxiety and depression, demonstrating symptom reduction from single treatment protocols [19], [20]. These programs have now been integrated within the UK Improved Access to Psychological Therapies program, stepping consumers from low to high-intensity treatments as clinically required, with completer analyses demonstrating good outcomes [4]. Additionally, preliminary support for the efficacy of an internet-delivered transdiagnostic treatment was reported in a recent RCT examining a transdiagnostic iCBT program for generalized anxiety disorder (GAD), social phobia (SP) and panic disorder (with or without agoraphobia) (Pan/Ag), demonstrating reductions in anxiety, distress and disability [21]. The lessons in this program covered core components including psychoeducation, cognitive restructuring, graded exposure, troubleshooting common treatment difficulties and relapse prevention. Additional resources covering issues such as low mood, improving sleep and communication skills, were accessed by all participants and were not prescribed. However, the sample size was not sufficient to reliably examine whether changes occurred in outcome measures for each of the three anxiety disorders.

The present study was an extension of the aforementioned study [21], using a larger sample to explore a revised version of the program, and also compared the relative benefits of Coach against Clinician guidance. This study attempted to answer three questions:

  1. Is a transdiagnostic iCBT program for anxiety disorders efficacious and acceptable?
  2. Does the program result in change for each specific disorder?
  3. Can good clinical outcomes be obtained when support is provided by a Coach when compared with a Clinician?

Methods

The protocol for this trial and supporting CONSORT checklist are available as supporting information; see Checklist S1 and Protocol S1.

Design and objectives

The objectives were to determine (1) the efficacy of a transdiagnostic iCBT program for anxiety disorders, (2) the relative benefits to each of the target disorders, and (3) to compare outcomes when the program is supported by either a Clinician or Coach. The design comprised a CONSORT-R compliant RCT comparing three parallel conditions: A Clinician-assisted iCBT treatment group (CL group); a Coaching-assisted iCBT treatment group (CO group); and a waitlist deferred-treatment control group (Control).

Hypotheses

The three hypotheses were: 1) The pooled CL and CO group (CL+CO) participants would show significant improvement on general and disorder-specific measures of anxiety, and measures of depression and disability after treatment, relative to Control participants, and would rate the treatment as acceptable; 2) the pooled CL+CO participants would show significant improvement on disorder-specific measures of anxiety over time, and; 3) participants in the CO group would achieve at similar outcomes to the CL group across all measures and time points.

Ethics

The study was approved by the Human Research Ethics Committee (HREC) of St Vincent's Hospital (Sydney, Australia) and the HREC of the University of New South Wales (Sydney, Australia). All participants provided written informed consent. The trial was registered as ACTRN12610000242022.

Participants

Potential participants consisted of individuals who had previously expressed interest in treatment via the online programs available on a research website, or from visitors to the website. Applicants applied online to the research website where they read details about the study. Details of participant flow are in Figure 1. During the 4 weeks of recruitment in early 2010, 253 individuals applied and 139 met the following inclusion criteria: (i) resident of Australia; (ii) at least 18 years of age; (iii) access to a computer, the Internet, and use of a printer; (iv) not currently participating in CBT; (v) not using illicit drugs or consuming more than three standard drinks a day; (vi) not currently experiencing a psychotic mental illness or severe symptoms of depression (defined as a total score >22 or responding >2 to Question 9 (suicidal ideation) on the Patient Health Questionnaire - 9 Item [22]; (vii) if taking medication (people taking benzodiazepines were excluded), had been taking the same dose for at least 1 month and did not intend to change that dose during the course of the program; and (viii) met DSM-IV [23] diagnostic criteria for a principal diagnosis (defined as the disorder the participant nominated as most troubling) of GAD, SP, or Pan/Ag. Applicants who did not meet these criteria were informed via an on-screen message and were sent an email thanking them for their application and encouraging them to discuss their symptoms with their physician. Participants who met the inclusion criteria then completed a 25-item questionnaire enquiring about demographic details and treatment history (see Table 1).

thumbnail
Figure 1. CONSORT-R participant flow chart.

PHQ-9, Patient Health Questionnaire – 9 Item; MINI 5.0.0, Mini International Neuropsychiatric Interview.

https://doi.org/10.1371/journal.pone.0028079.g001

thumbnail
Table 1. Demographic characteristics of the Coach assisted, Clinician assisted and Control groups.

https://doi.org/10.1371/journal.pone.0028079.t001

Applicants who passed the screening phase were telephoned and administered a diagnostic interview using the Mini International Neuropsychiatric Interview Version 5.0.0 (MINI) [24] to determine whether they met DSM-IV criteria [23] for GAD, SP or Pan/Ag. Applicants who satisfied all criteria and completed a consent form were included in the study.

Interventions

Both treatment groups received access to the Anxiety Program [21]. The intervention used in the present study employed a version with the following changes: i) information about cognitive skills were presented in the second rather than third lesson; ii) two new lessons were added to address core beliefs, beliefs about anxiety, and assertive communication and interpersonal boundaries; iii) the duration of the program was increased from eight to ten weeks. The enhanced Anxiety Program comprised the following components: Eight online lessons; a summary/homework assignment for each lesson; weekly telephone or email/asynchronous messaging contact with the Clinician or Coach, and regular automated reminder and notification emails. All participants also had access to additional written resources that included guidelines about managing low mood, improving sleep, and answers to frequently asked questions about the application of skills described in the lessons and summaries, although these were not prescribed as per other treatment protocols [25]. Participants were also provided with access to de-identified vignettes written by participants in previous iCBT programs covering topics relevant to each of the eight lessons. The content of each lesson is described in Table 2.

Each Lesson began with a restatement of the key skills described in previous lessons, an introduction to skills described in the current lesson, illustrated examples about people with each of the target disorders practicing those skills, and a summary of the main points. Participants were encouraged to complete one lesson each week, to complete the recommended homework and to complete the eight lessons within 10 weeks.

Clinician/Coach roles

Two staff conducted the study with supervision from NT. The Clinician role was fulfilled by JS who had completed specialist post-graduate training in Clinical Psychology, had 2.5 years post-clinical training experience, had previously treated participants using iCBT in two other trials [9], [21], and was employed as a Clinical Psychologist at the Anxiety Disorders Clinic, St Vincent's Hospital Sydney. The Coach role was performed by LJ, a Registered Psychologist without specialist post-graduate training, employed as a Research Assistant at the same research unit.

Clinician and Coach roles performed specific and distinct functions. Both roles required strict adherence to a pre-determined script to be followed throughout all contact with participants that specified: Reinforcing progress to date; encouraging the completion of further lessons; encouraging practice of homework tasks; normalising difficulties with practicing homework tasks; and providing direction to upcoming materials. In the event of receiving clinical questions the Coach was instructed to direct the participant to the program content or inform of upcoming materials that would address the question. The Coach was not permitted to provide clinical advice or to elaborate, expand upon or add to the existing information or skills provided in the program. The Clinician, however, was invited to provide therapy and engage the participant in more detailed discussion of the materials including how to apply the treatment, to provide further detail about the skills, assist the participant in practicing those skills, and suggest additional skills if applicable. Both Clinician and Coach received weekly supervision from an independent clinical psychologist (NT) as a matter of routine professional and ethical care. These sessions allowed discussion of clinical issues, and the opportunity for the Coach to refer participants to the Clinician in the event of any perceived deterioration in the participants' mental health status, or of any concerns about participants' wellbeing. Supervision was also provided to reinforce adherence to the script and guidelines and ensure that the Coach did not attempt ‘therapy’. Both Clinician and Coach were advised to limit weekly contact time to approximately 10 minutes per participant, unless more time was clinically indicated. Every instance of contact with each participant was recorded as was the total time that the Clinician and Coach spent per participant.

Outcomes

A wide range of measures were used. The total number of questionnaire items was kept below 80 to reduce burden on participants. The Mini International Neuropsychiatric Interview Version 5.0.0 (MINI) [24] was used as a diagnostic measure. The Generalized Anxiety Disorder 7-Item Scale, (GAD-7) [26] and Depression Anxiety Stress Scales – 21 Item (DASS-21) [27] were used as primary outcome measures. The Penn State Worry Questionnaire (PSWQ) [28], Social Interaction Anxiety Scale and Social Phobia Scale – Short Form (SIAS-6/SPS-6) [29] and Panic Disorder Severity Scale – Self Rating (PDSS-SR) [30] were used as disorder-specific outcome measures. The Patient Health Questionnaire – 9 Item (PHQ-9) [22] and Sheehan Disability Scales (SDS) [31] were used as secondary outcome measures. Each of these measures will be discussed in detail below.

Mini International Neuropsychiatric Interview Version 5.0.0 (MINI) [24].

The MINI is a brief diagnostic interview developed to determine the presence of current and lifetime Axis-I disorders using DSM-IV diagnostic criteria and was chosen in favour of other diagnostic interviews to reduce participant burden. Psychometric evaluations of the MINI [32] indicate it has excellent inter-rater reliability (k = .88 – 1.00) and adequate concurrent validity with the Composite International Diagnostic Interview. Pre-treatment interviews were conducted by LJ and JS. Three-month follow-up interviews were conducted by LJ, JS and BD.

Generalized Anxiety Disorder 7-Item Scale, (GAD-7) [26].

The GAD-7 comprises seven items measuring symptoms and severity of GAD based on the DSM-IV diagnostic criteria for GAD. The GAD-7 has good internal consistency (.89) and good convergent validity with other anxiety scales [33]. Evidence indicates the GAD-7 is sensitive to GAD, social phobia, and panic disorder with increasing scores indicating greater severity of symptoms [34]. The GAD-7 is increasingly used in research and in large scale dissemination studies as a generic measure of change in anxiety symptoms [4], [35]. The internal consistency of the GAD-7 in the current study was high (Cronbach's α = .86).

Depression Anxiety Stress Scales – 21 Item (DASS-21) [27].

The DASS-21 is a measure of severity of symptoms for anxiety, stress, and depression, and is used to measure change in higher-order, or common symptoms across anxiety and depressive disorders. It comprises three subscales that assess features uniquely associated with depression, anxiety, and psychological distress. The 21-item short form has demonstrated excellent psychometric properties including good internal consistency and concurrent validity comparable with the original 42-item measure [36]. The internal consistency of the DASS-21 in the current study was high (Cronbach's α = .88).

Penn State Worry Questionnaire (PSWQ) [28].

The PSWQ consists of 16 items and is considered a valid clinical measure of worry characteristic of GAD. Early psychometric evaluations revealed the PSWQ had high internal consistency and temporal stability [28], and was able to differentiate patients with GAD from those with other anxiety disorders [37]. The internal consistency (Cronbach's α) of the PSWQ in the current study was .90.

Social Interaction Anxiety Scale and Social Phobia Scale – Short form (SIAS-6/SPS-6) [29].

The SIAS-6/SPS-6 is a recently developed brief measure of social anxiety (12 items) based on the items of the Social Interaction Anxiety Scale (SIAS) and the Social Phobia Scale (SPS) [38]. The measure correlated strongly and significantly with the SIAS and SPS in clinical samples at pre-treatment, post-treatment, and at 3-month follow-up (rs = .79 –.90), and also correlated strongly and significantly with change scores in the SIAS and SPS following treatment (rs = .81 –.91). Cronbach's α of the SIAS-6/SPS-6 in the current study was .92.

Panic Disorder Severity Scale – Self Rating (PDSS-SR) [30].

The PDSS-SR is a seven-item measure of panic disorder severity. Psychometric evaluations suggest it has excellent psychometric properties including high internal consistency (Cronbach's α = .92), good test-retest reliability (r = .81), and sensitivity to change [30]. Cronbach's α of the PDSS-SR in the current study was high (.92).

Patient Health Questionnaire – 9 Item (PHQ-9) [22].

The PHQ-9 is a nine-item measure of the symptoms and severity of major depressive disorder based on the DSM-IV criteria for depression. A total score of 10 on the PHQ-9 has also been identified as an important threshold for identifying DSM-IV congruent depression with increasing scores indicating greater symptom severity [22]. Psychometric studies indicate the internal consistency is high (.86 – .89) [22] and the measure is sensitive to change [33]. The internal consistency of the PHQ-9 in the current study was high (Cronbach's α = .84).

Sheehan Disability Scales (SDS) [31].

The SDS comprises three items measuring impairment in psychosocial functioning with high internal consistency (α = .89) [39]. The internal consistency (Cronbach's α) of the SDS in the current study was .83.

With the exception of the SIAS-6/SPS-6, which is still under evaluation, all of these measures are considered reliable, valid, and appropriate for clinical research purposes. Moreover, recent research indicates that online administration of questionnaires results in acceptable reliability of responses with emerging evidence for equivalence between paper-and-pencil versions of self-report questionnaires and online administration [40], [41], [42], [43]. At post-treatment, all participants also completed a 7-item treatment satisfaction questionnaire based on the Credibility/Expectancy Questionnaire (CEQ) [44]. Additional questions enquiring about treatment satisfaction with the transdiagnostic treatment protocol were administered to participants in the treatment groups at follow-up. All questionnaires were administered via the Internet.

Timepoints

All participants were asked to complete the questionnaire outcome measures (GAD-7, DASS-21, PSWQ, SIAS-6/SPS-6, PDSS-SR, PHQ-9 and SDS) at pre-treatment, post-treatment, and at 3-month follow-up. Control group participants began treatment immediately after the CL and CO post-treatment time point, so the 3-month follow up for the CL and CO groups coincided with the post-treatment time point for the Control group.

Sample size and randomization

Power calculations indicated that a sample size of 36 participants in each group was sufficient to detect an effect size (ES) difference of 0.6 between the treatment groups and the Control group, with alpha at .05 and power of 80%, which was the minimum expected based on similar studies [9], [45], [46]. The study was not powered to detect small differences between the treatment groups.

One-hundred and thirty-nine applicants met all inclusion criteria and were randomized via a true randomization process (www.random.org), generated by an independent person, to either CL, CO or Control groups. The allocation sequence preceded pre-treatment diagnostic interviews and was concealed from LJ and JS. Researchers completing 3-month follow-up interviews were not blind to group allocation. Dependence on self-report measures precluded blinding.

Statistical analyses

Analysis of primary, disorder-specific and secondary outcome measures.

Baseline between-group differences in demographic data and pre-treatment measures were analysed with one-way ANOVAs and chi-square tests. To determine whether the transdiagnostic iCBT program was efficacious, scores from the CL and CO groups were pooled to create a single CL+CO group. To explore the relative clinical outcomes of each type of support, CL and CO data were analysed separately.

All post-treatment and 3-month follow-up analyses involved an intention-to-treat (ITT) design and missing data was addressed by carrying forward the first available data (baseline-observation-carried-forward; BOCF). Between-group changes in questionnaire scores were analysed using univariate ANCOVAs, assigning pre-treatment scores as the covariate. This approach is recommended as a robust and reliable statistical strategy for analysing the results of RCTs [47], [48]. Independent-samples t-tests were used to assess between-groups differences in the number and duration of contacts with participants. Within-group changes in questionnaires were analysed using paired-samples t-tests. Effect sizes (Cohen's d) were calculated for within- and between-group changes, based on the pooled standard deviation.

Clinical significance.

Two criteria of clinical significance were employed. Pre-treatment, post-treatment and 3-month follow up GAD-7 scores were compared with clinical cut-offs to provide an index of remission. This was defined as the proportion of participants who initially scored at or above, and subsequently scored below the cut-offs of a GAD-7 total score ≥8 [34]. An estimate of recovery was made by identifying the proportion of participants in each group who scored above the aforementioned pre-treatment threshold and subsequently demonstrated a significant reduction in their symptoms (defined here, as a reduction of 50% of pre-treatment GAD-7), as described in recent dissemination studies [4]. Secondly, changes in prevalence of principal and additional disorders of anxiety in the two treatment groups were calculated on the results of the diagnostic interviews conducted at pre-treatment and 3-month follow-up and were analysed with chi-square tests. All quantitative analyses were performed in PASW version 18.0 (SPSS, Inc., Chicago, IL).

Control group results.

As a preliminary test of the reliability of outcome associated with the Coach condition, data from the Control group, following their treatment, is reported.

Results

Participant flow

Two hundred and fifty-three individuals expressed interest in the study, and 139 met the eligibility criteria and were randomized to one of the three groups. One CO group and four Control group participants withdrew before beginning the program. Additionally, two CO group and one CL group participant withdrew before beginning treatment, which resulted in 43 CO, 46 CL and 42 Control group participants eligible for analysis (see Figure 1).

Baseline data

Table 1 shows the demographic characteristics of each group and the overall sample. There were no significant between-group differences in gender, marital status, education, employment, previous discussions of symptoms with a health professional, use of medication ( range(2–6, N = 131) = 0.76 – 8.60, p range = .15 – .69), age or treatment expectancy (F2, 128 range = .62 – 1.89, p range = .15 – .51).

Principal and additional diagnoses are displayed in Table 3. Twenty-nine of 43 (67%) CO, 35/46 (76%) CL and 28/42 (67%) Control participants had a co-morbid anxiety or depressive disorder (70% of the overall sample). At pre-treatment, GAD was the most common principal disorder followed by SP and Pan/Ag. There were no statistically significant differences between groups in the prevalence of each principal diagnosis, or the presence of additional diagnoses ((2–4, N = 131) range = 1.09 – 1.17, p range = .56 – .90).

thumbnail
Table 3. Frequency of principal diagnoses and comorbidity for Treatment and Control groups at pre-treatment, and 3-month follow up for CO and CL groups.

https://doi.org/10.1371/journal.pone.0028079.t003

Table 4 shows the pre-treatment scores for the pooled CL+CO group and for the Control group, and Table 5 shows the pre-treatment scores for the CO and CL groups separately, on primary, disorder-specific and secondary outcome measures. There was a trend towards significance between groups in pre-treatment scores on the DASS-21 (F2, 128 = 2.83, p = .06), and no significant differences between CO, CL and Control groups in pre-treatment scores on the GAD-7, PSWQ, PDSS-SR, SIAS-6/SPS-6, PHQ-9 or SDS (F2, 128 range = .07 – .79, p range = .45 – .94).

thumbnail
Table 4. Means, standard deviations and effect sizes (Cohen's d) for pooled CL+CO and Control groups on all outcome measures at pre-treatment, post-treatment and 3-month follow-up time points.

https://doi.org/10.1371/journal.pone.0028079.t004

thumbnail
Table 5. Means, standard deviations and effect sizes (Cohen's d) for CO and CL groups on all outcome measures at pre-treatment, post-treatment and 3-month follow-up timepoints.

https://doi.org/10.1371/journal.pone.0028079.t005

Adherence and attrition

Thirty-two of 43 (74%) CO and 35/46 CL (76%) group participants completed all eight lessons within the 10-week program. A further four (9%) CO participants completed the remaining lesson within seven days of the Program ending, but no CL participants completed within that time frame. There was no difference (t87 = 1.10, p = .27) in the mean number of lessons completed by CO group (7.57; SD = 0.99) and CL group participants (7.09; SD = 1.81). Post-treatment data was collected from 39/43 (90%) CO, 41/46 (89%) CL, and from 42/42 (100%) Control group participants. Three month follow-up data was provided by 40/43 (93%) CO and 34/46 (74%) CL group participants.

Is a transdiagnostic iCBT program for anxiety disorders efficacious?

Univariate ANCOVAs, controlling for pre-treatment scores, on post-treatment primary, disorder-specific and secondary outcomes outcome measures (Table 4) revealed significant differences between CL+CO and Control groups on the GAD-7, DASS-21, PSWQ, SIAS-6/SPS-6, PDSS-SR, PHQ-9, and SDS (F2, 130 = 28.28 – 53.68, p<.000). Paired samples t-tests revealed no significant difference between post-treatment and 3-month follow up scores for the CL+CO group (t88 = −1.15 – 2.13, p = .13 – 99).

Between- and within-group effect sizes on primary measures are included on Table 4. Large between-group effect sizes were achieved by the CL+CO group relative to the Control group on the GAD-7, DASS-21, PSWQ, SIAS-6/SPS-6, PDSS-SR and PHQ-9, (d = .81 – 1.44) and a moderate effect size was found on the SDS (d = .76). Large within group effect sizes were achieved by the CL+CO group at post-treatment on the GAD-7, DASS-21, PSWQ, PHQ-9 and SDS (d = .85 – 1.28), and a moderate effect size was achieved on the SIAS-6/SPS-6, and PDSS-SR (d = .76 and d = .71, respectively). The within-group effect sizes appeared stable through to 3-month follow-up.

At pre-treatment, 71/89 (80%, 95% CI (70–87%) CL+CO participants scored above the cutoff for the GAD-7 (total score ≥8). At post-treatment 46/71 (65%, 95% CI (53–75%) met criteria for remission (GAD-7 total score <7) and 36/71 (51%, 95% CI (39–62%) met criteria for recovery (GAD-7 total score <7 and reduction of at least 50% in total score). At 3-month follow up, 45/71 (63%, 95% CI (52–74%) met criteria for remission and 37/71 (52%, 95% CI (70–87%) met criteria for recovery. Additionally, at 3-month follow-up, 46/89 (52%, 95% CI (41–62%) of the CL+CO group no longer met diagnostic criteria for a principal diagnosis of GAD, SP or Pan/Ag (Table 3). Chi square tests demonstrated a significant reduction from pre-treatment to 3-month follow-up in the number of participants meeting criteria for GAD ((1, N = 178) = 13.92, p<.05), SP ((1, N = 178) = 5.75, p<.05), and a non-significant reduction regarding Pan/Ag ((2, N = 178) = 3.16, p = .08).

Thirty-seven of 43 (86%) CO and 40/46 (87%) CL group participants completed post-treatment satisfaction questionnaires. Results for the two groups were pooled as there were no significant differences in satisfaction ratings ((2, N = 78) = 4.81, p = .09). Sixty-five of seventy-seven (84%) CL+CO group participants responded to the satisfaction questionnaire and reported that they were either very or mostly satisfied with the Program. An additional 12/77 (16%) participants reported they were neutral/somewhat dissatisfied with the Program, but no participants reported they were very dissatisfied with the Program. Additionally, 75/77 (97%) participants said they would feel confident in recommending the Program to a friend.

Does the program result in change in each specific disorder?

Pre-treatment, post-treatment, and 3-month follow-up data for the pooled CL+CO group by principal disorder is presented in Table 6. Pre to post-treatment paired sample t-tests revealed significant improvements in PSWQ, SIAS-6/SPS-6 and PDSS-SR scores, regardless of principal diagnosis (t range 19-38 = 3.65 – 9.13, p<.000). Importantly, these analyses were significant when adjusting for the multiple comparisons required to examine this effect across the nine questionnaire measures (p significance level = .005). Paired sample t-tests revealed no change on the PSWQ, PDSS-SR, or SIAS-6/SPS-6 from post-treatment to 3-month follow up for any of the three principal diagnoses (t range 19-38 = .11 – 1.53, p = 0.14 – .91).

thumbnail
Table 6. Means, standard deviations and effect sizes (Cohen's d) for pooled CL+CO group on disorder specific outcome measures at pre-treatment, post-treatment and 3-month follow-up timepoints.

https://doi.org/10.1371/journal.pone.0028079.t006

Participants with a principal diagnosis of GAD, SP or Pan/Ag achieved large within-group effect sizes on their corresponding disorder-specific measure (Table 6). Additionally, participants achieved small to large effect sizes on disorder-specific measures that did not correspond to their principal diagnosis. These gains were generally stable at 3-month follow-up.

Can good clinical outcomes be obtained when support is provided by a Coach?

Pre-treatment, post-treatment and 3-month follow up data for the CO and CL groups is presented in Table 5. Univariate ANCOVAs controlling for pre-treatment scores revealed the CO group had significantly lower GAD-7 scores, and a trend towards significantly lower DASS-21 scores, than the CL group at post-treatment (F1,88 = 5.37, p = .02, F1,88 = 3.85, p = .05, respectively). There was no significant difference between CO and CL groups on PSWQ, SIAS-6/SPS-6, PDSS-SR, PHQ-9 and SDS at post-treatment (F1, 88 = 1.0 – 3.72, p = .06 – 32).

Univariate ANCOVAs controlling for pre-treatment scores revealed the CO group had significantly lower GAD-7, PDSS-SR, PHQ-9, and SDS scores than the CL group at 3-month follow up (F1, 88 = 5.11 – 7.71, p = .007 – .03), but no difference on the DASS-21, PSWQ, SIAS-6/SPS-6, (F1, 88 = 1.85 – 2.94, p = .09 – .18). Paired samples t-tests revealed no significant change from post-treatment to 3-month follow up on any measure for either CO (p range = .69–1.0) and CL (p range = .25–.48) groups.

Between- and within-group effect sizes on primary, disorder-specific measures, and measures of depression and disability are included in Table 5. Small to medium (d = .20 –.62) between-group effect sizes were achieved by the CO group relative to the CL group on all measures at post-treatment and 3 month-follow-up. Large within-group effect sizes were achieved by the CO group on all measures at post-treatment (d = .80 – 1.29). At post-treatment, the CL group achieved large within group effect sizes on the DASS-21, PSWQ, and SDS (d = .81 – .90), and moderate effect sizes on the GAD-7, SIAS-6/SPS-6, PDSS-SR, and PHQ-9 (d = .67 – .71). These gains appeared generally stable at 3-month follow-up.

Contact Events

Table 1 displays the frequency of contact events and duration of total contact time per participant. No significant differences were observed between the CO and CL groups in the number of phone calls, manually written contacts, automated written contacts or the total contact time provided by the Coach and Clinician throughout the program (t87 range = −1.79 – .87, p range = .08 – .98).

Control group results

As a partial replication of the CO condition, Control group participants received weekly support from the Coach during their treatment phase, consistent with that provided to the original CO group. One Control group participant withdrew before beginning the active treatment phase of the program reporting their symptoms had sufficiently resolved, and another could not be contacted, resulting in 40 Control group participants commencing the active treatment phase of the Anxiety program and eligible for analysis. Of these, 33 (82.5%) participants completed the eight lessons within the ten weeks of the program, and an additional two (5%) participants completed the remaining lesson within seven days of the program ending. The average number of Lessons completed was 7.56 (SD = 1.19). Post-treatment data was collected from 38/40 (95%) Control group participants.

Post-treatment Control group results and within-group effect sizes on primary, disorder-specific outcome measures, and measures of depression and disability are presented in Table 4. Paired samples t-tests revealed that the Control group achieved significant reductions from pre- to post-treatment on all measures (t39 range = 5.06 – 9.46, all p<.000). Importantly, these analyses were significant when adjusting for the multiple comparisons required to examine this effect across the seven questionnaire measures (p significance level = .007). The Control group achieved within-group effect sizes consistent with the original CO group, on all measures at post-treatment. Thirty-one of the 37 (84%) control group participants who completed the post-treatment satisfaction questionnaires reported being either very satisfied or mostly satisfied with the program, while six (16%) participants reported being neutral/somewhat dissatisfied with the Program, and no participants reported feeling very dissatisfied with the program. Additionally, 36/37 (97%) participants said they would feel confident in recommending the program to a friend.

Discussion

This trial examined the efficacy of an extended version of the Anxiety program, a transdiagnostic iCBT program for anxiety disorders, when guided by either a Coach or Clinician. At intake all participants met DSM-IV diagnosis for generalized anxiety disorder, social phobia, or panic disorder (with or without agoraphobia) and 70% met criteria for at least one additional disorder.

Is a transdiagnostic iCBT program for anxiety disorders efficacious?

Outcomes for the pooled treatment groups (CL+CO) were superior to the Control group on all measures and this was associated with large between-group effect sizes, with the exception of the SDS where a moderate effect size was obtained. Follow-up data indicated treatment effects were maintained. At follow-up more than half the CL+CO group did not meet criteria for their principal diagnosis. Adherence and satisfaction with treatment was high, suggesting that transdiagnostic approaches are acceptable to consumers. Importantly, these results were obtained with less than 70 min of total Clinician or Coach time per participant, and appear consistent with outcomes achieved in the low intensity treatments offered in recent field trials of the UK based Improved Access to Psychological Therapy program [4].

Does the program result in change in each specific disorder?

Significant reductions were found on the corresponding disorder-specific outcome measure for participants with each of the three principal diagnoses. Within-group effect sizes for each of the target disorders on their corresponding disorder-specific measure were large and gains were maintained at follow-up. Participants also achieved significant reductions on disorder-specific measures different to their principal diagnosis.

Can good clinical outcomes be obtained when support is provided by a Coach?

With one exception, no significant differences were found between the CL and CO groups at post-treatment, the exception being a lower GAD-7 score in the CO group. At follow-up the CO group had significantly lower symptom severity scores than those in the CL group on the GAD-7, PDSS-SR, and SDS. These results were unanticipated, and require replication. As a partial replication, the Control group received the CO treatment and achieved post-treatment outcomes comparable to those obtained by the original CO group. This result is consistent with studies indicating that non-clinical support roles for guided and highly structured iCBT programs for common mental disorders are associated with good clinical outcomes [9], [11], [49].

Limitations

Limitations of the present study are relevant to other studies in the field of transdiagnostic treatment. We had sufficient power to detect medium to large differences between groups, but not to detect small differences between groups or to compare between groups based on principal diagnosis. Consequently, small differences between groups could exist that were not detected in the present study, and which future studies employing larger sample sizes may reveal. It is important to note that the sample sizes required to address these issues are considerable, and was only able to be approximated by pooling treatment data. Pragmatic approaches such as those used here may provide a practical and preliminary alternative for answering such important questions; however, more expansive research is required. Future research employing larger samples may benefit from considering mixed models approaches that will further inform the debate surrounding treatment response.

A second limitation concerns the choice of general and disorder specific outcome measures; an issue identified in the broader field of transdiagnostic research [16]. In the present study we selected brief measures to reduce burden on participants. There is a need for broader discussion regarding the questionnaire batteries most appropriate for the evaluation of transdiagnostic treatment and to facilitate comparison of results.

A third limitation concerns blinding. Due to resource constraints researchers were not blinded for 3-month follow-up diagnostic interviews, which may have resulted in under-reporting of diagnostic symptoms. The enduring gains made by treatment groups across a broad range of outcome measures mitigates some of this concern, however, future research will clearly benefit from blinding in diagnostic interviews.

A fourth limitation concerns the generalizability of the current findings. Independent replication is required to further understand the relative efficacy of Clinician and Coach roles for guided iCBT. Future studies would also benefit from comparing treatment with an active control group rather than a delayed-treatment waiting list. For example, the treatment gains in the present study may be solely due to telephone contact and, although unlikely, this cannot be ruled out using a wait-list control group. Future research employing telephone contact as part of an active control may go some way to informing non-specific treatment effects.

An additional limitation is the duration of follow-up analyses. Some authors argue that transdiagnostic treatments target underlying vulnerabilities and thus may lead to more durable treatment effects [50]. Follow-up data in the present study is consistent with existing research [51], yet future research would benefit from considering longer follow-up periods.

General discussion

The findings of the current study are consistent with both the broader transdiagnostic and iCBT literature. Improvements on the general measures of anxiety are consistent with meta-analyses of transdiagnostic face-to-face programs for the anxiety disorders [52]. Analyses by principal disorder indicated improvement on the relevant diagnosis-specific outcome measures and also on diagnosis-specific measures different to the principal diagnosis. This supports the argument that transdiagnostic treatments may help consumers generalise beyond their principal complaint [16].

The magnitude of treatment gains in the present study are also comparable with those reported in meta-analyses of Internet and computer-aided psychotherapy for symptoms of anxiety [7]. Analyses by principal disorder yielded results consistent with those reported in recent studies of disorder-specific iCBT programs for GAD [53], SP [54] and Pan/Ag [46]. The outcomes achieved by the CO group, which were partially replicated with the Control group, are consistent with research indicating that coaching and clinical support roles can result in similar outcomes for guided iCBT [9], [45].

The Control group in the present research provided a partial replication of the CO condition, but independent replication of the study is required to examine the reliability of the findings. Future research examining the role of comorbidity and consumer attitudes, are two areas of research that will inform discussion regarding transdiagnostic treatment and are the topic of studies currently underway. Future research exploring the relative efficacy of transdiagnostic and individually-tailored interventions would be of value, as both approaches have provided encouraging findings regarding disorder specific change and have potential for the treatment of comorbidity [25], [55]. Additionally, future studies using a larger sample size would allow comparison of transdiagnostic iCBT with disorder-specific iCBT, and would begin to inform the debate around the relative utility of these approaches. An unresolved tension in the field of transdiagnostic treatment concerns the suitability of disorders such as OCD and PTSD to this approach [17], and inclusion of a broader range of disorders is required for future research to begin answering these questions. Moreover, research examining the relative benefits of clinician and coaching guidance in non-research environments is required to inform discussion about the dissemination of low-intensity interventions [5], [56].

Conclusions

This is an extension of a transdiagnostic iCBT program for three anxiety disorders. This randomized controlled trial revealed overall outcomes that were superior for the treatment groups relative to a waitlist control condition and which were stable over a 3 month follow up period and satisfactory to participants. Outcomes by principal diagnosis appeared consistent with those obtained in disorder-specific iCBT programs, and allowed participants to generalise gains beyond symptoms of their principal complaint. Coach assisted iCBT was as effective as Clinician assisted iCBT. Further studies need to explore questions about the role of comorbidity, consumer attitudes, to investigate clinical and coaching support roles and the relative efficacy of transdiagnostic and disorder-specific iCBT.

Acknowledgments

The authors gratefully acknowledge the contributions to the development of the research software by Mr Daniel Winter.

Author Contributions

Conceived and designed the experiments: LJ NT. Performed the experiments: LJ NT JS BD. Analyzed the data: LJ NT BD GA. Contributed reagents/materials/analysis tools: LJ NT BD GA. Wrote the paper: LJ NT GA JS BD.

References

  1. 1. Goldberg D, Krueger R, Andrews G, Hobbs M (2009) Emotional disorders: Cluster 4 of the proposed meta-structure for DSM-V and ICD-11. Psychological Medicine 39: 2043–2059.
  2. 2. Andrews G, Creamer M, Crino R, Hunt C, Lampe L, et al. (2003) The treatment of anxiety disorders: clinicians guides and patient manuals. Cambridge: Cambridge University Press.
  3. 3. Burgess P, Pirkis J, Slade T, Johnston A, Meadows G, et al. (2009) Service use for mental health problems: Findings from the 2007 National Survey of Mental Health and Wellbeing. Australian and New Zealand Journal of Psychiatry 43: 615–623.
  4. 4. Richards D, Suckling R (2009) Improving access to psychological therapies: Phase IV prospective cohort study. British Journal of Clinical Psychology 48: 377–396.
  5. 5. Bennet-Levy J, Richards D, Farrand P (2010) Low intensity CBT interventions: a revolution in mental health care; Bennet-Levy J, Richards DA, Farrand P, Christensen H, KM G, et al., editors. Oxford: Oxford University Press. pp. 3–18.
  6. 6. Andersson G, Cuijpers P (2009) Internet-based and other computerized psychological treatments for adult depression: A meta-analysis. Cognitive Behaviour Therapy 38: 196–205.
  7. 7. Andrews G, Cuijpers P, Craske M, McEvoy P, Titov N (2010) Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: A meta-analysis. PLoS ONE 5:
  8. 8. Cuijpers P, Marks I, van Straten A, Cavanagh K, Gega L, et al. (2009) Computer-aided psychotherapy for anxiety disorders: A meta-analytic review. Cognitive Behaviour Therapy 38: 66–82.
  9. 9. Robinson E, Titov N, Andrews G, McIntyre K, Schwencke G, et al. (2010) Internet treatment for generalized anxiety disorder: a randomized controlled trial comparing clinician vs. technician assistance. PloS one 5:
  10. 10. Titov N, Andrews G, Schwencke G, Solley K, Johnston L, et al. (2009) An RCT comparing effect of two types of support on severity of symptoms for people completing Internet-based cognitive behaviour therapy for social phobia Australian and New Zealand Journal of Psychiatry 43: 920–926.
  11. 11. Titov N, Andrews G, Davies M, McIntyre K, Robinson E, et al. (2010) Internet treatment for depression: a randomized controlled trial comparing clinician vs. technician assistance. PloS one 5:
  12. 12. Barlow D, Allen L, Choate M (2004) Toward a unified treatment for emotional disorders. Behavior Therapy 35: 205–230.
  13. 13. Norton P, Hope D (2005) Preliminary evaluation of a broad-spectrum cognitive-behavioral group therapy for anxiety. Journal of Behavior Therapy and Experimental Psychiatry 36: 79–97.
  14. 14. Clark D (2009) Cognitive behavioral therapy for anxiety and depression: Possibilities and limitations of a transdiagnostic perspective. Cognitive Behaviour Therapy 38: 29–34.
  15. 15. Mansell W, Harvey A, Watkins E, Shafran R (2009) Conceptual foundations of the transdiagnostic approach to CBT. Journal of Cognitive Psychotherapy 23: 6–19.
  16. 16. McEvoy P, Nathan P, Norton P (2009) Efficacy of transdiagnostic treatments: a review of published outcome studies and future research directions Journal of Cognitive Psychotherapy 23: 20–33.
  17. 17. Erickson D, Janeck A, Tallman K (2009) Transdiagnostic group CBT for anxiety: clinical experience and practical advice. Journal of Cognitive Psychotherapy 23: 34–43.
  18. 18. Norton P, Price E (2007) A meta-analytic review of adult cognitive-behavioral treatment outcome across the anxiety disorders. The Journal of nervous and mental disease 195: 521.
  19. 19. Marks I, Kenwright M, McDonough M, Whittaker M, Mataix-Cols D (2004) Saving clinicians' time by delegating routine aspects of therapy to a computer: A randomized controlled trial in phobia/panic disorder. Psychological Medicine 34: 9–17.
  20. 20. Proudfoot J, Ryden C, Everitt B, Shapiro D, Goldberg D, et al. (2004) Clinical efficacy of computerised cognitive-behavioural therapy for anxiety and depression in primary care: Randomised controlled trial. British Journal of Psychiatry 185: 46–54.
  21. 21. Titov N, Andrews G, Johnston L, Robinson E, Spence J (2010) Transdiagnostic Internet treatment for anxiety disorders: A randomized controlled trial. Behaviour Research and Therapy 48: 890–899.
  22. 22. Kroenke K, Spitzer R, Williams J (2001) The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine 16: 606–613.
  23. 23. American Psychiatric Association (2000) Diagnostic and Statistical Manual of Mental Disorders (Text Revision). Washington: American Psychiatric Association.
  24. 24. Sheehan D, Lecrubier Y, Sheehan K, Amorim P, Janavs J, et al. (1998) The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry 59: 22–33.
  25. 25. Carlbring P, Maurin L, Törngren C, Linna E, Eriksson T, et al. (2011) Individually-tailored, Internet-based treatment for anxiety disorders: A randomized controlled trial. Behaviour Research and Therapy 49: 18–24.
  26. 26. Spitzer R, Kroenke K, Williams J, Löwe B (2006) A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine 166: 1092–1097.
  27. 27. Lovibond S, Lovibond P (1995) Manual for the Depression Anxiety Stress Scales. Sydney, Australia: Psychology Foundation.
  28. 28. Meyer T, Miller M, Metzger R, Borkovec T (1990) Development and validation of the Penn State Worry Questionnaire. Behaviour Research and Therapy 28: 487–495.
  29. 29. Peters L, Sunderland M, Andrews G, Rapee R, Mattick R (2011) Development of a short form Social Interaction Anxiety (SIAS) and Social Phobia Scale (SPS) using nonparametric item response theory: The SIAS-6 and the SPS-6. Psychological Assessment Epub ahead of print.
  30. 30. Houck P, Spiegel D, Shear M, Rucci P (2002) Reliability of the self-report version of the panic disorder severity scale. Depression and Anxiety 15:
  31. 31. Sheehan D (1983) The Anxiety Disease. New York: Scribner.
  32. 32. Lecrubier Y, Sheehan D, Weiller E, Amorim P, Bonora I, et al. (1997) The Mini International Neuropsychiatric Interview (MINI). A short diagnostic structured interview: Reliability and validity according to the CIDI. European Psychiatry 12: 224–231.
  33. 33. Kroenke K, Spitzer R, Williams J, Löwe B (2010) The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: A systematic review. General Hospital Psychiatry 32: 345–359.
  34. 34. Löwe B, Decker O, Muller S, Brahler E, Schellberg D, et al. (2008) Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Medical care 46: 266–274.
  35. 35. Clark D, Layard R, Smithies R, Richards D, Suckling R, et al. (2009) Improving access to psychological therapy: Initial evaluation of two UK demonstration sites. Behaviour Research and Therapy 47: 910–920.
  36. 36. Antony M, Bieling P, Swinson RP, Cox B, Enns M, et al. (1998) Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales in clinical groups and a community sample. Psychological Assessment 10: 176–181.
  37. 37. Brown T, Antony M, Barlow D (1992) Psychometric properties of the Penn State Worry Questionnaire in a clinical anxiety disorders sample. Behaviour Research and Therapy 30: 33–37.
  38. 38. Mattick R, Clarke J (1998) Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy 36: 455–470.
  39. 39. Leon A, Olfson M, Portera L, Farber L, Sheehan D (1997) Assessing psychiatric impairment in primary care with the Sheehan Disability Scale. International Journal of Psychiatry in Medicine 27: 93–105.
  40. 40. Carlbring P, Brunt S, Bohman S, Austin D, Richards J, et al. (2007) Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research. Computers in Human Behavior 23: 1421–1434.
  41. 41. Donker T, van Straten A, Marks I, Cuijpers P (2010) Brief self-rated screening for depression on the Internet. Journal of Affective Disorders 122: 253–259.
  42. 42. Garb H (2007) Computer-administered interviews and rating scales. Psychological Assessment 19: 4–13.
  43. 43. Hedman E, Ljótsson B, Rück C, Furmark T, Carlbring P, et al. (2010) Internet administration of self-report measures commonly used in research on social anxiety disorder: A psychometric evaluation. Computers in Human Behavior 26: 736–740.
  44. 44. Devilly G, Borkovec T (2000) Psychometric properties of the credibility/expectancy questionnaire. Journal of Behavior Therapy and Experimental Psychiatry 31: 73–86.
  45. 45. Titov N, Andrews G, Johnston L, Schwencke G, Choi I (2009) Shyness programme: Longer term benefits, cost-effectiveness, and acceptability. Australian and New Zealand Journal of Psychiatry 43: 36–44.
  46. 46. Wims E, Titov N, Andrews G, Choi I (2010) Clinician-assisted Internet-based treatment is effective for panic: A randomized controlled trial. Australian and New Zealand Journal of Psychiatry 44: 599–607.
  47. 47. Vickers A (2005) Parametric versus non-parametric statistics in the analysis of randomized trials with non-normally distributed data. BMC Medical Research Methodology 5:
  48. 48. Vickers A (2005) Analysis of variance is easily misapplied in the analysis of randomized trials: A critique and discussion of alternative statistical approaches. Psychosomatic Medicine 67: 652–655.
  49. 49. Titov N, Andrews G, Choi I, Schwencke G, Johnston L (2009) Randomized controlled trial of web-based treatment of social phobia without clinician guidance Australian and New Zealand Journal of Psychiatry 43: 913–919.
  50. 50. Wilamowska Z, Thompson-Hollands J, Fairholme C, Ellard K, Farchione T, et al. (2010) Conceptual background, development, and preliminary data from the unified protocol for transdiagnostic treatment. Depression and Anxiety 27: 882–890.
  51. 51. Page A, Hooke G (2003) Outcomes for depressed and anxious inpatients discharged before or after group cognitive behavior therapy: a naturalistic comparison. The Journal of Nervous and Mental Disease 191: 653–659.
  52. 52. Norton P, Philipp L (2008) Transdiagnostic approaches to the treatment of anxiety disorders: A meta-analytic review. Psychotherapy: Theory, Research, Practice, Training 45: 214–226.
  53. 53. Titov N, Andrews G, Robinson E, Schwencke G, Johnston L, et al. (2009) Clinician-assisted Internet-based treatment is effective for generalized anxiety disorder: randomized controlled trial Australian and New Zealand Journal of Psychiatry 43: 905–912.
  54. 54. Titov N, Andrews G, Schwencke G (2008) Shyness 2: Treating social phobia online: Replication and extension. Australian and New Zealand Journal of Psychiatry 42: 595–605.
  55. 55. Andersson G, Estling F, Jakobsson E, Cuijpers P, Carlbring P (2011) Can the patient decide which modules to endorse? An open trial of tailored internet treatment of anxiety disorders. Cognitive Behaviour Therapy 40: 57–64.
  56. 56. Andersson G, Carlbring P, Berger T, Almlöv J, Cuijpers P (2009) What makes internet therapy work? Cognitive Behaviour Therapy 38: 55–60.