Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A pilot study on ecological momentary assessment in asylum-seeking children and adolescents resettled to Germany: Investigating compliance, post-migration factors, and the relation between daily mood, sleep patterns, and mental health

  • Lauritz Rudolf Floribert Müller ,

    Roles Conceptualization, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    lauritz.mueller@ku.de

    ‡ These authors are equal contributors and joint first authors

    Affiliation Department of Psychology, Catholic University of Eichstätt-Ingolstadt, Eichstätt, Germany

  • Katharina Gossmann ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft

    ‡ These authors are equal contributors and joint first authors

    Affiliation Department of Psychology, Catholic University of Eichstätt-Ingolstadt, Eichstätt, Germany

  • Regina F. Schmid,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft

    Affiliation Department of Psychology, Catholic University of Eichstätt-Ingolstadt, Eichstätt, Germany

  • Rita Rosner,

    Roles Conceptualization, Project administration, Supervision

    Affiliation Department of Psychology, Catholic University of Eichstätt-Ingolstadt, Eichstätt, Germany

  • Johanna Unterhitzenberger

    Roles Conceptualization, Funding acquisition, Project administration, Supervision, Validation

    Affiliation Department of Psychology, Catholic University of Eichstätt-Ingolstadt, Eichstätt, Germany

Abstract

Background

Asylum-seeking children and adolescents (ASCs) resettled to western countries show elevated levels of psychological distress. While research on the mental health of ASCs is increasing, less is known about their day-to-day living experiences such as their daily mood, sleep patterns, and post-migration factors. Moreover, no examination in situ, using smartphone-assisted ecological momentary assessment (EMA), has been conducted up to now among ASCs. Furthermore, we do not know if screening measures succeed in reflecting the daily mood of ASCs experienced in everyday life.

Methods

We undertook a smartphone-assisted EMA study over a two-week period with 3 measurements a day. Participants were N = 40 ASCs from 10 different countries who had resettled to Germany. They completed standardized questionnaires screening for history of trauma and clinical symptoms (post-traumatic stress symptoms, depression, and anxiety) that were carried out in interview-like settings, and they participated in the subsequent EMA where they rated mood, sleep parameters, and post-migration factors on a daily basis. Multilevel models of clinical symptoms, daily mood, and sleep parameters were computed based on a total of 680 measurements.

Results

The multiply traumatized and highly distressed participants reported different levels of discrimination, and various social activities and contacts in the EMA. The overall compliance rate was shown to be 40.5%. Higher PTSS and anxiety scores were associated with lower levels of daily mood and poorer outcomes of some sleep parameters. Depression scores were not associated with any of the variables assessed in the EMA.

Conclusions

Smartphone-assisted EMA among ASCs resettled to Germany proved to be implementable despite a rather low compliance rate. Not only do ASCs show high symptom levels, they are also affected by these symptoms in their daily lives. The results emphasize the need for concise screenings and psychological treatment for this high-risk population. Limitations include the convenient nature of the sample and the lack of a comparison group.

Introduction

Over the course of the years 2015 to 2017, at the peak of what became known as the European migrant crisis, almost 500,000 asylum-seeking children and adolescents (ASCs) under the age of 18 resettled to Germany [13]. Given the myriad of adversities that ASCs regularly experience in their home country and during different stages of flight [4,5], the screening of mental health problems of ASCs resettled to western countries has been a major focus of clinical research [6].

Whereas data on the rates of mental health problems of ASCs are appreciably increasing and becoming more accurate, less is known about the day-to-day experiences of ASCs with regard to domains such as post-migration factors, sleep patterns, and daily mood.

Moreover, most studies that focus on the everyday experiences of ASCs with regard to a variety of domains are of cross-sectional, more specifically retrospective, nature in the sense that participating ASCs were asked to rate their experiences over the course of a preceding time period (e.g. four weeks) at a given point in time (e.g. [7,8]). Naturally, this procedure is not specific to mental health research with ASCs but rather inherent to most non-experimental psychological research in and of itself [9]. However, this approach bears some considerations. In retrospective investigations, respondents might simply overlook past experiences, or these experiences might be conflated with current sensations and cognitions [10]. This can result in individuals recalling or rating their experiences differently from what they actually felt, thought, or perceived in a given situation, a phenomenon commonly known as recall or hindsight bias [11,12]. In fact, there is some evidence to suggest that memory inconsistencies among youths do appear regularly in psychological assessments, even with regard to severe experiences such as trauma [13]. For instance, in a 12-month follow-up study with ASCs in the Netherlands, 86.4% of the sample changed their response on at least one of the traumatic experiences assessed in the study [14]—which is largely in accordance with the proportion determined in studies with non-migration populations [15]. New technologies, like ecological momentary assessment (EMA), allow us to overcome some of these limitations. In EMAs, as opposed to conventional questionnaire assessments, participants respond in situ to the outcomes of interest using smartphones or comparable devices [16]. In doing so, respondents rate their present perceptions rather than evaluating what has happened in the past. In fact, studies that used the EMA approach have shown considerable discrepancy with retrospective examinations regarding the frequency with which certain symptoms were reported. For instance, in an EMA study with adult patients suffering from PTSD after childhood sexual abuse, participants reported roughly 50% more intrusions and flashbacks than in the subsequent retrospective investigation [17]. To date, however, little EMA research has been done among refugee youths. Although a study in Sweden examined intrusive memories in young refugees (age 16–25 years) in a daily diary format [18], real-time smartphone-based EMA among minor refugees has, to the authors’ knowledge, not yet been conducted. Some meta-analyses indicate that EMA studies among children and adolescents might yield lower compliance rates than studies among adults [19,20]. In addition, ASCs are likely to have lower language skills than native youths and may generally be less familiar with psychological test formats [21,22]—which is why we do not know whether the EMA approach is suitable for this population. Consequently, a key objective of this pilot study was to test the EMA approach among ASCs and to investigate their compliance to the EMA protocol as one aspect of its feasibility in this population.

Retrospective surveys indicate a wide range of post-migration factors that may affect the mental health of ASCs in the host country and suggest that ASCs regularly experience hassles regarding their asylum process [23,24], financial difficulties [23], and discriminatory incidents [7,8], among others. A very comprehensive review on risk and protective factors in ASCs distinguishes post-migration factors at the individual, family and community levels and demonstrates that lack of social support and resources in the host country and experiences of discrimination were among the most important post-migration factors to be associated with poorer mental health outcomes [25]. Ecological frameworks suggest that these post-migration factors are heavily interlinked [26], and, along with migration-related adversities, might have a cumulative effect on the mental health of ASCs [27]. Indeed, data from a Norwegian sample of minor refugees support this link by showing that higher levels of social support not only had a direct positive effect on mental health, but also had indirect positive effects on competence in dealing with experiences of discrimination [28]. However, the extent to which ASCs experience daily post-migration factors such as social support, resources, and discrimination is still unknown as assessed by real-time everyday data as these findings rely solely on retrospective investigations and there are, to date, no EMA investigations. In order to gather information on the most relevant aspects of the abovementioned post-migration factors in ASCs and as a precursor for a larger study that will look at the association between daily assessed post-migration factors and daily assessed mood and symptom scores of ASCs, this pilot study aimed at giving a first account of the as-is state regarding post-migration factors, daily mood, and sleep patterns.

The main body of clinical research among ASCs demonstrates large numbers of potentially traumatic experiences and high rates of psychological distress in this group, whereby posttraumatic stress symptoms (PTSS)/posttraumatic stress disorder (PTSD), depression, anxiety, and sleeping problems appear to be the major mental health problems [6,27,29,30]. In addition, the high rates of psychological distress seem to be stable over the course of the first years after arrival in the host country [31], even though a recent publication reported on the improvement of symptoms in a cohort of ASCs resettled to Germany [32]. However, it has been suggested very early on that ASCs might show good adaptation in daily life despite high symptom levels [33,34]. Primary caregivers might therefore simply overlook ASCs’ severe mental health status because it seems as though ASCs were not affected in everyday life. In addition, clinicians in low-resources environments, such as the refugee context, rely on concise screening measures that have mostly been validated in western countries [22]. While some may well be validated—or at least have been broadly used—with ASCs at the symptom level, cross-cultural validity of clinical screening measures remains an area of debate [3537]. For example, we do not know whether they have predictive validity at a culturally less disputable, and therefore lower threshold and more easily retrievable, level in ASCs, that is, whether they succeed in reflecting negative consequences in everyday life as assessed by real-time data on areas such as daily mood and sleep problems. Even though we assume that standardized screening measures are likely to reflect these consequences, as this association has been documented in different settings [3841], it is yet to be tested in the context of ASCs that, as mentioned above, may be a particular population where symptom levels might be high, yet, undetectable as demonstrated in everyday outcomes. Taken together, these results reveal the severe situation facing ASCs in western countries with regards to mental health issues, and the challenges for mental health care systems and professionals to adequately deliver services.

As outlined above, using EMA to inquire into the day-to-day experiences of ASCs, such as post-migration factors, daily mood, and sleep patterns, might constitute a worthwhile addition to the retrospective screening of ASCs’ symptom levels that has already been established in clinical research over the past few years. Accordingly, this pilot study aimed 1) to investigate the compliance of smartphone-assisted EMA among ASCs by deploying it for the first time in this group, 2) to depict the as-is state with regard to daily mood and post-migration factors of ASCs in day-to-day life (e.g. with whom do the ASCs interact most in everyday life? What activities do the ASCs pursue and enjoy in their daily lives? To what extent do they experience discrimination during the day?), and 3) to identify the association between ASCs’ symptom levels obtained by standardized questionnaire data and daily mood and sleep patterns obtained by EMA data. Specifically, we hypothesized that ASCs with higher symptom levels show poorer outcomes of daily mood and sleep parameters in everyday life.

Methods

We followed the reporting guidelines for EMA studies as outlined recently by Trull and Ebner-Priemer [16,42] when drafting this manuscript.

Ethics statement

The study was approved by the ethics board of the Catholic University Eichstätt-Ingolstadt in December 2016 (ethics approval number: 2016/23). An amendment for the original study was granted in July 2018 (ethics approval number: 2018/5). All participants and, if they were under 18, their legal guardians gave their written informed consent to participate in the study.

Procedure

This study is an EMA study on ASCs’ experience of post-migration factors, and the association of daily assessed mood and sleep patterns with the mental health of this population reported in retrospective questionnaires. It was carried out in the summer of 2018 in Bavaria, Germany. It is based on two pre-studies. Study 1 [43] was a cross-sectional mental health screening among ASCs resettled to Germany conducted in 2017. Study 2 [32] was the 1-year follow-up of the initial screening. In this study, we report on the EMA subsequent to the 1-year follow-up, and link daily EMA data to standardized questionnaire data obtained from the 1-year follow-up.

Power analysis had been carried out prior to the baseline screenings in Study 1. According to the power analysis, a total of N = 112 ASCs had been recruited initially, 14 of whom had dropped out before completing the interviews, resulting in a sample of N = 98 ASCs for the baseline screening in Study 1. All youths, who had participated in baseline assessments, were contacted again in 2018. In this way, a sample of N = 72 ASCs could be secured for the 1-year follow-up assessment in Study 2. As part of the follow-up assessments in Study 2, all participants were asked whether they wanted to participate in the subsequent EMA investigation. Of these, 26 ASCs were not interested in participating in the EMA due to time issues or language difficulties, resulting in a total of N = 46 ASCs who agreed to participate in this study. Six participants were excluded from the analysis, due either to incomplete questionnaire data or incomplete EMA forms (completed prompts <3). Accordingly, this study comprises a final sample of N = 40 ASCs who completed both the 1-year follow-up questionnaires and the EMA, and were therefore included in the statistical analysis. Fig 1 shows the participant flow.

thumbnail
Fig 1. Participant flow chart.

This chart shows the participant flow through different stages of study 1 (cross-sectional mental health screening), study 2 (1-year follow-up screenings), and this study (EMA).

https://doi.org/10.1371/journal.pone.0246069.g001

According to the inclusion criteria, ASCs who were under 18 when they entered the European Union and who had been resident in Germany for at least one year, were included in the original study (Study 1). At every stage of the different studies (baseline screening, follow-up, and EMA), participants and, in case of minors, their legal guardians were asked to give their informed written consent for participation. The follow-up screenings with standardized questionnaires (Study 2) were carried out in a face-to-face interview-like setting by either bachelor-level or master-level psychologists. See [32] for a more detailed account of the screening procedure.

After the face-to-face assessment in Study 2, all participating ASCs were asked if they were interested in taking part in the EMA study that took place over the course of two consecutive weeks. Nine days, on average, elapsed between the mental health screening and the completion of the first EMA prompt (M = 8.53, SD = 7.21, range 1–30). An additional inclusion criterion for the EMA was sufficient language proficiency in order to understand the forms. If the ASCs agreed to participate, they were given a programmed Android smartphone and were informed about the study aims, the procedure, the obligation of all professionals involved to preserve confidentiality, and the data privacy of the study. The authors clarified whether participants’ language proficiency was sufficient and went through all measures on an electronic tablet device prior to study intake so as to ensure the correct understanding of the items and the technical procedure. We designed the EMA as time-based monitoring with fixed-time sampling using the Android application movisensXS, version 1.4.8 (movisens GmbH, Karlsruhe, Germany). Since most participants still attended school, we chose fixed-time sampling in order to guarantee that no prompt was going to occur during school time or during scheduled afternoon activities. Throughout the day, three prompts occurred over a period of two consecutive weeks, in the morning at 7.15 a.m., in the afternoon at 2.15 p.m., and in the evening at 9.15 p.m. Participants could choose to suspend any prompt for up to 25 minutes. If participants did not respond to a prompt, it re-occurred 3 times with a time lag of 5 minutes before being counted as a missing. In order to enhance compliance, participants could contact the researchers at any time if they experienced any technical issues or problems of comprehension. In case of any mental or physical distress caused by the assessment, the researchers provided immediate psychological support. However, no emergencies occurred in the context of this study. At the end of the EMA, participants were given EUR 10, and the researchers retrieved the smartphones and extracted the EMA data.

Measures

Standardized questionnaires.

The sociodemographic characteristics were assessed by self-report at the beginning of the face-to-face assessment. Asylum status, placement changes, educational background in the country of origin, and previous psychosocial treatment were covered in addition to common demographic variables. Furthermore, the following measures were conducted in German during the interviews.

The Child and Adolescent Trauma Screen (CATS; [44]) consists of three parts. It assesses potentially traumatic events (CATS trauma list) and the frequency of PTSS during the previous two weeks (CATS symptom scale). The CATS trauma list originally comprises 15 items, and we added 4 items that examine potentially traumatic events related to flight and resettlement experiences (deprivation, dangerous journey, imprisonment and/or abduction, and the committing of violating acts (voluntary or involuntary)). In the CATS symptom scale, the participants rated the frequency of PTSS over the course of the previous two weeks on a 4-point Likert scale. The CATS symptom scale consists of 20 items and its sum score ranges from 0 to 60 with a suggested cut-off value of 21 to indicate clinically significant levels of PTSS. The CATS is based on the DSM-5 criteria for PTSD and has shown good psychometric properties [45]. It has previously been used among the ASC population in a variety of studies [32,46,47]. In this study, the inter-item reliability of the CATS symptom scale was α = .81.

The Hopkins Symptom Checklist-37 for Adolescents (HSCL-37A; [48]) examines both internalizing symptoms such as depression and anxiety, and externalizing symptoms. We used the included subscales for anxiety (range 10–40, cut-off 20) and depression (range 15–60, cut-off 33) as they represent two major symptom clusters among ASCs [27]. The frequency of the symptoms was assessed over the previous four weeks on a 4-point Likert scale. The HSCL-37A is a widely used questionnaire and has shown good psychometric properties for different populations including ASCs. The inter-item reliability of the constituent scales in this study was as follows: depression (15 items, α = .87), anxiety (10 items, α = .76).

Ecological momentary assessment (EMA).

The German version of the Multidimensional Mood Questionnaire (MDMQ; [49]) is a questionnaire on daily mood that, in its long version, comprises 24 items which are rated on a 6-point Likert scale. Analogous to Wilhelm & Schoebi [50], we modified the questionnaire for the EMA in order to guarantee an appropriate length and tailor it to the language proficiency of the ASCs. Consequently, the modified MDMQ version used in this study included 6 bipolar items rated by a visual analogue scale ranging from 0 to 100 where respondents were asked to indicate how they felt at that given moment. The scales, each comprising 2 bipolar items, were as follows: good mood vs. bad mood, awake vs. tired, calm vs. nervous. The bipolar items of the scales used during the EMA were happy ↔ unhappy and content ↔ discontent for the mood scale, alert ↔ tired and rested ↔ worn out for the tiredness scale, and relaxed ↔ tense and calm ↔ nervous for the nervousness scale. The term “very” was added to the endpoints of the visual analogue scales, and “0” represented the “positive” endpoints (i.e. happy/content, alert/rested, and relaxed/calm) and “100” represented the “negative” endpoints (i.e. unhappy/discontent, tired/worn out, tense/nervous) of the scales. Beyond that, no other linguistic anchor points were added. The MDMQ is a widely used questionnaire and has already been utilized in EMA studies with a variety of populations [51] including adolescents [52,53]. Within-person inter-item reliability for the mentioned scales in this study was as follows, good mood vs. bad mood (2 items, α = .84), awake vs. tired (2 items, α = .72), and calm vs. nervous (2 items, α = .74).

Since many ASCs present sleep problems [29,30], we assessed sleep functioning as additional aspects by quality of sleep, sleep duration, and sleep onset latency (i.e., time needed to fall asleep). Participants rated sleep quality using a single item on a visual analogue scale ranging from 0 (“very well”) to 100 (“very badly”), with lower numbers representing a more “positive” outcome. Furthermore, they rated sleep duration and sleep onset latency by stating hours and minutes. These items were addressed exclusively in the mornings. We designed both daily mood (MDMQ) and sleep parameters forms as forced-choice items.

In addition, the EMA examined everyday experiences regarding post-migration factors, namely activities undertaken by the participants and their valence (as aspects of everyday resources), the occurrence of social interactions and their valence (as aspects of everyday social support), and experiences of discrimination. Participants recorded activities they had undertaken since the last prompt in a single multiple-choice item and rated whether they experienced them as pleasant or unpleasant on a bipolar visual analogue scale ranging from 0 to 100 where lower numbers represented a less pleasant specification of the item (with “very pleasant” and “very unpleasant” as the linguistic endpoints). The same procedure was applied to social interactions, where participants could first indicate with whom they had contact since the last prompt. Participants could then state the person with whom they had the most memorable interaction, and were asked to rate the valence of this interaction on a bipolar visual analogue scale. Furthermore, experiences of discrimination were examined using a modified 4-item version of the Everyday Discrimination Scale (EDS) [54] adjusted to the EMA design, such that participants could state how often they had experienced different discriminatory events since the last prompt (i.e., ‘being treated with less courtesy or respect than youths without history of flight’; ‘people acting as if they thought I was not as smart as youths without history of flight’; ‘people acting as if they were afraid of me; ‘being threatened or harassed’). The operationalization of post-migration factors and sleep patterns as well as their item formulation were based on consensual literature research pointing to the most relevant aspects of these constructs [25,55,56] and consultation with experts in the field. See S2 Table for the German EMA forms used in this study, and see S3 Table for the translated forms.

Statistical analyses

Data were analyzed using SPSS statistics, version 25. Prior to analysis, the uncentered questionnaires and EMA data were analyzed using descriptive statistics. Next, all person-related predictors (level 2) were grand-mean centered [57] in line with the recommendations by Ohly, Sonnentag, Niessen, and Zapf [58]. We then performed random intercept models to examine whether PTSS, depression or anxiety (level 2) were predictors of the mean levels of daily mood (good mood vs. bad mood, awake vs. tired, calm vs. nervous) and sleep parameters (quality, duration, and onset latency) (level 1). Based on the hierarchical structure of data, in which the daily within-person variables (daily mood and sleep parameters) were nested in persons, we performed random intercept models for each level 1 outcome variable [57]. Based on the null models we calculated the intraclass correlations (ICC) in order to estimate the distribution of variances for all level 1 variables. To test our hypotheses, all level 2 variables including main effects (PTSS, depression, anxiety) and interaction effects (PTSS × depression, PTSS × anxiety, depression × anxiety) were added simultaneously. The models included a random intercept. For the model fit, we used chi-square tests to examine the differences in the log likelihood ratios and degrees of freedom between the null models and the main and interaction models.

Results

Sample characteristics

Forty ASCs were included in the final analysis. The majority were male (n = 34, 85%), members of the Islamic faith (n = 34, 85%), had immigrated unaccompanied to Europe (n = 17, 43%), came from Afghanistan (n = 20, 50%), and attended a public school in Germany (n = 27, 68%). Most of the adolescents kept in touch with family members who were living in their home country at the time of the study (n = 35, 88%). The majority of ASCs were living in either semi- (n = 14, 35%) or full-care facilities (n = 11, 28%) of the German child and youth welfare system or were living with their families in private accommodation (n = 11, 28%). The asylum applications of most participating ASCs had been accepted (n = 28, 70%), even though the applications of some participants had been rejected (n = 11, 28%) or were still pending (n = 1, 2%). The majority had not received any kind of psychotherapeutic treatment (n = 32, 80%) since their arrival in Germany, 5 ASCs had completed psychotherapy (12%), and 3 participants were receiving some kind of therapeutic treatment at the time of assessment (8%). The mean age of the participating ASCs was 17.5 years (SD = 1.88, range 13 to 20 years) and they had been living in Germany for almost 3 years (M = 2.92, SD = .85). No differences regarding the sociodemographic characteristics between the ASCs, who participated in the EMA and the ones who did not, were identified using t-tests for independent samples with all p values above .07.

Participating ASCs had experienced a mean of almost 9 different potentially traumatic events in their lifetime (M = 8.7, SD = 3.35). The proportion of individuals who scored above the clinical cut-offs was as follows, CATS symptom score (n = 21, 52.5%), HSCL-37A total scale (n = 11, 27.5%), HSCL-37A depression scale (n = 11, 27.5%), and HSCL-37A anxiety scale (n = 9, 22.5%). Participants in EMAs differed significantly from non-participants with respect to mental health outcomes, such that participants showed higher levels of PTSS (CATS symptom score, t(70) = 2.44; p < .05), depression (HSCL-37A depression scale, t(70) = 2.94; p < .01), and anxiety (HSCL-37A anxiety scale, t(70) = 2.13; p < .05). See S1 Table for further information regarding demographics and mental health outcomes assessed using standardized questionnaire data.

Compliance with the EMA protocol.

To allow for a sufficient intra-person variance in EMA measurement points, only participants who responded to a minimum of 3 prompts were included in further analyses. Overall, 42 EMA prompts occurred for each participant over the course of the study, resulting in a total of 1680 prompts across all participants and measurement points. Of those, participants dismissed a total of 123 prompts (7.3%), and responded to a total of 680 prompts, 57 of which were incomplete (8.4%), resulting in an overall compliance rate of 40.5%. Compliance rates were highly heterogenous ranging from 7.1% to 100% between persons, and participants responded to an average of M = 17 prompts (SD = 9.85, range 3–42). The measurement point with the highest compliance was the evening prompt (48.8%), compliance rates in the morning and in the afternoon were 43.9% and 28.8%, respectively. Compliance was not correlated with any of the symptom levels assessed in the study as identified by correlation analyses with all p values above .31. Participants responded within 2.5 minutes, on average (SD = 6.18), after the first prompt occurred and took 2 minutes to answer the EMA questionnaire (M = 2.0, SD = 2.4).

EMA data on daily mood, sleep parameters, and post-migration factors.

Table 1 gives the descriptive statistics of the EMA data with regard to daily mood and sleep parameters. Participants reported different levels of daily mood over the course of the day, ranging from M = 41.9 (SD = 25.3) to M = 39.81 (SD = 28.07) for the mood scale, from M = 51.11 (SD = 26.27) to M = 43.12 (SD = 27.99) for the tiredness scale, and from M = 40.28 (SD = 24.31) to M = 38.92 (SD = 26.3) for the nervousness scale. Their reported mean level of sleep quality was M = 45.28 (SD = 23.41), and they reported an average of some 5 hours of sleep a night (M = 5.42, SD = 2.55), and a latency of one hour, on average, to fall asleep (M = 1.2, SD = 1.06).

thumbnail
Table 1. Descriptive representation of daily mood (good mood vs. bad mood, awake vs. tired, calm vs. nervous) and sleep parameters (quality, duration, onset latency) as reported by the participants (N1 = 40) at different points during the EMA (N2 = 680).

https://doi.org/10.1371/journal.pone.0246069.t001

Table 2 gives the descriptive statistics of the EMA data with regard to post-migration factors. For social interactions, either virtually or in person, friends from the same country were indicated most frequently as the most memorable social interactions (in the evening, n = 71, 27.6%; in the afternoon, n = 33, 22.1%). In both cases this implied that the social interaction had occurred since the last prompt. Siblings were indicated the least frequently as the most memorable interactions both in the afternoon (n = 8, 5.4%) and in the evening (n = 17, 6.6%). Participants rated their most memorable social interactions similarly in the evening (M = 29.53, SD = 25.77) and in the afternoon (M = 27.58, SD = 25.29). Social interactions with fathers were rated as most pleasant both in the evening (M = 9.22, SD = 7.95) and in the afternoon (M = 14.21, SD = 14.39).

thumbnail
Table 2. Descriptive representation of post-migration factors (social interactions, activities undertaken, discrimination) as reported by the participants (N1 = 40) at different points during the EMA (N2 = 435).

https://doi.org/10.1371/journal.pone.0246069.t002

Activities undertaken by the participants were reported in the evening only since most ASCs were attending school. The most frequent activity reported by the participants was using media such as listening to music or watching videos (n = 128, 50%) which was rated M = 28.45 (SD = 24.84) on the valence scale. Religious activities were the rarest activities (n = 52, 20.3%), but were perceived the most pleasant (M = 13.75, SD = 14.2).

Across all prompts, participants reported 139 incidents of at least one discriminatory event since the last prompt (8.5% of all queries), and a mean of some 5 discriminatory events over the course of the study (M = 4.88, SD = 7.72). ‘Being treated with less courtesy or respect’ was the most common incident both in the afternoon (n = 19) and in the evening (n = 43), whereas ‘being threatened or harassed’ was the rarest incident in the afternoon (n = 5), and ‘people acting as if they were afraid of me was the rarest incident in the evening (n = 11).

Relation between symptom levels assessed using standardized questionnaire data and daily mood and sleep parameters assessed using EMA data

ICCs indicated that a considerable proportion of variance could be observed on the within-person level: ρ = .46 for good mood vs. bad mood; ρ = .35 for awake vs. tired; ρ = .47 for calm vs. nervous; ρ = .37 for quality of sleep; ρ = .49 for duration of sleep; and ρ = .49 for sleep onset latency. For the model fit, we examined the differences in the log likelihood ratios and degrees of freedom between the null models and the main and interaction models by chi-square tests. As stated in Table 3, none of the chi-square tests for good vs. bad mood, χ2(6) = 9.68, p = .139, awake vs. tired, χ2(6) = 8.62, p = .196, and calm vs. nervous, χ2(6) = 7.58, p = .271, proved to be significant, indicating no significant difference between the null models and the main and interaction models. For sleep parameters (see Table 4), differences between the null models and the main and interaction models proved to be insignificant for quality, χ2(6) = 2.15, p = .906, and highly significant for duration, χ2(6) = 18.61, p < .01), and onset latency, χ2(6) = 36.28, p < .001.

thumbnail
Table 3. Multilevel models predicting daily mood (good mood vs. bad mood, awake vs. tired, calm vs. nervous).

https://doi.org/10.1371/journal.pone.0246069.t003

thumbnail
Table 4. Multilevel models predicting sleep parameters (quality, duration, onset latency).

https://doi.org/10.1371/journal.pone.0246069.t004

The results show that some symptom measures assessed in the standardized questionnaires significantly determined the mean level of daily mood (see Table 3). Higher levels of PTSS were significantly associated with higher levels of bad mood (γ = 1.23, t(31) = 1.925, p < .05). The same was true for anxiety (γ = 2.65, t(32) = 2.021, p < .05), indicating that ASCs with higher ratings of PTSS and anxiety showed higher levels of bad mood. Anxiety was the only variable related to tiredness (γ = 2.50, t(30) = 2.16, p < .05), such that ASCs with higher levels of anxiety showed higher levels of tiredness. Both anxiety and PTSS, were significantly related to nervousness (PTSS, γ = 1.30, t(34) = 2.04, p < .05; anxiety, γ = 2.46, t(35) = 1.877, p < .05), such that ASCs suffering from higher symptom levels reported higher levels of nervousness. Neither depression scores nor any of the analyzed interactions between the level 2 variables proved to be associated with any of the level 1 outcome measures.

For sleep parameters, we observed some level 2 effects (see Table 4). None of the between-person symptom scales turned out to be significantly associated with sleep quality. For sleep duration, there was a negative association with PTSS (γ = -.15, t(31) = -2.12, p < .05), showing that participants with higher levels of PTSS slept less. Anxiety levels were significantly related to sleep onset latency (γ = .13, t(37) = 1.82, p < .05), such that ASCs with higher ratings for anxiety needed more time to fall asleep.

Discussion

To our knowledge, this is the first study to report on a smartphone-assisted EMA study undertaken among ASCs resettled to western countries. ASCs are a psychologically distressed [6,27] and hard-to-reach population that appears to be understudied with regard to domains such as day-to-day living, daily mood, and post-migration factors [6].

Consequently, one major aim of this pilot study was to probe the EMA approach in this particular group, and examine participants’ compliance to the EMA protocol, in order to gain insight as to whether it might constitute a worthwhile addition to conventional assessment formats for ASCs. With this in mind, the results of this study are promising although some limitations have to be borne in mind. The approach proved to be implementable overall given that a large number of the ASCs contacted prior to the study showed interest in participating in the assessments, and the survey format appeared to appeal overall to the participants. Electronic devices such as smartphones are widely used and appreciated among refugee populations [59], and arguably even more so in refugee youth. This may have facilitated the favourable outcome regarding the readiness of ASCs to participate in this particular form of assessment. Having said that, the compliance rate in this study (40.5%) was rather low compared to a literature review on EMA studies in children and adolescents where rates ranged from 54.6% to 96.21% [20]. This finding corresponds to a recent EMA study with adult refugees [60] where the overall compliance rate was shown to be 55% after excluding 7 participants with a particularly low response rate (<20%). There are several plausible explanations for the low compliance rate determined in our study. First, we excluded only those participants who completed less than 3 prompts (<5%), whereas exclusion criteria in other EMA studies among adolescents vary broadly and are sometimes as high as <50% [61]. Consequently, excluding more participants with especially low response rates would have resulted in a more favourable overall compliance rate. Second, refugee youths might not be familiar with psychological survey formats [21,22,36,62]. This is why problems of comprehension might have emerged over the study runtime, possibly resulting in a lack of motivation to pursue the study protocol. Even though we ensured correct understanding of all items prior to study intake, and offered close guidance and support over the course of the study, we cannot dispel this uncertainty. Third, the sampling frequency might have affected the compliance rate. While there seems to be an association between fewer prompts per day and higher compliance rates in non-clinical samples, quite the opposite proved to be the case in clinical samples as determined in a meta-analysis of EMA studies with children and adolescents [20]. Even though our sample was not a clinical sample per se, participants were severely traumatized and showed high levels of psychological distress that clearly exceed the levels of psychological problems reported in non-clinical community settings [63,64]. Following the line of reasoning of the Wen et al. (2017) meta-analysis [20], these severely distressed individuals may experience the daily assessment of symptom-related aspects such as daily mood as meaningful and intrinsically relevant. Accordingly, close-meshed monitoring including more prompts per day while, at the same time, taking into account the multitude of obligations of ASCs over the course of the day, might produce more favourable compliance outcomes. To sum up, future EMA investigations with ASCs should, first, carefully weigh the ideal frequency and times of day to incorporate assessment prompts. Second, they might consider including compliance-linked incentives as well as ASCs’ caregivers to guide adherence to the study protocol. Last, they should consider adding a conclusive interview to gather information regarding participants’ acceptance of the survey format and the question why some participants respond only infrequently. This could shed light on further aspects of the feasibility of EMA studies among ASCs, and could help to identify potential design modifications that might facilitate better compliance.

The second objective of this study was to give an account of the day-to-day experiences of ASCs after resettlement with regard to post-migration factors and daily mood. In view of the pilot character of this study, it must first be pointed out that a central shortcoming of this study is the lack of a comparison group. Including an appropriate comparison group (e.g., native-born adolescents, young migrants without a history of flight, or the comparison of unaccompanied to accompanied ASCs) would allow for more in-depth statistical and clinical conclusions. Moreover, there are no corresponding normative values for either the age group under investigation or the modified version of the MDMQ [65]—the same is true for the further measures used in this study. Interpretations and classifications of the participants' data should therefore be made with caution. Since ASCs are a little studied population, it is nevertheless worthwhile to give a first picture of daily collected mood and post-migration factors and to draw at least some tentative comparisons to methodologically similar studies with non-ASCs.

Participants reported moderate levels of daily mood over the course of the day, with the morning prompt showing the poorest levels of daily mood on all scales recorded (good vs. bad mood, awake vs. tired, calm vs. nervous). This could be a consequence of their mediocre rating of sleep quality [66] and very short sleep duration (some 5.4 hours) as compared to both a sample of ASCs in the UK [29] and a sample of German adolescents [67] who both reported some 7–8 hours of sleep on weekdays. This—in conjunction with the fact that the American Academy of Sleep Medicine recommends 8 to 10 hours of sleep per night in the 13–18 age group [56]—further illustrates that sleep problems are central symptoms of ASCs [30]. With regard to the levels of daily mood assessed in this study, there is only a limited number of comparable EMA studies that used both the modified version of the MDMQ and examined adolescents. For example, compared to a study with adolescents suffering from non-suicidal self-injury in Germany, participants in our study showed somewhat higher mean daily mood values which, on the other hand, were also well below the values of the healthy control group [52]. This might be another indication of the severe levels of psychological distress in our sample as determined by retrospective clinical screening measures.

Across all prompts, interactions with friends from the same country were reported most frequently and were considered pleasant overall. These social networks appear to be important sources of social support for ASCs [68]. This might have been encouraged by the fact that most participants were still integrated in full-care units of the German child and youth welfare system where they regularly live alongside youths from the same country. Even tough interactions with their parents occurred more rarely; they were consistently rated to be the most pleasant and supportive interactions, in particular the ones with their father. The latter is a notable finding considering that past research has mainly outlined the essential role of the mother as a protective factor [69,70]. As many unaccompanied ASCs in this study stayed in touch with their parents over the phone, this re-emphasizes the fact that access to electronic communication devices is absolutely key for them to experience social support from their parents [68]. Accordingly, ASCs who had difficulty staying in touch with their relatives presented poorer psychological functioning in earlier studies [71]. With regard to recreation activities, participants reported doing sports and using multimedia (e.g. listening to music or watching videos) most frequently and rated them as pleasant overall. Of all activities queried in the assessments, religious practices such as praying were reported the least frequently, yet, rated the most pleasant. This points to the value of religious practices as potential coping strategies for ASCs who have resettled to western countries [7274]. Doing sports also ranked among the most pleasant activities and this is largely in line with past research that has highlighted the vital role of sports for ASCs after resettlement. This may impact a wide array of favourable processes such as acculturating into a host country [75,76]. Consequently, special sports programs for refugee youth have been developed and evaluated in the past [77], and encouraging their proliferation and accessibility to ASC is desirable. By and large, the reported experiences of discrimination in our study were comparable to a daily diary study of ethnic minority youth in the US, with participants in our study reporting roughly one event more over the course of the study [78]. However, the comparability is limited as there was a different measure in use. As was reported there, one of the negative effects of the discrimination experiences was that already anxious individuals showed further increased anxiety values over the course of the days. Negative effects of experiences of discrimination are also extensively documented in ASC literature [25]. Consequently, the prevention of such experiences should be a decisive goal of current policies.

Finally, we sought to investigate the relationship between ASCs’ symptom levels obtained using standardized questionnaires and daily mood and sleep parameters obtained using EMAs. The results indicate that higher symptom levels (i.e., PTSS and anxiety scores) were associated with poorer daily mood (i.e., bad mood, tiredness, nervousness) and poorer outcomes of some sleep parameters (i.e., duration and onset latency) in everyday life. While this might be considered a corollary of high symptom levels, given that these mental health problems regularly encompass sleeping problems and low mood [79], it is still an important finding and can be thought of as a further component of the predictive validation of the CATS and HSCL-37A [80]. Symptom levels reported in retrospective investigations and as assessed using brief screening measures did, in fact, correspond to daily assessed implications and were shown to affect the participating ASCs in their day-to-day lives. It has been argued that querying lower-threshold problems, such as sleep parameters or mood, could be a worthwhile and culturally more accepted form of symptom retrieval in primary care settings that could still provide initial indications of clinically noticeable symptoms [29], and the findings of our study support this argumentation. Besides that, sleeping problems and poor daily mood have been shown to have detrimental effects on important domains such as academic performance and self-esteem [8183]. Consequently, and in order to facilitate integration and good everyday functioning, providing care models that include systematic screening and access to treatment of mental health problems should be a major aim of current policies. Despite the paucity of adequate treatments, there are promising approaches that have been pursued in the past [46,47,84]. It is, moreover, worth noting that participants who took part in the EMA, showed significantly higher symptom levels than those who merely completed the standardized questionnaires. This indicates that ASCs with the highest levels of psychological distress showed particular interest in participating in the EMA. While this may be contrary to our presumptions, it illustrates both the need of severely traumatized ASCs for appropriate care and their openness to long-term monitoring [85], and increases the scope for the potential of innovative technology-based treatment approaches.

Limitations

Certain limitations should be borne in mind with respect to the appraisal of this study. As has been discussed above, the major shortcomings of this study are the lack of a control group and the relatively low compliance rate. Beyond that, it should be pointed out that our sample was of a convenient nature for various reasons. The participants were not recruited at random, and only those who had acquired sufficient language proficiency in order to understand the EMA forms were included in the study which might have resulted in selection bias. Also, the sample size was rather small which impeded more nuanced analyses and limits generalizability to the population of ASCs as a whole. Apart from issues concerning the sample composition, there may also have been procedural distortions. Even though we offered close guidance and support to all participants throughout the study runtime, the compliance rate was quite low which may impair the validity of the current findings. As has been discussed earlier, future investigations should, therefore, take certain steps to address this shortcoming. Furthermore, we cannot exclude with absolute certainty that problems of understanding cropped up over the course of the EMAs which might have resulted in invalid responses to the questionnaires. Finally, it should be mentioned that we only assessed post-migration factors and daily mood but not symptom levels on a daily basis. Gathering further data on day-to-day symptom levels might, therefore, contribute to deriving more in-depth conclusions about the mental health of this vulnerable population.

Conclusions

Examining everyday daily mood and post-migration factors in ASCs from 10 different countries using smartphone-assisted EMA was shown to be implementable. Not only do ASCs show high symptom levels, they are also affected by these symptoms in their daily lives as determined by the EMA data. We would welcome the regular implementation of EMA in future research efforts with ASCs. In order to ensure access for the widest possible range of participants, including ASCs with a low language level or no literacy, possible modifications should include translated EMA forms or audio-assisted assessment tools [86]. Due to the lack of evidence pointing to empirically supported strategies to promote compliance in children and adolescents [20,87], we can only assume that individually tailored assessment schedules, compliance-linked incentives, and the involvement of ASCs’ caregivers could offer an opportunity for improvement. Future research efforts could also focus on the relationship between daily mood and post-migration factors as well as intra-individual fluctuations during the day. The results of this study, as well as the EMA approach in and of itself, may help to establish low-threshold screening possibilities in primary care and to identify specific resources and coping strategies of ASCs in everyday life that should be promoted accordingly in the future.

Supporting information

S1 Table. Socio-demographic characteristics of the participating ASCs.

https://doi.org/10.1371/journal.pone.0246069.s001

(DOCX)

S2 Table. Original wording of the items used for the scales post-migration factors (social contacts, activities undertaken, experiences of discrimination) and sleep parameters in the ecological momentary assessment.

https://doi.org/10.1371/journal.pone.0246069.s002

(DOCX)

S3 Table. English translation of the items used for the scales post-migration factors (social contacts, activities undertaken, experiences of discrimination) and sleep parameters in the ecological momentary assessment.

https://doi.org/10.1371/journal.pone.0246069.s003

(DOCX)

Acknowledgments

The authors would like to thank all the participants, caregivers, and interpreters involved in the study.

Consent for publication

All participants and, if they were under 18, their legal guardians gave their consent for publication of the study results ahead of study participation.

References

  1. 1. Federal Office for Migration and Refugees (Bundesamt für Migration und Flüchtlinge). Aktuelle Zahlen zu Asyl. Ausgabe: Dezember 2016 [Asylum statistics. Version: December 2016]; 2016 [cited 2019 Oct 28]. Available from: URL: http://www.bamf.de/SharedDocs/Anlagen/DE/Downloads/Infothek/Statistik/Asyl/aktuelle-zahlen-zu-asyl-dezember-2016.pdf?__blob=publicationFile.
  2. 2. Federal Office for Migration and Refugees (Bundesamt für Migration und Flüchtlinge). Aktuelle Zahlen zu Asyl. Ausgabe: Dezember 2015 [Asylum statistics. Version: December 2015]; 2015 [cited 2018 Oct 28]. Available from: URL: http://www.bamf.de/SharedDocs/Anlagen/DE/Downloads/Infothek/Statistik/Asyl/aktuelle-zahlen-zu-asyl-dezember-2016.pdf?__blob=publicationFile.
  3. 3. Federal Office for Migration and Refugees (Bundesamt für Migration und Flüchtlinge). Aktuelle Zahlen zu Asyl. Ausgabe: Dezember 2017 [Asylum statistics. Version: December 2017]; 2017 [cited 2019 Oct 28]. Available from: URL: http://www.bamf.de/SharedDocs/Anlagen/DE/Downloads/Infothek/Statistik/Asyl/aktuelle-zahlen-zu-asyl-dezember-2017.pdf?__blob=publicationFile.
  4. 4. Hodes M, Jagdev D, Chandra N, Cunniff A. Risk and resilience for psychological distress amongst unaccompanied asylum seeking adolescents. J Child Psychol Psychiatry 2008; 49(7):723–32. pmid:18492037
  5. 5. Jakobsen M, Demott MAM, Heir T. Prevalence of Psychiatric Disorders Among Unaccompanied Asylum- Seeking Adolescents in Norway. Clin Pract Epidemiol Ment Health 2014; 10:53–8. pmid:25006343
  6. 6. Frounfelker RL, Miconi D, Farrar J, Brooks MA, Rousseau C, Betancourt TS. Mental Health of Refugee Children and Youth: Epidemiology, Interventions, and Future Directions. Annu Rev Public Health 2020; 41:159–76. pmid:31910713
  7. 7. Beiser M, Hou F. Mental Health Effects of Premigration Trauma and Postmigration Discrimination on Refugee Youth in Canada. J Nerv Ment Dis 2016; 204(6):464–70. pmid:27101023
  8. 8. Ellis BH, MacDonald HZ, Lincoln AK, Cabral HJ. Mental health of Somali adolescent refugees: The role of trauma, stress, and perceived discrimination. J Consult Clin Psychol 2008; 76(2):184–93. pmid:18377116
  9. 9. Salkind NJ, editor. Encyclopedia of research design. Los Angeles, Calif., London: SAGE; 2010. https://doi.org/10.1097/SMJ.0b013e3181eab419 pmid:20697321
  10. 10. Ebner-Priemer UW, Trull TJ. Ambulatory Assessment. Eur Psychol 2009; 14(2):109–19.
  11. 11. Christensen-Szalanski JJJ. The Hindsight Bias: A Meta-analysis. Organ Behav Hum Decis Process 1991; 48:147–68.
  12. 12. Roese NJ, Vohs KD. Hindsight Bias. Perspect Psychol Sci 2012; 7(5):411–26. pmid:26168501
  13. 13. van Giezen AE, Arensman E, Spinhoven P, Wolters G. Consistency of memory for emotionally arousing events: A review of prospective and experimental studies. Clin Psychol Rev 2005; 25(7):935–53. pmid:15979220
  14. 14. Spinhoven P, Bean TM, Eurelings-Bontekoe E. Inconsistencies in the self-report of traumatic experiences by unaccompanied refugee minors. J Trauma Stress 2006; 19(5):663–73. pmid:17075917
  15. 15. Aalsma MC, Zimet GD, Fortenberry JD, Blythe M, Orr DP. Reports of childhood sexual abuse by adolescents and young adults: stability over time. J Sex Res 2002; 39(4):259–63. pmid:12545408
  16. 16. Trull TJ, Ebner-Priemer UW. Ambulatory Assessment. Annu Rev Clin Psychol 2012; 9:151–76. pmid:23157450
  17. 17. Priebe K, Kleindienst N, Zimmer J, Koudela S, Ebner-Priemer UW, Bohus M. Frequency of intrusions and flashbacks in patients with posttraumatic stress disorder related to childhood sexual abuse: an electronic diary study. Psychol Assess 2013; 25(4):1370–6. pmid:23876157
  18. 18. Holmes EA, Ghaderi A, Eriksson E, Lauri KO, Kukacka OM, Mamish M, et al. 'I Can't Concentrate': A Feasibility Study with Young Refugees in Sweden on Developing Science-Driven Interventions for Intrusive Memories Related to Trauma. Behav Cogn Psychother 2017; 45(2):97–109. pmid:28229806
  19. 19. Morren M, van Dulmen S, Ouwerkerk J, Bensing J. Compliance with momentary pain measurement using electronic diaries: A systematic review. European Journal of Pain 2009; 13:354–65. pmid:18603458
  20. 20. Wen CKF, Schneider S, Stone AA, Spruijt-Metz D. Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis. J Med Internet Res 2017; 19(4):e132. pmid:28446418
  21. 21. Ehntholt KA, Yule W. Practitioner review: assessment and treatment of refugee children and adolescents who have experienced war-related trauma. J Child Psychol Psychiatry 2006; 47(12):1197–210. pmid:17176375
  22. 22. Rassenhofer M, Fegert JM, Plener PL, Witt A. Validierte Verfahren zur psychologischen Diagnostik unbegleiteter minderjähriger Flüchtlinge—eine systematische Übersicht/Validated Instruments for the Psychological Assessment of Unaccompanied Refugee Minors–a Systematic Review. Prax Kinderpsychol K 2016; 65:97–112.
  23. 23. Heptinstall E, Sethna V, Taylor E. PTSD and depression in refugee children: Associations with pre-migration trauma and post-migration stress. Eur Child Adolesc Psychiatry 2004; 13(6):373–80. pmid:15619050
  24. 24. Jakobsen M, Meyer DeMott MA, Wentzel-Larsen T, Heir T. The impact of the asylum process on mental health: A longitudinal study of unaccompanied refugee minors in Norway. BMJ Open 2017; 7(6):e015157. pmid:28637731
  25. 25. Fazel M, Reed RV, Panter-Brick C, Stein A. Mental health of displaced and refugee children resettled in high-income countries: Risk and protective factors. Lancet 2012; 379(9812):266–82. pmid:21835459
  26. 26. Miller KE, Rasco LM. An ecological framework for addressing the mental health needs of refugee communities. In: Miller KE, Rasco LM, editors. The Mental Health of Refugees: Ecological Approaches To Healing and Adaptation. London: Lawrence Erlbaum Associates; 2004. p. 1–64.
  27. 27. Bronstein I, Montgomery P. Psychological distress in refugee children: A systematic review. Clin Child Fam Psychol Rev 2011; 14(1):44–56. pmid:21181268
  28. 28. Oppedal B, Idsoe T. The role of social support in the acculturation and mental health of unaccompanied minor asylum seekers. Scand J Psychol 2015; 56(2):203–11. pmid:25614276
  29. 29. Bronstein I, Montgomery P. Sleeping patterns of Afghan unaccompanied asylum-seeking adolescents: a large observational study. PLoS ONE 2013; 8(2):e56156. pmid:23457517
  30. 30. Horlings A, Hein I. Psychiatric screening and interventions for minor refugees in Europe: An overview of approaches and tools. Eur J Pediatr 2018; 177(2):163–9. pmid:29124447
  31. 31. Tam SY, Houlihan S, Melendez-Torres GJ. A Systematic Review of Longitudinal Risk and Protective Factors and Correlates for Posttraumatic Stress and Its Natural History in Forcibly Displaced Children. Trauma Violence Abuse 2017; 18(4):377–95. pmid:26721887
  32. 32. Müller LRF, Gossmann K, Hartmann F, Büter KP, Rosner R, Unterhitzenberger J. 1-year follow-up of the mental health and stress factors in asylum-seeking children and adolescents resettled in Germany. BMC Public Health 2019; 19(908):1–11. pmid:31286909
  33. 33. Mollica RF, Poole C, Son L, Murray CC, Tor S. Effects of war trauma on Cambodian refugee adolescents' functional health and mental health status. J Am Acad Child Psy 1997; 36(8):1098–106. pmid:9256589
  34. 34. Sack WH, Clarke GN, Him C, Dickason D, Goff B, Lanham K et al. A 6-year follow-up study of Cambodian refugee adolescents traumatized as children. J Am Acad Child Psy 1993; 32:431–7. pmid:8444775
  35. 35. Bhui K, Mohamud S, Warfa N, Craig TJ, Stansfeld SA. Cultural adaptation of mental health measures: improving the quality of clinical practice and research. Brit J Psychiat 2003; 183:184–6. pmid:12948986
  36. 36. Paalman CH, Terwee CB, Jansma EP, Jansen LMC. Instruments measuring externalizing mental health problems in immigrant ethnic minority youths: a systematic review of measurement properties. PLoS ONE 2013; 8(5):e63109. pmid:23704892
  37. 37. Prince M. Measurement validity in cross-cultural comparative research. Epidemiol Psichiatr Soc 2008; 17(3):211–20. pmid:18924560
  38. 38. Ouimette P, Goodwin E, Brown PJ. Health and well being of substance use disorder patients with and without posttraumatic stress disorder. Addict Behav 2006; 31(8):1415–23. pmid:16380217
  39. 39. Duffy A, Keown-Stoneman CD, Goodday SM, Saunders K, Horrocks J, Grof P, et al. Daily and weekly mood ratings using a remote capture method in high-risk offspring of bipolar parents: Compliance and symptom monitoring. Bipolar Disord 2019; 21(2):159–67. pmid:30422376
  40. 40. Schwartz S, Schultz S, Reider A, Saunders EFH. Daily mood monitoring of symptoms using smartphones in bipolar disorder: A pilot study assessing the feasibility of ecological momentary assessment. J Affect Disord 2016; 191:88–93. pmid:26655117
  41. 41. Cormack F, McCue M, Taptiklis N, Skirrow C, Glazer E, Panagopoulos E et al. Wearable Technology for High-Frequency Cognitive and Mood Assessment in Major Depressive Disorder: Longitudinal Observational Study. JMIR Ment Health 2019; 6(11):e12814. pmid:31738172
  42. 42. Trull TJ, Ebner-Priemer UW. Ambulatory assessment in psychopathology research: A review of recommended reporting guidelines and current practices. J Abnorm Psychol 2020; 129(1):56–63. pmid:31868388
  43. 43. Müller LRF, Büter KP, Rosner R, Unterhitzenberger J. Mental health and associated stress factors in accompanied and unaccompanied refugee minors resettled in Germany: a cross-sectional study. Child Adolesc Psychiatry Ment Health 2019; 13(8):1–13. pmid:30719070
  44. 44. Berliner L, Goldbeck L. Instructions for the CATS (Child and Adolescent Trauma Screening); 2014. Available from: URL: https://ulmer-onlineklinik.de/course/view.php?id=1701.
  45. 45. Sachser C, Berliner L, Holt T, Jensen TK, Jungbluth N, Risch E, et al. International development and psychometric properties of the Child and Adolescent Trauma Screen (CATS). J Affect Disord 2017; 210(1):189–95. pmid:28049104
  46. 46. Unterhitzenberger J, Wintersohl S, Lang M, König J, Rosner R. Providing manualized individual trauma-focused CBT to unaccompanied refugee minors with uncertain residence status: a pilot study. Child Adolesc Psychiatry Ment Health 2019; 13:22. pmid:31131021
  47. 47. Pfeiffer E, Sachser C, Rohlmann F, Goldbeck L. Effectiveness of a trauma-focused group intervention for young refugees: a randomized controlled trial. J Child Psychol Psychiatry 2018; 59(11):1171–9. pmid:29624664
  48. 48. Bean TM, Eurelings-Bontekoe E, Derluyn I, Spinhoven P. HSCL-37A User's Manual. Available from: URL: http://www.centrum45.nl.
  49. 49. Steyer R, Schwenkmezger P, Notz P, Eid M. Der mehrdimensionale Befindlichkeitsfragebogen (MDBF): [The multidimensional mood questionnaire (MDMQ)]. Göttingen: Hogrefe; 1997.
  50. 50. Wilhelm P, Schoebi D. Assessing Mood in Daily Life: Structural Validity, Sensitivity to Change, and Reliability of a Short-Scale to Measure Three Basic Dimensions of Mood. Eur J Psychol Assess 2007; 23(4):258–67.
  51. 51. Forster SD, Gauggel S, Petershofer A, Völzke V, Mainz V. Ecological Momentary Assessment in Patients With an Acquired Brain Injury: A Pilot Study on Compliance and Fluctuations. Front Neurol 2020; 11:115. pmid:32194494
  52. 52. Santangelo PS, Koenig J, Funke V, Parzer P, Resch F, Ebner-Priemer UW, et al. Ecological Momentary Assessment of Affective and Interpersonal Instability in Adolescent Non-Suicidal Self-Injury. J Abnorm Child Psychol 2017; 45(7):1429–38. pmid:27995358
  53. 53. Koenig J, Klier J, Parzer P, Santangelo P, Resch F, Ebner-Priemer U, et al. High-frequency ecological momentary assessment of emotional and interpersonal states preceding and following self-injury in female adolescents. Eur Child Adolesc Psychiatry 2020. pmid:32862250
  54. 54. Williams DR, Yu Y, Jackson JS, Anderson NB. “Racial Differences in Physical and Mental Health: Socioeconomic Status, Stress, and Discrimination. J Health Psychol 1997; 2(3):335–51. pmid:22013026
  55. 55. Sleijpen M, Boeije HR, Kleber RJ, Mooren T. Between power and powerlessness: a meta-ethnography of sources of resilience in young refugees. Ethn Health 2016; 21(2):158–80. pmid:26107385
  56. 56. Paruthi S, Brooks LJ, D'Ambrosio C, Hall WA, Kotagal S, Lloyd RM, et al. Recommended Amount of Sleep for Pediatric Populations: A Consensus Statement of the American Academy of Sleep Medicine. J Clin Sleep Med 2016; 12(6):785–6. pmid:27250809
  57. 57. Nezlek JB. Multilevel Modeling for Social and Personality Psychology. Los Angeles: SAGE; 2011.
  58. 58. Ohly S, Sonnentag S, Niessen C, Zapf D. Diary Studies in Organizational Research: An Introduction and Some Practical Recommendations. J Pers Psychol 2010; 9(2):79–93.
  59. 59. Mohr DC, Schueller SM, Araya R, Gureje O, Montague E. Mental health technologies and the needs of cultural groups. Lancet Psychiat 2014; 1:326–7. pmid:26360986
  60. 60. Koch T, Liedl A, Takano K, Ehring T. Daily Worry in Trauma-Exposed Afghan Refugees: Relationship with Affect and Sleep in a Study Using Ecological Momentary Assessment. Cogn Ther Res 2020; 16(6):1247.
  61. 61. Heron KE, Everhart RS, McHale SM, Smyth JM. Using Mobile-Technology-Based Ecological Momentary Assessment (EMA) Methods With Youth: A Systematic Review and Recommendations. J Pediatr Psychol 2017; 42(10):1087–107. pmid:28475765
  62. 62. Gadeberg AK, Montgomery E, Frederiksen HW, Norredam M. Assessing trauma and mental health in refugee children and youth: a systematic review of validated screening and measurement tools. Eur J Public Health 2017; 27(3):439–46. pmid:28472394
  63. 63. Alisic E, Zalta AK, van Wesel F, Larsen SE, Hafstad GS, Hassanpour K, et al. Rates of post-traumatic stress disorder in trauma-exposed children and adolescents: Meta-analysis. Brit J Psychiat 2014; 204:335–40. pmid:24785767
  64. 64. Costello EJ, Mustillo S, Erkanlin A, Keeler G, Angold A. Prevalence and Development of Psychiatric Disorders in Childhood and Adolescence. Arch Gen Psychiatry 2003; 60:837–44. pmid:12912767
  65. 65. Hinz A, Daig I, Petrowski K, Brähler E. Die Stimmung in der deutschen Bevölkerung: Referenzwerte für den Mehrdimensionalen Befindlichkeitsfragebogen MDBF. [Mood in the German population: Norms of the Multidimensional Mood Questionnaire MDBF]. Psychother Psychosom Med Psychol 2012; 62(2):52–7. pmid:22271232
  66. 66. Owens, Judith A., Weiss, Miriam R. Insufficient sleep in adolescents: causes and consequences. Minerva Pediatrica 2017; 69(4):326–36. pmid:28211649
  67. 67. Randler C, Wolfgang L, Matt K, Demirhan E, Horzum MB, Beşoluk Ş. Smartphone addiction proneness in relation to sleep and morningness-eveningness in German adolescents. J Behav Addict 2016; 5(3):465–73. pmid:27499228
  68. 68. Sierau S, Schneider E, Nesterko Y, Glaesmer H. Alone, but protected? Effects of social support on mental health of unaccompanied refugee minors. Eur Child Adolesc Psychiatry 2019; 28(6):769–80. pmid:30382357
  69. 69. Derluyn I, Mels C, Broekaert E. Mental health problems in separated refugee adolescents. J Adolesc Health 2009; 44(3):291–7. pmid:19237116
  70. 70. Derluyn I, Broekaert E, Schuyten G, Temmerman ED. Post-traumatic stress in former Ugandan child soldiers. Lancet 2004; 363(9412):861–3. pmid:15031032
  71. 71. Almqvist K, Brandell-Forsberg M. Refugee Children in Sweden: Post-Traumatic Stress Disorder in Iranian Preschool Children Exposed to Organzied Violence.
  72. 72. Seybold KS, Hill PC. The Role of Religion and Spirituality in Mental and Physical Health. Curr Dir Psychol Sci 2001; 10(1):21–4.
  73. 73. Sleijpen M, Boeije HR, Kleber RJ, Mooren T. Between power and powerlessness: a meta-ethnography of sources of resilience in young refugees. Ethn Health 2016; 21(2):158–80. pmid:26107385
  74. 74. Ní Raghallaigh M, Gilligan R. Active survival in the lives of unaccompanied minors: coping strategies, resilience, and the relevance of religion. Child Family Social Work 2010; 15(2):226–37.
  75. 75. Ha J-P, Lyras A. Sport for refugee youth in a new society: the role of acculturation in sport for development and peace programming. S Afr J Res Sport Ph 2013; 35(2):121–40.
  76. 76. Doherty A, Taylor T. Sport and physical recreation in the settlement of immigrant youth. Leisure 2007; 31(1):27–55.
  77. 77. Whitley MA, Coble C, Jewell GS. Evaluation of a sport-based youth development programme for refugees. Leisure 2016; 40(2):175–99.
  78. 78. Douglass S, Mirpuri S, English D, Yip T. "They were just making jokes": Ethnic/racial teasing and discrimination among adolescents. Cultur Divers Ethnic Minor Psychol 2016; 22(1):69–82. pmid:26009942
  79. 79. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 5th ed. Arlington, VA: American Psychiatric Publishing.
  80. 80. Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull 1955; 52:281–302. pmid:13245896
  81. 81. Roberts RE, Roberts CR, Duong HT. Sleepless in adolescence: prospective data on sleep deprivation, health and functioning. J Adolesc 2009; 32(5):1045–57. pmid:19361854
  82. 82. Frederiksen K, Rhodes J, Reddy R, Way N. Sleepless in Chicago: Tracking the Effects of Adolescent Sleep Loss During the Middle School Years. Child Dev 2004; 75(1):84–95. pmid:15015676
  83. 83. Huppert FA. Psychological Well-being: Evidence Regarding its Causes and Consequences. Appl Psychol Health Well Being 2009; 1(2):137–64.
  84. 84. Fazel M, Betancourt TS. Preventive mental health interventions for refugee children and adolescents in high-income settings. Lancet Child Adolesc Health 2018; 2(2):121–32. pmid:30169234
  85. 85. Runyan JD, Steenbergh TA, Bainbridge C, Daugherty DA, Oke L, Fry BN. A smartphone ecological momentary assessment/intervention "app" for collecting real-time data and promoting self-awareness. PLoS ONE 2013; 8(8):e71325. pmid:23977016
  86. 86. Morina N, Ewers SM, Passardi S, Schnyder U, Knaevelsrud C, Müller J, et al. Mental health assessments in refugees and asylum seekers: evaluation of a tablet-assisted screening software. Confl Health 2017; 11:18. pmid:29026438
  87. 87. Liao Y, Skelton K, Dunton G, Bruening M. A Systematic Review of Methods and Procedures Used in Ecological Momentary Assessments of Diet and Physical Activity Research in Youth: An Adapted STROBE Checklist for Reporting EMA Studies (CREMAS). J Med Internet Res 2016; 18(6):e151. pmid:27328833