Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Voice quality and speech fluency distinguish individuals with Mild Cognitive Impairment from Healthy Controls

  • Charalambos Themistocleous ,

    Roles Conceptualization, Formal analysis, Methodology, Software, Writing – original draft, Writing – review & editing

    cthemis1@jhu.edu

    Affiliation Department of Neurology, Johns Hopkins University, Baltimore, Maryland, United States of America

  • Marie Eckerström,

    Roles Validation, Writing – review & editing

    Affiliation Department of Psychiatry and Neurochemistry, University of Gothenburg, Gothenburg, Sweden

  • Dimitrios Kokkinakis

    Roles Data curation, Funding acquisition, Writing – review & editing

    Affiliations Department of Swedish, University of Gothenburg, Gothenburg, Sweden, Center of Ageing and Health—AgeCap, University of Gothenburg, Gothenburg, Sweden

Abstract

Mild Cognitive Impairment (MCI) is a syndrome characterized by cognitive decline greater than expected for an individual's age and education level. This study aims to determine whether voice quality and speech fluency distinguish patients with MCI from healthy individuals to improve diagnosis of patients with MCI. We analyzed recordings of the Cookie Theft picture description task produced by 26 patients with MCI and 29 healthy controls from Sweden and calculated measures of voice quality and speech fluency. The results show that patients with MCI differ significantly from HC with respect to acoustic aspects of voice quality, namely H1-A3, cepstral peak prominence, center of gravity, and shimmer; and speech fluency, namely articulation rate and averaged speaking time. The method proposed along with the obtainability of connected speech productions can enable quick and easy analysis of speech fluency and voice quality, providing accessible and objective diagnostic markers of patients with MCI.

Introduction

Mild Cognitive Impairment (MCI) is a syndrome characterized by cognitive decline greater than expected for an individual's age and education level. Patients with MCI remain functional in their daily activities [1]. Progression rates vary across studies depending on the diagnostic criteria and methods being employed, although there are indications that about 50% of patients with MCI progress to Alzheimer’s Disease (AD) within five years, yet many patients remain stable for several years [13]. Currently, there is no cure for AD, but identifying patients with MCI early and applying therapy in a timely manner can delay the progression of the MCI to AD [4]. It is of utmost importance, to develop straightforward, not intrusive, and reliable objective diagnostic measurements of cognitive impairment that can be conducted at primary care centers and memory clinics to determine whether an individual should seek further professional advice.

Speech can provide such objective measures for the identification of patients with MCI. As language impairment is a common symptom of AD, affecting most language domains and functions including phonetics [5, 6], phonology [7], morphosyntactic structure (e.g., mean length of utterances, proportions of nouns and verbs, and syntactic complexity measures), semantics [8, 9], discourse and conversation [7, 10, 11], it can be employed to provide objective diagnostic markers. One of the less understood and studied aspects of language is speech production in patients with MCI [12, 13] and more research is required on the speech of patients with MCI as speech can convey information about the underlying language system and how it interacts with other language domains [1416]. For instance, the slow recall of words can affect speech fluency, especially durational and frequency measures, tonal modulation, and pauses [1418]. Speech can convey information about motoric and cognitive abilities of patients with MCI that relate to articulation, voice quality, and fluency. König et al. [12] employed automated acoustic measures and classified patients with MCI and healthy controls (HC) with 79% classification accuracy, patients with MCI and AD with 80% accuracy, and patients with AD from HC with 89% classification accuracy. In our previous work [19], we analyzed segmental and prosodic features of speech production and showed that vowel formants (F1 to F5), the fundamental frequency, and vowel duration can distinguish patients with MCI from HC with 83% mean cross-validated accuracy.

This study aims to identify a few selected features from voice quality and speech fluency that can function as objective markers distinguishing patients with MCI from HC. An advantage of this study over other studies of language in MCI is that our approach does not require preprocessing, such as transcription and segmentation of the acoustic signal into vowels and consonants. Specifically, we tested two main questions: i. Does voice quality (as estimated by differences between speech harmonics and amplitudes, the cepstral peak prominence (CPP), mean energy concentration of spectral or first spectral moment, the Hammarberg index, jittering, and shimmer) distinguish patients with MCI from HC? And ii. Do measures of speech fluency (namely, the averaged speaking time, articulation rate, and speech rate) distinguish patients with MCI from HC? To answer these questions, we are providing an acoustic analysis of speech productions from the Cookie Theft picture description task from the Boston Diagnostic Aphasia Examination (BDAE) produced by Swedish patients with MCI and HC [20]. This study shows that voice quality and speech fluency provide information that can identify patients with MCI from HC.

Patients and methods

Participants

The 55 participants were recruited as part of the Gothenburg MCI study, which is a large clinically based longitudinal study on MCI [21]. Details about the participants are provided in Table 1. The Gothenburg MCI study provides an in-depth phenotyping of patients with different forms and degrees of cognitive impairment using imaging/physiologic methods, psychometrics, and biochemical methods, namely cerebrospinal fluid characterization of substances in the brain. Participants were selected based on specific inclusion and exclusion criteria: (i) no dyslexia and other reading deficiencies; (ii) no current history of major depression, and recent substance abuse; (iii) no history of serious psychiatric, neurological and other brain-related conditions; (iv) to be native Swedish speakers; (v) to be able to read and understand information about the study; and (vi) to be able to provide written consent. HC had a significantly higher Mini-Mental State Exam score (M = 29.6). The MMSE score is a scale of 0–30 and represents the cognitive status of an individual. Mean MMSE score for the MCI participants was 28.2, which is close to normal [2224]. Ethic approvals, the consent procedure, and data acquisition were approved by the Swedish Ethical Review Authority, <http://www.epn.se/> (ref. nr: 206–16, 2016) and the ethics amendment was approved by the same institution (ref. nr: T021-18, 2018). Subjects were prospectively recruited from one center: the Memory Clinic at the Sahlgrenska University Hospital, Sweden. All patients provided written informed consent for use of data before the data collection.

thumbnail
Table 1. Demographic information and scores for memory & learning, language, attention, and executive function, by group (mean and standard deviation).

https://doi.org/10.1371/journal.pone.0236009.t001

Procedure and acoustic measurements

MCI diagnosis was based on staging of cognitive and functional abilities using the Geriatric deterioration scale (GDS) (GDS stage 3 = MCI) [32]. Specific operationalization of the GDS scoring in the Gothenburg MCI study has been described previously in detail [21]. The MCI group was mixed—we did not categorize the patients into MCI subgroups (such as amnestic MCI and non-amnestic MCI). A physician and/or registered nurse conducted the GDS assessment procedure, and the neuropsychological tests were administered by licensed psychologists alternatively health care professionals supervised by a licensed psychologist. Neuropsychological tests were selected by specialized psychologists, comprising tests within the cognitive domains speed and attention, learning and episodic memory, visuospatial, language, and executive functions. Testing was performed during clinical visits.

The picture description task was part of additional assessment tests conducted as part of “Linguistic and extra-linguistic parameters for early detection of cognitive impairment” research project funded by Riksbankens Jubileumsfond–The Swedish Foundation for Humanities & Social Sciences (NHS 14–1761:1). This picture shows two children trying to remove cookies from a jar placed on top of a cupboard as their mother is washing the dishes. A speech and language pathologist presented the picture to participants and prompted them to tell everything they see on the picture following the standard BDAE version 3 instructions. The picture description task was audio recorded using a Zoom H4N audio recorder, located at a fixed distance (1ft) in front of the participant. The audio was subsequently converted to 16000 Hz mono format [19, 33] and analyzed acoustically using the open source software for acoustic analysis Praat [34]. Specifically, we analyzed speech sounds and measured acoustic properties related to voice quality and speech fluency. Measurements of voice quality and syllable structure were calculated.

1. Voice quality / phonation.

Phonation and voice quality account for the fine control of the sublaryngeal and laryngeal systems. To determine the phonation and voice quality differences of patients with MCI and HC, we have calculated the following measurements.

  1. H1-H2, H1-A1, H1-A3: Difference between the amplitude of the first and second harmonics (H1-H2), the amplitude of the first harmonic and the amplitude of strongest harmonic of the first formant frequency (H1-A1), and the amplitude of the first harmonic and the amplitude of the third formant (H1-A3) demarcate voice quality. Harmonics are estimated by considering the fundamental frequency, and amplitudes from the spectra. H1-H2 indicates breathy (strong H1) and creaky voice (weaker H2) [35].
  2. Cepstral Peak Prominence (CPP): CPP is a reliable measure of dysphonia [36]. It accounts for the periodicity in the voice signal: higher values of CPP correspond to greater periodicity. It stands as the relative amplitude of the CPP in relation to the expected amplitude as derived via linear regression.
  3. Mean Energy Concentration: or first spectral moment is the average spectral frequency [37, 38].
  4. Hammarberg Index: The Hammarberg index is the difference between the maximum energy in the 0…2kHz energy band and the energy in the 2…5kHz band. The Hammarberg index is considered an indicator of articulatory effort [39].
    Finally, we provide measures of shimmering, jittering, and harmonicity elicited using Praat [34].
  5. Jitter (Hz): it is the cycle-to-cycle variation of the fundamental frequency (F0) (1), expressed as:
    (1) where Ti are the extracted period lengths and N is the number of extracted F0 periods. The F0 is the basic frequency produced during the vibration of the vocal folds and it is one of the primary acoustic correlates of intonation, which manifests linguistic (e.g., different melodic patterns for questions, and statements) and extralinguistic functions (e.g., emotional prosody) [40]. Reduced control on vocal-fold vibration results in higher percentage of jitter [41].
  6. Shimmer (dB): it is the variability of the amplitude from peak-to-peak (local maxima). Eq (2) shows shimmer as the mean absolute base-10 logarithm (multiplied by 20) of the difference between the amplitudes of successive periods (2):
    (2) where Ai are the extracted peak-to-peak measurements of amplitude and N is the number of F0 periods. Shimmer indicates noisy productions and breathiness and it is a correlate of glottal resistance and mass lesions on the vocal folds [41].

2. Speech fluency.

Speech rate and articulation rate. These are measures of fluency as described in the introduction. We calculated the following measures: average syllable duration, the articulation rate, and speech rate.

  1. Average Syllable Duration: Is the mean syllable duration estimated as a measure of the overall speaking time divided by the number of syllables (3). (3)
  2. Articulation Rate: Articulation rate considers phonation time, which is a measure of phonation times and excludes pauses and silences (4). (4)
  3. Speech Rate: Is a measure of the number of syllables divided by the overall duration, which includes pauses and silences (5): (5)

For the statistical analysis, we employed linear mixed effects models using condition (MCI vs. HC) and gender as fixed factors on voice quality and phonation measurements (dependent variables) and condition on speech fluency measurements dependent variables. We included gender in the statistics of voice quality and phonation, as these measures depend on physiological differences between men and women, e.g., lower pitch in men than in women. The R package emmeans was employed to obtain estimated marginal means (EMMs, also known as least-squares means) for factor combinations in the linear mixed effects models and compute the contrasts or linear combinations of these marginal means.

Results

Voice quality / phonation

Voice quality measures demonstrate significant differences between patients with MCI and HC as shown in Fig 1. Patients with MCI produce speech that differs from HC in phonation and voice quality, which is measured using objective markers presented in this section and determine differences in the fine-control of the sublaryngeal and laryngeal systems. We found significant differences of patients with MCI from HC with respect to the difference of the first harmonic and third amplitude (H1-A3), shown in Table 2. Patients with MCI differed significantly from HC with respect to their CPP (see Fig 1, Panel B). There is an overall lower CPP in patients with MCI compared to HC, suggesting weaker voice. Also, patients with MCI differed significantly from HC with respect to shimmer and center of gravity. However, patients with MCI and HC did not differ significantly with respect to the Hammarberg Index measurement (F(1:278) = 0.137, p = 0.711). Also, there were no significant differences between patients with MCI and HC in jitter (F (1, 254) = 2.73, p = 0.1).

thumbnail
Fig 1. Voice quality and phonation elicited from audio recordings produced by patients with MCI and HC.

(A) H1-A3 (dB); (B) Cepstral Peak Prominence (dB); (C) Center of Gravity (Hz); and (D) Shimmer (dB) in HC and patients with MCI; ‘.’ indicates p < 0.1; ‘*’ indicates p < .05; ‘**’ indicates p < .01.

https://doi.org/10.1371/journal.pone.0236009.g001

thumbnail
Table 2. Regression results for the effect of condition (MCI vs. HC) and gender on H1-A3.

https://doi.org/10.1371/journal.pone.0236009.t002

C2. Speech fluency

Patients with MCI produced significantly longer syllables from HC, as measured by the average syllable duration and had a slower articulation rate and speech rate but only with respect to average syllable duration and articulation rate we found significant effects (see Fig 2 and Table 3).

thumbnail
Fig 2. Measures of speech fluency elicited from audio recordings produced by patients with MCI and HC.

(A) averaged speaking time; (B) articulation rate; and (C) speech rate in HC and patients with MCI; ‘.’ indicates p < 0.1; ‘*’ indicates p < .05; ‘**’ indicates p < .01.

https://doi.org/10.1371/journal.pone.0236009.g002

thumbnail
Table 3. Regression results for the effect of Condition (MCI vs. HC) on averaged syllable duration, articulation rate, and speech rate.

https://doi.org/10.1371/journal.pone.0236009.t003

Table 4 presents a summary of the main findings with the acoustic measures that differentiate patients with MCI from HC.

Discussion

Cognitive decline in patients with Mild Cognitive Impairment (MCI) is manifested as a noticeable memory difficulty in remembering events and situations, impaired language, speech, decision making, planning, interpreting instructions, and orientation [1, 21, 4248]. Given that MCI patients are a high risk group for developing AD, there is a dire need to elicit objective measures that can enable the early and quick identification of patients with MCI, to provide treatment promptly, facilitate MCI prognosis, and ultimately improve life quality both for patients with MCI and for their family members. This study provides novel findings that show impairment of speech production in patients with MCI with respect to (i) voice quality and (ii) speech fluency and demonstrates that these measures can provide objective diagnostics of patients with MCI.

Voice quality measures of MCI

An unexpected finding is that patients with MCI differed from HC with respect to voice quality. Early cognitive impairment is manifested by disparities in voice breathiness and increased dysphonia. Patients with MCI differed from HC in H1-A3, which suggests that voice breathiness is different in patients with MCI with respect to HC. Our study shows an increased H1-A3 in patients with MCI with respect to HC. Tanaka, Adachi [49] report a similar finding in patients with AD vs. HC. A novel finding was that patients with MCI show lower periodicity in spectra than HC, which corresponds to greater dysphonia, as measured with the CPP. Patients with MCI are characterized by overall lower center of gravity; which can correspond to lower frequency speech productions, that result into a significantly weaker speech than HC of the same age. It also indicates an overall relaxation of articulators during speech production that is manifested by the lowering of the spectral center of gravity. Patients with MCI are characterized by greater shimmer in speech production which indicates greater instability of amplitude. Greater shimmer may indicate less stability and control of the sublaryngeal/pulmonary pressure. Another important finding is that patients with MCI are characterized by differences in breathy voice, greater dysphonia, lower center of gravity and shimmer. These findings may be the result of cognitive and physiological impairment of the fine control and the slowing down of the vocal folds, of pulmonary pressure, respiration, and the co-ordination of phonation with articulatory production [15, 5053].

Speech fluency measures

Patients with MCI have different speech fluency measures. Our findings show that the overall articulation rate and speech rate are significantly slower in patients with MCI than in elderly HC. The slower articulation rate can be the result of slower cognitive processes due to MCI, affecting attention, memory, and language, including word recall and grammar [13]. It can also be the result of impaired motor control as patients with MCI are characterized largely by abnormalities in motor coordination and disinhibition [54], motor preparation [55], and motor planning [56], which can influence motoric functions related to articulation.

Diagnostic utility of speech features

This study brought together speech acoustics and statistical analysis for the study of speech production in MCI. Speech reveals multidimensional information about the speaker (e.g., age, gender, sociolinguistic characteristics, physiological condition) and can function as a fingerprint that identifies patients with MCI from HC. The findings provide objective measures from voice quality that distinguish patients with MCI and HC and at the same time they point to the importance of phonation and speech fluency as a diagnostic measurement [5053]. Implemented as a computer application, this approach can provide an easy and accessible interface for the automatic quantification of voice quality and speech fluency, utilized by physicians, neuropsychologists, and speech therapists to quantify speech in tasks, such as picture description tasks, scripts, and discourse. By increasing the span of acoustic measurements that can be analyzed and understanding their corresponding speech deficits [57, 58], physicians, neuropsychologists, and speech therapists can tailor therapeutic programs to the specific needs of their clients (e.g., focusing on targeted part of speech productions). Measures of voice quality and fluency from connected speech, discourse, etc. can enable clinicians to assess the overall speech production of patients with MCI and provide information about the differential speech properties of patients with MCI variants and HC and ultimately enable a better understanding of speech symptoms of patients with MCI.

Limitations and future directions

Picture description tasks (e.g., Cookie Theft) constrain the production of speech in that the productions are often narrowed down to labelling rather than on free narration which to a certain degree may constrain fluency measurements. In contrast, storytelling, discourse, and conversation are characterized by expressive variations of fluency. This aspect of fluency cannot be tested using picture description tasks but requires a computational analysis of voice quality and speech fluency in free style conversations and in other conditions affecting language, such as stroke aphasia and primary progressive aphasia [e.g., 58, 59, 6064]. Another limitation is the relatively small sample size; a larger sample size is expected to increase the effect size of the model. Also, as speakers are recruited at a single recruitment center, the participants may not be representative of the overall population of patients with MCI in Sweden. To address these limitations, we are collecting a variety of linguistic data from a larger population of patients attending different recruitment centers. The acoustic measures proposed in this study along with the obtainability of connected speech productions and the availability of acoustic analysis software can enable the rapid analysis of speech in the primary care centers and memory clinics providing accessible diagnostic methods for MCI.

References

  1. 1. Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Archives of neurology. 1999;56(3):303–8. pmid:10190820
  2. 2. Gauthier S, Reisberg B, Zaudig M, Petersen RC, Ritchie K, Broich K, et al. Mild cognitive impairment. The Lancet. 2006;367(9518):1262–70.
  3. 3. Petersen RC, Thomas RG, Aisen PS, Mohs RC, Carrillo MC, Albert MS. Randomized controlled trials in mild cognitive impairment: Sources of variability. Neurology. 2017. pmid:28381516.
  4. 4. Zucchella C, Sinforiani E, Tamburin S, Federico A, Mantovani E, Bernini S, et al. The Multidisciplinary Approach to Alzheimer's Disease and Dementia. A Narrative Review of Non-Pharmacological Treatment. Frontiers in Neurology. 2018;9:1058. pmid:30619031
  5. 5. Themistocleous C, Kokkinakis D, Marie E, Kathleen F, Kristina Lundholm F. Effects of Cognitive Impairment on vowel duration. Proceedings of the 9th Tutorial & Research Workshop on Experimental Linguistics (ExLing 2018) 28–30 Paris, France. 2018:113–6. cdeff18.
  6. 6. Lundholm Fors K, Fraser KC, Themistocleous C, Kokkinakis D. Prosodic features as potential markers of linguistic and cognitive deterioration in Mild Cognitive Impairment. Alzheimer's & Dementia. 2018;14(7, Supplement):P1195–P6. https://doi.org/10.1016/j.jalz.2018.06.1658.
  7. 7. Sajjadi SA, Patterson K, Tomek M, Nestor PJ. Abnormalities of connected speech in semantic dementia vs Alzheimer's disease. Aphasiology. 2012;26(6):847–66. WOS:000304530100006.
  8. 8. Braaten AJ, Parsons TD, McCue R, Sellers A, Burns WJ. Neurocognitive Differential Diagnosis Of Dementing Diseases: Alzheimer's Dementia, Vascular Dementia, Frontotemporal Dementia, And Major Depressive Disorder. International Journal of Neuroscience. 2006;116(11):1271–93. pmid:17000529
  9. 9. Kemper S, LaBarge E, Ferraro FR, Cheung H, Cheung H, Storandt M. On the Preservation of Syntax in Alzheimer's Disease: Evidence From Written Sentences. Archives of Neurology. 1993;50(1):81–6. pmid:8418805
  10. 10. Lira JOd Minett TSC, Bertolucci PHF Ortiz KZ. Analysis of word number and content in discourse of patients with mild to moderate Alzheimer's disease. Dementia & neuropsychologia. 2014;8(3):260–5.
  11. 11. Chapman SB, Ulatowska HK, King K, Johnson JK, McIntire DD. Discourse in early Alzheimer's disease versus normal advanced aging. American Journal of Speech-Language Pathology. 1995;4(4):124–9.
  12. 12. König A, Satt A, Sorin A, Hoory R, Toledo-Ronen O, Derreumaux A, et al. Automatic speech analysis for the assessment of patients with predementia and Alzheimer's disease. Alzheimer's and Dementia: Diagnosis, Assessment and Disease Monitoring. 2015;1(1):112–24. pmid:27239498
  13. 13. Hoffmann I, Nemeth D, Dye CD, Pákáski M, Irinyi T, Kálmán J. Temporal parameters of spontaneous speech in Alzheimer's disease. International Journal of Speech-Language Pathology. 2010;12(1):29–34. pmid:20380247
  14. 14. Martínez-Sánchez F, Meilán JJG, Pérez E, Carro J, Arana JM. Expressive prosodic patterns in individuals with Alzheimer's Disease. Psicothema. 2012;24(1):16–21. pmid:22269358
  15. 15. Meilan JJG, Martinez-Sanchez F, Carro J, Carcavilla N, Ivanova O. Voice Markers of Lexical Access in Mild Cognitive Impairment and Alzheimer's Disease. Current Alzheimer Research. 2018;15(2):111–9. pmid:28847280
  16. 16. Meilan JJG, Martinez-Sanchez F, Carro J, Lopez DE, Millian-Morell L, Arana JM. Speech in Alzheimer's Disease: Can Temporal and Acoustic Parameters Discriminate Dementia? Dementia and Geriatric Cognitive Disorders. 2014;37(5–6):327–34. WOS:000337795500008. pmid:24481220
  17. 17. Horley K, Reid A, Burnham D. Emotional prosody perception and production in Dementia of the Alzheimer's type. Journal of Speech, Language, and Hearing Research. 2010;53(5):1132–46. pmid:20643797
  18. 18. Martínez-Sánchez F, Meilán JJG, García-Sevilla J, Carro J, Arana JM. Oral reading fluency analysis in patients with Alzheimer disease and asymptomatic control subjects. Neurologia. 2013;28(6):325–31. pmid:23046975
  19. 19. Themistocleous C, Eckerstrom M, Kokkinakis D. Identification of Mild Cognitive Impairment From Speech in Swedish Using Deep Sequential Neural Networks. Frontiers in Neurology. 2018;9:975. WOS:000450247700002. pmid:30498472
  20. 20. Goodglass H, Kaplan E. Boston diagnostic aphasia examination (BDAE)1983.
  21. 21. Wallin A, Nordlund A, Jonsson M, others. The Gothenburg MCI study: Design and distribution of Alzheimer's disease and subcortical vascular disease diagnoses from baseline to 6-year follow-up. Journal of Cerebral Blood Flow & Metabolism. 2016;36(1):114–31.
  22. 22. Skoog J, Backman K, Ribbe M, Falk H, Gudmundsson P, Thorvaldsson V, et al. A Longitudinal Study of the Mini-Mental State Examination in Late Nonagenarians and Its Relationship with Dementia, Mortality, and Education. Journal of the American Geriatrics Society. 2017;65(6):1296–300. pmid:28323333
  23. 23. Fraser KC, Lundholm Fors K, Eckerström M, Themistocleous C, Kokkinakis D. Improving the Sensitivity and Specificity of MCI Screening with Linguistic Information. Proceedings of the LREC 2018 Workshop “Resources and ProcessIng of linguistic, para-linguistic and extra-linguistic Data from people with various forms of cognitive/psychiatric impairments (RaPID-2)”. 2018;(2015):19–26.
  24. 24. Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research. 1975;12(null):189–98. pmid:1202204
  25. 25. Kaplan E, Goodglass H, Weintraub S. Boston naming test: Pro-ed; 2001.
  26. 26. Nordlund A, Rolstad S, Hellström P, Sjögren M, Hansen S, Wallin A. The Goteborg MCI study: mild cognitive impairment is a heterogeneous condition. Journal of Neurology, Neurosurgery & Psychiatry. 2005;76(11):1485–90.
  27. 27. Schmidt M. Rey auditory verbal learning test: A handbook: Western Psychological Services Los Angeles, CA; 1996.
  28. 28. Meyers JE, Meyers KR. Rey complex figure test and recognition trial (RCFT): Psychological Assessment Resources Odessa, FL; 1995.
  29. 29. Reitan RWD, Wolfson D. The Halstead-Reitan Neuropsychological Test Battery: Therapy and Clinical Interpretation (1985). Tucson, AZ: Neuropsychological Press; 1985.
  30. 30. Warrington EK, James M. The visual object and space perception battery. 1991.
  31. 31. Wechsler D, Stone CP. Wechsler memory scale: Psychological Corporation; 1945.
  32. 32. Auer S, Reisberg B. The GDS/FAST Staging System. International Psychogeriatrics. 1997;9(S1):167–71. Epub 2005/01/10. pmid:9447440
  33. 33. Themistocleous C, Kokkinakis D. THEMIS-SV: Automatic classification of language disorders from speech signals. ESOC 2018: European Stroke Organisation Conference Gothenburg2018.
  34. 34. Boersma P, Weenink D. Praat: doing phonetics by computer (Version 6.0.37). 2018.
  35. 35. Klatt D, Klatt L. Analysis, synthesis, and perception of voice quality variations among female and male talkers. Time. 1990:820–57.
  36. 36. Heman-Ackah YD, Michael DD, Baroody MM, Ostrowski R, Hillenbrand J, Heuer RJ, et al. Cepstral Peak Prominence: A More Reliable Measure of Dysphonia. Annals of Otology, Rhinology & Laryngology. 2003;112(4):324–33. pmid:12731627
  37. 37. Boersma P. Praat, a system for doing phonetics by computer. Glot International. 2001;5(9/10):341–5.
  38. 38. Forrest K, Weismer G, Milenkovic P, Dougall RN. Statistical analysis of word-initial voiceless obstruents: preliminary data. Journal of the Acoustical Society of America. 1988;84(1):115–23. pmid:3411039
  39. 39. Hammarberg B, Fritzell B, Gaufin J, Sundberg J, Wedin L. Perceptual and Acoustic Correlates of Abnormal Voice Qualities. Acta Oto-Laryngologica. 1980;90(1–6):441–51. pmid:7211336
  40. 40. Themistocleous C. Seeking an Anchorage. Stability and Variability in Tonal Alignment of Rising Prenuclear Pitch Accents in Cypriot Greek. Language and Speech. 2016;59(4). pmid:28008803
  41. 41. Teixeira JP, Oliveira C, Lopes C. Vocal Acoustic Analysis–Jitter, Shimmer and HNR Parameters. Procedia Technology. 2013;9:1112–22. https://doi.org/10.1016/j.protcy.2013.12.124.
  42. 42. Bidelman GM, Lowther JE, Tak SH, Alain C. Mild Cognitive Impairment Is Characterized by Deficient Brainstem and Cortical Representations of Speech. The Journal Of Neuroscience: The Official Journal Of The Society For Neuroscience. 2017;37(13):3610–20. pmid:28270574.
  43. 43. Boccia M, Silveri MC, Sabatini U, Guariglia C, Nemmi F. Neural Underpinnings of the Decline of Topographical Memory in Mild Cognitive Impairment. American Journal Of Alzheimer's Disease And Other Dementias. 2016;31(8):618–30. pmid:27307142.
  44. 44. Borroni B, Di Luca M, Padovani A. Predicting Alzheimer dementia in mild cognitive impairment patients. Are biomarkers useful? European Journal of Pharmacology. 2006;545(1):73–80. pmid:16831417
  45. 45. Rahman TTA, Mohamed ST, Albanouby MH, Bekhet HF. Central auditory processing in elderly with mild cognitive impairment. Geriatrics and Gerontology International. 2011;11(3):304–8. pmid:21272179
  46. 46. Ribeiro F, Guerreiro M, de Mendonça A. Verbal learning and memory deficits in Mild Cognitive Impairment. Journal of Clinical and Experimental Neuropsychology. 2007;29.
  47. 47. Roark B, Mitchell M, Hosom J-P, Hollingshead K, Kaye J. Spoken Language Derived Measures for Detecting Mild Cognitive Impairment. IEEE Transactions on Audio, Speech, and Language Processing. 2011;19(7):2081–90. pmid:22199464
  48. 48. Ryan KA, Weldon A, Persad C, Heidebrink JL, Barbas N, Giordani B. Neuropsychiatric symptoms and executive functioning in patients with mild cognitive impairment: Relationship to caregiver burden. Dementia and Geriatric Cognitive Disorders. 2012;34(3–4):206–15. pmid:23128102
  49. 49. Tanaka H, Adachi H, Ukita N, Ikeda M, Kazui H, Kudo T, et al. Detecting Dementia Through Interactive Computer Avatars. IEEE journal of translational engineering in health and medicine. 2017;5:2200111–. pmid:29018636.
  50. 50. Ahmed S, Haigh A-MF, de Jager CA, Garrard P. Connected speech as a marker of disease progression in autopsy-proven Alzheimer’s disease. Brain. 2013;136(12):3727–37. pmid:24142144
  51. 51. Forbes KE, Venneri A, Shanks MF. Distinct patterns of spontaneous speech deterioration: an early predictor of Alzheimer's disease. Brain and Cognition. 2002;48(2–3):356–61. pmid:12030467
  52. 52. Forbes-McKay K, Shanks MF, Venneri A. Profiling spontaneous speech decline in Alzheimer's disease: a longitudinal study. Acta Neuropsychiatrica. 2013;25(6):320–7. WOS:000327784100003. pmid:25287871
  53. 53. Forbes-McKay KE, Venneri A. Detecting subtle spontaneous language decline in early Alzheimer’s disease with a picture description task. Neurological sciences. 2005;26(4):243–54. pmid:16193251
  54. 54. Li H-j, Wang P-y, Jiang Y , Chan RCK, Wang H-l, Li J. Neurological soft signs in persons with amnestic mild cognitive impairment and the relationships to neuropsychological functions. Behavioral and Brain Functions. 2012;8(1):29.
  55. 55. Ameli M, Kemper F, Sarfeld A-S, Kessler J, Fink GR, Nowak DA. Arbitrary visuo-motor mapping during object manipulation in mild cognitive impairment and Alzheimer's disease: A pilot study. Clinical Neurology and Neurosurgery. 2011;113(6):453–8. pmid:21353384
  56. 56. Salek Y, Anderson ND, Sergio L. Mild cognitive impairment is associated with impaired visual-motor planning when visual stimuli and actions are incongruent. European Neurology. 2011;66(5):283–93. pmid:22025035
  57. 57. Themistocleous C, Ficek B, Webster KT, Wendt H, Hillis AE, Den Ouden DB, et al. Acoustic markers of PPA variants using machine learning. Human Neuroscience Archive. 2019.
  58. 58. Themistocleous C, Ficek B, Webster K, den Ouden D-B, Hillis AE, Tsapkini K. Automatic subtyping of individuals with Primary Progressive Aphasia. bioRxiv. 2020:2020.04.04.025593.
  59. 59. Fyndanis V, Varlokosta S, Tsapkini K. Agrammatic production: Interpretable features and selective impairment in verb inflection. Lingua. 2012;122(10):1134–47. WOS:000306869200004.
  60. 60. Koukoulioti V, Bastiaanse R. Time reference in aphasia: Evidence from Greek. Journal of Neurolinguistics. 2020;53. WOS:000500049600004.
  61. 61. Dragoy O, Virfel E, Yurchenko A, Bastiaanse R. Aspect and tense attrition in Russian-German bilingual speakers. Int J Bilingual. 2019;23(1):275–95. WOS:000458862900015.
  62. 62. Bastiaanse R, Platonov A. Argument Structure and Time Reference in Agrammatic Aphasia. Cognitive Science Perspectives on Verb Representation and Processing2015. p. 141–55.
  63. 63. Bastiaanse R. Why reference to the past is difficult for agrammatic speakers. Clinical Linguistics & Phonetics. 2013;27(4):244–63. Epub 2013/01/24. pmid:23339396.
  64. 64. Fyndanis V, Themistocleous C. Are there prototypical associations between time frames and aspectual values? Evidence from Greek aphasia and healthy ageing. Clinical Linguistics & Phonetics. 2019;33(1–2):191–217. Epub 2018/06/26. pmid:29939796.