Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Prediction of Pneumonia in Acute Stroke Patients Using Tongue Pressure Measurements

  • Masahiro Nakamori,

    Affiliations Department of Clinical Neuroscience and Therapeutics, Hiroshima University Graduate School of Biomedical and Health Sciences, Hiroshima, Japan, Department of Neurology, Suiseikai Kajikawa Hospital, Hiroshima, Japan

  • Naohisa Hosomi ,

    nhosomi@hiroshima-u.ac.jp

    Affiliation Department of Clinical Neuroscience and Therapeutics, Hiroshima University Graduate School of Biomedical and Health Sciences, Hiroshima, Japan

  • Kenichi Ishikawa,

    Affiliation Department of Neurology, Suiseikai Kajikawa Hospital, Hiroshima, Japan

  • Eiji Imamura,

    Affiliation Department of Neurology, Suiseikai Kajikawa Hospital, Hiroshima, Japan

  • Takeo Shishido,

    Affiliation Department of Clinical Neuroscience and Therapeutics, Hiroshima University Graduate School of Biomedical and Health Sciences, Hiroshima, Japan

  • Tomohiko Ohshita,

    Affiliation Department of Neurology, Suiseikai Kajikawa Hospital, Hiroshima, Japan

  • Mineka Yoshikawa,

    Affiliation Department of Advanced Prosthodontics, Hiroshima University Graduate School of Biomedical and Health Sciences, Hiroshima, Japan

  • Kazuhiro Tsuga,

    Affiliation Department of Advanced Prosthodontics, Hiroshima University Graduate School of Biomedical and Health Sciences, Hiroshima, Japan

  • Shinichi Wakabayashi,

    Affiliation Department of Neurosurgery, Suiseikai Kajikawa Hospital, Hiroshima, Japan

  • Hirofumi Maruyama,

    Affiliation Department of Clinical Neuroscience and Therapeutics, Hiroshima University Graduate School of Biomedical and Health Sciences, Hiroshima, Japan

  • Masayasu Matsumoto

    Affiliation Department of Clinical Neuroscience and Therapeutics, Hiroshima University Graduate School of Biomedical and Health Sciences, Hiroshima, Japan

Expression of Concern

The Funding Statement for this article [1] states that the study received funding from the Smoking Research Foundation, which according to [2] has received financial support from the tobacco industry. In light of this issue the PLOS ONE article [1] does not comply with the journal’s policy on Funding from Tobacco Companies [3] which was implemented in 2010.

Therefore, the PLOS ONE Editors issue this Expression of Concern.

​​​​We regret that this concern was not identified and addressed prior to the article’s [1] publication.

11 Jan 2023: The PLOS ONE Editors (2023) Expression of Concern: Prediction of Pneumonia in Acute Stroke Patients Using Tongue Pressure Measurements. PLOS ONE 18(1): e0279804. https://doi.org/10.1371/journal.pone.0279804 View expression of concern

Abstract

Swallowing dysfunction caused by stroke is a risk factor for aspiration pneumonia. Tongue pressure measurement is a simple and noninvasive method for evaluating swallowing dysfunction. We have hypothesized that low tongue pressure may be able to predict pneumonia occurrence in acute stroke patients. Tongue pressure was measured using balloon-type equipment in 220 acute stroke patients. The modified Mann Assessment of Swallowing Ability (MASA) score was evaluated independently on the same day. Tongue pressure was measured every week thereafter. An improvement in tongue pressure was observed within the first 2 weeks. Receiver operating curve analysis was performed to determine the ability of tongue pressure to predict modified MASA score <95, which suggests swallowing dysfunction. The optimal cutoff for tongue pressure was 21.6 kPa (χ2 = 45.82, p<0.001, sensitivity 95.9%, specificity 91.8%, area under the curve = 0.97). The tongue pressure was significantly lower in patients with pneumonia than in those without pneumonia. Using a Cox proportional hazard model for pneumonia onset with a cutoff tongue pressure value of 21.6 kPa and adjustment for age, sex, and National Institutes of Health Stroke Scale score at admission, the tongue pressure had additional predictive power for pneumonia onset (hazard ratio, 7.95; 95% confidence interval, 2.09 to 52.11; p = 0.0013). In the group with low tongue pressure, 27 of 95 patients showed improvement of tongue pressure within 2 weeks. Pneumonia occurred frequently in patients without improvement of tongue pressure, but not in patients with improvement (31/68 and 2/27, p<0.001). Tongue pressure is a sensitive indicator for predicting pneumonia occurrence in acute stroke patients.

Introduction

Swallowing dysfunction is a critical issue in stroke patients. Prevention of aspiration pneumonia and improvement of nutrition are associated with reduced duration of hospitalization and mortality [13]. Pneumonia rates have been found to be lower in hospitals using dysphagia screening protocols with appropriate interventions following the identification of patients at risk for aspiration in stroke patients [4].

Among the organs of the oral cavity, the tongue plays a major role in swallowing [5]. The tongue presses the bolus into the pharynx, and it pushes the epiglottis downward, thus closing the larynx. The maximal tongue pressure exerted on the hard palate may offer a quantitative parameter for evaluating tongue motor biomechanics during swallowing [68]. Low tongue pressure impairs the control of the bolus, increases the amount of oral residue, which increases the risk of aspiration after swallowing. In addition, low tongue pressure contributes to inadequate closing, which increases the risk of aspiration during swallowing. Several reports have established a relationship between tongue pressure and swallowing dysfunction. Tongue pressure has been associated with the presence of oro-pharyngeal residue using videofluoroscopic examination [9]. In a water-swallowing test, tongue pressure was found to be significantly lower in dysphagic patients than in non-dysphagic patients [10]. Using a non-invasive, easy-to-use tongue pressure measurement tool is an advantage.

The Mann Assessment of Swallowing Ability (MASA) score is an established bedside assessment tool that indicates the risk of swallowing dysfunction in stroke patients [11]. The MASA score consists of 24 items with a total potential score of 200 points. Comparison of the MASA assessment with videofluoroscopic examination has established its reliability among patients with various diseases as well as stroke [12]. The original MASA required a long time and extensive effort for evaluation; therefore, the modified MASA score, which consists of only 12 items with a total potential score of 100 points, was created. It has been reported that patients who score <95 points are at risk for swallowing dysfunction [13].

Swallowing dysfunction is a risk factor for pneumonia, and patients with low MASA score are at a significantly higher risk of aspiration pneumonia and mortality than patients with high MASA score [14]. Knowing the association between tongue pressure and swallowing dysfunction, we hypothesized that low tongue pressure could predict pneumonia onset in acute stroke patients. Predicting pneumonia onset would allow for better patient management and outcomes. In this study, we investigated the association between tongue pressure and pneumonia. Swallowing dysfunction was evaluated using the modified MASA score.

Materials and Methods

Ethics Statement

The study protocols were approved by the ethics committee of Suiseikai Kajikawa Hospital and performed according to the guidelines of the national government based on the Helsinki Declaration of 1964. Written informed consent was obtained from all patients or their relatives. All data analyses were blinded.

Subjects

Consecutive acute stroke patients who were admitted to Suiseikai Kajikawa Hospital from September 1, 2014 to February 28, 2015 were enrolled in this prospective study. We included stroke patients with both ischemic and hemorrhagic stroke who were admitted within 1 week from onset, were aged ≥20 years, and consented to this study (if the patient was not able to consent to the study, consent was obtained from relatives). Some patients had a history of stroke. We excluded patients who were in a coma (the best eye response score in the Glasgow coma scale was 1), underwent craniotomy, or were on mechanical ventilation.

Data Acquisition

Stroke subtype was determined according to the Trial of Org 10172 in Acute Stroke Treatment criteria [15]. The diagnosis of clinically defined pneumonia was determined based on the agreement of two physicians based on the criteria of the Centers for Disease Control and Prevention [16] as follows. Clinically defined pneumonia criteria require the presence of a new and persistent infiltrate or consolidation on at least 1 chest X-ray or computed tomography examination with 1 of the following clinical signs: fever, leukopenia or leukocytosis, and altered mental status in patients over 70 years of age in the absence of other causes. These should be added to 2 of the following signs: new-onset purulent sputum or change in the character of the sputum, new-onset or progressive cough, rales, and impaired gas exchange. The severity of stroke was evaluated using the National Institutes of Health Stroke Scale (NIHSS) score [17]. Speech-language-hearing therapists and one physician scaled the modified MASA score at the same time with consensus. Clinical technicians measured tongue pressure independently using balloon-type equipment (TPM-01; JMS Co. Ltd., Hiroshima, Japan) on the same day as the evaluation of modified MASA score. Tongue pressure was measured every week thereafter.

The balloon-type equipment consists of a disposable oral probe, an infusion tube as a connector, and a recording device. For tongue pressure measurement, the subjects were placed in a relaxed sitting position and asked to place the balloon in their mouths, holding the plastic pipe at the midpoint of their central incisors with closed lips. The subjects were asked to maintain this position as clinicians adjusted the probe and confirmed that it was in the correct position. The subjects were then asked to raise their tongue and compress the small balloon with their palate at maximum voluntary effort for 7 seconds as described previously [7,18]. This measurement was performed 3 times with the subjects resting for approximately 30 seconds and rinsing the mouth between each measurement. The maximum value from the 3 measurements was defined as the tongue pressure for each subject.

The reliability of intraindividual measurement was previously reported [19]. In this study, we reconfirmed the reliability of tongue pressure measurement. We measured normal subjects three times per day, and the highest value from the 3 measurements was defined as the tongue pressure. These measurements were repeated for ten days, and the resulting coefficient of variation was 5.64%.

The modified MASA score and tongue pressure measurements were evaluated in the sitting position. These evaluations were performed every week until the patients were discharged from the hospital. The NIHSS score, tongue pressure, and modified MASA score were evaluated by different physicians or therapists who were blinded to the other findings.

We monitored patients for signs of pneumonia during the 30 days following admission. If patients were discharged earlier than the 30th day, we monitored the patients until the day of discharge.

Statistical Analysis

The data were expressed as the mean ± standard deviation or the median (minimum, maximum) for continuous variables and frequencies and percentages for discrete variables. Statistical analysis was performed using JMP 11 statistical software (SAS Institute Inc., Cary, NC, USA). The statistical significance of intergroup differences was assessed using t-tests or χ2 tests as appropriate. The baseline data in the stroke patients were analyzed, and two-step strategies were employed to assess the relative importance of variables in their association with tongue pressure using least square linear regression analysis. First, a univariate analysis was performed. Then, a multi-factorial analysis was performed with selected factors that had p<0.20 on univariate analysis. Receiver operating characteristic (ROC) analysis was performed to determine the tongue pressure predicting a modified MASA score <95, which suggests swallowing dysfunction. Kaplan–Meier and Cox proportional hazard regression analyses were performed to test the difference in the development of pneumonia between the high and low tongue pressure groups. A univariate split-plot approach was utilized for changes in tongue pressure over time, with the last observation carried forward for missing data. We considered p<0.05 as statistically significant.

Results

During the study period, 296 stroke patients were admitted in our hospital. Nineteen patients or their relatives did not consent to this study, 19 patients were admitted >1 week after onset, 30 patients were in a coma, and 8 patients underwent craniotomy. Therefore, 220 patients were included in this study. The subjects’ backgrounds and characteristics at the time of enrollment are shown in Table 1. The number of patients with a modified MASA score <95 was 98 (44.5%). The mean maximum tongue pressure was 22.8±14.6 kPa.

We evaluated the change of maximum tongue pressure every week (Fig 1A). An improvement in tongue pressure was observed within the first 2 weeks. We compared tongue pressure of the first measurement to that of 2 weeks after. The tongue pressure was significantly increased during the first 2 weeks using paired t-test (p<0.001). In addition, the patients showed a significant increase with repeated measurements in tongue pressure during the observation period (timing, F = 115.96; p<0.001; power = 1.00; adjusted R2 = 0.908; F220, 413 = 29.37; p<0.001; n = 220).

thumbnail
Fig 1. Tongue pressure time course and the association of tongue pressure with modified MASA and NIHSS scores.

The patients showed a significant increase in tongue pressure with repeated measurements during the observation period. The plot shows the mean values and the error bars indicate the standard deviation (A). An improvement in tongue pressure was observed over the first 2 weeks of hospitalization. Scatter diagram of tongue pressure with modified MASA score (B) and NIHSS score (C) at admission is shown. Modified MASA score increased with tongue pressure elevation curvilinearly, and reached a stable state at a tongue pressure >21.6 kPa. The NIHSS score decreased with tongue pressure elevation but varied widely compared with the modified MASA score shown in the scatter diagram. ○, without pneumonia; ●, onset pneumonia.

https://doi.org/10.1371/journal.pone.0165837.g001

Potential factors associated with tongue pressure at admission were evaluated from the factors listed in Table 1. In this analysis, age, stroke type (lacunar infarction or intracerebral hemorrhage), and modified MASA score were determined to be independent factors significantly associated with tongue pressure (Table 2). The optimal cutoff for tongue pressure to predict a modified MASA score <95 was 21.6 kPa from the ROC analysis (χ2 = 45.82, p<0.001, sensitivity 95.9%, specificity 91.8%, AUC = 0.97). Scatter diagrams for the association of tongue pressure with modified MASA score and NIHSS score are shown in Fig 1B and 1C. The modified MASA score increased with tongue pressure elevation and reached a maximum at tongue pressures higher than 21.6 kPa. The NIHSS score decreased with tongue pressure elevation.

Thirty-five subjects developed pneumonia during the observation period. No patient had pneumonia before stroke onset. We compared the maximum tongue pressure at admission between patients with and without pneumonia. The tongue pressure was significantly lower in patients with pneumonia than in those without pneumonia (Fig 2A). The results of the Kaplan–Meier analysis to compare the development of pneumonia between the high (≥21.6 kPa) and low (<21.6 kPa) tongue pressure groups are shown in Fig 2B. The low tongue pressure group had a significantly higher incidence of pneumonia than the high tongue pressure group (p<0.001, log-rank test). Cox proportional hazard model for pneumonia onset was performed with a tongue pressure cut-off value of 21.6 kPa adjusting for age and sex. The tongue pressure was found to be independently associated with pneumonia onset (hazard ratio, 17.27; 95% confidence interval, 5.10 to 107.86; p<0.001; model 1 adjusted for age and sex). Additionally, we added the NIHSS score to the adjustment. Even after adjustment with these factors, the tongue pressure was independently associated with pneumonia onset (hazard ratio, 7.95; 95% confidence interval, 2.09 to 52.11; p = 0.0013; model 2 adjusted with age, sex, and NIHSS score).

thumbnail
Fig 2. Relationship between tongue pressure and pneumonia.

The tongue pressure was significantly lower in patients with pneumonia than in those without pneumonia using unpaired t-tests. The error bars indicate the standard deviation (A). Kaplan–Meier curves of the duration until the development of pneumonia between the high tongue pressure group (≥21.6 kPa) and low tongue pressure group (<21.6 kPa) (B). The low tongue pressure (TP) group had a higher incidence of pneumonia.

https://doi.org/10.1371/journal.pone.0165837.g002

In the group with low tongue pressure, 27 of 95 patients showed improvement of tongue pressure up to 21.6 kPa within 2 weeks from admission. Only two of them (7.4%) developed pneumonia during the observational period. In contrast, in the non-improved patients, 31 out of 68 patients (45.6%) developed pneumonia. There was a significant difference in pneumonia onset between the patients with improvement and those with no improvement (p<0.001, with the Cox proportional hazard model).

Discussion

In this study, we measured tongue pressure in constitutive acute stroke patients using balloon-type equipment and found that it was significantly associated with the modified MASA score, which has been established as a reliable bedside assessment for detecting swallowing dysfunction [13]. We also showed that lower tongue pressure (<21.6 kPa) was an independent risk factor for pneumonia. Moreover, tongue pressure was evaluated repeatedly and was found to improve over time, especially over the first 2 weeks of admission.

Tongue pressure has been reported as low on the paralyzed side using sensor sheets in acute stroke patients [10]. In this method, a sensor sheet is attached to the hard palate of patients, and a water-swallowing test is performed. An advantage of this method is the ability to evaluate the focal weak point of the tongue. However, it is more invasive than the balloon-based method used in the present study. There are mainly three types of balloon-based tongue pressure evaluating equipment: the Kay Pentax device, the Iowa Oral Performance Instrument (IOPI) device, and the JMS device. These balloon-based methods enable us to evaluate tongue pressure non-invasively and repeatedly. The JMS device show lower values than the other balloon-based devices, but the values can be correlated linearly [7]. The JMS probe is fixed onto the incisor teeth, and one can measure tongue pressure at that same position.

The MASA score is a reliable tool for evaluating the risk of swallowing dysfunction and can be used at the patient’s bedside with no special instruments [12,13,20]. However, this non-invasive screening test requires approximately 15 minutes to complete when performed by a skilled evaluator. The modified MASA score is simplified from the original version, but it is still subjective and requires some training and experience. In this study, the modified MASA score was evaluated by skilled speech-language-hearing therapists and compared to the tongue pressure. The measurement of tongue pressure is simple and objective, requires less training, and can be completed within 3 minutes.

In this study, the modified MASA score increased according to the tongue pressure and reached a maximum at a tongue pressure >21.6 kPa. Among Japanese healthy subjects, using the same balloon-based equipment, the standard maximum tongue pressure was found to be reduced with aging (41.7±9.7 kPa in subjects their 20s and 31.9±8.9 kPa in subjects in their 70s [6]. In the studies using the same balloon-based equipment, Japanese elderly subjects with frailty showed a maximum tongue pressure of 18.0±12.0 kPa [8,21]. Additionally, in patients with spinal and bulbar muscular atrophy, the maximum tongue pressure of patients with severe dysphagia was observed to be approximately <20 kPa [22]. The numerical value suggesting a risk of swallowing dysfunction identified in our study was consistent with this previous report. Additionally, these maximum tongue pressure values were lower than those of the healthy subjects [6]. However, to the best of our knowledge, no previous studies have measured the tongue pressure in acute stroke patients using balloon-based equipment. Moreover, no other report has evaluated the relationship of tongue pressure with modified MASA or NIHSS scores. As shown in Fig 1B and 1C, both showed floor or ceiling effects when tongue pressure reached around 20 kPa. It showed the patient with full modified MASA score and low NIHSS score shows tongue pressure greater than around 20 kPa. It is interesting to note that swallowing dysfunction hardly emerged above 20 kPa of tongue pressure. Physiological research is needed to understand the underlying reasons.

The tongue pressures were significantly lower in patients with pneumonia than in patients without pneumonia. Low tongue pressure is considered to be a risk factor for pneumonia. The hazard ratio of pneumonia onset reveals that patients with low tongue pressure were at higher risk for pneumonia, even after adjusting for the severity of stroke (NIHSS score at admission). The relationship between low tongue pressure and pneumonia onset might be explained by the presence of swallowing dysfunction.

Tongue pressure improved favorably over the first 2 weeks of admission in this study. The onset rate of pneumonia was significantly higher in the group without improvement of tongue pressure than in the group with tongue pressure improvement. It has also been reported that tongue exercise in stroke patients significantly increases tongue pressure and reduced penetration [23]. In this study, all subjects underwent rehabilitation as appropriate. Especially, swallowing training was performed intensively in the patients who showed swallowing dysfunction. Rehabilitation could have affected the results. Rehabilitation towards an increase in tongue pressure may improve swallowing function, thus decreasing the risk of pneumonia. Tongue pressure and its recovery may thus be a replicable and objective tool for predicting pneumonia occurrence. However, it is not clear which type of rehabilitation is effective to improve swallowing function. Further prospective studies are needed to evaluate the influence of swallowing training on increased tongue pressure.

This study had several limitations. First, the tongue pressure may not be accurately evaluated in patients with a disturbance of consciousness, aphasia, or attention disorders. Regardless of tongue function, these conditions usually increase the risk of aspiration and pneumonia. In this study, we excluded patients in a coma, but included patients with a mild disturbance of consciousness, aphasia, or attention disorders, which limited the potential for selection bias. The modified MASA score includes factors such as consciousness, aphasia, and communication ability. Tongue pressure may decrease in association with a low modified MASA score and thus reflect the risk of swallowing dysfunction. A hybrid evaluation of modified MASA scores and tongue pressures may improve the assessment of swallowing function. Second, tongue pressures cannot reflect all functions of swallowing. Videofluoroscopic examination has been used for evaluating aspiration but has limitations, such as exposure to radiation and difficulties in conducting examinations in disabled patients and analyzing the biomechanics of swallowing organs [24]. Additionally, it is not possible to perform videofluoroscopic examinations for all acute stroke patients. Therefore, it is important that the risk of swallowing dysfunction be accurately evaluated using a combination of simple modalities such as ultrasonography for bedside assessment [25].

Conclusions

Tongue pressure is a sensitive indicator for predicting pneumonia in acute stroke patients. Therefore, as a bedside assessment tool, tongue pressure measurements may be helpful for evaluating swallowing function.

Acknowledgments

We would like to sincerely thank Dr. Satomi Kushitani, Ms. Akiko Hirata, Ms. Masami Nishino, Ms. Masako Kurose, Ms. Kanami Ogawa, Ms. Tomoko Ayukawa, and Mr. Hiroyuki Okamoto at the Suiseikai Kajikawa Hospital for their technical assistance.

Author Contributions

  1. Conceptualization: MN NH KT SW HM MM.
  2. Data curation: MN NH.
  3. Formal analysis: MN NH MY KT.
  4. Funding acquisition: NH MM.
  5. Investigation: MN NH KI EI TS TO.
  6. Methodology: MN NH MY.
  7. Project administration: MN NH MM.
  8. Resources: MN NH MY KT.
  9. Software: MN NH.
  10. Supervision: NH MM.
  11. Validation: MN NH KI EI TS TO.
  12. Visualization: MN NH.
  13. Writing – original draft: MN NH MM.
  14. Writing – review & editing: MN NH HM MM.

References

  1. 1. 1. Hinds NP, Wiles CM (1998) Assessment of swallowing and referral to speech and language therapists in acute stroke. QJM 91: 829–835. pmid:10024948
  2. 2. Nilsson H, Ekberg O, Olsson R, Hindfelt B (1998) Dysphagia in stroke: a prospective study of quantitative aspects of swallowing in dysphagic patients. Dysphagia 13: 32–38. pmid:9391228
  3. 3. Smithard DG, O'Neill PA, Parks C, Morris J (1996) Complications and outcome after acute stroke. Does dysphagia matter? Stroke 27: 1200–1204. pmid:8685928
  4. 4. Hinchey JA, Shephard T, Furie K, Smith D, Wang D, Tonn S (2005) Formal dysphagia screening protocols prevent pneumonia. Stroke 36: 1972–1976. pmid:16109909
  5. 5. Shaker R, Cook IJ, Dodds WJ, Hogan WJ (1988) Pressure-flow dynamics of the oral phase of swallowing. Dysphagia 3: 79–84. pmid:3271656
  6. 6. Utanohara Y, Hayashi R, Yoshikawa M, Yoshida M, Tsuga K, Akagawa Y (2008). Standard values of maximum tongue pressure taken using newly developed disposable tongue pressure measurement device. Dysphagia 23: 286–290. pmid:18574632
  7. 7. Yoshikawa M, Yoshida M, Tsuga K, Akagawa Y, Groher ME (2011) Comparison of three types of tongue pressure measurement devices. Dysphagia 26: 232–237. pmid:20623302
  8. 8. Tsuga K, Yoshikawa M, Oue H, Okazaki Y, Tsuchioka H, Maruyama M, et al. (2012) Maximal voluntary tongue pressure is decreased in Japanese frail elderly persons. Gerodontology 29: e1078–1085. pmid:22288526
  9. 9. Ono T, Kumakura I, Arimoto M, Hori K, Dong J, Iwata H, et al. (2007) Influence of bite force and tongue pressure on oro-pharyngeal residue in the elderly. Gerodontology 24: 143–150. pmid:17696891
  10. 10. Hirota N, Konaka K, Ono T, Tamine K, Kondo J, Hori K, et al. (2010) Reduced tongue pressure against the hard palate on the paralyzed side during swallowing predicts Dysphagia in patients with acute stroke. Stroke 41: 2982–2984. pmid:21071718
  11. 11. Carnaby-Mann G, Lenius K (2008) The bedside examination in dysphagia. Phys Med Rehabil Clin N Am 19: 747–768, viii. pmid:18940639
  12. 12. Gonzalez-Fernandez M, Sein MT, Palmer JB (2011) Clinical experience using the Mann assessment of swallowing ability for identification of patients at risk for aspiration in a mixed-disease population. Am J Speech Lang Pathol 20: 331–336. pmid:21813822
  13. 13. Antonios N, Carnaby-Mann G, Crary M, Miller L, Hubbard H, Hood K, et al. (2010). Analysis of a physician tool for evaluating dysphagia on an inpatient stroke unit: the modified Mann Assessment of Swallowing Ability. J Stroke Cerebrovasc Dis 19: 49–57. pmid:20123227
  14. 14. Hasan ZN, Al-Shimmery EK, Taha MA (2010) Evaluation of neurogenic dysphagia in Iraqi patients with acute stroke. Neurosciences (Riyadh) 15: 90–96.
  15. 15. Adams HP Jr., Bendixen BH, Kappelle LJ, Biller J, Love BB, Gordon DL, et al. (1993) Classification of subtype of acute ischemic stroke. Definitions for use in a multicenter clinical trial. TOAST. Trial of Org 10172 in Acute Stroke Treatment. Stroke 24: 35–41. pmid:7678184
  16. 16. Harms H, Hoffmann S, Malzahn U, Ohlraun S, Heuschmann P, Meisel A (2012) Decision-making in the diagnosis and treatment of stroke-associated pneumonia. J Neurol Neurosurg Psychiatry 83: 1225–1230. pmid:23024353
  17. 17. Lyden P, Brott T, Tilley B, Welch KM, Mascha EJ, Levine S, et al. (1994) Improved reliability of the NIH Stroke Scale using video training. NINDS TPA Stroke Study Group. Stroke 25: 2220–2226. pmid:7974549
  18. 18. Tsuga K, Maruyama M, Yoshikawa M, Yoshida M, Akagawa Y (2011) Manometric evaluation of oral function with a hand-held balloon probe. J Oral Rehabil 38: 680–685. pmid:21284690
  19. 19. Hayashi R, Tsuga K, Hosokawa R, Yoshida M, Sato Y, Akagawa Y (2002) A novel handy probe for tongue pressure measurement. Int J Prosthodont 15: 385–388. pmid:12170854
  20. 20. Oh JC, Park JH, Jung MY, Yoo EY, Chang KY, Lee TY (2015) Relationship between Quantified Instrumental Swallowing Examination and Comprehensive Clinical Swallowing Examination. Occup Ther Int.
  21. 21. Yoshida M, Kikutani T, Tsuga K, Utanohara Y, Hayashi R, Akagawa Y (2006) Decreased tongue pressure reflects symptom of dysphagia. Dysphagia 21: 61–65. pmid:16544085
  22. 22. Mano T, Katsuno M, Banno H, Suzuki K, Suga N, Hashizume A, et al. (2014) Tongue pressure as a novel biomarker of spinal and bulbar muscular atrophy. Neurology 82: 255–262. pmid:24353334
  23. 23. Robbins J, Kays SA, Gangnon RE, Hind JA, Hewitt AL, Gentry LR, et al. (2007) The effects of lingual exercise in stroke patients with dysphagia. Arch Phys Med Rehabil 88: 150–158. pmid:17270511
  24. 24. Yoshikawa M, Yoshida M, Nagasaki T, Tanimoto K, Tsuga K, Akagawa Y, et al. (2005) Aspects of swallowing in healthy dentate elderly persons older than 80 years. J Gerontol A Biol Sci Med Sci 60: 506–509. pmid:15933392
  25. 25. Nakamori M, Hosomi N, Takaki S, Oda M, Hiraoka A, Yoshikawa M, et al. (2016) Tongue thickness evaluation using ultrasonography can predict swallowing function in amyotrophic lateral sclerosis patients. Clin Neurophysiol 127: 1669–1674. pmid:26323377