Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

SANReSP: A new Italian questionnaire to screen patients for obstructive sleep apnea

  • Salvatore Romano ,

    Contributed equally to this work with: Salvatore Romano, Anna Lo Bue, Adriana Salvaggio, Luis V. F. Oliveira, Luigi Ferini-Strambi, Giuseppe Insalaco

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation National Research Council of Italy, Institute for Biomedical Research and Innovation (IRIB), Palermo, Italy

  • Anna Lo Bue ,

    Contributed equally to this work with: Salvatore Romano, Anna Lo Bue, Adriana Salvaggio, Luis V. F. Oliveira, Luigi Ferini-Strambi, Giuseppe Insalaco

    Roles Data curation, Methodology, Writing – original draft, Writing – review & editing

    Affiliations National Research Council of Italy, Institute for Biomedical Research and Innovation (IRIB), Palermo, Italy, National Research Council of Italy, Institute of Translational Pharmacology (IFT), Palermo, Italy

  • Adriana Salvaggio ,

    Contributed equally to this work with: Salvatore Romano, Anna Lo Bue, Adriana Salvaggio, Luis V. F. Oliveira, Luigi Ferini-Strambi, Giuseppe Insalaco

    Roles Conceptualization, Data curation, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    Affiliations National Research Council of Italy, Institute for Biomedical Research and Innovation (IRIB), Palermo, Italy, National Research Council of Italy, Institute of Translational Pharmacology (IFT), Palermo, Italy

  • Luis V. F. Oliveira ,

    Contributed equally to this work with: Salvatore Romano, Anna Lo Bue, Adriana Salvaggio, Luis V. F. Oliveira, Luigi Ferini-Strambi, Giuseppe Insalaco

    Roles Data curation, Funding acquisition, Methodology, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Evangelical University of Goiás (UniEVANGÉLICA), Postgraduate Program in Human Movement and Rehabilitation–PPGMHR, Anapolis, Brazil

  • Luigi Ferini-Strambi ,

    Contributed equally to this work with: Salvatore Romano, Anna Lo Bue, Adriana Salvaggio, Luis V. F. Oliveira, Luigi Ferini-Strambi, Giuseppe Insalaco

    Roles Data curation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Università Vita-Salute San Raffaele, and Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy

  • Giuseppe Insalaco

    Contributed equally to this work with: Salvatore Romano, Anna Lo Bue, Adriana Salvaggio, Luis V. F. Oliveira, Luigi Ferini-Strambi, Giuseppe Insalaco

    Roles Conceptualization, Data curation, Investigation, Methodology, Project administration, Resources, Supervision, Visualization, Writing – original draft, Writing – review & editing

    giuseppe.insalaco@ift.cnr.it

    Affiliations National Research Council of Italy, Institute for Biomedical Research and Innovation (IRIB), Palermo, Italy, National Research Council of Italy, Institute of Translational Pharmacology (IFT), Palermo, Italy

Abstract

Purpose

Obstructive sleep apnea (OSA) is a common, prevalent, and underdiagnosed disorder. Its lack of diagnosis and treatment is associated with increased morbidity and mortality. Previous screening questionnaires investigated parameters including body mass index, age, neck circumference, and sex, in addition to symptoms. This study aimed to validate a new Italian, self-administered, and easy-to-use six-item questionnaire that evaluates only subjective symptoms.

Patients and methods

The present study included 2622 patients (male, 2011; female, 611). Patients who were at least 18 years old, spoke Italian, referred to our sleep clinic for possible OSA, and completed the self-administered SANReSP questionnaire were recruited for the study. The predictive performance of the questionnaire was also evaluated.

Results

Nocturnal study showed 89.9% of OSA patients had apnea-hypopnea index (AHI) ≥ 5/h; 68.7%, AHI ≥ 15/h; and 48.2%, AHI ≥ 30/h. The optimal SANReSP score for AHI ≥ 5/h was >3 with a sensitivity and specificity of 74.76% and 67.92%, respectively, and an area under receiver operating characteristic curve (ROC) of 0.76. For moderate–severe OSA, the optimal SANReSP score was >3 (sensitivity, 78.18%; specificity, 46.53%; ROC, 0.66). For severe OSA, the optimal SANReSP score was >4 (sensitivity, 59.10%; specificity, 64.73%; ROC, 0.65). The probability of OSA increased with higher SANReSP scores (98.7% and 97.9% in men and women, respectively).

Conclusion

The SANReSP questionnaire is a short, easy-to-use, and self-administered screening tool for OSA. Its performance is similar to that of other widely used questionnaires; furthermore, it is advantageous in that it does not require anthropometric measurements.

Introduction

Obstructive sleep apnea (OSA) is characterised by recurrent episodes of partial or complete obstruction of the upper respiratory tract during sleep. It has been widely demonstrated that OSA is accompanied by a higher frequency of road, domestic, and workplace accidents and a decline in neurocognitive and psychosocial functions, which can have significant repercussions on quality of life [1]. Sleep apnea affects normal sleep architecture and causes intermittent hypoxaemia, oxidative stress, and increased sympathetic tone, resulting in cardiovascular, cerebrovascular, metabolic, and neurocognitive sequelae. Risk factors include obesity as well as soft and skeletal facial tissue abnormalities [2, 3].

OSA presents with daytime symptoms such as fatigue, unrefreshing sleep, and excessive sleepiness and nocturnal symptoms such as persistent and intermittent snoring, sleep apnea reported by the bed partner, and nocturia, especially in younger individuals without any urological disorders. The prevalence of nocturia in patients with OSA is 50–70% [4]. Women with OSA often exhibit atypical symptoms, such as insomnia, mood changes, and headache [5].

Substantial methodological heterogeneity in population prevalence studies cause a wide variation in the reported prevalence, which, in general, is high. At ≥5 events/h apnea-hypopnea index (AHI), the overall population prevalence range from 9% to 38% and as higher in men. At ≥15 events/h AHI, the prevalence in the general adult population range from 6% to 17%, being as high as 49% in the advanced ages [6].

A recent epidemiological study, using AHI ≥ 5/h as the criterion, estimates that nearly 1 billion (936 million) adults aged 30–69 years could have OSA, out of which the number of individuals with moderate–severe OSA (AHI ≥ 15/h), for which treatment is generally recommended, is estimated to be nearly 425 million [7].

Given the high prevalence and impact of OSA on health and quality of life, it is necessary to have screening tools for identifying OSA and preventing related comorbidities as well as health, social, and economic implications. To date, insufficient sensitive and specific criteria necessitate the clinical diagnosis of OSA. Nocturnal laboratory or home-based polysomnography and cardio-respiratory monitoring are the only diagnostic procedures. However, these methods are expensive in terms of economic and organisational resources, and they are not always immediately available. Thus, most people with moderate–severe OSA are not diagnosed [8].

Several assessment tools have been developed to expedite the identification of patients at risk for OSA. The different screening tools, mainly characterised by questionnaires, are generally based on the main clinical and anthropometric risk factors for OSA. Comparison between the different questionnaires can be difficult due to the heterogeneity of the studies, including the target population chosen and the different AHI cut-offs and type of examination instruments used for OSA diagnosis. The Berlin questionnaire (BQ), created in the field of general medicine, and the STOP-BANG questionnaire (SBQ), developed in the anaesthesiology field, are widely used for OSA diagnosis, but their predictivity vary depending on the area in which they are administered [9].

Given that OSA diagnosis using sleep studies is costly and time-consuming, and the existing screening tools have a significant tradeoff between sensitivity and specificity, there is a need to develop new tools that perform better and has no need of physical measures which are inherent disadvantages of the existing tools. We therefore thought is useful the development of an OSA screening tool based solely on symptoms.

In our study, we developed a self-administered six-item screening questionnaire for OSA with dichotomous answers, without the need of anthropometric measurements, called SANReSP.

Material and methods

Participants

The study involved Italian patients consulting our sleep center for respiratory sleep disorders. This study was conducted in accordance with the amended Declaration of Helsinki. The Institutional Ethical Committee, Azienda Ospedaliera Universitaria Policlinico “Paolo Giaccone”, Palermo 1, approved the protocol. All patients gave their written informed consent for personal data processing.

Recruitment was conducted between January 2015 and June 2019. The study recruited 2622 patients (male, 2011; female, 611). Italian-speaking patients referred to our sleep clinic because of OSA suspicion and at least 18 years of age were eligible for the study. Patients with uncontrolled psychiatric illness, neurocognitive impairment, usage of sedative or hypnotic medications, sleep time test duration shorter than 6 h, or “absence of answer” answer to at least one of the SANReSP items were not included in the study. The minimum sample size required for a screening study, with the null hypothesis for sensitivity and specificity at 0.5, a target significance level of 0.05, and a power of 80%, ranges from 22 (prevalence = 90%) to 980 (prevalence = 5%) [10]. The prevalence of OSA in patients at a sleep clinic is estimated to be approximately 80%. Thus, the study’s sample size of 2622 patients was consistent.

Sample processing

A portable, computerised system type III (Embla, Natus Inc., Middleton, USA) was employed to perform nocturnal monitoring. The sleep studies were performed at the sleep lab and at patients’ home. A sleep technician has set sleep studies device. The following signals were recorded: airflow by nasal cannula pressure, snoring, thoracic and abdominal efforts, body position, limb movements, arterial oxygen saturation, pulse rate, and pulse waveform. The recording duration was at least 6 h [11].

Type III Sleep Studies uses portable monitors that allow sleep studies to be done at the patient’s home or elsewhere. This option was introduced as a more accessible and less expensive alternative to in-laboratory polysomnography. Unlike Type I, Type III testing cannot measure the duration of sleep, the number of arousals or sleep stages, nor can it detect non respiratory sleep disorders. The American Academy of Sleep Medicine and Canadian Sleep Society/Canadian Thoracic Society guidelines recommend that portable sleep studies be provided under the direction of health professionals with accreditation in sleep medicine and as part of a comprehensive assessment [11].

Apneas and hypopneas were visually scored and OSA severity was defined according to the American Academy of Sleep Medicine 2012 standard criteria [12]. Apneas were identified on the airflow signal and were classified as obstructive, central, or mixed according to the behavior of thoraco-abdominal movements. Hypopneas were defined as discernible reductions in airflow or thoraco-abdominal movements for at least 10 s, followed by an arterial oxygen saturation fall of ≥3%. The AHI was calculated as the number of apneas and hypopneas per hour of estimated total sleep time. The percentage of the night with O2 saturation <90% (TSat90) was assessed. A sleep medicine expert, blinded to the questionnaire, scored all sleep studies.

Questionnaire

To keep the questionnaire concise, easy-to-use, and quick to fill out, the questions were designed in a yes/no format. Based on a literature review, questions were designed using the most common clinical domains of OSA and hypertension. The SANReSP questionnaire includes six dichotomous (yes/no) questions: S: Do they tell you that you Snore? [Le dicono che russa?], A: Do they tell you that sometimes you stop breathing or have sleep Apnea? [Le dicono che talvolta smette di respirare o ha apnee durante il sonno?], N: Do you wake up during the night with an urge to urinate ‘Nocturia’? [Si sveglia durante la notte con il bisogno urgente di urinare?], Re: Do you sometimes feel unsatisfied with how you slept ‘Rest’? [Le capita di non essere soddisfatto/a di come ha dormito?], S: Do you frequently feel the desire or need to sleep during the day except after lunch ‘Sleepy’? [Sente frequentemente il desiderio o il bisogno di dormire durante il giorno eccetto dopo pranzo?], and P: Do you take medications for high blood Pressure? [Assume farmaci per la pressione arteriosa alta?] (Fig 1). SANReSP is a self-administered questionnaire. The score ranges from 0 to 6, attributing one point for each affirmative response and 0 is assigned when no answer is given.

Statistical analyses

Statistical analyses were performed using the commercial 2020 MedCalc statistical software (MedCalc Software Ltd., Ostend, Belgium). The Kolmogorov–Smirnov test was used for evaluating the accordance of the parameters with a normal distribution. Normally distributed continuous variables were reported as means and standard deviations. Non-normally distributed continuous variables were reported as median and 25–75% interquartile range. Categorical variables were reported as frequencies. The non-parametric Wilcoxon’s test was used to assess the differences. Comparisons with a p-value of ≤0.05 were considered statistically significant.

The OSA probability determined by SANReSP was compared to the diagnostic sleep study results. Receiver operating characteristic (ROC) curve analysis was performed. The specificity, sensitivity, positive predictive value (PPV), negative predictive value (NPV), likelihood ratio (LR) for a positive test result (LR+), LR for a negative test result (LR-), accuracy, and odds ratio (LR+/LR-) (OR) were calculated. All estimates were reported with their respective 95% confidence intervals (CIs). The CIs for sensitivity, specificity, and accuracy were ‘exact’ Clopper–Pearson CIs. The CIs for the LRs was calculated using the ‘Log method’ of Altman et al. 2000 (as given on page 109) [13]. The CIs for the predictive values were the standard logit CIs given by Mercaldo et al. 2007 [14]. The CIs for OR were calculated according to Altman DG 1991 [15].

The LR+ and LR- indicate if a patient is more or less likely to have a disease, respectively. Since LRs are not affected by disease prevalence, they might be more useful parameters than sensitivity, specificity, and predictive values. The higher the LR+ (>1), the stronger is the prediction of a disease. Conversely, the lower the LR- (<0.5), the better is the prediction of the absence of disease.

The optimal cut-off that maximises true positives and minimises false positives was determined, and it corresponds to the highest sensitivity + specificity. The response was dichotomised by AHI ≥ 5/h for all OSA patients, AHI ≥ 15/h for moderate–severe OSA patients, and AHI ≥ 30/h for only severe OSA patients. The predictive probability (post-test probability) was calculated using logistic regression. The statistical analyses were conducted separately for men and women. The statistical significance of the difference between the areas under ROC curves (AUCs) of men and women was evaluated using the DeLong method [16].

Results

Demographic characteristics

Descriptive statistics of the analysed sample are presented in Table 1. Body mass index (BMI) and age were greater in women than in men, while neck circumference and AHI severity were greater in men than in women. Of the 2622 patients, 265 (10.1%) patients did not have OSA, 2357 (89.9%) had AHI ≥ 5/h, 1801 (68.7%) had AHI ≥ 15/h, and 1264 (48.2%) had AHI ≥ 30/h.

Questionnaire analysis

The median SANReSP score was 4 for men and 5 for women. In Table 2, we can see the positive responses for SANReSP, from the total population and between males and females. Fig 2 shows the distribution of the SANReSP scores for men and women. A score of 5 was most frequent in both sexes. Figs 3 and 4 show the ROC curves for all patients and men/women, respectively, at AHI severity levels of ≥ 5/h, ≥ 15/h, and ≥ 30/h. The comparison between the ROC curves of men and women were statistically different at AHI ≥ 15/h. Additionally, the AUCs for women were larger than that of men.

thumbnail
Fig 2. Distribution of patients according to their SANReSP score for males and females.

https://doi.org/10.1371/journal.pone.0276217.g002

thumbnail
Fig 3. Receiver operating characteristic curves analysis of the SANReSP for all subjects.

https://doi.org/10.1371/journal.pone.0276217.g003

thumbnail
Fig 4. Receiver operating characteristic curves analysis of the SANReSP for males and females.

https://doi.org/10.1371/journal.pone.0276217.g004

Evaluation of the questionnaire’s validity for AHI severity (≥ 5/h, ≥ 15/h, ≥ 30/h) is presented in Table 3. For AHI ≥ 5/h, the optimal SANReSP cut-off was >3 (sensitivity, 74.76%; specificity, 67.92%; accuracy, 74.07%; OR, 6.30; AUC, 0.76). For moderate–severe OSA (AHI ≥ 15/h), the optimal cut-off was >3 (sensitivity, 78.18%; specificity, 46.53%; accuracy, 68.27%; OR, 3.11; AUC, 0.66). For severe OSA (AHI ≥ 30/h), the optimal cut-off was >4 (sensitivity, 59.10%; specificity 64.73%; accuracy, 62.01%; OR, 2.67; AUC, 0.65).

thumbnail
Table 3. Predictive parameters for SANReSP questionnaire.

https://doi.org/10.1371/journal.pone.0276217.t003

Fig 5 shows the relationship between the predictive probability of sleep apnea (AHI ≥ 5/h) versus the SANReSP questionnaire score; the dashed line indicates the 95% CIs. The probability of OSA increased as the SANReSP score increased, with the same trend in both women and men. The probability of AHI ≥ 5/h was 86.8% in men and 68.7% in women for a score of 3, while it was 98.7% in men and 97.9% in women for a score of 6.

thumbnail
Fig 5. Predicted probabilities plot for AHI ≥5/h, with the corresponding SANReSP score.

Dashed lines indicate the 95% confidence intervals.

https://doi.org/10.1371/journal.pone.0276217.g005

Discussion

An ideal screening tool for detecting OSA in the general or sleep clinic populations should consist of simple questions combined with good sensitivity and specificity. In the general population, questionnaires with high sensitivity and LR- are generally desired, where-as in specific populations, questionnaires with high specificity are needed to promptly initiate appropriate therapeutic measures [15, 17]. The short questionnaires most commonly used to detect OSA are the BQ and SBQ along with the ESS for the subjective assessment of daytime sleepiness.

The BQ is a screening test designed for primary care administration, with 10 questions allocated in-to three categories. The first category includes five questions on snoring and cessation of breathing, the second category includes four questions on daytime sleepiness and fatigue, and the last category includes one question on systemic arterial hypertension and obesity. Patients with positive scores in two or more categories are defined as being at high risk for OSA [18]. A meta-analysis of 42 studies found sensitivity and specificity levels of 76% and 59% for mild OSA, 77% and 44% for moderate OSA, and 77% and 44% for severe OSA [9].

The SBQ is a simple OSA screening tool, partly related to symptoms (STOP) and physical measures (BANG).

The total score ranges from 0 to 8, with a score between 5 and 8 classified as high risk for OSA [12].

The SBQ, developed in the anaesthesiology field, has been validated in different contexts (different ethnic groups, general population, sleep clinic populations, commercial drivers, patients with cardiovascular factors) and it is now widely used to identify patients at high risk for OSA [1921].

Different BMI thresholds for OSA have been suggested among ethnic groups. BMIs of 27.5 kg/m2 in Chinese and Indian populations and 35 kg/m2 in Malay and Caucasian populations predict moderate–severe OSA [22]. A meta-analysis of 11 sleep clinic studies with multiethnic populations (47–1426 participants) revealed that the SBQ predicted OSA (AHI ≥ 5) at a sensitivity and specificity ranging from 81% to 95% and 31% to 58%, respectively [23]. The advantage of the SANReSP questionnaire in a sleep clinic is in the speed and simplicity of the screening method and the absence of anthropometric parameters that allows patient interviews to be conducted using telephone or videoconferencing. One study evaluated the sensitivity and specificity of the SBQ among patients referred to a sleep disorder laboratory where physical measurements of BANG were reported by the patient rather than measured by the clinic staff. The use of self-reported values (height, weight, sex, age, and neck circumference), rather than measurements by sleep clinic staff, reduced the sensitivity of the SBQ [19]. A new four-item questionnaire, named GOAL (gender, obesity, age, and loud snoring), has been developed and validated [24].

The SANReSP questionnaire has the advantage of not including questions that require direct measurement of patient parameters. The convenience of a screening tool that does not require physical assessment increases its use in large-scale studies. The SANReSP questionnaire adds an important symptom of the clinical picture of OSA, namely nocturia. OSA is a frequent cause of nocturia, especially in younger individuals without urological disorders. The prevalence of nocturia in patients with OSA is 50–70% [25].

The ESS is used worldwide for the subjective evaluation of the propensity to fall asleep in specific daytime situations. It includes eight self-rated items, and each item is scored from 0 to 3. A score of >10 indicates significant daytime sleepiness. The ESS was initially proposed for the assessment of excessive daytime sleepiness (EDS) in narcolepsy, but it has subsequently been widely used for assessing EDS in OSA. Studies have shown that the ESS is a weak predictor of OSA, but it is useful when combined with other measures [26]. The ESS correlates only modestly with ‘objective’ measures of sleepiness, such as the sleep latency test and maintenance of wakefulness test, while it correlates very weakly with the severity of OSA defined by both AHI and nocturnal oxygen saturation.

Strengths and limitations

The SANReSP questionnaire is a low-cost, easy, short, and self-administered questionnaire, which exclusively consists of clinical parameters and does not require patient measurements. Thus, it is excellent for screening patients with suspected OSA. The sample size of the study is among the largest sample sizes used to investigate the predictivity of OSA screening questionnaires. A limitation of the study is the use of home polygraphic studies for diagnostics rather than complete laboratory-based polysomnography. PSG is widely accepted as the gold standard test for diagnosis of OSA. However, within the appropriate context, the use of Level 3 sleep study is considered an acceptable method for diagnosing OSA by the American Academy of Sleep Medicine [27]. As reported by AASM Rules, Level 3 sleep study were performed after clinical evaluation. Additionally, sleep assessment was performed under the supervision of certified sleep medicine physician. Furthermore, the study has a selection bias since the results apply to a sleep clinic population, i.e. patients with a high probability of pre-test disease, which is not representative of the general adult population. Additionally, the sensitivity of this tool is moderate and some of the patients referred to sleep clinic can be missed. Furthermore, the questionnaire development was based on a literature review and questions were related to the most common clinical domain of OSA. No factor analysis was performed.

Conclusion

In light of the profound impact of OSA on health and quality of life, it is essential that patients are adequately screened to receive the necessary medical care. Thus, a screening tool is necessary to stratify patients based on clinical symptoms and risk factors. The performance of the SANReSP questionnaire is similar to other widely used OSA screening questionnaires; moreover, the possibility of its use without the measurement of anthropometric parameters makes it a valid screening tool that can be administered using telephone or video-conferencing in sleep clinic populations. In conclusion, the SANReSP questionnaire is a short, easy-to-use, and self-administered screening tool for OSA. The questionnaire needs further investigation as a possible aid in the public health efforts to identify populations at risk of OSA, a frequently unrecognised sleep disorder with serious associated morbidity and mortality.

Supporting information

Acknowledgments

The authors wish to thank the participants and Mr. Fabio Artisi, Mr. Gabriele Lo Monaco, and Mr. Giovanni Sciortino for their technical support.

References

  1. 1. Lo Bue A, Salvaggio A, Iacono Isidoro S, et al. OSA and CPAP therapy: effect of gender, somnolence, and treatment adherence on health-related quality of life. Sleep Breath. 2020; 24:533–540. pmid:31309464
  2. 2. Fogel RB, Malhotra A, White DP. Sleep. 2: pathophysiology of obstructive sleep apnoea/hypopnoea syndrome. Thorax. 2004;59:159–163. pmid:14760159
  3. 3. Neelapu BC, Kharbanda OP, Sardana HK, et al. Craniofacial and upper airway morphology in adult obstructive sleep apnea patients: A systematic review and meta-analysis of cephalometric studies. Sleep Med Rev. 2017;31:79–90. pmid:27039222
  4. 4. Flemons WW. Clinical practice. Obstructive sleep apnea. N Engl J Med. 2002;347(7):498–504. pmid:12181405
  5. 5. Ye L, Pien GW, Weaver TE. Gender differences in the clinical manifestation of obstructive sleep apnea. Sleep Med. 2009;10:1075–84. pmid:19403333
  6. 6. Senaratna CV, Perret JL, Lodge CJ, Lowe AJ, Campbell BE, Matheson MC, et al. Prevalence of obstructive sleep apnea in the general population: A systematic review. Sleep Med Rev. 2017 Aug;34:70–81. pmid:27568340
  7. 7. Benjafield AV, Ayas NT, Eastwood PR, et al. Estimation of the global prevalence and burden of obstructive sleep apnoea: a literature-based analysis. Lancet Respir Med. 2019;7:687–98. pmid:31300334
  8. 8. Pietzsch JB, Garner A, Cipriano LE, et al. An integrated health-economic analysis of diagnostic and therapeutic strategies in the treatment of moderate-to-severe obstructive sleep apnea. Sleep. 2011;34:695–709. pmid:21629357
  9. 9. Chiu HY, Chen PY, Chuang LP, et al. Diagnostic accuracy of the Berlin questionnaire, STOP-BANG, STOP, and Epworth sleepiness scale in detecting obstructive sleep apnea: A bivariate meta-analysis. Sleep Med Rev. 2017;36:57–70. pmid:27919588
  10. 10. Bujang MA, Adnan TH. Requirements for minimum sample size for sensitivity and specificity analysis. J Clin Diagn Res 2016;10:YE01–YE06. pmid:27891446
  11. 11. Kapur VK, Auckley DH, Chowdhuri S, et al. Clinical Practice Guideline for Diagnostic Testing for Adult Obstructive Sleep Apnea: An American Academy of Sleep Medicine Clinical Practice Guideline. J Clin Sleep Med. 2017 Mar 15;13:479–504. pmid:28162150
  12. 12. Berry RB, Budhiraja R, Gottlieb DJ, et al. American Academy of Sleep Medicine. Rules for scoring respiratory events in sleep: update of the 2007 AASM manual for the scoring of sleep and associated events. Deliberations of the Sleep Apnea Definitions Task Force of the American Academy of Sleep Medicine. J Clin Sleep Med. 2012;8:597–619.
  13. 13. Altman DG, Machin D, Bryant TN, Gardner MJ (Eds) (2000) Statistics with confidence, 2nd ed. BMJ Books.
  14. 14. Mercaldo ND, Lau KF, Zhou XH. Confidence intervals for predictive values with an emphasis to case-control studies. Statistics in Medicine 2007;26:2170–83. pmid:16927452
  15. 15. Altman DG, Bland JM. Practical statistics for medical research. London, Chapman and Hall, 1991.
  16. 16. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing areas under two or more correlated reciever operating characteristics curves: a nonparamentric approach. Biometrics. 1988;44(3):837–845.
  17. 17. Ouanes-Besbes L, Hammouda Z, Besbes S, et al. Diagnosis of sleep apnea syndrome in the ICU: A case-series of survivors of hypercapnic respiratory failure. Ann Am Thorac Soc. Published Online: November 10, 2020. pmid:33171053
  18. 18. Netzer NC, Stoohs RA, Netzer CM, et al. Using the Berlin Questionnaire to identify patients at risk for the sleep apnea syndrome. Ann Intern Med. 1999;13:485–91. pmid:10507956
  19. 19. Pivetta B, Chen L, Nagappa M, et al. Use and Performance of the STOP-Bang Questionnaire for Obstructive Sleep Apnea Screening Across Geographic Regions: A Systematic Review and Meta-Analysis. JAMA Netw Open. 2021 Mar 1;4(3).
  20. 20. Chen L, Pivetta B, Nagappa M, et al. Validation of the STOP-Bang questionnaire for screening of obstructive sleep apnea in the general population and commercial drivers: a systematic review and meta-analysis. Sleep Breath. 2021;25(4):1741–1751. pmid:33507478
  21. 21. Hwang M, Zhang K, Nagappa M, et al. Validation of the STOP-Bang questionnaire as a screening tool for obstructive sleep apnoea in patients with cardiovascular risk factors: a systematic review and meta-analysis. BMJ Open Respir Res. 2021 Mar;8(1). pmid:33664122
  22. 22. Waseem R, Chan MTV, Wang CY, et al. Diagnostic performance of the STOP-Bang questionnaire as a screening tool for obstructive sleep apnea in different ethnic groups. J Clin Sleep Med. 2020 Oct 28. pmid:33112227
  23. 23. Nagappa M, Liao P, Wong J, et al. Validation of the STOP-Bang Questionnaire as a Screening Tool for Obstructive Sleep Apnea among Different Populations: A Systematic Review and Meta-Analysis. PLoS One. 2015 Dec 14;10(12):e0143697.
  24. 24. Duarte RL, Magalhães-da-Silveira FJ, Oliveira-E-Sá TS, et al. Obstructive Sleep Apnea Screening with a 4-Item Instrument, Named GOAL Questionnaire: Development, Validation and Comparative Study with No-Apnea, STOP-Bang, and NoSAS. Nat Sci Sleep. 2020;12:57–67. pmid:32158294
  25. 25. Miyauchi Y, Okazoe H, Tamaki M, et al. Obstructive Sleep Apnea Syndrome as a Potential Cause of Nocturia in Younger Adults. Urology 2020;143:42–47. pmid:32473935
  26. 26. Silva GE, Vana KD, Goodwin JL, et al. Identification of patients with sleep disordered breathing: comparing the four-variable screening tool, STOP, STOP-Bang, and Epworth Sleepiness Scales. J Clin Sleep Med 2011;7:467–72. pmid:22003341
  27. 27. Epstein LJ, Kristo D, Strollo PJ, et al. Adult Obstructive Sleep Apnea Task Force of the American Academy of Sleep Medicine. Clinical guideline for the evaluation, management and long-term care of obstructive sleep apnea in adults. J Clin Sleep Med 2009;5:263–76.