Figures
Abstract
While the fractional concentration of exhaled nitric oxide (FeNO) has proven useful in asthma research, its exact role in clinical care remains unclear, in part due to unexplained inter-subject heterogeneity. In this study, we assessed the hypothesis that the effects of determinants of the fractional concentration of exhaled nitric oxide (FeNO) vary with differing levels of FeNO. In a population-based cohort of 1542 school children aged 12–15 from the Southern California Children's Health Study, we used quantile regression to investigate if the relationships of asthma, socio-demographic and clinical covariates with FeNO vary across its distribution. Differences in FeNO between children with and without asthma increased steeply as FeNO increased (Estimated asthma effects (in ppb) at selected 20th, 50th and 80th percentiles of FeNO are 2.4, 6.3 and 22.2, respectively) but the difference was steeper with increasing FeNO in boys and in children with active rhinitis (p-values<0.01). Active rhinitis also showed significantly larger effects on FeNO at higher concentrations of FeNO (Estimated active rhinitis effects (in ppb) at selected 20th, 50th and 80th percentiles of FeNO are 2.1, 5.7 and 14.3, respectively). Boys and children of Asian descent had higher FeNO than girls and non-Hispanic whites; these differences were significantly larger in those with higher FeNO (p-values<0.01). In summary, application of quantile regression techniques provides new insights into the determinants of FeNO showing substantially varying effects in those with high versus low concentrations.
Citation: Zhang Y, Berhane K, Eckel SP, Salam MT, Linn WS, Rappaport EB, et al. (2015) Determinants of Children's Exhaled Nitric Oxide: New Insights from Quantile Regression. PLoS ONE 10(7): e0130505. https://doi.org/10.1371/journal.pone.0130505
Editor: Stelios Loukides, University of Athens, GREECE
Received: December 19, 2014; Accepted: March 12, 2015; Published: July 27, 2015
Copyright: © 2015 Zhang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: Due to ethical and legal restrictions, the raw data underlying this paper cannot be freely available in the public domain. The de-identified data from the Southern California Children Health Study is available to interested researchers upon request, pending ethical approval. Investigators who wish to access the data will be required to submit a brief research protocol, which will be reviewed by the Children’s Health Study Health Data Release Committee and the USC IRB. Recipients must agree to security policies. Please send requests to access this dataset to the corresponding author, Dr. Yue Zhang (zhang.yue@hsc.utah.edu).
Funding: This work was supported by the National Heart, Lung and Blood Institute (grants 5R01HL61768 and 5R01HL76647); the Southern California Environmental Health Sciences Center (grant 5P30ES007048) funded by the National Institute of Environmental Health Sciences; the Children’s Environmental Health Center (grants 5P01ES009581, R826708-01 and RD831861-01) funded by the National Institute of Environmental Health Sciences and the Environmental Protection Agency; the National Institute of Environmental Health Sciences (grants 5P01ES011627, 1K22ES022987 and R01ES023262); the James H. Zumberge Research and Innovation Fund, and the Hastings Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Due to the great potential of fractional exhaled nitric oxide (FeNO) as a noninvasive marker of eosinophilic airway inflammation [1–8], extensive research has been undertaken in recent years to explore the important host and environmental factors as determinants of FeNO. Kovesi et al found FeNO concentration among healthy school children to be significantly associated with race, age and height [9]. Levesque et al found that gender, serum total immunoglobulin E (IgE) levels and current upper respiratory tract infection symptoms significantly contributed to the FeNO variability in healthy nonsmoking African Americans [10]. Olivieri et al and Taylor et al recommended that gender should be considered in creating FeNO reference values even when atopy, smoking, asthma symptoms and steroid usage have been taken into account [11, 12]. Yao et al determined that the upper limits of normal FeNO in Asian children are higher than in Caucasian children [13]. Van der Valk et al identified FeNO in children was associated with 3 genetic variants [14].
To date, most studies have investigated the determinants of FeNO using conventional mean regression techniques. This method assumes that the effects of predictors of FeNO have a constant relationship across the distribution of FeNO from low to high concentrations. However, this assumption may obscure potentially important variation in effects by averaging the effects of a predictor across the distribution of FeNO. For example, the same level of exposure may cause a relatively larger response in subjects whose FeNO is already high, but no response in subjects with low-to-moderate prior FeNO levels. To the best of our knowledge, no studies have investigated heterogeneity in effects of FeNO determinants amongst individuals with underlying high versus low FeNO levels.
To investigate heterogeneity in effects of determinants across the distribution of FeNO concentrations, we applied a quantile regression (QR) approach. The QR approach [15] provides a useful framework to assess the effects of risk factors that could vary across the distribution of FeNO, providing a more complete picture of covariate effects on FeNO. The QR approach also has the additional advantage of being independent on the normality assumption inherent in regular mean regression. While our analysis of FeNO data using QR is novel, its advantages have already provided new insights in pulmonary function research [16,17].
The present study aimed to investigate heterogeneity in the relationships of important determinants of FeNO across different percentiles of FeNO among school children who participated in the Southern California Children's Health Study (CHS). We focus on the school children in this study because they suffer greater burden from respiratory disease, such as asthma, than adults.
Methods
Study Population
Study participants were drawn from an ongoing, population-based CHS cohort of children who were recruited from kindergarten or first grade classrooms in 2002–2003 from 13 southern California communities. The research protocol was approved and documented by the University of Southern California Health Sciences Campus Institutional Review Board. Written informed consent was obtained from a parent or guardian on behalf of each child participant. More information on the study design of this cohort has been reported elsewhere [18].
FeNO measurement
Details of the FeNO collection and quality control approaches have been reported elsewhere [19]. Briefly, FeNO measurements were collected at schools from March to June 2010 using an online breath collection technique. Online measurements were performed at 50ml/s expiratory flow rates using EcoMedics CLD-88-SP analyzers, with DeNOx accessories to provide NO-free inhaled air (EcoPhysics Inc., Ann Arbor, MI, USA/Duernten, Switzerland), according to American Thoracic Society (ATS) guidelines [20]. Each child provided three maneuvers recorded at the 50 ml/s target flow rate. Additional maneuvers may have been recorded if the technician judged it necessary to replace one that was unsatisfactory. Plateau acceptability required < = 10% NO concentration variability [20]. Plateau concentration for each maneuver was taken from the 3 second plateau with the minimum NO coefficient of variation. FeNO was represented by the mean of two or three ATS acceptable plateaus that differed by less than 15% or 1 ppb where all ATS acceptable plateaus were less than 10 ppb. In the present analysis, acceptable FeNO was measured in 1542 subjects on March through June of 2010 school year of the study.
Covariate Information
We collected covariate data from questionnaires completed by parents/guardians, including socio-demographic factors such as child's gender, race/ethnicity, date of birth, and community of residence. Children were classified as having asthma if the parent/guardian reported that a doctor had "ever diagnosed the child as having asthma." Children who enrolled were asked to fill out a questionnaire regarding their health information in the past 12 months at the time of FeNO measurement [18,21]. Information on current rhinitis was defined based on children's answers to two nested questions ("In the past 12 months, have you had a problem with sneezing, or a runny or blocked nose when you did not have a cold or the flu?" and "In just the last 30 days, when did you have this nose problem?") with categories of 1) No rhinitis in last 12 month, 2) rhinitis between 1 and 12 months ago, 3) rhinitis between 7 days and 1 month ago and 4) rhinitis within last 7 days, hereafter also referred to as active rhinitis. BMI was calculated based on height and weight measurement made on the day of FeNO measurement. Overweight and obesity status were determined based on age and gender specific cutoffs from CDC BMI-for-age growth charts (SAS program available at http://www.cdc.gov/nccdphp/dnpao/growthcharts/resources/sas.htm). Inhaled corticosteroid (ICS) use was defined based on children's answers to the questions about medication requirement for asthma and wheezing in the last 12 months and in just the past month, with categories of 1) Never use, 2) ICS use between 1 and 12 months ago, 3) ICS use between 7 days and 1 month ago, and 4) ICS use within 7 days.
Statistical analysis
Descriptive and exploratory data analyses were conducted to examine the characteristics of the whole study population and by asthma status to characterize the distribution of the FeNO measurements. QR approach [15] was used to model the relationship between a set of covariates and specific percentiles (or quantiles, denoted by τ) of the response variable, FeNO, as shown below:
In the QR model, the regression coefficients are indexed by quantile τ (where, for example, τ = 0.5 corresponds to the median) and quantify the change in the value of the quantile of FeNO, QFeNO(τ), associated with a one unit change in the predictor variable X. In this study, QR was used to examine the mutually adjusted effects of asthma, socio-demographic and clinical factors on quantiles of FeNO. The list of these priori determinants of FeNO was selected based on existing literature and study design. All models were adjusted for the design variables age and community of residence as well as BMI percentiles. Interaction effects of asthma by active rhinitis or gender were also examined. Sensitivity analyses were conducted among children reporting no ICS use in last 12 months and children reporting not having both allergic and infectious rhinitis in last 30 days, respectively. We fitted the QR models at quantiles ranging from 0.10 to 0.90, with 0.01 increments. Since inference in quantile regression is independent of the normality assumption, log transformation of FeNO is not needed. All models were fitted using the quantreg package in R (a statistical software which is freely available at http://cran.r-project.org/) using method discussed in [15]. Pairwise Wald tests were used to test the equality of covariate effects across selected quantiles (0.2, 0.5 and 0.8). Statistical significance was assessed assuming a 0.05 significance level and a two-sided alternative hypothesis.
Results
Participants of this study were between 12 and 15 years old and were equally divided between boys and girls (Table 1). The majority of the subjects were Hispanic (Primarily Mexican or Central American descent) (56.6%) and Non Hispanic White (31.3%). The geometric mean (SD) of FeNO for the cohort was 15.8 ppb (SD = 2.1). Consistent with previous literature, we found that gender and race/ethnicity were associated with FeNO (P-value: <0.0001 for gender and 0.003 for race/ethnicity), with boys and Asians, African Americans having significantly higher FeNO levels. Children with asthma had significantly higher FeNO level compared to children without asthma (p-value<0.0001). Almost 16% of the children had rhinitis within the last 7 days before the FeNO measurements. We found that more recent occurrence of rhinitis was associated with higher FeNO level (P-value<0.0001) while children with rhinitis within last 7 days have highest FeNO level (geometric mean 21.6 ppb with geometric standard deviation 2.4). Less than 10% of children had rhinitis between 7 days and 1 month prior to FeNO measurement, and about 6% had it between 1 month and 12 months prior. Most children in this population-based cohort did not have asthma (80% of the full cohort). Among children with asthma, slightly more than half were boys, almost a quarter had rhinitis within the last 7 days before FeNO measurements, and less than 10% had ICS use within 1 month preceding FeNO measurement. Both current rhinitis and male were significantly associated with FeNO measurement (P-value: 0.001 for current rhinitis and 0.02 for gender). More information about the distribution of FeNO in the study cohort by selected children's characteristics is shown in the Online Repository (S1 Table).
Table 2 presents the estimated differences in the selected quantiles of FeNO (ppb) associated with asthma, rhinitis in the last 12 months, gender and race/ethnicity. We found that the effects of asthma on FeNO steeply increased in magnitude across the distribution of FeNO. In other words, there was substantial heterogeneity of the effect of asthma as asthma tended to have a larger effect on the FeNO level as the FeNO level increased. The estimated FeNO level at 20th percentile for children with asthma was 2.4 ppb (p-value<0.01) higher than that for children without asthma. In contrast, the estimated FeNO level at 80th percentile for children with asthma increased by 22.2 ppb (p-value<0.01). The estimated increase in the 80th percentile of FeNO associated with asthma was about 10 times, 4 times and 2 times larger than children without asthma at 20th, 50th and 60th percentiles, respectively. These pairwise differences of the effect of asthma among those with low levels (quantile = 0.2), intermediate levels (quantile = 0.5) and high levels (quantile = 0.8) were all statistically significant with p-value <0.01 (see S2 Table in the online supplement). We found further evidence for a non-constant effects of rhinitis symptoms within 7 days before FeNO measurement, gender and Asian ethnicity. Especially, we discovered a substantial heterogeneity in the impact of rhinitis within 7 days before FeNO testing on the distribution of FeNO. While the estimated FeNO level at 20th percentile for children with active rhinitis within 7 days before FeNO testing was only 2.1 ppb (p-value<0.01) higher than children without active rhinitis, the estimated FeNO level at 80th percentile for children with active rhinitis is 14.3 ppb (p-value<0.01) higher.
Fig 1 shows the heterogeneity of the magnitude of effect of asthma on FeNO in a more complete way by presenting the estimated effects at quantiles ranging from 0.10 to 0.90. The figure shows that the differences in the effect associated with asthma were statistically significant across the distribution of FeNO but varied in magnitude from low to high FeNO concentrations. Although the effects of asthma were small in the lower tail of the distribution, the magnitude increased dramatically in the upper tail of the distribution. Similar patterns for the non-constant and increasing effects of active rhinitis, gender and race/ethnicity are shown in Fig 2.
The solid line shows the location of no covariate effect. The shaded gray area depicts a 95% pointwise confidence band for the quantile regression estimates, which is represented by the dot line.
Table 3 presents estimates of FeNO differences associated with asthma by current rhinitis and gender. The pattern of steeply increasing effect of asthma with increasing FeNO was evident in both sexes and each rhinitis symptom group. At each quantile, asthma had consistently larger effects in boys than in girls and with increasing effects in the more recent occurrence of rhinitis symptoms. The differences of asthma effects between boys and girls were statistically significant only at the extreme upper tail of the FeNO distribution (interaction p-value = 0.002 at 0.8). Asthma had consistently larger effects in children with rhinitis symptoms within last 7 days than in children without rhinitis across the various quantiles. Figs 3 and 4 presents a summary of estimated effect of asthma by gender and current rhinitis groups, respectively, across quantiles ranging from 0.10 to 0.90. In both groups, the magnitude differences of FeNO concentrations associated with asthma was smaller in the lower tail of the FeNO distribution, but was considerably larger in the upper tail. The effect of asthma increased steeply as the percentile of interest increased. The rate of increase (effect size vs. percentile) was larger in boys than in girls. A similar pattern was also observed in the comparison between the active rhinitis group and the group without rhinitis symptoms. The race/ethnicity differences of the pattern of increasing asthma effects were not statistically significant (data not shown). The relationship of history of rhinitis symptoms on FeNO across its distribution did not significantly vary by gender and race/ethnicity (data not shown).
Several models were fitted to assess the sensitivity of the results. Excluding subjects reporting ICS use in the past 12 months (N = 43) did not alter the significant effects and increasing trends in the magnitude of effects these determinants, and did not reveal any significant evidence of heterogeneity of effects for any of the other covariates, such as physical activity, BMI and community (data not shown). The analysis excluding subjects with both allergic and infectious rhinitis in the last 1 month (N = 79) showed that the results of non-constant effects of rhinitis symptoms within 7 days before FeNO measurement are very robust (data not shown).
Discussion
Our results provide new insight into the heterogeneity of relationships of asthma, rhinitis, gender and race/ethnicity with FeNO in children. By allowing the effects of determinants to vary depending on the level of FeNO, quantile regression models present a more comprehensive picture of the covariate effects across the entire FeNO distribution. As a result, we identified potentially important insight about variation in the effects of determinants of FeNO across its distribution. As in many previous studies, we found significant difference in FeNO between children with and without asthma. Importantly, these differences varied in magnitude across the FeNO distribution. The effects of asthma were larger at higher FeNO concentrations, especially in boys and in children with rhinitis symptoms within 7 days before FeNO testing. Active rhinitis showed significant larger effects on FeNO at higher concentrations of FeNO. Boys had higher FeNO than girls that increase across FeNO levels. Children of Asian descent had significantly larger increases in the upper tail of the FeNO distribution. These novel insights suggest that the magnitude of effects of several key determinants vary across the full distribution of FeNO concentrations observed in a population. These findings suggest that assessment of asthma status using FeNO may be enhanced by using classification algorithms that account for these heterogeneity of effects, and imply that in clinical care, there is no "one size fits all" cutoff for FeNO and that more personalized reference values for FeNO would be preferable.
Our results extend and complement previous findings. Xu et al found that asthma and allergic rhinitis could increase the FeNO levels in Chinese schoolchildren near 10 years of age [22]. Kalpaklioglu et al also found that rhinitis and asthma are responsible for increased FeNO, irrespective of atopy [23]. Malinovschi et al found that intermediate or high FeNO and blood eosinophil count (B-Eos) values were independently associated with having asthma, wheeze and asthma attacks [24]. We found that the effect of asthma is much stronger in children who already have high FeNO level, especially for boys and children with active rhinitis. Our study also extends the association between FeNO and rhinitis to a more diverse population using a population-based cohort of school children from southern California, increasing the generalizability of the previous finding. The effect of active rhinitis symptoms within last 7 days was not constant but monotonically increases with increasing percentiles of FeNO. This implies that interpretation of FeNO level needs to account for rhinitis symptoms.
The strengths of the current study include the large, population-based study of school children, online FeNO testing, rigorous FeNO data quality control, and a thorough investigation of the effects of determinants on FeNO using a cutting-edge statistical approach.
The results from our study should be interpreted in light of some limitations. The cross sectional nature of the analysis precludes us from assessing the effects on FeNO with adjustments for some long term health confounders and temporal effects. Our covariates were collected based on questionnaire information; this approach might potentially introduce recall bias and misclassification. However, the questionnaire items we employ are widely used in similar studies and treated as standardized core questions to estimate the prevalence of asthma status and current nose symptoms [25]. The relationship between current rhinitis symptoms and FeNO is biologically plausible, because allergic rhinitis is associated with poor asthma control in children [26]. In addition, Malinovschi et al showed that elevated exhaled nitric oxide predicted the onset and prevalence of rhinitis symptoms in an adolescent cohort [27]. The findings in this study may not be generalizable to a clinical population as the study population was pubescent children who were primarily non-Hispanic white and Hispanic children in southern California. Due to the small proportion of the children of Asian descent in study cohort, the robustness of the finding in the no-constant effects of Asian group on FeNO need be further evaluated. The mean FeNO of the children with asthma not receiving inhaled steroid is relatively low implying well controlled asthma of the majority of the asthmatic children of the study. It would be ideal that the information of the Asthma Control Test (ACT), which is not available in CHS cohort, could be evaluated. The lack of puberty information in the study cohort limits our ability to have further understanding of the observed heterogeneity in gender effect on the FeNO. Meanwhile, it is also plausible that hormonal factors may influence FeNO level and as such gender differences we observed could be explained by difference in hormonal milieu between boys and girls. Further studies are warranted to investigate the role of sex steroid hormones and puberty in FeNO.
In summary, application of quantile regression techniques provides new insights into the determinants of FeNO showing substantially varying effects in those with high versus low concentrations. Our findings provide evidence that risk factors associated with FeNO, have different effects across the range of FeNO in children. Incorporating this heterogeneity of effects in interpreting FeNO may result in significant improvement in applications of FeNO. Further research is warranted to explore the variation of determinants effects in other populations and on "extended" (multiple-flow) measurements of FeNO as well as the methods for applying quantile regression to clustered data in the setting of longitudinal studies.
Supporting Information
S1 Table. Distribution of FeNO by Selected Participant Characteristics.
https://doi.org/10.1371/journal.pone.0130505.s001
(DOCX)
S2 Table. Pairwise Tests of the Equality of Covariate Effects across Selected Quantiles.
https://doi.org/10.1371/journal.pone.0130505.s002
(DOCX)
Acknowledgments
We acknowledge the efforts of the study field team and the participation of the study communities, the school principals and the many teachers, students and parents.
Author Contributions
Conceived and designed the experiments: KB FDG. Analyzed the data: YZ. Contributed reagents/materials/analysis tools: YZ. Wrote the paper: YZ KB SPE MTS WSL EBR TMB FDG.
References
- 1. Alving K, Weitzberg E, Lundberg JM (1993) Increased amount of nitric oxide in exhaled air of asthmatics. Eur Respir J 6: 1368–1370. pmid:7507065
- 2. Barnes PJ, Dweik RA, Gelb AF, Gibson PG, George SC, Grasemann H et al. (2010) Exhaled nitric oxide in pulmonary diseases: a comprehensive review. Chest 138: 682–692. pmid:20822990
- 3. Bjermer L, Alving K, Diamant Z, Magnussen H, Pavord I, Piacentini G et al. (2014) Current evidence and future research needs for FeNO measurement in respiratory diseases. Respir Med.
- 4. Pavord ID, Shaw D (2008) The use of exhaled nitric oxide in the management of asthma. J Asthma 45: 523–531. pmid:18773320
- 5. Pedersen S, O'Byrne PM (2008) Exhaled nitric oxide in guideline-based asthma management. Lancet 372: 1015–1017. pmid:18805314
- 6. Ricciardolo FL (2014) Revisiting the role of exhaled nitric oxide in asthma. Curr Opin Pulm Med 20: 53–59. pmid:24275926
- 7. Smith AD, Cowan JO, Brassett KP, Herbison GP, Taylor DR (2005) Use of exhaled nitric oxide measurements to guide treatment in chronic asthma. N Engl J Med 352: 2163–2173. pmid:15914548
- 8. Szefler SJ, Mitchell H, Sorkness CA, Gergen PJ, O'Connor GT, Morgan WJ et al. (2008) Management of asthma based on exhaled nitric oxide in addition to guideline-based treatment for inner-city adolescents and young adults: a randomised controlled trial. Lancet 372: 1065–1072. pmid:18805335
- 9. Kovesi T, Kulka R, Dales R (2008) Exhaled nitric oxide concentration is affected by age, height, and race in healthy 9- to 12-year-old children. Chest 133: 169–175. pmid:17925422
- 10. Levesque MC, Hauswirth DW, Mervin-Blake S, Fernandez CA, Patch KB, Alexander PM et al. (2008) Determinants of exhaled nitric oxide levels in healthy, nonsmoking African American adults. J Allergy Clin Immunol 121: 396–402 e393. pmid:18036642
- 11. Olivieri M, Corradi M, Malerba M (2007) Gender and exhaled nitric oxide. Chest 132: 1410; author reply 1410. pmid:17934135
- 12. Taylor DR, Mandhane P, Greene JM, Hancox RJ, Filsell S, McLanchlan CR et al. (2007) Factors affecting exhaled nitric oxide measurements: the effect of sex. Respir Res 8: 82. pmid:18005450
- 13. Yao TC, Lee WI, Ou LS, Chen LC, Yeh KW, Huang JL et al. (2012) Reference values of exhaled nitric oxide in healthy Asian children aged 5 to 18 years. Eur Respir J 39: 378–384. pmid:21622584
- 14. Van der Valk RJ, Duijts L, Timpson NJ, Salam MT, Standl M, Curtin JA et al. (2013) Fraction of exhaled nitric oxide values in childhood are associated with 17q11.2-q12 and 17q12-q21 variants. J Allergy Clin Immunol.
- 15.
Koenker R (2005) Quantile Regression: Cambridge University Press.
- 16. Koch B, Schaper C, Ewert R, Volzke H, Obst A, Friedrich N et al. (2011) Lung function reference values in different German populations. Respir Med 105: 352–362. pmid:21130637
- 17. Van Sickle D, Magzamen S, Mullahy J (2011) Understanding socioeconomic and racial differences in adult lung function. Am J Respir Crit Care Med 184: 521–527. pmid:21562132
- 18. McConnell R, Berhane K, Yao L, Jerrett M, Lurmann F, Gilliland F et al. (2006) Traffic, susceptibility, and childhood asthma. Environ Health Perspect 114: 766–772. pmid:16675435
- 19. Berhane K, Zhang Y, Salam MT, Eckel SP, Linn WS, Rappaport EB et al. (2014) Longitudinal effects of air pollution on exhaled nitric oxide: the Children's Health Study. Occup Environ Med.
- 20. ATS/ERS recommendations for standardized procedures for the online and offline measurement of exhaled lower respiratory nitric oxide and nasal nitric oxide, 2005. Am J Respir Crit Care Med 171: 912–930. pmid:15817806
- 21. Linn WS, Rappaport EB, Berhane KT, Bastain TM, Avol EL, Gilliland FD. (2009) Exhaled nitric oxide in a population-based study of southern California schoolchildren. Respir Res 10: 28. pmid:19379527
- 22. Xu F, Zou Z, Yan S, Li F, Kan H, Norback D et al. (2011) Fractional exhaled nitric oxide in relation to asthma, allergic rhinitis, and atopic dermatitis in Chinese children. J Asthma 48: 1001–1006. pmid:22029828
- 23. Kalpaklioglu AF, Kalkan IK (2012) Comparison of orally exhaled nitric oxide in allergic versus nonallergic rhinitis. Am J Rhinol Allergy 26: e50–54. pmid:22487277
- 24. Malinovschi A, Fonseca JA, Jacinto T, Alving K, Janson C (2013) Exhaled nitric oxide levels and blood eosinophil counts independently associate with wheeze and asthma events in National Health and Nutrition Examination Survey subjects. J Allergy Clin Immunol 132: 821–827 e825. pmid:23890753
- 25. Ait-Khaled N, Pearce N, Anderson HR, Ellwood P, Montefort S, Shah J et al. (2009) Global map of the prevalence of symptoms of rhinoconjunctivitis in children: The International Study of Asthma and Allergies in Childhood (ISAAC) Phase Three. Allergy 64: 123–148. pmid:19132975
- 26. de Groot EP, Nijkamp A, Duiverman EJ, Brand PL (2012) Allergic rhinitis is associated with poor asthma control in children with asthma. Thorax 67: 582–587. pmid:22213738
- 27. Malinovschi A, Alving K, Kalm-Stephens P, Janson C, Nordvall L (2012) Increased exhaled nitric oxide predicts new-onset rhinitis and persistent rhinitis in adolescents without allergic symptoms. Clin Exp Allergy 42: 433–440. pmid:22356144