http://orcid.org/0000-0001-9614-5199
Figures
Abstract
Objective
To estimate cut-off points and to establish response criteria for the Hospital Universitario La Princesa Index (HUPI) in patients with chronic polyarthritis.
Methods
Two cohorts, one of early arthritis (Princesa Early Arthritis Register Longitudinal [PEARL] study) and other of long-term rheumatoid arthritis (Estudio de la Morbilidad y Expresión Clínica de la Artritis Reumatoide [EMECAR]) including altogether 1200 patients were used to determine cut-off values for remission, and for low, moderate and high activity through receiver operating curve (ROC) analysis. The areas under ROC (AUC) were compared to those of validated indexes (SDAI, CDAI, DAS28). ROC analysis was also applied to establish minimal and relevant clinical improvement for HUPI.
Results
The best cut-off points for HUPI are 2, 5 and 9, classifying RA activity as remission if ≤2, low disease activity if >2 and ≤5), moderate if >5 and <9 and high if ≥9. HUPI’s AUC to discriminate between low-moderate activity was 0.909 and between moderate-high activity 0.887. DAS28’s AUCs were 0.887 and 0.846, respectively; both indices had higher accuracy than SDAI (AUCs: 0.832 and 0.756) and CDAI (AUCs: 0.789 and 0.728). HUPI discriminates remission better than DAS28-ESR in early arthritis, but similarly to SDAI. The HUPI cut-off for minimal clinical improvement was established at 2 and for relevant clinical improvement at 4. Response criteria were established based on these cut-off values.
Citation: González-Álvaro I, Castrejón I, Ortiz AM, Toledano E, Castañeda S, García-Vadillo A, et al. (2016) Cut-Offs and Response Criteria for the Hospital Universitario La Princesa Index (HUPI) and Their Comparison to Widely-Used Indices of Disease Activity in Rheumatoid Arthritis. PLoS ONE 11(9): e0161727. https://doi.org/10.1371/journal.pone.0161727
Editor: Xu-jie Zhou, Peking University First Hospital, CHINA
Received: April 23, 2016; Accepted: August 10, 2016; Published: September 7, 2016
Copyright: © 2016 González-Álvaro et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data regarding PEARL cohort are within the paper and its Supporting Information files. Data from EMECAR cohort belong to the Sociedad Española de Reumatología (SER). Researchers interested on gaining access to these data please contact with the Research Unit of SER at proyectos@ser.es.
Funding: Support was provided by grants RD12/0009/0017 and PI14/00442 to IG-A from the Ministerio de Economia y Competitividad (Instituto de Salud Carlos III) and co-funded by Fondo Europeo de Desarrollo Regional (FEDER). The EMECAR study was funded by the Spanish Society of Rheumatology, the Spanish Foundation of Rheumatology, and by an independent research grant from Aventis. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: IG-A received support from unrestricted research projects funded by BMS, Roche and UCB; paid consulting and delivering of presentations for Abbvie, BMS, Lilly, Pfizer, Roche and UCB. IG-A and AMO are co-inventors of the patent “Prognostic method for autoimmune disorders through genotyping Vasoactive Intestinal Peptide variants” with International Application PCT/ES2015/070182 having a positive international search report. SC has received education support, travel grants, consultancy fees, honoraria for clinical trials and speakers' fees from the following pharmaceutical companies: Abbvie, Amgen, Bristol Myers Squibb, Celgene, Gebro Pharma, Lilly, MSD, Pfizer and Roche. In the last 5 years, S. Castañeda has also been supported by an unrestricted research grant from Pfizer. IC, ET, AG-V and LC have no conflict of interest in relation with the present study. This does not alter the authors' adherence to PLOS ONE policies on sharing data and materials.
Introduction
The treat to target (T2T) strategy has improved the outcome of rheumatoid arthritis (RA) and therefore has been included in established RA guidelines [1,2]. In relation to this strategy, there is substantial agreement on considering remission, or low disease activity, as the therapeutic objective for most patients with RA [1,2]. However, DAS28 and SDAI, the most widely-used indices for defining these targets, have several biases that may interfere with their accuracy [3–6]. DAS28 has the additional inconvenient that its values differ when it is calculated with either erytrosedimentation rate (ESR) or C-reactive protein (CRP) [7,8]. Furthermore, both DAS28 and SDAI have a gender bias derived from the larger number of tender joints and of ESR values in women compared to men [5,9,10]. To overcome these issues, we developed the Hospital Universitario La Princesa Index (HUPI), an index for the assessment of disease activity in chronic polyarthritis that includes the same domains as in DAS28 and SDAI but corrected by gender and easier to calculate than the DAS28 (Table 1) [6]. Moreover, it can be calculated with either CRP, or ESR or both. Fig 1 shows how the interchangeability of values is better with HUPI than with DAS28. This may be of special interest in observational studies to avoid missing data. HUPI has demonstrated high accuracy, feasibility and sensitivity to change, even superior to those of DAS28 and SDAI [6]. However, to be useful both in daily clinical practice and clinical trials it is necessary to define cut-off points that allow establishing different levels of disease activity, as well as response criteria, such as those based on DAS28 [11].
Data are shown as percent of visits with a given difference between calculated scores: A) DAS28 calculated with ESR (DAS28_ESR) minus DAS28 calculated with CRP (DAS28_CRP), B) HUPI calculated with ESR (HUPI_ESR) minus HUPI calculated with CRP (HUPI_CRP), C) HUPI calculated with both acute phase reactants (HUPI) minus HUPI_ESR, and D) HUPI minus HUPI_CRP. Vertical red lines show the percent of visits where the scores from both pairs was equal (Δ = 0). In the case of DAS28 a difference of ±0.25 was considered equal to null.
The objectives of this study were 1) to establish cut-off points for HUPI able to discriminate between activity levels both in early arthritis and in long-term RA populations; 2) to establish response criteria based on HUPI; and 3) to compare the accuracy and discriminant ability to that of widely-used indices.
Methods
Patients
This is a validation study with repeated measures for which we used data obtained from two cohorts. HUPI was developed and validated in a mixed population of early RA and undifferentiated arthritis (UA) patients, the Princesa Early Arthritis Register Longitudinal study (PEARL) cohort [6], which we now use also to define cut-offs. In order to determine whether HUPI and its cut-offs are valid in long-term RA we added the data from the Estudio de la Morbilidad y Expresión Clínica de la Artritis Reumatoide (EMECAR) cohort [12].
The research carried out in PEARL and EMECAR is in compliance with Helsinki Declaration. The Ethics Committee for Clinical Research at Hospital Universitario de La Princesa reviewed and approved both protocols, and all patients included in both studies signed an informed consent form.
The Princesa Early Arthritis Register Longitudinal (PEARL) cohort
PEARL includes patients recruited from the early arthritis clinic of Hospital Universitario La Princesa, Madrid (Spain). Patients with a suspicion of arthritis of less than a year since symptom onset are referred to this clinic. Patients diagnosed with gout, septic or viral arthritis, osteoarthritis, spondyloarthropathies or connective tissue diseases during the first 2 years of follow-up are excluded from the cohort. Therefore, for this specific analysis, only patients fulfilling the 1987 ACR RA criteria [13] or with chronic undifferentiated arthritis (UA) were included. The clinical protocol includes five visits during a follow-up period of 5 years (baseline, 6, 12, 24 and 60 months) in which demographic, clinical, therapeutic, and laboratory data as well as biologic samples are collected. With the information collected it is possible to estimate the value of the following disease activity indexes: DAS28-ESR [14], DAS28-CRP (calculated as described in http://www.das-score.nl), SDAI [15], CDAI [15] and HUPI [6]. More detailed information about the protocol has been described previously [16].
The EMECAR cohort
EMECAR was a prospective longitudinal cohort of prevalent RA patients selected by random sampling in 34 Rheumatology Units from Spain. The follow-up took place from November 1999 to December 2004. EMECAR database includes the required information to calculate DAS28-ESR, DAS28-CRP and HUPI, but not SDAI or CDAI since global disease assessment by physician was not collected. Remission was defined in EMECAR by the Pinal’s criteria [17]. A more detailed description of the EMECAR cohort has been published previously [12].
Definition of low, moderate and high disease activity
We used two definitions, depending on the cohort.
Low, moderate and high disease activity levels were established in a subset of PEARL as previously reported [18]. Six experienced rheumatologists (AMO, ET, IC, SC, AG-V and IG-A) categorized the level of disease activity into low-moderate-high at each visit based on the following information: 28 tender and swollen joint counts, global disease assessment by patient in a 0 to 100 mm scale, Health Assessment Questionnaire, ESR, and CRP. The assessment was retrospective and therefore, the physicians could not physically examine the patients. In addition, they were blinded to the global disease assessment by physician obtained on a 0 to 10 visual analog scale at each visit.
In EMECAR, low, moderate and high disease activity level were defined by the DAS28-ESR classical cut-offs (2.6, 3.2 and 5.1) [14].
Criteria to define remission
Considering that at present there is no definitive consensus on a best definition for remission and the differences in data collection at the two cohorts, we used 4 operational definitions to estimate this cut-off point for HUPI: 1) by the consensus of the 6 experienced rheumatologists in the subpopulation of PEARL; 2) by the ACR/EULAR remission criteria according to SDAI (<3.3); 3) by the ACR/EULAR remission criteria according to Boolean criteria [19]; and by the criteria by Pinals et al [17].
Estimation of cut-off points
Receiver operating characteristic (ROC) analysis was performed using the “roctab” command of Stata 12.1® for Windows (StataCorp LP, College Station, TX, USA). Each cut-off point was selected on the basis of the best trade-off values between sensitivity and specificity. ROC curves were also obtained with the “roctab” command of Stata, using the “graph” option. To estimate whether the differences in the area under the curve (AUC) between the indices were statistically significant, we used the Stata “roccomp” command that provides a test for the equality of the AUCs using an algorithm described by DeLong et al.[20]. Statistical significance was accepted if the p value was lower than 0.05.
Estimation of minimal and relevant clinical improvement for HUPI
PEARL patients whose ΔDAS28-ESR between baseline and 6 months follow-up visits was ≥0.6 were considered to experience, at least, a minimal clinical improvement. Those patients whose ΔDAS28-ESR was ≥1.2 were considered to experience a relevant clinical improvement.
The best value for minimal or relevant clinical improvement for HUPI was selected on the basis of the best trade-off values between sensitivity and specificity from the respective ROC curves as described above for cut-off points to separate disease activity levels.
Results
Patients’ characteristics
We studied data from 1547 visits of 403 patients included in PEARL study and 2880 visits belonging to 789 patients from EMECAR. Since the former is an early arthritis register and the later a prevalent RA cohort, patients from PEARL study were on average 6 years younger than EMECAR patients (Table 2). Accordingly, at baseline, disease duration was longer in EMECAR patients but slightly higher disease activity was observed in patients from PEARL study (Table 2), since these patients were untreated at baseline visit whereas EMECAR patients were under treatment when enrolled at the cohort. Table 2 also shows the number of visits in which the patients were at remission, low, moderate or high disease activity (defined by DAS28-ESR cut-off points: 2.6, 3.2, 5.1).
Cut-off points for low/moderate and moderate/high disease activity
The best threshold value of the HUPI to discriminate between low and moderate disease activity was 5 (Table 3). As it is shown in Fig 2 (upper panels), there were no significant differences between area under ROC curves of HUPI and the two versions of DAS28. However, the AUC of HUPI was significantly greater than those of SDAI (p = 0.0002) and CDAI (p<0.0001). Likewise, both DAS28 versions (ESR and CRP) showed higher ROC curves areas than SDAI and CDAI (p<0.0001).
Receiver operating curves were plot using the “roctab” command of STATA, with the option graph. Data obtained from the PEARL cohort. The best cut-off point to discriminate between moderate and high disease activity was 9 (Table 3). The AUC of HUPI was systematically larger than those from the other indices (Fig 1 lower panels), although differences were only significant with SDAI (p = 0.0004) and CDAI (p = 0.0001).
Remission cut-off point for HUPI
Table 4 summarizes the best cut-off points for remission considering the different populations and definitions described under Methods. In view of all these results, we decided to choose 2 as cut-off for remission in HUPI.
In order to determine whether HUPI is more accurate than DAS28 or SDAI for estimating remission, we compared DAS28 and HUPI in EMECAR and PEARL with all previous definitions and SDAI and HUPI in PEARL with rheumatologist assessment and Boolean based ACR/EULAR remission criteria. As it is shown in Fig 3, HUPI is, depending on definition of remission, as accurate as DAS28 (A and B panels) or significantly superior (ACR/EULAR remission definitions at C and D panels). HUPI was significantly better than SDAI when using the classification of remission by experienced rheumatologists (Fig 3A) but worse than SDAI when using the 2011 Boolean definition of remission (Fig 3C).
A) Remission defined by rheumatologist consensus in PEARL population. B) Remission defined by Pinals criteria in EMECAR population. C) Remission defined by ACR/EULAR boolean criteria in PEARL population. D) Remission defined by ACR/EULAR SDAI<3.3 criteria in PEARL population. Receiver operating curves were plot using the “roccomp” command of STATA, with the option graph. This command also tests the equality of ROC areas.
Fig 4A shows how cut-off points to define remission, low, moderate and high disease activity are distributed along the range of values of DAS28, SDAI and HUPI. Interestingly, the distribution of the cut-off points on the HUPI is more homogeneous in HUPI than in the other scales.
A) Comparison of cut-off points’ distribution along HUPI, DAS28 and SDAI’s range of values. B) Response criteria using HUPI based on its cut-off values for low, moderate and high disease, as well as minimal and relevant improvements. The black box means that in no case the HUPI can be ≥9 if the improvement in HUPI score is ≥4.
Response criteria using HUPI
A minimal clinical improvement in HUPI, corresponding to a 0.6 point improvement in DAS28, was 2 (Sensitivity [Se] 73%, Specificity [Sp] 84%; Positive likelihood ratio [LR+] 3.15, LR- 0.21). A relevant clinical improvement in HUPI, corresponding to a 1.2 points improvement in DAS28, was 4 (Se 65%, Sp 90%; LR+ 6.22, LR– 0.39). Considering the cut-off points and the estimation for relevant improvement for HUPI, Fig 4B shows how to classify the response into none, moderate or good by using the HUPI.
Discussion
The assessment of disease activity in RA through composite indexes, such as DAS28 or SDAI, has been a cornerstone in clinical research, translational research and daily clinical practice. However, several concerns affect both indexes: a difficult calculation of DAS28, gender bias, left skewed distribution of their values leading to low sensitivity to change, especially with SDAI [4–6,21]. All these problems led us to develop HUPI, with the hope that it could be useful in clinical and translational research and probably in daily clinical practice since it is easy to calculate without calculator. However, to be useful in the current T2T strategies we needed specific cut-off values to determine the common targets (clinical remission or low disease activity) accepted at present, and this study has established them.
In addition, the present study suggests that HUPI is more accurate than SDAI to discriminate low-moderate disease activity. This is an important landmark of HUPI since this level of activity is commonly used to prescribe biological therapy [1,2] as well as to initiate tapering of kind of treatment [22].
Furthermore, depending on the definition, HUPI discriminates clinical remission better than DAS28. This may be due to the fact that HUPI corrects for gender and for extreme values, both accepted as interfering with the definition of remission [23].
One of the main limitations of this study is the absence of real gold standards for evaluating disease activity. This was the reason leading to the use of several definitions of remission and different ways of defining low, moderate and high disease activity either in PEARL and EMECAR. Nevertheless, the results in both populations were quite concordant, which is reassuring on the validity of the HUPI. Another limitation of HUPI is that it may suffer from a ceiling effect in patients with very high disease activity. It is possible that in clinical trials in which such kind of patients is preferentially included sensitivity to change might be more difficult to demonstrate.
We are aware that implementation of HUPI will be difficult since DAS28 and SDAI are deeply accepted by rheumatologists. However, we provide this information convinced that HUPI will be useful to scientists involved in RA clinical and translational research. It would be especially interesting when needing complex multivariable analysis since HUPI suffers from less biases than DAS28 and SDAI and its values show a normal distribution.
Finally, further validation of the index, its cut-offs and response criteria will be needed in different cohorts, either in early and long term RA populations, as well as in patients with very high disease activity from clinical trials. Of special interest will be to study whether HUPI or current validated indexes explain better radiological progression or biological processes.
In summary, we have estimated the most adequate cut-offs for the HUPI to define levels of activity in RA (low-moderate-high and remission), which are stable in early and long-term populations, and found that HUPI is at least as good as widely established indices.
Supporting Information
S1 File. Data from PEARL study used in this article are provided.
https://doi.org/10.1371/journal.pone.0161727.s001
(XLS)
Acknowledgments
We are grateful to the generous collaboration of patients from both cohorts. We also acknowledge the permission of the Sociedad Española de Reumatología for allowing the use of EMECAR data, as well as to the colleagues listed in the Appendix for EMECAR Study group.
Contributors
Members of the EMECAR study group are:
Abasolo Alcazar L, Hospital Clínico Universitario San Carlos, Madrid. Spain
Alegre de Miguel C, Hospital de Malalties Reumatiques, Barcelona. Spain
Andreu Sánchez JL, Clínica Puerta de Hierro, Majadahonda. Spain
Aragón Díez A, Hospital Nuestra Señora del Prado, Toledo. Spain
Balsa Criado A, Hospital La Paz, Madrid. Spain
Batlle Gualda E, Hospital General Universitario, Alicante. Spain
Belmonte Serrano MA, Hospital General, Castellón. Spain
Beltrán Audera J, Hospital Clínico Universitario, Zaragoza. Spain
Beltrán Fabregat J, Hospital General, Castellón. Spain
Bonilla Hernan G, Hospital La Paz, Madrid. Spain
Carmona Ortells L, InMusc, Madrid. Spain
Caro Fernández N, Hospital Nuestra Señora del Prado, Toledo. Spain
Casado E, Hospital Universitario Germans Trias i Pujol, Badalona. Spain
Cebrian Mendez L, Hospital Gregorio Marañón, Madrid. Spain
Corteguera Coro M, Hospital Nuestra Señora de Sonsoles, Avila. Spain
Cuadra Díaz JL, Hospital Nuestra Señora del Carmen, Ciudad Real. Spain
Cuesta E, Hospital Virgen de La Luz, Cuenca. Spain
Fiter Aresté J, Hospital Son Dureta, Palma de Mallorca. Spain
Freire Gonzalez M, Hospital Gregorio Marañón, Madrid. Spain
Galindo Izquierdo M, Hospital 12 de Octubre, Madrid. Spain
García Meijide JA, Hospital Clínico Universitario, Santiago de Compostela. Spain
García Gómez MC, Hospital de Bellvitge Princeps D'Espanya, L’Hospitalet de Llobregat. Spain
Giménez Ubeda E, Hospital Clínico Universitario, Zaragoza. Spain
Gómez Centeno E, Hospital Clinic i Provincial, Barcelona. Spain
Gómez Vaquero C, Hospital de Bellvitge Princeps D'Espanya, L’Hospitalet de Llobregat. Spain
González Fernández MJ, Hospital de Malalties Reumatiques, Barcelona. Spain
González Gómez ML, Hospital Gregorio Marañón, Madrid. Spain
González Hernández T, Instituto Provincial de Rehabilitación, Madrid. Spain
González-Alvaro I, Hospital de la Princesa, Madrid. Spain
González-Montagut Gómez C, Hospital Virgen de La Luz, Cuenca. Spain
Grandal Delgado Y, Hospital General, Jerez de La Frontera. Spain
Gratacos Masmitja J, Complejo Hospitalario del Parc Tauli, Sabadell. Spain
Hernández del Río A, Hospital Juan Canalejo, La Coruña. Spain
Instxaurbe AR, Hospital de Basurto, Bilbao. Spain
Irigoyen Oyarzabal MV, Hospital General Carlos Haya, Malaga. Spain
Jiménez Palop M, Hospital Nuestra Señora de Sonsoles, Avila. Spain
Juan Mas A, Hospital Son Llatzer, Palma de Mallorca. Spain
Júdez Navarro E, Hospital Clínico Universitario San Carlos, Madrid. Spain
Larrosa Padro M, Complejo Hospitalario del Parc Tauli, Sabadell. Spain
López Longo FJ, Hospital Gregorio Marañón, Madrid. Spain
Loza Santamaria E, Hospital Clínico Universitario San Carlos, Madrid. Spain
Maese Manzano J, Fundación Española de Reumatología, Madrid. Spain
Manero Ruiz FJ, Hospital Clínico Universitario, Zaragoza. Spain
Mateo Bernardo I, Hospital 12 de Octubre, Madrid. Spain
Mayordomo González L, Hospital Universitario de Valme, Sevilla. Madrid
Mazzucheli R, Hospital Fundación Alcorcón, Alcorcón. Spain
Medrano San Idelfonso M, Hospital Clínico Universitario, Zaragoza. Spain
Naranjo Hernández A, Hospital de Gran Canaria Dr. Negrín, Las Palmas de Gran Canaria. Spain
Pecondón Español A, Hospital Clínico Universitario, Zaragoza. Spain
Peiró Callizo E, Hospital Virgen de La Luz, Cuenca. Spain
Quirós Donate J, Hospital Fundación Alcorcón, Alcorcón. Spain
Ramos López P, Hospital Príncipe de Asturias, Alcalá de Henares. Spain
Rivera Redondo J, Instituto Provincial de Rehabilitación, Madrid. Spain
Rodríguez Gómez M, Complejo Hospitalario Cristal-Piñor, Orense. Spain
Rodríguez López M, Hospital Arquitecto Marcide, Lugo. Spain
Roselló Pardo R, Hospital General San Jorge, Huesca. Spain
Sampedro Alvarez J, Hospital Virgen de La Salud, Toledo. Spain
Sanmartí Sala R, Hospital Clinic i Provincial, Barcelona. Spain
Santos Rey Rey J, Hospital Virgen de La Salud, Toledo. Spain
Tena Marsá X, Hospital Universitario Germans Trias i Pujol, Badalona. Spain
Tenorio Martín M, Hospital del Insalud,Ceuta. Spain
Torres Martín MC, Hospital Nuestra Señora de Sonsoles, Avila. Spain
Ureña Garnica I, Hospital General Carlos Haya, Malaga. Spain
Valdazo de Diego JP, Hospital General Virgen de La Concha, Zamora. Spain
Valls M, Hospital Universitario Germans Trias i Pujol, Badalona. Spain
Villaverde García V, Hospital La Paz, Madrid. Spain
Zarco Montejo P, Hospital Fundación Alcorcón, Alcorcón. Spain
Zubieta Tabernero J, Hospital Virgen de La Salud, Toledo. Spain
Author Contributions
- Conceptualization: IG-A IC LC.
- Data curation: IG-A AMO LC.
- Formal analysis: IG-A LC.
- Funding acquisition: IG-A.
- Investigation: IG-A LC AMO ET SC AG-V EMECAR.
- Visualization: IG-A IC AMO ET SC AG-V LC.
- Writing – original draft: IG-A.
- Writing – review & editing: IG-A IC AMO ET SC AG-V LC.
References
- 1. Smolen JS, Landewe R, Breedveld FC, Buch M, Burmester G, Dougados M, et al. (2014) EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2013 update. Ann Rheum Dis 73: 492–509. pmid:24161836
- 2. Sanmarti R, Garcia-Rodriguez S, Alvaro-Gracia JM, Andreu JL, Balsa A, Caliz R, et al. (2015) 2014 update of the Consensus Statement of the Spanish Society of Rheumatology on the use of biological therapies in rheumatoid arthritis. Reumatol Clin 11: 279–294. pmid:26051464
- 3. Sokka T, Toloza S, Cutolo M, Kautiainen H, Makinen H, Gogus F, et al. (2009) Women, men, and rheumatoid arthritis: analyses of disease activity, disease characteristics, and treatments in the QUEST-RA Study. Arthritis Res Ther 11: R7. pmid:19144159
- 4. Ahlmen M, Svensson B, Albertsson K, Forslind K, Hafstrom I (2010) Influence of gender on assessments of disease activity and function in early rheumatoid arthritis in relation to radiographic joint damage. Ann Rheum Dis 69: 230–233. pmid:19158113
- 5. Castrejón Fernández I, Martínez-López J, Ortiz García A, Carmona Ortells L, García-Vicuña R, Gonzalez-Alvaro I (2010) Influencia del género en la respuesta al tratamiento en una cohorte de pacientes con artritis reumatoide precoz del área 2 de la Comunidad de Madrid. Reumatol Clin 6: 134–140.
- 6. Castrejon I, Carmona L, Ortiz AM, Belmonte MA, Martinez-Lopez JA, Gonzalez-Alvaro I (2013) Development and validation of a new disease activity index as a numerical sum of four variables in patients with early arthritis. Arthritis Care Res (Hoboken) 65: 518–525.
- 7. Inoue E, Yamanaka H, Hara M, Tomatsu T, Kamatani N (2007) Comparison of Disease Activity Score (DAS)28- erythrocyte sedimentation rate and DAS28- C-reactive protein threshold values. Ann Rheum Dis 66: 407–409. pmid:16926186
- 8. Castrejon I, Ortiz AM, Garcia-Vicuna R, Lopez-Bote JP, Humbria A, Carmona L, et al. (2008) Are the C-reactive protein values and erythrocyte sedimentation rate equivalent when estimating the 28-joint disease activity score in rheumatoid arthritis? Clin Exp Rheumatol 26: 769–775. pmid:19032807
- 9. Hallert E, Thyberg I, Hass U, Skargren E, Skogh T (2003) Comparison between women and men with recent onset rheumatoid arthritis of disease activity and functional ability over two years (the TIRA project). Ann Rheum Dis 62: 667–670. pmid:12810432
- 10. Leeb BF, Haindl PM, Maktari A, Nothnagl T, Rintelen B (2007) Disease activity score-28 values differ considerably depending on patient's pain perception and sex. J Rheumatol 34: 2382–2387. pmid:17985407
- 11. van Gestel AM, Haagsma CJ, van Riel PL (1998) Validation of rheumatoid arthritis improvement criteria that include simplified joint counts. Arthritis Rheum 41: 1845–1850. pmid:9778226
- 12. Gonzalez-Alvaro I, Descalzo MA, Carmona L (2008) Trends towards an improved disease state in rheumatoid arthritis over time: influence of new therapies and changes in management approach: analysis of the EMECAR cohort. Arthritis Res Ther 10: R138. pmid:19036152
- 13. Arnett FC, Edworthy SM, Bloch DA, McShane DJ, Fries JF, Cooper NS, et al. (1988) The American Rheumatism Association 1987 revised criteria for the classification of rheumatoid arthritis. Arthritis Rheum 31: 315–324. pmid:3358796
- 14. Prevoo ML, van 't Hof MA, Kuper HH, van Leeuwen MA, van de Putte LB, van Riel PL (1995) Modified disease activity scores that include twenty-eight-joint counts. Development and validation in a prospective longitudinal study of patients with rheumatoid arthritis. Arthritis Rheum 38: 44–48. pmid:7818570
- 15. Aletaha D, Smolen J (2005) The Simplified Disease Activity Index (SDAI) and the Clinical Disease Activity Index (CDAI): a review of their usefulness and validity in rheumatoid arthritis. Clin Exp Rheumatol 23: S100–108. pmid:16273793
- 16. Gonzalez-Alvaro I, Ortiz AM, Alvaro-Gracia JM, Castaneda S, Diaz-Sanchez B, Cavajal I, et al. (2011) Interleukin 15 levels in serum may predict a severe disease course in patients with early arthritis. PLoS One 6: e29492. pmid:22242124
- 17. Pinals RS, Masi AT, Larsen RA (1981) Preliminary criteria for clinical remission in rheumatoid arthritis. Arthritis Rheum 24: 1308–1315. pmid:7306232
- 18. Castrejon I, Ortiz AM, Toledano E, Castaneda S, Garcia-Vadillo A, Patino E, et al. (2010) Estimated Cutoff Points for the 28-Joint Disease Activity Score Based o,n C-reactive Protein in a Longitudinal Register of Early Arthritis. J Rheumatol 37: 1439–1443. pmid:20472931
- 19. Felson DT, Smolen JS, Wells G, Zhang B, van Tuyl LH, Funovist J, et al. (2011) American College of Rheumatology/European League Against Rheumatism provisional definition of remission in rheumatoid arthritis for clinical trials. Arthritis Rheum 63: 573–586. pmid:21294106
- 20. DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44: 837–845. pmid:3203132
- 21. Radovits BJ, Fransen J, van Riel PL, Laan RF (2008) Influence of age and gender on the 28-joint Disease Activity Score (DAS28) in rheumatoid arthritis. Ann Rheum Dis 67: 1127–1131. pmid:17965425
- 22. Gonzalez-Alvaro I, Martinez-Fernandez C, Dorantes-Calderon B, Garcia-Vicuna R, Hernandez-Cruz B, Herrero-Ambrosio A, et al. (2015) Spanish Rheumatology Society and Hospital Pharmacy Society Consensus on recommendations for biologics optimization in patients with rheumatoid arthritis, ankylosing spondylitis and psoriatic arthritis. Rheumatology (Oxford) 54: 1200–1209.
- 23. Saleem B, Nizam S, Emery P (2006) Can remission be maintained with or without further drug therapy in rheumatoid arthritis? Clin Exp Rheumatol 24: S-33–36.