Figures
Abstract
Background and Aims
Noninvasive models have been developed for fibrosis assessment in patients with chronic hepatitis B. However, the sensitivity, specificity and diagnostic accuracy in evaluating liver fibrosis of these methods have not been validated and compared in the same group of patients. The aim of this study was to verify the diagnostic performance and reproducibility of ten reported noninvasive models in a large cohort of Asian CHB patients.
Methods
The diagnostic performance of ten noninvasive models (HALF index, FibroScan, S index, Zeng model, Youyi model, Hui model, APAG, APRI, FIB-4 and FibroTest) was assessed against the liver histology by ROC curve analysis in CHB patients. The reproducibility of the ten models were evaluated by recalculating the diagnostic values at the given cut-off values defined by the original studies.
Results
Six models (HALF index, FibroScan, Zeng model, Youyi model, S index and FibroTest) had AUROCs higher than 0.70 in predicting any fibrosis stage and 2 of them had best diagnostic performance with AUROCs to predict F≥2, F≥3 and F4 being 0.83, 0.89 and 0.89 for HALF index, 0.82, 0.87 and 0.87 for FibroScan, respectively. Four models (HALF index, FibroScan, Zeng model and Youyi model) showed good diagnostic values at given cut-offs.
Citation: Cheng J, Hou J, Ding H, Chen G, Xie Q, Wang Y, et al. (2015) Validation of Ten Noninvasive Diagnostic Models for Prediction of Liver Fibrosis in Patients with Chronic Hepatitis B. PLoS ONE 10(12): e0144425. https://doi.org/10.1371/journal.pone.0144425
Editor: Seung Up Kim, Yonsei University College of Medicine, REPUBLIC OF KOREA
Received: August 1, 2015; Accepted: November 18, 2015; Published: December 28, 2015
Copyright: © 2015 Cheng et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: JYC received the funding from Wang Bao-En Liver Fibrosis Fund (an unrestricted grant from China Foundation for Hepatitis Prevention and Control, ChiCTR-DCS-07000039), Major Science and Technology Special Project of China Twelfth Five-year Plan (2012ZX10002003) and Key Project from Beijing Municipal Science and Technology Commission (Z09050700940902, D121100003912002, D121100003912003) in study design and data collection.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: CHB, chronic hepatitis B; LSM, liver stiffness measurement; AUROC, area under receiver operating characteristic curve; CI, confidence interval; MS, maximum sum of sensitivity and specificity; Sen, sensitivity, Spe, specificity; AC, accuracy; PPV, positive predictive value; NPV, negative predictive value; LR+, positive likelihood ratio; LR-, negative likelihood ratio; ULN, upper limit of normal
Introduction
Chronic hepatitis B (CHB) is a major global health problem, which can lead to cirrhosis, decompensation and hepatocellular carcinoma (HCC). The recent guidelines[1] on the management of CHB have proposed that the presence of significant fibrosis and cirrhosis are indication for treatment and close monitoring for complications of portal hypertension and development of HCC. Therefore, assessment of liver fibrosis in patients with CHB is of paramount importance to predict disease progression, determine the optimal timing and evaluate the efficacy of antiviral therapy.
At present, liver biopsy remains the gold standard for assessing liver fibrosis. However, liver biopsy is an invasive procedure with a potential risk of complications, especially in those with advanced fibrosis and cirrhosis, and its diagnostic accuracy is compromised by sampling error as well as interobserver variations[2–4].
Therefore, noninvasive methods for assessing liver fibrosis have been the focus of translational research. Noninvasive models such as aspartate aminotransferase (AST)-to-platelet ratio index (APRI)[5], FibroTest[6], FibroScan[7], Zeng model[8] and so on, comprising various biochemical and clinical parameters have been derived from patients with CHB, CHC and alcoholic liver disease. Most of these studies reported good values in AUROC analysis but have not been externally validated and compared in the same group patients. Therefore, in the present study we validated the diagnostic performance and evaluated the reproducibility of these forementioned models against liver histology in a big cohort of Chinese patients with CHB.
Methods
Patients
Between September 2007 and April 2009, patients with CHB who underwent a percutaneous liver biopsy at the seven hospitals (Beijing Friendship Hospital, Beijing; Beijing Youan Hospital, Beijing; 302 Hospital of the Chinese People's Liberation Army, Beijing; Nanfang Hospital, Guangzhou; Ruijin Hospital, Shanghai; Renji Hospital, Shanghai; Southwest Hospital, Chongqing) who met the following criteria were recruited into this study. (I) Age between 18 and 65 years; (II) hepatitis B surface antigen (HBsAg) positive for longer than 6 months; (III) at least two weeks off-therapy of biofendate or biocyclol before enrollment; (IV) written informed consent. Exclusion criteria included: (I) white blood cell count <3.5×109/L, or platelet count <80×109/L, or prothrombin index <60%; (II) evidence of a co-infection with hepatitis C; (III) evidence of any other acquired or inherited liver disease; (IV) a history of decompensated cirrhosis defined as jaundice in the presence of cirrhosis, ascites, bleeding gastric or esophageal varices or encephalopathy; (V) a history of malignancies including hepatocellular carcinoma; (VI) lactation; (VII) body mass index (BMI) > 28 kg/m2; (VIII) cardiac pacemaker or defibrillator carrier; (IX) unhealed wound in right upper quadrant.
All patients wrote informed consent before inclusion. This study was approved by ethics committee of principle investigator, i.e. Beijing Friendship Hospital, for all the participating centers in 2007, in accordance with the guidelines of the 1975 Declaration of Helsinki.
Liver Histology
Needle liver biopsy specimens were obtained with a 16-gauge needle under ultrasound guidance. To be considered as adequate for scoring, the liver biopsies had to measure at least 10mm and contain 8 portal tracts. All the liver biopsy specimens were routinely processed by formalin fixation, paraffin-embedding, and sectioned at 5μm thickness, and then stained with Masson Trichrome and reticulin staining for histological assessment. All specimens were assessed by two independent pathologists blinded to patient clinical and laboratory characteristics. Fibrosis was scored on a 5-point scale according to the METAVIR scoring system[2, 9]: F0, no fibrosis; F1, portal fibrosis without septa; F2, portal fibrosis with few septa; F3, numerous septa without cirrhosis; F4, cirrhosis. Discordant cases were reviewed by both pathologists together to reach consensus.
Liver Stiffness Measurement
Liver stiffness measurement (LSM) were performed using the FibroScan® medical device (Echosens, Paris, France). LSM was performed by well-trained operators on the same day as liver biopsy. The procedure was based on at least ten validated measurements. The success rate was calculated as the number of measurements. The median value, expressed in kilopascals (kPa), was considered representative of the liver stiffness value. The liver stiffness value was considered reliable only if at least 10 successful acquisitions were obtained, the overall success rate was ≥ 60%, and the interquartile range over median value of liver stiffness was ≤ 30%.
Sample collection
Blood samples were collected in evacuated tubes (Monovette 02.1063, Sarstedt, Germany), allowed to clot for 30 min at room temperature and centrifuged at 1600g for 15 min at 4°C. Sera were frozen at -80°C within 2 h after collection.
Biochemical Measurements
Enzyme activities (U/L) were measured in each hospital by a Modular P800 automatic analyzer using standard methods (Roche Diagnostics, Mannheim, Germany): alanine aminotransferase (ALT: female <34, male <45), aspartate aminotransferase (AST: female <31, male <35), alkaline phosphatase (ALP: female 35–104, male 40–129), gamma-glutamyltransferase (GGT: female <38, male <55). Serum albumin (normal range 35–52 g/L) was routinely measured immunonephelometrically using the Modular P 800 (Roche Diagnostics, Mannheim, Germany). 8mL additional serum and 3mL plasma were taken around the same time (stored at -80°C) and send to a central laboratory (302 Hospital of the Chinese People's Liberation Army) for fibrosis markers analysis. Haptoglobin (HPT), alpha2-macroglobulin (α2-M) and apolipoprotein A (apoA1) were measured with immunoturbidimetry (Beckman Coultery, USA). PIIINP and hyaluronic Acid (HA) were measured with chemiluminescence immunoassay (Xiamen Lujia Biotechnology Company reagents, China), and TIMP-1 and TGFβ1 were measured with ELISA (R&D Systems reagents, USA).
Noninvasive models
Up to October 2013, there are serval published noninvasive models for assessing liver fibrosis. Most of them are derived from CHC patients, including APRI[5], FibroTest[6] and FIB-4[10], which are the most well validated noninvasive models. Fourteen models derived from CHB patients including Zeng model, Hui model, HALF index, S index, Youyi model, APAG, FibroScore, Cirrhosis Score (CS), Compensated Cirrhosis Index (CCI), Cirrhosis Index (CI), Mohamadnejad model, SPRI and ASPRI [8, 11–21]. In the fourteen models, seven models were excluded for the follow reasons: (i) incomplete ultrasound information (SPRI, ASPRI, CCI and CI were excluded), (ii) inequal lower detection limit of HBV-DNA (Mohamadnejad model was excluded), (iii) patients less than 150 in training group (CS and FibroScore were excluded). Therefore, seven CHB models and three well-validated CHC models were evaluated in this study, including APRI, FibroTest, FIB-4, FibroScan, Zeng model, Hui model, HALF index, S index, Youyi model and APAG. The scores were calculated directly by the instrument employing the equations according to the original articles which are listed in Table 1.
Statistical Analysis
The diagnostic performance of each noninvasive model was assessed using receiver operating characteristic curves (ROC). The areas under the ROC curves (AUROC) as well as 95% confidential interval (CI) of AUROC were calculated. AUROC values for different diagnostic criteria for the same data set were compared with the De Long method [22], using Medcalc Software version 12.2.1.0 (Medcalc, Mariakerke, Belgium). A P-value < 0.05 was considered statistically significant.
To evaluate the reproducibility of these models, we recalculated their diagnostic values (Sen, Spe, PPV, NPV, positive likelihood ratios (LR+) and negative likelihood ratios (LR-) at the given cut-off values defined by the original studies [5–8, 10–15]. Statistical analysis was performed by SPSS software version 17.0 (SPSS, Chicago, IL, USA).
Results
Patient characteristics
From September 2007 to April 2009, we included 624 CHB patients for this study. Of these, 138 patients were excluded base on exclusion criteria, and 27 patients were excluded because of the incomplete serum analysis data. So, 459 patients who met the eligibility criteria were used as study subjects for the following analysis, as shown in Fig 1.
459 subjects were finally recruited for analysis.
Patient characteristics are summarized in Table 2. The median BMI was 22.0 kg/m2. The median PLT was 168.0×109/L. The median ALT and AST level were 50.4 U/L and 36.0 U/L, respectively. Patient distribution for METAVIR and Ishak fibrosis stage was as follows: F0, n = 37; F1, n = 142; F2, n = 145; F3, n = 65; F4, n = 70. The values of ten noninvasive models were significant increased in patients with significant fibrosis (F2/F3/F4) vs the patients with no significant fibrosis (F0/F1), as shown in Table 3.
Diagnostic performance of noninvasive models in comparison with liver biopsy
Diagnostic performances of the noninvasive models were evaluated by AUROCs determined for the whole population according to their histology fibrosis stages, which were shown in Table 4. For significant fibrosis (≥F2), the AUROCs of HALF index, Zeng model, FibroScan, Youyi model, S index and FibroTest were varies from 0.70 to 0.90, while the AUROCs of Hui model, APAG, APRI and FIB-4 were less than 0.70 (Fig 2A). For advanced fibrosis (Fig 2B) and cirrhosis (Fig 2C), the AUROCs of all models were better than 0.70, except APRI.
The ROC curves of respective noninvasive models had been compared with each other using the Delong method (S1 Fig and S1 Table). HALF index and FibroScan showed significantly better performances for diagnosis of significant fibrosis, advanced fibrosis and cirrhosis than any other serum models (all P<0.05). The accuracy of FibroScan and HALF index for prediction of ≥F2, ≥F3 and F4 was statistically equivalent to each other (P = 0.25 for ≥F2, P = 0.30 for ≥F3, P = 0.45 for F4).
The AUROCs for F≥2, F≥3 and F4 of HALF index, FibroScan, Zeng model, Youyi model, S index and FibroTest were consistently better than 0.70, so the six noninvasive models were selected for further evaluation.
Evaluation the reproducibility of the six noninvasive models
The given cutoff values for each model obtained from the original articles[6–8, 12–14] were listed in Table 5. For FibroScan, the diagnostic accuracy for F≥2, F≥3 and F4 were 73%, 84% and 88% respectively, which were similar to the values of original article[7] (76%, 90% and 94% for F2, F3 and F4), indicating FibroScan has a good reproducibility to predict fibrosis stage in CHB patients. The diagnostic accuracy of Youyi model were 65%, 71% and 77% with the given cutoff values in this study, similar to the values of original article[14] (79%, 82% and 77% for F2, F3 and F4). Since low cutoffs were originally described to rule out significant fibrosis, attention must be paid to NPV. The NPV for HALF index was 100% with cutoff value < 2.22, higher than the one in original article[12] (NPV 94.7%). While high cutoffs were described to confirm significant fibrosis, attention should be paid to PPV. The PPV for HALF index was 95% which was similar to the one in original article[12] (PPV 100%). These results demonstrated that HALF index has a good reproducibility. Compared to the original article[8] (NPV 86.1% at value <3.0, PPV 91.1% at value >8.7), Zeng model also has a good reproducibility. Whereas the NPV of S index in this study with low cutoff value (less than 0.1) was only 56%, less than the one of the original article[13] (NPV 65.57%). The NPV of FibroTest was 59% at the cutoff value 0.1 in this study compared with 100% in the original article[6], which means the reproducibility of FibroTest is not good enough.
Discussion
In this study, we compared and verified ten noninvasive fibrosis evaluation models in diagnostic performance and reproducibility in the same group of CHB patients. Among the ten models, there are six models (HALF index, FibroScan, Zeng model, Youyi model, S index and FibroTest) consistently show an AUROC over 0.70 in diagnosing significant fibrosis, advanced fibrosis and cirrhosis, especially HALF index and FibroScan have a much better accuracy in diagnosing any stage of liver fibrosis. Four models, HALF index, FibroScan, Zeng model and Youyi model, have a much better reproducibility than the other six models.
The first important finding of this study was that models containing of imaging techniques or direct serum markers (the HALF index, FibroScan, Zeng model, and Youyi model) had better diagnostic values for CHB patients than those only containing of indirect serum markers (the S index, Hui model, APAG, APRI and FIB-4), which was similar to the previous validation studies[13, 23]. Secondly, noninvasive models derived from CHC are not useful tools to assess liver fibrosis in patients with CHB because of the different pathogenesis and histology progression of fibrosis between CHB and CHC. Thirdly, LSM alone showed similar diagnostic performance to the complex models that combine LSM and other serum parameters (such as HALF index).
This study had two unique features. The first one is that most noninvasive models derived from CHB only validated in an internal validation cohort from the same population with the training cohort or validated in a single-center external cohort[23], while our study validated ten reported noninvasive models (seven derived from CHB patients and three from CHC patients) in a large multicenter cohort from different parts of China. The large number and geographic diversity of patients played a key role in validating the reproducibility. The other is that we recruited patients who underwent not only blood tests but also LSM, and this allowed us to compare the diagnostic performance of these two major categories of noninvasive diagnostic modalities in Asian populations with CHB[24–26].
This study did have some limitations. Firstly, we recruited only patients with liver biopsy specimens at least 1 cm in length and 8 complete portal tracts, which could satisfy the primary assessment of liver fibrosis, but still not fulfill the more stringent criterion recommended by the guideline of AASLD[3]. Secondly, in our study 39% patients had fibrosis stage < F2, and less patients (15%) had cirrhosis, which may lead to a selection bias. Thirdly, since patients enrolled from 7 different hospitals, FibroScan was performed by the different operator and potentially subject to interobserver variability. To reduce this interobserver variability, we setup standard operating procedures for FibroScan when designing the experiments, and all the operators had been trained together before this study. Finally, this is a cross-sectional study. Whether these models can be used to assess treatment response and long term clinical outcome in CHB patients still needs prospective cohort study.
In conclusion, in a big cohort of CHB patients we found that six noninvasive models including HALF index, FibroScan, Zeng model, Youyi model, S index and FibroTest had a good diagnosis accuracy and four of them (HALF index, FibroScan, Zeng model and Youyi model) had a good reproducibility for evaluating liver fibrosis in CHB patients.
Supporting Information
S1 Fig. AUROC of ten noninvasive models in the diagnosis of significant fibrosis (F2-4), advanced fibrosis (F3-4), and cirrhosis (F4).
https://doi.org/10.1371/journal.pone.0144425.s003
(TIF)
S1 Table. AUROC of respective models was compared with each other and the P values was listed.
https://doi.org/10.1371/journal.pone.0144425.s004
(DOCX)
Acknowledgments
We thank the following contributors to the study for their active support: Hong You, Yuanyuan Kong (Beijing Friendship Hospital), Yongpeng Chen (Hepatology Department, Nanfang Hospital of Southern Medical University), Chunlei Fan (Gastroenterology and Hepatology Department, Beijing Youan Hospital), Shao Qing (Diagnosis and Treatment Center of Liver Fibrosis, 302 Military Hospital of China), Yan Zhuang (Infectious Diseases Department, Ruijin Hospital of Shanghai), Zedong Xiang (Infectious Diseases Department, Southwest Hospital of Third Military Medical University), Yiming Mao (Gastroenterology Department, Renji Hospital of Shanghai), Yuanli Mao and Boan Li (Clinical Test Center, 302 Military Hospital of China).
Author Contributions
Conceived and designed the experiments: JDJ HM JLH HGD GFC QX YMW MDZ. Performed the experiments: HM XJO JLH HGD GFC QX YMW MDZ. Analyzed the data: JYC HM. Contributed reagents/materials/analysis tools: JDJ HM JLH HGD GFC QX YMW MDZ. Wrote the paper: JYC HM JDJ.
References
- 1. EASL clinical practice guidelines: Management of chronic hepatitis B virus infection. J Hepatol 2012;57:167–185. pmid:22436845
- 2. Intraobserver and interobserver variations in liver biopsy interpretation in patients with chronic hepatitis C. The French METAVIR Cooperative Study Group. Hepatology 1994;20:15–20. pmid:8020885
- 3. Rockey DC, Caldwell SH, Goodman ZD, Nelson RC, Smith AD. Liver biopsy. Hepatology 2009;49:1017–1044. pmid:19243014
- 4. Cheng JY, Wang TL, Zhao XY, Shi XY, Hu DD, Ma H. [Analysis of liver specimen quality using 280 specimens obtained by routine puncture biopsy]. Chin J Hepatol 2014;22:231–232.
- 5. Wai CT, Greenson JK, Fontana RJ, Kalbfleisch JD, Marrero JA, Conjeevaram HS, et al. A simple noninvasive index can predict both significant fibrosis and cirrhosis in patients with chronic hepatitis C. Hepatology 2003;38:518–526. pmid:12883497
- 6. Imbert-Bismut F, Ratziu V, Pieroni L, Charlotte F, Benhamou Y, Poynard T. Biochemical markers of liver fibrosis in patients with hepatitis C virus infection: a prospective study. Lancet 2001;357:1069–1075. pmid:11297957
- 7. Marcellin P, Ziol M, Bedossa P, Douvin C, Poupon R, de Ledinghen V, et al. Non-invasive assessment of liver fibrosis by stiffness measurement in patients with chronic hepatitis B. Liver Int 2009;29:242–247. pmid:18637064
- 8. Zeng MD, Lu LG, Mao YM, Qiu DK, Li JQ, Wan MB, et al. Prediction of significant fibrosis in HBeAg-positive patients with chronic hepatitis B by a noninvasive model. Hepatology 2005;42:1437–1445. pmid:16317674
- 9. Bedossa P, Poynard T. An algorithm for the grading of activity in chronic hepatitis C. The METAVIR Cooperative Study Group. Hepatology 1996;24:289–293. pmid:8690394
- 10. Sterling RK, Lissen E, Clumeck N, Sola R, Correa MC, Montaner J, et al. Development of a simple noninvasive index to predict significant fibrosis in patients with HIV/HCV coinfection. Hepatology 2006; 43(6): 1317–1325. pmid:16729309
- 11. Hui AY, Chan HL, Wong VW, Liew CT, Chim AM, Chan FK, et al. Identification of chronic hepatitis B patients without significant liver fibrosis by a simple noninvasive predictive model. Am J Gastroenterol 2005;100:616–623. pmid:15743360
- 12. Lee HJ, Seo YS, Kim DJ, Kang HS, An H, Kim JH, et al. Application of the HALF index obviates the need for liver biopsy in half of all patients with chronic hepatitis B. J Gastroenterol Hepatol 2011;26:987–995. pmid:21198828
- 13. Zhou K, Gao CF, Zhao YP, Liu HL, Zheng RD, Xian JC, et al. Simpler score of routine laboratory tests predicts liver fibrosis in patients with chronic hepatitis B. J Gastroenterol Hepatol 2010;25:1569–1577. pmid:20796157
- 14. Zhang WS, Wang BE, Wang TL, Ou XJ, Chen Y, Li Q, et al. [Noninvasive assessment of liver fibrosis in chronic hepatitis B using a predictive model]. Chin J Hepatol 2006;14:169–173.
- 15. Wu SD, Liu LL, Li L, Zhu XY, Wang JY. Development and Validation of Noninvasive Models to Predict Significant Fibrosis in Patients with Chronic Hepatitis B. Chin J Dig 2010;30:478–480.
- 16. Liu WP, Xu DJ, Zhao LR, Lu ZH, Wang YH, Lang ZW, et al. [The prediction and validation of liver fibrosis by a noninvasive model and validation in patients with chronic hepatitis B]. Zhonghua Nei Ke Za Zhi 2008;47:308–312. pmid:18843956
- 17. Park SH, Kim DJ, Cheong JY, Cho SW, Hwang SG, Lee YJ, et al. Noninvasive markers to diagnose cirrhosis in patients with HBeAg positive chronic hepatitis: Do new biomarkers improve the accuracy. Clin Biochem 2010;43:877–881. pmid:20433821
- 18. Chen YP, Dai L, Wang JL, Zhu YF, Feng XR, Hou JL. Model consisting of ultrasonographic and simple blood indexes accurately identify compensated hepatitis B cirrhosis. J Gastroenterol Hepatol 2008;23:1228–1234. pmid:18637057
- 19. Tu XL, Xiao YQ, Chen F, Chen JL, Chen HY. A noninvasive model to predict histological liver cirrhosis in patients with chronic hepatitis B. Chin J Hepatol 2009;17:28–32.
- 20. Mohamadnejad M, Montazeri G, Fazlollahi A, Zamani F, Nasiri J, Nobakht H, et al. Noninvasive markers of liver fibrosis and inflammation in chronic hepatitis B-virus related liver disease. Am J Gastroenterol 2006;101:2537–2545. pmid:17029616
- 21. Kim BK, Kim SA, Park YN, Cheong JY, Kim HS, Park JY, et al. Noninvasive models to predict liver cirrhosis in patients with chronic hepatitis B. Liver Int 2007;27:969–976. pmid:17696936
- 22. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988;44:837–845. pmid:3203132
- 23. Wu SD, Wang JY, Li L. Staging of liver fibrosis in chronic hepatitis B patients with a composite predictive model: a comparative study. World J Gastroenterol 2010;16:501–507. pmid:20101779
- 24. Kim BK, Kim SU, Kim HS, Park JY, Ahn SH, Chon CY, et al. Prospective validation of FibroTest in comparison with liver stiffness for predicting liver fibrosis in Asian subjects with chronic hepatitis B. PLoS One 2012;7:e35825. pmid:22536445
- 25. Chen XB, Zhu X, Chen LY, Chen EQ, Tang H. Accuracy of FibroScan for the diagnosis of liver fibrosis influenced by serum alanine aminotransferase levels in patients with chronic hepatitis B. Chin J Hepatol 2011;19:286–290.
- 26. Friedrich-Rust M, Rosenberg W, Parkes J, Herrmann E, Zeuzem S, Sarrazin C. Comparison of ELF, FibroTest and FibroScan for the non-invasive assessment of liver fibrosis. BMC Gastroenterol 2010;10:103. pmid:20828377