http://orcid.org/0000-0003-3944-7072
Figures
Abstract
The diagnostic accuracy of contrast-enhanced ultrasound (CEUS) for distinguishing malignant thyroid nodules from benign thyroid nodules remains controversial. This meta-analysis was performed to evaluate the overall diagnostic value of CEUS for the characterization of thyroid nodules. Relevant studies were identified by searching PubMed, Embase and the Cochrane Library until August 1th 2019 to assess the overall diagnostic accuracy of CEUS. 37 eligible studies were included in the present meta-analysis. The pooled sensitivity, specificity, positive likelihood rate, negative likelihood rate and diagnostic odds ratio of CEUS were 0.87, 0.83, 5.38, 0.17 and 38.94, respectively, with the AUC of 0.9263. Subgroup analysis showed the heterogeneity was greatly reduced in small nodules group (≤ 1 cm) (I2 = 0.0%), while heterogeneity was still observed in the group of variable sizes group (I2 = 69.5%). However, meta-regression analysis revealed that only diagnostic criterion was the major source of heterogeneity (p = 0.0259). The risk of publication bias was negligible (p = 0.35). CEUS exhibited high accuracy for the identification of thyroid nodules and might provide additional perfusion information for the current US imaging reporting systems.
Citation: Zhang J, Zhang X, Meng Y, Chen Y (2020) Contrast-enhanced ultrasound for the differential diagnosis of thyroid nodules: An updated meta-analysis with comprehensive heterogeneity analysis. PLoS ONE 15(4): e0231775. https://doi.org/10.1371/journal.pone.0231775
Editor: Oded Cohen, Kaplan Medical Center, ISRAEL
Received: November 15, 2019; Accepted: March 31, 2020; Published: April 20, 2020
Copyright: © 2020 Zhang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This work was supported by Science and Technology Research Project of Kaifeng City (1503031).
Competing interests: The authors have declared that no competing interests exist.
Introduction
A thyroid nodule, by definition, is a discrete lesion within the thyroid gland, which is radiographically distinct from the surrounding thyroid parenchyma [1]. With the increased utilization of diagnostic imaging (ultrasound (US), computed tomography (CT) or magnetic resonance imaging (MRI)) unrelated to the thyroid, the prevalence of thyroid incidentaloma has been significantly increased in the past twenty years [2,3]. For instance, the proportion of patients with thyroid nodules that clinicians now encounter is as high as 68% of the general population [4]. The major clinical issue in managing thyroid nodules is to maximize the detection of relevant thyroid cancer while reducing unnecessary overdiagnosis and overtreatment [5,6].
Several diagnostic tools have been used to identify nodules. Fine needle aspiration biopsy (FNAB) is widely adopted by clinicians as a simple way of diagnosing thyroid nodules [2]. However, this invasive technique may have false positive or negative outcomes, and about 10% to 20% of thyroid nodules could not be diagnosed [7]. Conventional US is the first-line diagnostic tool for initial cancer risk stratification of thyroid nodules [2,7]. Certain ultrasound features associated with malignancy include solid composition, hypoechogenicity, infiltrative or irregular margins, intranodular blood flow, microcalcification and “taller-than-wide” configuration [7,8]. However, one single ultrasound characteristic has inadequate sensitivity or specificity to identify or rule out malignant tumors. For example, microcalcification has the highest positive predictive value (PPV) among the above ultrasound features, but it has low sensitivity and only exists in 26% to 59% thyroid cancers [9]. In order to increase diagnosis confidence, the American Thyroid Association (ATA), American College of Radiologists (ACR) and other professional groups have proposed several systems to classify nodules by sonographic features and to recommend cutoffs for FNAB [2]. Among them, the thyroid imaging reporting and data system (TI-RADS) is a simple and practical reporting system created by ACR [10]. Horvath [11] and Kwak [12] indicated TI-RADS could be used to improve diagnostic accuracy, reduce unnecessary biopsies and follow-up scans, and ultimately improve management of patients with thyroid nodules. Despite TI-RADS has achieved great clinical value, it still suffers inherent flaws, such as dependence on experience, poor repeatability and high heterogeneity among sonographers [7].
Advances in US technology may facilitate better characterization of benign and malignant thyroid nodules. Contrast-enhanced ultrasound (CEUS) is currently the focus of medical US research, because it can show microvascular blood flow clearly and assess tumor perfusion and vascular distribution in real time after intravenous injection of microbubble contrast agent (CA) [13]. It is well known that the thyroid gland is rich in microvessels, thus the parenchyma of normal thyroid exhibits rapid uniform enhancement after injection of CA [14]. However, the vascular structures of nodules differ from normal tissues, which enhance their differences from normal tissues [14]. Several studies [15,16] revealed specific CEUS enhancement patterns (such as heterogeneous or low enhancement) were related to malignant thyroid nodules (Fig 1). Unfortunately, not all studies confirmed these results [17]. Furthermore, CEUS presents some limitations: the examination is expensive, only one nodule can be evaluated for each injection of CA, and there was no established criterion for the patterns of enhancement and classification of thyroid nodules, resulting in the inability to be widely-used worldwide [14]. Besides, the current thyroid nodule imaging reporting systems, including the widely-used TI-RADS, do not contain CEUS enhancement patterns as the evaluation item [2], making it controversial in clinical practice. Therefore, the present comprehensive meta-analysis was conducted to investigate the value of CEUS for distinguishing malignant thyroid nodules from benign ones, hoping to provide evidence for the new TI-RADS classification system including CEUS features.
(A~C) A 35-year -old man was found to have a solid nodule in the left lobe of his thyroid. (A) The conventional two-dimensional image showed the nodule had three malignant indicators (solid, markedly hypoechoic, and microcalcifications). (B) CEUS image showed high enhancement of the nodule, indicating that the nodule was benign. (C) The pathological result revealed this lesion was a nodular goiter. (D~F) A 42-year-old woman was found to have a solid nodule in her left thyroid lobe. (D) The conventional two-dimensional image showed the nodule had two malignant indicators (solid and irregular margin). (E) CEUS image showed low enhancement of the nodule, indicating that the nodule was malignant. (F) The pathological result revealed this lesion was a thyroid papillary carcinoma [15]. From Zhang et al. (2017) Usefulness of combined use of contrast-enhanced ultrasound and TI-RADS classification for the differentiation of benign from malignant lesions of thyroid nodules. Eur Radiol 27: 1527–1536. doi: 10.1007/s00330-016-4508-y.
Methods
This present meta-analysis was conducted following the PRISMA statement. No institutional review board approval is required, as our study was a systematic review and meta-analysis, thus obtaining consent was exempted for this study.
Literature search
A comprehensive search was undertaken to identify suitable articles from electronic databases (the PubMed, Embase, and Cochrane Library) without an upper-limit date until August 1th, 2019. Searches were performed using the following MeSH heading and key words: “thyroid” and “CEUS or contrast-enhanced ultrasound or contrast-enhanced US or contrast-enhance Doppler ultrasonography or contrast-enhanced ultrasonography”. Additionally, manual retrieval was also performed on references of related reviews.
Eligibility and exclusion criteria
After removing duplicate studies, two authors independently reviewed the titles and abstracts based on the following inclusion and exclusion criteria. (A) inclusion criteria: (1) related to the diagnostic value of CEUS for thyroid nodules; (2) all patients were diagnosed with histopathology as the gold standard; (3) reported data were sufficient to calculate the true-positive (TP), false-negative (FN), false-positive (FP) and true-negative (TN). (B) exclusion criteria: (1) studies not published in English; (2) duplicated publications or incomplete data; (3) reviews, letters, case reports and editorials; (4) studies not performed on human subjects. When two authors’ opinions differed, the disagreements would be resolved by consensus.
Data extraction and quality evaluation
Full texts of eligible studies were screened and data were extracted using a standardized form for the final meta-analysis. The detailed information including first author, publication year, country, specimen, sample size (both lesions and patients), gold standard, diagnostic criterion, type and dosage of contrast agent, TP, FP, TN, FN and any other additional information required for quality evaluation.
The methodological quality of eligible studies was assessed by the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) criteria, which are recommended for diagnostic systematic reviews based on sources of bias and variation.
Statistical analysis
The statistical softwares Meta-Disc (version 1.4, XI Cochrane Colloquium, Barcelona, Spain) and STATA (version 11.0, Stata Corporation, College Station, TX, USA) were used in this meta-analysis. The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and their corresponding 95% confidence intervals (CI) were calculated by certain formulae composed of TP, FP, TN and FN. Besides, the summary receiver operating characteristic (SROC) curve and areas under curve (AUC) were also constructed. The heterogeneity of included studies was investigated using I2 and Q tests. The random-effects model (DerSimonian-Laird method) was used because the heterogeneity was significant in this meta-analysis. Spearman correlation coefficient was calculated to analyze the diagnostic threshold. Subgroup analysis and meta-regression analysis were subsequently performed to assess the variabilities attributed to heterogeneity. Publication bias was investigated by Deeks’ funnel plot analysis. Two-sided statistical tests were performed, with a p value < 0.05 representing statistically significant.
Results
Study selection
Initial electronic search identified 701 records, 311 from PubMed, 381 from Embase and 9 from Cochrane. After automatically and manually removing the duplicates, 448 studies were left for initial screening. Depending on the inclusion and exclusion criteria, 384 studies were excluded. Full texts of the remaining 64 studies were left for further reviewing. Finally, 37 [14–16, 18–51] studies were identified as eligible studies. The search and selection process for this meta-analysis was shown in Fig 2.
Characteristics and quality assessment of the included studies
The basic characteristics of the included 37 studies were summarized in Table 1. The publication year of studies ranged from 2010 to 2019. These studies were from 4 countries, most of them (29 studies) were done in Asia (all from China), the rest 8 were from Europe (5 from Italy, 2 from Germany and 1 from Austria). The average age of all included patients was under 60. The number of lesions varied from 20 to 432, and the number of patients varied from 20 to 370. Most of the malignant lesions were papillary carcinomas, and most of the benign lesions were nodular goiters and adenomas. Most of contrast agents used in the studies were Sonovue, except for two studies that did not mention the specific brand. The dosages of contrast agent ranged from 1 to 5 mL. QUADAS scores were also summarized in Table 1.
The overall diagnostic accuracy
Analysis of CEUS for characterizing thyroid nodules showed that the pooled sensitivity was 0.87 (95%CI: 0.86–0.88), and specificity was 0.83 (95%CI: 0.82–0.85) (Fig 3). The pooled PLR, NLR and DOR were 5.38 (95%CI: 4.28–6.76) and 0.17 (95%CI: 0.14–0.20), 38.94 (95%CI: 27.69–54.75), respectively (S1 Fig). Fig 4 illustrated the SROC curve with AUC to be 0.9263, which was close to 1, indicating CEUS as a useful diagnostic tool to distinguish malignant from benign thyroid nodules. As seen in the forest plots (Fig 3 and S1 Fig), all indices of diagnostic accuracy denoted heterogeneity of the included studies. There was no threshold effect by calculating spearman correlation coefficient (r = -0.093, p = 0.585).
Sensitivity (A) and specificity (B) of CEUS for characterizing thyroid nodules.
Subgroup analysis and meta-regression analysis
Because the DOR is a single estimate which combines the data from sensitivity and specificity, the pooled DOR was calculated to present the diagnostic accuracy. Several potential factors were explored to show their abilities in affecting the diagnostic accuracy. As the results listed in Table 2, region, number of lesions, size of nodules and CA dosage greatly influenced the diagnostic accuracy. DOR of Asian country (all from China) was improved than it from Western countries (45.85 vs. 16.31). Similarly, the higher the number of lesions, the higher the diagnostic efficiency (46.52 vs. 26.65). And DOR of low CA dosage group was higher than them of high CA dosage group and variable dosage group (50.96 vs. 34.71 vs. 34.71). However, great heterogeneity was observed in all above groups (I2 all > 50%). Besides, size of nodules also greatly affected the diagnostic accuracy of included studies (Fig 5). DOR of variable sizes group was higher than small nodules group (41.48 vs. 21.42). However, the heterogeneity was greatly reduced in small nodules group (≤ 1 cm) (I2 = 0.0%), while great heterogeneity was observed in the group of variable sizes of nodules (I2 = 69.5%). Diagnostic accuracy was equivalent according to different diagnostic criterion. When Sonographers characterized the thyroid nodules by visual features (such as heterogeneous enhancement was identified as malignancy), its overall diagnostic accuracy was the same as when using quantitative or semi-quantitative parameters (both DOR were 53.46). However, great heterogeneity was observed in both above groups (both I2 were 64.4%).
Subgroup analysis of DOR for small nodules (A) and variable sizes of nodules (B) in characterization of thyroid nodules.
Meta-regression analysis was also performed to take all the above factors into account. As seen in Table 3, diagnostic criterion was the major source of heterogeneity (p = 0.0259). However, size of nodules was not the source of heterogeneity (p = 0.1084).
Publication bias
A Deeks’ funnel plot was generated to assess the publication bias of the 37 eligible studies. As seen in Fig 6, the plot was symmetric, indicating that there was no potential publication bias for the included studies (p = 0.35).
Discussion
The diagnostic accuracy of CEUS
Early diagnosis and correct identification of thyroid cancer has great importance for clinical treatment regimens and may improve the prognosis [32]. However, differentiating malignancy from benign thyroid nodules remains the challenging dilemma. The combination of several suspicious US characteristics can further improve the diagnostic accuracy than one single US characteristic. A large number of studies have used TI-RADS system to predict malignant thyroid nodules [12,13]. But this system is still limited to different US criterion and inevitable inter-observer variability, making its sensitivity and specificity compromised. CEUS promises to bring additional diagnostic power to this conventional imaging modality with its high sensitivity for detecting the microvascularization of thyroid carcinomas [15]. Zhang [15] and Zhao [18] implied CEUS had complementary effects to the TI-RADS system, which improved the differential diagnosis of thyroid nodules. Jiang [38] also demonstrated CEUS could even provide a basis for determining which nodules should undergo fine needle aspiration (FNA). Whereas, Friedrich-Rust [52] indicated that CEUS did not improve the characterization of thyroid nodules in their preliminary study. Because of these conflicting studies, clinicians are often confused when they choose imaging techniques. Therefore, a comprehensive meta-analysis is in an urgent need to summarize all current results to determine the role of CEUS for characterizing thyroid nodules. Despite Liu et al [53] (search date was May 2018) and Ma et al [54] (search date was December 2013) had published their meta-analyses on this topic, we noticed there were repeated studies included in both researches, which compromised the diagnostic performance. Additionally, significant heterogeneity existed in both studies, but neither of them pursued its source. However, heterogeneity analysis is very important, it is an essential part of systematic review, and it can provide a basis for assessment of diagnostic research. For these reasons, an updated meta-analysis was performed, including more preliminary studies and comprehensive heterogeneity analysis to assess the performance of CEUS in identifying benign and malignant thyroid nodules.
Our results showed that CEUS had high pooled sensitivity and specificity (0.87 and 0.83) with AUC of 0.9263, indicating it could be a considerable tool in the diagnosis of thyroid nodules. Moreover, funnel plot analysis revealed absence of publication bias, which strengthened the validity of the study. However, there was great heterogeneity of included studies, which might compromise the credibility. Thus, subgroup and meta-regression analyses were conducted to reveal potential sources of heterogeneity.
Heterogeneity analysis of this meta-analysis
Subgroup analysis showed great heterogeneity in the variable-sized nodule group (I2 = 69.5%), while the small nodule group (≤1 cm) was significantly reduced (I2 = 0.0%). Unfortunately, meta-regression analysis did not show that nodular size was a source of heterogeneity. Several studies reported that CEUS features were closely related to nodule size [31, 39]. Yuan et al [39] implied in thyroid cancers less than 1 cm in diameter, the hypoenhancement was more common than thyroid cancers with diameters greater than 2 cm. Ma’s [31] research showed that heterogeneous enhancement was an independent predictor for predicting papillary thyroid microcarcinoma (PTMC). In all eligible studies, there were three studies [31, 39, 42] focused on the diagnosis of PTMC from small nodules (≤ 1 cm). Among them, two studies [31, 42] used heterogeneous enhancement as the diagnostic criterion for PTMC, the remaining one [39] considered inhomogeneous perfusion and whole course low enhancement as the diagnostic indicators for PTMC. Due to similar diagnostic criterion, the heterogeneity was greatly reduced in this group (I2 = 0.0%), while great heterogeneity was still observed in the group of variable sizes of nodules (I2 = 64.5%). However, Li [39] demonstrated that CEUS had no significant advantage in characterizing PTMC for the following reasons: firstly, there were overlapped CEUS perfusion features in small malignant and benign nodules; secondly, small malignant tumors might not exhibit typical characteristics of malignancies; thirdly, the instrument sensitivity, adjustments and parameters employed during the process of imaging might fail to meet diagnostic level at present. Similar to the above hypotheses, our subgroup analysis showed relatively lower diagnostic accuracy for small nodules group than variable sizes group (DOR: 24.42 vs. 41.48).
Meta-regression analysis revealed diagnostic criterion was the major factor which contributed to the great heterogeneity. All diagnostic criteria of included studies could be divided into two categories: visual features and quantitative or semi-quantitative parameters. Most of the studies (24 studies) used visual features (perfusion characteristics observed by sonographer observed during the procedure) to differentiate thyroid nodules, which were usually low or weak enhancement pattern, heterogeneous enhancement pattern and ill-defined enhancement border. Because papillary thyroid cancers (PTC) account for the vast majority of thyroid cancers, their characteristics contributed to the main diagnostic criterion. According to these studies, most thyroid cancers showed hypoenhancement due to insufficient blood supply in PTC [8]. The necrosis inside the cancer, blocked blood vessels by cancer embolus, intensive interstitial fibrosis and thyroid peripheral calcification may all lead to the hypoenhancement feature of CEUS in thyroid cancers [27]. While benign nodules (such as nodular goiters and adenomas) usually have enhanced perfusion, homogeneous enhancement and no perfusion defects because of their rich blood supply [30]. Our meta-analysis results showed visual features had favorable ability to identify malignant nodules with DOR of 53.46, however, the heterogeneity of this group was still considerable (I2 = 64.4%). With the introduction of ultrasound software and computer-aided diagnosis (CAD) technology, quantitative or semi-quantitative parameters derived from series of CEUS images are believed to provide more valuable information for blood flow observation than visualization [27]. Commonly used parameters are derived from the time-intensity curve. Zhou [26] showed the nodule-to-perinodule peak intensity ratio had the best diagnostic efficiency for identifying malignant thyroid nodules. Jin [27] utilized the image heterogeneity calculation equation to calculate the heterogeneity values (HVs) and heterogeneity ratios (HRs), which were quantifications of nodular heterogeneity enhancement. And their results revealed the heterogeneity quantifications had lower sensitivity (0.72 vs. 0.83), but higher specificity (0.83 vs. 0.66) and diagnostic accuracy (0.78 vs. 0.74) than visual assessment. Whereas, the parameters used in their studies were quite different from one by one, which might lead to great heterogeneity (I2 = 64.4%) in this group (quantitative or semi-quantitative parameters). Therefore, diagnostic criterion would need further investigation and standardization. Especially, standardized diagnostic parameters need to be determined and validated in the future.
Conclusion
In conclusion, CEUS might be a promising method for identifying the malignancy from benign thyroid nodules. Yet, there is still insufficient evidence that CEUS features can improve the diagnostic accuracy of US imaging reporting systems (such as TI-RADS) at present, our meta-analysis provided the potential for forward-looking, multi-center and large-scale CEUS studies in the future.
Supporting information
S1 Fig.
PLR (A), NLR (B) and DOR (C) of CEUS for characterizing thyroid nodules.
https://doi.org/10.1371/journal.pone.0231775.s002
(TIF)
Acknowledgments
We sincerely thank Mr. Lunshou Wei from the Huaihe Hospital of Henan University (Kaifeng, China), for his support with respect to the drafting of the manuscript.
References
- 1. Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, et al. 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid. 2016; 26: 1–133. pmid:26462967
- 2. Durante C, Grani G, Lamartina L, Filetti S, Mandel SJ, Cooper D. The Diagnosis and Management of Thyroid Nodules: A Review. JAMA. 2018; 319:914–924. pmid:29509871
- 3. Li Q, Lin X, Shao Y, Xiang F, Samir AE. Imaging and Screening of Thyroid Cancer. Radiol Clin North Am. 2017; 55: 1261–1271. pmid:28991565
- 4. Guth S, Theune U, Aberle J, Galach A, Bamberger CM. Very high prevalence of thyroid nodules detected by high frequency (13 MHz) ultrasound examination. Eur J Clin Invest. 2009; 39: 699–706. pmid:19601965
- 5. Tamhane S, Gharib H. Thyroid nodule update on diagnosis and management. Clin Diabetes Endocrinol. 2016; 2: 17. pmid:28702251
- 6. Ozolins A, Narbuts Z, Strumfa I, Volanska G, Gardovskis J. Diagnostic utility of immunohistochemical panel in various thyroid pathologies. Langenbecks Arch Surg. 2010; 395: 885–891. pmid:20640858
- 7. Melany M, Chen S. Thyroid Cancer: Ultrasound Imaging and Fine-Needle Aspiration Biopsy. Endocrinol Metab Clin North Am. 2017; 46: 691–711. pmid:28760234
- 8. Moon HJ, Sung JM, Kim EK, Yoon JH, Youk JH, Kwak JY. Diagnostic performance of gray-scale US and elastography in solid thyroid nodules. Radiology. 2012; 262: 1002–1013. pmid:22357900
- 9. Bastin S, Bolland MJ, Croxson MS. Role of ultrasound in the assessment of nodular thyroid disease. J Med Imaging Radiat Oncol. 2009; 53: 177–187. pmid:19527364
- 10. Tessler FN, Middleton WD, Grant EG, Hoang JK, Berland LL, Teefey SA, et al. ACR Thyroid Imaging, Reporting and Data System (TI-RADS): White Paper of the ACR TI-RADS Committee. J Am Coll Radiol. 2017; 14: 587–595. pmid:28372962
- 11. Horvath E, Majlis S, Rossi R, Franco C, Niedmann JP, Castro A, et al. An ultrasonogram reporting system for thyroid nodules stratifying cancer risk for clinical management. J Clin Endocrinol Metab. 2009; 94: 1748–1751. pmid:19276237
- 12. Kwak JY, Han KH, Yoon JH, Moon HJ, Son EJ, Park SH, et al. Thyroid imaging reporting and data system for US features of nodules: a step in establishing better stratification of cancer risk. Radiology. 2011; 260: 892–989. pmid:21771959
- 13. Greis C. Quantitative evaluation of microvascular blood flow by contrast-enhanced ultrasound (CEUS). Clin Hemorheol Microcirc. 2011; 49: 137–149. pmid:22214685
- 14. Giusti M, Orlandi D, Melle G, Massa B, Silvestri E, Minuto F, et al. Is there a real diagnostic impact of elastosonography and contrast-enhanced ultrasonography in the management of thyroid nodules? J Zhejiang Univ Sci B. 2013; 14: 195–206. pmid:23463762
- 15. Zhang Y, Zhou P, Tian SM, Zhao YF, Li JL, Li L. Usefulness of combined use of contrast-enhanced ultrasound and TI-RADS classification for the differentiation of benign from malignant lesions of thyroid nodules. Eur Radiol. 2017; 27: 1527–1536. pmid:27525973
- 16. Wang Y, Nie F, Liu T, Yang D, Li Q, Li J, et al. Revised Value of Contrast-Enhanced Ultrasound for Solid Hypo-Echoic Thyroid Nodules Graded with the Thyroid Imaging Reporting and Data System. Ultrasound Med Biol. 2018; 44: 930–940. pmid:29472113
- 17. Hu Y, Li P, Jiang S, Li F. Quantitative analysis of suspicious thyroid nodules by contrast-enhanced ultrasonography. Int J Clin Exp Med. 2015; 8: 11786–11793. pmid:26380019
- 18. Zhao H, Liu X, Lei B, Cheng P, Li J, Wu Y, et al. Diagnostic performance of thyroid imaging reporting and data system (TI-RADS) alone and in combination with contrast-enhanced ultrasonography for the characterization of thyroid nodules. Clin Hemorheol Microcirc. 2019; 72: 95–106. pmid:30320563
- 19. Xu Y, Qi X, Zhao X, Ren W, Ding W. Clinical diagnostic value of contrast-enhanced ultrasound and TI-RADS classification for benign and malignant thyroid tumors: One comparative cohort study. Medicine (Baltimore). 2019; 98: e14051.
- 20. He Y, Wang XY, Hu Q, Chen XX, Ling B, Wei HM. Value of Contrast-Enhanced Ultrasound and Acoustic Radiation Force Impulse Imaging for the Differential Diagnosis of Benign and Malignant Thyroid Nodules. Front Pharmacol. 2018; 9: 1363. pmid:30542283
- 21. Tian Q, Zhu H, Li H. Significance of contrast-enhanced ultrasonography in differential diagnosis of thyroid nodules. Medicine (Baltimore). 2018; 97: e12688.
- 22. Wang Y, Nie F, Liu T, Yang D, Li Q, Li J, et al. Revised Value of Contrast-Enhanced Ultrasound for Solid Hypo-Echoic Thyroid Nodules Graded with the Thyroid Imaging Reporting and Data System. Ultrasound Med Biol. 2018; 44: 930–940. pmid:29472113
- 23. Zhang Y, Zhang MB, Luo YK, Li J, Wang ZL, Tang J. The Value of Peripheral Enhancement Pattern for Diagnosing Thyroid Cancer Using Contrast-Enhanced Ultrasound. Int J Endocrinol 2018; 2018: 1625958. pmid:30627155
- 24. Zhao RN, Zhang B, Jiang YX, Yang X, Lai XJ, Zhu SL, et al. Ultrasonographic Multimodality Diagnostic Model of Thyroid Nodules. Ultrason Imaging. 2018; 26: 161734618815070.
- 25. Caresio C, Caballo M, Deandrea M, Garberoglio R, Mormile A, Rossetto R, et al. Quantitative analysis of thyroid tumors vascularity: A comparison between 3-D contrast-enhanced ultrasound and 3-D Power Doppler on benign and malignant thyroid nodules. Med Phys. 2018; 45: 3173–3184. pmid:29763966
- 26. Zhou X, Zhou P, Hu Z, Tian SM, Zhao Y, Liu W, et al. Diagnostic Efficiency of Quantitative Contrast-Enhanced Ultrasound Indicators for Discriminating Benign From Malignant Solid Thyroid Nodules. J Ultrasound Med. 2018; 37: 425–437. pmid:28880412
- 27. Jin L, Xu C, Xie X, Li F, Lv X, Du L. An Algorithm of Image Heterogeneity with Contrast-Enhanced Ultrasound in Differential Diagnosis of Solid Thyroid Nodules. Ultrasound Med Biol. 2017; 43: 104–110. pmid:28029495
- 28. Diao X, Zhan J, Chen L, Chen Y, Liu Y. Quantification of solid hypo-echoic thyroid nodule enhancement with contrast-enhanced ultrasound. Transl Cancer Res. 2017; 6: 1078–1087.
- 29. Li F, Wang Y, Bai B, Wang S, Liu S. Advantages of Routine Ultrasound Combined With Contrast-Enhanced Ultrasound in Diagnosing Papillary Thyroid Carcinoma. Ultrasound Q. 2017; 33: 213–218. pmid:28832401
- 30. Liu MJ, Men YM, Zhang YL, Zhang YX, Liu H. Improvement of diagnostic efficiency in distinguishing the benign and malignant thyroid nodules via conventional ultrasound combined with ultrasound contrast and elastography. Oncol Lett. 2017; 14: 867–871. pmid:28693244
- 31. Ma HJ, Yang JC, Leng ZP, Chang Y, Kang H, Teng LH. Preoperative prediction of papillary thyroid microcarcinoma via multiparameter ultrasound. Acta Radiol. 2017; 58: 1303–1311. pmid:28194993
- 32. Chen M, Zhang KQ, Xu YF, Zhang SM, Cao Y, Sun WQ. Shear wave elastography and contrast-enhanced ultrasonography in the diagnosis of thyroid malignant nodules. Mol Clin Oncol. 2016; 5: 724–730. pmid:28101352
- 33. Zhang Y, Luo YK, Zhang MB, Li J, Li J, Tang J. Diagnostic Accuracy of Contrast-Enhanced Ultrasound Enhancement Patterns for Thyroid Nodules. Med Sci Monit. 2016; 22:4755–4764. pmid:27916971
- 34. Sui X, Liu HJ, Jia HL, Fang QM. Contrast-enhanced ultrasound and real-time elastography in the differential diagnosis of malignant and benign thyroid nodules. Exp Ther Med. 2016; 12: 783–791. pmid:27446276
- 35. Wendl CM, Janke M, Jung W, Stroszczysnski C, Jung EM. Contrast-enhanced ultrasound with perfusion analysis for the identification of malignant and benign tumours of the thyroid gland. Clin Hemorheol Microcirc. 2015; 63: 113–121. pmid:26519225
- 36. Wu Q, Wang Y, Li Y, Hu B, He ZY. Diagnostic value of contrast-enhanced ultrasound in solid thyroid nodules with and without enhancement. Endocrine. 2016; 53: 480–488. pmid:26732040
- 37. Zhang YZ, Xu T, Gong HY, Li CY, Ye XH, Lin HJ, et al. Application of high-resolution ultrasound, real-time elastography, and contrast-enhanced ultrasound in differentiating solid thyroid nodules. Medicine (Baltimore). 2016; 95: e5329.
- 38. Jiang J, Shang X, Wang H, Xu YB, Gao Y, Zhou Q. Diagnostic value of contrast-enhanced ultrasound in thyroid nodules with calcification. Kaohsiung J Med Sci. 2015; 31:138–144. pmid:25744236
- 39. Li F, Zhang J, Wang Y, Liu L. Clinical value of elasticity imaging and contrast-enhanced ultrasound in the diagnosis of papillary thyroid microcarcinoma. Oncol Lett. 2015; 10:1371–1377. pmid:26622676
- 40. Yuan Z, Quan J, Yunxiao Z, Jian C, Zhu H. Contrast-enhanced ultrasound in the diagnosis of solitary thyroid nodules. J Cancer Res Ther. 2015; 11: 41–45. pmid:25879334
- 41. Schleder S, Janke M, Agha A, Schacherer D, Hornung M, Schlitt HJ, et al. Preoperative differentiation of thyroid adenomas and thyroid carcinomas using high resolution contrast-enhanced ultrasound (CEUS). Clin Hemorheol Microcirc. 2015; 61:13–22. pmid:24898562
- 42. Zhao RN, Zhang B, Yang X, Jiang YX, Lai XJ, Zhang XY. Logistic Regression Analysis of Contrast-Enhanced Ultrasound and Conventional Ultrasound Characteristics of Sub-centimeter Thyroid Nodules. Ultrasound Med Biol. 2015; 41: 3102–3108. pmid:26423183
- 43. Liang XN, Guo RJ, Li S, Zheng ZM, Liang HD. Binary logistic regression analysis of solid thyroid nodules imaged by high-frequency ultrasonography, acoustic radiation force impulse, and contrast-enhanced ultrasonography. Eur Rev Med Pharmacol Sci. 2014; 18: 3601–3610. pmid:25535129
- 44. Giusti M, Campomenosi C, Gay S, Massa B, Silvestri E, Monti E, et al. The use of semi-quantitative ultrasound elastosonography in combination with conventional ultrasonography and contrast-enhanced ultrasonography in the assessment of malignancy risk of thyroid nodules with indeterminate cytology. Thyroid Res. 2014; 7: 9. pmid:25506397
- 45. Jiang J, Shang X, Zhang H, Ma W, Xu Y, Zhou Q, et al. Correlation between maximum intensity and microvessel density for differentiation of malignant from benign thyroid nodules on contrast-enhanced sonography. J Ultrasound Med. 2014; 33: 1257–1263. pmid:24958412
- 46. Deng J, Zhou P, Tian SM, Zhang L, Li JL, Qian Y. Comparison of diagnostic efficacy of contrast-enhanced ultrasound, acoustic radiation force impulse imaging, and their combined use in differentiating focal solid thyroid nodules. PLoS One. 2014; 9:e90674. pmid:24594879
- 47. Ma JJ, Ding H, Xu BH, Xu C, Song LJ, Huang BJ, et al. Diagnostic performances of various gray-scale, color Doppler, and contrast-enhanced ultrasonography findings in predicting malignant thyroid nodules. Thyroid. 2014; 24: 355–363. pmid:23978252
- 48. Cantisani V, Consorti F, Guerrisi A, Guerrisi I, Ricci P, Di Segni M, et al. Prospective comparative evaluation of quantitative-elastosonography (Q-elastography) and contrast-enhanced ultrasound for the evaluation of thyroid nodules: preliminary experience. Eur J Radiol. 2013; 82: 1892–1898. pmid:23928231
- 49. Acharya UR, Vinitha Sree S, Krishnan MM, Molinari F, Garberoglio R, Suri JS. Non-invasive automated 3D thyroid lesion classification in ultrasound: a class of ThyroScan™ systems. Ultrasonics. 2012; 52:508–520. pmid:22154208
- 50. Nemec U, Nemec SF, Novotny C, Weber M, Czerny C, Krestan CR. Quantitative evaluation of contrast-enhanced ultrasound after intravenous administration of a microbubble contrast agent for differentiation of benign and malignant thyroid nodules: assessment of diagnostic accuracy. Eur Radiol. 2012; 22: 1357–1365. pmid:22322310
- 51. Zhang B, Jiang YX, Liu JB, Yang M, Dai Q, Zhu QL, et al. Utility of contrast-enhanced ultrasound for evaluation of thyroid nodules. Thyroid. 2010; 20:51–57. pmid:20067379
- 52. Friedrich-Rust M, Sperber A, Holzer K, Diener J, Grünwald F, Badenhoop K, et al. Real-time elastography and contrast-enhanced ultrasound for the assessment of thyroid nodules. Exp Clin Endocrinol Diabetes. 2010; 118: 602–609. pmid:19856256
- 53. Liu Q, Cheng J, Li J, Gao X, Li H. The diagnostic accuracy of contrast-enhanced ultrasound for the differentiation of benign and malignant thyroid nodules: A PRISMA compliant meta-analysis. Medicine (Baltimore). 2018; 97: e13325.
- 54. Ma X, Zhang B, Ling W, Liu R, Jia H, Zhu F, et al. Contrast-enhanced sonography for the identification of benign and malignant thyroid nodules: Systematic review and meta-analysis. J Clin Ultrasound. 2016; 44:199–209. pmid:26402325