Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Logistic regression analysis of conventional ultrasonography, strain elastosonography, and contrast-enhanced ultrasound characteristics for the differentiation of benign and malignant thyroid nodules

  • Tiantian Pang ,

    Contributed equally to this work with: Tiantian Pang, Leidan Huang

    Roles Methodology, Project administration, Writing – original draft

    Affiliations Health Science Center, Shenzhen University, Shenzhen 518060, China, School of Biomedical Engineering, Shenzhen University, Shenzhen 518060, China, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Shenzhen 518060, China, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen 518060, China

  • Leidan Huang ,

    Contributed equally to this work with: Tiantian Pang, Leidan Huang

    Roles Writing – review & editing

    Affiliations Department of Ultrasound, First Affiliated Hospital of Shenzhen University, Second People’s Hospital of Shenzhen, Shenzhen 518035, China, Guangzhou Medical University, Guangzhou 510182, China

  • Yingyuan Deng,

    Roles Data curation

    Affiliation Department of Ultrasound, First Affiliated Hospital of Shenzhen University, Second People’s Hospital of Shenzhen, Shenzhen 518035, China

  • Tianfu Wang,

    Roles Supervision

    Affiliations Health Science Center, Shenzhen University, Shenzhen 518060, China, School of Biomedical Engineering, Shenzhen University, Shenzhen 518060, China, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Shenzhen 518060, China, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen 518060, China

  • Siping Chen,

    Roles Supervision

    Affiliations Health Science Center, Shenzhen University, Shenzhen 518060, China, School of Biomedical Engineering, Shenzhen University, Shenzhen 518060, China, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Shenzhen 518060, China, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen 518060, China

  • Xuehao Gong ,

    Roles Conceptualization, Funding acquisition

    fox_gxh@sina.com (XHG); wxliu@szu.edu.cn (WXL)

    Affiliation Department of Ultrasound, First Affiliated Hospital of Shenzhen University, Second People’s Hospital of Shenzhen, Shenzhen 518035, China

  • Weixiang Liu

    Roles Funding acquisition, Methodology

    fox_gxh@sina.com (XHG); wxliu@szu.edu.cn (WXL)

    Affiliations Health Science Center, Shenzhen University, Shenzhen 518060, China, School of Biomedical Engineering, Shenzhen University, Shenzhen 518060, China, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Shenzhen 518060, China, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen 518060, China

Abstract

The aim of the study is to screen the significant sonographic features by logistic regression analysis and fit a model to diagnose thyroid nodules. A total of 525 pathological thyroid nodules were retrospectively analyzed. All the nodules underwent conventional ultrasonography (US), strain elastosonography (SE), and contrast -enhanced ultrasound (CEUS). Those nodules’ 12 suspicious sonographic features were used to assess thyroid nodules. The significant features of diagnosing thyroid nodules were picked out by logistic regression analysis. All variables that were statistically related to diagnosis of thyroid nodules, at a level of p < 0.05 were embodied in a logistic regression analysis model. The significant features in the logistic regression model of diagnosing thyroid nodules were calcification, suspected cervical lymph node metastasis, hypoenhancement pattern, margin, shape, vascularity, posterior acoustic, echogenicity, and elastography score. According to the results of logistic regression analysis, the formula that could predict whether or not thyroid nodules are malignant was established. The area under the receiver operating curve (ROC) was 0.930 and the sensitivity, specificity, accuracy, positive predictive value, and negative predictive value were 83.77%, 89.56%, 87.05%, 86.04%, and 87.79% respectively.

Introduction

In clinical practice, thyroid nodules have a high incidence. The incidence in the general population is approximately 4%-7% by palpation. With widespread use of high frequency ultrasonography (US), the prevalence of thyroid has risen to 67% [1]. The most thyroid nodules are benign, while less than 10% are malignant [2, 3]. Therefore, the differentiation of benign and malignant thyroid nodules is full of challenges. There are various malignant sonographic features but lack of consistent criterion. Some scholars have proposed the concept of Thyroid Imaging Reporting and Data system (TI-RADS) which refers to the Breast Imaging Reporting and Data system (BI-RADS) [3]. Horvath et al. first proposed TI-RADS in 2009 which defined 6 categories based on 10 sonographic features, including shape, orientation, echogenicity, echo structure, acoustic transmission, borders, surface, presence or absence of a capsule, calcifications, and vascularization. Park et al. established TI-RADS and developed 5 categories based on sonographic features. The study indicated that characteristics such as taller-than-wide shape, a not circumscribed margin, solid composition, homogeneous echotexture, marked hypoechogenecity, hypoechogenecity, presence of microcalcification, absence of a perinodular halo, and presence of an adjacent abnormal lymph node predicted a malignant classification [4]. Strain elastography (SE) is a new dynamic technology to evaluate the elasticity of tissue qualitatively by exerting external force. The hard tissue is less distortion than the soft in the same situation. Different degree of distortion is used to examine the hardness of tissue. Based on the fact that malignant thyroid nodules are harder than benign, SE is used to distinguish benign and malignant nodules [5, 6]. CEUS is a technique that infuses micro-bubble to blood capillary which is smaller than erythrocyte. Due to the ultrasound scattering effect produced by blood capillary, it can estimate the blood perfusion features of thyroid nodules to evaluate the angiogenesis situation [7]. Accuracy of diagnosis for thyroid nodules can be increased by combining CEUS and conventional US [8].

Relevant published articles are consistent with the finding that irregular margin, ill-defined border, taller-than-wide shape, hypoechogenicity or marked hypoechogenicity, microcalcification and so on are the US suspicious features of malignant thyroid nodules [9]. Up to now, various studies performed TI-RADS to differentiate benign and malignant thyroid nodules and identify whether it has a good diagnostic performance of thyroid lesions or not. However, the existing studies have not covered elastography and angiography parameters. Based on the previous researches, this study intends to establish a model and to evaluate the fitted model’s diagnostic performance in the determination of thyroid lesions by logistic regression in 12 clinical sonographic features from US, SE, and CEUS.

Materials and methods

Patients

The ethics committee of Shenzhen Second People’s Hospital approved this study. Written consent was obtained from all the patients. We retrospectively reviewed database (S1 Data) of 525 thyroid nodules from 525 patients (average age of 44 ± 11 years; 129 male and 396 female) who underwent conventional US, SE, and CEUS from March 2014 to December 2016. All the thyroid nodules were pathologically proven.

Sonographic examinations and characteristics

S2000 US scanner (Siemens Medical Solutions, Mountain View, CA, USA) equipped with 9L4 transducer (bandwidth frequency of 4–9 MHz) and acoustic radiation force impulse (ARFI) software was used to perform the sonographic examinations. The conventional US, SE, and CEUS examinations were performed by one radiologist with at least 10 years of experience. Patients were kept in a supine position with the neck fully exposed. All the sonographic images were review by 2 radiologists with 10-year experience in thyroid blindly. When discrepancy occurred, agreement was reached after discussion.

Firstly, all the patients underwent conventional US, involving B mode US and color Doppler US. Conventional US features include: margin, border, shape, echogenicity, calcification, posterior acoustic, peripheral acoustic halo, capsule of thyroid, vascularity, and suspected cervical lymph node metastasis. Margin was categorized as regular or irregular. Border was classified as well-defined (obvious boundaries between the nodule and surrounding thyroid parenchyma) or ill-defined. Shape was classified as taller-than-wide or wider-than-taller. The echogenicity of thyroid nodule was categorized as hyperechogenicity, isoechogenicity, hypoechogenicity compared with normal thyroid parenchyma, or marked hypoechogenicity when the lesion was hypoechoic relative to the neighboring strap muscles. In addition, the presence of hyperechogenicity and isoechogenicity were regard as no hypoechogenicity or no marked hypoechogenicity in this study. Presence of calcification was classified as microcalcification (<1mm in size; punctuate, small intranodular hyperechoic without posterior acoustic shadows) or no microcalcification (coarse calcifications or no calcification). The posterior acoustic of nodule was categorized as posterior echo attenuation, no findings, or posterior echo enhancement. Additionally, the presence of posterior echo enhancement and no finding were regard as no posterior echo attenuation in this study. The acoustic halo at the peripheral of thyroid nodule was classified as presence or absence. The capsule of thyroid was classified as interruption or completeness. Vascularity was categorized as no vascularity (no color Doppler flow within the nodule and at the peripheral), peripheral vascularity (color Doppler flow at the peripheral of the nodule and no color Doppler flow within the nodule), and central vascularity (color Doppler flow within the nodule). In addition, no vascularity and peripheral vascularity were regarded as no central vascularity in this study. Lymph nodes with the absence of hyperechoic hilum and the nodes with irregular shape was regarded as suspected cervical lymph node metastasis.

ARFI-induced SE examination was carried out following conventional US. The ARFI-induced SE image could reflect the elasticity of tissue in the field of view (FOV) by grayscale over the conventional B-mode image. The score for SE was referred to Xu’s scoring system [10]: score 1, the nodule is showed as predominantly white; score 2, the nodule is showed as predominantly white with few black portions; score 3, the nodule is showed as equally white and black; score 4, the nodule is showed as predominantly black with a few white spots; score 5, the nodule is showed as almost completely black; score 6, the nodule is showed as completely black without white spots. The nodule was regarded as malignant if the score is greater than 4.

CEUS was performed with contrast pulse sequencing (CPS) ultrasound imaging mode. The contrast agent used was SonoVue (Bracco S.p.A Inc., Milan, Italy). Intravenous access was established by elbow vein. A total of 25mg contrast medium was dissolved in 5ml 0.9% sodium chloride. Subsequently, it was injected as an intravenous bolus of 1.2ml per subject through the elbow vein, followed by a 5ml normal saline flush. Under the contrast mode, the mechanical index (MI) ranged between 0.05 and 0.07. The focus was adjusted to the lower edge or the middle of the thyroid nodule. The continuous dynamic images were recorded for a minimum of 2 minutes on the machine’s internal hard drive for the purpose of analyzing off-line. With the comparison of echogenicity brightness between thyroid nodule and surrounding parenchyma at peak enhancement, the degree of enhancement was classified as hypo-enhancement, iso-enhancement, hyper-enhancement and no-enhancement. According to the identity of echogenicity intensity of thyroid nodule, the enhancement identity was classified as homogeneous and heterogeneous. Additionally, the nodule was regarded as malignant if the pattern of enhancement is heterogeneous hypo-enhancement.

In this study, we evaluated the diagnostic value of the following 12 sonographic features to differentiate malignant and benign thyroid nodules. Sonographic features included margin (X1), border (X2), shape (X3), echogenicity (X4), calcifications (X5), posterior acoustic (X6), acoustic halo at the peripheral of nodule (X7), capsule of thyroid (X8), vascularity (X9), suspected cervical lymph node metastasis (X10), elastography score (X11), hypoenhancement pattern (X12). The pathological result for the thyroid nodule was the golden standard.

Statistical analysis

Statistical analyses were performed by R program software package for Windows (R X 64 3.2.3). We used logistic regression to simulate a model to differentiate malignant and benign thyroid nodules. A p value <0.05 was considered statistically significant. The statistically significant features were encapsulated in this model. This study got this model’s performance by five folder cross validation, including sensitivity, specificity, accuracy, positive predictive value, and negative predictive value. The receiver operator characteristic curves (ROC) of multivariate observations were drawn, which can assess the logistic regression model’s prediction performance.

Results

Of the 525 thyroid nodules, 228 (43.4%) were malignant and 297 (56.6%) were benign lesions. All 228 malignant and 27 benign nodules were confirmed by surgery, and the rest of 270 benign were confirmed by cytologic examination. In the group of malignant nodules, the diagnosis included papillary carcinoma (n = 220), follicular carcinoma (n = 7), and anaplastic carcinoma (n = 1). In the group of benign nodules, the diagnosis included nodular goiter (n = 208), adenoma (n = 70), and Hashimoto’s nodule (n = 19). There were 339 persons more than or equal to 40 years old (144 were malignant, and 195 were benign). The remaining 186 persons were less than 40 years old (84 were malignant, and 102 were benign). Clinical data for patients and sonographic characteristics for nodules were presented in Table 1. The gender and age were not found to differ significantly between malignant and benign nodules. Among the sonographic features, calcification, suspected cervical lymph node metastasis, hypoenhancement pattern, margin, shape, vascularity, posterior acoustic, echogenicity, and elastography score had statistic significance between malignant and benign nodules.

The summary after logistic regression analysis about every sonographic feature was detailed in the Table 2. The fitted model was established: where Z was the probability of suffering from maligant thyroid nodule, sigmoid(⋅) was the activation function of logistic regression, χ denoted the all features. The thyroid nodules were regarded as malignant if Z was equal to or greater than 0.5. In contrast, the thyroid nodules were regarded as benign if Z was less than 0.5. After five folder cross validation, we also got the receiver operator characteristic curve (Fig 1) which is close to top left corner of the coordinate system. The area under the ROC curve (AUC) for using this formula to differentiate malignant and benign thyroid nodules was 0.930. The sensitivity, specificity, accuracy, positive predictive value, and negative predictive value were 83.77%, 89.56%, 87.05%, 86.04%, and 87.79% respectively.

Discussion

Nowadays thyroid nodules have a high incidence because of the widespread use of high-resolution ultrasound in clinical practice. Most of thyroid nodules are benign, whereas it is uneasy to find the thyroid carcinomas because of the hidden early clinical symptoms of them. Pathological findings are the gold standards in differentiating benign and malignant thyroid nodules. High-frequency ultrasound plays an important role in the diagnosis of differentiating malignant from benign nodules because of its economy, noninvasive, and convenient features. Known suspicious US features of malignant thyroid nodules are irregular margins, ill-defined border, hypoechogenicity or marked hypoechogenicity, microcalcification, taller-than-wide shape and so on. Based on the fact that malignant are harder than benign nodules, ultrasound elastography is a reliable technique in the differentiation of malignant and benign thyroid nodules [11, 12]. On the basis of previous study, thyroid nodules with the ARFI-induced SE score ≥ 4 would be regarded as malignancy. CEUS is a useful screening tool to differentiate thyroid nodules. If the thyroid nodules are malignant, lesions could be heterogeneous hypoenhanced after the infusion of contrast agent. In clinical practice, no single feature can authentically predict the risk of malignant. However, a combination of suspicious ultrasound features is known to provide better diagnostic accuracy.

Suspicious features reported in different studies vary slightly. Chng et al. [9] reported that nodules with irregular margin, hypoechogenicity, and taller-than-wide morphology significantly had higher percentages of malignancy comparing to benign. Kim et al. [13] reported that hypoechogenicity, microcalcifications, infiltrative margin, solid composition and taller-than-wide shape were significant features associated with malignancy. Tay et al. [14] investigated that there was not significantly different in size of nodules, patients’ gender and age. In the present study, we got the consistent result with them. Sex (p = 0.698) and age (p = 0.213) did not have significant difference between benign and malignant groups. They also found that benign nodules have all four US characteristics: well-defined margin, no calcification, no increase in vascularity, and no suspected cervical lymph node metastasis. Shweel et al. [15] found that elastography alone, as well as the combination of elastography and conventional US, showed superior diagnostic performance when compared with conventional US examination. Zhao et al. [16] reported that CEUS in combination with conventional US could improve the diagnostic accuracy of sub-centimeter nodules and reduced unnecessary surgery.

In daily practical work, it is common that not all malignant have suspicious ultrasound features of malignancy. In other words, it is hard for clinicians to determine whether the nodule is malignant or not when the lesion don’t have all suspicious features. In this study, we used the above mentioned 12 features in Table 1 to select the significant features and simulate a model to diagnose thyroid nodules. In the logistic regression model, the significant features which p values less than 0.05 were showed in Table 2 (including margin, shape, echogenicity, calcification, posterior acoustic, vascularity, suspected cervical lymph node metastasis, elastography score, and hypoenhancement). Malignant nodules may show irregular margin because of irregular growth of the fibrous stroma surrounding the carcinoma or carcinoma invasion into surrounding thyroid parenchyma. The taller-than-wide shape was first proposed by Kim et al [17], which was based on the fact that growth of most benign nodules has been found to remain within normal tissue planes, whereas malignant nodules grow across normal tissue planes. Because of the uneven intranodular composition, malignant nodules may display hypoechogenicity or marked hypoechogenicity, and posterior echo attenuation. Microcalcification was thought to be the representation of calcified psammoma bodies of carcinoma. The rapid growth and hyperplasia reaction of thyroid carcinoma cells may result in microcalcification. The second explanation for microcalcification is the secretion of glycoproteins and mucopolysaccharides by carcinoma cells. It is reported that most thyroid cancers showed increased vascularity. Thyroid carcinoma cells could produce angiogenic factors, thereby promoting the formation of neovascularization. In the study of Papini [18], suspected cervical lymph node metastasis was the most frequent finding in thyroid carcinoma. A published study reported that ARFI elastography seemed to be a valuable technique to differentiate thyroid carcinomas from benign lesions. Regarding CEUS, a small number of papers have documented that the diagnostic accuracy of CEUS following intravenous microbubble contrast. The tortuosity and irregularity of newly formed vessels in malignant lesions may lead to heterogeneous hypo-enhancement pattern. Although the presence of ill-defined border, acoustic halo and interrupted capsule of thyroid were found to be predictive of malignancy in some studies [19, 20]. However, these three characteristics were also not significant in this study. It is probably because some benign thyroid nodules have ill-defined border, such as subacute thyroiditis and Hashimoto’s thyroiditis. Acoustic halo may be due to the presence of edema which may appear in benign nodules. The presence of interrupted capsule of thyroid was not significantly associated with malignancy. It was probably related to that some nodules are just protrusions but without breakthrough.

In this study, one nodule was found to have irregular margin, ill-defined border, taller-than-wide shape, hypoechogenicity, central vascularity, elastography score of 4 and heterogeneous hypo-enhancement. The predictive value calculated with the logistic regression formula, 0.974, supported the presence of a malignant nodule. Pathologic analysis after surgery revealed a papillary thyroid carcinoma (Fig 2). The other nodule was found to have microcalcification, and peripheral acoustic halo, central vascularity, elastography score of 3 and heterogeneous hypo-enhancement. The predictive value calculated with the logistic regression formula, 0.350, supported the presence of a benign nodule. Pathologic analysis after surgery revealed a nodular goiter (Fig 3).

thumbnail
Fig 2. Ultrasonography images of a malignant thyroid nodule in the right lobe of a 44-year-old woman.

The calculated predictive value with the logistic regression formula was 0.980. Surgical pathology proved a papillary thyroid carcinoma. (a) Conventional US image showing a thyroid nodule with irregular margin, ill-defined border, taller-than-wide shape, hypoechogenicity in the longitudinal section. (b) Color Doppler US image showing central vascularity in the transversal section. (c) SE image showing elastography score of 4 in the longitudinal section. (d) CEUS image showing a heterogeneous mass with hypo-enhancement pattern in the longitudinal section.

https://doi.org/10.1371/journal.pone.0188987.g002

thumbnail
Fig 3. Ultrasonography images of a benign thyroid nodule in the right lobe of a 50-year-old woman.

The calculated predictive value with the logistic regression formula was 0.412. Surgical pathology proved a nodular goiter. (a) Conventional US image showing a thyroid nodule with microcalcification, and peripheral acoustic halo in the longitudinal section. (b) Color Doppler US image showing presence of central vascularity in the longitudinal section. (c) SE image showing elastography score of 3 in the longitudinal section. (d) CEUS image showing a heterogeneous mass with hypo-enhancement pattern in the longitudinal section.

https://doi.org/10.1371/journal.pone.0188987.g003

The strength of this study is that we used 12 features regarding SE, CEUS in combination with conventional US to screen the significant features in the diagnosis of malignancy and benign. In addition, the established prediction model in this study is simple and convenient, allowing a widespread use among clinicians. There are several limitations in this study. First, we have not considered the size of the nodules and the number of nodules. Second, the sample size was limited in this study. And this was a retrospective study. The established model needs more researches to validate and support. We are looking forward to perform large-sample study. Third, we did not analyze the variation of interobserver and intraobserver. We are looking forward to performing the analysis of interobserver and intraobserver variation in future.

Conclusion

The logistic regression model for significant sonographic features of conventional US, SE, and CEUS is an effective and accurate diagnostic tool for differentiating malignant and benign thyroid nodules. Independent risk features for determination are calcification, suspected cervical lymph node metastasis, hypoenhancement pattern, margin, shape, vascularity, posterior acoustic, echogenicity, and elastography score. Elastography and CEUS show a highly valuable performance in the diagnostic approach of thyroid nodules.

Supporting information

Acknowledgments

This work was supported in part by Grants JCYJ20140414170821285 and JCYJ20150529164154046 from Shenzhen Science and Technology Innovation Committee and JCYJ20160422113119640 from Shenzhen Fundamental Research Project.

References

  1. 1. Chang YC, Lo WC, Liao LJ. Surgeon-performed Ultrasound Elastography in the Evaluation of Thyroid Nodules. Journal of Medical Ultrasound. 2014;22(3):145–151. http://dx.doi.org/10.1016/j.jmu.2014.06.004.
  2. 2. Batawil N, Alkordy T. Ultrasonographic features associated with malignancy in cytologically indeterminate thyroid nodules. European Journal of Surgical Oncology (EJSO). 2014;40(2):182–186. http://dx.doi.org/10.1016/j.ejso.2013.11.015.
  3. 3. Kwak JY, Han KH, Yoon JH, Moon HJ, Son EJ, Park SH, et al. Thyroid Imaging Reporting and Data System for US Features of Nodules: A Step in Establishing Better Stratification of Cancer Risk. Radiology. 2011;260(3):892–899. pmid:21771959
  4. 4. Park JY, Lee HJ, Jang HW, Kim HK, Yi JH, Lee W, et al. A proposal for a thyroid imaging reporting and data system for ultrasound features of thyroid carcinoma. Thyroid. 2009;19(11):1257–1264. pmid:19754280
  5. 5. Cantisani V, D’Andrea V, Biancari F, Medvedyeva O, Di SM, Olive M, et al. Prospective evaluation of multiparametric ultrasound and quantitative elastosonography in the differential diagnosis of benign and malignant thyroid nodules: preliminary experience. European Journal of Radiology. 2012;81(10):2678–2683. pmid:22357195
  6. 6. Mohey N, Hassan TA, Abdel-Baki S. Role of combined grey scale US and US tissue elastography in differentiating solid thyroid nodules. The Egyptian Journal of Radiology and Nuclear Medicine. 2013;44(3):505–512. http://dx.doi.org/10.1016/j.ejrnm.2013.04.008.
  7. 7. Greis C. Quantitative evaluation of microvascular blood flow by contrast-enhanced ultrasound (CEUS). Clinical Hemorheology & Microcirculation. 2011;49(1–4):137.
  8. 8. Jiang J, Shang X, Wang H, Xu YB, Gao Y, Zhou Q. Diagnostic value of contrast-enhanced ultrasound in thyroid nodules with calcification. The Kaohsiung Journal of Medical Sciences. 2015;31(3):138–144. http://dx.doi.org/10.1016/j.kjms.2014.12.001. pmid:25744236
  9. 9. Chng CL, Kurzawinski TR, Beale T. Value of sonographic features in predicting malignancy in thyroid nodules diagnosed as follicular neoplasm on cytology. Clinical endocrinology. 2014;. pmid:25488575
  10. 10. Zhang YF, He Y, Xu HX, Xu XH, Liu C, Guo LH, et al. Virtual Touch Tissue Imaging on Acoustic Radiation Force Impulse Elastography. Journal of Ultrasound in Medicine Official Journal of the American Institute of Ultrasound in Medicine. 2014;33(4):585. pmid:24658938
  11. 11. Moon HJ, Sung JM, Kim EK, Yoon JH, Youk JH, Kwak JY. Diagnostic Performance of Gray-Scale US and Elastography in Solid Thyroid Nodules. Radiology. 2012;262(3):1002–1013. pmid:22357900
  12. 12. Rago T, Vitti P. Diagnostic role of ultrasound and elastosonography in nodular goiter. Best Practice & Research Clinical Endocrinology & Metabolism. 2014;28(4):519–529. http://dx.doi.org/10.1016/j.beem.2014.02.003.
  13. 13. Kim HG, Moon HJ, Kwak JY, Kim EK. Diagnostic accuracy of the ultrasonographic features for subcentimeter thyroid nodules suggested by the revised American Thyroid Association guidelines. Thyroid Official Journal of the American Thyroid Association. 2013;23(12):1583. pmid:23701365
  14. 14. Tay SY, Chen CY, Chan WP. Sonographic criteria predictive of benign thyroid nodules useful in avoiding unnecessary ultrasound-guided fine needle aspiration. Journal of the Formosan Medical Association. 2015;114(7):590–597. http://dx.doi.org/10.1016/j.jfma.2014.03.015. pmid:24866975
  15. 15. Shweel M, Mansour E. Diagnostic performance of combined elastosonography scoring and high-resolution ultrasonography for the differentiation of benign and malignant thyroid nodules. European Journal of Radiology. 2013;82(6):995–1001. http://dx.doi.org/10.1016/j.ejrad.2013.02.002. pmid:23465738
  16. 16. Zhao RN, Zhang B, Yang X, Jiang YX, Lai XJ, Zhang XY. Logistic Regression Analysis of Contrast-Enhanced Ultrasound and Conventional Ultrasound Characteristics of Sub-centimeter Thyroid Nodules. Ultrasound in Medicine & Biology. 2015;.
  17. 17. Kim EK, Park CS, Chung WY, Oh KK, Kim DI, Lee JT, et al. New sonographic criteria for recommending fine-needle aspiration biopsy of nonpalpable solid nodules of the thyroid. Ajr American Journal of Roentgenology. 2002;178(3):687. pmid:11856699
  18. 18. Papini E, Guglielmi R, Bianchini A, Crescenzi A, Taccogna S, Nardi F, et al. Risk of malignancy in nonpalpable thyroid nodules: predictive value of ultrasound and color-Doppler features. Journal of Clinical Endocrinology & Metabolism. 2013;87(5):1941.
  19. 19. Cappelli C, Castellano M, Pirola I, Cumetti D, Agosti B, Gandossi E, et al. The predictive value of ultrasound findings in the management of thyroid nodules. QJM: An International Journal of Medicine. 2007;100(1):29.
  20. 20. Cappelli C, Castellano M, Pirola I, Gandossi E, De Martino E, Cumetti D, et al. Thyroid nodule shape suggests malignancy. European Journal of Endocrinology. 2006;155(1):27–31. pmid:16793946