https://orcid.org/0000-0001-9935-2863
Figures
Abstract
The aim of this study was to determine the rate, important findings, and risk factors related to discrepancies between on-call residents’ and attending radiologists’ interpretations of abdominal examinations. We identified 1132 eligible patients with abdominal radiology findings that were preliminary interpreted by on-call residents between February 2016 and September 2019. The preliminary interpretations were compared with the final interpretations by abdominal attending radiologists, including clinical data. The preliminary interpretations were analyzed by three radiologists in consensus, who categorized the reports according to organs, important findings (i.e., active bleeding, bowel obstruction, organ ischemia or infarction, and organ rupture), clinical outcomes, and discrepancies with respect to final interpretations. Multiple logistic regression analysis was used to evaluate the risk factors for important discrepant findings. Of 1132 patients, the bowel (n = 567, 50.1%) was the most common organ interpreted by on-call residents, followed by gallbladder/bile duct/pancreas (n = 139, 12.3%) and liver (n = 116, 10.2%). Of 1132, 359 patients (31.7%) had disease with 379 important findings: active bleeding (n = 222), organ rupture (n = 77), bowel obstruction (n = 52), bowel ischemia (n = 24), and organ infarction (n = 4). Sixty-four patients (5.6%) showed discrepancies, and 30 (2.6%) showed 32 important discrepant findings comprising 14 active bleeding, 10 bowel obstructions, 6 organ ruptures, and 2 cases of bowel ischemia. Of the 64 discrepant patients, 33 underwent delayed surgery (n = 18, 28.1%) or interventional treatment (n = 15, 23.4%). In multivariable analysis, bowel obstruction (adjusted odds ratio, 2.52; p = 0.049) was an independent risk factor for determining discrepancy between preliminary and final interpretations. The rate of overall and important discrepancies between on-call residents’ and final interpretations was low. However, given that the bowel was the most frequently interpreted organ, bowel obstruction was identified as a risk factor for discrepant interpretations. The identified risk factor and findings may be useful for residents to minimize discrepancies.
Citation: Yang SJ, Lim HJ, Park SH, Choi SJ, Shim YS (2022) Interpretation discrepancies of abdominal imaging by on-call radiology residents: Evaluation of risk factors. PLoS ONE 17(9): e0274313. https://doi.org/10.1371/journal.pone.0274313
Editor: Raffaele Serra, University Magna Graecia of Catanzaro, ITALY
Received: February 23, 2022; Accepted: August 25, 2022; Published: September 9, 2022
Copyright: © 2022 Yang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
In many academic radiology departments, radiology residents often provide after-hour coverage for preliminary independent radiology examinations performed on inpatients and conducted in the emergency department. A common evaluation by on-call radiology residents is conducted on abdominal examinations, which are often challenging, and attending radiologists review these interpretations the next morning.
Many previous studies have reported low rates of discrepancies between the preliminary report from residents and the final report by attending radiologists [1–7]. Nevertheless, diagnostic errors in preliminary radiology reports may cause discrepancies. Errors are divided into 1) perceptual (misses) errors and 2) interpretation (differential diagnosis) errors [8]. Identifying the underlying risk factors or causes of erroneous evaluation may lead to reduce the discrepancy rate. However, to the best of our knowledge, no study has investigated the risk factors for discrepancies between preliminary abdominal radiology reports provided by residents and the final reports verified by attending radiologists. As misinterpretations during overnight duty may result in changes to treatments and additional evaluations [3], it is important to analyze discrepancies between preliminary and final reports in abdomen radiology studies.
We conducted a retrospective review of preliminary reports of abdominal imaging examinations by radiology residents during after-hour coverage. We analyzed the discrepant cases and risk factors for discrepancies between residents’ preliminary reports and attending radiologists’ final reports along with the clinical outcomes. If residents can identify such discrepant cases and risk factors for discrepancies and prepare for similar situations before on-call duty, misinterpretations may be reduced, thus improving diagnostic accuracy of preliminary readings.
We aimed to determine the rate, types, important findings, and risk factors related to discrepancies between residents’ preliminary reports and final interpretations by abdominal attending radiologists including the clinical outcomes.
Materials and methods
This retrospective study at a tertiary referral center was approved by the Institutional Review Board of Gil medical center (GAIRB2021-378), and the requirement for obtaining written informed patient consent was waived.
Study population
We evaluated 2374 consecutive patients for the preliminary radiology interpretations by on-call radiology residents between February 2016 and September 2019. From this overall set, we identified eligible patients that were over 16 years of age and with a consultation which included abdominal imaging. Among 1180 eligible patients, 16 patients had data recording errors and 32 patients had insufficient follow-up time (less than one month) and were excluded. For this study, we reviewed data on 1132 patients with preliminary radiology interpretations made by on-call radiology residents (Fig 1).
Preliminary report data by resident
In our institution, radiology residents take on-call duty from 5 pm to 8 am on weekdays and 8 am to 8 am overnight on weekends and holidays for emergency department and inpatient examinations. The evaluations are based on the referring clinician’s questions made by phone call regarding simple radiography, ultrasonography (US), CT, and MRI. The questions regarding simple radiography, CT, and MRI are interpretative, and those on US query about the possibility of the resident to perform on-call US and interpret it. The residents in our institution begin taking on-call duty responsibilities between the second half of the first year and the first half of the fourth year of training. The duty consists of mainly second- and third-year job (approximately 85–90%) and remnant job of the second half of the first year and the first half of the fourth year. All residents are educated about abdominal radiology for more than 8 weeks before taking a call. In some cases, when a junior (first-year) resident has difficulty with a case during on-call duty, they can ask a senior resident regarding the case. At the end of each overnight shift, all residents should record a list containing the consulted patients, their information, and preliminary reports for educational purposes in our institution’s database. The database includes the patients’ sex, age, number, image study date, date of duty, name of on-call duty resident, and reason for the consultation.
Evaluating discrepancies
The complete database was reviewed retrospectively by three radiologists with experience in abdominal radiology in consensus reading. One radiologist had 10 years of experience (S.H.P) and the remaining two radiologists (S.J.Y., H.J.L.) had 3 years of experience at the time of the study. The data were classified according to specific organs, examination types, resident’s grade (i.e., years of training), presence of important findings, and discrepancies with and without legal consequences. Important findings of the abdomen were defined as the presence of a potentially life-threatening condition that may require immediate clinical management [9, 10]: 1) presence of active bleeding, 2) bowel obstruction, 3) organ ischemia or infarction, or 4) organ rupture based on the modification of critical results in abdominal radiology [11–17]. The definitions and descriptions of findings 1–4 are summarized in S1 Table.
The preliminary reports were evaluated for discrepancies of the final interpretations, including final reports and clinical outcome (surgery with pathology, intervention, endoscopy, and medical treatment based on EMR). The final reports were completed within 1–2 days after the preliminary report by one of four abdominal attending radiologists. The clinical outcome was reviewed on electronic medical records and classified as surgery, interventional treatment, endoscopic procedure, or medical treatment with clinical follow-up. The final reports with clinical outcome (i.e., final interpretations) were used as the reference standard for resident on-call reading.
Imaging protocol
CT examinations were performed using a 64-section CT scanner (SOMATOM Definition, SOMATOM Definition Edge, Siemens Healthineers) and 128-section dual source CT scanners (SOMATOM Definition Flash, Siemens Healthineers). Four types of images were obtained: precontrast CT only, portal venous phase only (postcontrast), arterial and portal venous phase (postcontrast), precontrast, arterial, and portal venous phase (precontrast and postcontrast scans).
MRI examinations were performed for evaluation of acute appendicitis in pregnant patients and magnetic resonance cholangiopancreatography using a 3T scanner (Skyra, Siemens Healthineers).
Appendix US and upper abdomen US were included in the US examination.
Statistical analysis
Residents were grouped as “discrepant” when the preliminary report differed from the final interpretation and as “identical” when the reports agreed. Patient characteristics in each group were compared using Student’s t-test and chi-square test. Univariable and multivariable logistic regression analyses were used to evaluate the risk factors of discrepancy interpretations by on-call residents, adjusting for covariates. Parameters with a p value less than 0.2 on univariable analysis, were included in the multivariable analysis [18, 19]. Multivariate logistic regression analysis was performed using the backward likelihood ratio. Differences were considered statistically significant with a 95% confidence interval and p < 0.050. All statistical analyses were performed using the SPSS software (version 22.0, IBM).
Results
Patient and interpretation characteristics
The clinical characteristics of the patients included in our study are summarized in Table 1. Of the 1132 patients, 544 (48.1%) were men and 588 (51.9%) were women, with a mean age ± standard deviation of 58.9 years ± 19.4 year. CT was the most common examination (n = 1064, 94.0%), followed by US (n = 49, 4.3%), MRI (n = 11, 1.0%), X-ray (n = 4, 0.4%), CT and MRI (n = 2, 0.2%), and MRI and US (n = 2, 0.2%). Among them, 678 patients (59.9%) underwent initial examinations, and 454 (40.1%) underwent follow-up examinations. Of the patients, 381 (33.7%) were inpatients and 751 (66.3%) were admitted to the emergency department. Among the 751 emergencies, 24 patients presented several lesions after traumatic accidents. Sixty-two patients were evaluated using 62 US or MRI, of which 50 (80.6%) were evaluated for acute appendicitis.
Fourteen residents, from 1st year to 4th year, had on-call duties during the study period. Preliminary reports from third year residents were the most common (n = 443, 39.1%) reports, followed by 2nd year (n = 432, 38.2%), 1st year (n = 187, 16.5%), and 4th year (n = 70, 6.2%) residents. A total of 77 out of 187 cases were interpreted by 1st year residents with assistance from senior residents. The bowel (n = 567, 50.1%) was the most common organ evaluated by on-call residents, followed by gallbladder/bile duct/pancreas (n = 139, 12.3%), and liver (n = 116, 10.2%). Final interpretations were determined using the attending radiologist reports surgery (n = 202, 17.8%), interventional treatment (n = 244, 21.6%), endoscopy (n = 47, 4.2%), or medical treatment (n = 639, 56.4%).
Characteristics of discrepant interpretation
We found a total of 64 discrepancies (5.6%) between the preliminary reports from the residents and the final interpretations: acute appendicitis (n = 4), acute cholecystitis (n = 4), absence of abnormal bowel wall thickening (n = 4), colitis (n = 3), hepatocellular carcinoma (n = 3), normal appendix (n = 2), Crohn’s disease (n = 2), bile duct stone (n = 2), pancreatic cancer (n = 1), large gastric ulcer (n = 1), acute diverticulitis (n = 1), hemobilia (n = 1), ovarian torsion (n = 1), ovarian abscess (n = 1), hemorrhagic ovarian cyst (n = 1), urothelial cancer (n = 1), fungal infection in the spleen (n = 1), prostatic abscess (n = 1), and 30 important discrepant cases on final interpretations. Of these 64, the majority of imaging modalities were CT (n = 62, 96.9%) except for two USs in pregnant patients with acute appendicitis. The bowel (n = 37, 57.8%) was the most frequently discrepant organ, followed by gallbladder/bile duct/pancreas (n = 9, 14.1%), liver (n = 5, 7.8%, Fig 2), and others. Of the 64, 33 patients underwent delayed surgery (n = 18, 28.1%) or interventional treatment (n = 15, 23.4%). The preliminary report by 2nd year resident showed the highest number of discrepancies (n = 36, 56.2%) compared the other residency years (p = 0.017).
A 79-year-old man showed fever and right flank pain. (A, B) CT images show thick rim enhancing mass in the right posterior section of the liver. The heterogeneously enhancing mass in the liver was mistaken for liver abscess by the on-call resident. (C) The lesion shows a heterogeneous echoic mass in abdominal ultrasonography. (D) Another small arterial enhancing nodule in the inferior aspect of the lesion with washout (E) in the portal venous phase. Attending radiologist reported HCC in the right posterior section with additional HCC. A subsequent biopsy revealed HCC.
Characteristics of preliminary reports with important findings
Tables 2 and 3 summarize the important findings reported by on-call residents. A total of 359 patients (31.7%) had disease with 379 important findings: active bleeding (n = 222), organ rupture (n = 77), bowel obstruction (n = 52), bowel ischemia (n = 24), and organ infarction (n = 4). Eighteen patients had two important findings, and one had three important findings.
Only thirty patients (2.6%) showed 32 important discrepant findings, including 14 active bleeding, ten bowel obstructions, six organ ruptures, and two bowel ischemia. Two patients had two important findings. Of 30, all cases were CT, initial CT examinations were 16 (53.3%), and bowel was the most common organ (20, 66.7%). Although 14 patients showed active bleeding on CT scans, the on-call residents were unable to detect it. In addition, 10 cases of bowel obstruction were mistaken as paralytic ileus (6 cases), pelvic inflammatory disease (1 case), absence of bowel perforation (1 case), acute diverticulitis (1 case), and paraduodenal hernia (1 case) in the preliminary reports. In the patient with paraduodenal hernia, the resident detected the transitional zone of the small bowel, but different diagnosis was interpreted during on-call duty. Therefore, of the 30 discrepant cases, 23 (76.7%) were perceptual errors (i.e., no detection of the transitional zone at bowel obstruction or active bleeding focus in preliminary readings) leading to misinterpretations. Perceptual errors were most frequently noted in preliminary reports with important discrepant findings. Table 4 provides details about the important discrepant cases. The patients’ management included surgery (11/30, 36.7%), interventional treatment (9/30, 30.0%), endoscopy (1/30, 3.3%), or medical treatment (9/30, 30.0%). However, there were no legal consequences related to the interpretation discrepancies.
Risk factors for predicting discrepancy interpretations by on-call residents.
Table 5 shows risk factors for discrepancy between preliminary and final interpretations in the important findings (n = 359). The results of the univariable analysis showed a specific grade of residents (resident 2nd year), and bowel obstruction (p < 0.2) were available risk factors included in the multivariable analysis. In the multivariable analysis, bowel obstruction (adjusted OR, 2.52; 95% CI: 1.00–6.50, p = 0.049) was an independent risk factor for important discrepant findings (Fig 3). Of 52 bowel obstruction interpretations, eight were interpreted by 1st year (three discrepancies), 18 were interpreted by 2nd year (four discrepancies), 21 were interpreted by 3rd year (three discrepancies), and five were interpreted by 4th year residents (no discrepancies).
A 39-year-old woman showed abdominal pain in the right lower quadrant area. The patient underwent an appendectomy 20 years ago and was treated for pelvic inflammatory disease a few years ago. The patient underwent abdominopelvic computed tomography (CT, single portal venous phase) in the emergency department. (A, B) Axial CT images show segmental distension of the small bowel. (C) In the coronal image, abrupt narrowing of dilated ileum is suggested to be the transitional zone (white arrow) of small bowel obstruction. (D) CT shows decrease in the segmental wall enhancement of small bowel, suggesting ischemic change (black arrow). The preliminary report by second-year radiology resident on duty indicated pelvic inflammatory disease with paralytic ileus. The patient continuously complained of abdominal pain with fever and underwent operation (operation finding: strangulated bowel obstruction), as resection of strangulated ileum. Histopathology revealed transmural necrosis of the ileum.
Discussion
This study investigated the rate and risk factors of discrepancies between on-call residents’ and final interpretations considering the attending radiologist’s report and clinical outcomes on abdominal examinations. The rate of overall and important discrepancies was low in abdominal radiology. Bowel obstruction was a significant risk factor for important discrepant findings. The bowel showed the highest discrepancy. Educating abdominal residents emphasizing the bowel and bowel obstruction may improve the interpretation ability of radiology reports during on-call duty.
We found a 5.6% (64/1132) discrepancy rate between preliminary and final interpretations. Previous studies have reported an overall discrepancy rate from 0.1% to 3.8% [1–7, 20–25] in the preliminary radiology reports. Few studies [1, 3, 20] have reported that body CT may be associated with discrepant interpretations given the slightly higher discrepancy rate (6.4%, 9.8%, respectively) compared with the overall discrepancy rate [1, 3]. Our study analyzed abdominal cases, mainly abdominopelvic CT. Our rate (5.6%) was similar or slightly lower than that reported in previous studies. We consider that the resulting rates may reflect different clinical practice environments or educational efforts regarding the review of discrepant cases.
The bowel was the most common preliminary interpreted organ and had the highest discrepancy rate in our study. The high frequency of bowel interpretations during on-call duty may be explained by the common pathologies of acute abdominal pain, including gastrointestinal perforation or inflammation and bowel obstruction or infarction [26]. This finding was similar to that in a previous study regarding abdominal and pelvic CT taken in an emergency department, where bowel disease showed the highest discrepancy between preliminary and final reports [25]. Another study suggested that acute appendicitis in contrast-enhanced abdominopelvic CT was the most common cause of misinterpretation [20]. Considering previous studies and our present study, residents should pay urgent attention to the evaluation of bowel disease during on-call duty and study radiologic findings of this pathology before starting and during their after-hour coverage.
We found that bowel obstruction was significantly associated with discrepant preliminary and final interpretations, with an adjusted OR of 2.52. Abdominal CT is an important diagnostic modality for detecting small bowel obstruction and predicting surgical candidates [27, 28]. The CT findings of small bowel obstruction were feces signs, transitional zones, beak signs, mesenteric vessel course, presence of closed-loop obstruction or ischemia, and ascites [12, 28, 29]. The radiologist can detect the transitional zone between the dilated and collapsed loops using a bowel trace on consecutive CT images. One possible explanation for our results is that the bowel tracing skills to find the transitional zone (i.e., obstruction site) are acquired through a relatively long learning curve, which may have affected the preliminary report results. Our results also showed misinterpretations by 1st and 2nd year residents were higher than those by 3rd and 4th year residents. Although next-day CT readings by the abdominal attending radiologist can minimize the patient severity risk, performing early accurate diagnosis of bowel obstruction on the preliminary report may improve the patient care because delayed surgical management of bowel obstruction can increase the mortality and morbidity rates of patients and prolong hospitalization [30]. Additional practice before and during on-call duty is thus essential to identify the number and location as well as the presence of transitional zones related to closed-loop small bowel obstruction and development of pneumoperitoneum, pneumatosis intestinalis, and portal vein gas, which is highly suspected to be a surgical candidate and complications of bowel obstruction [28].
Among the 1132 evaluated cases, our results showed 30 important discrepant findings categorized into active bleeding, bowel obstruction, organ ischemia or infarction, and organ rupture. We found that perceptual errors during preliminary interpretation were the most common cause of important discrepancies. Perceptual errors develop during initial screening (i.e., failure to recognize an abnormality) and cause missed diagnoses in radiology. Consistent with our results, perception errors have been reported to be the most common and important mistake made by radiologists [8, 31, 32]. We suggest residents to collect and review missed lesions showing important findings on CT to reduce the error incidence and improve the diagnostic accuracy. We believe that education can improve radiologic interpretations throughout training. Critical point of the important findings obtained with imaging modalities may require surgical or interventional approaches. As important discrepant findings are directly related to life-threatening scenarios, our educational goal should be aimed at reducing the frequency of discrepancies.
Our study further showed that 446 patients (39.4%) underwent surgery or intervention. Among them, 33 patients (2.9%) underwent delayed surgery or interventional treatment after a preliminary radiology report. These results suggest that the discrepancy in on-call residents’ preliminary interpretations can lead to management changes. Similarly, previous studies have demonstrated that discrepancies in on-call residents’ preliminary interpretations can affect patient care and management [3, 20–24]. McWilliams et al. [22] studied abdominal imaging and other body-part imaging, finding that 44.6% of the discrepant preliminary cases resulted in management changes, and 14% of the discrepant preliminary cases caused therapeutic management changes, such as surgery and interventional endoscopic procedures, while 11.9% of the discharged patients were recalled. Ruchman et al. [20] suggested that 7.2% of discrepant reports showed a negative effect on patients. Friedman et al. [24] reported that 35.7% of such cases increased the patients’ morbidity and hospitalization period, whereas discrepant preliminary reports did not increase mortality or long-term outcomes.
We also found that the experience of a second-year resident was a possible risk factor for the discrepancies. However, a specific training degree was not a significant risk factor after multivariable analysis. In our study, it was difficult to evaluate the experience of a first-year resident because the number of overnight duty days in the first-year was small and they can ask a senior resident regarding the difficult case. These results may differ from a previous study [20], which showed the highest discrepancy rate for residents who were in their third year of training. Mellnick et al. [5] reported that a higher grade of residents led to more discrepancies, whereas other studies reported that a higher grade of residents led to reduced discrepancies [1, 3, 6, 7]. We suggest that the overnight coverage ratio in a specific residency year and different education systems depending on the academic institutions can affect the discrepancy results. In addition, training programs have undergone many changes over the years, including strict work-hour regulations in South Korea, increased training under supervision, and decreased trainee independence [7, 33]. Few studies have reported higher error rates in residents working more than 10 consecutive hours overnight [34] and increasing their caseload or working hours [35], and these error rates may be associated with fatigue or circadian effects.
This study has various limitations. First, it was a retrospective single-center study in South Korean population that inevitably leads to selection bias. Second, our study was performed in a tertiary academic medical institution including regional emergency medical, cancer, and trauma centers for a specific region, possibly impacting the severity of cases in enrolled patients. Third, discrepancies were noted only for a small portion of patients. Thus, our study revealed one risk factor. Including more patients may be conducive to identify additional risk factors. Finally, only a small number of imaging modalities besides CT were considered in this study.
In conclusion, overall and important discrepant findings between preliminary interpretations by on-call residents and final interpretations showed a low rate in abdominal radiology. Nevertheless, bowel obstruction is a risk factor for discrepancies, and the bowel is the most common target of on-call interpretations.
Supporting information
S1 Table. Important findings and definitions.
https://doi.org/10.1371/journal.pone.0274313.s002
(DOCX)
References
- 1. Cooper VF, Goodhartz LA, Nemcek AA, Jr., Ryu RK. Radiology Resident Interpretations of On-call Imaging Studies: The Incidence of Major Discrepancies. Academic Radiology. 2008;15(9): 1198–1204. pmid:18692761
- 2. Branstetter BFIV Morgan MB, Nesbit CE Phillips JA, Lionetti DM Chang PJ, et al. Preliminary Reports in the Emergency Department: Is a Subspecialist Radiologist More Accurate Than a Radiology Resident? Academic Radiology. 2007;14(2): 201–206. pmid:17236993
- 3. Carney E, Kempf J, DeCarvalho V, Yudd A, Nosher J. Preliminary Interpretations of After-Hours CT and Sonography by Radiology Residents Versus Final Interpretations by Body Imaging Radiologists at a Level 1 Trauma Center. American Journal of Roentgenology. 2003;181(2): 367–373. pmid:12876012
- 4. Kung JW, Melenevsky Y, Hochman MG, Didolkar MM, Yablon CM, Eisenberg RL, et al. On-Call Musculoskeletal Radiographs: Discrepancy Rates Between Radiology Residents and Musculoskeletal Radiologists. American Journal of Roentgenology. 2013;200(4): 856–859. pmid:23521460
- 5. Mellnick V, Raptis C, McWilliams S, Picus D, Wahl R. On-Call Radiology Resident Discrepancies: Categorization by Patient Location and Severity. Journal of the American College of Radiology. 2016;13(10): 1233–1238. pmid:27319372
- 6. Tomich J, Retrouvey M, Shaves S. Emergency imaging discrepancy rates at a level 1 trauma center: identifying the most common on-call resident “misses”. Emergency Radiology. 2013;20(6): 499–505. pmid:23887692
- 7. Weinberg BD, Richter MD, Champine JG, Morriss MC, Browning T. Radiology Resident Preliminary Reporting in an Independent Call Environment: Multiyear Assessment of Volume, Timeliness, and Accuracy. Journal of the American College of Radiology. 2015;12(1): 95–100. pmid:25557573
- 8. Bruno MA, Walker EA, Abujudeh HH. Understanding and Confronting Our Mistakes: The Epidemiology of Error in Radiology and Strategies for Error Reduction. Radiographics. 2015;35(6): 1668–1676. pmid:26466178
- 9.
UMass Memorial Medical Center, Communication of actionable findings on radiology imaging studies and procedure [Internet, cited 2021 Aug 13] Available from https://www.umassmed.edu/globalassets/radiology/documents/2020-Rad2033-communication-actionable-findings-radiology-imaging-studies-and-procedure.pdf.
- 10. Anthony SG, Prevedello LM, Damiano MM, Gandhi TK, Doubilet PM, Seltzer SE, et al. Impact of a 4-year quality improvement initiative to improve communication of critical imaging test results. Radiology. 2011;259(3): 802–807. pmid:21467253
- 11. Hamilton JD, Kumaravel M, Censullo ML, Cohen AM, Kievlan DS, West OC. Multidetector CT evaluation of active extravasation in blunt abdominal and pelvic trauma patients. Radiographics. 2008;28(6): 1603–1616. pmid:18936024
- 12. Santillan CS. Computed tomography of small bowel obstruction. Radiol Clin North Am. 2013;51(1): 17–27. pmid:23182505
- 13. Kim SW, Shin HC, Kim IY, Kim YT, Kim CJ. CT findings of colonic complications associated with colon cancer. Korean J Radiol. 2010;11(2): 211–221. pmid:20191069
- 14. Rha SE, Ha HK, Lee SH, Kim JH, Kim JK, Kim JH, et al. CT and MR imaging findings of bowel ischemia from various primary causes. Radiographics. 2000;20(1): 29–42. pmid:10682769
- 15. Karaosmanoglu AD, Uysal A, Akata D, Ozmen MN, Karcaaltincaba M. Role of imaging in visceral vascular emergencies. Insights into Imaging. 2020;11(1): 112. pmid:33057847
- 16. Kozar RA, Crandall M, Shanmuganathan K, Zarzaur BL, Coburn M, Cribari C, et al. Organ injury scaling 2018 update: Spleen, liver, and kidney. Journal of Trauma and Acute Care Surgery. 2018;85(6).
- 17. Kim SH, Shin SS, Jeong YY, Heo SH, Kim JW, Kang HK. Gastrointestinal tract perforation: MDCT findings according to the perforation sites. Korean J Radiol. 2009;10(1): 63–70. pmid:19182505
- 18. Bursac Z, Gauss CH, Williams DK, Hosmer DW. Purposeful selection of variables in logistic regression. Source Code Biol Med. 2008;3: 17. pmid:19087314
- 19. Mickey RM, Greenland S. The impact of confounder selection criteria on effect estimation. Am J Epidemiol. 1989;129(1): 125–137. pmid:2910056
- 20. Ruchman RB, Jaeger J, Wiggins EF, Seinfeld S, Thakral V, Bolla S, et al. Preliminary Radiology Resident Interpretations Versus Final Attending Radiologist Interpretations and the Impact on Patient Care in a Community Hospital. American Journal of Roentgenology. 2007;189(3): 523–526. pmid:17715095
- 21. Jo SY, Scanlon M, Cook T. Preliminary Radiology Report Discordances and Patient Outcomes. Journal of the American College of Radiology. 2020;17(12): 1621–1625. pmid:32768423
- 22. McWilliams SR, Smith C, Oweis Y, Mawad K, Raptis C, Mellnick V. The Clinical Impact of Resident-attending Discrepancies in On-call Radiology Reporting: A Retrospective Assessment. Academic Radiology. 2018;25(6): 727–732. pmid:29337090
- 23. Stevens KJ, Griffiths KL, Rosenberg J, Mahadevan S, Zatz LM, Leung ANC. Discordance Rates Between Preliminary and Final Radiology Reports on Cross-sectional Imaging Studies at a Level 1 Trauma Center. Academic Radiology. 2008;15(10): 1217–1226. pmid:18790392
- 24. Friedman SM, Merman E, Chopra A. Clinical impact of diagnostic imaging discrepancy by radiology trainees in an urban teaching hospital emergency department. International Journal of Emergency Medicine. 2013;6(1): 24. pmid:23866048
- 25. Chung JH, Strigel RM, Chew AR, Albrecht E, Gunn ML. Overnight Resident Interpretation of Torso CT at a Level 1 Trauma Center: An Analysis and Review of the Literature. Academic Radiology. 2009;16(9): 1155–1160. pmid:19481962
- 26. Scheirey CD, Fowler KJ, Therrien JA, Kim DH, Al-Refaie WB, Camacho MA, et al. ACR Appropriateness Criteria(®) Acute Nonlocalized Abdominal Pain. J Am Coll Radiol. 2018;15(11s): S217–s231. pmid:30392591
- 27. Scrima A, Lubner MG, King S, Pankratz J, Kennedy G, Pickhardt PJ. Value of MDCT and Clinical and Laboratory Data for Predicting the Need for Surgical Intervention in Suspected Small-Bowel Obstruction. American Journal of Roentgenology. 2017;208(4): 785–793. pmid:28328258
- 28. Zins M, Millet I, Taourel P. Adhesive Small Bowel Obstruction: Predictive Radiology to Improve Patient Management. Radiology. 2020;296(3): 480–492. pmid:32692296
- 29. Millet I, Ruyer A, Alili C, Curros Doyon F, Molinari N, Pages E, et al. Adhesive small-bowel obstruction: value of CT in identifying findings associated with the effectiveness of nonsurgical treatment. Radiology. 2014;273(2): 425–432. pmid:24991990
- 30. Teixeira PG, Karamanos E, Talving P, Inaba K, Lam L, Demetriades D. Early Operation Is Associated With a Survival Benefit for Patients With Adhesive Bowel Obstruction. Annals of Surgery. 2013;258(3). pmid:24022438
- 31. Bruno MA. 256 Shades of gray: uncertainty and diagnostic error in radiology. Diagnosis (Berl). 2017;4(3): 149–157. pmid:29536935
- 32. Kim YW, Mansfield LT. Fool me twice: delayed diagnoses in radiology with emphasis on perpetuated errors. AJR Am J Roentgenol. 2014;202(3): 465–470. pmid:24555582
- 33. Bruno MA, Duncan JR, Bierhals AJ, Tappouni R. Overnight Resident versus 24-hour Attending Radiologist Coverage in Academic Medical Centers. Radiology. 2018;289(3): 809–813. pmid:30277849
- 34. Ruutiainen AT, Durand DJ, Scanlon MH, Itri JN. Increased error rates in preliminary reports issued by radiology residents working more than 10 consecutive hours overnight. Acad Radiol. 2013;20(3): 305–311. pmid:23452475
- 35. Davenport MS, Ellis JH, Khalatbari SH, Myles JD, Klein KA. Effect of work hours, caseload, shift type, and experience on resident call performance. Acad Radiol. 2010;17(7): 921–927. pmid:20540912