RSNA 2008 

Abstract Archives of the RSNA, 2008


SSE02-04

Quantifying Diagnostic Confidence in Free-Text Mammography Reporting

Scientific Papers

Presented on December 1, 2008
Presented as part of SSE02: Breast Imaging (Mammography)

Participants

Bruce Ian Reiner MD, Abstract Co-Author: Nothing to Disclose
Eliot Lawrence Siegel MD, Abstract Co-Author: Research grant, General Electric Company Research grant, Siemens AG Speakers Bureau, TeraRecon, Inc Advisory Board, Mercury Computer Systems, Inc Board of Directors, Carestream Health, Inc Research grant, XYBIX Systems, Inc Research grant, Steelcase, Inc Research grant, Anthro Corp Research grant, RedRick Technologies Inc Research grant, Evolved Technologies Corporation Research grant, Barco nv Research grant, Intel Corporation Research grant, Herman Miller, Inc Research grant, Anatomical Travelogue, Inc
Rakhi Goel MD, Presenter: Nothing to Disclose
Tara Ann Morgan MD, Abstract Co-Author: Nothing to Disclose
Joseph Jen-Sho Chen MD, Abstract Co-Author: Nothing to Disclose

PURPOSE

Despite the utilization of the breast imaging reporting and data system (BIRADS)  the use of terms of uncertainty and disclaimers persists.  The purpose of the study was to analyze text related to radiologists’ diagnostic confidence with the use of free-text mammography reporting, determine the rate of use of terms of uncertainty and correlate the use of terms suggesting uncertainty with BIRADS codes and the type of study performed.

METHOD AND MATERIALS

Data mining of a multi-institutional mammography database was performed using natural language processing (NLP) software, which was externally validated through a manual report audit. Using the NLP software, “uncertainty terms” (e.g. cannot exclude), were extracted from the mammography reports and correlated with the type of mammogram and corresponding BIRADS codes

RESULTS

Of the 141,787 mammography reports analyzed, 11% represented diagnostic mammograms and 89% screening mammograms. The frequency distribution of “uncertainty terms” was found to be significant (p < 0.001) when correlating exam type and BIRADS code. Uncertainty terms were demonstrated in 19% of all diagnostic mammography reports, compared with only 2.8% of screening mammography reports. When correlating with the corresponding BIRADS codes, 4.3% of negative mammography reports (BIRADS 1 and 2) contained uncertainty terms, compared with 11.0% of equivocal mammography reports (BIRADS 0 and 3), and 10.5% of positive mammography reports (BIRADS 4 and 5).  

CONCLUSION

A substantial percentage of existing mammography reports contain “uncertainty terms” that reflect equivocation and lack of diagnostic confidence on the part of the interpreting radiologist particularly for diagnostic mammograms where these terms are invoked in approximately one in five cases or in those with equivocal or positive BIRADS categorization. The content of existing free-text mammography reports allows for the incorporation of equivocation language and potentially less than ideal reporting. New structured reporting and decision support technologies may be utilized to effectively reduce radiologist equivocation and improve report diagnostic confidence.

CLINICAL RELEVANCE/APPLICATION

Despite the use of BIRADS codes and reported associated improvements in the quality of mammography reports the use of uncertainty terms persists, especially for diagnostic mammograms.

Cite This Abstract

Reiner, B, Siegel, E, Goel, R, Morgan, T, Chen, J, Quantifying Diagnostic Confidence in Free-Text Mammography Reporting.  Radiological Society of North America 2008 Scientific Assembly and Annual Meeting, February 18 - February 20, 2008 ,Chicago IL. http://archive.rsna.org/2008/6020029.html