RSNA 2007 

Abstract Archives of the RSNA, 2007


LL-IN6148-D01

Performance of Internet Search Engines on Radiology Queries

Scientific Posters

Presented on November 26, 2007
Presented as part of LL-IN-D: Informatics

Participants

Kathleen Michelle Hughes MD, Presenter: Nothing to Disclose
Richard Earnest Sharpe BS, Abstract Co-Author: Nothing to Disclose
Priti Anilkumar Shah MD, Abstract Co-Author: Nothing to Disclose
Jeffrey Takeshi Hirata MD, Abstract Co-Author: Nothing to Disclose
Eliot Lawrence Siegel MD, Abstract Co-Author: Nothing to Disclose

PURPOSE

The purpose of this exhibit is to demonstrate the performance of four different search engines in radiology related queries.

METHOD AND MATERIALS

The different search engines utilized in the study were "kosmix.com", "medstory.com", "goldminer.arrs.org", and "yottalook.com". Every 100th search (with no change in spelling or word order) was extracted from a database of over 20,000 actual queries made using yottalook.com and was used to initiate a search in each search engine. The search results were evaluated based on the experiences of twelve radiology residents and attendings who searched each of the four different engines using the same query. Evaluation was based on the number of returns, whether the question was answered, search result relevance, whether the results were radiology related, ease of use, and whether there was a problem with the search.

RESULTS

Results from 48 searches demonstrate advantages and disadvantages of each engine. Medstory returned over 10 results per query 100% of the time, while yottalook, kosmix, and goldminer returned less than 10 queries 8%, 16%, and 42% respectively. Goldminer and yottalook returned no results in 17% and 8% respectively. A problem was encountered in approximately 17% of searches with goldminer, kosmix and medstory, and 8% with yottalook. Search results were deemed relevent 50% of the time in goldminer, 58% in kosmix, 83% in medstory, and 92% in yottalook. Results were radiology related 33% of the time in medstory, 58% in kosmix, 83% in goldminer, and 92% in yottalook. In 42% of the searches, the question was answered in goldminer compared to 83% in both kosmix and medstory, and 92% in yottalook. As far as ease of search, 50% of kosmix and medstory, 75% of goldminer, and 92% of yottalook searches were classified as easy.

CONCLUSION

Each of the search engines evaluated demonstrated unique strengths and weaknesses. Some are more geared to searching the diverse radiology database, where as some are more geared to the general public. The data from our study can be used to help choose a search engine optimized for the desired results. (RGC Grant CUH K9961)

CLINICAL RELEVANCE/APPLICATION

This exhibit will help radiologists optimize the time spent searching for radiology related content on the Internet.

Cite This Abstract

Hughes, K, Sharpe, R, Shah, P, Hirata, J, Siegel, E, Performance of Internet Search Engines on Radiology Queries.  Radiological Society of North America 2007 Scientific Assembly and Annual Meeting, November 25 - November 30, 2007 ,Chicago IL. http://archive.rsna.org/2007/5008199.html