Hee Chun, Presenter: Nothing to Disclose

Bradley Clymer PhD, Abstract Co-Author: Nothing to Disclose

Michael V. Knopp MD, PhD, Abstract Co-Author: Nothing to Disclose

Radiological image assessment (reading) relies on visual perception by which the diagnostic performance is limited by the three dimensional spatial information, screen size, image resolution and visual capacity. Today’s advances in imaging methodology and technology have drastically increased the number and complexity of imaging data with the simultaneous availability of multidimensional/ multiparametric information (structural, functional, and molecular). The simultaneous and coherent visual perception of the multiple information sources is beyond screen/film based visual perception. We explored the use of audio sensory information as an adjunct visual perception to complement simultaneous assessment of complex imaging data set.

The implementation framework mainly consists of IDL (Interactive Data Language, RSI) software, a dynamically loadable module, and application environments. This enables the ready processing and rendering volumetric medical imaging data (MR, PET-CT, DCE-MRI). In addition to the conventional display approaches, a sound generating object has been developed, which enables the perception of data instead of gray scales as characteristics (sound channels, frequency, amplitude and pan) that can be parameterized to communicate quantified data as audible perception.

Morphologic information is best visualized by conventional grayscale display that can be supplemented with color-coded overlay frequently used in PET-CT fusion. As more complex multiparametric image data sets become available, this information can not be visually perceived simultaneously and by utilizing the very sensible, audible capability, complementary information can be communicated by auditory perception of different sound characteristics. The feasibility of the approach was demonstrated using PET-CT and functional (DCE-MRI) data sets.

The feasibility of communicating complex multiparametric/multidimensional information adjunctive to visual perception by modulated sound has be been demonstrated and appears as a powerful tool to assist radiologists and assessment of these complex images in association with conventional grey scale display of structural information.

Chun, H, Clymer, B, Knopp, M, Enhancing Visual Analysis of Medical Images with Auditory Sensory Information.  Radiological Society of North America 2005 Scientific Assembly and Annual Meeting, November 27 - December 2, 2005 ,Chicago IL. http://archive.rsna.org/2005/4408511.html