Abstract
A novel system for gaze-contingent image analysis and multisensorial image display is described. The observer's scanpaths are recorded while viewing and analysing 2D or 3D (volumetric) images. A region-of-interest (ROI) centered around the current fixation point is simultaneously subjected to real-time image analysis algorithms to compute various image features, e.g. edges, textures (2D) or surfaces and volumetric texture (3D). This feature information is fed back to the observer using multiple channels, i.e. in visual (replacing the ROI by a visually modified ROI), auditory (generating an auditory display of a computed feature) and tactile (generating a tactile representation of a computed feature) manner. Thus, the observer can use several of his senses to perceive information from the image which may be otherwise hidden to his eyes, e.g. targets or patterns which are very difficult or impossible to detect. The human brain then fuses all the information from the multisensorial display. The moment the eyes make a saccade to a new fixation location, the same process is applied to the new ROI centred around it. In this way the observer receives information from the local real-time image analysis around the point of gaze, hence the term gaze-contingent image analysis. The new system is profiled and several example applications are discussed.
| Original language | English |
|---|---|
| Pages | 749 - 756 |
| Publication status | Published - Jul 2003 |
Bibliographical note
Sponsorship: Financial support from the Royal Society (UK) is gratefully acknowledged.Terms of use: Copyright © 2003 IEEE. Reprinted from Sixth International Conference of Information Fusion, 2003 (ICIF 2003).
This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of the University of Bristol's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected].
By choosing to view this document, you agree to all provisions of the copyright laws protecting it.
Name of Conference: 6th International Conference of Information Fusion
Venue of Conference: Cairns, Qld., Australia
Research Groups and Themes
- Cognitive Science
Keywords
- eye-tracking
- multisensorial
- information fusion
- display
- gaze-contingent
- image analysis