Abstract
Planning of transportation infrastructure requires analyzing combinations of many different types of geo-spatial information (maps). Displaying all of these maps together in a tradition Geographic Information System (GIS) limits its effectiveness with visual clutter and information overload. Multi-modal interfaces (MMIs) aim to improve the efficiency of human-computer interaction by combining several types of sensory modalities. We are presenting a prototype virtual environment using vision, haptics and sonification for multi-modal GIS scenarios such as road planning. We use a point-haptic device (Phantom) for various haptic effects and sonification to present additional non-visual data while drawing on a virtual canvas. We conducted a user study to gather experience with this multi-modal system and to learn more about how these users interact with geospatial data via various combinations of sensory modalities. The results indicate that certain forms of haptics and audio were preferentially used to present certain types of spatial data.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Emery, V.K., Edwards, P.J., Jacko, J.A., Moloney, K.P., Barnard, L., Kongnakorn, T., Sainfort, F., Scott, I.U.: Toward Achieving Universal Usability for Older Adults Through Multimodal Feedback. In: Proc. of the 2003 Conference on Universal Usability (2003)
Flowers: Thirteen Years of reflection on Auditory Graphing. In: Proc. of ICAD 2005, Limerick, Ireland (2005)
Fisher, P.F.: Visualizing uncertainty in soil maps by animation. Cartographica 30(2&3), 20–27 (1993)
Gaver, W.: Auditory Icons: Using sounds in computer interfaces. Human-Computer Interaction 2, 167–177 (1986)
Griffin, A.L.: Feeling it out: The use of haptic visualization for exploratory geographical visualization. Cartographic Perspectives 39, 12–29 (2002)
Harding, C., Newcomb, M.: Supporting Interactive Data Exploration for GIS Planning Tasks with a Multi-modal Virtual Environment. In: Proc. of HAVE 2004 (2004)
Jacobson, R.D.: Representing Spatial Information through Multimodal Interfaces. In: Proc. of the Sixth International Conference on Information Visualisation (2002)
Krygier, J.B.: Sound and Geographic Visualization. In: MacEachren, A., Taylor, D.R.F. (eds.) Visualization in Modern Cartography, pp. 149–166. Pergamon, New York (1994)
McGee, M.R., Gray, P., Brewster, S.: The effective combination of haptic and auditory textural information. In: Brewster, S., Murray-Smith, R. (eds.) Haptic HCI 2000. LNCS, vol. 2058, p. 118. Springer, Heidelberg (2001)
Miller, G.A.: The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. The Psychological Review 63, 81–97 (1956)
Newcomb, M.C.: Results, from a user study of a multi-modal road planning system, MS thesis, Iowa State University (in preparation, 2006)
Oviatt, S., Coulston, R., Lunsford, R.: When Do We Interact Multimodally? Cognitive Load and Multimodal Communication Patterns. In: Proc. of the Sixth International Conference on Multimodal Interfaces (ICMI 2004), Pennsylvania, USA, October 14-15 (2004)
Samman, S., Stanney, K., Sims, V.: Think Multimodal to Maximize Information Management Capacity. In: HCI International (2005)
Wall, S., Brewster, S.: Scratching the Surface: Preliminary Investigations of Haptic Properties for Data Representation, Eurohaptics, Dublin, Ireland, pp. 330–342 (2003)
Wickens, C.D.: Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science 3(2), 159–177 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Newcomb, M., Harding, C. (2006). A Multi-Modal Interface for Road Planning Tasks Using Vision, Haptics and Sound. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2006. Lecture Notes in Computer Science, vol 4292. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11919629_43
Download citation
DOI: https://doi.org/10.1007/11919629_43
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-48626-8
Online ISBN: 978-3-540-48627-5
eBook Packages: Computer ScienceComputer Science (R0)