Skip to main content
Springer Nature Link
Log in

A Multi-modal Communication Approach to Describing the Surroundings to Mobile Users

  • Conference paper
Web and Wireless Geographical Information Systems (W2GIS 2013)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7820))

  • 1073 Accesses

Abstract

Mobile users frequently pass non-obvious features that could be represented to the user in a multi-modal manner. This type of information can be used to affect the decision making of the user or to complement his or her navigation experience. However, data providers do not have a common data interchange schema for describing geographical features multi-modally. This paper presents a multi-modal approach by extending the GeoJSON, GML, and KML formats to describe the surroundings of a mobile user in a Location-Based Service. In addition, the paper discusses how the approach can be implemented on a mobile client. Finally, the paper demonstrates how the proposal has been implemented with a functional prototype for a hiking use case.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Alvestrand, H.: Tags for the Identification of Languages, RFC 1766, Network Working Group, Internet Engineering Task Force (1995)

    Google Scholar 

  2. Aslan, I., Schwalm, M., Baus, J., Krüger, A., Schwartz, T.: Acquisition of Spatial Knowledge in Location Aware Mobile Pedestrian Navigation Systems. In: Proceedings of the 8th Conference on Human-Computer Interaction With Mobile Devices and Services, MobileHCI 2006, Helsinki, Finland, pp. 105–108. ACM, New York (2006)

    Chapter  Google Scholar 

  3. Baus, J., Wasinger, R., Aslan, I., Krüger, A., Maier, A., Schwartz, T.: Auditory perceptible landmarks in mobile navigation. In: Proceedings of the 12th International Conference on Intelligent User Interfaces, IUI 2007, Honolulu, Hawaii, USA, pp. 302–304. ACM, New York (2007)

    Chapter  Google Scholar 

  4. Blattner, M.M., Sumikawa, D.A., Greenberg, R.M.: Earcons and icons: Their structure and common design principles. Human-Computer Interaction 4, 11–44 (1989)

    Article  Google Scholar 

  5. Butler, H., Daly, M., Doyle, A., Gillies, S., Schaub, T., Schmidt, C.: The GeoJSON Format Specification, Revision: 1.0 (2008)

    Google Scholar 

  6. Caquard, S., Brauen, G., Wright, B.: Exploring sound design in cybercartography. In: Proceedings of the 22nd International Cartographic Conference (ICC), July 9-16 (2005)

    Google Scholar 

  7. Cheverst, K., Davies, N., Mitchell, K., Friday, A., Efstratiou, C.: Developing a context-aware electronic tourist guide: some issues and experiences. In: Proceedings of the International Conference on Human-Computer Interaction, CHI 2000, The Hague, The Netherlands, pp. 17–24. ACM, New York (2000)

    Google Scholar 

  8. Chittaro, L., Burigat, S.: Augmenting audio messages with visual directions in mobile guides: an evaluation of three approaches. In: Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services, MobileHCI 2005, Salzburg, Austria, pp. 107–114. ACM, New York (2005)

    Chapter  Google Scholar 

  9. Ciavarella, C., Paternò, F.: The design of a handheld, location-aware guide for indoor environments. Personal and Ubiquitous Computing 8(2), 82–91 (2004)

    Article  Google Scholar 

  10. Crockford, D.: The application/json Media Type for JavaScript Object Notation (JSON), RFC 4627, Network Working Group, The Internet Engineering Task Force (2006)

    Google Scholar 

  11. eSpeak: Speech Synthesizer, version 1.46.27 (2012), http://espeak.sourceforge.net

  12. Furieri, A.: SpatiaLite, version 3.0.0 (2011), http://www.gaia-gis.it/fossil/libspatialite/index

  13. Gaver, W.W.: Auditory icons: Using sound in computer interfaces. Human-Computer Interaction 2, 167–177 (1986)

    Article  Google Scholar 

  14. Ghiani, G., Leporini, B., Paternò, F.: Supporting orientation for blind people using museum guides. In: CHI 2008 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2008, Florence, Italy, pp. 3417–3422. ACM, New York (2008)

    Google Scholar 

  15. Gong, L., Lai, J.: To Mix or Not to Mix Synthetic Speech and Human Speech? Contrasting Impact on Judge-Rated Task Performance versus Self-Rated Performance and Attitudinal Responses. International Journal of Speech Technology 6(2), 123–131 (2003)

    Article  Google Scholar 

  16. Graham, C., Cheverst, K.: Guides, locals, chaperones, buddies and captains: managing trust through interaction paradigms. In: Workshop on Mobile Guides at the Fifth International Symposium on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2004, Glasgow, Scotland (2004)

    Google Scholar 

  17. Guy, R., Truong, K.: Crossingguard: exploring information content in navigation aids for visually impaired pedestrians. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2012, Austin, Texas, USA, pp. 405–414. ACM, New York (2012)

    Google Scholar 

  18. Hameseder, K., Fowler, S., Peterson, A.: Performance analysis of ubiquitous web systems for SmartPhones. In: International Symposium on Performance Evaluation of Computer Telecommunication Systems, SPECTS 2011, pp. 84–89 (2011)

    Google Scholar 

  19. Heuten, W., Wichmann, D., Boll, S.: Interactive 3d sonification for the exploration of city maps. In: Proceedings of the 4th Nordic Conference on Human-Computer Interaction: Changing Roles, NordiCHI 2006, Oslo, Norway, pp. 155–164. ACM, New York (2006)

    Chapter  Google Scholar 

  20. Holland, S., Morse, D.R., Gedenryd, H.: AudioGPS: Spatial audio navigation with a minimal attention interface. Personal and Ubiquitous Computing 6(4), 253–259 (2002)

    Article  Google Scholar 

  21. Kainulainen, A., Turunen, M., Hakulinen, J., Melto, A.: Soundmarks in spoken route guidance. In: Proceedings of the 13th International Conference on Auditory Display, Montreal, Canada (2007)

    Google Scholar 

  22. Kan, A., Pope, G., Jin, C., van Schaik, A.: Mobile Spatial Audio Communication System. In: Proceedings of ICAD 2004-Tenth Meeting of the International Conference on Auditory Display (July 2004)

    Google Scholar 

  23. Kangasharju, J., Tarkoma, S.: Benefits of alternate XML serialization formats in scientific computing. In: Proceedings of the 2007 Workshop on Service-Oriented Computing Performance: Aspects, Issues, and Approaches, SOCP 2007, Monterey, California, USA, pp. 23–30. ACM, New York (2007)

    Chapter  Google Scholar 

  24. Krüger, A., Aslan, I., Zimmer, H.D.: The Effects of Mobile Pedestrian Navigation Systems on the Concurrent Acquisition of Route and Survey Knowledge. In: Brewster, S., Dunlop, M.D. (eds.) Mobile HCI 2004. LNCS, vol. 3160, pp. 446–450. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  25. Liljedahl, M., Lindberg, S., Delsing, K., Polojärvi, M., Saloranta, T., Alakärppä, I.: Testing Two Tools for Multimodal Navigation. In: Advances in Human-Computer Interaction (2012)

    Google Scholar 

  26. Mabrouk, M.: OpenGIS® Location Services (OpenLS): Core Services, Document OGC 07-074, Version 1.2, Open Geospatial Consortium Inc. (2008)

    Google Scholar 

  27. McGookin, D., Brewster, S., Priego, P.: Audio Bubbles: Employing Non-speech Audio to Support Tourist Wayfinding. In: Altinsoy, M.E., Jekosch, U., Brewster, S. (eds.) HAID 2009. LNCS, vol. 5763, pp. 41–50. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  28. Münzer, S., Zimmer, H.D., Schwalm, M., Baus, J., Aslan, I.: Computer-assisted navigation and the acquisition of route and survey knowledge. Journal of Environmental Psychology 26(4), 300–308 (2006)

    Article  Google Scholar 

  29. Oppermann, R., Specht, M.: A nomadic information system for adaptive exhibition guidance. In: Proc. of the International Conference on Hypermedia and Interactivity in Museums, pp. 103–109 (1999)

    Google Scholar 

  30. Petrelli, D., Not, E., Sarini, M., Stock, O., Strapparava, C., Zancanaro, M.: Hyperaudio: location-awareness + adaptivity. In: CHI 1999 Extended Abstracts on Human Factors in Computing Systems, CHI EA 1999, pp. 21–22. ACM, New York (1999)

    Google Scholar 

  31. Pielot, M., Henze, N., Boll, S.: Supporting Map-Based Wayfinding with Tactile Cues. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2009, Bonn, Germany, pp. 1–10. ACM, New York (2009)

    Google Scholar 

  32. Pielot, M., Poppinga, B., Boll, S.: Understanding tourists on a bicycle trip “in the wild”. In: Mobile Living Labs Workshop in Conjunction with MobileHCI 2009 (2009)

    Google Scholar 

  33. Richter, K.-F.: A Uniform Handling of Different Landmark Types in Route Directions. In: Winter, S., Duckham, M., Kulik, L., Kuipers, B. (eds.) COSIT 2007. LNCS, vol. 4736, pp. 373–389. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  34. Rodrigues, C., Afonso, J., Tomé, P.: Mobile Application Webservice Performance Analysis: Restful Services with JSON and XML. In: Cruz-Cunha, M.M., Varajão, J., Powell, P., Martinho, R. (eds.) CENTERIS 2011, Part II. CCIS, vol. 220, pp. 162–169. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  35. Sumaray, A., Makki, S.K.: A comparison of data serialization formats for optimal efficiency on a mobile platform. In: Proceedings of the 6th International Conference on Ubiquitous Information Management and Communication, ICUIMC 2012, Kuala Lumpur, Malaysia, pp. 48:1–48:6. ACM, New York (2012)

    Google Scholar 

  36. van den Brink, L., Portele, C., Vretanos, P.A.: Geography Markup Language (GML) simple features profile (with Corrigendum), Version 2.0, OGC® 10-100r3, Open Geospatial Consortium (2012)

    Google Scholar 

  37. Van House, N., Davis, M.: The Social Life of Cameraphone Images. In: Proceedings of the Pervasive Image Capture and Sharing: New Social Practices and Implications for Technology Workshop (PICS 2005) at the Seventh International Conference on Ubiquitous Computing (UbiComp 2005), Tokyo, Japan (2005)

    Google Scholar 

  38. Wilson, G.: Multimedia tour programme at tate modern. In: Bearman, D., Trant, J. (eds.) Proceedings of the Museums and the Web 2004. Archives & Museum Informatics, Toronto (2004)

    Google Scholar 

  39. Wilson, T.: OGC®KML, Version: 2.2.0, Document 07-147r2, Open Geospatial Consortium (2008)

    Google Scholar 

  40. Zyp, K.: A JSON Media Type for Describing the Structure and Meaning of JSON Documents, Version 03, Internet-Draft, Internet Engineering Task Force (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Geoinformatics and Cartography, Finnish Geodetic Institute, P.O. Box 15, 02431, Masala, Finland

    Janne Kovanen, Tapani Sarjakoski & L. Tiina Sarjakoski

Authors
  1. Janne Kovanen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tapani Sarjakoski
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. L. Tiina Sarjakoski
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Geomatics Engineering, University of Calgary, T2N 1N4, Calgary, AB, Canada

    Steve H. L. Liang  & Xin Wang  & 

  2. Naval Academy Research Institute, Lanvéoc-Poulmic, BP 600, France

    Christophe Claramunt

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kovanen, J., Sarjakoski, T., Sarjakoski, L.T. (2013). A Multi-modal Communication Approach to Describing the Surroundings to Mobile Users. In: Liang, S.H.L., Wang, X., Claramunt, C. (eds) Web and Wireless Geographical Information Systems. W2GIS 2013. Lecture Notes in Computer Science, vol 7820. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37087-8_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37087-8_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37086-1

  • Online ISBN: 978-3-642-37087-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics