skip to main content
10.1145/1394445.1394449acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

The role of a cohort in the design and evaluation of pervasive systems

Published:25 February 2008Publication History

ABSTRACT

In this paper, we describe a new methodology for the design and evaluation of pervasive systems. We have recruited a cohort of 30 participants who are engaging with an interdisciplinary pervasive computing project Cityware over 3 years. The cohort has been selected in order to represent a broad mix of ages and technological abilities so as to increase the ecological validity of evaluation of systems and applications developed in Cityware. We discuss some of the techniques and methods that we have been able to employ as a result of maintaining this group of participants and illustrate how their data feeds into Cityware studies and applications. While the costs of recruiting and maintaining a cohort such as this are relatively high, the benefits in terms of the depth, richness and validity of results produced in this way are considered to be significant. We discuss this in terms of the potential for new designs, the type of data one can collect and engagement within the city.

References

  1. Benford, S., Seagar, W., Flintham, M., Anastasi, R., Rowland, D., Humble, J., Stanton, D., Bowers, J., Tandavanitj, N., Adams, M., Row Farr, J., Oldroyd, A. and Sutton, J. The Error of our Ways: The experience of Self-Reported Position in a Location-Based Game. The 6th International Conference on Ubiquitous Computing. (UbiComp). Nottingham, September 2004. Springer/ACM pp. 70--87.Google ScholarGoogle ScholarCross RefCross Ref
  2. Bodker, S., Ehn, P., Kammersgaard, J., Kyng, M., Sundblad, Y. A Utopian Experience. Proceedings of the 1986 Conference on Computers and Democracy, Avebury pp. 251--278.Google ScholarGoogle Scholar
  3. Brown B., Chalmers, M., Bell, M., MacColl, I., Hall, M., MacColl, I., Rudman, P. Sharing the square: collaborative leisure in the city streets. Proceedings of ECSCW 2005, Paris, France. Springer. p427--429 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Cheverst, K. and Schmidt-Belz, B. "Mobile guides -- an HCI perspective", editorial, Special Issue of Journal of Behaviour and IT on 'HCI in Mobile Guides', Guest editors, K. Cheverst, B. Schmidt-Belz, Taylor and Francis Ltd. Volume 24, Number. 1, Jan-Feb 2005.Google ScholarGoogle Scholar
  5. Druin, A., Cooperative Inquiry: Developing new technologies for children with children. Proceedings of the ACM SIGCHI 99 Conference on Human Factors in Computing Systems, Pittsburgh, USA, 15--20 May, pp. 592--599 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Fraser, M., Stanton, D., Ng, K. H., Benford, S., O'Malley, C., Bowers, J., Taxén, G., Ferris, K., Hindmarsh, J. Assembling History: Achieving Coherent Experiences with Diverse Technologies. In Proceedings of ECSCW 2003, Helsinki, Finland. Kluwer. pp. 179--198 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Greenbaum, J. and Kyng, M., Design at work: Cooperative design of computer systems. Hillsdale, NJ: Lawrence Erlbaum. 1991 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Katz, J. E. Connections: Social and cultural studies of the telephone in American life. New Jersey: Transaction Publishers, 1999Google ScholarGoogle Scholar
  9. Kjeldskov, J. and Graham, C. "A review of mobile HCI research methods," in Human-Computer Interaction with Mobile Devices and Services: 5th International Symposium, Mobile HCI 2003 Udine, Italy, Lecture Notes in Computer Science. pp. 317--335.Google ScholarGoogle Scholar
  10. Lemish, D. "On the gendered nature of mobile phone culture in Israel," Sex Roles, pp. 511--521, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  11. Nicholas, D. and Chivhanga, M. "The communications love-affair: Children and the mobile phone," Library Association Record, vol. 104, pp. 90--95, 2002.Google ScholarGoogle Scholar
  12. O'Neill, E., Kostakos, V., Kindberg, T., Fatah gen. Shieck, A., Penn, A., Stanton Fraser, D., Jones, T. "Instrumenting the city: Developing methods for observing and understanding the digital cityscape," Proceedings of the 8th International Conference on Ubiquitous Computing, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Scaife, M. and Rogers, Y, Kids as informants: Telling us what we didn't know or confirming what we knew already, in A. Druin (ed.) The Design of Children's Technology. San Francisco, CA: Morgan Kaufmann. 1999 Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Stanton, D., Bayon, V., Neale, H., Ghali, A., Benford, S., Cobb, S., Ingram, R., Wilson, J., Pridmore, T., O'Malley, C. Classroom Collaboration in the Design of Tangible Interfaces for Storytelling. In Proceedings of Human Factors in Computing Systems (CHI 2001), ACM Press, Seattle, Washington, pp. 482--489 Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. J. Vincent, '11--16 mobile': Examining mobile phone and ICT use amongst children aged 11--16: University of Surrey: Digital World Research Centre, 2004.Google ScholarGoogle Scholar

Index Terms

  1. The role of a cohort in the design and evaluation of pervasive systems

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      DIS '08: Proceedings of the 7th ACM conference on Designing interactive systems
      February 2008
      487 pages
      ISBN:9781605580029
      DOI:10.1145/1394445

      Copyright © 2008 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 25 February 2008

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate1,158of4,684submissions,25%

      Upcoming Conference

      DIS '24
      Designing Interactive Systems Conference
      July 1 - 5, 2024
      IT University of Copenhagen , Denmark

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader