Skip to main content

The Needfinding Machine

  • Chapter
  • First Online:
Social Internet of Things

Part of the book series: Internet of Things ((ITTCC))

Abstract

Interactive systems present new opportunities for creating devices that attempt to learn the needs of people. However, inferring from data alone may not always allow for a true understanding of user needs. We suggest a vision of Social IoT where designers interact with users through machines as a new method for needfinding. We present a framework using interactive systems as Needfinding Machines. Acting through a Needfinding Machine, the designer observes behavior, asks questions, and remotely performs the machine in order to understand the user within a situated context. To explore a Needfinding Machine in use, we created DJ Bot, an interactive music agent that allows designers to remotely control music and talk to users about why they are listening. We show three test sessions where designers used DJ Bot with people listening to music while driving. These sessions suggest how Needfinding Machines can be used by designers to help empathize with users, discover potential needs and explore future alternatives for Social Internet of Things products.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The driver’s car was instrumented the evening before by the research team.

References

  1. Abras, C., Maloney-Krichmar, D., & Preece, J. (2004). User-centered design. In W. Bainbridge (Ed.), Encyclopedia of human-computer interaction (Vol. 37(4), pp. 445–456). Thousand Oaks: Sage Publications.

    Google Scholar 

  2. Aldaz, G., Steinert, M., & Leifer, L. J. (2013). Instrumenting the user: Needfinding by combining data logging and immediate self-reporting. In ResearchGate (Vol. 7). https://www.researchgate.net/publication/269764041_Instrumenting_the_user_Needfinding_by_combining_data_logging_and_immediate_self-reporting.

  3. Amin, A. K., Kersten, B. T., Kulyk, O. A., Pelgrim, P., Wang, C. M., & Markopoulos, P. (2005). Sensems: a user-centered approach to enrich the messaging experience for teens by non-verbal means. In: Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services (pp. 161–166). ACM.

    Google Scholar 

  4. Amir, D. (1999). Meeting the sounds. Music therapy practice, theory and research. Modan, Ben Shemen.

    Google Scholar 

  5. Andreasen, M. S., Nielsen, H. V., Schrøder, S. O., & Stage, J. (2007). What happened to remote usability testing?: An empirical study of three methods. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’07 (pp. 1405–1414). New York, NY, USA: ACM. http://doi.acm.org/10.1145/1240624.1240838.

  6. Berger, A., Bischof, A., & Sren Totzauer, M. S. K. L. A. K. (2018). The social internet of things, chap. Sensing home: Participatory exploration of smart sensors in the home. Springer.

    Google Scholar 

  7. Baur, D., Büttgen, J., & Butz, A. (2012). Listening factors: A large-scale principal components analysis of long-term music listening histories. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 1273–1276). ACM. http://dl.acm.org/citation.cfm?id=2208581.

  8. Bensimon, M., & Gilboa, A. (2010). The music of my life: The impact of the musical presentation on the sense of purpose in life and on self-consciousness. The Arts in Psychotherapy, 37(3), 172–178. https://doi.org/10.1016/j.aip.2010.03.002. http://www.sciencedirect.com/science/article/pii/S0197455610000274.

    Article  Google Scholar 

  9. Bentley, F., Metcalf, C., & Harboe, G. (2006). Personal versus commercial content: The similarities between consumer use of photos and music. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 667–676. ACM. http://dl.acm.org/citation.cfm?id=1124871.

  10. Beyer, H., & Holtzblatt, K. (1997). Contextual design: Defining customer-centered systems. Elsevier.

    Google Scholar 

  11. Black, J., & Abrams, M. (2018). Remote usability testing. The Wiley handbook of human computer interaction (pp. 277–297).

    Chapter  Google Scholar 

  12. Boehner, K., Vertesi, J., Sengers, P., & Dourish, P. (2007). How HCI interprets the probes. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’07 (pp. 1077–1086). New York, NY, USA: ACM. http://doi.acm.org/10.1145/1240624.1240789.

  13. Brennan, S. E. (1991). Conversation with and through computers. User Modeling and User-Adapted Interaction, 1(1), 67–86.

    Article  Google Scholar 

  14. Broadman, D., & Koo, S. (2016). Chatbots: Your ultimate prototyping tool. https://medium.com/ideo-stories/chatbots-ultimate-prototyping-tool-e4e2831967f3#.fnaltafiu.

  15. Brush, A. B., Ames, M., & Davis, J. (2004). A comparison of synchronous remote and local usability studies for an expert interface. In CHI ’04 extended abstracts on human factors in computing systems, CHI EA ’04 (pp. 1179–1182). New York, NY, USA: ACM. http://doi.acm.org/10.1145/985921.986018.

  16. Burzacca, P., & Paternò, F. (2013). Remote usability evaluation of mobile web applications (pp. 241–248). Berlin, Heidelberg: Springer. http://dx.doi.org/10.1007/978-3-642-39232-0_27.

    Chapter  Google Scholar 

  17. Cadotte, E. R. (1979). The push-button questionnaire: A new tool for measuring customer satisfaction. Cornell Hotel and Restaurant Administration Quarterly, 19(4), 70–79.

    Article  Google Scholar 

  18. Chen, E. S., & Cimino, J. J. (2003). Automated discovery of patient-specific clinician information needs using clinical information system log files. In AMIA Annual Symposium Proceedings (Vol. 2003, p. 145). American Medical Informatics Association.

    Google Scholar 

  19. Christian, B. (2012). The a/b test: Inside the technology thats changing the rules of business. Wired Magazine, 20(5) (2012).

    Google Scholar 

  20. Comber, R., Thieme, A., Rafiev, A., Taylor, N., Krämer, N., & Olivier, P. (2013). Bincam: Designing for engagement with facebook for behavior change. In: IFIP Conference on Human-Computer Interaction (pp. 99–115). Springer.

    Chapter  Google Scholar 

  21. Consolvo, S., & Walker, M. (2003). Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing, 2(2), 24–31.

    Article  Google Scholar 

  22. Cook, N. (2000). Music: A very short introduction. OUP Oxford.

    Google Scholar 

  23. Crabtree, A., Benford, S., Greenhalgh, C., Tennent, P., Chalmers, M., & Brown, B. (2006). Supporting ethnographic studies of ubiquitous computing in the wild. In: Proceedings of the 6th Conference on Designing Interactive Systems, DIS ’06 (pp. 60–69). New York, NY, USA: ACM. http://doi.acm.org/10.1145/1142405.1142417.

  24. Csikszentmihalyi, M., & Larson, R. (1987). Validity and reliability of the experience-sampling method. Journal of Nervous and Mental Disease.

    Article  Google Scholar 

  25. Dahlbäck, N., Jönsson, A., & Ahrenberg, L. (1993). Wizard of oz studies—why and how. Knowledge-based Systems, 6(4), 258–266.

    Article  Google Scholar 

  26. Dishman, E. (2003). Designing for the new old: Asking, observing and performing future elders. Design research: Methods and perspectives (pp. 41–48). Cambridge, MA and London, England: MIT Press.

    Google Scholar 

  27. Dourish, P. (2006). Implications for design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 541–550). ACM. http://dl.acm.org/citation.cfm?id=1124855.

  28. Dray, S., & Siegel, D. (2004). Remote possibilities? International usability testing at a distance. Interactions, 11(2), 10–17. http://doi.acm.org/10.1145/971258.971264.

    Article  Google Scholar 

  29. Dreyfuss, H. (2012). Designing for people. Skyhorse Publishing Inc.

    Google Scholar 

  30. Dubberly, H., & Pangaro, P. (2009). What is conversation? how can we design for effective conversation. Interactions Magazine, XVI, 4, 22–28.

    Google Scholar 

  31. English, J., & Rampoldi-Hnilo, L. (2004). Remote contextual inquiry: A technique to improve enterprise software. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 48(13), pp. 1483–1487). http://dx.doi.org/10.1177/154193120404801303.

    Article  Google Scholar 

  32. Faste, R. A. (1987). Perceiving needs. SAE Technical Paper 871534, Warrendale, PA: SAE International. http://papers.sae.org/871534/.

  33. Forlizzi, J., & Battarbee, K. (2004). Understanding experience in interactive systems. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (pp. 261–268). ACM. http://dl.acm.org/citation.cfm?id=1013152.

  34. Froehlich, J., Chen, M. Y., Consolvo, S., Harrison, B., & Landay, J. A. (2007). MyExperience: A system for in situ tracing and capturing of user feedback on mobile phones. In: Proceedings of the 5th International Conference on Mobile Systems, Applications and Services, MobiSys ’07 (pp. 57–70). New York, NY, USA: ACM. http://doi.acm.org/10.1145/1247660.1247670.

  35. Frohne-Hagemann, I. (1998). The “musical life panorama” (mlp). Nordisk Tidsskrift for Musikkterapi, 7(2), 104–112. http://dx.doi.org/10.1080/08098139809477930.

    Article  Google Scholar 

  36. Ganglbauer, E., Fitzpatrick, G., & Comber, R. (2013). Negotiating food waste: Using a practice lens to inform design. ACM Transactions on Computer-Human Interaction (TOCHI), 20(2), 11.

    Article  Google Scholar 

  37. Gaver, B., Dunne, T., & Pacenti, E. (1999). Design: Cultural probes. Interactions, 6(1), 21–29. http://dl.acm.org/citation.cfm?id=291235.

    Article  Google Scholar 

  38. Gaye, L., & Holmquist, L. E. (2004). In duet with everyday urban settings: A user study of sonic city. In Proceedings of the 2004 conference on New interfaces for musical expression (pp. 161–164). National University of Singapore.

    Google Scholar 

  39. Geertz, C. (1973). The interpretation of cultures: Selected essays, (Vol. 5019). Basic Books.

    Google Scholar 

  40. Geiger, R. S., & Ribes, D. (2011). Trace ethnography: Following coordination through documentary practices. In: 2011 44th Hawaii International Conference on System Sciences (pp. 1–10). https://doi.org/10.1109/HICSS.2011.455.

  41. Giaccardi, E., Cila, N., Speed, C., & Caldwell, M. (2016). Thing ethnography: Doing design research with non-humans. In: Proceedings of the 2016 ACM Conference on Designing Interactive Systems, DIS ’16 (pp. 377–387). New York, NY, USA: ACM. http://doi.acm.org/10.1145/2901790.2901905.

  42. Giaccardi, E., Speed, C., Cila, N., & Caldwell, M. (2016). Things as co-ethnographers: Implications of a thing perspective for design and anthropology. Design Anthropological Futures, 235.

    Google Scholar 

  43. Grudin, J., Ehrlich, S. F., & Shriner, R. (1986). Positioning human factors in the user interface development chain. SIGCHI Bull, 18(4), 125–131. http://doi.acm.org/10.1145/1165387.30871.

    Article  Google Scholar 

  44. Hargreaves, D. J., Miell, D., & MacDonald, R. A. (2002). What are musical identities, and why are they important. Musical Identities, 1–20.

    Google Scholar 

  45. Horvitz, E., Breese, J., Heckerman, D., Hovel, D., & Rommelse, K. (1998). The Lumire project: Bayesian user modeling for inferring the goals and needs of software users. In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, UAI’98 (pp. 256–265). San Francisco, CA, USA: Morgan Kaufmann Publishers Inc. http://dl.acm.org/citation.cfm?id=2074094.2074124.

  46. Hummels, C., & Frens, J., et al. (2008). Designing for the unknown: A design process for the future generation of highly interactive systems and products. In: DS 46: Proceedings of E&PDE 2008, the 10th International Conference on Engineering and Product Design Education, Barcelona, Spain, September 04–05, 2008.

    Google Scholar 

  47. Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., et al. (2003). Others: Technology probes: Inspiring design for and with families. In Proceedings of the SIGCHI conference on human factors in computing systems (pp 17–24). ACM. http://dl.acm.org/citation.cfm?id=642616.

  48. Johnstone, K. (2012). Impro: Improvisation and the theatre. Routledge.

    Google Scholar 

  49. Jones, J. C. (1992). Design methods. Wiley.

    Google Scholar 

  50. Kane, R. M., & Yuschik, M. (1987). A case example of human factors in product definition: Needs finding for a voice output workstation for the blind. In Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface, CHI ’87 (pp. 69–73). New York, NY, USA: ACM. http://doi.acm.org/10.1145/29933.30862.

    Article  Google Scholar 

  51. Kelley, J. F. (1983). An empirical methodology for writing user-friendly natural language computer applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’83 (pp. 193–196). New York, NY, USA: ACM. http://doi.acm.org/10.1145/800045.801609.

  52. Kelley, T. (2007). The art of innovation: Lessons in creativity from IDEO, America’s leading design firm. Crown Business. https://books.google.com/books?hl=en&lr=&id=yjgO70g_qbsC&oi=fnd&pg=PA5&dq=the+art+of+innovation&ots=Un68CbdATN&sig=lDERYluIqk_BIjB2heuBToIkBMg.

  53. Kuiper-Hoyng, L., & Beusmans, J. (2004). Using home networks to create atmospheres in the home: technology push or (latent) user need? In Proceedings of the Conference on Dutch Directions in HCI (p. 7). ACM.

    Google Scholar 

  54. Ladner, S. (2012). Is rapid ethnography possible? A cultural analysis of academic critiques of private-sector ethnography (part 2 of 3) (guest contributor). Ethnography Matters.

    Google Scholar 

  55. Laurel, B. (2003). Design research: Methods and perspectives. MIT Press.

    Google Scholar 

  56. Lee, J. H., & Price, R. (2016). User experience with commercial music services: An empirical exploration. Journal of the Association for Information Science and Technology, 67(4), 800–811. https://doi.org/10.1002/asi.23433. http://onlinelibrary.wiley.com/doi/10.1002/asi.23433/abstract.

    Article  Google Scholar 

  57. Mantei, M. (1986). Techniques for incorporating human factors in the software lifecycle. Division of Research: Graduate School of Business Administration, University of Michigan.

    Google Scholar 

  58. Martelaro, N., & Ju, W. (2017). WoZ Way: Enabling real-time interaction prototyping and on-road observation. In: Proceedings of the 2017 Conference on Computer Supported Cooperative Work. Portland, OR. https://doi.org/10.1145/2998181.2998293.

  59. Mattelmäki, T., & Battarbee, K. (2002). Empathy probes. In PDC (pp. 266–271).

    Google Scholar 

  60. Maulsby, D., Greenberg, S., & Mander, R. (1993). Prototyping an intelligent agent through wizard of oz. In Proceedings of the INTERACT’93 and CHI’93 Conference on Human Factors in Computing Systems (pp. 277–284). ACM.

    Google Scholar 

  61. Millen, D. R. (2000). Rapid ethnography: Time deepening strategies for HCI field research. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, DIS ’00, pp. 280–286. New York, NY, USA: ACM. http://doi.acm.org/10.1145/347642.347763.

  62. Molin, L. (2004). Wizard-of-Oz prototyping for co-operative interaction design of graphical user interfaces. In Proceedings of the Third Nordic Conference on Human-computer Interaction, NordiCHI ’04 (pp. 425–428). New York, NY, USA: ACM. http://doi.acm.org/10.1145/1028014.1028086.

  63. Nass, C., Moon, Y., & Carney, P. (1999). Are people polite to computers? Responses to computer-based interviewing systems. Journal of Applied Social Psychology, 29(5), 1093–1109.

    Article  Google Scholar 

  64. Owen, D. (2018). Customer satisfaction at the push of a button. https://www.newyorker.com/magazine/2018/02/05/customer-satisfaction-at-the-push-of-a-button?mbid=social_twitter.

  65. Patnaik, D., & Becker, R. (1999). Needfinding: The why and how of uncovering people’s needs. Design Management Journal (Former Series), 10(2), 37–43. https://doi.org/10.1111/j.1948-7169.1999.tb00250.x. http://onlinelibrary.wiley.com/doi/10.1111/j.1948-7169.1999.tb00250.x/abstract.

    Article  Google Scholar 

  66. Patton, M. Q. (1990). Qualitative evaluation and research methods. SAGE Publications, inc.

    Google Scholar 

  67. Plowman, T. (2003). Ethnography and critical design practice. Design research: Methods and perspectives (pp. 30–38).

    Google Scholar 

  68. Rashid, A. M., Albert, I., Cosley, D., Lam, S. K., McNee, S. M., Konstan, J. A., & Riedl, J. (2002). Getting to know you: Learning new user preferences in recommender systems. In Proceedings of the 7th International Conference on Intelligent user Interfaces, pp. 127–134. ACM. http://dl.acm.org/citation.cfm?id=502737.

  69. Rosen, P. (2016). Eero Saarinen: the architect who saw the future. http://www.pbs.org/wnet/americanmasters/eero-saarinen-film/7507/.

  70. Rottgers, J. (2018). Spotifys line-in tool lets users add tags, moods and other metadata. http://variety.com/2018/digital/news/spotify-line-in-music-metadata-1202723757/.

  71. Sas, C., Whittaker, S., Dow, S., Forlizzi, J., & Zimmerman, J. (2014). Generating implications for design through design research. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’14 (pp. 1971–1980). New York, NY, USA: ACM. http://doi.acm.org/10.1145/2556288.2557357.

  72. Schedl, M., Knees, P., McFee, B., Bogdanov, D., & Kaminskas, M. (2015). Music recommender systems. In Recommender systems handbook (pp. 453–492). Springer.

    Chapter  Google Scholar 

  73. Schön, D. A. (1983). The reflective practitioner: How professionals think in action (Vol. 5126). Basic Books.

    Google Scholar 

  74. Sengers, P., Boehner, K., David, S., & Kaye, J. J. (2005). Reflective design. In Proceedings of the 4th Decennial Conference on Critical Computing: Between Sense and Sensibility, CC ’05 (pp. 49–58). New York, NY, USA, ACM. http://doi.acm.org/10.1145/1094562.1094569.

  75. Simon, H. A. (1996). The sciences of the artificial. MIT Press.

    Google Scholar 

  76. Sirkin, D., Fischer, K., Jensen, L., & Ju, W. (2016). Eliciting conversation in robot vehicle interactions. In 2016 AAAI Spring Symposium Series. http://www.aaai.org/ocs/index.php/SSS/SSS16/paper/view/12755.

  77. Speed, C., & Oberlander, J. (2016). Designing from, with and by Data: Introducing the ablative framework. In Proceedings of the 50th Anniversary Conference of the Design Research Society.

    Google Scholar 

  78. Suchman, L. A. (1987). Plans and situated actions: The problem of human-machine communication. Cambridge University Press.

    Google Scholar 

  79. Trevarthen, C. (2002). Origins of musical identity: Evidence from infancy for musical social awareness. Musical Identities (pp. 21–38) (2002).

    Google Scholar 

  80. Verplank, B. (2003). Interaction design sketchbook. Unpublished paper for CCRMA course Music 250a. http://www.billverplank.com/IxDSketchBook.pdf.

  81. Wakkary, R., Oogjes, D., Hauser, S., Lin, H., Cao, C., Ma, L., et al. (2017). Morse things: A design inquiry into the gap between things and us. In Proceedings of the 2017 Conference on Designing Interactive Systems, DIS ’17 (pp. 503–514). New York, NY, USA: ACM. http://doi.acm.org/10.1145/3064663.3064734.

  82. Waterson, S., Landay, J. A., & Matthews, T. (2002). In the lab and out in the wild: Remote web usability testing for mobile devices. In CHI ’02 extended abstracts on human factors in computing systems, CHI EA ’02 (pp. 796–797). New York, NY, USA: ACM. http://doi.acm.org/10.1145/506443.506602.

  83. Weiser, M. (1999). The computer for the 21st century. SIGMOBILE Mobile Computing Research Community, 3(3), 3–11. http://doi.acm.org/10.1145/329124.329126.

    Article  Google Scholar 

  84. Weizenbaum, J. (1966). Eliza—a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1), 36–45.

    Article  Google Scholar 

  85. Wright, P., & McCarthy, J. (2008). Empathy and experience in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’08 (pp. 637–646). New York, NY, USA: ACM. http://doi.acm.org/10.1145/1357054.1357156.

  86. Zhang, B., Kreitz, G., Isaksson, M., Ubillos, J., Urdaneta, G., Pouwelse, J. A., et al. (2013). Understanding user behavior in spotify. In 2013 Proceedings IEEE INFOCOM (pp. 220–224). https://doi.org/10.1109/INFCOM.2013.6566767.

Download references

Acknowledgements

The authors would like to thank Kyu Keough, Henriette Cramer, and Jenn Thom for participating as DJ Bot wizards. They would also like to thank Paul Pangaro, Henriette Cramer, Jenn Thom, and Alessandro Soro for providing comments on an early draft of this chapter.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nikolas Martelaro .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Martelaro, N., Ju, W. (2019). The Needfinding Machine. In: Soro, A., Brereton, M., Roe, P. (eds) Social Internet of Things. Internet of Things. Springer, Cham. https://doi.org/10.1007/978-3-319-94659-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-94659-7_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-94657-3

  • Online ISBN: 978-3-319-94659-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics