Abstract
In this paper, we examine the feasibility of sound source localization (SSL) in a home environment, and explore its potential to support inference of communication activity between people. Motivated by recent research in pervasive computing that uses a variety of sensor modes to infer high-level activity, we are interested in exploring how the relatively simple information of SSL might contribute. Our SSL system covers a significant portion of the public space in a realistic home setting by adapting traditional SSL algorithms developed for more highly-controlled lab environments. We describe engineering tradeoffs that result in a localization system with a fairly good 3D resolution. To help make design decisions for deploying a SSL system in a domestic environment, we provide a quantitative assessment of the accuracy and precision of our system. We also demonstrate how such a sensor system can provide a visualization to help humans infer activity in that space. Finally, we show preliminary results for automatic detection of face-to-face conversations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abowd, G.D., Battestini, A., O’Connell, T.: The Location Service: A framework for handling multiple location sensing technologies. GVU technical report, Georgia Institute of Technology Technical Report (2002)
Benesty, J., Elko, G.W.: Adaptive eigenvalue decomposition algorithm for real-time acoustic source localization system. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 1999), pp. 937–940 (2001)
Bian, X., Rehg, J.M., Abowd, G.D.: Sound Source Localization in Domestic Environment. GVU center, Georgia Inst. of Technology Technical Report GIT-GVU-04- 06 (2004)
Castro, P., Chiu, P., Kremenek, T., Muntz, R.: A Probabilistic Room Location Service for Wireless Networked Environments. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201, pp. 18–24. Springer, Heidelberg (2001)
Checka, N., Wilson, K., Siracusa, M., Darrell, T.: Multiple Person and Speaker Activity Tracking with a Particle Filter. In: Proceedings of International Conference on Acoustics, Speech, and Signal Processing (2004)
Cheverst, K.: Developing a Context-Aware Electronic Tourist Guide: Some Issues and Experiences. In: Proc. 2000 Conf. Human Factors in Computing Systems, pp. 17–24. ACM Press, New York (2000)
Di Biase, J., Silverman, H., Brandstein, M.: Localization in Reverberant Rooms. In: Brandstein, M.S., Ward, D.B. (eds.) Microphone Arrays: Signal Processing Techniques and Applications. Springer, Heidelberg (2001)
Haritaoglu, I., Harwood, D., Davis, L.S.: W4: Real-Time Surveillance of People and Their Activities. In: Proceedings of IEEE Trans. On PAMI (2000)
Harter, A., Hopper, A.: A Distributed Location System for the Active Office. IEEE Network 8(1), 62–70 (1994)
Harter, A., Hopper, A., Steggles, P., Ward, A., Webster, P.: The Anatomy of a Context- Aware Application. In: Proceedings of Int’l Conf. Mobile Computing and Networking (MobiCom 1999), pp. 59–68. ACM Press, New York (1999)
Hightower, J., Borriello, G.: Location Systems for Ubiquitous Computing. Computer 34(8), 57–66 (2001)
Hudson, S., Fogarty, J., Atkeson, C., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J., Yang, J.: Predicting Human Interruptability with Sensors: A Wizard of Oz Feasibility Study. In: Proceedings of CHI Letters (Proceedings of the CHI 2003 Conference on Human Factors in Computing Systems), pp. 377–384 (2003)
Intel Research Place Lab Project, http://www.placelab.org (Downloaded on Ocober 6, 2004)
Intel Research SHARP Project, http://seattleweb.intel-research.net/projects/activity (Download on October 6, 2004)
Knapp, C.H., Carter, G.C.: The generalized correlation method for estimation of time delay. IEEE Transaction on Acoustics, Speech and Signal Process (ASSP-24) 24, 320–327 (1976)
Koile, K., Tollmar, K., Demirdjian, D., Shrobe, H., Darrell, T.: Activity zones for context-aware computing. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, pp. 90–106. Springer, Heidelberg (2003)
Krumm, J., Harris, S., Meyers, B., Brumitt, B., Hale, M., Shafer, S.: Multi-Camera Multi-Person Tracking for EasyLiving. In: Proceedings of IEEE Workshop on Visual Surveillance, Dublin, Ireland (2000)
Nagel, K.S., Hudson, J.M., Abowd, G.D.: Predictors of Availability in Home Life Context-Mediated Communication. In: Proceedings of Computer Supported Collaborative Work, 2004, Chicago, IL USA (2004)
Priyantha, N.B., Chakraborty, A., Balakrishnan, H.: The Cricket Location-Support System. In: Proceedings of Proc. 6th Ann. Int’l Conf. Mobile Computing and Networking (Mobicom 2000), pp. 32–43. ACM Press, New York (2000)
Rehg, J.M., Morris, D.D., Kanade, T.: Ambiguities in Visual Tracking of Articulated Objects Using Two- and Three-Dimensional Models. Int. J. of Robotics Research 22(6), 393–418 (2003)
Rui, Y., Florencio, D.: New direct approaches to robust sound source localization. In: Proceedings of Proc. of IEEE ICME 2003, Baltimore, MD (2003)
Schmandt, C., Vallejo, G.: ”LISTENIN” to domestic environments from remote locations. In: Proceedings of the 9th International Conference on Auditory Display, Boston University, USA (2003)
Tapia, E.M., Intille, S.S., Larson, K.: Activity Recognition in the Home Using Simple and Ubiquitous Sensors. In: Ferscha, A., Mattern, F. (eds.) PERVASIVE 2004. LNCS, vol. 3001, pp. 158–175. Springer, Heidelberg (2004)
Venkatesh, A.: Computers and Other Interactive Technologies for the Home. Communications of the ACM, 47–54 (1996)
Wang, C., Griebel, S.: Automatic Video-Conferencing With Multiple Cameras And Microphones. In: Proceedings of IEEE International Conference on Multimedia (2000)
Wren, C., Azarbayejani, A., Darrell, T.: Real-Time Tracking of the Human Body. In: Proceedings of IEEE Transactions on Pattern Analysis and Machine Intelligence (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bian, X., Abowd, G.D., Rehg, J.M. (2005). Using Sound Source Localization in a Home Environment. In: Gellersen, H.W., Want, R., Schmidt, A. (eds) Pervasive Computing. Pervasive 2005. Lecture Notes in Computer Science, vol 3468. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11428572_2
Download citation
DOI: https://doi.org/10.1007/11428572_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26008-0
Online ISBN: 978-3-540-32034-0
eBook Packages: Computer ScienceComputer Science (R0)