skip to main content
10.1145/2494091.2497281acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
tutorial

MyConverse: recognising and visualising personal conversations using smartphones

Published: 08 September 2013 Publication History

Abstract

MyConverse is a personal conversation recogniser and visualiser for smartphones. MyConverse uses the smartphone's microphone to continuously recognise the user's conversations during daily life. While it recognises pre-trained speakers, unknown speakers are detected and subsequently trained for future identification. Based on the recognition, MyConverse visualises user's social interactions on the smartphone. An extensive system parameter evaluation has been done based on a freely available dataset. Additionally, MyConverse was tested in different real-life environments and in a full-day evaluation study. The speaker recognition system reached an identification accuracy of 75% for 24 speakers in meeting room conditions. In other daily life situations MyConverse reached accuracies from 60% to 84%.

References

[1]
Choudhury, T. K. Sensing and Modeling Human Networks. PhD thesis, Massachusetts Institute of Technology, 2004.
[2]
Choudhury, T. K., and Pentland, A. The sociometer: A wearable device for understanding human networks. In Proc. of ACM Conf. on Computer Supported Cooperative Work (CSCW) (2002).
[3]
Deller, J. R., Proakis, J. G., and Hansen, J. H. Discrete-Time Processing of Speech Signals. Prentice Hall PTR, 2000.
[4]
Deshpande, M. S., and Holambe, R. S. Speaker identification based on robust am-fm features. In Proc. of Int. Conf. on Emerging Trends in Engineering & Technology (2009).
[5]
Deshpande, M. S., and Holambe, R. S. Speaker identification using admissible wavelet packet based decomposition. Int. Journal of Signal Processing 6, 1 (2010).
[6]
Kim, T., Brdiczka, O., Chu, M., and Begole, J. Predicting shoppers' interest from social interactions using sociometric sensors. In Proc. of Int. Conf. on Human Factors in Computing Systems (CHI) (2009).
[7]
Lu, H., Brush, A. B., Priyantha, B., Karlson, A. K., and Liu, J. Speakersense: Energy efficient unobtrusive speaker identification on mobile phones. Tech. rep., Microsoft Research, 2011.
[8]
May, T., van de Par, S., and Kohlrausch, A. Noise-robust speaker recognition combining missing data techniques and universal background modeling. IEEE Audio, Speech, and Language Processing 20, 1 (2012), 108--121.
[9]
Miluzzo, E., Cornelius, C., Ramaswamy, A., Choudhury, T., Liu, Z., and Campbell, A. Darwin phones: the evolution of sensing and inference on mobile phones. In Proc. of Int. Conf. on Mobile systems, applications, and services (MobiSys) (2010).
[10]
Olguin, D., P. A. Goor, and Pentland, A. Capturing individual and group behavior withwearable sensors. In Proc. of AAAI Spring Symposium on Human Behavior Modeling (2009).
[11]
Rachuri, K., Musolesi, M., Mascolo, C., Rentfrow, P., Longworth, C., and Aucinas, A. Emotionsense: A mobile phone based adaptive platform for experimental social psychology research. In Proc of Int. Conf. on Ubiquitous computing (UbiComp) (2010).
[12]
Raj, B., Turicchia, L., Schmidt-Nielsen, B., and Sarpeshkar, R. An fft-based companding front end for noise-robust automatic speech recognition. EURASIP J. Audio Speech Music Process, 2 (2007).
[13]
Reynolds, D. A. An Overview of Automatic Speaker Recognition Technology. In ICASSP 2002 (2002), 4072--4075.
[14]
Reynolds, D. A., Quatieri, T. F., and Dunn, R. B. Speaker verification using adapted gaussian mixture models. Tech. rep., M.I.T. Lincoln Laboratory, 2000.
[15]
Rossi, M., Amft, O., Kusserow, M., and Tröster, G. Collaborative Real-Time Speaker Identification for Wearable Systems. In Proc. of Int. Conf. on Pervasive Computing and Communications (PerCom) (2010).
[16]
Sarikaya, R., Pellom, B. L., and Hansen, J. H. L. Wavelet packet transform features with application to speaker identification. In Proc. of IEEE Nordic Signal Processing Symp., Visgo (1998).
[17]
Sen, N., Patil, H., and Basu, T. A new transform for robust text-independent speaker identification. In Proc. of IEEE India Conference (INDICON) (2009).

Cited By

View all
  • (2014)Personalised phone placement recognition in daily life using RFID tagging2014 IEEE International Conference on Pervasive Computing and Communication Workshops (PERCOM WORKSHOPS)10.1109/PerComW.2014.6815159(19-26)Online publication date: Mar-2014

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
September 2013
1608 pages
ISBN:9781450322157
DOI:10.1145/2494091
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2013

Check for updates

Author Tags

  1. real-time smartphone sensing
  2. speaker identification

Qualifiers

  • Tutorial

Conference

UbiComp '13
Sponsor:

Acceptance Rates

UbiComp '13 Adjunct Paper Acceptance Rate 254 of 399 submissions, 64%;
Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)2
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2014)Personalised phone placement recognition in daily life using RFID tagging2014 IEEE International Conference on Pervasive Computing and Communication Workshops (PERCOM WORKSHOPS)10.1109/PerComW.2014.6815159(19-26)Online publication date: Mar-2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media