Johanne R. Trippas
Damiano Spina
Mark Sanderson
Lawrence Cavedon
ABSTRACT
We propose research to investigate a new paradigm for Interactive Information Retrieval (IIR) where all input and output is mediated via speech. Our aim is to develop a new framework for effective and efficient IIR over a speech-only channel: a Spoken Conversational Search System (SCSS). This SCSS will provide an interactive conversational approach to determine user information needs, presenting results and enabling search reformulations. We have thus far investigated the format of results summaries for both audio and text, features such as summary length and summaries documents (noisy document or clean document) generated from (noisy) speech-recognition output from spoken document. In this paper we discuss future directions regarding a novel spoken interface targeted at search result presentation, query intent detection, and interaction patterns for audio search.
- L. Azzopardi and M. de Rijke. Automatic construction of known-item finding test beds. In Proc. of SIGIR'06, pages 603--604, 2006. Google Scholar
Digital Library
- C. Baber, B. Mellor, R. Graham, J. M. Noyes, and C. Tunley. Workload and the use of automatic speech recognition: The effects of time and resource demands. Speech Communication, 20 (1): 37--53, 1996. Google ScholarDigital Library
- E. Chang, F. Seide, H. M. Meng, C. Zhuoran, S. Yu, and L. Yuk-Chi. A system for spoken query information retrieval on mobile devices. Speech and Audio Processing, IEEE Trans. on, 10 (8): 531--541, 2002.Google Scholar
- K. Collins-Thompson, P. Bennett, F. Diaz, C. L. Clarke, and E. M. Voorhees. Trec 2013 web track overview. In Proc. of 22nd Text REtrieval Conference (TREC), 2014.Google Scholar
- V. Demberg and J. D. Moore. Information presentation in spoken dialogue systems. In Proc. of EACL'06, 2006.Google Scholar
- V. Demberg and A. Sayeed. Linguistic cognitive load: implications for automotive uis. In Proc. of AutomotiveUI 2011, 2011.Google Scholar
- V. Demberg, A. Winterboer, and J. D. Moore. A strategy for information presentation in spoken dialog systems. Computational Linguistics, 37 (3): 489--539, 2011. Google ScholarDigital Library
- G. Drzadzewski and F. Tompa. Enhancing exploration with a faceted browser through summarization. In Proc. of DocEng 2015, 2015. Google ScholarDigital Library
- M. Hearst. Search user interfaces. Cambridge University Press, 2009. Google ScholarDigital Library
- T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay. Accurately interpreting clickthrough data as implicit feedback. In Proc. of SIGIR '05, 2005. Google ScholarDigital Library
- S. R. Klemmer, A. K. Sinha, J. Chen, J. A. Landay, N. Aboobaker, and A. Wang. Suede: a wizard of oz prototyping tool for speech user interfaces. In Proc. of UIST'00, 2000. Google ScholarDigital Library
- J. Lai and N. Yankelovich. Speech Interface Design, pages 764--770. Elsevier, 2006.Google Scholar
- L. J. Najjar, J. J. Ockerman, and J. C. Thompson. User interface design guidelines for speech recognition applications. In Proc. of IEEE Virtual Reality Annual International Symposium (VRAIS '98), 1998.Google Scholar
- H.-T. Pu. User evaluation of textual results clustering for web search. Online Information Review, 34 (6): 855--874, 2010.Google ScholarCross Ref
- N. G. Sahib, D. Al Thani, A. Tombros, and T. Stockman. Accessible information seeking. In Proc. of Digital Futures '12, 2012.Google Scholar
- A. Stein and E. Maier. Structuring collaborative information-seeking dialogues. Knowledge-Based Systems, 8 (2): 82--93, 1995.Google ScholarDigital Library
- J. R. Trippas, D. Spina, M. Sanderson, and L. Cavedon. Towards understanding the impact of length in web search result summaries over a speech-only communication channel. In Proc. of SIGIR, 2015. Google ScholarDigital Library
- M. Turunen, J. Hakulinen, N. Rajput, and A. A. Nanavati. Evaluation of mobile and pervasive speech applications. In Speech in Mobile and Pervasive Environments, pages 219--262. 2012.Google ScholarCross Ref
- S. Varges, F. Weng, and H. Pon-Barry. Interactive question answering and constraint relaxation in spoken dialogue systems. Natural Language Engineering, 15 (01): 9--30, 2009. Google ScholarDigital Library
- M. Wolters, K. Georgila, J. D. Moore, R. H. Logie, S. E. MacPherson, and M. Watson. Reducing working memory load in spoken dialogue systems. Interacting with Computers, 21 (4): 276--287, 2009. Google ScholarDigital Library
- N. Yankelovich and J. Lai. Designing speech user interfaces. ACM, 1998.Google ScholarDigital Library
- N. Yankelovich, G.-A. Levow, and M. Marx. Designing speechacts: Issues in speech user interfaces. In Proc. of SIGCHI'95, 1995. Google ScholarDigital Library
Index Terms
- Results Presentation Methods for a Spoken Conversational Search System
Recommendations
How Do People Interact in Conversational Speech-Only Search Tasks: A Preliminary Analysis
CHIIR '17: Proceedings of the 2017 Conference on Conference Human Information Interaction and RetrievalWe present preliminary findings from a study of mixed initiative conversational behaviour for informational search in an acoustic setting. The aim of the observational study is to reveal insights into how users would conduct searches over voice where a ...
Informing the Design of Spoken Conversational Search: Perspective Paper
CHIIR '18: Proceedings of the 2018 Conference on Human Information Interaction & RetrievalWe conducted a laboratory-based observational study where pairs of people performed search tasks communicating verbally. Examination of the discourse allowed commonly used interactions to be identified for Spoken Conversational Search (SCS). We compared ...
Spoken Conversational Search: Speech-only Interactive Information Retrieval
CHIIR '16: Proceedings of the 2016 ACM on Conference on Human Information Interaction and RetrievalThis research investigates a new interface paradigm for interactive information retrieval (IIR) which forces us to shift away from the classic "ten blue links" search engine results page. Instead we investigate how to present search results through a ...
Comments