abstract

Do We Need Natural Language?: Exploring Restricted Language Interfaces for Complex Domains

Authors:

Advait SarkarAuthors Info & Claims

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: LBW2822, Pages 1 - 6

https://doi.org/10.1145/3290607.3312975

Published: 02 May 2019 Publication History

Abstract

Natural language interfaces (NLIs) that aim to understand arbitrary language are not only difficult to engineer; they can also create unrealistic expectations of the capabilities of the system, resulting in user confusion and disappointment. We use an interactive language learning game in a 3D blocks world to examine whether limiting a user's communication to a small set of artificial utterances is an acceptable alternative to the much harder task of accepting unrestricted language. We find that such a restricted language interface provides same or better performance on this task while improving user experience indices. This suggests that some NLIs can restrict user languages without sacrificing user experience and highlights the importance of conveying NLI limitations to users.

References

[1]

Matthew P Aylett, Per Ola Kristensson, Steve Whittaker, and Yolanda Vazquez-Alvarez. 2014. None of a CHInd: relationship counselling for HCI and speech technology. In CHI '14 Extended Abstracts on Human Factors in Computing Systems. 749--760.

Digital Library

[2]

Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013. Semantic parsing on freebase from question-answer pairs. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 1533--1544.

[3]

Benjamin R Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017. What can I help you with?: infrequent users' experiences of intelligent personal assistants. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. 43:1--43:12.

Digital Library

[4]

Sumit Gulwani and Mark Marron. 2014. NLyze: Interactive programming by natural language for spreadsheet data analysis and manipulation. In Proc. 2014 ACM SIGMOD International Conference on Management of Data. 803--814.

Digital Library

[5]

Brian Hansen, David G Novick, and Stephen Sutton. 1996. Systematic design of spoken prompts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 157--164.

Digital Library

[6]

Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 50. 904--908.

[7]

Gary G Hendrix. 1982. Natural-language interface. Computational Linguistics 8, 2 (1982), 56--61.

Digital Library

[8]

Julia Hirschberg and Christopher D Manning. 2015. Advances in natural language processing. Science 349, 6245 (2015), 261--266.

[9]

Laurent Karsenty. 2002. Shifting the design philosophy of spoken natural language dialogue: From invisible to transparent systems. International Journal of Speech Technology 5, 2 (2002), 147--157.

[10]

Nate Kushman and Regina Barzilay. 2013. Using semantic unification to generate regular expressions from natural language. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 826--836.

[11]

Gierad P Laput, Mira Dontcheva, Gregg Wilensky, Walter Chang, Aseem Agarwala, Jason Linder, and Eytan Adar. 2013. Pixeltone: A multimodal interface for image editing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2185--2194.

Digital Library

[12]

Ewa Luger and Abigail Sellen. 2016. Like having a really bad PA: the gulf between user expectation and experience of conversational agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5286--5297.

Digital Library

[13]

Martin Porcheron, Joel E Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 640:1--640:12.

Digital Library

[14]

Stefanie Tellex, Thomas Kollar, Steven Dickerson, Matthew R Walter, Ashis Gopal Banerjee, Seth J Teller, and Nicholas Roy. 2011. Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation. In AAAI Conference on Artificial Intelligence.

Digital Library

[15]

Sida I Wang, Percy Liang, and Christopher D Manning. 2016. Learning language games through interaction. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2368--2378.

[16]

Terry Winograd. 1971. Procedures as a representation for data in a computer program for understanding natural language. Technical Report. MIT.

Cited By

Ayli MBakouny YJalloul NKilany R(2024)Enhancing the Resiliency of Automated Web Tests with Natural LanguageProceedings of the 2024 4th International Conference on Artificial Intelligence, Automation and Algorithms10.1145/3700523.3700536(63-69)Online publication date: 27-Sep-2024
https://dl.acm.org/doi/10.1145/3700523.3700536
Do HBrachman MDugan CJohnson JLauer JRai PPan Q(2024)Grounding with Structure: Exploring Design Variations of Grounded Human-AI Collaboration in a Natural Language InterfaceProceedings of the ACM on Human-Computer Interaction10.1145/36869028:CSCW2(1-27)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686902
Drosos ISarkar AXu XNegreanu CRintel STankelevitch L(2024)"It's like a rubber duck that talks back": Understanding Generative AI-Assisted Data Analysis Workflows through a Participatory Prompting StudyProceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3663384.3663389(1-21)Online publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1145/3663384.3663389
Show More Cited By

Index Terms

Do We Need Natural Language?: Exploring Restricted Language Interfaces for Complex Domains
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing
      2. User studies
    2. Interaction paradigms
      1. Natural language interfaces

Recommendations

The economics of natural language interfaces: natural language processing technology as a scarce resource

This paper discusses appropriate application areas for natural language interfaces (NLIs) to databases. This requires comparing NLIs with competing approaches, including other user-friendly interfaces, and training of users with less user-friendly ...
Evaluating the usability of natural language query languages and interfaces to Semantic Web knowledge bases

The need to make the contents of the Semantic Web accessible to end-users becomes increasingly pressing as the amount of information stored in ontology-based knowledge bases steadily increases. Natural language interfaces (NLIs) provide a familiar and ...
Creating natural language interfaces to VR systems

Two research projects are described that explore the use of spoken natural language interfaces to virtual reality (VR) systems. Both projects combine off-the-shelf speech recognition and synthesis technology with in-house command interpreters that ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

3673 pages

ISBN:9781450359719

DOI:10.1145/3290607

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
368
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ayli MBakouny YJalloul NKilany R(2024)Enhancing the Resiliency of Automated Web Tests with Natural LanguageProceedings of the 2024 4th International Conference on Artificial Intelligence, Automation and Algorithms10.1145/3700523.3700536(63-69)Online publication date: 27-Sep-2024
https://dl.acm.org/doi/10.1145/3700523.3700536
Do HBrachman MDugan CJohnson JLauer JRai PPan Q(2024)Grounding with Structure: Exploring Design Variations of Grounded Human-AI Collaboration in a Natural Language InterfaceProceedings of the ACM on Human-Computer Interaction10.1145/36869028:CSCW2(1-27)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686902
Drosos ISarkar AXu XNegreanu CRintel STankelevitch L(2024)"It's like a rubber duck that talks back": Understanding Generative AI-Assisted Data Analysis Workflows through a Participatory Prompting StudyProceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3663384.3663389(1-21)Online publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1145/3663384.3663389
King EYu HLee SJulien C(2024)SashaProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435058:1(1-38)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643505
Harel DMarron A(2024)The Human-or-Machine Issue: Turing-Inspired Reflections on an Everyday MatterCommunications of the ACM10.1145/363721067:6(62-69)Online publication date: 23-May-2024
https://doi.org/10.1145/3637210
Liu MSarkar ANegreanu CZorn BWilliams JToronto NGordon A(2023)“What It Wants Me To Say”: Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language ModelsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580817(1-31)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580817
Tyagi NBhushan B(2023)Demystifying the Role of Natural Language Processing (NLP) in Smart City Applications: Background, Motivation, Recent Advances, and Future Research DirectionsWireless Personal Communications10.1007/s11277-023-10312-8130:2(857-908)Online publication date: 16-Mar-2023
https://doi.org/10.1007/s11277-023-10312-8
Elshan EZierau NEngel CJanson ALeimeister J(2022)Understanding the Design Elements Affecting User Acceptance of Intelligent Agents: Past, Present and FutureInformation Systems Frontiers10.1007/s10796-021-10230-924:3(699-730)Online publication date: 4-Jan-2022
https://doi.org/10.1007/s10796-021-10230-9
Matic RKabiljo MZivkovic MCabarkapa M(2021)Extensible Chatbot Architecture Using Metamodels of Natural Language UnderstandingElectronics10.3390/electronics1018230010:18(2300)Online publication date: 18-Sep-2021
https://doi.org/10.3390/electronics10182300

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten