skip to main content
10.1145/2597008.2597791acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
Article

Enabling integrated development environments with natural user interface interactions

Published: 02 June 2014 Publication History

Abstract

The paper introduces the concept of applying Natural User Interface (NUI) interactions in the context of Integrated Development Environments (IDEs). Human voice and gestures are mapped to several IDE commends. A prototype tool is developed using the Microsoft Kinect hardware sensors and the available software development kits for Microsoft Visual Studio. A pilot study was conducted to assess the developed prototype. The results of the study suggest that it might be possible to apply natural interactions to a range of IDE capabilities.

References

[1]
A. Begel and S.L. Graham. An assessment of a speech-based programming environment. In Visual Languages and Human-Centric Computing, 2006. VL/HCC 2006. IEEE Symposium on, pages 116–120, Sept 2006.
[2]
Wei-Chieh Fang, Yu-Lun Lin, Feng-Ru Sheu, and Nian-Shing Chen. Exploring problem solving performance through natural user interfaces. In Advanced Learning Technologies (ICALT), 2013 IEEE 13th International Conference on, pages 232–234, July 2013.
[3]
M.A. Kader, B. Singha, and M.N. Islam. Speech enabled operating system control. In Computer and Information Technology, 2008. ICCIT 2008. 11th International Conference on, pages 448–452, Dec 2008.
[4]
J.L. Leopold and A.L. Ambler. Keyboardless visual programming using voice, handwriting, and gesture. In Visual Languages, 1997. Proceedings. 1997 IEEE Symposium on, pages 28–35, Sep 1997.
[5]
I. Marsic, A. Medl, and J. Flanagan. Natural communication with information systems. Proceedings of the IEEE, 88(8):1354–1366, Aug 2000.
[6]
Shairaj Shaik, Raymond Corvin, Rajesh Sudarsan, Faizan Javed, Qasim Ijaz, Suman Roychoudhury, Jeffrey G. Gray, and Barrett R. Bryant. SpeechClipse: an Eclipse speech plug-in. In Conference on Object-Oriented Programming Systems, Languages, and Applications, pages 84–88, 2003. 2 http://serl.cs.wichita.edu/?page id=166

Cited By

View all

Index Terms

  1. Enabling integrated development environments with natural user interface interactions

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICPC 2014: Proceedings of the 22nd International Conference on Program Comprehension
    June 2014
    325 pages
    ISBN:9781450328791
    DOI:10.1145/2597008
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    • TCSE: IEEE Computer Society's Tech. Council on Software Engin.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 June 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Development Process Optimization
    2. Gestures
    3. IDE
    4. NUI
    5. Speech

    Qualifiers

    • Article

    Conference

    ICSE '14
    Sponsor:

    Upcoming Conference

    ICSE 2025

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Voice coding experiences for developers with physical impairmentsJournal of Enabling Technologies10.1108/JET-02-2024-0021Online publication date: 22-Oct-2024
    • (2023)Evaluating design guidelines for hand proximate user interfacesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596117(1159-1173)Online publication date: 10-Jul-2023
    • (2022)A Survey of Natural Design for InteractionProceedings of Mensch und Computer 202210.1145/3543758.3543773(240-254)Online publication date: 4-Sep-2022
    • (2022)Recreating Poompuhar Ancient History Using Virtual RealityIntelligent Communication Technologies and Virtual Mobile Networks10.1007/978-981-19-1844-5_12(135-144)Online publication date: 20-Jul-2022
    • (2020)Usability and user experience evaluation of natural user interfaces: a systematic mapping studyIET Software10.1049/iet-sen.2020.0051Online publication date: 21-Jul-2020
    • (2016)Usability and Functionality Assessment of an Oculus Rift in Immersive and Interactive Systems Using Voice CommandsVirtual, Augmented and Mixed Reality10.1007/978-3-319-39907-2_21(222-232)Online publication date: 19-Jun-2016
    • (2015)Virtual reality in software engineeringProceedings of the 37th International Conference on Software Engineering - Volume 210.5555/2819009.2819098(547-550)Online publication date: 16-May-2015
    • (2015)Exploring software cities in virtual reality2015 IEEE 3rd Working Conference on Software Visualization (VISSOFT)10.1109/VISSOFT.2015.7332423(130-134)Online publication date: Sep-2015
    • (2015)Virtual Reality in Software Engineering: Affordances, Applications, and Challenges2015 IEEE/ACM 37th IEEE International Conference on Software Engineering10.1109/ICSE.2015.191(547-550)Online publication date: May-2015
    • (2015)Low Cost Hand-Tracking Devices to Design Customized Medical DevicesVirtual, Augmented and Mixed Reality10.1007/978-3-319-21067-4_36(351-360)Online publication date: 21-Jul-2015

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media