skip to main content
10.1145/2076354.2076393acmconferencesArticle/Chapter ViewAbstractPublication PagesissConference Proceedingsconference-collections
research-article

Code space: touch + air gesture hybrid interactions for supporting developer meetings

Published: 13 November 2011 Publication History

Abstract

We present Code Space, a system that contributes touch + air gesture hybrid interactions to support co-located, small group developer meetings by democratizing access, control, and sharing of information across multiple personal devices and public displays. Our system uses a combination of a shared multi-touch screen, mobile touch devices, and Microsoft Kinect sensors. We describe cross-device interactions, which use a combination of in-air pointing for social disclosure of commands, targeting and mode setting, combined with touch for command execution and precise gestures. In a formative study, professional developers were positive about the interaction design, and most felt that pointing with hands or devices and forming hand postures are socially acceptable. Users also felt that the techniques adequately disclosed who was interacting and that existing social protocols would help to dictate most permissions, but also felt that our lightweight permission feature helped presenters manage incoming content.

Supplementary Material

WMV File (p212-bragdon.wmv)

References

[1]
G. M. Olson, J. S. Olson, M. R. Carter, M. Storrosten. Small group design meetings: an analysis of collaboration. In HCI '92.
[2]
Biehl, J. T., Czerwinski, M., Smith, G., and Robertson, G. G. FASTDash: a visual dashboard for fostering awareness in software teams. In CHI'06.
[3]
Ballendat, T., Marquardt, N., and Greenberg, S. Proxemic interaction: designing for a proximity and orientation-aware environment. In ITS'10.
[4]
Fitzmaurice, G. W., Khan, A., Buxton, W., Kurtenbach, G., et al. Sentient Data Access via a Diverse Society of Devices. ACM Queue, 8, 1 (Nov 2003).
[5]
Vogel, D. et al. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In UIST'04.
[6]
Streitz, N., Geißler, J., Holmer, T., et al. i-LAND: An Interactive Landscape for Creativity and Innovation. In Proc. of ACM SIGCHI'99.
[7]
Johanson, B., et al. The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms. IEEE Pervasive Computing, 1, 2.
[8]
Rekimoto, J. and Saitoh, M. Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proc. of CHI'99.
[9]
Brooks, R. and et al. The Intelligent Room Project. In Proc. of IC'97.
[10]
Krumm, J., Harris, S., Meyers, B., Brumitt, B., and et al. Multi-camera multi-person tracking for EasyLiving. In Proc. of IEEE WVS, 3--10.
[11]
Rekimoto, J. A multiple device approach for supporting whiteboard-based interactions. In Proc. of CHI'98, 344--351.
[12]
Rekimoto, J. Multiple-computer interfaces: "Beyond the desktop" direct manipulation environments. In CHI'00 EA.
[13]
Wigdor, D., et al. WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system. In CHI'09.
[14]
Myers, B. A. Using Multiple Devices Simultaneously for Display and Control (Oct. 2000), 62--65.
[15]
Wilson, A. and Benko, H. Combining Multiple Depth Cameras and Projectors for Interactions On, Above, and Between Surfaces. In UIST'10.
[16]
Izadi, S., et al. Dynamo: a public interactive surface supporting the cooperative sharing and exchange of media. In Proc. of UIST'03, 159--168.
[17]
Greenberg, S., Boyle, M., and LaBerge, J. PDAs and Shared Public Displays: Making Personal Information Public, and Public Information Personal. Personal Technologies, 3, 1 (March 1999).
[18]
Li, F., Dearman, D., and Truong, K. Virtual shelves: interactions with orientation aware devices. In Proc. of UIST'09, 125--128.
[19]
Bolt, R. A. "Put-that-there": Voice and gesture at the graphics interface. In Proc. of SIGGRAPH'80, 262--270.
[20]
Oviatt, S., DeAngeli, A., and Kuhn, K. Integration and synchronization of input modes during multimodal human-computer interaction. In Referring Phenomena in a Multimedia Context and their Computational Treatment ('97).
[21]
Zeleznik, R., Bragdon, A., et al. Hands-on math: a page-based multi-touch and pen desktop for technical work and problem solving. In Proc. of UIST'10.
[22]
NINTENDO. Wii Game Console. 2006.
[23]
Baudel, T. and Beaudouin-Lafon, M. CHARADE: Remote Control of Objects using Free-Hand Gestures. Communications of the ACM, 36, 7 (1993).
[24]
Hinckley, K., Pausch, R., Goble, J., and Kassell, N. A survey of design issues in spatial input. In Proc. of UIST'94, 213--222.
[25]
Bragdon, A. and Ko, H. Gesture Select: Acquiring Remote Targets on Large Displays without Pointing. In Proceedings of 'CHI'11.
[26]
Mangano, N., Baker, A., and van der Hoek, A. Calico: a prototype sketching tool for modeling in early design. In Proc. of MiSE '08, 63--68.
[27]
Parnin, C., Görg, C., and Rugaber, S. CodePad: interactive spaces for maintaining concentration in programming environments. In SOFTVIS '10.
[28]
Rekimoto, J. Pick-and-drop: a direct manipulation technique for multiple computer environments. In Proc. of UIST'97, 31--39.
[29]
Wilson, A. and Sarin, R. BlueTable: Connecting Wireless Mobile Devices on Interactive Surfaces Using Vision-Based Handshaking. In Proc. of GI'07.
[30]
Bragdon, A., Zeleznik, R., Williamson, B., et al. GestureBar: improving the approachability of gesture-based interfaces. In Proc. of CHI'09, 2269--2278.
[31]
Rico, J. and Brewster, S. Usable gestures for mobile interfaces: evaluating social acceptability. In Proc. of CHI'10, 887--896.
[32]
Bragdon, A., Zeleznik, R., et al. Code Bubbles: A Working Set-based Interface for Code Understanding and Maintanence. In CHI'10, 2503--2512.
[33]
Morris, M. R., Huang, A., Paepcke, A., et al. Cooperative gestures: multi-user gestural interactions for co-located groupware. In Proc. of CHI'06.
[34]
BUMP TECHNOLOGIES. Bump (iPhone App). 2011.
[35]
Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P., and Smith, M. Stitching: pen gestures that span multiple displays. In Proc. of AVI'04, 23--31.
[36]
Bier, E. A., Stone, M., Pier, K., Buxton, W., and DeRose, T. Toolglass and magic lenses: the see-through interface. In Proc. of SIGGPAPH'93, 73--80.
[37]
Kurtenbach, G. and Buxton, W. The limits of expert performance using hierarchic marking menus. In Proc. of CHI'93, 482--487.
[38]
Schöning, J., Rohs, M., et al. Using Mobile Phones to Spontaneously Authenticate and Interact with Multi-touch Surfaces. In In PPD'08.
[39]
Gellersen, H., et al. Supporting device discovery and spontaneous interaction with spatial references. J. of Personal & Ubiquitous Computing, 13, 4 (May '09).
[40]
Hassan, N., Rahman, M., Irani, P., and Graham, P. Chucking: A One-Handed Document Sharing Technique. In Proc. of INTERACT'09.
[41]
Nacenta, M. A., et al. There and Back Again: Cross-Display Object Movement in Multi-Display Environments. Human-Computer Interaction, 24(1), 170--229.
[42]
Elrod, S., et al. Liveboard: a large interactive display supporting group meetings, presentations and remote collaboration. In Proc. Of CHI'92.
[43]
Schmidt, D. PhoneTouch: a technique for direct phone interaction on surfaces. In Proc. of UIST'10.

Cited By

View all
  • (2024)A Systematic Literature Review on the Influence of Enhanced Developer Experience on Developers' Productivity: Factors, Practices, and RecommendationsACM Computing Surveys10.1145/368729957:1(1-46)Online publication date: 7-Oct-2024
  • (2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
  • (2024)Natural Hand Gesture Interaction for 3D Transformations in Immersive VRInformation Systems and Technologies10.1007/978-3-031-45642-8_21(216-222)Online publication date: 16-Feb-2024
  • Show More Cited By

Index Terms

  1. Code space: touch + air gesture hybrid interactions for supporting developer meetings

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ITS '11: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
    November 2011
    295 pages
    ISBN:9781450308717
    DOI:10.1145/2076354
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 November 2011

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. cross-device interaction
    2. depth camera
    3. development teams
    4. mobile devices
    5. touch

    Qualifiers

    • Research-article

    Conference

    ITS'11
    Sponsor:
    ITS'11: Interactive Tabletops and Surfaces
    November 13 - 16, 2011
    Kobe, Japan

    Acceptance Rates

    Overall Acceptance Rate 119 of 418 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)34
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A Systematic Literature Review on the Influence of Enhanced Developer Experience on Developers' Productivity: Factors, Practices, and RecommendationsACM Computing Surveys10.1145/368729957:1(1-46)Online publication date: 7-Oct-2024
    • (2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
    • (2024)Natural Hand Gesture Interaction for 3D Transformations in Immersive VRInformation Systems and Technologies10.1007/978-3-031-45642-8_21(216-222)Online publication date: 16-Feb-2024
    • (2023)RadarSense: Accurate Recognition of Mid-air Hand Gestures with Radar Sensing and Few Training ExamplesACM Transactions on Interactive Intelligent Systems10.1145/358964513:3(1-45)Online publication date: 11-Sep-2023
    • (2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
    • (2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
    • (2022)Can’t Touch This: Rethinking Public Technology in a COVID-19 EraProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501980(1-14)Online publication date: 29-Apr-2022
    • (2022)Hand Gesture Recognition for an Off-the-Shelf Radar by Electromagnetic Modeling and InversionProceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511107(506-522)Online publication date: 22-Mar-2022
    • (2022)A hybrid 2D–3D tangible interface combining a smartphone and controller for virtual realityVirtual Reality10.1007/s10055-022-00735-227:2(1273-1291)Online publication date: 18-Dec-2022
    • (2020)Extend, Push, Pull: Smartphone Mediated Interaction in Spatial Augmented Reality via Intuitive Mode SwitchingProceedings of the 2020 ACM Symposium on Spatial User Interaction10.1145/3385959.3418456(1-10)Online publication date: 31-Oct-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media