skip to main content
10.1145/2785830.2785871acmconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
research-article

Proxemic-Aware Controls: Designing Remote Controls for Ubiquitous Computing Ecologies

Published: 24 August 2015 Publication History

Abstract

Remote controls facilitate interactions at-a-distance with appliances. However, the complexity, diversity, and increasing number of digital appliances in ubiquitous computing ecologies make it increasingly difficult to: (1) discover which appliances are controllable; (2) select a particular appliance from the large number available; (3) view information about its status; and (4) control the appliance in a pertinent manner. To mitigate these problems we contribute proxemic-aware controls, which exploit the spatial relationships between a person's handheld device and all surrounding appliances to create a dynamic appliance control interface. Specifically, a person can discover and select an appliance by the way one orients a mobile device around the room, and then progressively view the appliance's status and control its features in increasing detail by simply moving towards it. We illustrate proxemic-aware controls of assorted appliances through various scenarios. We then provide a generalized conceptual framework that informs future designs of proxemic-aware controls.

Supplementary Material

ledo (p187-ledo-suppl.zip)
Supplemental movie and image files for, Designing Remote Controls for Ubiquitous Computing Ecologies

References

[1]
Ballendat, T., Marquardt, N., and Greenberg, S. Proxemic interaction: designing for a proximity and orientation-aware environment. Proc. ACM ITS 2010, 121--130.
[2]
Baudel, T. and Beaudouin-Lafon, M. Charade: remote control of objects using free-hand gestures. Commun. ACM 1993, 28--35.
[3]
Bederson, B.B. and Hollan, J.D. Pad++: A Zooming Graphical Interface for Exploring Alternate Interface Physics. Proc. ACM UIST 1994, 17--26.
[4]
Beigl, M. Point & Click-Interaction in Smart Environments. Springer HUC 1999, 311--313.
[5]
Boring, S., Baur, D., Butz, A., Gustafson, S., and Baudisch, P. Touch projector: mobile interaction through video. Proc. ACM CHI 2010, 2287--2296.
[6]
Chen, Y.-H., Zhang, B., Tuna, C., Li, Y., Lee, E.A., and Hartmann, B. A Context Menu for the Real World: Controlling Physical Appliances Through Head-Worn Infrared Targeting. Report UCB/EECS-2013-200, EECS Department, University of Berkeley, (2013).
[7]
Gellersen, H., Fischer, C., Guinard, D., et al. Supporting device discovery and spontaneous interaction with spatial references. PUC, 2009, 255--264.
[8]
Hall, E.T. The Hidden Dimension. Anchor Books New York, 1969.
[9]
Hinckley, K. Synchronous Gestures for Multiple Persons and Computers. Proc. ACM UIST 2003, 149--158.
[10]
Kim, D., Hilliges, O., Izadi, S., et al. Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor. Proc, ACM UIST 2012, 167--176.
[11]
Kohtake, N., Rekimoto, J., and Anzai, Y. InfoPoint: A Device that Provides a Uniform User Interface to Allow Appliances to Work Together over a Network. Personal and Ubiquitous Computing 5, 4 (2001), 264--274.
[12]
Lehikoinen, J. and Suomela, R. Accessing Context in Wearable Computers. PUC 2002, 64--74.
[13]
Lidwell, W., Holden, K., and Butler, J. Universal Principles of Design. Rockport, 2003.
[14]
Marquardt, N., Ballendat, T., Boring, S., Greenberg, S., and Hinckley, K. Gradual Engagement between Digital Devices as a Function of Proximity: From Awareness to Progressive Reveal to Information Transfer. Proc, ACM ITS 2012, 31--40.
[15]
Marquardt, N., Diaz-Marino, R., Boring, S., and Greenberg, S. The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies. Proc. ACM UIST 2011, 315--326.
[16]
Marquardt, N., Hinckley, K., and Greenberg, S. Cross-device Interaction via Micro-mobility and F-formations. Proc. ACM UIST 2012, 13--22.
[17]
Mulloni, A., Dünser, A., and Schmalstieg, D. Zooming interfaces for augmented reality browsers. Proc. ACM MobileHCI 2010, 161--170.
[18]
Myers, B. Mobile Devices for Control. Springer Human Computer Interaction with Mobile Devices, 2002.
[19]
Myers, B.A., Peck, C.H., Nichols, J., Kong, D., and Miller, R. Interacting at a Distance Using Semantic Snarfing. Proc. Springer Ubicomp 2001, 305--314.
[20]
Nichols, J., Rothrock, B., Chau, D.H., and Myers, B.A. Huddle: automatically generating interfaces for systems of multiple connected appliances. Proc ACM UIST 2006, 279--288.
[21]
Norman, D.A. Living with Complexity. MIT Press, 2010.
[22]
Rukzio, E., Leichtenstern, K., Callaghan, V., Holleis, P., Schmidt, A., and Chin, J. An Experimental Comparison of Physical Mobile Interaction Techniques: Touching, Pointing and Scanning. Proc. Springer Ubicomp 2006, 87--104.
[23]
Schmidt, D., Molyneaux, D., and Cao, X. PICOntrol: using a handheld projector for direct control of physical devices through visible light. Proc. ACM UIST 2012, 379--388.
[24]
Seifried, T., Haller, M., Scott, S.D., et al. CRISTAL: a collaborative home media and device controller based on a multi-touch display. Proc ACM ITS 2009, 33--40.
[25]
Shneiderman, B. The eyes have it: a task by data type taxonomy for information visualizations. Proc. IEEE VL/HCC, 1996, 336--343.
[26]
Swindells, C., Inkpen, K.M., Dill, J.C., and Tory, M. That One There! Pointing to Establish Device Identity. Proc. ACM UIST 2002, 151--160.
[27]
Tani, M., Yamaashi, K., Tanikoshi, K., Futakawa, M., and Tanifuji, S. Object-oriented video: interaction with real-world objects through live video. Proc. ACM CHI 1992, 593--598.
[28]
Välkkynen, P. and Tuomisto, T. Physical Browsing Research. Proc. PERMID 2005, (2005), 35--38.
[29]
Want, R., Fishkin, K.P., Gujar, A., and Harrison, B.L. Bridging physical and virtual worlds with electronic tags. Proc. ACM CHI 1999, 370--377.
[30]
Wiberg, M. and Stolterman, E. What Makes a Prototype Novel?: A Knowledge Contribution Concern for Interaction Design Research. Proc. ACM NordiCHI 2014, 531--540.
[31]
Zimmerman, J., Forlizzi, J., and Evenson, S. Research Through Design As a Method for Interaction Design Research in HCI. Proc. ACM CHI 2007, 493--502.
[32]
Remote Control Anarchy (Jakob Nielsen's Alertbox). 2004. http://www.useit.com/alertbox/20040607.html.
[33]
Revolv. Accessed October 2014. http://revolv.com/.
[34]
Nest. Accessed February 2015. https://nest.com.
[35]
Logitech Harmony. Accessed February 2015. http://www.logitech.com/en-ca/product/harmony-ultimate-home.

Cited By

View all
  • (2024)Mappings in the Home: Selecting Home Appliances in 3D SpaceExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650745(1-7)Online publication date: 11-May-2024
  • (2023)AdHocProx: Sensing Mobile, Ad-Hoc Collaborative Device Formations using Dual Ultra-Wideband RadiosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581300(1-18)Online publication date: 19-Apr-2023
  • (2023)RagRug: A Toolkit for Situated AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.315705829:7(3281-3297)Online publication date: 1-Jul-2023
  • Show More Cited By

Index Terms

  1. Proxemic-Aware Controls: Designing Remote Controls for Ubiquitous Computing Ecologies

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services
    August 2015
    611 pages
    ISBN:9781450336529
    DOI:10.1145/2785830
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 24 August 2015

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Mobile Interaction
    2. control of appliances
    3. proxemic-interaction
    4. ubiquitous computing

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    MobileHCI '15
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 202 of 906 submissions, 22%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)41
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Mappings in the Home: Selecting Home Appliances in 3D SpaceExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650745(1-7)Online publication date: 11-May-2024
    • (2023)AdHocProx: Sensing Mobile, Ad-Hoc Collaborative Device Formations using Dual Ultra-Wideband RadiosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581300(1-18)Online publication date: 19-Apr-2023
    • (2023)RagRug: A Toolkit for Situated AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.315705829:7(3281-3297)Online publication date: 1-Jul-2023
    • (2023)Proxemic-aware Augmented Reality For Human-Robot Interaction2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309582(1323-1330)Online publication date: 28-Aug-2023
    • (2022)ProGesAR: Mobile AR Prototyping for Proxemic and Gestural Interactions with Real-world IoT Enhanced SpacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517689(1-14)Online publication date: 29-Apr-2022
    • (2022)Dually Noted: Layout-Aware Annotations with Smartphone Augmented RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502026(1-15)Online publication date: 29-Apr-2022
    • (2021)An Approach of Social Navigation Based on Proxemics for Crowded Environments of Humans and RobotsMicromachines10.3390/mi1202019312:2(193)Online publication date: 13-Feb-2021
    • (2021)Trade-offs in Augmented Reality User Interfaces for Controlling a Smart EnvironmentProceedings of the 2021 ACM Symposium on Spatial User Interaction10.1145/3485279.3485288(1-11)Online publication date: 9-Nov-2021
    • (2021)Personal Augmented Reality for Information Visualization on Large Interactive DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.303046027:2(1182-1192)Online publication date: Feb-2021
    • (2021)Smart Vehicle Proxemics: A Conceptual Framework Operationalizing Proxemics in the Context of Outside-the-Vehicle InteractionsHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85616-8_11(150-171)Online publication date: 26-Aug-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media