Matthias Budde
Michael Beigl
ABSTRACT
This work presents a system that makes use of the Microsoft Kinect to enable Point&Click interaction for the control of appliances in smart environments. A backend server determines through collision detection which device the user is pointing at and sends the respective control interface to the user's smartphone. Any commands the user issues are then sent back to the server which in turn controls the appliance. New devices can either be registered manually or using markers such as QR codes to identify them and get their position at the same time. The video demonstrates the interaction concept and our technical implementation.
Supplemental Material
- Beigl, M. Point & Click -- Interaction in Smart Environments. In Proc. HUC, Springer (1999). Google Scholar
Digital Library
- Bernardos, A. M., Casar, J. R., Cano, J., and Bergesio, L. Enhancing Interaction With Smart Objects Through Mobile Devices. In Proc. MobiWac (2011). Google ScholarDigital Library
- Fleer, D., and Leichsenring, C. MISO: A Context-Sensitive Multimodal Interface for Smart Objects Based on Hand Gestures and Finger Snaps. In Adj. proc. UIST, ACM (2012), 93--94. Google ScholarDigital Library
- Ringwald, M. UbiControl: Providing New and Easy Ways to Interact With Various Consumer Devices. In Adj. Proc. Ubicomp (2002), 81.Google Scholar
- Roduner, C., Langheinrich, M., Floerkemeier, C., and Schwarzentrub, B. Operating Appliances with Mobile Phones -- Strengths and Limits of a Universal Interaction Device. In Proc. PERVASIVE (2007). Google ScholarDigital Library
- Schmidt, D., Molyneaux, D., and Cao, X. PICOntrol: Using a Handheld Projector for Direct Control of Physical Devices Through Visible Light. In Proc. UIST, ACM (2012), 379--388. Google ScholarDigital Library
- Wu, J., Pan, G., Zhang, D., Li, S., and Wu, Z. MagicPhone: Pointing & Interacting. In Adj. proc. Ubicomp, ACM (2010). Google ScholarDigital Library
- Zimmermann, G., Vanderheiden, G., and Gilman, A. Prototype Implementations for a Universal Remote Console Specification. In CHI EA '02, ACM (2002). Google ScholarDigital Library
Index Terms
- Point & control -- interaction in smart environments: you only click twice
Recommendations
Semantic metadata to support device interaction in smart environments
UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publicationFacilitating the interaction of human users and machines with smart devices is important to drive the successful adoption of the Internet of Things in people's homes and at their workplaces. In this paper, we present a system that helps users control ...
Embedded semantic metadata to support device interaction in smart environments
UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publicationFacilitating the interaction of human users and machines with smart devices is important to drive the successful adoption of the Internet of Things in people's homes and at their workplaces. In this poster contribution, we present an approach to support ...
Gesture Control System for Smart Environments
IE '13: Proceedings of the 2013 9th International Conference on Intelligent EnvironmentsThis paper presents a system to control lighting, heating, ventilation and entertainment electronics in smart environments using gestures. Until now, there has not been general control method for intelligent environments available. In addition to the ...
Comments