Rodrigo de A. Maués
Simone Diniz Junqueira Barbosa
ABSTRACT
Automating tasks can make a smartphone easier to use and more battery efficient. However, currently little work has been done to help end-users to create such automations. In this paper, we explore an approach for automating smartphone tasks by demonstration. We have developed a mobile application called Keep Doing It that continuously records users' interactions with their smartphones. After users performed a task that they would like to automate, they can ask our application to create the automation based on their latest actions. Since users only have to use their smartphones, as they would naturally do, to demonstrate automations, we believe that our approach can lower the barrier for creating smartphone automations. Overall, an initial evaluation of the approach suggests that users would be willing to automate their phones by demonstration.
- Antila, V., Polet, J., Lamsa, A., Liikka, J. RoutineMaker: Towards end-user automation of daily routines using smartphones. PERCOM Workshops 2012, IEEE (2012), 399--402.Google Scholar
Cross Ref
- Aztiria, A., Augusto, J. C., Izaguirre, A. Autonomous Learning of User's Preferences Improved through User Feedback. In Gottfried, B. and Aghajan, H. K., editors, BMI, volume 396 of CEUR Workshop Proceedings (2008), pages 72--86.Google Scholar
- Chen, J., Weld, D. S. Recovering from errors during programming by demonstration. In Proc. IUI 2008, ACM (2008), 159--168. Google ScholarDigital Library
- Deemter, K. V., Krahmer, E., Theune, M. Real versus Template-Based Natural Language Generation: A False Opposition? Comput. Linguist. 31, 1 (2005), 15--24. Google ScholarDigital Library
- Dey, A. K. Understanding and Using Context. Personal Ubiquitous Computing 5 (2001), 4--7. Google ScholarDigital Library
- Dey, A. K., Hamid, R., Beckmann, C., Li, I., Hsu, D. a CAPpella: programming by demonstration of contextaware applications. In Proc. CHI 2004. ACM (2004), 33--40. Google ScholarDigital Library
- Dey, A. K., Mankoff, J. Designing mediation for context-aware applications. ACM Trans. Comput.-Hum. Interact. 12, 1 (2005), 53--80. Google ScholarDigital Library
- Häkkilä, J., Korpipää, P., Ronkainen, S., Tuomela, U. Interaction and end-user programming with a contextaware mobile application. In Human-Computer Interaction-INTERACT 2005. Springer Berlin Heidelberg (2005), 927--937. Google ScholarDigital Library
- IFTTT. http://ifttt.com/.Google Scholar
- Lieberman, H. (ed.). Your Wish is My Command: Programming by Example. Morgan Kaufmann Publishers Inc. (2001).Google Scholar
- Locale. http://www.twofortyfouram.com/.Google Scholar
- Lucas-Cuesta, J. M., Ferreiros, J., Aztiria, A., Augusto, J. C., McTear, M. F. Dialogue-based Management of user Feedback in an Autonomous Preference Learning System. In ICAART (2010), 330--336.Google Scholar
- on{x}. http://onx.ms/.Google Scholar
- Ravindranath, L., Thiagarajan, A., Balakrishnan, H., & Madden, S. Code in the air: simplifying sensing and coordination tasks on smartphones. In Proc. HotMobile 2012. ACM (2012), 4. Google ScholarDigital Library
- Tasker. http://tasker.dinglisch.net/.Google Scholar
Index Terms
- Keep doing what i just did: automating smartphones by demonstration
Recommendations
VASTA: a vision and language-assisted smartphone task automation system
IUI '20: Proceedings of the 25th International Conference on Intelligent User InterfacesWe present VASTA, a novel vision and language-assisted Programming By Demonstration (PBD) system for smartphone task automation. Development of a robust PBD automation system requires overcoming three key challenges: first, how to make a particular ...
SUGILITE: Creating Multimodal Smartphone Automation by Demonstration
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsSUGILITE is a new programming-by-demonstration (PBD) system that enables users to create automation on smartphones. SUGILITE uses Android's accessibility API to support automating arbitrary tasks in any Android app (or even across multiple apps). When ...
Analyzing the Use of Quick Response Codes in the Wild
MobiSys '15: Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and ServicesOne- and two-dimensional barcodes, including Quick Response (QR) codes, have become a convenient way to communicate small amounts of information from physical objects to mobile devices. While there is much discussion, awareness, and proposed use of such ...
Comments