skip to main content
10.1145/3613904.3642158acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Fast-Forward Reality: Authoring Error-Free Context-Aware Policies with Real-Time Unit Tests in Extended Reality

Published: 11 May 2024 Publication History

Abstract

Advances in ubiquitous computing have enabled end-user authoring of context-aware policies (CAPs) that control smart devices based on specific contexts of the user and environment. However, authoring CAPs accurately and avoiding run-time errors is challenging for end-users as it is difficult to foresee CAP behaviors under complex real-world conditions. We propose Fast-Forward Reality, an Extended Reality (XR) based authoring workflow that enables end-users to iteratively author and refine CAPs by validating their behaviors via simulated unit test cases. We develop a computational approach to automatically generate test cases based on the authored CAP and the user’s context history. Our system delivers each test case with immersive visualizations in XR, facilitating users to verify the CAP behavior and identify necessary refinements. We evaluated Fast-Forward Reality in a user study (N=12). Our authoring and validation process improved the accuracy of CAPs and the users provided positive feedback on the system usability.

Supplemental Material

MP4 File - Video Preview
Video Preview
Transcript for: Video Preview
MP4 File - Video Presentation
Video Presentation
Transcript for: Video Presentation
MP4 File - Video Figure
The associated video figure of this paper.
Transcript for: Video Figure

References

[1]
Gregory D Abowd, Anind K Dey, Peter J Brown, Nigel Davies, Mark Smith, and Pete Steggles. 1999. Towards a better understanding of context and context-awareness. In International symposium on handheld and ubiquitous computing. Springer, 304–307.
[2]
Rakesh Agrawal, Tomasz Imieliński, and Arun Swami. 1993. Mining association rules between sets of items in large databases. In Proceedings of the 1993 ACM SIGMOD international conference on Management of data. 207–216.
[3]
Alexa Routines 2022. Alexa Routines. https://www.amazon.com/alexa-routines/.
[4]
Stavros Antifakos, Nicky Kern, Bernt Schiele, and Adrian Schwaninger. 2005. Towards improving trust in context-aware systems by displaying system confidence. In Proceedings of the 7th international conference on Human computer interaction with mobile devices & services. 9–14.
[5]
Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador García, Sergio Gil-López, Daniel Molina, Richard Benjamins, 2020. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information fusion 58 (2020), 82–115.
[6]
Dana H Ballard, Mary M Hayhoe, Polly K Pook, and Rajesh PN Rao. 1997. Deictic codes for the embodiment of cognition. Behavioral and brain sciences 20, 4 (1997), 723–742.
[7]
Adrian Bangerter. 2004. Using pointing and describing to achieve joint focus of attention in dialogue. Psychological science 15, 6 (2004), 415–419.
[8]
Victoria Bellotti and Keith Edwards. 2001. Intelligibility and Accountability: Human Considerations in Context-Aware Systems. Human–Computer Interaction 16, 2-4 (2001), 193–212. https://doi.org/10.1207/S15327051HCI16234_05
[9]
Sanjay Bhati, Harshid Soni, Vijayrajsinh Zala, Parth Vyas, and Yash Sharma. 2017. Smart medicine reminder box. IJSTE-International Journal of Science Technology & Engineering 3, 10 (2017), 172–177.
[10]
Valentina Bianchi, Marco Bassoli, Gianfranco Lombardo, Paolo Fornacciari, Monica Mordonini, and Ilaria De Munari. 2019. IoT wearable sensor and deep learning: An integrated approach for personalized human activity recognition in a smart home environment. IEEE Internet of Things Journal 6, 5 (2019), 8553–8562.
[11]
Michael S Borofsky, Casey A Dauw, Nadya York, Colin Terry, and James E Lingeman. 2018. Accuracy of daily fluid intake measurements using a “smart” water bottle. Urolithiasis 46, 4 (2018), 343–348.
[12]
Yuanzhi Cao, Xun Qian, Tianyi Wang, Rachel Lee, Ke Huo, and Karthik Ramani. 2020. An exploratory study of augmented reality presence for tutoring machine tasks. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–13.
[13]
Yuanzhi Cao, Tianyi Wang, Xun Qian, Pawan S Rao, Manav Wadhawan, Ke Huo, and Karthik Ramani. 2019. GhostAR: A time-space editor for embodied authoring of human-robot collaborative task with augmented reality. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 521–534.
[14]
Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2017. Realtime multi-person 2d pose estimation using part affinity fields. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7291–7299.
[15]
Alberto Huertas Celdrán, Félix J García Clemente, Manuel Gil Pérez, and Gregorio Martínez Pérez. 2014. SeCoMan: A semantic-aware policy framework for developing privacy-preserving and context-aware smart applications. IEEE Systems Journal 10, 3 (2014), 1111–1124.
[16]
Seungho Chae, Yoonsik Yang, Heeseung Choi, Ig-Jae Kim, Junghyun Byun, Jiyoon Jo, and Tack-Don Han. 2016. Smart advisor: Real-time information provider with mobile augmented reality. In 2016 IEEE International Conference on Consumer Electronics (ICCE). IEEE, 97–98.
[17]
Yi-Ting Chiang, Kuo-Chung Hsu, Ching-Hu Lu, Li-Chen Fu, and Jane Yung-Jen Hsu. 2010. Interaction models for multiple-resident activity recognition in a smart home. In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 3753–3758.
[18]
Meghan Clark, Mark W Newman, and Prabal Dutta. 2022. ARticulate: One-Shot Interactions with Intelligent Assistants in Unfamiliar Smart Spaces Using Augmented Reality. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1–24.
[19]
Michael H Coen 1998. Design principles for intelligent environments. AAAI/IAAI 547 (1998), 554.
[20]
Dima Damen, Hazel Doughty, Giovanni Maria Farinella, Sanja Fidler, Antonino Furnari, Evangelos Kazakos, Davide Moltisanti, Jonathan Munro, Toby Perrett, Will Price, 2018. Scaling egocentric vision: The epic-kitchens dataset. In Proceedings of the European Conference on Computer Vision (ECCV). 720–736.
[21]
Ismayle de Sousa Santos, Rossana Maria de Castro Andrade, Lincoln Souza Rocha, Santiago Matalonga, Kathia Marcal de Oliveira, and Guilherme Horta Travassos. 2017. Test case design for context-aware applications: Are we there yet?Information and Software Technology 88 (2017), 1–16.
[22]
Stefan Decker, Sergey Melnik, Frank Van Harmelen, Dieter Fensel, Michel Klein, Jeen Broekstra, Michael Erdmann, and Ian Horrocks. 2000. The semantic web: The roles of XML and RDF. IEEE Internet computing 4, 5 (2000), 63–73.
[23]
Anind K Dey. 2001. Understanding and using context. Personal and ubiquitous computing 5, 1 (2001), 4–7.
[24]
Anind K Dey, Gregory D Abowd, and Daniel Salber. 2001. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human–Computer Interaction 16, 2-4 (2001), 97–166.
[25]
Anind K Dey, Raffay Hamid, Chris Beckmann, Ian Li, and Daniel Hsu. 2004. a CAPpella: programming by demonstration of context-aware applications. In Proceedings of the SIGCHI conference on Human factors in computing systems. 33–40.
[26]
Anind K Dey, Timothy Sohn, Sara Streng, and Justin Kodama. 2006. iCAP: Interactive prototyping of context-aware applications. In International conference on pervasive computing. Springer, 254–271.
[27]
Tom Djajadiningrat, Kees Overbeeke, and Stephan Wensveen. 2002. But How, Donald, Tell Us How? On the Creation of Meaning in Interaction Design through Feedforward and Inherent Feedback. In Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (London, England) (DIS ’02). Association for Computing Machinery, New York, NY, USA, 285–291. https://doi.org/10.1145/778712.778752
[28]
Yegang Du, Yuto Lim, and Yasuo Tan. 2019. A novel human activity recognition and prediction in smart home based on interaction. Sensors 19, 20 (2019), 4474.
[29]
Barrett Ens, Fraser Anderson, Tovi Grossman, Michelle Annett, Pourang Irani, and George Fitzmaurice. 2017. Ivy: Exploring spatially situated visual programming for authoring and understanding intelligent environments. In Proceedings of the 43rd Graphics Interface Conference. 156–162.
[30]
Andreas Rene Fender and Christian Holz. 2022. Causality-preserving Asynchronous Reality. In CHI Conference on Human Factors in Computing Systems. 1–15.
[31]
Aurel-Dorian Floarea and Valentin Sgârciu. 2016. Smart refrigerator: A next generation refrigerator connected to the IoT. In 2016 8th International Conference on Electronics, Computers and Artificial Intelligence (ECAI). IEEE, 1–6.
[32]
Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, Hao Jiang, Miao Liu, Xingyu Liu, 2022. Ego4d: Around the world in 3,000 hours of egocentric video. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 18995–19012.
[33]
Shalom Greene, Himanshu Thapliyal, and David Carpenter. 2016. IoT-based fall detection for smart home environments. In 2016 IEEE international symposium on nanoelectronic and information systems (iNIS). IEEE, 23–28.
[34]
Tobias Griebe and Volker Gruhn. 2014. A model-based approach to test automation for context-aware mobile applications. In Proceedings of the 29th Annual ACM Symposium on Applied Computing. 420–427.
[35]
Jens Grubert, Tobias Langlotz, Stefanie Zollmann, and Holger Regenbrecht. 2016. Towards pervasive augmented reality: Context-awareness in augmented reality. IEEE transactions on visualization and computer graphics 23, 6 (2016), 1706–1724.
[36]
Corentin Haidon, Hélène Pigot, and Sylvain Giroux. 2020. Joining semantic and augmented reality to design smart homes for assistance. Journal of Rehabilitation and Assistive Technologies Engineering 7 (2020), 2055668320964121.
[37]
Paul Hamill. 2004. Unit test frameworks: tools for high-quality software development. " O’Reilly Media, Inc.".
[38]
Fengming He, Xiyun Hu, Jingyu Shi, Xun Qian, Tianyi Wang, and Karthik Ramani. 2023. Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–14.
[39]
Sumi Helal, Bryon Winkler, Choonhwa Lee, Youssef Kaddoura, Lisa Ran, Carlos Giraldo, Sree Kuchibhotla, and William Mann. 2003. Enabling location-aware pervasive computing applications for the elderly. In Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003.(PerCom 2003). IEEE, 531–536.
[40]
Gaoping Huang, Xun Qian, Tianyi Wang, Fagun Patel, Maitreya Sreeram, Yuanzhi Cao, Karthik Ramani, and Alexander J Quinn. 2021. Adaptutar: An adaptive tutoring system for machine tasks in augmented reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–15.
[41]
Ke Huo, Yuanzhi Cao, Sang Ho Yoon, Zhuangying Xu, Guiming Chen, and Karthik Ramani. 2018. Scenariot: Spatially mapping smart things within augmented reality scenes. In Proceedings of the 2018 CHI Conference on human factors in computing systems. 1–13.
[42]
IFTTT 2022. IFTTT. https://ifttt.com.
[43]
Panagiotis Kostopoulos, Athanasios I Kyritsis, Michel Deriaz, and Dimitri Konstantas. 2016. F2D: a location aware fall detection system tested with real data from daily life of elderly people. Procedia computer science 98 (2016), 212–219.
[44]
Wallace S Lages and Doug A Bowman. 2019. Walking with adaptive augmented reality workspaces: design and usage patterns. In Proceedings of the 24th International Conference on Intelligent User Interfaces. 356–366.
[45]
Gun A Lee, Claudia Nelles, Mark Billinghurst, and Gerard Jounghyun Kim. 2004. Immersive authoring of tangible augmented reality applications. In Third IEEE and ACM International Symposium on Mixed and Augmented Reality. IEEE, 172–181.
[46]
Jisoo Lee, Luis Garduño, Erin Walker, and Winslow Burleson. 2013. A tangible programming tool for creation of context-aware applications. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. 391–400.
[47]
Deyi Li and Yi Du. 2017. Artificial intelligence with uncertainty. CRC press.
[48]
Shancang Li, Li Da Xu, and Shanshan Zhao. 2015. The internet of things: a survey. Information systems frontiers 17, 2 (2015), 243–259.
[49]
Yang Li, Jason I Hong, and James A Landay. 2004. Topiary: a tool for prototyping location-enhanced applications. In Proceedings of the 17th annual ACM symposium on User interface software and technology. 217–226.
[50]
Brian Y Lim and Anind K Dey. 2010. Toolkit to support intelligibility in context-aware applications. In Proceedings of the 12th ACM international conference on Ubiquitous computing. 13–22.
[51]
David Lindlbauer, Anna Maria Feit, and Otmar Hilliges. 2019. Context-aware online adaptation of mixed reality interfaces. In Proceedings of the 32nd annual ACM symposium on user interface software and technology. 147–160.
[52]
David Lindlbauer and Andy D Wilson. 2018. Remixed reality: Manipulating space and time in augmented reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.
[53]
Ziyi Liu, Zhengzhe Zhu, Enze Jiang, Feichi Huang, Ana M Villanueva, Xun Qian, Tianyi Wang, and Karthik Ramani. 2023. InstruMentAR: Auto-Generation of Augmented Reality Tutorials for Operating Digital Instruments Through Recording Embodied Demonstration. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–17.
[54]
Chu Luo, Jorge Goncalves, Eduardo Velloso, and Vassilis Kostakos. 2020. A survey of context simulation for testing mobile context-aware applications. ACM Computing Surveys (CSUR) 53, 1 (2020), 1–39.
[55]
Chu Luo, Miikka Kuutila, Simon Klakegg, Denzil Ferreira, Huber Flores, Jorge Goncalves, Mika Mäntylä, and Vassilis Kostakos. 2017. TestAWARE: a laboratory-oriented testing tool for mobile context-aware applications. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–29.
[56]
Blair MacIntyre, Maribeth Gandy, Steven Dow, and Jay David Bolter. 2004. DART: a toolkit for rapid design exploration of augmented reality experiences. In Proceedings of the 17th annual ACM symposium on User interface software and technology. 197–206.
[57]
Luca Mainetti, Luigi Patrono, Andrea Secco, and Ilaria Sergi. 2016. An IoT-aware AAL system for elderly people. In 2016 International multidisciplinary conference on computer and energy science (SpliTech). IEEE, 1–6.
[58]
Santiago Matalonga, Felyppe Rodrigues, and Guilherme Travassos. 2015. Challenges in testing context aware software systems. In 9th Workshop on Systematic and Automated Software Testing. sn, 51–60.
[59]
Meta Quest 2 2022. Meta Quest 2. https://www.oculus.com/experiences/quest/.
[60]
Fereshteh Jadidi Miandashti, Mohammad Izadi, Ali Asghar Nazari Shirehjini, and Shervin Shirmohammadi. 2020. An empirical approach to modeling user-system interaction conflicts in smart homes. IEEE Transactions on Human-Machine Systems 50, 6 (2020), 573–583.
[61]
Microsoft HoloLens 2 2022. Microsoft HoloLens 2. https://www.microsoft.com/en-us/hololens.
[62]
Diaa Salama Abdul Minaam and Mohamed Abd-ELfattah. 2018. Smart drugs: Improving healthcare using smart pill box for medicine reminder and monitoring system. Future Computing and Informatics Journal 3, 2 (2018), 443–456.
[63]
Aamir Mehmood Mirza and Muhammad Naeem Ahmed Khan. 2018. An automated functional testing framework for context-aware applications. IEEE Access 6 (2018), 46568–46583.
[64]
BONNIE M. MUIR. 1994. Trust in automation: Part I. Theoretical issues in the study of trust and human intervention in automated systems. Ergonomics 37, 11 (1994), 1905–1922. https://doi.org/10.1080/00140139408964957
[65]
Michael Nebeling, Katy Lewis, Yu-Cheng Chang, Lihan Zhu, Michelle Chung, Piaoyang Wang, and Janet Nebeling. 2020. Xrdirector: A role-based collaborative immersive authoring system. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.
[66]
Michael Nebeling, Shwetha Rajaram, Liwei Wu, Yifei Cheng, and Jaylin Herskovitz. 2021. Xrstudio: A virtual production and live streaming system for immersive instructional experiences. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12.
[67]
Roy Oberhauser. 2022. VR-Git: Git Repository Visualization and Immersion in Virtual Reality. In Proceedings of the the Seventeenth International Conference on Software Engineering Advances. 9–14.
[68]
Ian Oppermann, Matti Hämäläinen, and Jari Iinatti. 2004. UWB: theory and applications. John Wiley & Sons.
[69]
JoonSeok Park, Mikyeong Moon, Seongjin Hwang, and Keunhyuk Yeom. 2007. CASS: A context-aware simulation system for smart home. In 5th ACIS International Conference on Software Engineering Research, Management & Applications (SERA 2007). IEEE, 461–467.
[70]
Ken Pfeuffer, Yasmeen Abdrabou, Augusto Esteves, Radiah Rivu, Yomna Abdelrahman, Stefanie Meitner, Amr Saadi, and Florian Alt. 2021. ARtention: A design space for gaze-adaptive user interfaces in augmented reality. Computers & Graphics 95 (2021), 1–12.
[71]
pytest 2023. pytest. https://docs.pytest.org/en/8.0.x/.
[72]
Xun Qian, Fengming He, Xiyun Hu, Tianyi Wang, Ananya Ipsita, and Karthik Ramani. 2022. ScalAR: Authoring Semantically Adaptive Augmented Reality Experiences in Virtual Reality. In CHI Conference on Human Factors in Computing Systems. 1–18.
[73]
Xun Qian, Fengming He, Xiyun Hu, Tianyi Wang, and Karthik Ramani. 2022. ARnnotate: An Augmented Reality Interface for Collecting Custom Dataset of 3D Hand-Object Interaction Pose Estimation. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–14.
[74]
Raf Ramakers, Kashyap Todi, and Kris Luyten. 2015. PaperPulse: An Integrated Approach to Fabricating Interactive Paper. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 267–270. https://doi.org/10.1145/2702613.2725430
[75]
Abhishek Roy, SK Das Bhaumik, Amiya Bhattacharya, Kalyan Basu, Diane J Cook, and Sajal K Das. 2003. Location aware resource management in smart homes. In Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003.(PerCom 2003). IEEE, 481–488.
[76]
Michele Sama, David S Rosenblum, Zhimin Wang, and Sebastian Elbaum. 2008. Model-based fault detection in context-aware adaptive applications. In Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering. 261–271.
[77]
Bill Schilit, Norman Adams, and Roy Want. 1994. Context-aware computing applications. In 1994 first workshop on mobile computing systems and applications. IEEE, 85–90.
[78]
Shortcuts 2022. Shortcuts. https://support.apple.com/guide/shortcuts/create-a-new-personal-automation-apdfbdbd7123/5.0/ios/15.0.
[79]
Henri Theil. 1970. On the estimation of relationships involving qualitative variables. Amer. J. Sociology 76, 1 (1970), 103–154.
[80]
Kashyap Todi, Daryl Weir, and Antti Oulasvirta. 2016. Sketchplore: Sketch and Explore with a Layout Optimiser. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (Brisbane, QLD, Australia) (DIS ’16). Association for Computing Machinery, New York, NY, USA, 543–555. https://doi.org/10.1145/2901790.2901817
[81]
Rahmadi Trimananda, Seyed Amir Hossein Aqajari, Jason Chuang, Brian Demsky, Guoqing Harry Xu, and Shan Lu. 2020. Understanding and automatically detecting conflicting interactions between smart home IoT applications. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 1215–1227.
[82]
Unity3D 2022. Unity3D. https://unity.com/.
[83]
Blase Ur, Elyse McManus, Melwyn Pak Yong Ho, and Michael L Littman. 2014. Practical trigger-action programming in the smart home. In Proceedings of the SIGCHI conference on human factors in computing systems. 803–812.
[84]
Blase Ur, Melwyn Pak Yong Ho, Stephen Brawner, Jiyun Lee, Sarah Mennicken, Noah Picard, Diane Schulze, and Michael L Littman. 2016. Trigger-action programming in the wild: An analysis of 200,000 ifttt recipes. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3227–3231.
[85]
Jo Vermeulen, Kris Luyten, and Karin Coninx. 2012. Understanding complex environments with the feedforward torch. In International Joint Conference on Ambient Intelligence. Springer, 312–319.
[86]
Jo Vermeulen, Kris Luyten, Elise van den Hoven, and Karin Coninx. 2013. Crossing the bridge over Norman’s Gulf of Execution: revealing feedforward’s true identity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1931–1940.
[87]
Huai Wang, WK Chan, and TH Tse. 2014. Improving the effectiveness of testing pervasive software via context diversity. ACM Transactions on Autonomous and Adaptive Systems (TAAS) 9, 2 (2014), 1–28.
[88]
Huai Wang, Ke Zhai, and TH Tse. 2010. Correlating context-awareness and mutation analysis for pervasive computing systems. In 2010 10th International Conference on Quality Software. IEEE, 151–160.
[89]
Junbo Wang, Zixue Cheng, Lei Jing, Yota Ozawa, and Yinghui Zhou. 2012. A location-aware lifestyle improvement system to save energy in smart home. In 4th International Conference on Awareness Science and Technology. IEEE, 109–114.
[90]
Liang Wang, Tao Gu, Xianping Tao, Hanhua Chen, and Jian Lu. 2011. Recognizing multi-user activities using wearable sensors in a smart home. Pervasive and Mobile Computing 7, 3 (2011), 287–298.
[91]
Tianyi Wang, Xun Qian, Fengming He, Xiyun Hu, Yuanzhi Cao, and Karthik Ramani. 2021. GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality Applications. In The 34th Annual ACM Symposium on User Interface Software and Technology. 552–567.
[92]
Tianyi Wang, Xun Qian, Fengming He, Xiyun Hu, Ke Huo, Yuanzhi Cao, and Karthik Ramani. 2020. CAPturAR: An augmented reality tool for authoring human-involved context-aware applications. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 328–341.
[93]
Zhimin Wang, Sebastian Elbaum, and David S Rosenblum. 2007. Automated generation of context-aware tests. In 29th International Conference on Software Engineering (ICSE’07). IEEE, 406–415.
[94]
Zeyu Wang, Cuong Nguyen, Paul Asente, and Julie Dorsey. 2021. Distanciar: Authoring site-specific augmented reality experiences for remote environments. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12.
[95]
Ron Weinstein. 2005. RFID: a technical overview and its application to the enterprise. IT professional 7, 3 (2005), 27–33.
[96]
Mark Weiser. 1999. The computer for the 21st century. ACM SIGMOBILE mobile computing and communications review 3, 3 (1999), 3–11.
[97]
Konlakorn Wongpatikaseree, Mitsuru Ikeda, Marut Buranarach, Thepchai Supnithi, Azman Osman Lim, and Yasuo Tan. 2012. Activity recognition using context-aware infrastructure ontology in smart home domain. In 2012 Seventh International Conference on Knowledge, Information and Creativity Support Systems. IEEE, 50–57.
[98]
Chao-Lin Wu, Yi-Show Tseng, and Li-Chen Fu. 2013. Spatio-temporal feature enhanced semi-supervised adaptation for activity recognition in IoT-based context-aware smart homes. In 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing. IEEE, 460–467.
[99]
Haijun Xia, Sebastian Herscher, Ken Perlin, and Daniel Wigdor. 2018. Spacetime: Enabling fluid individual and collaborative editing in virtual reality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. 853–866.
[100]
Wenhua Yang, Chang Xu, Yepang Liu, Chun Cao, Xiaoxing Ma, and Jian Lu. 2014. Verifying self-adaptive applications suffering uncertainty. In Proceedings of the 29th ACM/IEEE international conference on Automated software engineering. 199–210.
[101]
Hui Ye and Hongbo Fu. 2022. ProGesAR: Mobile AR Prototyping for Proxemic and Gestural Interactions with Real-world IoT Enhanced Spaces. In CHI Conference on Human Factors in Computing Systems. 1–14.
[102]
Hui Ye, Jiaye Leng, Chufeng Xiao, Lili Wang, and Hongbo Fu. 2023. ProObjAR: Prototyping Spatially-aware Interactions of Smart Objects with AR-HMD. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–15.
[103]
Lian Yu, Wei-Tek Tsai, and Gian Perrone. 2016. Testing context-aware applications based on bigraphical modeling. IEEE Transactions on Reliability 65, 3 (2016), 1584–1611.
[104]
Daqing Zhang, Tao Gu, and Xiaohang Wang. 2005. Enabling context-aware smart home with semantic web technologies. International Journal of Human-friendly Welfare Robotic Systems 6, 4 (2005), 12–20.
[105]
Lei Zhang and Steve Oney. 2020. Flowmatic: An immersive authoring tool for creating interactive scenes in virtual reality. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 342–353.
[106]
Yang Zhang, Yasha Iravantchi, Haojian Jin, Swarun Kumar, and Chris Harrison. 2019. Sozu: Self-powered radio tags for building-scale activity sensing. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 973–985.
[107]
Hong Zhu, Patrick AV Hall, and John HR May. 1997. Software unit test coverage and adequacy. Acm computing surveys (csur) 29, 4 (1997), 366–427.
[108]
Zhengzhe Zhu, Ziyi Liu, Youyou Zhang, Lijun Zhu, Joey Huang, Ana M Villanueva, Xun Qian, Kylie Peppler, and Karthik Ramani. 2023. LearnIoTVR: An End-to-End Virtual Reality Environment Providing Authentic Learning Experiences for Internet of Things. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–17.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems
May 2024
18961 pages
ISBN:9798400703300
DOI:10.1145/3613904
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 May 2024

Permissions

Request permissions for this article.

Check for updates

Badges

Author Tags

  1. Context-Aware Policy
  2. Extended Reality
  3. Unit Test
  4. Validation

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

CHI '24

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 579
    Total Downloads
  • Downloads (Last 12 months)579
  • Downloads (Last 6 weeks)59
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media