Andrew D. Wilson
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Coronavirus is thought to spread through close contact from person to person. While it is believed that the primary means of spread is by inhaling respiratory droplets or aersols, it may also be spread by touching inanimate objects such as doorknobs and handrails that have the virus on it ("fomites''). The Centers for Disease Control and Prevention (CDC) therefore recommends individuals maintain "social distance'' of more than six feet between one another. It further notes that an individual may be infected by touching a fomite and then touching their own mouth, nose or possibly their eyes. We propose the use of computer vision techniques to combat the spread of coronavirus by sounding an audible alarm when an individual touches their own face, or when multiple individuals come within six feet of one another or shake hands. We further propose using depth cameras to track where people touch parts of their physical environment throughout the day, and a simple model of disease spread among potential fomites. Projection mapping techniques can be used to display likely fomites in realtime, while headworn augmented reality systems can be used by custodial staff to perform more effective cleaning of surfaces. Such techniques may find application in particularly vulnerable settings such as schools, long-term care facilities and physician offices.
Supplemental Material
- Arduino Team. 2020. This pair of Arduino glasses stops you from touching your face. https://blog.arduino.cc/2020/03/ 10/this-pair-of-arduino-glasses-stops-you-from-touching-your-face/. Proc. ACM Hum.-Comput. Interact., Vol. 4, No. ISS, Article 203. Publication date: November 2020. 203:12 Andrew D. WilsonGoogle Scholar
- Z. Cao, G. Hidalgo Martinez, T. Simon, S. Wei, and Y. A. Sheikh. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2019).Google Scholar
- Centers for Disease Control and Prevention. 2020. CDC updates COVID-19 transmission webpage to clarify information about types of spread. https://www.cdc.gov/media/releases/2020/s0522-cdc-updates-covid-transmission.html.Google Scholar
- Centers for Disease Control and Prevention. 2020. How COVID-19 Spreads. https://www.cdc.gov/coronavirus/2019- ncov/prevent-getting-sick/how-covid-spreads.html.Google Scholar
- Xiang 'Anthony' Chen. 2020. FaceOff: Detecting Face Touching with a Wrist-Worn Accelerometer. arXiv:2008.01769 [cs.HC]Google Scholar
- Zhen-Dong Guo, Zhong-Yi Wang, Shou-Feng Zhang, Xiao Li, Lin Li, Chao Li, Yan Cui, Rui-Bin Fu, Yun-Zhu Dong, Xiang-Yang Chi, et al. 2020. Aerosol and surface distribution of severe acute respiratory syndrome coronavirus 2 in hospital wards, Wuhan, China, 2020. Emerg Infect Dis 26, 7 (2020).Google Scholar
- Otmar Hilliges, David Kim, Shahram Izadi, Malte Weiss, and Andrew Wilson. 2012. HoloDesk: Direct 3d Interactions with a Situated See-through Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 2421--2430. https: //doi.org/10.1145/2207676.2208405Google ScholarDigital Library
- Shahram Izadi, Richard A. Newcombe, David Kim, Otmar Hilliges, David Molyneaux, Steve Hodges, Pushmeet Kohli, Jamie Shotton, Andrew J. Davison, and Andrew Fitzgibbon. 2011. KinectFusion: Real-Time Dynamic 3D Surface Reconstruction and Interaction. In ACM SIGGRAPH 2011 Talks (Vancouver, British Columbia, Canada) (SIGGRAPH '11). Association for Computing Machinery, NewYork, NY, USA, Article 23, 1 pages. https://doi.org/10.1145/2037826.2037857Google ScholarDigital Library
- Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, AndrewWilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector- Camera Units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST '14). Association for Computing Machinery, New York, NY, USA, 637--644. https://doi.org/10. 1145/2642918.2647383Google ScholarDigital Library
- Alicia NM Kraay, Michael AL Hayashi, Nancy Hernandez-Ceron, Ian H Spicknall, Marisa C Eisenberg, Rafael Meza, and Joseph NS Eisenberg. 2018. Fomite-mediated transmission as a sufficient pathway: a comparative analysis across three viral pathogens. BMC infectious diseases 18, 1 (2018), 540.Google Scholar
- Mary Y. Y. Lai, Peter K. C. Cheng, and Wilina W. L. Lim. 2005. Survival of Severe Acute Respiratory Syndrome Coronavirus. Clinical Infectious Diseases 41, 7 (10 2005), e67--e71. https://doi.org/10.1086/433186 arXiv:https://academic.oup.com/cid/article-pdf/41/7/e67/881171/41--7-e67.pdfGoogle Scholar
- David Lindlbauer and Andy D. Wilson. 2018. Remixed Reality: Manipulating Space and Time in Augmented Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, Article 129, 13 pages. https://doi.org/10.1145/3173574. 3173703Google Scholar
- Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 315--326. https://doi.org/10.1145/2047196.2047238Google ScholarDigital Library
- Microsoft. 2020. About Azure Kinect Sensor SDK. https://docs.microsoft.com/en-us/azure/kinect-dk/about-sensor-sdk.Google Scholar
- Microsoft. 2020. Azure Kinect DK. https://azure.microsoft.com/en-us/services/kinect-dk/.Google Scholar
- Microsoft. 2020. Quickstart: Set up Azure Kinect body tracking. https://docs.microsoft.com/en-us/azure/kinectdk/ body-sdk-setup.Google Scholar
- Microsoft Research. 2015. RoomAlive Toolkit. https://github.com/Microsoft/RoomAliveToolkit.Google Scholar
- Brian Moore Mike Bodge and Isaac Blankensmith. 2020. https://donottouchyourface.com/.Google Scholar
- MIT Media Lab. 2020. Project Saving Face. https://www.media.mit.edu/projects/saving-face/overview/.Google Scholar
- New York Times. 2020. This 3-D Simulation Shows Why Social Distancing Is So Important. https://www.nytimes. com/interactive/2020/04/14/science/coronavirus-transmission-cough-6-feet-ar-ul.html.Google Scholar
- New York Times. 2020. What's the Risk of Catching Coronavirus From a Surface? https://www.nytimes.com/2020/05/ 28/well/live/whats-the-risk-of-catching-coronavirus-from-a-surface.html.Google Scholar
- Mark Nicas and Daniel Best. 2008. A Study Quantifying the Hand-to-Face Contact Rate and Its Potential Application to Predicting Respiratory Tract Infection. Journal of Occupational and Environmental Hygiene 5, 6 (2008), 347--352. https://doi.org/10.1080/15459620802003896 arXiv:https://doi.org/10.1080/15459620802003896 PMID: 18357546.Google ScholarCross Ref
- Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-Time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Proc. ACM Hum.-Comput. Interact., Vol. 4, No. ISS, Article 203. Publication date: November 2020. Combating the Spread of Coronavirus by Modeling Fomites with Depth Cameras 203:13 Machinery, New York, NY, USA, 741--754. https://doi.org/10.1145/2984511.2984517Google ScholarDigital Library
- Mark Rober. 2020. How To See Germs Spread (Coronavirus). https://www.youtube.com/watch?v=I5-dI74zxPg.Google Scholar
- Jamie Shotton, Toby Sharp, Alex Kipman, Andrew Fitzgibbon, Mark Finocchio, Andrew Blake, Mat Cook, and Richard Moore. 2013. Real-Time Human Pose Recognition in Parts from Single Depth Images. Commun. ACM 56, 1 (Jan. 2013), 116--124. https://doi.org/10.1145/2398356.2398381Google ScholarDigital Library
- TechCrunch. 2020. Immutouch wristband buzzed to stop touching your face. https://techcrunch.com/2020/03/09/dontimmutouch/.Google Scholar
- Neeltje van Doremalen, Trenton Bushmaker, Dylan H. Morris, Myndi G. Holbrook, Amandine Gamble, Brandi N. Williamson, Azaibi Tamin, Jennifer L. Harcourt, Natalie J. Thornburg, Susan I. Gerber, James O. Lloyd-Smith, Emmie de Wit, and Vincent J. Munster. 2020. Aerosol and Surface Stability of SARS-CoV-2 as Compared with SARS-CoV-1. New England Journal of Medicine 382, 16 (2020), 1564--1567. https://doi.org/10.1056/NEJMc2004973 arXiv:https://doi.org/10.1056/NEJMc2004973Google ScholarCross Ref
- Washington Post. 2020. Officials keep warning the public not to touch their faces -- and then do just that. https: //www.youtube.com/watch?v=mA1wqjaeKj0.Google Scholar
- Andrew Wilson, Hrvoje Benko, Shahram Izadi, and Otmar Hilliges. 2012. Steerable Augmented Reality with the Beamatron. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST '12). Association for Computing Machinery, New York, NY, USA, 413--422. https://doi.org/ 10.1145/2380116.2380169Google ScholarDigital Library
- Andrew D. Wilson. 2010. Using a Depth Camera as a Touch Sensor. In ACM International Conference on Interactive Tabletops and Surfaces (Saarbrücken, Germany) (ITS '10). Association for Computing Machinery, New York, NY, USA, 69--72. https://doi.org/10.1145/1936652.1936665Google ScholarDigital Library
- Andrew D. Wilson. 2017. Fast Lossless Depth Image Compression. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (Brighton, United Kingdom) (ISS '17). Association for Computing Machinery, New York, NY, USA, 100--105. https://doi.org/10.1145/3132272.3134144Google ScholarDigital Library
- Andrew D. Wilson and Hrvoje Benko. 2010. Combining Multiple Depth Cameras and Projectors for Interactions on, above and between Surfaces. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST '10). Association for Computing Machinery, New York, NY, USA, 273--282. https://doi.org/10.1145/1866029.1866073Google Scholar
- Chi-Jui Wu, Steven Houben, and Nicolai Marquardt. 2017. EagleSense: Tracking People and Devices in Interactive Spaces Using Real-Time Top-View Depth-Sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 3929--3942. https://doi.org/10.1145/3025453.3025562Google ScholarDigital Library
- Robert Xiao, Scott Hudson, and Chris Harrison. 2016. DIRECT: Making Touch Tracking on Ordinary Surfaces Practical with Hybrid Depth-Infrared Sensing. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS '16). Association for Computing Machinery, New York, NY, USA, 85--94. https://doi.org/10.1145/2992154.2992173Google ScholarDigital Library
- Jijun Zhao, Joseph E Eisenberg, Ian H Spicknall, Sheng Li, and James S Koopman. 2012. Model analysis of fomite mediated influenza transmission. PloS one 7, 12 (2012).Google Scholar
Index Terms
- Combating the Spread of Coronavirus by Modeling Fomites with Depth Cameras
Recommendations
Modeling the spread dynamics of multiple-variant coronavirus disease under public health interventions: A general framework
AbstractThe COVID-19 pandemic was caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which is a single-stranded positive-stranded RNA virus with a high multi-directional mutation rate. Many new variants even have an immune-evading ...
Highlights- An epidemiological SEUACRD-VP model considering multi-directional mutation process and multiple variants of COVID-19 is proposed.
- The cost-effectiveness of a wide spectrum of single or combined public health intervention strategies is ...
Mental health toll from the coronavirus: Social media usage reveals Wuhan residents’ depression and secondary trauma in the COVID-19 outbreak
AbstractThis study investigates the possible association between social media usage and the mental health toll from the coronavirus at the peak of Wuhan's COVID-19 outbreak. Informed by the Crisis and Emergency Risk Communication Model and ...
Highlights- This study reveals mental health toll at the peak of Wuhan's COVID-19 outbreak.
Phenotyping coronavirus disease 2019 during a global health pandemic: Lessons learned from the characterization of an early cohort
Graphical abstractDisplay Omitted
Highlights- New patient population-level characteristics should be assessed in a health pandemic.
AbstractFrom the start of the coronavirus disease 2019 (COVID-19) pandemic, researchers have looked to electronic health record (EHR) data as a way to study possible risk factors and outcomes. To ensure the validity and accuracy of research ...
Comments