Sangki Yun
ABSTRACT
Next generation devices, such as virtual reality (VR), augmented reality (AR), and smart appliances, demand a simple and intuitive way for users to interact with them. To address such needs, we develop a novel acoustic based device-free tracking system, called Strata, to enable a user to interact with a nearby device by simply moving his finger. In Strata, a mobile (e.g., smartphone) transmits known audio signals at inaudible frequency, and analyzes the received signal reflected by the moving finger to track the finger location. To explicitly take into account multipath propagation, the mobile estimates the channel impulse response (CIR), which characterizes signal traversal paths with different delays. Each channel tap corresponds to the multipath effects within a certain delay range. The mobile selects the channel tap corresponding to the finger movement and extracts the phase change of the selected tap to accurately estimate the distance change of a finger. Moreover, it estimates the absolute distance of the finger based on the change in CIR using a novel optimization framework. We then combine the absolute and relative distance estimates to accurately track the moving target. We implement our tracking system on Samsung Galaxy S4 mobile phone. Through micro-benchmarks and user studies, we show that our system achieves high tracking accuracy and low latency without extra hardware.
- Microsoft X-box Kinect. http://xbox.com.Google Scholar
- F. Adib, Z. Kabelac, D. Katabi, and R. Miller. Witrack: Motion tracking via radio reflections off the body. In Proc. of NSDI, 2014. Google ScholarDigital Library
- F. Adib, H. Mao, Z. Kabelac, D. Katabi, and R. C. Miller. Smart homes that monitor breathing and heart rate. In Proceedings of the CHI Conference on Human Factors in Computing Systems, pages 837--846. ACM, 2015. Google ScholarDigital Library
- M. T. I. Aumi, S. Gupta, M. Goel, E. Larson, and S. Patel. Doplink: Using the doppler effect for multi-device interaction. In Proc. of ACM UbiComp, pages 583--586, 2013. Google ScholarDigital Library
- P. Bahl and V. N. Padmanabhan. Radar: An in-building RF-based user location and tracking system. In INFOCOM 2000. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings. IEEE, volume 2, pages 775--784, 2000.Google ScholarCross Ref
- Google Cardboard. https://www.microsoft.com/microsoft-hololens/en-us.Google Scholar
- T. Carter, S. A. Seah, B. Long, B. Drinkwater, and S. Subramanian. Ultrahaptics: Multi-point mid-air haptic feedback for touch surfaces. In Proceedings of UIST, 2013. Google ScholarDigital Library
- Google Daydream. https://vr.google.com/daydream/.Google Scholar
- Edm mix 2017 - best remixes of popular music. https://www.youtube.com/watch?v=IpHXpQ5sWZI&t=1038s.Google Scholar
- Face camera - snappy photo. https://play.google.com/store/apps/details?id=com.fotoable.snapfilters.Google Scholar
- Microsoft HoloLens. https://www.microsoft.com/microsoft-hololens/en-us.Google Scholar
- W. Huang, Y. Xiong, X.-Y. Li, H. Lin, X. Mao, P. Yang, and Y. Liu. Shake and walk: Acoustic direction finding and fine-grained indoor localization using smartphones. In Proc. of IEEE INFOCOM, 2014.Google ScholarCross Ref
- K. Joshi, D. Bharadia, M. Kotaru, and S. Katti. Wideo: Fine-grained device-free motion tracing using RF backscatter. In Proc. of NSDI, 2015. Google ScholarDigital Library
- M. Kotaru, K. Joshi, D. Bharadia, and S. Katti. Spotfi: Decimeter level localization using wifi. In ACM SIGCOMM, volume 45, pages 269--282. ACM, 2015. Google ScholarDigital Library
- P. Lazik and A. Rowe. Indoor pseudo-ranging of mobile devices using ultrasonic chirps. In Proc. of ACM SenSys, pages 99--112, 2012. Google ScholarDigital Library
- Leap motion. https://www.leapmotion.com/.Google Scholar
- J. Lien, N. Gillian, M. E. Karagozler, P. Amihood, C. Schwesig, E. Olson, H. Raja, and I. Poupyrev. Soli: ubiquitous gesture sensing with millimeter wave radar. In Proc. of SIGGRAPH, 2016. Google ScholarDigital Library
- W. Mao, J. He, and L. Qiu. Accurate audio tracker. In Proceedings of ACM MobiCom, Oct. 2016.Google Scholar
- A. T. Mariakakis, S. Sen, J. Lee, and K.-H. Kim. Sail: Single access point-based indoor localization. In Proceedings of the 12th annual international conference on Mobile systems, applications, and services, pages 315--328. ACM, 2014. Google ScholarDigital Library
- R. Nandakumar, S. Gollakota, and N. Watson. Contactless sleep apnea detection on smartphones. In Proc. of ACM MobiSys, 2015. Google ScholarDigital Library
- R. Nandakumar, V. Iyer, D. Tan, and S. Gollakota. Fingerio: Using active sonar for fine-grained finger tracking. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 1515--1525. ACM, 2016. Google ScholarDigital Library
- A. V. Oppenheim, R. W. Schafer, J. R. Buck, et al. Discrete-time signal processing, volume 2. Prentice-hall Englewood Cliffs, 1989. Google ScholarDigital Library
- C. Peng, G. Shen, Y. Zhang, Y. Li, and K. Tan. BeepBeep: a high accuracy acoustic ranging system using COTS mobile devices. In Proc. of ACM SenSys, 2007. Google ScholarDigital Library
- Q. Pu, S. Gupta, S. Gollakota, and S. Patel. Whole-home gesture recognition using wireless signals. In Proc. of ACM MobiCom, 2013. Google ScholarDigital Library
- M. Pukkila. Channel estimation modeling. Nokia Research Center, 2000.Google Scholar
- A. Rai, K. K. Chintalapudi, V. N. Padmanabhan, and R. Sen. Zee: zero-effort crowdsourcing for indoor localization. In Proc. of ACM MobiCom, 2012. Google ScholarDigital Library
- T. S. Rappaport et al. Wireless communications: principles and practice, volume 2. Prentice Hall PTR New Jersey, 1996. Google ScholarDigital Library
- S. Sen, J. Lee, K.-H. Kim, and P. Congdon. Avoiding multipath to revive inbuilding wifi localization. In Proceeding of the 11th annual international conference on Mobile systems, applications, and services, pages 249--262. ACM, 2013. Google ScholarDigital Library
- L. Shangguan and K. Jamieson. The design and implementation of a mobile rfid tag sorting robot. In Proceedings of ACM MobiCom, pages 31--42. ACM, 2016. Google ScholarDigital Library
- K. G. Shin and Y.-C. Tung. Real-time warning for distracted pedestrians with smartphones, Sept. 25 2015. US Patent App. 14/865,262.Google Scholar
- A. Smith, H. Balakrishnan, M. Goraczko, and N. Priyantha. Tracking moving devices with the cricket location system. In Proc. of ACM MobiSys, 2005. Google ScholarDigital Library
- L. Sun, S. Sen, D. Koutsonikolas, and K. Kim. Widraw: Enabling hands-free drawing in the air on commodity wifi devices. In Proc. of ACM MobiCom, 2015. Google ScholarDigital Library
- Z. Sun, A. Purohit, R. Bose, and P. Zhang. Spartacus: spatially-aware interaction for mobile devices through energy-efficient audio sensing. In Proc. of ACM Mobisys, pages 263--276, 2013. Google ScholarDigital Library
- J. Taylor, L. Bordeaux, T. Cashman, B. Corish, C. Keskin, T. Sharp, E. Soto, D. Sweeney, J. Valentin, B. Luff, A. Topalian, E. Wood, S. Khamis, P. Kohli, S. Izadi, R. Banks, A. Fitzgibbon, and J. Shotton. Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. In Proc. of SIGGRAPH, 2016. Google ScholarDigital Library
- D. Tse and P. Viswanath. Fundamentals of wireless communication. Cambridge university press, 2005. Google ScholarDigital Library
- D. Vasisht, S. Kumar, and D. Katabi. Decimeter-level localization with a single wifi access point. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16), pages 165--178, 2016. Google ScholarDigital Library
- Vive. http://www.htcvive.com.Google Scholar
- J. Wang, D. Vasisht, and D. Katabi. RF-IDraw: virtual touch screen in the air using RF signals. In Proc. of ACM SIGCOMM, 2014. Google ScholarDigital Library
- S. Wang, J. Song, J. Lien, I. Poupyrev, and O. Hilliges. Interacting with soli: Exploring fine-grained dynamic gesture recognition in the radio-frequency spectrum. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST), pages 851--860. ACM, 2016. Google ScholarDigital Library
- W. Wang, A. X. Liu, and K. Sun. Device-free gesture tracking using acoustic signals. In Proceedings of ACM MobiCom, pages 82--94. ACM, 2016. Google ScholarDigital Library
- T. Wei and X. Zhang. mTrack: high precision passive tracking using millimeter wave radios. In Proc. of ACM MobiCom, 2015. Google ScholarDigital Library
- J. Xiong and K. Jamieson. Arraytrack: A fine-grained indoor location system. In Proc. of NSDI, pages 71--84, 2013. Google ScholarDigital Library
- L. Yang, Y. Chen, X.-Y. Li, C. Xiao, M. Li, and Y. Liu. Tagoram: Real-time tracking of mobile RFID tags to high precision using cots devices. In Proc. of ACM MobiCom, 2014. Google ScholarDigital Library
- S. Yun, Y. chao Chen, and L. Qiu. Turning a mobile device into a mouse in the air. In Proc. of ACM MobiSys, May 2015. Google ScholarDigital Library
- Z. Zhang, D. Chu, X. Chen, and T. Moscibroda. Swordfight: Enabling a new class of phone-to-phone action games on commodity phones. In Proc. of ACM MobiSys, 2012. Google ScholarDigital Library
Index Terms
- Strata: Fine-Grained Acoustic-based Device-Free Tracking
Recommendations
Low‐complexity channel estimation and turbo equalisation for high frequency channels
A low‐complexity channel estimation algorithm is proposed to improve performance of two high frequency standardised waveforms: MIL‐STD‐188‐110B Appendix C standard and STANAG 4285. In the proposed estimation algorithm, the channel impulse response is ...
Mobile-to-Mobile Wideband MIMO Channel Realization by Using a Two-Ring Geometry-Based Stochastic Scattering Model
In this paper, a geometry-based stochastic scattering model (GBSSM) for wideband multiple-input multiple-output mobile-to-mobile (M2M) isotropic scattering fading channels is proposed. The model is based on a two-ring scattering model which can be ...
Multi‐user indoor ultra‐wideband wireless communication using polyphase spreading sequences
In this study, the authors design a multi‐user ultra‐wideband system for indoor wireless communication. The proposed system is useful in multipath radio reception as the full multipath diversity gain is achieved. The system has multiple transmitters and ...
Comments