Skip to main content

WiHead: WiFi-Based Head-Pose Estimation

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13326))

Abstract

Due to the impact of Covid-19, people have started to conduct online courses or meetings. However, this makes it difficult to communicate with each other effectively because of the lack of non-verbal communication. Although webcams are available for online courses, etc., people often do not want to turn them on for privacy reasons. Thus, there is a need to develop privacy preserving way to enable non-verbal communication in online learning and work environments. WiFi as a sensor can be used to detect non-verbal gestures such as head poses, and has been increasingly valued due to its advantages of avoiding the effects of light, non-line of sight monitoring, privacy protection, etc. In this paper, we proposed an approach, which uses WiFi CSI data to estimate head pose. Our approach not only use the amplitude and phase data of raw CSI data, but also use the information in frequency domain. Our experiment with proposed approach confirmed the feasibility of head pose estimation based on WiFi CSI data. This has important implications for device-free sensing detection. Especially in today’s world where web conferences and online courses are widely used, WiFi-based head recognition can give feedback to the other party while protecting privacy, which helps to improve the quality and comfort of communication.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Abdelnasser, H., Youssef, M., Harras, K.A.: WiGest: a ubiquitous WiFi-based gesture recognition system. In: 2015 IEEE Conference on Computer Communications (INFOCOM), pp. 1472–1480. IEEE (2015)

    Google Scholar 

  2. Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (1999)

    Google Scholar 

  3. Borghi, G., Fabbri, M., Vezzani, R., Calderara, S., Cucchiara, R.: Face-from-depth for head pose estimation on depth images. IEEE Trans. Pattern Anal. Mach. Intell. 42(3), 596–609 (2018)

    Article  Google Scholar 

  4. Cao, C., Weng, Y., Lin, S., Zhou, K.: 3D shape regression for real-time facial animation. ACM Trans. Graph. (TOG) 32(4), 1–10 (2013)

    Article  Google Scholar 

  5. Chang, C.Y., Chung, P.C., Yeh, Y.S., Yang, J.F.: An intelligent bulletin board system with real-time vision-based interaction using head pose estimation. In: 18th International Conference on Pattern Recognition (ICPR 2006), vol. 1, pp. 1140–1143. IEEE (2006)

    Google Scholar 

  6. Chen, Z., Zhang, L., Jiang, C., Cao, Z., Cui, W.: WiFi CSI based passive human activity recognition using attention based BLSTM. IEEE Trans. Mob. Comput. 18(11), 2714–2724 (2018)

    Article  Google Scholar 

  7. Ding, J., Wang, Y.: WiFi CSI-based human activity recognition using deep recurrent neural network. IEEE Access 7, 174257–174269 (2019)

    Article  Google Scholar 

  8. Gu, Y., Ren, F., Li, J.: PAWS: passive human activity recognition based on WiFi ambient signals. IEEE Internet Things J. 3(5), 796–805 (2015)

    Article  Google Scholar 

  9. Hoang, M.T., Yuen, B., Dong, X., Lu, T., Westendorp, R., Reddy, K.: Recurrent neural networks for accurate RSSI indoor localization. IEEE Internet Things J. 6(6), 10639–10651 (2019)

    Article  Google Scholar 

  10. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

    Google Scholar 

  11. Jha, S., Busso, C.: Analyzing the relationship between head pose and gaze to model driver visual attention. In: 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), pp. 2157–2162. IEEE (2016)

    Google Scholar 

  12. Matsumoto, Y., Zelinsky, A.: An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement. In: Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580), pp. 499–504. IEEE (2000)

    Google Scholar 

  13. Sigg, S., Blanke, U., Tröster, G.: The telepathic phone: frictionless activity recognition from WiFi-RSSI. In: 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom), pp. 148–155. IEEE (2014)

    Google Scholar 

  14. Vatahska, T., Bennewitz, M., Behnke, S.: Feature-based head pose estimation from images. In: 2007 7th IEEE-RAS International Conference on Humanoid Robots, pp. 330–335. IEEE (2007)

    Google Scholar 

  15. Wang, F., Zhou, S., Panev, S., Han, J., Huang, D.: Person-in-WiFi: fine-grained person perception using WiFi. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 5452–5461 (2019)

    Google Scholar 

  16. Wang, H., Zhang, D., Wang, Y., Ma, J., Wang, Y., Li, S.: RT-fall: a real-time and contactless fall detection system with commodity WiFi devices. IEEE Trans. Mob. Comput. 16(2), 511–526 (2016)

    Article  Google Scholar 

  17. Wang, Y., Liu, J., Chen, Y., Gruteser, M., Yang, J., Liu, H.: E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures. In: Proceedings of the 20th Annual International Conference on Mobile Computing and Networking, pp. 617–628 (2014)

    Google Scholar 

  18. Wang, Y., Guo, L., Lu, Z., Wen, X., Zhou, S., Meng, W.: From point to space: 3D moving human pose estimation using commodity WiFi. IEEE Commun. Lett. 25(7), 2235–2239 (2021)

    Article  Google Scholar 

  19. Whitehill, J., Movellan, J.R.: A discriminative approach to frame-by-frame head pose tracking. In: 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition, pp. 1–7. IEEE (2008)

    Google Scholar 

  20. Xie, X., Shin, K.G., Yousefi, H., He, S.: Wireless CSI-based head tracking in the driver seat. In: Proceedings of the 14th International Conference on emerging Networking EXperiments and Technologies, pp. 112–125 (2018)

    Google Scholar 

  21. Yang, R., Zhang, Z.: Model-based head pose tracking with stereovision. In: Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition, pp. 255–260. IEEE (2002)

    Google Scholar 

  22. Zhou, Y., Gregson, J.: WHENet: real-time fine-grained estimation for wide range head pose. arXiv preprint arXiv:2005.10353 (2020)

Download references

Acknowledgement

This work was supported by JSPS KAKENHI Grant Numbers 20H00622 and 17KT0154.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yiming Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, Y., Konomi, S. (2022). WiHead: WiFi-Based Head-Pose Estimation. In: Streitz, N.A., Konomi, S. (eds) Distributed, Ambient and Pervasive Interactions. Smart Living, Learning, Well-being and Health, Art and Creativity. HCII 2022. Lecture Notes in Computer Science, vol 13326. Springer, Cham. https://doi.org/10.1007/978-3-031-05431-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05431-0_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05430-3

  • Online ISBN: 978-3-031-05431-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics