survey

A Survey on Seismic Sensor based Target Detection, Localization, Identification, and Activity Recognition

Authors:
Priyankar Choudhary

Indian Institute of Technology Ropar, Rupnagar, Punjab, India

Indian Institute of Technology Ropar, Rupnagar, Punjab, India

0000-0003-2688-7415
View Profile

,
Neeraj Goel

Indian Institute of Technology Ropar, Rupnagar, Punjab, India

Indian Institute of Technology Ropar, Rupnagar, Punjab, India

0000-0003-3824-9437
View Profile

,
Mukesh Saini

Indian Institute of Technology Ropar, Rupnagar, Punjab, India

Indian Institute of Technology Ropar, Rupnagar, Punjab, India

0000-0003-2215-9365
View Profile

Authors Info & Claims

ACM Computing Surveys Volume 55 Issue 11Article No.: 223pp 1–36https://doi.org/10.1145/3568671

Published:09 February 2023Publication History

ACM Computing Surveys

Abstract

Current sensor technologies facilitate device-free and non-invasive monitoring of target activities and infrastructures to ensure a safe and inhabitable environment. Device-free techniques for sensing the surrounding environment are an emerging area of research where a target does not need to carry or attach any device to provide information about its motion or the surrounding environment. Consequently, there has been an increasing interest in device-free sensing. Seismic sensors are extremely effective tools for gathering target motion information. In this paper, we provide a comprehensive overview of the seismic sensor-based device-free sensing process and highlight the key techniques within the research field. We classify the existing literature into three categories, viz., (i) target detection, (ii) target localization, and (iii) target identification, and activity recognition. The techniques in each category are divided into multiple subcategories in a structured manner to comprehensively discuss the details. We also discuss the challenges associated with contemporary cutting-edge research and suggest potential solutions.

REFERENCES

[1] Harbi Fatima S. Al and Helgert Hermann J.. 2010. An improved Chan-Ho location algorithm for TDOA subscriber position estimation. International Journal of Computer Science and Network Security 10, 9 (Sept.2010), 101–105.Google Scholar
[2] Alajlouni Sa’ed and Tarazaga Pablo. 2020. A passive energy-based method for footstep impact localization, using an underfloor accelerometer sensor network with Kalman filtering. J. Vib. Control 26, 11-12 (2020), 941–951.Google ScholarCross Ref
[3] Alippi Cesare, Bocca Maurizio, Boracchi Giacomo, Patwari Neal, and Roveri Manuel. 2015. RTI goes wild: Radio tomographic imaging for outdoor people detection and localization. IEEE Trans. Mob. Comput. 15, 10 (Oct.2015), 2585–2598.Google ScholarDigital Library
[4] Allen Michael, Baydere Sebnem, Gaura Elena, and Kucuk Gurhan. 2009. Evaluation of localization algorithms. In Localization Algorithms and Strategies for Wireless Sensor Networks: Monitoring and Surveillance Techniques for Target Tracking. IGI Global, Hershey, PA, USA, 348–379.Google ScholarCross Ref
[5] Alpaydin Ethem. 2014. Introduction to Machine Learning, Third Edition. MIT Press, Cambridge, MA, USA.Google ScholarDigital Library
[6] Altmann Jurgen. 2004. Acoustic and seismic signals of heavy military vehicles for co-operative verification. J. Sound Vib. 273, 4–5 (June2004), 713–740. DOI:Google ScholarCross Ref
[7] Anchal Sahil, Mukhopadhyay Bodhibrata, and Kar Subrat. 2017. UREDT: Unsupervised learning based real-time footfall event detection technique in seismic signal. IEEE Sens. Lett. 2, 1 (Mar.2017), 1–4. DOI:Google ScholarCross Ref
[8] Andrews J., Vakil A., and Li J.. 2020. Biometric authentication and stationary detection of human subjects by deep learning of passive infrared (PIR) sensor data. In Proceedings of IEEE Signal Processing in Medicine and Biology Symposium (SPMB’20). IEEE, Philadelphia, PA, USA, 1–6. DOI:Google ScholarCross Ref
[9] Anghelescu Petre, Iana Gabriel Vasile, and Tramandan Ionut. 2015. Human footstep detection using seismic sensors. In Proceedings of 7th International Conference on Electronics, Computers and Artificial Intelligence (ECAI’15). IEEE, Bucharest, Romania, AE–1. DOI:Google ScholarCross Ref
[10] Audette William E., Kynor David B., Wilbur Jed C., Gagne John R., and Peck Lindamae. 2009. Improved intruder detection using seismic sensors and adaptive noise cancellation. In Human, Light Vehicle, and Tunnel Detection Workshop (HLVTDW’09). Creare Inc., Hanover, NH, USA, 1–14.Google Scholar
[11] Bahrampour Soheil, Ray Asok, Sarkar Soumalya, Damarla Thyagaraju, and Nasrabadi Nasser M.. 2013. Performance comparison of feature extraction algorithms for target detection and classification. Pattern Recognit. Lett. 34, 16 (Dec.2013), 2126–2134.Google ScholarDigital Library
[12] Bahroun R., Michel Olivier, Frassati Francois, Carmona Mikael, and Lacoume Jean-Louis. 2014. New algorithm for footstep localization using seismic sensors in an indoor environment. J. Sound Vib. 333, 3 (Feb.2014), 1046–1066.Google ScholarCross Ref
[13] Banerdt W. B., Smrekar S., Lognonné P., Spohn T., Asmar S. W., Banfield D., Boschi L., Christensen U., Dehant V., Folkner W., et al. 2013. InSight: A discovery mission to explore the interior of Mars. In Proceeding of 44th Lunar and Planetary Science Conference. The Woodlands, Texas, 1915.Google Scholar
[14] Bian Xuehai, Abowd Gregory D., and Rehg James Matthew. 2004. Using Sound Source Localization to Monitor and Infer Activities in the Home. Technical Report. Georgia Institute of Technology.Google Scholar
[15] Biau Gérard and Scornet Erwan. 2016. A random forest guided tour. Test 25, 2 (2016), 197–227.Google ScholarCross Ref
[16] Bonde Amelie, Noh Hae Young, Pan Shijia, and Zhang Pei. 2019. Demo abstract: Deskbuddy: An office activity detection system. In Proceedings of 18th International Conference on Information Processing in Sensor Networks (IPSN’19). ACM/IEEE, Montreal, QC, Canada, 352–353.Google ScholarDigital Library
[17] Bormann P. and Wielandt E.. 2002. Chapter 4-Seismic signals and noise. IASPEI New Manual of Seismological Observatory Practice, GeoForschungsZentrum Potsdam 1 (2002), 34.Google Scholar
[18] Paterna Vicente Canton, Auge Anna Calveras, Aspas Josep Paradells, and Bullones Maria Alejandra Perez. 2017. A Bluetooth low energy indoor positioning system with channel diversity, weighted trilateration and Kalman filtering. Sensors 17, 12 (Dec.2017), 2927.Google ScholarCross Ref
[19] Casale Pierluigi, Pujol Oriol, and Radeva Petia. 2011. Human activity recognition from accelerometer data using a wearable device. In Proceedings of Iberian Conference on Pattern Recognition and Image Analysis. Springer, Berlin, Germany, 289–296.Google ScholarCross Ref
[20] Chen L. H., Chen D. Y., Wang J. B., Sun Z. Y., Li G. L., and Chen J.. 2017. A MEMS based integrated three axial electrochemical seismic sensor. In Proceedings of 19th International Conference on Solid-State Sensors, Actuators and Microsystems (TRANSDUCERS). IEEE, Kaohsiung, Taiwan, 1017–1020.Google ScholarCross Ref
[21] Chetty Girija, White Matthew, and Akther Farnaz. 2015. Smart phone based data mining for human activity recognition. Procedia Computer Science 46 (Jan.2015), 1181–1187.Google ScholarDigital Library
[22] Choudhary Priyankar, Goel Neeraj, and Saini Mukesh. 2020. Event detection and localization for sparsely populated outdoor environment using seismic sensor. In Proceedings of 6th International Conference on Multimedia Big Data (BigMM’20). IEEE, New Delhi, India, 346–350.Google ScholarCross Ref
[23] Choudhary Priyankar, Goel Neeraj, and Saini Mukesh. 2021. A seismic sensor based human activity recognition framework using deep learning. In Proceedings of 17th International Conference on Advanced Video and Signal Based Surveillance (AVSS’21). IEEE, Washington, DC, USA, 1–8.Google ScholarCross Ref
[24] Choudhary Priyankar, Goel Neeraj, and Saini Mukesh. 2022. A fingerprinting based audio-seismic systems for human target localization in an outdoor environment using regression. IEEE Sens. J. 22, 8 (Feb.2022), 7944–7960.Google ScholarCross Ref
[25] Clemente Jose, Li Fangyu, Valero Maria, and Song WenZhan. 2019. Smart seismic sensing for indoor fall detection, location, and notification. IEEE J. Biomed. Health Inform. 24, 2 (Feb.2019), 524–532.Google ScholarCross Ref
[26] Codling Jesse R., Mirshekari Mostafa, Noh Hae Young, and Zhang Pei. 2020. Demo abstract: Active structural occupant detector. In Proceedings of 19th International Conference on Information Processing in Sensor Networks (IPSN’20). ACM/IEEE, Sydney, NSW, Australia, 353–354.Google ScholarCross Ref
[27] Crocco Marco, Cristani Marco, Trucco Andrea, and Murino Vittorio. 2016. Audio surveillance: A systematic review. ACM Computing Surveys (CSUR) 48, 4 (May2016), 1–46.Google ScholarDigital Library
[28] Cunningham Padraig and Delany Sarah Jane. 2021. K-nearest neighbour classifiers-a tutorial. ACM Computing Surveys (CSUR) 54, 6 (July2021), 1–25.Google ScholarDigital Library
[29] Damarla Raju and Ufford David. 2007. Personnel detection using ground sensors. In Unattended Ground, Sea, and Air Sensor Technologies and Applications IX, Vol. 6562. International Society for Optics and Photonics, Orlando, FL, USA, 656205.Google Scholar
[30] Damarla Thyagaraju, Mehmood Asif, and Sabatier James. 2011. Detection of people and animals using non-imaging sensors. In Proceedings of 14th International Conference on Information Fusion. IEEE, Chicago, IL, USA, 1–8.Google Scholar
[31] Denis Stijn, Berkvens Rafael, and Weyn Maarten. 2019. A survey on detection, tracking and identification in radio frequency-based device-free localization. Sensors 19, 23 (Dec.2019), 5329.Google ScholarCross Ref
[32] Dibazar Alireza A., Park Hyung O., and Berger Theodore W.. 2007. The application of dynamic synapse neural networks on footstep and vehicle recognition. In Proceedings of International Joint Conference on Neural Networks. IEEE, Orlando, FL, USA, 1842–1846.Google ScholarCross Ref
[33] Drira Slah, Reuland Yves, Olsen Nils F. H., Pai Sai G. S., and Smith Ian F. C.. 2019. Occupant-detection strategy using footstep-induced floor vibrations. In Proceedings of 1st International Workshop on Device-Free Human Sensing. ACM, New York, USA, 31–34.Google ScholarDigital Library
[34] Geethanjali P., Mohan Y. Krishna, and Sen Jinisha. 2012. Time domain feature extraction and classification of EEG data for brain computer interface. In Proceedings of 9th International Conference on Fuzzy Systems and Knowledge Discovery. IEEE, Chongqing, China, 1136–1139.Google ScholarCross Ref
[35] Goodfellow Ian, Bengio Yoshua, and Courville Aaron. 2016. Deep Learning. MIT Press, Cambridge, MA, USA.Google ScholarDigital Library
[36] Goodman Graham L.. 1999. Detection and classification for unattended ground sensors. In Proceedings of Information, Decision and Control. Data and Information Fusion Symposium, Signal Processing and Communications Symposium and Decision and Control Symposium. Proceedings (Cat. No. 99EX251). IEEE, Adelaide, SA, Australia, 419–424.Google ScholarCross Ref
[37] Gramann Richard A., Bennett Mary Beth, and O’Brien Thomas D.. 1999. Vehicle and personnel detection using seismic sensors. In Sensors, C3I, Information, and Training Technologies for Law Enforcement, Vol. 3577. SPIE, Boston, MA, USA, 74–85.Google Scholar
[38] Hastie Trevor, Rosset Saharon, Zhu Ji, and Zou Hui. 2009. Multi-class AdaBoost. Statistics and its Interface 2, 3 (2009), 349–360.Google ScholarCross Ref
[39] He Pengju, Chen Xiaomeng, and Zeng Huazhi. 2016. Wireless sensor network for multi-target detection algorithm based on blind source separation. International Journal of Security and Networks 11, 4 (Jan.2016), 235–241.Google ScholarDigital Library
[40] Hong Sang Gi, Kim Nae Soo, and Kim Whan Woo. 2013. Reduction of false alarm signals for PIR sensor in realistic outdoor surveillance. ETRI J. 35, 1 (Feb. 2013), 80–88.Google ScholarCross Ref
[41] Hossin Mohammad and Sulaiman Md. Nasir. 2015. A review on evaluation metrics for data classification evaluations. Int. J. Data Min. Knowl. Manag. Process 5, 2 (Mar.2015), 1.Google ScholarCross Ref
[42] Houston Kenneth M. and McGaffigan Daniel P.. 2003. Spectrum analysis techniques for personnel detection using seismic sensors. In Unattended Ground Sensor Technologies and Applications V, Vol. 5090. International Society for Optics and Photonics, Orlando, FL, USA, 162–173.Google Scholar
[43] Huang Jingchang, Zhou Qianwei, Zhang Xin, Song Enliang, Li Baoqing, and Yuan Xiaobing. 2013. Seismic target classification using a wavelet packet manifold in unattended ground sensors systems. Sensors 13, 7 (July2013), 8534–8550.Google ScholarCross Ref
[44] Iyengar Satish G., Varshney Pramod K., and Damarla Thyagaraju. 2007. On the detection of footsteps based on acoustic and seismic sensing. In Proceedings of 41st Asilomar Conference on Signals, Systems and Computers. IEEE, Pacific Grove, CA, USA, 2248–2252.Google ScholarCross Ref
[45] Izenman Alan Julian. 2013. Linear discriminant analysis. In Modern Multivariate Statistical Techniques. Springer, New York, USA, 237–280.Google ScholarCross Ref
[46] Jia Zhenhua, Alaziz Musaab, Chi Xiang, Howard Richard E., Zhang Yanyong, Zhang Pei, Trappe Wade, Sivasubramaniam Anand, and An Ning. 2016. HB-phone: A bed-mounted geophone-based heartbeat monitoring system. In Proceedings of 15th International Conference on Information Processing in Sensor Networks (IPSN’16). ACM/IEEE, Vienna, Austria, 1–12.Google ScholarCross Ref
[47] Jia Zhenhua, Bonde Amelie, Li Sugang, Xu Chenren, Wang Jingxian, Zhang Yanyong, Howard Richard E., and Zhang Pei. 2017. Monitoring a person’s heart rate and respiratory rate on a shared bed using geophones. In Proceedings of the 15th Conference on Embedded Network Sensor Systems. ACM, Delft, The Netherlands, 1–14.Google ScholarDigital Library
[48] Jin Xin, Gupta Shalabh, Mukherjee Kushal, and Ray Asok. 2011. Wavelet-based feature extraction using probabilistic finite state automata for pattern classification. Pattern Recognit. Lett. 44, 7 (July2011), 1343–1356.Google ScholarDigital Library
[49] Jin Xin, Gupta Shalabh, Ray Asok, and Damarla Thyagaraju. 2011. Symbolic dynamic filtering of seismic sensors for target detection and classification. In Proceedings of American Control Conference. IEEE, Hilton San Francisco, California, USA, 5151–5156.Google ScholarCross Ref
[50] Jin Xin, Sarkar Soumalya, Ray Asok, Gupta Shalabh, and Damarla Thyagaraju. 2011. Target detection and classification using seismic and PIR sensors. IEEE Sens. J. 12, 6 (June2011), 1709–1718.Google ScholarCross Ref
[51] Kalra Manish, Kumar Satish, and Das Bhargab. 2018. Target detection using smooth pseudo Wigner-Ville distribution. In Proceedings of IEEE Recent Advances in Intelligent Computational Systems (RAICS’18). IEEE, Thiruvananthapuram, India, 6–10.Google ScholarCross Ref
[52] Kalra Manish, Kumar Satish, and Das Bhargab. 2019. Moving ground target detection with seismic signal using smooth pseudo Wigner–Ville distribution. IEEE Trans. Instrum. Meas. 69, 6 (June2019), 3896–3906.Google ScholarCross Ref
[53] Kalra Manish, Kumar Satish, and Das Bhargab. 2019. Target detection on the basis of empirical wavelet transform using seismic signal. In 2019 IEEE Bombay Section Signature Conference (IBSSC’19). IEEE, Mumbai, India, 1–4.Google ScholarCross Ref
[54] Kalra Manish, Kumar Satish, and Das Bhargab. 2020. Seismic signal analysis using empirical wavelet transform for moving ground target detection and classification. IEEE Sens. J. 20, 14 (July2020), 7886–7895.Google ScholarCross Ref
[55] Kalra Manish, Kumar Satish, and Das Bhargab. 2021. Analysis of instantaneous amplitude and frequency of EWT modes for automatic target classification. In Proceedings of IEEE Bombay Section Signature Conference (IBSSC’21). IEEE, Gwalior, India, 1–6.Google ScholarCross Ref
[56] Ke Shian-Ru, Thuc Hoang Le Uyen, Lee Yong-Jin, Hwang Jenq-Neng, Yoo Jang-Hee, and Choi Kyoung-Ho. 2013. A review on video-based human activity recognition. Computers 2, 2 (June2013), 88–131.Google ScholarCross Ref
[57] Keally Matthew, Zhou Gang, Xing Guoliang, Wu Jianxin, and Pyles Andrew. 2011. PBN: Towards practical activity recognition using smartphone-based body sensor networks. In Proceedings of 9th ACM Conference on Embedded Networked Sensor Systems. ACM, Seattle, WA, USA, 246–259.Google ScholarDigital Library
[58] Koc Gokhan and Yegin Korkut. 2013. Footstep and vehicle detection using seismic sensors in wireless sensor network: Field tests. Int. J. Distrib. Sens. Netw. 9, 10 (Oct.2013), 120386.Google ScholarCross Ref
[59] Krogh Anders. 2008. What are artificial neural networks? Nature Biotechnology 26, 2 (2008), 195–197.Google ScholarCross Ref
[60] Kuccukbay Selver Ezgi, Sert Mustafa, and Yazici Adnan. 2017. Use of acoustic and vibration sensor data to detect objects in surveillance wireless sensor networks. In Proceedings of 21st International Conference on Control Systems and Computer Science (CSCS’17). IEEE, Bucharest, Romania, 207–212.Google ScholarCross Ref
[61] Kwapisz Jennifer R., Weiss Gary M., and Moore Samuel A.. 2010. Activity recognition using cell phone accelerometers. ACM SIGKDD Explorations Newsletter 12, 2 (Dec.2010), 74–82.Google ScholarDigital Library
[62] Lacombe James, Peck Lindamae, Anderson Thomas, and Fisk David. 2006. Seismic detection algorithm and sensor deployment recommendations for perimeter security. In Unattended Ground, Sea, and Air Sensor Technologies and Applications VIII, Vol. 6231. SPIE, Orlando, Florida, USA, 623109.Google Scholar
[63] Lam Mike, Mirshekari Mostafa, Pan Shijia, Zhang Pei, and Noh Hae Young. 2016. Robust occupant detection through step-induced floor vibration by incorporating structural characteristics. Dynamics of Coupled Structures 4 (May2016), 357–367.Google ScholarCross Ref
[64] Larose Eric, Khan A., Nakamura Y., and Campillo M.. 2005. Lunar subsurface investigated from correlation of seismic noise. Geophys. Res. Lett. 32, 16 (Aug.2005).Google ScholarCross Ref
[65] Lee Boon-Giin, Lee Seung-Chul, Chung Wan-Young, et al. 2008. Enhanced RSSI-based high accuracy real-time user location tracking system for indoor and outdoor environments. Int. J. Smart Sens. Intell. Syst. 1, 2 (June2008), 534–548.Google Scholar
[66] Lee Suk, Ha Kyoung Nam, and Lee Kyung Chang. 2006. A pyroelectric infrared sensor-based indoor location-aware system for the smart home. IEEE Trans. Consum. Electron. 52, 4 (Nov.2006), 1311–1317.Google ScholarDigital Library
[67] Li Dan, Wong Kerry D., Hu Yu Hen, and Sayeed Akbar M.. 2002. Detection, classification, and tracking of targets. IEEE Signal Process Mag. 19, 2 (Mar.2002), 17–29.Google ScholarCross Ref
[68] Liu Jian, Liu Hongbo, Chen Yingying, Wang Yan, and Wang Chen. 2019. Wireless sensing for human activity: A survey. IEEE Commun. Surv. Tutor. 22, 3 (Aug.2019), 1629–1645.Google ScholarCross Ref
[69] Liu Jason J., Phillips Cody, and Daniilidis Kostas. 2010. Video-based localization without 3D mapping for the visually impaired. In Proceedings of Computer Society Conference on Computer Vision and Pattern Recognition-Workshops. IEEE, San Francisco, California, USA, 23–30.Google ScholarCross Ref
[70] Loh Wei-Yin. 2011. Classification and regression trees. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 1, 1 (Jan.2011), 14–23.Google ScholarCross Ref
[71] Lygouras Eleftherios and Gasteratos Antonios. 2021. A novel moving-base RTK-GPS-based wearable apparatus for precise localization of humans in peril. Microprocess. Microsyst. 82 (Apr. 2021), 103833.Google ScholarDigital Library
[72] McCallum Andrew, Nigam Kamal, et al. 1998. A comparison of event models for Naive Bayes text classification. In Proceedings of 15th National Conference on Artificial Intelligence (AAAI-98), Vol. 752. Citeseer, Madison, Wisconsin, USA, 41–48.Google Scholar
[73] Mehmood Asif, Damarla Thyagaraju, and Sabatier James. 2012. Separation of human and animal seismic signatures using non-negative matrix factorization. Pattern Recognit. Lett. 33, 16 (Dec.2012), 2085–2093.Google ScholarDigital Library
[74] Mehmood Asif, Patel Vishal M., and Damarla Thyagaraju. 2012. Discrimination of bipeds from quadrupeds using seismic footstep signatures. In Proceedings of IEEE International Geoscience and Remote Sensing Symposium. IEEE, Munich, Germany, 6920–6923.Google ScholarCross Ref
[75] Mirshekari Mostafa, Fagert Jonathon, Pan Shijia, Zhang Pei, and Noh Hae Young. 2020. Step-level occupant detection across different structures through footstep-induced floor vibration using model transfer. J. Eng. Mech. 146, 3 (Mar.2020), 04019137.Google ScholarCross Ref
[76] Mirshekari Mostafa, Fagert Jonathon, Pan Shijia, Zhang Pei, and Noh Hae Young. 2021. Obstruction-invariant occupant localization using footstep-induced structural vibrations. Mech. Syst. Signal Process. 153 (May2021), 107499.Google ScholarCross Ref
[77] Mirshekari Mostafa, Pan Shijia, Bannis Adeola, Lam Yan Pui Mike, Zhang Pei, and Noh Hae Young. 2015. Step-level person localization through sparse sensing of structural vibration. In Proceedings of the 14th International Conference on Information Processing in Sensor Networks. ACM, Seattle, Washington, USA, 376–377.Google ScholarDigital Library
[78] Mirshekari Mostafa, Pan Shijia, Fagert Jonathon, Schooler Eve M., Zhang Pei, and Noh Hae Young. 2018. Occupant localization using footstep-induced structural vibration. Mech. Syst. Signal Process. 112 (Nov.2018), 77–97.Google ScholarCross Ref
[79] Mirshekari Mostafa, Pan Shijia, Zhang Pei, and Noh Hae Young. 2016. Characterizing wave propagation to improve indoor step-level person localization using floor vibration. In Proceedings of Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems, Vol. 9803. SPIE, Las Vegas, Nevada, USA, 980305.Google Scholar
[80] Mirshekari Mostafa, Zhang Pei, and Noh Hae Young. 2016. Non-intrusive occupant localization using floor vibrations in dispersive structure. In Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM (SenSys’16). ACM, Stanford, CA, USA, 378–379.Google ScholarDigital Library
[81] Mukhopadhyay Bodhibrata, Anchal Sahil, and Kar Subrat. 2017. Detection of an intruder and prediction of his state of motion by using seismic sensor. IEEE Sens. J. 18, 2 (Jan.2017), 703–712.Google ScholarCross Ref
[82] Mukhopadhyay Bodhibrata, Anchal Sahil, and Kar Subrat. 2018. Person identification using seismic signals generated from footfalls. arXiv (Sep.2018), arXiv–1809.Google Scholar
[83] Narayanaswami Ranga, Gandhe Avinash, Tyurina Anastasia, and Mehra Raman K.. 2010. Sensor fusion and feature-based human/animal classification for unattended ground sensors. In Proceedings of IEEE International Conference on Technologies for Homeland Security (HST’10). IEEE, Waltham, MA, USA, 344–350.Google ScholarCross Ref
[84] Nelder John A. and Mead Roger. 1965. A simplex method for function minimization. Comput. J. 7, 4 (Jan.1965), 308–313.Google ScholarCross Ref
[85] Olson J. S. and Redkar S.. 2018. A survey of wearable sensor networks in health and entertainment. MOJ Appl. Bionics Biomech. 2, 5 (Sept.2018), 280–287.Google ScholarCross Ref
[86] Pan Shijia, Berges Mario, Rodakowski Juleen, Zhang Pei, and Noh Hae Young. 2019. Fine-grained recognition of activities of daily living through structural vibration and electrical sensing. In Proceedings of the 6th International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation. ACM, New York, USA, 149–158.Google ScholarDigital Library
[87] Pan Shijia, Bonde Amelie, Jing Jie, Zhang Lin, Zhang Pei, and Noh Hae Young. 2014. BOES: Building occupancy estimation system using sparse ambient vibration monitoring. In Proceedings of Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems, Vol. 9061. SPIE, San Diego, California, USA, 406–421.Google Scholar
[88] Pan Shijia, Lyons Kent, Mirshekari Mostafa, Noh Hae Young, and Zhang Pei. 2016. Multiple pedestrian tracking through ambient structural vibration sensing. In Proceedings of 14th ACM Conference on Embedded Network Sensor Systems CD-ROM (SenSy’16). ACM, Stanford, CA, USA, 366–367.Google ScholarDigital Library
[89] Pan Shijia, Wang Ningning, Qian Yuqiu, Velibeyoglu Irem, Noh Hae Young, and Zhang Pei. 2015. Indoor person identification through footstep induced structural vibration. In Proceedings of 16th International Workshop on Mobile Computing Systems and Applications (HotMobile). ACM, Santa Fe, New Mexico, USA, 81–86.Google ScholarDigital Library
[90] Pan Shijia, Yu Tong, Mirshekari Mostafa, Fagert Jonathon, Bonde Amelie, Mengshoel Ole J., Noh Hae Young, and Zhang Pei. 2017. FootprintID: Indoor pedestrian identification through ambient structural vibration sensing. Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (Sept.2017), 1–31.Google ScholarDigital Library
[91] Park Hyung O., Dibazar Alireza A., and Berger Theodore W.. 2008. Protecting military perimeters from approaching human and vehicle using biologically realistic dynamic synapse neural network. In Proceedings of IEEE Conference on Technologies for Homeland Security. IEEE, Waltham, MA, USA, 73–78.Google ScholarCross Ref
[92] Park Hyung O., Dibazar Alireza A., and Berger Theodore W.. 2009. Cadence analysis of temporal gait patterns for seismic discrimination between human and quadruped footsteps. In Proceedings of International Conference on Acoustics, Speech and Signal Processing. IEEE, Taipei, Taiwan, 1749–1752.Google ScholarDigital Library
[93] Peck Lindamae and Lacombe James. 2007. Seismic-based personnel detection. In Proceedings of 41st Annual IEEE International Carnahan Conference on Security Technology. IEEE, Ottawa, ON, Canada, 169–175.Google ScholarCross Ref
[94] Peng Chao-Ying Joanne, Lee Kuk Lida, and Ingersoll Gary M.. 2002. An introduction to logistic regression analysis and reporting. J. Educ. Res. 96, 1 (Apr.2002), 3–14.Google ScholarCross Ref
[95] Platt John et al. 1999. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in Large Margin Classifiers 10, 3 (Mar.1999), 61–74.Google Scholar
[96] Porto Vincent W., Fogel Lawrence J., and Fogel David B.. 2004. Using evolutionary computation for seismic signal detection: A homeland security application. In Proceedings of International Conference on Computational Intelligence for Homeland Security and Personal Safety (CIHSPS’04). IEEE, Venice, Italy, 62–66.Google ScholarCross Ref
[97] Poston Jeffrey D., Buehrer R. Michael, Woolard Americo G., and Tarazaga Pablo A.. 2016. Indoor positioning from vibration localization in smart buildings. In Proceedings of IEEE/ION Position, Location and Navigation Symposium (PLANS’16). IEEE, Savannah, GA, USA, 366–372.Google ScholarCross Ref
[98] Poston Jeffrey D., Schloemann Javier, Buehrer R. Michael, Malladi V. V. N. Sriram, Woolard Americo G., and Tarazaga Pablo A.. 2015. Towards indoor localization of pedestrians via smart building vibration sensing. In Proceedings of International Conference on Location and GNSS (ICL-GNSS’15). IEEE, Gothenburg, Sweden, 1–6.Google ScholarCross Ref
[99] Priyadarshini Rashmi and Mehra R. M.. 2015. Quantitative review of occupancy detection technologies. Int. J. Radio Freq. 1, 1 (Jan.2015), 1–19.Google Scholar
[100] Pucci Lorenzo, Testi Enrico, Favarelli Elia, and Giorgetti Andrea. 2020. Human activities classification using biaxial seismic sensors. IEEE Sens. Lett. 4, 10 (Oct.2020), 1–4.Google ScholarCross Ref
[101] Putri Arisa Olivia, Ali M. A., Saad Mohammad, and Hidayat Sidiq Samsul. 2018. Wearable sensor and Internet of Things technology for better medical science: A review. Int. J. Eng. Technol. 7, 4.11 (2018), 1–4.Google ScholarCross Ref
[102] Reynolds Douglas A.. 2015. Gaussian mixture models. Encyclopedia of Biometrics 741 (July2015), 827–832.Google ScholarCross Ref
[103] Sakpere Wilson, Adeyeye-Oshin Michael, and Mlitwa Nhlanhla B. W.. 2017. A state-of-the-art survey of indoor positioning and navigation systems and technologies. S. Afr. Comput. J. 29, 3 (Dec.2017), 145–197.Google Scholar
[104] Sarkar Soumalya, Damarla Thyagaraju, and Ray Asok. 2015. Real-time activity recognition from seismic signature via multi-scale symbolic time series analysis (MSTSA). In Proceedings of American Control Conference (ACC’15). IEEE, Chicago, IL, USA, 5818–5823.Google ScholarCross Ref
[105] Seifeldin Moustafa, Saeed Ahmed, Kosba Ahmed E., El-Keyi Amr, and Youssef Moustafa. 2012. Nuzzer: A large-scale device-free passive localization system for wireless environments. IEEE Trans. Mob. Comput. 12, 7 (July2012), 1321–1334.Google ScholarDigital Library
[106] Shi Laixi, Mirshekari Mostafa, Fagert Jonathon, Chi Yuejie, Noh Hae Young, Zhang Pei, and Pan Shijia. 2019. Device-free multiple people localization through floor vibration. In Proceedings of 1st ACM International Workshop on Device-Free Human Sensing. IEEE, New York, USA, 57–61.Google ScholarDigital Library
[107] Shoji Yasuhiro, Itai Akitoshi, and Yasukawa Hiroshi. 2005. Personal identification using footstep detection in indoor environment. IEICE T. Fund. Electr. 88, 8 (Aug.2005), 2072–2077.Google ScholarDigital Library
[108] Shoji Yasuhiro, Takasuka Takashi, and Yasukawa Hiroshi. 2004. Personal identification using footstep detection. In Proceedings of International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS’04). IEEE, Seoul, South Korea, 43–47.Google ScholarCross Ref
[109] Sparkfun. 2006. Geophone SM-24 1-Axis, with Insulating Disc, A Sensor used in Seismic Exploration. https://www.sparkfun.com/products/11744.Accessed: 2022-06-30.Google Scholar
[110] Stanney Kay M., Mourant Ronald R., and Kennedy Robert S.. 1998. Human factors issues in virtual environments: A review of the literature. Presence 7, 4 (Aug.1998), 327–351.Google ScholarDigital Library
[111] Stąpor Katarzyna. 2017. Evaluating and comparing classifiers: Review, some recommendations and limitations. In Proceedings of 10th International Conference on Computer Recognition Systems (CORES’17). Springer, Polanica Zdroj, Poland, 12–21.Google Scholar
[112] Succi George P., Clapp Daniel, Gampert Robert, and Prado Gervasio. 2001. Footstep detection and tracking. In Proceedings of Unattended Ground Sensor Technologies and Applications III, Vol. 4393. SPIE, Orlando, FL, USA, 22–29.Google ScholarCross Ref
[113] Succi George P., Prado Gervasio, Gampert Robert, Pedersen Torstein K., and Dhaliwal Hardave. 2000. Problems in seismic detection and tracking. In Proceedings of Unattended Ground Sensor Technologies and Applications II, Vol. 4040. SPIE, Orlando, FL, USA, 165–173.Google ScholarCross Ref
[114] Sundaresan Ashok, Subramanian Arun, Varshney Pramod K., and Damarla Thyagaraju. 2010. A copula-based semi-parametric approach for footstep detection using seismic sensor networks. In Proceedings of Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications, Vol. 7710. SPIE, Orlando, FL, USA, 103–114.Google ScholarCross Ref
[115] Tian Yuxin, Qi Hairong, and Wang Xiaoling. 2002. Target detection and classification using seismic signal processing in unattended ground sensor systems. In Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP’02), Vol. 4. IEEE, Orlando, FL, USA, 4172–4172.Google ScholarCross Ref
[116] Upton Eben and Halfacree Gareth. 2014. Raspberry Pi User Guide. https://www.raspberrypi.org/.Accessed: 2022-06-30.Google Scholar
[117] Virani Nurali, Marcks Shane, Sarkar Soumalya, Mukherjee Kushal, Ray Asok, and Phoha Shashi. 2013. Dynamic data driven sensor array fusion for target detection and classification. Procedia Comput. Sci. 18 (Jan.2013), 2046–2055.Google ScholarCross Ref
[118] Wang Jie, Gao Qinhua, Pan Miao, and Fang Yuguang. 2018. Device-free wireless sensing: Challenges, opportunities, and applications. IEEE Network 32, 2 (April2018), 132–137.Google ScholarCross Ref
[119] Wang Meng, Min Li, Zhang Xiaolei, Zhang Faxiang, Sun Zhihui, Li Shujuan, Wang Chang, Zhao Zhong, and Hao Guanghu. 2017. Field test investigation of high sensitivity fiber optic seismic geophone. Fiber Optic Sensing and Optical Communications 10464 (Oct.2017), 353–358.Google Scholar
[120] Wang Yan, Cheng Xiaoliu, Zhou Peng, Li Baoqing, and Yuan Xiaobing. 2019. Convolutional neural network-based moving ground target classification using raw seismic waveforms as input. IEEE Sens. J. 19, 14 (July2019), 5751–5759.Google ScholarCross Ref
[121] Xing Huaifei, Li Fang, Xiao Hao, Wang Yongjie, and Liu Yuliang. 2007. Ground target detection, classification, and sensor fusion in distributed fiber seismic sensor network. In Proceedings of Advanced Sensor Systems and Applications III, Vol. 6830. SPIE, Beijing, China, 208–217.Google Scholar
[122] Xu Tonghua, Wang Nan, and Xu Xin. 2019. Seismic target recognition based on parallel recurrent neural network for unattended ground sensor systems. IEEE Access 7 (Aug.2019), 137823–137834.Google ScholarCross Ref
[123] Youssef Moustafa, Mah Matthew, and Agrawala Ashok. 2007. Challenges: Device-free passive localization for wireless environments. In Proceedings of 13th Annual ACM International Conference on Mobile Computing and Networking (MobiCom/MobiHoc). Association for Computing Machinery, Montréal Québec, Canada, 222–229.Google ScholarDigital Library
[124] Zhang Dian, Liu Yunhuai, Guo Xiaonan, and Ni Lionel M.. 2012. RASS: A real-time, accurate, and scalable system for tracking transceiver-free objects. In Proceedings of International Conference on Pervasive Computing and Communications (PerCom’12), Vol. 24. IEEE, Seattle, WA, USA, 996–1008.Google Scholar
[125] Zhang Yue, Pan Shijia, Fagert Jonathon, Mirshekari Mostafa, Noh Hae Young, Zhang Pei, and Zhang Lin. 2018. Occupant activity level estimation using floor vibration. In Proceedings of International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp’18). ACM, Singapore, 1355–1363.Google ScholarDigital Library
[126] Zhao Yumin, Li Yunyue Elita, Nilot Enhedelihai, and Fang Gang. 2022. Urban running activity detected using a seismic sensor during COVID-19 pandemic. Seismological Research Letters 93, 1 (Sept.2022), 181–192.Google ScholarCross Ref
[127] Zhou Qianwei, Tong Guanjun, Xie Dongfeng, Li Baoqing, and Yuan Xiaobing. 2012. A seismic-based feature extraction algorithm for robust ground target classification. IEEE Signal Process. Lett. 19, 10 (Oct.2012), 639–642.Google ScholarCross Ref
[128] Zhu Chun and Sheng Weihua. 2011. Wearable sensor-based hand gesture and daily activity recognition for robot-assisted living. IEEE Trans. Syst. Man Cybern.: Syst. 41, 3 (Jan. 2011), 569–573.Google ScholarDigital Library
[129] Zubair Mussab and Hartmann Klaus. 2011. Target classification based on sensor fusion in multi-channel seismic network. In Proceedings of International Symposium on Signal Processing and Information Technology (ISSPIT’11). IEEE, Bilbao, Spain, 438–443.Google ScholarDigital Library
[130] Zubair Mussab, Hartmann Klaus, and Loffeld Otmar. 2012. Design and implementation of a wireless geophone sensor node for target detection and classification. In Automatic Target Recognition XXII, Vol. 8391. SPIE, Baltimore, MD, USA, 237–243.Google Scholar

Index Terms

A Survey on Seismic Sensor based Target Detection, Localization, Identification, and Activity Recognition
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

Multiple feature points representation in target localization of wireless visual sensor networks

This paper discusses the target localization problem in wireless visual sensor networks. Additive noises and measurement errors will affect the accuracy of target localization when the visual nodes are equipped with low-resolution cameras. In the goal ...
Read More
Distributed cooperative target detection and localization in decentralized wireless sensor networks

In many network applications such as surveillance systems, it is crucial to detect the target and estimate its location. Distributed processing algorithms are capable of providing fast, secure, scalable and robust solutions. In this paper, we study the ...
Read More
Optimal path shape for range-only underwater target localization using a Wave Glider

Underwater localization using acoustic signals is one of the main components in a navigation system for an autonomous underwater vehicle (AUV) as a more accurate alternative to dead-reckoning techniques. Although different methods based on the idea of ...
Read More

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Published in
ACM Computing Surveys Volume 55, Issue 11
November 2023
849 pages
ISSN:0360-0300
EISSN:1557-7341
DOI:10.1145/3572825
Editor:
Albert Zomaya
University of Sydney, Australia
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
- Published: 9 February 2023
- Online AM: 19 October 2022
- Accepted: 9 October 2022
- Revised: 4 September 2022
- Received: 5 June 2021
Published in csur Volume 55, Issue 11

Permissions
Request permissions about this article.
Request Permissions

Check for updates
Author Tags
Seismic sensor
device-free sensing
target detection
target localization
target identification
activity recognition
Qualifiers
- survey
- Refereed
Conference
Funding Sources
Other Metrics
View Article Metrics

Article Metrics
- 0
  Total Citations
  View Citations
- 780
  Total Downloads
- Downloads (Last 12 months)488
- Downloads (Last 6 weeks)40
Other Metrics
View Author Metrics
Cited By
This publication has not been cited yet

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

View Full Text

HTML Format

View this article in HTML Format .

View HTML Format

A Survey on Seismic Sensor based Target Detection, Localization, Identification, and Activity Recognition

ACM Computing Surveys

Abstract

REFERENCES

Cited By

Index Terms

Recommendations

Multiple feature points representation in target localization of wireless visual sensor networks

Distributed cooperative target detection and localization in decentralized wireless sensor networks

Optimal path shape for range-only underwater target localization using a Wave Glider