Skip to main content
Log in

Scalable real-time sound source localization method based on TDOA

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Sound source localization remains a critical task for increasing sufficiently the location accuracy and typically decreasing the computational complexity of a real-time passive or active target tracking by multiple-microphone in topology-based concurrent sensor arrays for far- or near-filed domains. This paper properly presents a passive real-time localization method scientifically based on the time difference of arrival signal in reliably estimating the arrival angles for meaningfully improving the location accuracy and typically decreasing the prediction time of a stationary source in a three-dimensional (3D) model for an outdoor environment in free-field conditions. The proposed scalable distributed method significantly increases the localization accuracy by integrating local direction-finding information of two concurrent parallel microphone arrays and naturally deriving a specific piece of global location-finding information to sufficiently reduce the predictions’ run-time. The designing approach accurately represents a two-step process to properly implement a suitable decomposition method and gently apply an interpolation technique in the near-filed ideal domain. The primary goal of our innovative design realistically is to seemingly indicate the key role of hardware architecture and popularly use suitable techniques in complexity reduction and accuracy improvement of the intelligent model for future scalable localization systems to progressively increase outstanding performance. The empirical experiments using different real and simulated datasets show the modern TDOA-SSL method ordinarily has a low-time 360 msec in 3D accurately estimating the prime location with an average error of 12.07 cm in the near-field and 296 cm in the far-field. In key addition, the proposed method invariably is robust to ambient noise and sound reflection in the near- and far-field. However, the average accuracy of the proposed system efficiently is 99.43% with an error factor of 0.19% for the near-field and 99.70% with an error factor of 0.016% for the far-field for the used range of 100 m and 1 km, respectively. Performance evaluation of the proposed method sufficiently shows the real-time prediction and the reasonable accuracy of the specific prediction positively enhances by carefully applying the geometric architectural specification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Data Availability

The datasets that traditionally support the empirical findings of this research study are not publicly available due to the special sampling and considerable complexity of the saving data structure but in the specific form of accurate bare data are available from the corresponding author on a reasonable request.

References

  1. Abiri A, Pourmohammad A (2020) The bullet shockwave-based real-time sniper sound source localization. IEEE Sensors J 20(13):7253–7264

    Article  Google Scholar 

  2. Awarkeh N (2019) 2D Indoor localization system with an UWB multistatic radar. Doctoral dissertation, Université Paris-Saclay (ComUE), English, Available: https://hal.univlorraine.fr/RFM2/tel-02505477v1

  3. Bai Y et al (2020) Acoustic-based sensing and applications: A survey. Comput Netw 181:107447

    Article  Google Scholar 

  4. Chan YT, Ho KC (1994) A simple and efficient estimator for hyperbolic location. IEEE Trans Signal Process 42(8):1905–1915

    Article  Google Scholar 

  5. Chen JY et al (2018) Improved two-step weighted least squares algorithm for TDOA-based source localization. In: 19th international radar symposium (IRS) IEEE, pp 1–5

  6. Cui X et al (2018) Approximate closed-form TDOA-based estimator for acoustic direction finding via constrained optimization. IEEE Sensors J 18(8):3360–3371

    Article  Google Scholar 

  7. Dang X. et al (2022) TDOA-based robust sound source localization with sparse regularization in wireless acoustic sensor networks. IEEE/ACM Transactions on Audio, Speech, and Language Processing 30:1108–1123

    Article  Google Scholar 

  8. DiBiase JH (2000) A high-accuracy, low-latency technique for talker localization in reverberant environments using micro-phone arrays. PhD. Thesis, Brown University, Providence, RI, USA

    Google Scholar 

  9. Dogancay K, Ibal G (2005) 3D passive bearings-only emitter localization using crude angle-of-arrival measurements, Proceedings of SimTecT 2005, Melbourne, Australia

  10. Fenwick AJ (1999) Algorithms for position fixing using pulse arrival times. IEE Proceedings-Radar, Sonar and Navigation 146(4):208–212

    Article  Google Scholar 

  11. Foy WH (1976) Position-location solutions by Taylor-series estimation. IEEE Trans Aerosp Electron Syst 2:187–194

    Article  Google Scholar 

  12. German F et al (2020) Design and implementation of acoustic source localization on a low-cost IoT edge platform. IEEE Transactions on Circuits and Systems II: Express Briefs 67(12):3547–3551

    Google Scholar 

  13. Grondin F, Michaud F (2019) Lightweight and optimized sound source localization and tracking methods for open and closed microphone array configurations. Robot Auton Syst 113:63–80

    Article  Google Scholar 

  14. Heydari Z et al (2020) Smart speaker localization by using time difference of arrival approach. In: 6th international acoustic conference Iran, Persian

  15. Heydari Z et al (2021) The effect of energy and interpolation combination on the accuracy of indoor localization based on the speech signal time difference of the arrival. Journal of Acoustical Engineering Society (JCSIT) of Iran 8(2):13–21

    Google Scholar 

  16. Heydari Z et al (2021) Broadband sound source localization methods based on TDOA - A survey. Journal of Computer Science and Information Technology (JCSIT) 19(1):1–14

    MathSciNet  Google Scholar 

  17. Invernizzi D et al (2020) Comparison of control methods for trajectory tracking in fully actuated unmanned aerial vehicles. IEEE Trans Control Syst Technol 29(3):1147–1160

    Article  Google Scholar 

  18. Jin B et al (2018) Robust time-difference-of-arrival (TDOA) localization using weighted least squares with cone tangent plane constraint. Sensors 18 18 (3):778

    Article  Google Scholar 

  19. Kraljević L et al (2020) Free-field TDOA-AOA sound source localization using three soundfield microphones. IEEE Access 8:87749–87761

    Article  Google Scholar 

  20. Liang Z, Yi W (2022) Application of Taylor-Chan algorithm based on TDOA in sound source location. In: 2th international conference on mechanical engineering, intelligent manufacturing and automation technology, pp 1–4

  21. Liaquat MU et al (2021) Localization of sound sources: a systematic review. Energies 14(13):3910

    Article  Google Scholar 

  22. Luo H et al (2022) Recent progress of air/water cross-boundary communications for underwater sensor networks: a review. IEEE Sensors J 22(9):8360–8382

    Article  Google Scholar 

  23. Mahabadi A, Besmi MR (2021) Risk-aware service level agreement modeling in smart grid. Multimed Tools Appl 80(1):1433–1456

    Article  Google Scholar 

  24. Mirbeygi M et al (2021) And RPCA-based real-time speech and music separation method. Speech Comm 126:22–34

    Article  Google Scholar 

  25. Pierce AD (1989) Acoustics: an introduction to its physical principles and applications, acoustical society of America and American Institute of Physics Publisher, ISBN 978-0883186121

  26. Polvara R, et al. (2021) Navigate-and-Seek: a robotics framework for people localization in agricultural environments. IEEE Robot Autom Lett 6 (4):6577–6584

    Article  Google Scholar 

  27. Popper AN et al (2005) Sound source localization, vol 25. Springer, New York

    Book  Google Scholar 

  28. Rascon C, Meza I (2017) Localization of sound sources in robotics: a review. Robot Auton Syst 96:184–210

    Article  Google Scholar 

  29. Rumsey F, McCormick T (2014) Sound and recording: application and theory, Routledge, ISBN:978-0-240-52163-3

  30. Seidel A et al (2021) Scenario-based analysis of the carbon mitigation potential of 6G-enabled 3D video conferencing in 2030. Telematics Inform 23:101686

    Article  Google Scholar 

  31. Shi Z et al (2020) An acoustic-based surveillance system for amateur drones detection and localization. IEEE Trans Veh Technol 69(3):2731–2739

    Article  Google Scholar 

  32. Smith J, Abel J (1987) Closed-form least-squares source location estimation from range-difference measurements. IEEE Trans Acoust Speech Signal Process 35(12):1661–1669

    Article  Google Scholar 

  33. So HC et al (2008) And closed-form formulae for time-difference-of-arrival estimation. IEEE Trans Signal Process 56(6):2614–2620

    Article  MathSciNet  MATH  Google Scholar 

  34. Su D et al (2021) And necessary and sufficient conditions for observability of SLAM-based TDOA sensor array calibration and source localization. IEEE Trans Robot 37(5):1451–1468

    Article  Google Scholar 

  35. Sudo Y., et al. (2021) And multi-channel environmental sound segmentation utilizing sound source localization and separation U-Net. In: IEEE/SICE international symposium on system integration (SII), pp 382–387

  36. Sun Y et al (2018) And solution and analysis of TDOA localization of a near or distant source in closed form. IEEE Trans Signal Process 67(2):320–335

    Article  MathSciNet  MATH  Google Scholar 

  37. Wu P et al (2019) Time difference of arrival (TDoa) localization combining weighted least squares and firefly algorithm. Sensors 19(11):2554

    Article  Google Scholar 

  38. Yang S et al (2019) Scalable digital neuromorphic architecture for large-scale biophysically meaningful neural network with multi-compartment neurons. IEEE Transactions on Neural Networks and Learning Systems 31(1):148–162

    Article  Google Scholar 

  39. Yasin I et al (2020) Optimizing speech recognition using a computational model of human hearing: effect of noise type and efferent time constants. IEEE Access 8:56711–56719

    Article  Google Scholar 

  40. Yassin A et al (2016) Recent advances in indoor localization: a survey on theoretical approaches and applications. IEEE Communications Surveys & Tutorials 19(2):1327–46

    Article  Google Scholar 

  41. Yin J et al (2016) A simple and accurate TDOA-AOA localization method using two stations. IEEE Signal Process Lett 23(1):144–148

    Article  MathSciNet  Google Scholar 

  42. Zou Y, Liu H (2020) A simple and efficient iterative method for TOA localization. In: IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 4881–4884

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aminollah Mahabadi.

Ethics declarations

Conflict of Interests

This Article has been written by the stated authors, is original and has not been previously published. They have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Heydari, Z., Mahabadi, A. Scalable real-time sound source localization method based on TDOA. Multimed Tools Appl 82, 23333–23372 (2023). https://doi.org/10.1007/s11042-022-14256-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-14256-2

Keywords

Navigation