Skip to main content
SpringerLink
Log in

Detection and Tracking of Multiple Metallic Objects in Millimetre-Wave Images

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

In this paper we present a system for the automatic detection and tracking of metallic objects concealed on moving people in sequences of millimetre-wave (MMW) images. The millimetre-wave sensor employed has been demonstrated for use in covert detection because of its ability to see through clothing, plastics and fabrics.

The system employs two distinct stages: detection and tracking. In this paper a single detector, for metallic objects, is presented which utilises a statistical model also developed in this paper. The second stage tracks the target locations of the objects using a Probability Hypothesis Density filter. The advantage of this filter is that it has the ability to track a variable number of targets, estimating both the number of targets and their locations. This avoids the need for data association techniques as the identities of the individual targets are not required. Results are presented for both simulations and real millimetre-wave image test sequences demonstrating the benefits of our system for the automatic detection and tracking of metallic objects.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Arulampalam, M.S., Maskell, S., Gordon, N., and Clapp, T. 2001. A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking. IEEE Transactions on Signal Processing, 50:174–188.

    Article  Google Scholar 

  • Bar-Shalom, Y., and Fortmann, T.E. 1998. Tracking and Data Association. Academic Press.

  • Choi, K.N., Carcassoni, M., and Hancock, E.R. 2002. Recovering facial pose with the EM algorithm. Pattern Recognition, 35: 2073–2093.

    Article  MATH  Google Scholar 

  • Clark, D.E., and Bell, J. 2005. Data Association for the PHD Filter. Accepted to appear in ISSNIP 2005, 5-8 December, Melbourne.

  • Clark, D., and Bell, J. 2005. Bayesian Multiple Target Tracking in Forward Scan Sonar Images Using the PHD Filter. IEE Radar, Sonar and Navigation, 152:327–334.

    Article  Google Scholar 

  • Clark, D.E., Bell, J., de S.-Pern, Y., and Petillot, Y. 2005. Phd Filter Multi-target Tracking in 3D Sonar. In Oceans Europe Conference, (Brest), IEEE.

  • Clark, D.E., and Bell, J., Convergence Results for the Particle PHD Filter. Accepted to appear in IEEE Transactions on Signal Processing.

  • Comaniciu, D. and Meer, P. 2002. Mean shift: A robust approach toward feature space analysis. IEEE Transaction on Pattern Analysis and Machine Intelligence, 24:603–619.

    Article  Google Scholar 

  • Comaniciu, D., Ramesh, V., and Meer, P. 2003. Kernel-based object tracking. IEEE Transaction on Pattern Analysis and Machine Intelligence, 25:564–577.

    Article  Google Scholar 

  • Coward, P. and Appleby, R. 2003. Development of an illumination chamber for indoor millimetre-wave imaging. In Passive Millimeter-wave Imaging Technology VI and Radar Sensor Technology VII, R. Appleby, D.A. Wikner, R. Trebits, and J.L. Kurtz, eds., vol. 5077, of Proceedings of SPIE, SPIE, pp. 54–61.

  • Hall, D., and Llinas, J. eds. 2001. Handbook of Multisensor Data Fusion, Ch. of 7. CRC Press.

  • Haworth, C.D., González, B.G., Tomsin, M., Appleby, R., Coward, P., Harvey, A., Lebart, K., Petillot, Y., and Trucco, E. 2004. Image analysis for object detection in millimetre-wave images. In Passive Millimetre-wave and Terahertz Imaging and Technology R. Appleby, J. M. Chamberlain, and K. A. Krapels, eds., SPIE, vol. 5619, pp. 117–129.

  • Hue, C., Cadre, J.-P.L., and Perez, IP. 2002. Tracking multiple objects with particle filtering. In IEEE Transactions on Aerospace and Electronic Systems, IEEE, vol. 38, pp. 791–812.

  • Johansen, A.M., Singh, S.S., Doucet, A., and Vo, B.-N. 2005. Convergence of the SMC implementation of the PHD filter. Technical Report CUED/F-INFENG/TR-517, University of Cambridge.

  • Karlsson, R., and Gustafsson, F. 2001. Monte Carlo data association for multiple target tracking. Target Tracking: Algorithms and Applications (Ref. No. 2001/174), IEE, 1:13/1–13/5.

    Google Scholar 

  • Keller, P., McMakin, D.L., McMakin, D.M., McKinnon, A.D., and Summet, J.W. 2000. Privacy algorithm for cylindrical holographic weapons surveillance system. Aerospace and Electronic Systems Magazine, 15:17–24.

    Article  Google Scholar 

  • Lin, L. 2004. Parameter estimation and data association for multitarget tracking. PhD Thesis, The University of Connecticut.

  • Mahler, R.P.S. 2003. Multitarget Bayes filtering via first-order multitarget moments. IEEE Transaction on Aerospace and Electronic Systems, 39:1152–1178.

    Article  Google Scholar 

  • Murphy, K.S.J., Appleby, R., Sinclair, G., McClum-pha, A., Tatlock, K., Doney, R., and Hutcheson, I. 2002. Millimeter wave aviation security scanner. In Proceedings of the 36th International Carnahan Conference on Security Technology, London, UK, IEEE, pp. 162–166.

  • Panta, K., Vo, B., Singh, S., and Doucet, A. 2004. Probability hypothesis density filter versus multiple hypothesis tracking. In Signal Processing, Sensor Fusion, and Target Recognition XIII I. Kadara, ed., SPIE, vol. 5429, pp. 284–295.

  • Rabiner, L.R. 1989. A tutorial on Hidden Markov Models and selected applications in speech recognition. In Proceedings of the IEEE, vol. 77, pp. 257–285.

    Article  Google Scholar 

  • Schulz, D., Burgard, W., Fox, D., and Cremers, A.B. 2003. People tracking with a mobile robot using sample-based Joint Probabilistic Data Association Filters. International Journal of Robotics Research, 99–116.

  • Sinclair, G.N., Anderton R.N., and Appleby, R. 2001. Outdoor passive millimetre wave security screening. In Proceedings of the 35th International Carnahan Conference on Security Technology, London, UK, IEEE, pp. 172–179.

  • Sidenbladh, H. 2003. Multi-target particle filtering for the probability hypothesis density. In Sixth International Conference on Information Fusion, Cairns, Australia, pp. 800–806.

  • Sinclair, G.N., Coward, P.R., Anderton, R.N., Appleby, R., Seys, T., and Southwood, P. 2002. Detection of illegal passengers in lorries using passive millimeter wave scanner. In Proceedings of the 36th International Carnahan Conference on Security Technology, London, UK, IEEE, pp.167–170.

  • Slamani, M.A., Vershney, P.K., Rao, R.M., Alford, M.G., and Ferris, D. 1999. Image processing tools for the enhancement of concealed weapon detection. In Proceedings of the International Conference on Image Processing, Kobe, Japan, IEEE, Vol. 3, pp. 518–522.

    Google Scholar 

  • Slamani, M.A. and Ferris Jr., D.D. 2001. Shape-descriptor-based detection of concealed weapons in millimeter-wave data. In Optical Pattern Recognition XII, D. P. Casasent and T.-H. Chao, eds., vol. 4387, of Proceedings of SPIE, SPIE, pp. 176–185.

  • Slamani, M.A., Varshney, P.K., and Ferris Jr., D.D. 2002. Survey of image processing techniques applied to the enhancement and detection of weapons in mmw data. In Passive Millimeter-Wave Imaging Technology VI, SPIE, vol. 4719B, pp. 296–305.

    Google Scholar 

  • Tobias M., and Lanterman, A.D. 2004. A Probability Hypothesis Density-based multitarget tracker using multiple bistatic range and velocity measurements. In Proceedings of the Thirty-Sixth Southeastern Symposium on System Theory, pp. 205–209.

  • Tommasini, T., Fusiello, A., Trucco, E., and Roberto, V. 1998. Making good features track better. In Proceedings of the International Conference on Computer Vision and Pattern Recognition, IEEE, pp. 178–183.

  • Trucco, E., and Plakas, K. 2005. Video tracking: a concise survey. IEEE Journal of Oceanic Engineering, 30:p. (to appear).

  • Varshney, P.K., Chen, H.-M., Ramac, L.C., Uner, M., Ferris, D., and Alford, M. 1999. Registration and fusion of infrared and millimeter wave images for concealed weapon detection. In Proceedings of the International Conference on Image Processing, Kobe, Japan, IEEE, vol. 3, pp. 532–536.

    Google Scholar 

  • Vo, B., Singh, S., and Doucet, A. 2003.Sequential Monte Carlo Implementation of the PHD filter for Multi-target Tracking. In Proc. FUSION 2003, pp. 792–799.

  • Xue, Z. and Blum, R.S. 2003. Concealed weapon detection using color image fusion. In Proceedings of the 6th International Conference on Information Fusion, Queensland, Australia, IEEE, vol. 1, pp. 622–627.

  • Zajic, T., and Mahler, R. 2003. A particle-systems implementation of the PHD multitarget tracking filter. SPIE Vol. 5096 Signal Processing, Sensor Fusion and Target Recognition, pp. 291–299.

Download references

Author information

Authors and Affiliations

  1. Heriot-Watt University, Edinburgh, EH14 4AS, United Kingdom

    C. D. Haworth, Y. De Saint-Pern, D. Clark, E. Trucco & Y. R. Petillot

Authors
  1. C. D. Haworth
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Y. De Saint-Pern
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. D. Clark
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. E. Trucco
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Y. R. Petillot
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Haworth, C.D., De Saint-Pern, Y., Clark, D. et al. Detection and Tracking of Multiple Metallic Objects in Millimetre-Wave Images. Int J Comput Vision 71, 183–196 (2007). https://doi.org/10.1007/s11263-006-6275-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-006-6275-8

Keywords

Search

Navigation