Skip to main content
SpringerLink
Log in

Enhanced low-complexity pruning for corner detection

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Low-complexity corner detection is essential for many real-time computer vision applications that need to be executed on low-cost/low-power embedded platforms such as robots. The widely used Shi–Tomasi and Harris corner detectors become prohibitive in such platforms due to their high computational complexity, which is attributed to the need to apply a complex corner measure on the entire image. In this paper, we introduce a novel and computationally efficient technique to accelerate the Shi–Tomasi and Harris corner detectors. The proposed technique consists of two steps. In the first step, the complex corner measure is replaced with simple approximations to quickly prune away non-corners. In the second step, the complex corner measure is applied to a small corner candidate set obtained after pruning. Evaluations using standard image benchmarks show that the proposed pruning technique achieves up to 75 % speedup on the Nios-II platform, while yielding corners with comparable or better accuracy than the conventional Shi–Tomasi and Harris detectors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Mirota, D.J., Ishii, M., Hager, G.D.: Vision-based navigation in image-guided interventions. Annu. Rev. Biomed. Eng. 13, 297–319 (2011)

    Article  Google Scholar 

  2. Ehsan, S., McDonald-Maier, K.D.:On-board vision processing for small UAVs: time to rethink strategy. In: Presented at the Proceedings of the 2009 NASA/ESA Conference on Adaptive Hardware and Systems (2009)

  3. Schmidt, A., Kraft, M., Kasiński, A.: An evaluation of image feature detectors and descriptors for robot navigation. Comput. Vis. Graph. 6375, 251–259 (2010)

    Article  Google Scholar 

  4. Bhaskaranand, M., Gibson, J.D.: Low-complexity video encoding for UAV reconnaissance and surveillance. In: Military Communications Conference, 2011—MILCOM 2011, pp. 1633–1638 (2011)

  5. Gauglitz, S., Höllerer, T., Turk, M.: Evaluation of interest point detectors and feature descriptors for visual tracking. Int. J. Comput. Vis. 94, 335–360 (2011)

    Article  MATH  Google Scholar 

  6. Gil, A., Mozos, O., Ballesta, M., Reinoso, O.: A comparative evaluation of interest point detectors and local descriptors for visual SLAM. Mach. Vis. Appl. 21, 905–920 (2010)

    Article  Google Scholar 

  7. Tuytelaars, T., Mikolajczyk, K.: Local invariant feature detectors: a survey. Found. Trends. Comput. Graph. Vis. 3, 177–280 (2008)

    Article  Google Scholar 

  8. Schmid, C., Mohr, R., Bauckhage, C.: Evaluation of interest point detectors. Int. J. Comput. Vis. 37, 151–172 (2000)

    Article  MATH  Google Scholar 

  9. Jianbo, S., Tomasi, C.: Good features to track. In: Computer Vision and Pattern Recognition, 1994. Proceedings CVPR ‘94, 1994 IEEE Computer Society Conference on, 1994, pp. 593–600 (1994)

  10. Harris, C., Stephens, M.: A combined corner and edge detector. In: Proceedings of The Fourth Alvey Vision Conference, 1988, pp. 147–151 (1988)

  11. Aanæs, H., Dahl, A., Steenstrup Pedersen, K.: Interesting interest points. Int. J. Comput. Vis. 97, 18–35 (2012)

    Article  Google Scholar 

  12. Wu M., Ramakrishnan, N., Lam, S.-K., Srikanthan, T.: Low-complexity pruning for accelerating corner detection. In: Circuits and Systems (ISCAS), 2012 IEEE International Symposium on, 2012, pp. 1684–1687 (2012)

  13. Wang, H., Brady, M.: Real-time corner detection algorithm for motion estimation. Image Vis. Comput. 13, 695–703 (1995)

    Article  Google Scholar 

  14. Smith, S.M., Brady, J.M.: SUSAN—a new approach to low level image processing. Int. J. Comput. Vision 23, 45–78 (1997)

    Article  Google Scholar 

  15. Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Presented at the Proceedings of the 9th European conference on Computer Vision, Volume Part I, Graz, Austria (2006)

  16. Claus, C., Huitl, R., Rausch, J., Stechele, W.: Optimizing the SUSAN corner detection algorithm for a high speed FPGA implementation. In: Field Programmable Logic and Applications, 2009. FPL 2009. International Conference on, 2009, pp. 138–145 (2009)

  17. Chih-Chi, C., Chia-Hua, L., Chung-Te, L., Chang, S.C., Liang-Gee, C.: iVisual: an intelligent visual sensor SoC with 2790fps CMOS image sensor and 205GOPS/W vision processor. In: Design Automation Conference, 2008. DAC 2008. 45th ACM/IEEE, 2008, pp. 90–95 (2008)

  18. Dietrich, B.: Design and implementation of an FPGA-based stereo vision system for the EyeBot M6. University of Western Australia (2009)

  19. Saidani, T., Lacassagne, L., Bouaziz, S., Khan, T.: Parallelization strategies for the points of interests algorithm on the cell processor. In: Stojmenovic, I., Thulasiram, R., Yang, L., Jia, W., Guo, M., Mello, R. (eds.) Parallel and distributed processing and applications, vol. 4742, pp. 104–112. Springer, Berlin (2007)

    Chapter  Google Scholar 

  20. Hosseini, F., Fijany, A., Fontaine, J.-G.: Highly parallel implementation of Harris Corner detector on CSX SIMD architecture. In: Presented at the Proceedings of the 2010 conference on Parallel processing, Ischia, Italy (2011)

  21. Piskorski, S., Lacassagne, L., Bouaziz, S., Etiemble, D.: Customizing CPU instructions for embedded vision systems. In: Presented at the Proceedings of the 2007 IEEE International Conference on Application-Specific Systems, Architectures and Processors (2007)

  22. Tippetts, B., Lee, D.-J., Archibald, J.: An on-board vision sensor system for small unmanned vehicle applications. Mach. Vis. Appl. 23(2), 1–13 (2012)

    Google Scholar 

  23. Benedetti, A., Perona, P.: Real-time 2-D feature detection on a reconfigurable computer. In: Computer Vision and Pattern Recognition, 1998. Proceedings. 1998 IEEE Computer Society Conference on, 1998, pp. 586–593 (1998)

  24. Teixeira, L.P., Celes, W., Gattass, M.: Accelerated corner-detector algorithms. In: British Machine Vision Conference, Leeds, United Kingdom (2008)

  25. Sinha, S., Frahm, J.-M., Pollefeys, M., Genc, Y.: Feature tracking and matching in video using programmable graphics hardware. Mach. Vis. Appl. 22, 207–217 (2011)

    Article  Google Scholar 

  26. Mainali, P., Qiong, Y., Lafruit, G., Van Gool, L., Lauwereins, R.: Robust low complexity corner detector. IEEE Trans. Circuits Syst. Video Technol. 21, 435–445 (2011)

    Article  Google Scholar 

  27. Alkaabi, S., Deravi, F.: Candidate pruning for fast corner detection. Electron. Lett. 40, 18–19 (2004)

    Article  Google Scholar 

  28. Bouguet, J.-Y.: Pyramidal implementation of the Lucas Kanade feature tracker. Intel corporation, Microprocessor research labs (2000)

  29. Affine covariant features. Available: http://www.robots.ox.ac.uk/~vgg/research/affine/

  30. Nios II processor: the world’s most versatile embedded processor. Available: http://www.altera.com/devices/processor/nios2/ni2-index.html (2012)

  31. Claybrough, M., Defay, F.: Stabilization of an unmanned aerial vehicle using real-time embedded motion estimation. In: Robotics and Biomimetics (ROBIO), 2012 IEEE International Conference on, pp. 2189–2194 (2012)

  32. Sangmin, O., Hoogs, A., Perera, A., Cuntoor, N., Chia-Chih, C., Jong Taek, L., et al.: A large-scale benchmark dataset for event recognition in surveillance video. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 3153–3160 (2011)

  33. Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Presented at the Proceedings of the 7th international joint conference on Artificial intelligence, vol. 2, Vancouver, BC, Canada (1981)

Download references

Author information

Authors and Affiliations

  1. School of Computer Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore

    Nirmala Ramakrishnan, Meiqing Wu, Siew-Kei Lam & Thambipillai Srikanthan

Authors
  1. Nirmala Ramakrishnan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Meiqing Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Siew-Kei Lam
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Thambipillai Srikanthan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nirmala Ramakrishnan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ramakrishnan, N., Wu, M., Lam, SK. et al. Enhanced low-complexity pruning for corner detection. J Real-Time Image Proc 12, 197–213 (2016). https://doi.org/10.1007/s11554-014-0396-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-014-0396-z

Keywords

Search

Navigation