Skip to main content
SpringerLink
Log in

A robust keypoint extraction and matching algorithm based on wavelet transform and information theory for point-based registration in endoscopic sinus cavity data

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Feature extraction is one of the most important steps in processing endoscopic data. The extracted features should be invariant to image scale and rotation to provide a robust matching across a substantial range of affine distortions and changes in 3D space. In this study, a method is proposed on the basis of the dual-tree complex wavelet transform. First, a map is estimated for each scale, and then a Gaussian weighted additive function (GWAF) is determined. Keypoints are selected from local peaks of GWAF. The matching and registration are performed by applying normalized mutual information and our modified iterative closest point. Results are reported in terms of robustness to rotation, noise, color, brightness, number of keypoints, index of matching and execution time for the building, standard clinical and phantom sinus datasets. Although the results are comparable to that of the speeded up robust features, scale invariant feature transform, and the Harris method, they are more robust to the variations in rotation, brightness, color, and noise than those obtained from other methods. Registration errors obtained for consequent frames for building, clinical and phantom datasets are 0.97, 1.46 and 1.1 mm, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

References

  1. Mirota, D.J., et al.: High-accuracy 3D image-based registration of endoscopic video to C-arm cone-beam CT for image-guided skull base surgery. In: Medical Imaging 2011: Visualization, Image-Guided Procedures, and Modeling, vol. 7964 (2011)

  2. Mirota, D.J., Uneri, A., Schafer, S., Nithiananthan, S., Reh, D., Ishii, M., Gallia, G.L., Taylor, R.H., Hager, G.D., Siewerdsen, J.H.: Evaluation of a system for high-accuracy 3D image-based registration of endoscopic video to C-arm cone-beam CT for image-guided skull base surgery. IEEE Trans. Med. Imaging. 32(7), (2013)

  3. Thormahlen, T., Broszio, H., Meier, P.N.: Three-dimensional endoscopy. In: Falk Symposium, Medical Imaging in Gastroenterology and Hepatology, 212 edn., vol. 124, pp. 199–212. Hannover (2002)

  4. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  5. Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference, pp. 147–151 (1988)

  6. Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)

    Article  Google Scholar 

  7. Bay, H., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) Computer Vision—ECCV 2006, pp. 404–417. Springer, Berlin (2006)

    Chapter  Google Scholar 

  8. Loupias, E. et al.: Wavelet-based salient points for image retrieval. In: IEEE International Conference on Image Processing (2000)

  9. Neumann, J., Steidl, G.: Dual-tree complex wavelet transform in the frequency domain and an application to signal classification. Int. J. Wavelets Multiresolut Inf. Process. 3(43), (2005). doi:10.1142/S0219691305000749

  10. Kingsbury, N.G.: Complex wavelets for shift invariant analysis and filtering of signals. J. Appl. Comput. Harmonic Anal. 10(3), 234–253 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  11. Selesnick, I.W., Baraniuk, R.G., Kingsbury, N.G.: The dual-tree complex wavelet transform. IEEE Signal Process. Mag. 22(6), 123–151 (2005)

    Article  Google Scholar 

  12. Papademetris, X., et al.: Integrated intensity and point-feature nonrigid registration. In: Barillot, C., Haynor, D.R., Hellier, P. (eds.) MICCAI (1), pp. 763–770. Springer, Berlin (2004)

    Google Scholar 

  13. Nabatchian, A., Abdel-Raheem, E., Ahmadi, M.: Illumination invariant feature extraction and mutual-information-based local matching for face recognition under illumination variation and occlusion. Pattern Recognit. 44(10–11), 2576–2587 (2011)

    Article  Google Scholar 

  14. Wells III, W.M., et al.: Multi-modal volume registration by maximization of mutual information. Med. Image Anal. 1(1), 35–51 (1996)

    Article  Google Scholar 

  15. Maes, F., et al.: Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imaging 16(2), 187–198 (1997)

    Article  Google Scholar 

  16. Estevez, P.A., et al.: Normalized mutual information feature selection. IEEE Trans. Neural Netw. 20(2), 189–201 (2009)

    Article  Google Scholar 

  17. Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)

    Article  Google Scholar 

  18. Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: 3-D Digital Imaging and Modeling. Quebec City, QC (2001)

  19. Nazem, F., et al.: Two-stage point-based registration method between ultrasound and CT imaging of the liver based on ICP and unscented Kalman filter: a phantom study. Int. J. Comput. Assist. Radiol. Surg. 9(1), 39–48 (2014)

    Article  Google Scholar 

  20. Ahmadian, A., et al.: An efficient method for estimation of soft tissue deformation based on intra-operative stereo image features and point-based registration. Int. J. Imaging Syst. Technol. 23(4), 294–303 (2013)

    Article  MathSciNet  Google Scholar 

  21. Bendale, P., Triggs, B., Kingsbury, N.: Multiscale keypoint analysis based on complex wavelets. In: Proceedings of the British Machine Vision Conference. BMVA Press (2010)

  22. Fauqueur, J., Kingsbury, N., Anderson, R.: Multiscale keypoint detection using the dual-tree complex wavelet transform. In: International Conference Image Processing (2006)

  23. Studholme, C., Hill, D.L.G., Hawkes, D.J.: An overlap invariant entropy measure of 3D medical image alignment. Pattern Recognit. 32(1), 71–86 (1999)

    Article  Google Scholar 

  24. Abretske, D., et al.: Intelligent frame selection for anatomic reconstruction from endoscopic video. In: WACV, pp. 1–5. IEEE Computer Society (2009)

  25. Serej, N.D., Ahmadian, A., Mohagheghi, S., Sadrehosseini, S.M.: A projected landmark method for reduction of registration error in image-guided surgery systems. Int. J. Comput. Assist. Radiol. Surg. 10(5), 541–554 (2015)

  26. Kovesi, P.: http://www.csse.uwa.edu.au/~pk/research/matlabfns/

  27. Kroon, D.: http://www.mathworks.com/matlabcentral/fileexchange/28300-opensurf-including-image-warp/

  28. Lowe, D.: http://www.cs.ubc.ca/spider/lowe/keypoints/siftDemoV4.zip

Download references

Acknowledgments

This research has been supported by Tehran University of Medical Sciences & health Services grant 90-04-30-15836. Also, the authors would like to thank Research Center for Biomedical Technology & Robotics, RCBTR for supporting and providing an environment to carry on this project.

Author information

Authors and Affiliations

  1. Medical Physics and Biomedical Engineering Department, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran

    Nasim Dadashi Serej, Alireza Ahmadian & Parastoo Farnia

  2. Research Center for Biomedical Technologies and Robotics (RCBTR), Tehran University of Medical Sciences, Tehran, Iran

    Nasim Dadashi Serej, Alireza Ahmadian & Parastoo Farnia

  3. Department of Computer Engineering, Sharif University of Technology, Tehran, Iran

    Shohreh Kasaei

  4. Skull Base Center, Imam Khomeini Hospital Complex, Tehran University of medical sciences, Tehran, Iran

    Seyed Musa Sadrehosseini

Authors
  1. Nasim Dadashi Serej
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alireza Ahmadian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shohreh Kasaei
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Seyed Musa Sadrehosseini
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Parastoo Farnia
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alireza Ahmadian.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (docx 677 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Serej, N.D., Ahmadian, A., Kasaei, S. et al. A robust keypoint extraction and matching algorithm based on wavelet transform and information theory for point-based registration in endoscopic sinus cavity data. SIViP 10, 983–991 (2016). https://doi.org/10.1007/s11760-015-0849-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-015-0849-2

Keywords

Search

Navigation