Abstract
Industrial machine-vision (MV) applications require high-speed stitching of low-textural images from multiple high-resolution cameras for Field-of-View expansion. The most vital step in the stitching process is the effective and efficient extraction of features, which becomes challenging for low-textural images. This paper presents a comparative study of five popular feature descriptor algorithms for image stitching viz. Scale Invariant Feature Transform (SIFT), Speeded Up Robust Feature (SURF), Oriented Fast and Rotated BRIEF (ORB), Binary Robust invariant scalable keypoints (BRISK), and Accelerated-KAZE (AKAZE).
The focus of this paper is to present a study of the performance comparison among these feature extraction methods for low-textural images from real-time steel surface inspection systems. Primarily, synchronized images of steel rolled at room temperatures are obtained from a two-camera network with overlapping regions. Feature descriptor algorithms extract features from two images with an overlapping area and further match the features using K-Nearest Neighbour (KNN) algorithm. The performance of the five feature descriptor algorithms is evaluated using a low-textural dataset that consists of a set of 177 images captured from two cameras placed at a fixed distance from each other. The efficiency of these algorithms is quantitatively and qualitatively evaluated using execution time, sensitivity, and specificity. Finally, this paper provides guidelines for future research on problems with FOV expansion in industrial scenarios.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alcantarilla, P.F., Nuevo, J., Bartoli, A.: Fast explicit diffusion for accelerated features in nonlinear scale spaces. British Machine Vision Conference (BMVC) (2013)
Alzohairy, T., El-Dein, E.: Image mosaicing based on neural networks. Int. J. Comput. Appl. 975, 8887 (2016)
Bay, H., Tuytelaars, T., Gool, L.V.: SURF: Speeded-up robust features. Comput. Vis. Image Underst. 110(3), 346–359 (2008)
Bonny, M., Uddin, M.: Feature-based image stitching algorithms. In: IWCI, pp. 198–203 (2016)
Brown, M., Lowe, D.G.: Recognizing panoramas. In: Proceedings of the IEEE International Conference on Computer Vision, vol. 3, p. 1218. Nice, France (2003)
Brown, M., Lowe, D.G.: Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. 74(1), 59–73 (2007)
Chien, H.: When to use what feature? sift, surf, orb, or a-kaze features for monocular visual odometry, pp. 1–6. Palmerston North, IVCNZ (2016)
Colucci, F.: Keep one eye out (2012). http://www.aviationtoday.com/av/issue/cover/Keep-One-Eye-Out_75101.html. Accessed 1 May 2020
Gao, J., Kim, S.J., Brown, M.S.: Constructing image panoramas using dual-homography warping. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 201, pp. 49–56. Colorado Springs, CO, USA (2011)
Gauglitz, S.: Evaluation of interest point detectors and feature descriptors for visual tracking. Int. J. Comput. Vision 94(3), 335–360 (2011)
Goa, F., Goa, F.: Stitching (2017)
Hoang, V.-D., Tran, D.-P., Nhu, N.G., Pham, T.-A., Pham, V.-H.: Deep feature extraction for panoramic image stitching. In: Nguyen, N.T., Jearanaitanakij, K., Selamat, A., Trawiński, B., Chittayasothorn, S. (eds.) ACIIDS 2020. LNCS (LNAI), vol. 12034, pp. 141–151. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-42058-1_12
Horst, R., Negin, M.: Vision system for high-resolution dimensional measurements and on-line SPC: web process application. IEEE Trans. Ind. Appl. 28, 993–997 (1992)
Imaging, S.: Distributed aperture systems. http://www.sarnoffimaging.com/research-and-development/vision-technologies/embeddedvision/distributed-aperture-systems. Accessed 16 May 2020
Jain, R., Kasturi, R., Schunck, B.G.: Machine vision. McGraw-Hill, Inc. (1995)
Jia, J., Tang, K.C.: Eliminating structure and intensity misalignment in image stitching. In: Tenth IEEE International Conference on Computer Vision, ICCV2005, pp. 1651–1658. Beijing, China (2005)
Joshi, K.: Open access a survey on real-time image stitching (2020)
Kaynig, V., Fischer, B., M, B.J.: Probabilistic image registration and anomaly detection by nonlinear warping. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. Anchorage, Alaska, USA (2008)
Khan, N.: Sift and surf performance evaluation against various image deformations on benchmark dataset. In: IEEE International Conference on Digital Image Computing Techniques and Applications, pp. 501–506. DICTA (2011)
Kumar, A.: Computer-vision-based fabric defect detection: a survey. IEEE Trans. Ind. Electron. 55, 348–363 (2008)
Lai, W.S., Gallo, O., Gu, J., Sun, D., Yang, M.H., Kautz, J.: Video stitching for linear camera arrays (2019). arXiv preprint arXiv:1907.13622
Lamkin, M., Ringgenberg, K., Lamkin, J.: Distributed multi - aperture camera array. US 2019/0246044 A1 (2019)
Leutenegger, S., Chli, M., Siegwart, R.: Brisk: Binary robust invariant scalable keypoints. In: International Conference on Computer Vision, pp. 2548–2555 (2011)
Levin, A., Zomet, A., Peleg, S., Weiss, Y.: Seamless image stitching in the gradient domain. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3024, pp. 377–389. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24673-2_31
Li, J., Zhao, Y., Ye, W., Yu, K., Ge, S.: Attentive deep stitching and quality assessment for 360 omnidirectional images. IEEE J. Select. Top. Signal Process 14, 209–221 (2019)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004). http://link.springer.com/10.1023/B:VISI.0000029664.99615.94
Luo, Q., Fang, X., Liu, L., Yang, C., Sun, Y.: Automated visual defect detection for flat steel surface: a survey. IEEE Trans. Instrum. Meas. 69(3), 626–644 (2020)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)
Mistry, S., Patel, A.: Image stitching using Harris feature detection. Int. Res. J. Eng. Technol 03(04), 1363–1369, (2016). https://www.irjet.net/
Nayar, S.: Catadioptric omnidirectional camera. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 482–488 (1997)
Peleg, S., Rousso, B., Rav-Acha, A., Zomet, A.: Mosaicing on adaptive manifolds. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1144–1154 (2000)
Pusztai, Z., Hajder, L.: Quantitative comparison of feature matchers implemented in opencv3. Computer Vision Winter Workshop (2016)
Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: IEEE International Conference on Computer Vision (ICCV) (2011)
Sanders-Reed, J., Koon, P.: Vision systems for manned and robotic ground vehicles. Proc. SPIE 7692, 1–12 (2010)
Shen, C., Ji, X., Miao, C.: Real-time image stitching with convolutional neural networks. International Conference on Real-time Computing and Robotics (RCAR), pp. 192–197 (2019)
Shi, Z., Li, H., Cao, Q., Ren, H., Fan, B.: An image mosaic method based on convolutional neural network semantic features extraction. J. Signal Process. Syst 92, 435–444 (2020)
Silva, R., Bruno, F., Gomes, P., Frensh, T., Monteiro, D.: Real time 360\(^{\circ }\) video stitching and streaming. In: ACM SIGGRAPH 2016 Posters, pp. 1–2. ACM, Anaheim, California (2016)
Sugimoto, T., Kawaguchi, T.: Development of a surface defect inspection system using radiant light from steel products in a hot rolling line. IEEE Trans. Instrum. Meas. 47, 409–416 (1998)
Szeliski, R.: Image alignment and stitching: a tutorial. Found. Trend® Comput. Graph. Vis. 2(1), 1–104 (2007)
Technologies, R.: Advanced distributed aperture system (adas). http://www.raytheon.com/capabilities/products/adas/. Accessed 6 May 2020
Urban, S., Weinmann, M.: Finding a good feature detector-descriptor combination for the 2D keypoint-based registration of TIS point clouds, pp. 121–128. Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences pp (2015)
Wang, L., Yu, W., Li, B.: Multi-scenes image stitching based on autonomous driving. In: 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), vol. 1, pp. 694–698 (2020)
Yan, M., Yin, Q., Guo, P.: Image stitching with single-hidden layer feedforward neural networks. International Joint Conference on Neural Networks (IJCNN), pp. 4162–4169 (2016)
Zhang, J., Chen, G., Jia, Z.: An image stitching algorithm based on histogram matching and sift algorithm. Int. J. Pattern Recognit Artif Intell. 31(4), 1–14 (2017)
Zomet, A., Levin, A., Peleg, S., Weiss, Y.: Seamless image stitching by minimizing false edges. IEEE Trans. Image Process. 15(4), 969–977 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Subramanyam, V., Kumar, J., Singh, S.N., Kumar, R., Yadav, A.R. (2023). Low-Textural Image Registration: Comparative Analysis of Feature Descriptors. In: Gupta, D., Bhurchandi, K., Murala, S., Raman, B., Kumar, S. (eds) Computer Vision and Image Processing. CVIP 2022. Communications in Computer and Information Science, vol 1777. Springer, Cham. https://doi.org/10.1007/978-3-031-31417-9_35
Download citation
DOI: https://doi.org/10.1007/978-3-031-31417-9_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-31416-2
Online ISBN: 978-3-031-31417-9
eBook Packages: Computer ScienceComputer Science (R0)