Skip to main content

Histogram Based Split and Merge Framework for Shot Boundary Detection

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 8284))

Abstract

In this paper, we propose a non-parametric approach for shot boundary detection in videos. The proposed method exploits the split and merge framework by the use of color histograms. Initially, every frame of the input video sequence undergoes color quantization and subsequently, the color histograms are computed for every quantized frame. The split and merge is driven by the fishers linear discriminant criterion function which results with a set of subsequences after several iterations which are assumed to be the shots present in the given video. The proposed method is experimentally tested on video samples from TrecVid 2002 dataset and YouTube online database. We have obtained overall accuracy of 85.5% Precision, 87.1% Recall and 86.1% F-measure for the dataset used. A comparative study of the proposed approach with the contemporary research works is also carried out.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Idris, F., Panchanathan, S.: Review of image and video indexing techniques. J. Vis. Commun. Image Represent. 8(2), 146–166 (1997)

    Article  Google Scholar 

  2. Brunelli, R., Mich, O., Modena, C.M.: A survey on the automatic indexing of video data. J. Vis. Commun. Image Represent. 10, 78–112 (1999)

    Article  Google Scholar 

  3. Koprinska, I., Carrato, S.: Temporal video segmentation: a survey. Signal Processing: Image Communication 16(5), 477–500 (2001)

    Google Scholar 

  4. Lefevre, S., Holler, J., Vincent, N.: A review of real-time segmentation of uncompressed video sequences for content-based search and retrieval. Real-Time Imaging 9(1), 73–98 (2003)

    Article  Google Scholar 

  5. Patel, B.V., Shah, B.B.: Content based video retrieval systems. Int. J. Ubi Comp. 3(2), 13–30 (2012)

    Article  Google Scholar 

  6. Kanagavalli, R., Duraiswamy, K.: A study on techniques used in digital video for shot segmentation and content based video retrieval. European Journal of Scientific Research 69(3), 370–380 (2012)

    Google Scholar 

  7. Mittal, A., Cheong, L., Sing, L.: Robust identification of gradual shot-transition types. In: Proceedings of 2002 International Conference on Image Processing, vol. 2, pp. 413–416 (2002)

    Google Scholar 

  8. Patel, N.V., Sethi, I.K.: Video shot detection and characterization for video databases. Pattern Recognition 30, 583–592 (1997)

    Article  Google Scholar 

  9. Yuan, J., Wang, H., Xiao, L., Zheng, W., Li, J., Lin, F., Zhang, B.: A formal study of shot boundary detection. IEEE Trans. on Circuits and Systems for Video Technology 17(2), 168–186 (2007)

    Article  Google Scholar 

  10. Zhang, C., Wang, W.A.: Robust and efficient shot boundary detection approach based on fisher criterion. In: Proceedings of the 20th ACM International Conference on Multimedia (MM 2012), pp. 701–704. ACM, New York (2012)

    Google Scholar 

  11. Onur, K., Ugur, G., Ozgur, U.: Fuzzy color histogram-based video segmentation. Computer Vision and Image Understanding 114(1), 125–134 (2010)

    Article  Google Scholar 

  12. Abdelati, M.A., Ben, A.A., Mtibaa, A.: Video shot boundary detection using motion activity descriptor. J. Telecommun. 2(1), 54–59 (2010)

    Google Scholar 

  13. Chen, W., Zhang, Y.: Parametric model for video content analysis. Pattern Recogn. Lett. 29(3), 181–191 (2008)

    Article  MATH  Google Scholar 

  14. Massimiliano, A., Chianese, A., Moscato, V., Sansone, L.: A formal model for video shot segmentation and its application via animate vision. Multimedia Tools Appl. 24(3), 253–272 (2004)

    Article  Google Scholar 

  15. Damnjanovic, U., Izquierdo, E., Grzegorzek, M.: Shot boundary detection using spectral clustering. In: 15th European Signal Processing Conference (EUSIPCO 2007), Poznan, Poland, pp. 1779–1783 (2007)

    Google Scholar 

  16. Wang, P., Liu, Z., Yang, S.: Investigation on unsupervised clustering algorithms for video shot categorization. Journal of Soft Comput. 11(4), 355–360 (2006)

    Article  MathSciNet  Google Scholar 

  17. Yuchou, C., Lee, D.J., Yi, H., James, A.: Unsupervised video shot detection using clustering ensemble with a color global scale-invariant feature transform descriptor. J. Image Video Proc. 1, 1–10 (2008)

    Google Scholar 

  18. Manjunath, S., Guru, D.S., Suraj, M.G., Harish, B.S.: A non-parametric shot boundary detection: an Eigen gap based approach. In: Proceedings of Fourth Annual ACM Bangalore Conference, vol. 1, pp. 1030–1036

    Google Scholar 

  19. Wang, H., Divakaran, A., Vetro, A., Chang, S.F., Sun, H.: Survey of compressed-domain features used in audio-visual indexing and analysis. J. Visual. Commun. Image Represent. 14, 150–183 (2003)

    Article  Google Scholar 

  20. Bruyne, S.D., Deursen, D.V., Cock, J.D., Neve, W.D., Lambert, P., Walle, R.V.D.: A compressed-domain approach for shot boundary detection on H.264/AVC bit streams. Signal Processing: Image Communication 23, 473–489 (2008)

    Google Scholar 

  21. Chen, J., Ren, J., Jiang, J.: Modelling of content-aware indicators for effective determination of shot boundaries in compressed MPEG videos. Multimedia Tools Appl. 54(2), 219–239 (2011)

    Article  Google Scholar 

  22. Jacobs, A., Miene, A., Ioannidis, G.T., Herzog, O.: Automatic shot boundary detection combining color, edge, and motion features of adjacent frames (2004), www-nlpir.nist.gov/projects/tvpubs/tvpapers04/ubremen.pdf

  23. Chang, Y., Lee, D.J., Hong, Y., Archibald, J.: Unsupervised video shot detection using clustering ensemble with a color global scale-invariant feature transform descriptor. J. Image Video Process. 9, 10 (2008)

    Google Scholar 

  24. Philips, M., Wolf, W.: A multi-attribute shot segmentation algorithm for video programs. Telecommunication Systems 9(3-4), 393–402 (1998)

    Article  Google Scholar 

  25. Boreczky, J.S., Rowe, L.A.: Comparison of video shot boundary detection techniques. J. Electron Imaging 5(2), 122–128 (1996)

    Article  Google Scholar 

  26. Alan, F.S., Palu, O., Aiden, R.D.: Video shot boundary detection: Seven years of TRECVid activity. Comput. Vis. Image Und. 114(4), 411–418 (2010)

    Article  Google Scholar 

  27. Mishra, R., Singhai, S.: A review on different methods of video shot boundary detection. International Journal of Management IT and Engineering 2(9), 46–57 (2012)

    Google Scholar 

  28. Guru, D.S., Suhil, M., Lolika, P.: A novel approach for shot boundary detection in videos. In: Multimedia processing, communication and computing applications. LNEE, vol. 213, pp. 209–220. Springer (2013)

    Google Scholar 

  29. Mas, J., Fernandez, G.: Video shot boundary detection using color histogram (2003), http://www-nlpir.nist.gov/projects/tvpubs/tvpapers03/ramonlull.paper.pdf

  30. Gonzalez, R.C., Woods, R.E.: Digital Image Processing. PHI Learning Private Limited, New Delhi-110001 (2008)

    Google Scholar 

  31. Max Welling.:Fisher linear discriminant analysis. Max welling’s classnotes in machine learning.  16(7), 817–830, http://www.ics.uci.edu/~welling/classnotes/classnotes.html

  32. Nagabhushana, P., Guru, D.S., Shekara, B.H. (2D)2 FLD: An efficient approach for appearance based object recognition. Neurocomputing. 69, 934–940 (2006)

    Article  Google Scholar 

  33. Atmel, A.M., Abdessalem, B.A., Abdellatif, M.: Video shot boundary detection using motion activity descriptor. Journal of Telecommunications. 2(1), 54–59 (2010)

    Google Scholar 

  34. Zhang, C., Wang, W.: A robust and efficient shot boundary detection approach based on fisher criterion. In: Proceedings of 20th ACM International Conference on Multimedia, vol. 5, pp. 701–704 (2012) ISBN: 978-1-4503-1089-5, doi:10.1145/2393347.2396291

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this paper

Cite this paper

Guru, D.S., Suhil, M. (2013). Histogram Based Split and Merge Framework for Shot Boundary Detection. In: Prasath, R., Kathirvalavakumar, T. (eds) Mining Intelligence and Knowledge Exploration. Lecture Notes in Computer Science(), vol 8284. Springer, Cham. https://doi.org/10.1007/978-3-319-03844-5_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-03844-5_19

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-03843-8

  • Online ISBN: 978-3-319-03844-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics