Skip to main content
SpringerLink
Log in

A Shot boundary Detection Technique based on Visual Colour Information

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The paper proposes a novel video segmentation system with maiden application of CIEDE2000 colour-difference and mean luminace pattern. CIEDE2000 colour-difference uses Lab colour space which is a stable and efficient colour space. The main advantage of Lab colour space model is that it can approximate all the available colours perceived by our human eye. CIEDE2000 colour difference is used for detecting abrupt transitions in the video. The novel contribution of the paper is the maiden use of the mean luminance pattern, increasing and decreasing patterns of the mean value of frame luminance, for detecting the gradual transition. The approach is validated on standard databases TRECVid 2001 and 2007 test video database. The performance of the proposed technique is compared with recently reported techniques and found to be superior as compared to other techniques. The accuracy achieved with the proposed method on the standard databases is 95.9% for cut transition, 78.6% for gradual transition and 92.1% overall.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Abdulhussain Sadiq H., Ramli Abd Rahman, Saripan M.I., Mahmmod B.M., Al-Haddad S.A.R., Jassim W.A. (2018) Methods and challenges in shot boundary detection: a review. Entropy 20(4):1–42

    MATH  Google Scholar 

  2. Boccignone G., Chianese A., Moscato V., Picariello A. (2005) Foveated shot detection for video segmentation. IEEE Transactions on Circuits and Systems for Video Technology 15(3):365–377

    Article  Google Scholar 

  3. Cai C., Lam K., Tan Z. (2005) TRECVID 2005 experiments in the Hong Kong polytechnic university: shot boundary detection based on a Multi-Step comparison scheme, Proc. Int. Conf.

  4. Farshid A., Arding H., Ming-Yee C. (1993) Image Processing on Compressed Data for Large Video Databases. Association for Computing Machinery, New York, NY, USA, pp 267–272. https://doi.org/10.1145/166266.166297 isbn 0897915968 MULTIMEDIA ’93 Anaheim, California, USA

    Google Scholar 

  5. Gao Y., Yong J., Cheng F, Yong J., Cheng F. (2011) Video shot boundary detection using Frame-Skipping technique

  6. Gaurav S., Wu W., Dalal E. (2005) The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations. Color Research & Application. 30(1):21–30

    Article  Google Scholar 

  7. Gengshen W.U., Liu L, Guo Y., Ding G., Han J., Shen J., Shao L (2017) Unsupervised deep video hashing with balanced rotation. IJCAI 17:3076–3082. https://doi.org/10.24963/ijcai.2017/429

    Google Scholar 

  8. Gong Y., Liu X. (2000) Video Shot Segmentation and Classification

  9. HongJiang Z., Kankanhalli A., Smoliar S. (1993) Automatic partitioning of full-motion video. Multimedia Systems. 1(1):10–28

    Article  Google Scholar 

  10. Hongjiang Z., Chien Yong L., Smoliar S. (1995) Video Parsing and browsing using compressed data. Multimedia Tools Appl. 1(1):89–111

    Article  Google Scholar 

  11. Kar T., Kanungo P. (2017) A motion and illumination resilient framework for automatic shot boundary detection. Signal Image and Video Processing 11(7):1237–1244

    Article  Google Scholar 

  12. Koprinska I., Carrato S. (2001) ‘Temporal video segmentation: A survey’. Signal Processing:, Image Communication. 16(5):477–500

    Google Scholar 

  13. Küçüktunç O., Güdükbay U., Ulusoy Ö. (2010) Fuzzy Color Histogram-based Video Segmentation. Comput. Vis. Image Underst. 114 (1):125–134

    Article  Google Scholar 

  14. Li Y.N., Lu Z.M., Niu X.M. (2009) Fast video shot boundary detection framework employing pre-processing techniques. IET Image Process 3 (3):121–134

    Article  Google Scholar 

  15. Lienhart R. (1999) Comparison of automatic shot boundary detection algorithms. In: Proc. Int. Conf. SPIE, pp 290–301

  16. Liu X., Jia M., Zhang X., Lu W. (2019) A novel multichannel internet of things based on dynamic spectrum sharing in 5G communication. IEEE Internet Things J. 6(4):5962–5970

    Article  Google Scholar 

  17. Liu F., Wan Y. (2015) Improving the video shot boundary detection using the HSV color space and image subsampling. In: Proc. Int. Conf. Advanced Computational Intelligence, China, pp 351—354

  18. Liu X., Zhang X. (2020) NOMA-based Resource Allocation for Cluster-based Cognitive Industrial Internet of Things. IEEE Transactions on Industrial Informatics 16(8):5379–5388

    Article  Google Scholar 

  19. Lu Z., Shi Y. (2013) Fast Video shot boundary detection based on SVD and pattern matching. IEEE Transactions on Image Processing. 22(12):5136–5145

    Article  MathSciNet  Google Scholar 

  20. Nagasaka A., Tanaka Y. (1992) Automatic video indexing and Full-Video search for object appearances, Proc. IFIP TC2/WG 2.6. Conf. Visual database systems II The Netherlands, 113–127

  21. Pei S., Chou Y. (1999) Efficient MPEG compressed video analysis using macroblock type information. IEEE TRANS. ON MUL. 1(4):321–331

    Article  Google Scholar 

  22. Prabavathy A.K., Shree J.D. (2017) Histogram difference with fuzzy rule base modeling for gradual shot boundary detection in video cloud applications

  23. Prasertsakul P, Kondo T., Iida H. (2020) Camera operation estimation from video shot using 2D motion vector histogram. Multimed Tools Appl 79:17403–17426. https://doi.org/10.1007/s11042-019-08378-3

    Article  Google Scholar 

  24. Priya L.S.D. (2014) Hadamard transform Kernel-Based feature vector for shot boundary detection. IEEE Trans Image Process 23(12):5187–5197

    Article  MathSciNet  Google Scholar 

  25. Shen J., Tao D., Li X. (2008) Modality Mixture Projections for Semantic Video Event Detection. In: IEEE Transactions on Circuits and Systems for Video Technology. https://doi.org/10.1109/TCSVT.2008.2005607, vol 18, pp 1587–1596

  26. Smeaton A., Over P., Doherty A. (2010) Video shot boundary detection: Seven years of TRECVid activity. Comput Vis Image Underst 114(4):411–418

    Article  Google Scholar 

  27. Thounaojam D.M., Bhadouria V., Roy S., Singh K.H.M. (2017) Shot boundary detection using perceptual and semantic information. International Journal of Multimedia Information Retrieval. 6(2):167–174

    Article  Google Scholar 

  28. Thounaojam D.M., Khelchandra T., Singh Kh.M., Roy S. (2016) A Genetic Algorithm and Fuzzy Logic Approach for Video Shot Boundary Detection’, Computational intelligence and neuroscience, 2016, 11

  29. Thounaojam D.M., Trivedi A., Manglem-Singh K.H, Roy S. (2013) A survey on video segmentation Proc. Int. Conf. Advanced computing, networking, and informatics India, 903–912

  30. Tippaya S., Sitjongsataporn S., Tan T., Khan M.M., Chamnongthai K. (2017) Multi-Modal visual Features-Based video shot boundary detection. IEEE Access 5:12563–12575

    Article  Google Scholar 

  31. Tong W., Song L., Yang X., Qu H., Xie R. (2015) CNN-based shot boundary detection and video annotationl

  32. Xu W., Xu L. (2010) A novel shot detection algorithm based on clustering. In: Proc. Int. Conf. Education Technology and Computer, China, pp 1570–1572

  33. Yasuyuki N. (1999) A Video browsing using fast scene cut detection for an efficient networked video database access. IEICE transactions on information and systems 77(12):1355–1364

    Google Scholar 

Download references

Acknowledgments

Sound and Vision video is copyrighted. The Sound and Vision video used in this work is provided solely for research purposes through the TREC Video Information Retrieval Evaluation Project Collection.

Author information

Authors and Affiliations

  1. Computer Vision Laboratory Department of Computer Science, Engineering, National Institute of Technology Silchar, Assam, India

    Saptarshi Chakraborty, Dalton Meitei Thounaojam & Nidul Sinha

Authors
  1. Saptarshi Chakraborty
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dalton Meitei Thounaojam
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nidul Sinha
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Saptarshi Chakraborty.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chakraborty, S., Thounaojam, D.M. & Sinha, N. A Shot boundary Detection Technique based on Visual Colour Information. Multimed Tools Appl 80, 4007–4022 (2021). https://doi.org/10.1007/s11042-020-09857-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09857-8

Keywords

Search

Navigation