Skip to main content

Advertisement

Log in

A low complexity detection method for video data discontinuity implemented on SoC-FPGA by using pixel location prediction scheme

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

Image/video processing in real-time is always in high demand for the quality of video. There are several factors which cause the loss of the video content, such as the type of transmission, missing data and especially data switch. Data switch generally occurs in the alternation of the video signal, which can cause the discontinuity of data during the video data stored in buffer or memory. The current method which adopts frame difference for detecting this issue may consume many resources and memory footprint. This paper presents a method which uses the video pixel prediction to detect the freezing event. The method is implemented with a video system which employs the System-on-chip (SoC) architecture with Field Programmable Gate Array (FPGA) and other components including DDR3 ram, flash, and exchange interfaces as the main processing platform that prevents this problem through freezing detection. The result of evaluation shows that the accuracy of the proposed method is above 99%, in terms of saving more logic usage and reducing the footprint of the memory on the video system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Alavi M, Leidner DE (2001) Knowledge management and knowledge management systems : Conceptual foundations and research issues. Manag Inf Syst Res Center 25 (1):107–136

    Article  Google Scholar 

  2. Apperson RW, Yu Z, Meeuwsen MJ, Mohsenin T, Baas BM (2007) A scalable Dual-Clock FIFO for data transfers between arbitrary and haltable clock domains. IEEE Trans Very Large Scale Integr (VLSI) Syst 15(10):1125–1134

    Article  Google Scholar 

  3. Chien S, Ma S, Chen L (2002) Efficient moving object segmentation algorithm using background registration technique. IEEE Trans Circ Syst Video Technol 12 (7):577–586

    Article  Google Scholar 

  4. Davis J, Goadrich M (2006) The relationship between Precision-Recall and ROC curves. In: 23Rd international conference on machine learning. ACM, New York, pp 233–240

  5. Dorbian F, Awan A, Joseph D, Ganjam A, Zhan J, Sekar V, Stoica I, Zhang H (2011) Understanding the impact of video quality on user engagement. In: ACM Special interest group data communication conference. IEEE, Toronto, pp 362–373

  6. Huynh-Thu Q, Ghanbari M (2009) No-reference temporal quality metric for video impaired by frame freezing artefacts. In: 16Th international conference image processing. IEEE, Cairo, pp 2221–2224

  7. ITU (2007) ITU-R recommendation BT.656 ITU-T Rec

  8. Karam L, Ebrahimi T, Hemami S, Pappas T, Safranek R, Wang Z, Watson A (2009) Introduction to the special issue on visual media quality assessment. IEEE J Sel Top Signal Process 3(2):189–192

    Article  Google Scholar 

  9. Kim K, Chalidabhongse TH, Harwood D, Davis LS (2005) Real-time foreground-background segmentation using codebook Model. Real-Time Imaging 11 (3):172–185

    Article  Google Scholar 

  10. Kumbhare P, Krishna V (2014) Designing high-performance video systems in 7 series FPGAs with the AXI Interconnect. Xilinx, CA, pp v1.3

  11. Laplante PA (1997) Real-Time Systems design and analysis. IEEE Press, NJ

  12. Li J, Xu T, Zhang K (2017) Real-Time Feature-Based Video stabilization on FPGA. IEEE Trans Circ Syst Video Technol 27(4):907–919

    Article  Google Scholar 

  13. Li P, Lilja DJ (2011) A low power fault-tolerance architecture for the kernel density estimation based image segmentation algorithm. Application-specific Systems, Architectures and Processors, ASAP. IEEE Santa Monica. https://doi.org/10.1109/ASAP.2011.6043264

  14. Li Y, Wang G, Nie L, Wang Q, Tan W (2018) Distance metric optimization driven convolutional neural network for age invariant face recognition. Pattern Recogn 75:51–62

    Article  Google Scholar 

  15. Marwedel P (2006) Embedded System Design, 1st edn. Springer, New York. https://doi.org/10.1007/978-94-007-0257-8

    MATH  Google Scholar 

  16. Nagai Y, Okamawari T, Fujii T (2016) A novel streaming method using QoS control function of LTE to prevent video freezing. In: Wireless communications and networking conference, WCNC. IEEE, Doha. https://doi.org/10.1109/WCNC.2016.7564971

  17. Pedre S, Krajník S, Todorovich E, Borensztejn R (2016) Accelerating embedded image processing for real time: a case study. J Real-Time Image Proc 11 (2):349–374

    Article  Google Scholar 

  18. Seshadrinathan K, Soundararajan R, Bovik AC, Cormack LK (2010) Study of subjective and objective quality assessment of video. IEEE Trans Image Process 19(6):1427–1441

    Article  MathSciNet  MATH  Google Scholar 

  19. Shuang Y, Yifan W, Fang M (2014) The comparison and improvement of data processing methods in video quality subjective assessment. In: 7Th international congress image and signal processing. IEEE, Dalian, pp 612–616

  20. Stauffer C, Grimson W (1999) Adaptive background mixture models for real-time tracking. In: Computer vision and pattern recognition conference. IEEE, Fort Collins, pp 246–252

  21. Škobić V, Marić U, Tomić S (2016) Real time video freezing detection implementation on FPGA. In: 24Th telecommunication forum TELFOR. IEEE, Belgrade, pp 1–3

  22. Xue Y, Erkin B, Wang Y (2015) A novel No-Reference video quality metric for evaluating temporal jerkiness due to frame freezing. IEEE Trans Multimed 17(1):134–139

    Article  Google Scholar 

  23. Yammine Y, Wige E, Simmet F (2012) Blind frame freeze detection in coded videos. In: Picture coding symposium. IEEE, Krakow, pp 341–344

  24. Yan H, Li X, Wang Y, Jia C (2018) Centralized Duplicate Removal Video Storage System with Privacy Preservation in IoT. Sensors 18(60):1813

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shanq-Jang Ruan.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nian, TK., Chondro, P. & Ruan, SJ. A low complexity detection method for video data discontinuity implemented on SoC-FPGA by using pixel location prediction scheme. Multimed Tools Appl 79, 22261–22276 (2020). https://doi.org/10.1007/s11042-020-09021-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09021-2

Keywords

Navigation