Skip to main content
SpringerLink
Log in

A flexible and uniform string matching technique for general screen content coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes a flexible and uniform string matching technique named universal string matching (USM) for general screen content coding (SCC). USM uses two reference buffers for string matching: primary reference buffer (PRB) and secondary reference buffer (SRB), and includes three modes: general string (GS) mode, constrained string 1 (CS1) mode, and constrained string 2 (CS2) mode. PRB is used in GS mode and CS1 mode and SRB is used in GS mode and CS2 mode. Each of the three modes plays an essential role in SCC due to the diversity and comprehensiveness of the screen content. The experiments use HEVC SCC common test condition (CTC) for lossy coding. Compared with HEVC HM-16.6 + SCM-5.2 reference software of full frame search range for IBC and with ACT off, USM achieves an average Y BD-rate of −25.5% for four TGM (text and graphics with motion) test sequences from the SCC verification test suite and −5.5% for eight TGM test sequences from the HEVC SCC CTC test suite in all intra configuration with a small increase of encoding runtime and a small decrease of decoding runtime.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Bjøntegaard G (2001) Calculation of average PSNR differences between RD-Curves. ITU-T SG16 Q.6 Document, VCEG-M33, Austin, USA, Apr. 2001

  2. Bjøntegaard G (2008) Improvements of the BD-PSNR model. ITU-T SG16 Q.6 Document, VCEGAI11, Berlin, German, July 2008

  3. Guo L, Pu W, Zou F et al (2014) Color Palette for Screen content coding. In: IEEE International Conference on Image Process (ICIP), Paris, France, 27–30 Oct. 2014. https://doi.org/10.1109/ICIP.2014.7026124

  4. Guo J, Zhao LP, Lin T (2015) A new SCC test sequence with ClearType text rendering for consideration. JCT-VC Doc JCTVC-V0097, Geneva, Switzerland, Oct. 2015

  5. ISO/IEC JTC1/SC29/WG11, N14174 (2014) Requirements for an extension of HEVC for coding of screen content, San Jose, USA, Jan. 2014

  6. Joshi R, Liu S, Sullivan GJ et al (2016) High efficiency video coding (HEVC) Screen Content Coding: Draft 6. JCT-VC Doc JCTVC-W1005, San Diego, USA, Feb. 2016

  7. Lan C, Peng X, Xu J, Wu F (2011) Intra and inter coding tools for screen contents. JCT-VC Doc JCTVC-E145,Geneva, Switzerland, March 2011

  8. Li B, Xu J, Wu F (2014) A Unified Framework of Hash-based Matching for Screen Content coding. In: Proceedings of the IEEE Visual Communications and Image Processing Conference, Valletta, Malta, 7-10 Dec. 2014. https://doi.org/10.1109/VCIP.2014.7051623

  9. Lin T and Wang SH (2009) Cloudlet-Screen Computing: A Multi-core-based, Cloud-computingoriented, Traditional-computing-compatible Parallel Computing Paradigm for the Masses. In: IEEE Workshop on Multimedia Signal Processing and Novel Parallel Computing. New York, USA, 28 June-3 July 2009. https://doi.org/10.1109/ICME.2009.5202873

  10. Lin T, Zhou KL, Chen XY et al (2013) Arbitrary shape matching for screen content coding. In: IEEE Picture Coding Symposium (PCS), San Jose, USA, 8-11 Dec. 2013. https://doi.org/10.1109/PCS.2013.6737760

  11. Lin T (2009) Achieving re-loss-free video coding. IEEE Signal Process Lett 16(4):323–326

    Article  Google Scholar 

  12. Lin T and Wang SH (2009) Cloudlet-Screen Computing: A Multi-core-based, Cloud-computing-oriented, Traditional-computing-compatible Parallel Computing Paradigm for the Masses. In: IEEE Workshop on Multimedia Signal Processing and Novel Parallel Computing. New York, pp. 1805–1808

  13. Lin T, Zhou KL, Wang SH (2013) Cloudlet-screen computing: a client-server architecture with top graphics performance. Int J Ad Hoc Ubiquitous Comput 13(2):96–108

    Article  Google Scholar 

  14. Lin T, Zhang P, Wang SH et al (2013) Mixed Chroma sampling-rate high efficiency video coding for full-chroma screen content. IEEE Trans Circuits Syst Video Technol 23(1):173–185

    Article  Google Scholar 

  15. Lin T, Zhou KL, Chen XY et al (2013) Arbitrary shape matching for screen content coding. IEEE Picture Coding Symposium, pp. 369–372

  16. Lin T, Chen XY, and Wang SH (2013) Pseudo-2-D-matching based Dual-coder Architecture for Screen Contents coding. IEEE International Conference on Multimedia and Expo, pp. 1–4

  17. Lu Y, Li S, Shen H (2011) Virtualized screen: a third element for Cloud_Mobile convergence. IEEE Multimedia 18(2):4–11

    Article  Google Scholar 

  18. Ma Z, Wang W, Xu M, Huamg Y (2014) Advanced screen content coding using color table and index map. IEEE Trans Image Process 23(10):4399–4412

    Article  MathSciNet  MATH  Google Scholar 

  19. Marpe D, Kirchhoffer H, George V et al (2006) Macroblock-adaptive residual color space transforms for 4:4:4 Video Coding. In: IEEE International Conference on Image Processing, Atlanta, USA, 8-11 Oct. 2006. https://doi.org/10.1109/ICIP.2006.313039

  20. Pang C, Sole J, Guo L et al (2013) Intra motion compensation with 2-D MVs. JCT-VC Doc JCTVCN0256, Vienna, Austria, July 2013

  21. Pen WH, Walls FG, Cohen RA, Xu JZ, Ostermann J, MacInnis A, Lin T (2016) Overview of screen content video coding technologies, standards, and beyond. IEEE J Emerging Sel Top Circuits Syst 6(4):393–408

    Article  Google Scholar 

  22. Peng X, Xu J (2016) Hash-based line-by-line template matching for lossless screen image coding. IEEE Trans Image Process 25:5601–5609 ISSN 1057-7149

    Article  MathSciNet  Google Scholar 

  23. Tao LIN, Wenting CAI, CHEN (2017) Xianyi etal. Lossless compression algorithm based on string matching with high performance and low complexity for screen content coding. JEIT 39(2):351–359

    Google Scholar 

  24. Wang SH, Lin T (2009) A unified LZ and hybrid coding for compound image partial-lossless compression. In: IEEE int. conf. Image and Signal Processing, Tianjin, China, 17-19 Oct. 2009. https://doi.org/10.1109/CISP.2009.5301019

  25. Wang SH, Lin T (2010) United Coding for Compound Image Compression. IEEE int. conf. Image and Signal Processing, pp. 566–570

  26. Wang SH, Lin T (2013) Compound image compression based on unified LZ and hybrid coding. IET Image Process 7(5):484–499

    Article  Google Scholar 

  27. Wang SH, Lin T (2014) United coding method for compound image compression. Multimedia Tools Appl 71(3):1263–1282

    Article  Google Scholar 

  28. Wang W, Xu M, Ma Z, Yu H (2015) CE3 test B.3: 2-D intra string copy in HEVC SCC. JCT-VC doc JCTVC-T0126

  29. Wang SH, Lin T, Zhou KL et al (2015) Pseudo-2D-matching based enhancement to high efficiency video coding for screen contents. Multimedia Tools Appl 74(18):7753–7771

    Article  Google Scholar 

  30. Xian-yi C, Li-ping Z, Lin T (2015) A new HEVC intra mode for screen content coding. JEIT 37(11):2685–2690

    Google Scholar 

  31. Xu J, Joshi R, Cohen RA (2016) Overview of the emerging HEVC screen content coding extension. IEEE Trans Circuits Syst Video Technol 26(1):50–62

    Article  Google Scholar 

  32. Yu HP, Cohen R, Rapaka K, and Xu J (2015) Common conditions for screen content coding tests. JCT-VC Doc JCTVC-U1015, Warsaw, Poland, June 2015

  33. Yu H, Baroncini V, Joshi R, Liu S, Xiu X, Xu J (2017) Proposed draft of final report on SCC verification test. JCT-VC Doc JCTVC-AA0040, Hobart, Australia, March 2017

  34. Zeng W, Li J, Lei S (2000) An efficient color re-indexing scheme for palette-based compression. In: Proc. IEEE ICIP, Vancouver, Canada, 10–13 Sept. 2000. https://doi.org/10.1109/ICIP.2000.899448

  35. Zhao LP, Guo J, Lin T (2015) Significantly improving coding performance of Clear Type texts and translucently blended screen content by P2SM. JCT-VC Doc JCTVC-V0095, Geneva, Switzerland, Oct. 2015

  36. Zhao LP, Lin T, Zhou KL et al (2016) Pseudo 2D string matching technique for high efficiency screen content coding. IEEE Trans Multimedia 18(3):339–350

    Article  Google Scholar 

  37. Zhao LP, Zhou KL, Guo J et al (2016) Universal string matching for ultra high quality and ultra high efficiency SCC. JVET-B0048

  38. Zhou KL, Zhao LP, Lin T (2015) Advanced SCC tool using Pseudo 2D String Matching (P2SM) integrated into HM16.6. JCT-VC Doc JCTVC-V0094, Geneva, Switzerland, Oct. 2015

  39. Zhou KL, Zhao LP, Lin T (2016) A hardware decoder architecture for general string matching technique. IEEE J Emerging Sel Top Circuits Syst 6(4):560–572

    Article  Google Scholar 

  40. Zhu W, Xu J, Ding W, et al (2013) Adaptive LZMA-based coding for screen content. In: IEEE Picture Coding Symposium (PCS), San Jose, USA, 8–11 Dec. 2013. https://doi.org/10.1109/PCS.2013.6737761

  41. Zhu W, Ding W, Xu J (2014) Screen content coding based on HEVC framework. IEEE Trans Multimedia 16(5):1316–1326

    Article  Google Scholar 

  42. Zhu W, Ding W, Xu J et al (2015) Hash-based block matching for screen content coding. IEEE Trans Multimedia 17(7):935–944

    Article  Google Scholar 

  43. Ziv J, Lempel S (1977) A universal algorithm for sequential data compression. IEEE Trans Inf Theory 23(3):337–343

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (No.61601200).

Author information

Authors and Affiliations

  1. Institute of VLSI, College of Electronics and Information Engineering, Tongji University, Shanghai, 200092, China

    Kailun Zhou & Tao Lin

  2. Department of Computer Science and Engineering, Shaoxing University, Shaoxing, 312000, China

    Liping Zhao

Authors
  1. Kailun Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Liping Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tao Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tao Lin.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, K., Zhao, L. & Lin, T. A flexible and uniform string matching technique for general screen content coding. Multimed Tools Appl 77, 23751–23775 (2018). https://doi.org/10.1007/s11042-018-5624-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5624-2

Keywords

Search

Navigation