Skip to main content
SpringerLink
Log in

Hybrid JND model-guided watermarking method for screen content images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

With the prevalence of digital products like cellphone, tablet and personal computer, the screen content images (SCIs) consisting of text, graphic, and natural scene picture becomes a significant media in various communication scenarios. In this paper, we propose a novel Spread Transform Dither Modulation (STDM) watermarking scheme based on Hybrid just noticeable distortion model for screen content images. Firstly, the original image was transformed from RGB into YCrCb to ensure stability robustness and invisibility. Then, we proposed a novel automatic classification method based on AC coefficients feature. Different from pictorial block in screen content images, structural-based contrast masking effects was incorporated to adjust the just noticeable distortion value for textual blocks. Finally, the reference image from the SIQAD image database was used to evaluate the performance of our proposed scheme. Experiments showed that our method has a good performance in term of robustness with better visual quality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Chang X, Nie F, Wang S, Yang Y, Zhou X, Zhang C (2016) Compound rank-k projections for bilinear analysis. IEEE Trans Neural Netw Learn Syst 27(7):1502–1513

    Article  MathSciNet  Google Scholar 

  2. Chang X, Yu YL, Yang Y, Xing EP (2017) Semantic pooling for complex event analysis in untrimmed videos. IEEE Trans Pattern Anal Mach Intell 39(8):1617–1632

    Article  Google Scholar 

  3. Eckert MP, Bradley AP (1998) Perceptual quality metrics applied to still image compression. Signal Process 70(3):177–200

    Article  Google Scholar 

  4. Fang Y, Lin W, Chen Z, Tsai CM, Lin CW (2014) A video saliency detection model in compressed domain. IEEE Trans Circuits Syst Video Technol 24(1):27–38

    Article  Google Scholar 

  5. Fang Y, Yan J, Li L, Wu J (2017) No reference quality assessment for screen content images. In: Multimedia & expo workshops (ICMEW), 2017 IEEE International Conference on, IEEE, pp 169-174

  6. Gu K, Qiao J, Min X, Yue G, Weisi L, Thalmann D (2017a) Evaluating quality of screen content images via structural variation analysis. IEEE Transactions on Visualization and Computer Graphics

  7. Gu K, Zhou J, Qiao JF, Zhai G, Lin W, Bovik AC (2017b) No-reference quality assessment of screen content pictures. IEEE Trans Image Process 26(8):4005–4018

    Article  MathSciNet  Google Scholar 

  8. Lan C, Shi G, Wu F (2010) Compress compound images in h. 264/mpge-4 avc by exploiting spatial correlation. IEEE Trans Image Process 19(4):946–957

    Article  MathSciNet  Google Scholar 

  9. Li Q, Cox IJ (2007) Improved spread transform dither modulation using a perceptual model: robustness to amplitude scaling and jpeg compression. In: Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on, IEEE, vol 2, pp II–185

  10. Li Q, Doërr G, Cox IJ (2006) Spread transform dither modulation using a perceptual model. In: Multimedia Signal Processing, 2006 IEEE 8th Workshop on, IEEE, pp 98–102

  11. Li X, Liu J, Sun J, Yang X, Liu W (2011) Step-projection-based spread transform dither modulation. IET Inf Secur 5(3):170–180

    Article  Google Scholar 

  12. Li Z, Nie F, Chang X, Yang Y (2017) Beyond trace ratio: weighted harmonic mean of trace ratios for multiclass discriminant analysis. IEEE Trans Knowl Data Eng 29(10):2100–2110

    Article  Google Scholar 

  13. Lin T, Hao P (2005) Compound image compression for real-time computer screen image transmission. IEEE Trans Image Process 14(8):993–1005

    Article  MathSciNet  Google Scholar 

  14. Lin T, Zhang P, Wang S, Zhou K, Chen X (2013) Mixed chroma sampling-rate high efficiency video coding for full-chroma screen content. IEEE Trans Circuits Syst Video Technol 23(1):173–185

    Article  Google Scholar 

  15. Ma L, Yu D, Wei G, Tian J, Lu H (2010) Adaptive spread-transform dither modulation using a new perceptual model for color image watermarking. IEICE Trans Inf Syst 93(4):843–857

    Article  Google Scholar 

  16. Ma Z, Chang X, Xu Z, Sebe N, Hauptmann AG (2017) Joint attributes and event analysis for multimedia event detection. IEEE Trans Neural Netw Learn Syst 29(10)

  17. Min X, Ma K, Gu K, Zhai G, Wang Z, Lin W (2017) Unified blind quality assessment of compressed natural, graphic, and screen content images. IEEE Trans Image Process 26(11):5462–5474

    Article  MathSciNet  Google Scholar 

  18. Ni Z, Ma L, Zeng H, Cai C, Ma KK (2016) Gradient direction for screen content image quality assessment. IEEE Signal Process Lett 23(10):1394–1398

    Article  Google Scholar 

  19. Pan Z, Shen H, Lu Y, Li S, Yu N (2013) A low-complexity screen compression scheme for interactive screen sharing. IEEE Trans Circuits Syst Video Technol 23(6):949–960

    Article  Google Scholar 

  20. Qi H, Jiao S, Lin W, Tang L, Shen W (2014) Content-based image quality assessment using semantic information and luminance differences. Electron Lett 50(20):1435–1436

    Article  Google Scholar 

  21. Tong HH, Venetsanopoulos AN (1998) A perceptual model for jpeg applications based on block classification, texture masking, and luminance masking. In: Image processing, 1998. ICIP 98. Proceedings. 1998 International Conference on, IEEE, pp 428-432

  22. Wan W, Liu J, Sun J, Yang X, Nie X, Wang F (2013) Logarithmic spread-transform dither modulation watermarking based on perceptual model. In: Image Processing (ICIP), 2013 20th IEEE International Conference on, IEEE, pp 4522–4526

  23. Wan W, Liu J, Sun J, Ge C, Nie X (2015a) Logarithmic stdm watermarking using visual saliency-based jnd model. Electron Lett 51(10):758–760

    Article  Google Scholar 

  24. Wan W, Liu J, Sun J, Ge C, Nie X, Gao D (2015b) Improved spread transform dither modulation based on robust perceptual just noticeable distortion model. J. Electron Imaging 24(2):023002

    Article  Google Scholar 

  25. Wan W, Liu J, Sun J, Gao D (2016) Improved logarithmic spread transform dither modulation using a robust perceptual model. Multimedia Tools Appl 75(21):13481–13502

    Article  Google Scholar 

  26. Wan W, Wang J, Li J, Meng L, Sun J, Zhang H, Liu J (2018) Pattern complexity-based jnd estimation for quantization watermarking. Pattern Recognition Letters. https://doi.org/10.1016/j.patrec.2018.08.009

    Article  Google Scholar 

  27. Wang J, Wan W, Zhang M, Zou L, Sun J (2018) A blind quantization watermarking scheme for screen content image. In: International Conference on Cloud Computing and Security, Springer, pp 61–71

    Chapter  Google Scholar 

  28. Wang S, Gu K, Zeng K, Wang Z, Lin W (2016a) Objective quality assessment and perceptual compression of screen content images. IEEE computer graphics and applications

  29. Wang S, Ma L, Fang Y, Lin W, Ma S, Gao W (2016b) Just noticeable difference estimation for screen content images. IEEE Trans Image Process 25(8):3838–3851

    MathSciNet  MATH  Google Scholar 

  30. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  31. Watson AB (1993) Dct quantization matrices visually optimized for individual images. In: Human vision, visual processing, and digital display IV, International Society for Optics and Photonics, vol 1913, pp 202-217

  32. Wei Z, Ngan KN (2009) Spatio-temporal just noticeable distortion profile for grey scale image/video in dct domain. IEEE Trans Circuits Syst Video Technol 19 (3):337–346

    Article  Google Scholar 

  33. Wolfgang RB, Podilchuk CI, Delp EJ (1999) Perceptual watermarks for digital images and video. Proc IEEE 87(7):1108–1126

    Article  Google Scholar 

  34. Wu J, Shi G, Lin W, Liu A, Qi F (2013) Just noticeable difference estimation for images with free-energy principle. IEEE Trans Multimedia 15(7):1705–1710

    Article  Google Scholar 

  35. Xu J, Joshi R, Cohen RA (2016) Overview of the emerging hevc screen content coding extension. IEEE Trans Circuits Syst Video Technol 26(1):50–62

    Article  Google Scholar 

  36. Yang H, Lin W, Deng C (2012) Learning based screen image compression. In: IEEE International Workshop on Multimedia Signal Processing, pp 77–82

  37. Yang H, Fang Y, Lin W (2015) Perceptual quality assessment of screen content images. IEEE Trans Image Process 24(11):4408–4421

    Article  MathSciNet  Google Scholar 

  38. Zhang X, Lin W, Xue P (2005) Improved estimation for just-noticeable visual distortion. Signal Process 85(4):795–808

    Article  Google Scholar 

Download references

Acknowledgements

This work is partially supported by the Natural Science Foundation of Shandong Province (ZR2016FB12), Natural Science Foundation of China (61601268, U1736122), Natural Science Foundation for Distinguished Young Scholars of Shandong Province (JQ201718), Key research and Development Foundation of Shandong Province (2016GGX101009) and Shandong Provincial Key Research and Development Plan (2017CXGC1504).

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Shandong Normal University, Jinan, China

    Wenbo Wan, Jun Wang, Jiande Sun & Huaxiang Zhang

  2. School of Mechanical and Electrical Engineering, Shandong Management University, Jinan, China

    Jing Li

  3. School of Information Science and Engineering, Shandong University, Qingdao, China

    Ju Liu

Authors
  1. Wenbo Wan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jiande Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Huaxiang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ju Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiande Sun.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wan, W., Wang, J., Li, J. et al. Hybrid JND model-guided watermarking method for screen content images. Multimed Tools Appl 79, 4907–4930 (2020). https://doi.org/10.1007/s11042-018-6860-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6860-1

Keywords

Search

Navigation