Skip to main content
Springer Nature Link
Log in

Pixel-Level Sonar Image JND Based on Inexact Supervised Learning

  • Conference paper
  • First Online:
Pattern Recognition and Computer Vision (PRCV 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14435))

Included in the following conference series:

Abstract

The Just Noticeable Difference (JND) model aims to identify perceptual redundancies in images by simulating the perception of the Human Visual System (HVS). Exploring the JND of sonar images is important for the study of their visual properties and related applications. However, there is still room for improvement in performance of existing JND models designed for Natural Scene Images (NSIs), and the characteristics of sonar images are not sufficiently considered by them. On the other hand, there are significant challenges in constructing a densely labeled pixel-level JND dataset. To tackle these issues, we proposed a pixel-level JND model based on inexact supervised learning. A perceptually lossy/lossless predictor was first pre-trained on a coarse-grained picture-level JND dataset. This predictor can guide the unsupervised generator to produce an image that is perceptually lossless compared to the original image. Then we designed a loss function to ensure that the generated image is perceptually lossless and maximally different from the original image. Experimental results show that our model outperforms current models.

This work was supported in part by the National Natural Science Foundation of China under Grant 62171134 and in part by Natural Science Foundation of Fujian Province, China under Grant 2022J05117 and 2022J02015.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Lin, W., Ghinea, G.: Progress and opportunities in modelling just-noticeable difference (JND) for multimedia. IEEE Trans. Multimedia 24, 3706–3721 (2021)

    Article  Google Scholar 

  2. Chou, C.H., Li, Y.C.: A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile. IEEE Trans. Circuits Syst. Video Technol. 5(6), 467–476 (1995)

    Article  Google Scholar 

  3. Yang, X., Ling, W., Lu, Z., Ong, E.P., Yao, S.: Just noticeable distortion model and its applications in video coding. Sig. Process. Image Commun. 20(7), 662–680 (2005)

    Article  Google Scholar 

  4. Liu, A., Lin, W., Paul, M., Deng, C., Zhang, F.: Just noticeable difference for images with decomposition model for separating edge and textured regions. IEEE Trans. Circuits Syst. Video Technol. 20(11), 1648–1652 (2010)

    Article  Google Scholar 

  5. Wu, J., Li, L., Dong, W., Shi, G., Lin, W., Kuo, C.C.J.: Enhanced just noticeable difference model for images with pattern complexity. IEEE Trans. Image Process. 26(6), 2682–2693 (2017)

    Article  MathSciNet  Google Scholar 

  6. Wang, H., Yu, L., Liang, J., Yin, H., Li, T., Wang, S.: Hierarchical predictive coding-based JND estimation for image compression. IEEE Trans. Image Process. 30, 487–500 (2020)

    Article  Google Scholar 

  7. Ahumada Jr, A.J., Peterson, H.A.: Luminance-model-based DCT quantization for color image compression. In: Human Vision, Visual Processing, and Digital Display III, vol. 1666, pp. 365–374. SPIE (1992)

    Google Scholar 

  8. Watson, A.B.: DCT quantization matrices visually optimized for individual images. In: Human Vision, Visual Processing, and Digital Display IV, vol. 1913, pp. 202–216. SPIE (1993)

    Google Scholar 

  9. Hontsch, I., Karam, L.J.: Adaptive image coding with perceptual distortion control. IEEE Trans. Image Process. 11(3), 213–222 (2002)

    Article  Google Scholar 

  10. Tong, H.H., Venetsanopoulos, A.N.: A perceptual model for JPEG applications based on block classification, texture masking, and luminance masking. In: Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No. 98CB36269), pp. 428–432. IEEE (1998)

    Google Scholar 

  11. Liu, H., et al.: Deep learning-based picture-wise just noticeable distortion prediction model for image compression. IEEE Trans. Image Process. 29, 641–656 (2019)

    Article  MathSciNet  Google Scholar 

  12. Tian, T., Wang, H., Kwong, S., Kuo, C.C.J.: Perceptual image compression with block-level just noticeable difference prediction. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 16(4), 1–15 (2021)

    Google Scholar 

  13. Jiang, Q., Liu, Z., Wang, S., Shao, F., Lin, W.: Toward top-down just noticeable difference estimation of natural images. IEEE Trans. Image Process. 31, 3697–3712 (2022)

    Article  Google Scholar 

  14. Feng, T.: IC9600: a benchmark dataset for automatic image complexity assessment. IEEE Trans. Pattern Anal. Mach. Intell. 45, 8577–8593 (2022)

    Google Scholar 

  15. Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28

    Chapter  Google Scholar 

  16. Chen, W., Gu, K., Lin, W., Yuan, F., Cheng, E.: Statistical and structural information backed full-reference quality measure of compressed sonar images. IEEE Trans. Circuits Syst. Video Technol. 30(2), 334–348 (2019)

    Article  Google Scholar 

  17. Kim, J., Bae, S.H., Kim, M.: An HEVC-compliant perceptual video coding scheme based on JND models for variable block-sized transform kernels. IEEE Trans. Circuits Syst. Video Technol. 25(11), 1786–1800 (2015)

    Article  Google Scholar 

  18. BT.500-13, I.R.: Methodology for the subjective assessment of the quality of television pictures (2012)

    Google Scholar 

  19. Wang, H., et al.: VideoSet: a large-scale compressed video quality dataset based on JND measurement. J. Vis. Commun. Image Represent. 46, 292–302 (2017)

    Article  Google Scholar 

  20. Wu, J., Shi, G., Lin, W., Liu, A., Qi, F.: Just noticeable difference estimation for images with free-energy principle. IEEE Trans. Multimedia 15(7), 1705–1710 (2013)

    Article  Google Scholar 

  21. Wang, M., Liu, X., Xie, W., Xu, L.: Perceptual redundancy estimation of screen images via multi-domain sensitivities. IEEE Signal Process. Lett. 28, 1440–1444 (2021)

    Article  Google Scholar 

  22. Wan, W., Wu, J., Xie, X., Shi, G.: A novel just noticeable difference model via orientation regularity in DCT domain. IEEE Access 5, 22953–22964 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, Fuzhou University, Fuzhou, 350108, China

    Qianxue Feng, Mingjie Wang, Weiling Chen & Tiesong Zhao

  2. Key Laboratory of Underwater Acoustic Communication and Marine Information Technology (Xiamen University), Ministry of Education, Xiamen University, Xiamen, 361005, China

    Yi Zhu

Authors
  1. Qianxue Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mingjie Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Weiling Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tiesong Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yi Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weiling Chen .

Editor information

Editors and Affiliations

  1. Nanjing University of Information Science and Technology, Nanjing, China

    Qingshan Liu

  2. Xiamen University, Xiamen, China

    Hanzi Wang

  3. Beijing University of Posts and Telecommunications, Beijing, China

    Zhanyu Ma

  4. Sun Yat-sen University, Guangzhou, China

    Weishi Zheng

  5. Peking University, Beijing, China

    Hongbin Zha

  6. Chinese Academy of Sciences, Beijing, China

    Xilin Chen

  7. Chinese Academy of Sciences, Beijing, China

    Liang Wang

  8. Xiamen University, Xiamen, China

    Rongrong Ji

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Feng, Q., Wang, M., Chen, W., Zhao, T., Zhu, Y. (2024). Pixel-Level Sonar Image JND Based on Inexact Supervised Learning. In: Liu, Q., et al. Pattern Recognition and Computer Vision. PRCV 2023. Lecture Notes in Computer Science, vol 14435. Springer, Singapore. https://doi.org/10.1007/978-981-99-8552-4_37

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-8552-4_37

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-8551-7

  • Online ISBN: 978-981-99-8552-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics