Abstract
Recently, device storage capacity and transmission bandwidth requirements are facing a heavy burden on account of massive internet images. Generally, to improve user experience and save costs as much as possible, a lot of internet applications always focus on how to achieve appropriate image recompression. In this paper, we propose a novel framework to efficiently customize image recompression according to a variety of applications. First of all, we evaluate the input image's compression level and predict an initial compression level which is very close to the final output of our system using a prior learnt from massive images. Then, we iteratively recompress the input image to different levels and measure the perceptual similarity between the input image and the new result by a block-based coding quality method. According to the output of the quality assessment method, we can update the target compression level, or switch to the subjective evaluation, or return the final recompression result in our system pipeline control. We organize subjective evaluations based on different applications and obtain corresponding assessment report. At last, based on the assessment report, we set up a series of appropriate parameters for customizing image recompression. Moreover, our new framework has been successfully applied to many commercial applications, such as web portals, e-commerce, online game, and so on.
Similar content being viewed by others
References
Chen T, Cheng M M, Tan P, Shamir A, Hu S M. Sketch2Photo: Internet image montage. ACM Trans. Graphics, 2009, 28(5), Article No.124.
Huang H, Zhang L, Zhang H C. Arcimboldolike collage using internet images. ACM Trans. Graphics, 2011, 30(6), Article No.155.
Zhuang Y, Han Y, Wu F, Yang J. Stable multi-label boosting for image annotation with structural feature selection. Science China Information Sciences, 2011, 54(12): 2508-2521.
Yang F, Li B. Unsupervised learning of spatial structures shared among images. The Visual Computer, 2011, 27(2): 175-180.
Xie Z F, Lau R, Gui Y, Chen M G, Ma L Z. A gradient-domain-based edge-preserving sharpen filter. The Visual Computer, Published Online: 19 Jan., 2012.
Pennebaker W B, Mitchell J L. JPEG: Still Image Data Compression Standards. Springer, 1992.
Rabbani M, Joshi R. An overview of the JPEG 2000 still image compression standard. Signal Processing: Image Communication, 2002, 17(1): 3-48.
Taubman D. High performance scalable image compression with EBCOT. IEEE Trans. Image Processing, 2000, 9(7): 1158-1170.
Do M, Vetterli M. The contourlet transform: An efficient directional multiresolution image representation. IEEE Transactions on Image Processing, 2005, 14(12): 2091-2106.
He X, Ji M, Bao H. A unified active and semi-supervised learning framework for image compression. In Proc. Int. Conf. Computer Vision and Pattern Recognition, June 2009, pp.65-72.
Ierodiaconou S, Byrne J, Bull D, Redmill D, Hill P. Unsupervised image compression using graphcut texture synthesis. In Proc. the 16th IEEE International Conference on Image Processing, November 2009, pp.2289-2292.
Byrne J, Ierodiaconou S, Bull D, Redmill D, Hill P. Unsupervised image compression-by-synthesis within a JPEG framework. In Proc. the 15th IEEE International Conference on Image Processing, October 2008, pp.2892-2895.
Wang Z, Bovik A, Sheikh H, Simoncelli E. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.
Chandler D, Hemami S. VSNR: A waveletbased visual signal-to-noise ratio for natural images. IEEE Transactions on Image Processing, 2007, 16(9): 2284-2298.
Shnayderman A, Gusev A, Eskicioglu A. An SVD-based grayscale image quality measure for local and global assessment. IEEE Trans. Image Processing, 2006, 15(2): 422-429.
Shoham T, Gill D, Carmel S. A novel perceptual image quality measure for block based image compression. In Proc. SPIE 7867, Farnand S, Gaykema F (eds.), January 2011, pp.786 709-786 715.
Hamberg R, de Ridder H. Continuous assessment of time-varying image quality. In Proc. SPIE 3016, Rogowitz B, Pappas T (eds.), June 1997, pp.248-259.
de Ridder H. Psychophysical evaluation of image quality: From judgment to impression. In Proc. SPIE 3299, Rogowitz B E, Pappas T N (eds.), July 1998, pp.252-263.
Sheikh H, Sabir M, Bovik A. A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Transactions on Image Processing, 2006, 15(11): 3440-3451.
International Telecommunication Union − Radiocommunication Sector. Studies towards the unification of picture assessment methodologies. Technical Report, BT.1082-1, 1990.
International Telecommunication Union − Radiocommunication Sector. Methodology for the subjective assessment of the quality of television pictures. Technical Report, BT.500-11 Recommendation, 2003.
Ding S, Huang F, Xie Z,Wu Y, Ma L. A novel customized recompression framework for massive internet images. In Proc. Computational Visual Media Conference, November 2012, pp.9-16.
Liu D, Sun X, Wu F, Li S, Zhang Y Q. Image compression with edge-based inpainting. IEEE Transactions on Circuits and Systems for Video Technology, 2007, 17(10): 1273-1287.
Cheng L, Vishwanathan S V N. Learning to compress images and videos. In Proc.the 24th International Conference on Machine Learning, June 2007, pp.161-168.
Sheikh H R, Wang Z, Cormack L, Bovik A C. Quality assessment database. Release 2, 2005, http://live.ece.utexas.edu/research/quality.
Liu Y J, Luo X, Xuan Y M et al. Image retargeting quality assessment. Computer Graphics Forum, 2011, 30(2): 583-592.
Wang Z, Bovik A. Mean squared error: Love it or leave it? a new look at signal fidelity measures. IEEE Signal Processing Magazine, 2009, 26(1): 98-117.
Sampat M, Wang Z, Gupta S, Bovik A, Markey M. Complex wavelet structural similarity: A new image similarity index. IEEE Trans. Image Processing, 2009, 18(11): 2385-2401.
Wang Z, Simoncelli E. Translation insensitive image similarity in complex wavelet domain. In Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, March 2005, pp.573-576.
Wang Z, Li Q. Information content weighting for perceptual image quality assessment. IEEE Transactions on Image Processing, 2011, 20(5): 1185-1198.
Sheikh H, Bovik A. Image information and visual quality. IEEE Trans. Image Processing, 2006, 15(2): 430-444.
Bauschke H, Hamilton C, Macklem M, McMichael J, Swart N. Recompression of JPEG images by requantization. IEEE Transactions on Image Processing, 2003, 12(7): 843-849.
Ng C, Ng V, Poon P. Quantisation error reduction for reducing Q-factor JPEG recompression. In Proc. IFSA World Congress and 20th NAFIPS International Conference, July 2001, pp.1460-1465.
International Telecommunication Union − Radiocommunication Sector. Subjective assessment methods for image quality in high definition television. Technical Report, BT.710-4 Recommendation, 1998.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is supported by a joint project of Tencent Research and Shanghai Jiao Tong University. It is also partially supported by the National Basic Research 973 Program of China under Grant No. 2011CB302203, the National Natural Science Foundation of China under Grant Nos. 61073089, 61133009, the Open Projects Program of National Laboratory of Pattern Recognition of China, and the Open Project Program of the State Key Lab of CAD&CG of Zhejiang University of China under Grant No. A1206.
**The preliminary version of the paper was published in the Proceedings of the 2012 Computational Visual Media Conference.
Rights and permissions
About this article
Cite this article
Ding, SH., Huang, FY., Xie, ZF. et al. A Customized Framework to Recompress Massive Internet Images. J. Comput. Sci. Technol. 27, 1129–1139 (2012). https://doi.org/10.1007/s11390-012-1291-3
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11390-012-1291-3