research-article

Multidimensional image retargeting

Authors:

Francesco Banterle,

Alessandro Artusi,

Tunç O. Aydin,

Elmar Eisemann,

Diego Gutierrez,

Karol MyszkowskiAuthors Info & Claims

SA '11: SIGGRAPH Asia 2011 Courses

Article No.: 15, Pages 1 - 612

https://doi.org/10.1145/2077434.2077447

Published: 12 December 2011 Publication History

Abstract

Retargeting refers to the process by which an image or video is adapted from the display device for which it was meant (target display) to another one (retarget display). The retarget display has different features from the target one such as dynamic range, discretization levels, color gamut, multi-view, and refresh rate spatial resolution. This is a very relevant topic in graphics, given the increasing number of display devices from large, high-contrast screens to small cell phones with limited dynamic range; a lot of techniques are being published in different venues, and it's hard to keep up. For most cases retargeting can be an ill-posed problem, for example in the process of displaying Low Dynamic Range (LDR) or 8-bit content on High Dynamic Range (HDR) displays. Such a problem requires the retargeting algorithm to generate new content which is missing in the input image/frame. In this course, we will present the latest solutions and techniques for retargeting images along various dimensions such as dynamic range, colors, temporal and spatial resolutions, and for the first time offer a much-needed holistic view of the field. Moreover, we are going to show how to measure and analyze the changes applied to an image or video in terms of quality using both psychophysical experiments (subjective) and computational metrics (objective). The course should be of interest to anyone involved in graphics in a broader sense, given the almost unavoidable need to retarget results to different devices -from developers interested in implementing retargeting techniques, to users that just need an overall perspective. For researchers fully engaged in developing multi-dimensional retargeting techniques, this course will serve as a solid background for future algorithms.

References

[1]

Adams, A., Gelfand, N., Dolson, J., and Levoy, M. 2009. Gaussian kd-trees for fast high-dimensional filtering. ACM Transactions on Graphics (TOG) 28, 3, 1--12.

Digital Library

[2]

Adams, A., Baek, J., and Davis, M. 2010. Fast High-Dimensional Filtering Using the Permutohedral Lattice. Computer Graphics Forum 29, 2, 753--762.

[3]

Akyüz, A. O., Fleming, R., Riecke, B. E., Reinhard, E., and Bülthoff, H. H. 2007. Do hdr displays support ldr content?: a psychophysical evaluation. ACM Trans. Graph. 26, 3, 38.

Digital Library

[4]

Anstis, S. M., and Howard, I. P. 1978. A Craik-O'Brien-Cornsweet illusion for visual depth. Vision Res., 18, 213--217.

[5]

Artamonov, O., 2004. X-bit's guide: Contemporary lcd monitor parameters and characteristics. http://www.xbitlabs.com/articles/monitors/display/lcd-guide_11.html, October.

[6]

Avidan, S., and Shamir, A. 2007. Seam carving for content-aware image resizing. ACM Trans. Graph. 26 (July).

Digital Library

[7]

Aydin, T. O., Mantiuk, R., Myszkowski, K., and Seidel, H.-P. 2008. Dynamic range independent image quality assessment. ACM Trans. Graph. 27, 3, 1--10.

Digital Library

[8]

Aydin, T. O., Čadík, M., Myszkowski, K., and Seidel, H.-P. 2010. Video quality assessment for computer graphics applications. ACM Trans. Graph. 29 (December), 161:1--161:12.

Digital Library

[9]

Banterle, F., Ledda, P., Debattista, K., and Chalmers, A. 2006. Inverse tone mapping. In GRAPHITE '06: Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia, ACM, New York, NY, USA, 349--356.

Digital Library

[10]

Banterle, F., Ledda, P., Debattista, K., Chalmers, A., and Bloj, M. 2007. A framework for inverse tone mapping. The Visual Computer 23, 7, 467--478.

Digital Library

[11]

Banterle, F., Ledda, P., Debattista, K., and Chalmers, A. 2008. Expanding low dynamic range videos for high dynamic range applications. In SCCG '08: Proceedings of the 4th Spring Conference on Computer Graphics, ACM, New York, NY, USA, 349--356.

Digital Library

[12]

Banterle, F., Ledda, P., Debattista, K., Artusi, A., Bloj, M., and Chalmers, A. 2009. A psychophysical evaluation of inverse tone mapping techniques. Computer Graphics Forum 28, 1 (March), 13--25.

[13]

Barten, P. G. 1999. Contrast sensitivity of the human eye and its effects on image quality. SPIE -- The International Society for Optical Engineering.

[14]

Berns, R. S., Motta, R. J., and Gorzynski, M. E. 1993. Crt colorimetry. parti:theory and parctice. Color Research & Applications Journal 18, 299--314.

[15]

1999. Gamut Mapping for Pictorial Images, IS&T - The Society for Imaging Science and Technology.

[16]

1999. General-Purpose Gamut-Mapping Algorithms: Evaluation of Contrast-Preserving Rescaling Functions for Color Gamut Mapping, IS&T - The Society for Imaging Science and Technology.

[17]

Bradshaw, M. F., and Rogers, B. J. 1999. Sensitivity to horizontal and vertical corrugations defined by binocular disparity. Vision Res. 39, 18, 3049--56.

[18]

Brookes, A., and Stevens, K. 1989. The analogy between stereo depth and brightness. Perception 18, 5, 601--614.

[19]

Burr, D. 1987. Implications of the Craik-O'Brien illusion for brightness perception. Vision Resarch 27, 11, 1903--1913.

[20]

Calabria, A. J., and Fairchild, M. D. 2003. Perceived image contrast and observer preference: I. the effects of lightness, chroma, and sharpness manipulations on contrast perception. The Journal of imaging science and technology 47, 6, 479--493.

[21]

Chen, H., Kim, S.-S., Lee, S.-H., Kwon, O.-J., and Sung, J.-H. 2005. Nonlinearity compensated smooth frame insertion for motion-blur reduction in LCD. In Proc. Multimedia Signal Processing, 2005 IEEE 7th Workshop on, 1--4.

[22]

Chen, J., Paris, S., and Durand, F. 2007. Real-time edge-aware image processing with the bilateral grid. ACM Transactions on Graphics (TOG) 26, 3, 103.

Digital Library

[23]

Chiu, K., Herf, M., Shirley, P., Swamy, S., Wang, C., and Zimmerman, K. 1993. Spatially nonuniform scaling functions for high contrast images. In Graphics Interface, Citeseer, 245--253.

[24]

Cutting, J., and Vishton, P. 1995. Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth. In Perception of Space and Motion (Handbook Of Perception And Cognition), Academic Press, W. Epstein and S. Rogers, Eds., 69--117.

[25]

Daly, S. 1993. The visible differences predictor: an algorithm for the assessment of image fidelity. Digital images and human vision, 179.

Digital Library

[26]

Daly, S. 1993. The visible differences predictor: an algorithm for the assessment of image fidelity. Digital images and human vision, 179--206.

Digital Library

[27]

Deeley, R., Drasdo, N., and Charman, W. 1991. A simple parametric model of the human ocular modulation transfer function. Ophthalmic and Physiological Optics 11, 1, 91--93.

[28]

Didyk, P., Mantiuk, R., Hein, M., and Seidel, H.-P. 2008. Enhancement of bright video features for HDR displays. In Proceeding of Eurographics Symposium on Rendering 2008, Eurographics, Blackwell Ltd, Computer Graphics Forum.

Digital Library

[29]

Didyk, P., Eisemann, E., Ritschel, T., Myszkowski, K., and Seidel, H.-P. 2010. Apparent display resolution enhancement for moving images. ACM Transactions on Graphics (Proceedings SIGGRAPH 2010, Los Angeles) 29, 3.

Digital Library

[30]

Didyk, P., Eisemann, E., Ritschel, T., Myszkowski, K., and Seidel, H.-P. 2010. Apparent display resolution enhancement for moving images. ACM Transactions on Graphics (Proceedings SIGGRAPH 2010, Los Angeles) 29, 4.

Digital Library

[31]

Didyk, P., Eisemann, E., Ritschel, T., Myszkowski, K., and Seidel, H.-P. 2010. Perceptually-motivated real-time temporal upsampling of 3D content for high-refresh-rate displays. Computer Graphics Forum (Proceedings Eurographics 2010, Norrköpping, Sweden) 29, 2, 713--722.

[32]

Didyk, P., Ritschel, T., Eiseman, E., Myszkowski, K., and Seidel, H.-P. 2010. Adaptive image-based stereo view synthesis. In Proc. VMV.

[33]

Didyk, P., Ritschel, T., Eisemann, E., Myszkowski, K., and Seidel, H.-P. 2010. Adaptive image-space stereo view synthesis. In Vision, Modeling and Visualization Workshop, 299--306.

[34]

Didyk, P., Ritschel, T., Eisemann, E., Myszkowski, K., and Seidel, H.-P. 2010. A perceptual model for disparity. ACM Transactions on Graphics (Proceedings SIGGRAPH 2011, Vancouver) 30, 4.

Digital Library

[35]

Dooley, R. P., and Greenfield, M. I. 1977. Measurements of edge-induced visual contrast and a spatial-frequency interaction of the cornsweet illusion. Journal of the Optical Society of America 67.

[36]

Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics 21, 3 (July).

Digital Library

[37]

DZmura, M., and Lennie, P. 1986. Mechanisms of color constancy. Journal of the Optical Society of America A 3, 10, 1662--1672.

[38]

Fedorovskaya, E., deRidder, H., and Blommaert, F. 1997. Chroma variations and perceived quality of color images of natural scenes. Color Research and Application 22, 2, 96--110.

[39]

Feng, X.-F., Pan, H., and Daly, S. 2008. Comparisons of motion-blur assessment strategies for newly emergent LCD and backlight driving technologies. Journal of the Society for Information Display 16, 981--988.

[40]

Feng, X.-F. 2006. LCD motion blur analysis, perception, and reduction using synchronized backlight flashing. In Human Vision and Electronic Imaging XI, SPIE, vol. 6057, M1--14.

[41]

Goodman, J. 2005. Introduction To Fourier Optics. Roberts & Co.

[42]

Gorea, A., and Tyler, C. W. 1986. New look at Bloch's law for contrast. Journal of the Optical Society of America A 3, 1, 52--61.

[43]

Green, P. 2000. Defining Colour Gamut Boundaries with a Test Target.

[44]

Herzog, R., Eisemann, E., Myszkowski, K., and Seidel, H.-P. 2010. Spatio-temporal upsampling on the GPU. In Proceedings of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, 91--98.

Digital Library

[45]

Hoffman, D., Girshick, A., Akeley, K., and Banks, M. 2008. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. Journal of vision 8, 3, 1--30.

[46]

Howard, I. P., and Rogers, B. J. 2002. Seeing in Depth, vol. 2: Depth Perception. I. Porteous, Toronto.

[47]

Hullin, M. B., Eisemann, E., Seidel, H.-P., and Lee, S. 2011. Physically-based real-time lens flare rendering. ACM Trans. Graph. (Proc. SIGGRAPH 2011) 30, 4, 108:1--108:9.

Digital Library

[48]

Janssen, R. 2001. Computational Image Quality. SPIE Press.

[49]

Kakimoto, M., Matsuoka, K., Nishita, T., Naemura, T., and Harashima, H. 2005. Glare generation based on wave optics. Computer Graphics Forum 24, 2, 185--193.

[50]

Kakimoto, M., Matsuoka, K., Nishita, T., Naemura, T., and Harashima, H. 2005. Glare simulation and its application to evaluation of bright lights with spectral power distribution. In ACM SIGGRAPH 2005 Posters, ACM, New York, NY, USA, ACM, 42.

Digital Library

[51]

Kalloniatis, M., and Luu, C., 2009. Temporal resolution.

[52]

Karni, Z., Freedman, D., and Gotsman, C. 2009. Energy-based image deformation. In Proceedings of the Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP '09, 1257--1268.

Digital Library

[53]

Kawase, M. 2005. Practical implementation of high dynamic range rendering. In Game Developers Conference.

[54]

Keil, M. S. 2007. Gradient representations and the perception of luminosity. Vision research 47, 27, 3360--3372.

[55]

Kingdom, F., and Moulden, B. 1988. Border effects on brightness: a review of findings, models and issues. Spatial Vision 3, 4, 225--262.

[56]

Kingdom, F. A. A., and Whittle, P. 1996. Contrast discrimination at high contrasts reveals the influence of local light adaptation on contrast processing. Vision Research 36, 6, 817--829.

[57]

Klompenhouwer, M. A., and Velthoven, L. J. 2004. Motion blur reduction for liquid crystal displays: Motion-compensated inverse filtering. In Proceedings of SPIE, vol. 5308, 690.

[58]

Kovaleski, R. P., and Oliveira, M. M. 2009. High-quality brightness enhancement functions for real-time reverse tone mapping. Vis. Comput. 25 (April), 539--547.

Digital Library

[59]

Krähenbühl, P., Lang, M., Hornung, A., and Gross, M. 2009. A system for retargeting of streaming video. In ACM SIGGRAPH Asia 2009 papers, ACM, New York, NY, USA, SIGGRAPH Asia '09, 126:1--126:10.

Digital Library

[60]

Krawczyk, G., Myszkowski, K., and Seidel, H.-P. 2007. Contrast restoration by adaptive countershading. Computer Graphics Forum (Proc. Eurographics 2007) 26, 3, 581--590.

[61]

Kurita, T. 2001. Moving picture quality improvement for hold-type AM-LCDs. In Society for Information Display (SID) '01, 986--989.

[62]

Křivánek, J., Ferwerda, J. A., and Bala, K. 2010. Effects of global illumination approximations on material appearance. In ACM SIGGRAPH 2010 papers, ACM, New York, NY, USA, SIGGRAPH '10, 112:1--112:10.

Digital Library

[63]

Landis, H. 2002. Production-ready global illumination. In Siggraph Course Notes 16.

[64]

Lang, M., Hornung, A., Wang, O., Poulakos, S., Smolic, A., and Gross, M. 2010. Nonlinear disparity mapping for stereoscopic 3D. ACM Trans. Graph. (Proc. SIGGRAPH) 29, 4, 751--760.

Digital Library

[65]

Lin, W., Gai, Y., and Kassim, A. 2006. Perceptual impact of edge sharpness in images. Vision, Image and Signal Processing, IEE Proceedings 152, 2 (April), 215--223.

[66]

Liu, F., Gleicher, M., Jin, H., and Agarwala, A. 2009. Content-preserving warps for 3D video stabilization. ACM Transaction on Graphics (Proceedings SIGGRAPH) 28.

Digital Library

[67]

Livingstone, M. 2002. Vision and Art: The Biology of Seeing. Harry N. Abrams.

[68]

Lubin, J. 1995. A visual discrimination model for imaging system design and development. In Vision models for target detection and recognition, World Scientific, P. E., Ed., 245--283.

[69]

Luebke, D., Watson, B., Cohen, J. D., Reddy, M., and Varshney, A. 2002. Level of Detail for 3D Graphics. Elsevier Science Inc., New York, NY, USA.

Digital Library

[70]

Luft, T., Colditz, C., and Deussen, O. 2006. Image enhancement by unsharp masking the depth buffer. ACM Transactions on Graphics 25, 3, 1206--1213.

Digital Library

[71]

Lunn, P., and Morgan, M. 1995. The analogy between stereo depth and brightness: a reexamination. Perception 24, 8, 901--4.

[72]

1993. Gamut Mapping in Perceptual Colour Space, IS&T - The Society for Imaging Science and Technology.

[73]

Mackay, D. M. 1973. Lateral interaction between neural channels sensitive to texture density? Nature 245, 5421, 159--161.

[74]

Mahajan, D., Huang, F.-C., Matusik, W., Ramamoorthi, R., and Belhumeur, P. 2009. Moving gradients: a path-based method for plausible image interpolation. ACM Trans. Graph. 28 (July), 42:1--42:11.

Digital Library

[75]

Mahajan, D., Huang, F.-C., Matusik, W., Ramamoorthi, R., and Belhumeur, P. 2009. Moving gradients: A path-based method for plausible image interpolation. ACM Transaction on Graphics (Proceedings SIGGRAPH '09) 28, 3.

Digital Library

[76]

Mäkelä, P., Rovamo, J., and Whitaker, D. 1994. Effects of luminance and external temporal noise on flicker sensitivity as a function of stimulus size at various eccentricities. Vision Research 34, 15, 1981--91.

[77]

Mantiuk, R., Krawczyk, G., Myszkowski, K., and Seidel, H.-P. 2004. Perception-motivated high dynamic range video encoding. ACM Transactions on Graphics (Proc. of SIGGRAPH) 23, 3 (Aug.), 733.

Digital Library

[78]

Mantiuk, R., Myszkowski, K., and Seidel, H.-P. 2004. Visible difference predicator for high dynamic range images. In Proceedings of IEEE International Conference on Systems, Man and Cybernetics, 2763--2769.

[79]

Mantiuk, R., Daly, S., Myszkowski, K., and Seidel, H. 2005. Predicting visible differences in high dynamic range images: model and its calibration. Proc. SPIE.

[80]

Mantiuk, R., Daly, S., Myszkowski, K., and Seidel, H.-P. 2005. Predicting visible differences in high dynamic range images - model and its calibration. In Human Vision and Electronic Imaging X, IST SPIE's 17th Annual Symposium on Electronic Imaging, B. E. Rogowitz, T. N. Pappas, and S. J. Daly, Eds., vol. 5666, 204--214.

[81]

Mantiuk, R., Mantiuk, R., Tomaszweska, A., and Heidrich, W. 2009. Color correction for tone mapping. Prooceedings of Eurographics 2009 28, 2.

[82]

Mark, W. R., McMillan, L., and Bishop, G. 1997. Post-rendering 3D warping. In Proceedings of the 1997 symposium on Interactive 3D graphics, 7--16.

Digital Library

[83]

Masia, B., Agustin, S., Fleming, R. W., Sorkine, O., and Gutierrez, D. 2009. Evaluation of reverse tone mapping through varying exposure conditions. ACM Trans. Graph. 28, 5, 1--8.

Digital Library

[84]

McCann, J. J. 2005. Do humans discount the illuminant? In Proceedings of SPIE, SPIE, vol. 5666, 5666--9.

[85]

Meylan, L., Daly, S., and Süsstrunk, S. 2006. The Reproduction of Specular Highlights on High Dynamic Range Displays. In IST/SID 14th Color Imaging Conference.

[86]

Meylan, L., Daly, S., and Süsstrunk, S. 2007. Tone Mapping For High Dynamic Range Displays. In Electronic Imaging, vol. 6492.

[87]

Moon, P., and Spencer, D. E. 1944. On the Stiles-Crawford Effect. Journal of the Optical Society of America 34, 6 (June), 319--329.

[88]

Morovic, J., and R, L. M. 2000. Calculating medium and image gamut boundaries for gamut mapping. Color Research & Applications Journal 25, 394--401.

[89]

Morovic, J. 1998. To Develop a Universal Gamut Mapping Algorithm.

[90]

Nakamae, E., Kaneda, K., Okamoto, T., and Nishita, T. 1990. A lighting model aiming at drive simulators. In Proceedings of the 17th Annual Conference on Computer Graphics and Interactive Techniques, ACM, vol. 24, 395--404.

Digital Library

[91]

Nehab, D. F., Sander, P. V., Lawrence, J., Tatarchuk, N., and Isidoro, J. 2007. Accelerating realtime shading with reverse reprojection caching. In Proceedings of the 22nd ACM SIGGRAPH/EUROGRAPHICS symposium on Graphics hardware, Eurographics Association, 25--35.

Digital Library

[92]

2004. Interactive Perception Based Model for Characterization of Display device, IS&T - The Society for Imaging Science and Technology.

[93]

Neumann, A., Artusi, A., Zotti, G., Neumann, L., and Purgathofer, W. 2007. Accurate display gamma functions based on human observation. Color Research & Applications Journal 32, 310--319.

[94]

Nicolas Bonnier, Francis Schmitt, M. H., and Leynadier, C. 2007. Spatial and color adaptive gamut mapping: A mathematical framework and two new algorithms. Proc. of the 15th Color Imaging Conference, 267--272.

[95]

Oppenheim, A., Schafer, R., and Stockham, T. 1968. Nonlinear filtering of multiplied and convolved signals. Proceedings of the IEEE 56, 8, 1264--1291.

[96]

Pajak, D., Herzog, R., Eisemann, E., Myszkowski, K., and Seidel, H.-P. 2011. Scalable remote rendering with depth and motion-flow augmented streaming. Computer Graphics Forum 30, 2, 415--424.

[97]

Palmer, S. E. 1999. Vision Science: Photons to Phenomenology. The MIT Press.

[98]

Pan, H., Feng, X.-F., and Daly, S. 2005. LCD motion blur modeling and analysis. In Proc. ICIP, 21--24.

[99]

Paris, S., and Durand, F. 2009. A fast approximation of the bilateral filter using a signal processing approach. International journal of computer vision 81, 1, 24--52.

Digital Library

[100]

Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Transaction on Graphics 22, 3, 313--318.

Digital Library

[101]

Poynton, C. 1993. "gamma" and its disguises: The nonlinear mappings of intensity in perception, crts, film and video. SMPTE Journal 102, 1099--1108.

[102]

Pratt, W. K. 1991. Digital image processing (2nd ed.). John Wiley & Sons, Inc., New York, USA.

Digital Library

[103]

Pritch, Y., Kav-Venaki, E., and Peleg, S. 2009. Shift-map image editing. In ICCV'09, 151--158.

[104]

Purves, D., Shimpi, A., and Lotto, R. 1999. An empirical explanation of the Cornsweet effect. The Journal of Neuroscience 19, 19, 8542--8551.

[105]

Ramanarayanan, G., Ferwerda, J., Walter, B., and Bala, K. 2007. Visual Equivalence: Towards a new standard for Image Fidelity. ACM Transactions on Graphics (Proc. of SIGGRAPH) 26, 3. Article 76.

Digital Library

[106]

Ratliff, F. 1971. Contour and contrast. Proceedings of the American Philosophical Society 115, 2, 150--163.

[107]

Rempel, A. G., Trentacoste, M., Seetzen, H., Young, H. D., Heidrich, W., Whitehead, L., and Ward, G. 2007. Ldr2hdr: on-the-fly reverse tone mapping of legacy video and photographs. ACM Trans. Graph. 26, 3, 39.

Digital Library

[108]

Ritschel, T., Smith, K., Ihrke, M., Grosch, T., Myszkowski, K., and Seidel, H.-P. 2008. 3D unsharp masking for scene coherent enhancement. ACM Transactions on Graphics (Proc. SIGGRAPH) 27 (August), 90:1--90:8.

Digital Library

[109]

Ritschel, T., Ihrke, M., Frisvad, J. R., Coppens, J., Myszkowski, K., and Seidel, H.-P. 2009. Temporal glare: Real-time dynamic simulation of the scattering in the human eye. Computer Graphics Forum (Proc. EUROGRAPHICS 2009) 28, 3 (March), 183--192.

[110]

Rogers, B., and Graham, M. 1983. Anisotropies in the perception of three-dimensional surfaces. Science 221, 4618, 1409--11.

[111]

Rokita, P. 1993. A model for rendering high intensity lights. Computers & graphics 17, 4, 431--437.

[112]

Rubinstein, M., Shamir, A., and Avidan, S. 2008. Improved seam carving for video retargeting. ACM Trans. Graph. 27 (August), 16:1--16:9.

Digital Library

[113]

Rubinstein, M., Shamir, A., and Avidan, S. 2009. Multi-operator media retargeting. ACM Trans. Graph. 28 (July), 23:1--23:11.

Digital Library

[114]

Rubinstein, M., Gutierrez, D., Sorkine, O., and Shamir, A. 2010. A comparative study of image retargeting. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 29, 5.

Digital Library

[115]

Scherzer, D., Yang, L., Mattausch, O., Nehab, D., Sander, P. V., Wimmer, M., and Eisemann, E. 2011. A survey on temporal coherence methods in real-time rendering. In In State of the Art Reports Eurographics. May 2010.,

[116]

Seshadrinathan, K., and Bovik, A. 2007. A structural similarity metric for video based on motion models. In Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on, vol. 1, I-869--I-872.

[117]

Shi, L., Wang, J., Duan, L., and Lu, H. 2009. Consumer video retargeting: context assisted spatial-temporal grid optimization. In Proceedings of the seventeen ACM international conference on Multimedia, ACM, New York, NY, USA, MM '09, 301--310.

Digital Library

[118]

Simpson, G. 1953. Ocular haloes and coronas. British Journal of Ophthalmology 37, 8, 450--486.

[119]

Sitthi-amorn, P., Lawrence, J., Yang, L., Sander, P. V., Nehab, D., and Xi, J. 2008. Automated reprojection-based pixel shader optimization.

[120]

Smith, K., Krawczyk, G., Myszkowski, K., and Seidel, H.-P. 2006. Beyond tone mapping: Enhanced depiction of tone mapped HDR images. In EUROGRAPHICS 2006 (EG'06), Blackwell, Vienna, Austria, E. Gröller and L. Szirmay-Kalos, Eds., vol. 25 of Computer Graphics Forum, Eurographics, 427--438.

[121]

Smith, K., Krawczyk, G., Myszkowski, K., and Seidel, H.-P. 2006. Beyond tone mapping: Enhanced depiction of tone mapped HDR images. Computer Graphics Forum (Proc. of EUROGRAPHICS) 25, 3, 427--438.

[122]

Smith, K., Landes, P.-E., Thollot, J., and Myszkowski, K. 2008. Apparent greyscale: A simple and fast conversion to perceptually accurate images and video. Computer Graphics Forum (Proc. EUROGRAPHICS) 27, 2, 193--200.

[123]

Smith, K. 2008. Contours and Contrast. PhD thesis, MPI Informatik, Saarbruecken, Germany.

[124]

Spencer, G., Shirley, P., Zimmerman, K., and Greenberg, D. P. 1995. Physically-based glare effects for digital images. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, ACM, 325--334.

Digital Library

[125]

Stevens, J., and Stevens, S. 1963. Brightness function: Effects of adaptation. JOSA.

[126]

Stich, T., Linz, C., Wallraven, C., Cunningham, D., and Magnor, M. 2011. Perception-motivated interpolation of image sequences. ACM Transactions on Applied Perception (TAP) 8, 2, 11:1--11:25.

Digital Library

[127]

Templin, K., Didyk, P., Ritschel, T., Eisemann, E., Myszkowski, K., and Seidel, H.-P. 2011. Apparent resolution enhancement for animations. In 27th Spring Conference on Computer Graphics, 85--92.

Digital Library

[128]

Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In International Conference on Computer Vision, Narosa Publishing House, 839--846.

Digital Library

[129]

Tyler, C. W. 1975. Spatial organization of binocular disparity sensitivity. Vision Res. 15, 5, 583--590.

[130]

van den Berg, T. J. T. P., Hagenouw, M. P. J., and Coppens, J. E. 2005. The ciliary corona: Physical model and simulation of the fine needles radiating from point light sources. Investigative Ophthalmology and Visual Science 46, 2627--2632.

[131]

Vos, J. J., and Boogaard, J. 1963. Contribution of the Cornea to Entoptic Scatter. Journal of the Optical Society of America 53, 7 (July), 869--873.

[132]

Walter, B., Drettakis, G., and Parker, S. 1999. Interactive rendering using the render cache. In Proceedings of the 10th Eurographics Workshop on Rendering, vol. 10, Citeseer, 235--246.

Digital Library

[133]

Wang, Z., and Bovik, A. C. 2002. A universal image quality index. IEEE Signal Processing Letters 9, 3 (March), 81--84.

[134]

Wang, Z., and Bovik, A. C. 2006. Modern Image Quality Assessment. Morgan & Claypool Publishers.

[135]

Wang, L., Wei, L.-Y., Zhou, K., Guo, B., and Shum, H.-Y. 2007. High dynamic range image hallucination. In Proceedings of Eurographics Symposium on Rendering.

Digital Library

[136]

Wang, Y.-S., Tai, C.-L., Sorkine, O., and Lee, T.-Y. 2008. Optimized scale-and-stretch for image resizing. In ACM SIGGRAPH Asia 2008 papers, ACM, New York, NY, USA, SIGGRAPH Asia '08, 118:1--118:8.

Digital Library

[137]

Wang, Y.-S., Fu, H., Sorkine, O., Lee, T.-Y., and Seidel, H.-P. 2009. Motion-aware temporal coherence for video resizing. ACM Trans. Graph. 28 (December), 127:1--127:10.

Digital Library

[138]

Wang, Y.-S., Lin, H.-C., Sorkine, O., and Lee, T.-Y. 2010. Motion-based video retargeting with optimized crop-and-warp. ACM Trans. Graph. 29 (July), 90:1--90:9.

Digital Library

[139]

Westheimer, G. 1986. The eye as an optical instrument. In Handbook of Perception and Human Performance: 1. Sensory Processes and Perception, K. Boff, L. Kaufman, and J. Thomas, Eds. Wiley, New York, 4.1--4.20.

[140]

Whittle, P. 1986. Increments and decrements: Luminance discrimination. Vision Research 26, 10, 1677--1691.

[141]

Wolberg, G. 1998. Image morphing: A survey. The Visual Computer 14, 8.

[142]

Wolf, L., Guttmann, M., and Cohen-Or, D. 2007. Non-homogeneous content-driven video-retargeting. In Proceedings of the Eleventh IEEE International Conference on Computer Vision (ICCV-07).

[143]

Wüller, D., and Gabele, H. 2007. The usage of digital cameras as luminance meters. In Proceedings of SPIE, SPIE, vol. 6502, 65020U-65020U-11.

[144]

Yoshida, A., Mantiuk, R., Myszkowski, K., and Seidel, H.-P. 2006. Analysis of reproducing real-world appearance on displays of varying dynamic range. Computer Graphics Forum (Proc. EUROGRAPHICS 2006) 25, 3 (March), 415--426.

[145]

Yoshida, A., Ihrke, M., Mantiuk, R., and Seidel, H.-P. 2008. Brightness of the glare illusion. In Proceedings of the ACM Symposium on Applied Perception in Graphics and Visualization, ACM, 83--90.

Digital Library

[146]

Zavagno, D., and Caputo, G. 2001. The glare effect and the perception of luminosity. Perception 30, 2, 209--222.

[147]

Zavagno, D. 1999. Some new luminance-gradient effects. Perception 28, 835--838.

Cited By

Miyashita YSawahata YSakai AHarasawa MHara KMorita TKomine K(2022)Display-Size Dependent Effects of 3D Viewing on Subjective ImpressionsACM Transactions on Applied Perception10.1145/351046119:2(1-15)Online publication date: 11-Jul-2022
https://dl.acm.org/doi/10.1145/3510461
Wetzstein GPatney ASun Q(2020)State of the Art in Perceptual VR DisplaysReal VR – Immersive Digital Reality10.1007/978-3-030-41816-8_9(221-243)Online publication date: 3-Mar-2020
https://doi.org/10.1007/978-3-030-41816-8_9
Wetzstein G(2020)Augmented and Virtual RealityNANO-CHIPS 203010.1007/978-3-030-18338-7_25(467-499)Online publication date: 9-Jun-2020
https://doi.org/10.1007/978-3-030-18338-7_25
Show More Cited By

Index Terms

Multidimensional image retargeting
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
  2. Computer graphics
    1. Image manipulation

Index terms have been assigned to the content through auto-classification.

Recommendations

Artist friendly facial animation retargeting

This paper presents a novel facial animation retargeting system that is carefully designed to support the animator's workflow. Observation and analysis of the animators' often preferred process of key-frame animation with blendshape models informed our ...
Rig-space motion retargeting
EG '16: Proceedings of the 37th Annual Conference of the European Association for Computer Graphics: Posters

This paper presents a framework for transferring rig parameters from a source animation to a target model, allowing artists to further refine and adjust the animation. Most previous methods only transfer animations to meshes or joint parameters. However,...
Artist friendly facial animation retargeting
SA '11: Proceedings of the 2011 SIGGRAPH Asia Conference

This paper presents a novel facial animation retargeting system that is carefully designed to support the animator's workflow. Observation and analysis of the animators' often preferred process of key-frame animation with blendshape models informed our ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SA '11: SIGGRAPH Asia 2011 Courses

December 2011

2474 pages

ISBN:9781450311359

DOI:10.1145/2077434

Conference Chair:
Pedro Sander
Hong Kong University of Science and Technology

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SA '11

Sponsor:

SIGGRAPH

SA '11: SIGGRAPH Asia 2011

December 12 - 15, 2011

Hong Kong, China

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
1,193
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Miyashita YSawahata YSakai AHarasawa MHara KMorita TKomine K(2022)Display-Size Dependent Effects of 3D Viewing on Subjective ImpressionsACM Transactions on Applied Perception10.1145/351046119:2(1-15)Online publication date: 11-Jul-2022
https://dl.acm.org/doi/10.1145/3510461
Wetzstein GPatney ASun Q(2020)State of the Art in Perceptual VR DisplaysReal VR – Immersive Digital Reality10.1007/978-3-030-41816-8_9(221-243)Online publication date: 3-Mar-2020
https://doi.org/10.1007/978-3-030-41816-8_9
Wetzstein G(2020)Augmented and Virtual RealityNANO-CHIPS 203010.1007/978-3-030-18338-7_25(467-499)Online publication date: 9-Jun-2020
https://doi.org/10.1007/978-3-030-18338-7_25
Zhou YZhang LZhang CLi PLi X(2018)Perceptually Aware Image Retargeting for Mobile DevicesIEEE Transactions on Image Processing10.1109/TIP.2017.277927227:5(2301-2313)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1109/TIP.2017.2779272
Patel VShah PRaman S(2018)A Generative Adversarial Network for Tone Mapping HDR ImagesComputer Vision, Pattern Recognition, Image Processing, and Graphics10.1007/978-981-13-0020-2_20(220-231)Online publication date: 26-Apr-2018
https://doi.org/10.1007/978-981-13-0020-2_20
Masia BSerrano AGutierrez D(2017)Dynamic range expansion based on image statisticsMultimedia Tools and Applications10.5555/3048137.304818176:1(631-648)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.5555/3048137.3048181
Liu ZWang ZZhang LShah RXia YYang YLi XLiu QLienhart RWang HChen SBoll SChen PFriedland GLi JYan S(2017)FastShrinkageProceedings of the 25th ACM international conference on Multimedia10.1145/3123266.3123377(501-509)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3123266.3123377
Liang YLiu YGutierrez D(2017)Objective Quality Prediction of Image Retargeting AlgorithmsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2016.251764123:2(1099-1110)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1109/TVCG.2016.2517641
Zhang YNgan KMa LLi H(2017)Objective Quality Assessment of Image Retargeting by Incorporating Fidelity Measures and Inconsistency DetectionIEEE Transactions on Image Processing10.1109/TIP.2017.274626026:12(5980-5993)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1109/TIP.2017.2746260
Wu GMasia BJarabo AZhang YWang LDai QChai TLiu Y(2017)Light Field Image Processing: An OverviewIEEE Journal of Selected Topics in Signal Processing10.1109/JSTSP.2017.274712611:7(926-954)Online publication date: Oct-2017
https://doi.org/10.1109/JSTSP.2017.2747126
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten