skip to main content
research-article

Display supersampling

Published:09 February 2009Publication History
Skip Abstract Section

Abstract

Supersampling is widely used by graphics hardware to render anti-aliased images. In conventional supersampling, multiple scene samples are computationally combined to produce a single screen pixel. We consider a novel imaging paradigm that we call display supersampling, where multiple display samples are physically combined via the superimposition of multiple image subframes. Conventional anti-aliasing and texture mapping techniques are shown inadequate for the task of rendering high-quality images on supersampled displays. Instead of requiring anti-aliasing filters, supersampled displays actually require alias generation filters to cancel the aliasing introduced by nonuniform sampling. We present fundamental theory and efficient algorithms for the real-time rendering of high-resolution anti-aliased images on supersampled displays. We show that significant image quality gains are achievable by taking advantage of display supersampling. We prove that alias-free resolution beyond the Nyquist limits of a single subframe may be achieved by designing a bank of alias-canceling rendering filters. In addition, we derive a practical noniterative filter bank approach to real-time rendering and discuss implementations on commodity graphics hardware.

References

  1. Akenine-Möller, T. and Haines, E. 2002. Real-Time Rendering. A. K. Peters Ltd., Natick, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Allen, W. and Ulichney, R. 2005. Wobulation: Doubling the addressed resolution of projection displays. In Proceedings of the SID Symposium Digest of Technical Papers (SID). Boston, MA, 1514--1517.Google ScholarGoogle Scholar
  3. Baker, S. and Kanade, T. 2002. Limits on super-resolution and how to break them. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1167--1183. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Ben-Ezra, M., Zomet, A., and Nayar, S. 2004. Jitter camera: High resolution video from a low resolution detector. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 135--142. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Brown, M., Majumder, A., and Yang, R. 2005. Camera-Based calibration techniques for seamless multiprojector displays. IEEE Trans. Visual. Comput. Graphics 11, 193--206. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Chang, N. L. 2003. Efficient dense correspondences using temporally encoded light patterns. In Proceedings of the IEEE International Workshop on Projector-Camera Systems (ProCams).Google ScholarGoogle Scholar
  7. Chang, N. L. 2004. Creating interactive 3-D media with projector-camera system. In Proceedings of the SPIE Visual Communications and Image Processing Conference (VCIP), vol. 5308, 850--861.Google ScholarGoogle ScholarCross RefCross Ref
  8. Cook, R. 1986. Stochastic sampling in computer graphics. ACM Trans. Comput. Graphics 5, 51--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Crow, F. 1981. A comparison of antialiasing techniques. IEEE Comput. Graphics Appl. 1, 40--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Damera-Venkata, N. and Chang, N. L. 2007a. On the resolution limits of superimposed projection. In Proceedings of the IEEE International Conference on Image Processing (ICIP), vol. V., 373--376.Google ScholarGoogle Scholar
  11. Damera-Venkata, N. and Chang, N. L. 2007b. Realizing super-resolution with superimposed projection. In Proceedings of the IEEE International Workshop on Projector-Camera Systems (ProCams).Google ScholarGoogle Scholar
  12. Damera-Venkata, N., Chang, N. L., and DiCarlo, J. M. 2007. A unified paradigm for scalable multi-projector displays. IEEE Trans. Visualiz. Comput. Graphics (Proceedings of the IEEE Visualization/Information Visualization Conference) 13, 6, 1360--1367. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Deering, M., Winner, S., Schediwy, B., Doffy, C., and Hunt, N. 1988. The triangle processor and normal vector shader: A VLSI system for high performance graphics. In Proceedings of SIGGRAPH Computer Graphics Conference, 21--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Dippe, M. and Wold, E. 1985. Antialiasing through stochastic sampling. In Proceedings of SIGGRAPH, Computer Graphics Conference, 69--78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Elad, M. and Feuer, A. 1997. Restoration of single super-resolution image from several blurred, noisy and down-sampled measured images. IEEE Trans. Image Process. 6, 1646--1658. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Eldar, Y. and Oppenheim, A. 2000. Filterbank reconstruction of bandlimited signals from nonuniform and generalized samples. IEEE Trans. Signal Process 48, 2864--2875. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Fuchs, H., Goldfeather, J., Hillquist, J. P., Spach, S., Austin, J. D., Brooks, F. P., Eyles, J. G., and Poulton, J. 1985. Fast spheres, shadows, textures, transparencies, and image enhancements in pixel-planes. In Proceedings of SIGGRAPH Computer Graphics Conference, 111--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Haeberli, P. and Akeley, K. 1990. The accumulation buffer: Hardware support for high-quality rendering. In Proceedings of SIGGRAPH Computer Graphics Conference, 309--318. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Harville, M., Culbertson, B., Sobel, I., Gelb, D., Fitzhugh, A., and Tanguay, D. 2006. Practical methods for geometric and photometric correction of tiled projector displays on curved surfaces. In Proceedings of the IEEE International Workshop on Projector-Camera Systems (ProCams), 52--59.Google ScholarGoogle Scholar
  20. Heckbert, P. 1986. A survey of texture mapping. IEEE Comput. Graphics Appl. 6, 56--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Heckbert, P. 1989. Fundamentals of texture mapping and image warping. M.S. thesis, The University of California at Berkeley, Berkeley, California.Google ScholarGoogle Scholar
  22. Irani, M. and Peleg, S. 1990. Super resolution from image sequences. In Proceedings of the 10th International Conference on Pattern Recognition, 115--120.Google ScholarGoogle Scholar
  23. Jaynes, C. and Ramakrishnan, D. 2003. Super-Resolution composition in multi-projector displays. In Proceedings of the IEEE International Workshop on Projector-Camera Systems (ProCams).Google ScholarGoogle Scholar
  24. Jiang, Z., Wong, T., and Bao, H. 2003. Practical super-resolution from dynamic video sequences. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 549--554.Google ScholarGoogle Scholar
  25. Lin, H. and Shum, H. 2004. Fundamental limits of reconstruction-based superresolution algorithms under local translation. IEEE Trans. Pattern Anal. Mach. Intell. 26, 83--97. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Majumder, A. 2005. Is spatial super-resolution feasible using overlapping projectors? In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 209--212.Google ScholarGoogle Scholar
  27. Majumder, A. and Stevens, R. 2005. Perceptual photometric seamlessness in tiled projection-based displays. ACM Trans. Graphics 24, 111--134. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Marvasti, F., Analoui, M., and Gamshadzahi, M. 1991. Recovery of signals from nonuniform samples using iterative methods. IEEE Trans. Signal Process. 39, 872--877.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Mitchell, D. 1987. Generating antialiased images at low sampling densities. Comput. Graphics 21, 65--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Oppenheim, A. and Schafer, R. 1989. Discrete-Time Signal Processing. Prentice-Hall, Englewood-Cliffs, NJ. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Park, S., Park, M., and Kang, M. 2003. Super-Resolution image reconstruction: A technical overview. IEEE Signal Process. Mag. 20, 21--36.Google ScholarGoogle ScholarCross RefCross Ref
  32. Raskar, R., Brown, M. S., Yang, R., Chen, W., Welch, G., and Towles, H. 1999. Multi-Projector displays using camera-based registration. In Proceedings of the IEEE Visualization Conference, 161--522. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Said, A. 2006. Analysis of subframe generation for superimposed images. In Proceedings of the IEEE International Conference on Image Processing (ICIP), 401--404.Google ScholarGoogle ScholarCross RefCross Ref
  34. Strang, G. and Nguyen, T. 1996. Wavelets and Filter Banks. Wellesley-Cambridge, Cambridge, MA.Google ScholarGoogle Scholar
  35. Surati, R. 1999. Scalable self-calibrating display technology for seamless large-scale displays. Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, Massachusetts. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Wang, L., Kang, S., Szeliski, R., and Shum, H. 2001. Optimal texture map reconstruction from multiple views. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 347--354. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Yao, K. and Thomas, J. 1967. On some stability and interpolatory properties of non-uniform sampling expansions. IEEE Trans. Circ. Theory 14, 404--408.Google ScholarGoogle ScholarCross RefCross Ref
  38. Zomet, A., Rav-Acha, A., and Peleg, S. 2001. Robust super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 645--650.Google ScholarGoogle Scholar

Index Terms

  1. Display supersampling

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Graphics
        ACM Transactions on Graphics  Volume 28, Issue 1
        January 2009
        144 pages
        ISSN:0730-0301
        EISSN:1557-7368
        DOI:10.1145/1477926
        Issue’s Table of Contents

        Copyright © 2009 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 9 February 2009
        • Accepted: 1 December 2008
        • Revised: 1 September 2008
        • Received: 1 February 2007
        Published in tog Volume 28, Issue 1

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader