Abstract
Supersampling is widely used by graphics hardware to render anti-aliased images. In conventional supersampling, multiple scene samples are computationally combined to produce a single screen pixel. We consider a novel imaging paradigm that we call display supersampling, where multiple display samples are physically combined via the superimposition of multiple image subframes. Conventional anti-aliasing and texture mapping techniques are shown inadequate for the task of rendering high-quality images on supersampled displays. Instead of requiring anti-aliasing filters, supersampled displays actually require alias generation filters to cancel the aliasing introduced by nonuniform sampling. We present fundamental theory and efficient algorithms for the real-time rendering of high-resolution anti-aliased images on supersampled displays. We show that significant image quality gains are achievable by taking advantage of display supersampling. We prove that alias-free resolution beyond the Nyquist limits of a single subframe may be achieved by designing a bank of alias-canceling rendering filters. In addition, we derive a practical noniterative filter bank approach to real-time rendering and discuss implementations on commodity graphics hardware.
- Akenine-Möller, T. and Haines, E. 2002. Real-Time Rendering. A. K. Peters Ltd., Natick, MA. Google ScholarDigital Library
- Allen, W. and Ulichney, R. 2005. Wobulation: Doubling the addressed resolution of projection displays. In Proceedings of the SID Symposium Digest of Technical Papers (SID). Boston, MA, 1514--1517.Google Scholar
- Baker, S. and Kanade, T. 2002. Limits on super-resolution and how to break them. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1167--1183. Google ScholarDigital Library
- Ben-Ezra, M., Zomet, A., and Nayar, S. 2004. Jitter camera: High resolution video from a low resolution detector. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 135--142. Google ScholarDigital Library
- Brown, M., Majumder, A., and Yang, R. 2005. Camera-Based calibration techniques for seamless multiprojector displays. IEEE Trans. Visual. Comput. Graphics 11, 193--206. Google ScholarDigital Library
- Chang, N. L. 2003. Efficient dense correspondences using temporally encoded light patterns. In Proceedings of the IEEE International Workshop on Projector-Camera Systems (ProCams).Google Scholar
- Chang, N. L. 2004. Creating interactive 3-D media with projector-camera system. In Proceedings of the SPIE Visual Communications and Image Processing Conference (VCIP), vol. 5308, 850--861.Google ScholarCross Ref
- Cook, R. 1986. Stochastic sampling in computer graphics. ACM Trans. Comput. Graphics 5, 51--72. Google ScholarDigital Library
- Crow, F. 1981. A comparison of antialiasing techniques. IEEE Comput. Graphics Appl. 1, 40--48. Google ScholarDigital Library
- Damera-Venkata, N. and Chang, N. L. 2007a. On the resolution limits of superimposed projection. In Proceedings of the IEEE International Conference on Image Processing (ICIP), vol. V., 373--376.Google Scholar
- Damera-Venkata, N. and Chang, N. L. 2007b. Realizing super-resolution with superimposed projection. In Proceedings of the IEEE International Workshop on Projector-Camera Systems (ProCams).Google Scholar
- Damera-Venkata, N., Chang, N. L., and DiCarlo, J. M. 2007. A unified paradigm for scalable multi-projector displays. IEEE Trans. Visualiz. Comput. Graphics (Proceedings of the IEEE Visualization/Information Visualization Conference) 13, 6, 1360--1367. Google ScholarDigital Library
- Deering, M., Winner, S., Schediwy, B., Doffy, C., and Hunt, N. 1988. The triangle processor and normal vector shader: A VLSI system for high performance graphics. In Proceedings of SIGGRAPH Computer Graphics Conference, 21--30. Google ScholarDigital Library
- Dippe, M. and Wold, E. 1985. Antialiasing through stochastic sampling. In Proceedings of SIGGRAPH, Computer Graphics Conference, 69--78. Google ScholarDigital Library
- Elad, M. and Feuer, A. 1997. Restoration of single super-resolution image from several blurred, noisy and down-sampled measured images. IEEE Trans. Image Process. 6, 1646--1658. Google ScholarDigital Library
- Eldar, Y. and Oppenheim, A. 2000. Filterbank reconstruction of bandlimited signals from nonuniform and generalized samples. IEEE Trans. Signal Process 48, 2864--2875. Google ScholarDigital Library
- Fuchs, H., Goldfeather, J., Hillquist, J. P., Spach, S., Austin, J. D., Brooks, F. P., Eyles, J. G., and Poulton, J. 1985. Fast spheres, shadows, textures, transparencies, and image enhancements in pixel-planes. In Proceedings of SIGGRAPH Computer Graphics Conference, 111--120. Google ScholarDigital Library
- Haeberli, P. and Akeley, K. 1990. The accumulation buffer: Hardware support for high-quality rendering. In Proceedings of SIGGRAPH Computer Graphics Conference, 309--318. Google ScholarDigital Library
- Harville, M., Culbertson, B., Sobel, I., Gelb, D., Fitzhugh, A., and Tanguay, D. 2006. Practical methods for geometric and photometric correction of tiled projector displays on curved surfaces. In Proceedings of the IEEE International Workshop on Projector-Camera Systems (ProCams), 52--59.Google Scholar
- Heckbert, P. 1986. A survey of texture mapping. IEEE Comput. Graphics Appl. 6, 56--67. Google ScholarDigital Library
- Heckbert, P. 1989. Fundamentals of texture mapping and image warping. M.S. thesis, The University of California at Berkeley, Berkeley, California.Google Scholar
- Irani, M. and Peleg, S. 1990. Super resolution from image sequences. In Proceedings of the 10th International Conference on Pattern Recognition, 115--120.Google Scholar
- Jaynes, C. and Ramakrishnan, D. 2003. Super-Resolution composition in multi-projector displays. In Proceedings of the IEEE International Workshop on Projector-Camera Systems (ProCams).Google Scholar
- Jiang, Z., Wong, T., and Bao, H. 2003. Practical super-resolution from dynamic video sequences. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 549--554.Google Scholar
- Lin, H. and Shum, H. 2004. Fundamental limits of reconstruction-based superresolution algorithms under local translation. IEEE Trans. Pattern Anal. Mach. Intell. 26, 83--97. Google ScholarDigital Library
- Majumder, A. 2005. Is spatial super-resolution feasible using overlapping projectors? In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 209--212.Google Scholar
- Majumder, A. and Stevens, R. 2005. Perceptual photometric seamlessness in tiled projection-based displays. ACM Trans. Graphics 24, 111--134. Google ScholarDigital Library
- Marvasti, F., Analoui, M., and Gamshadzahi, M. 1991. Recovery of signals from nonuniform samples using iterative methods. IEEE Trans. Signal Process. 39, 872--877.Google ScholarDigital Library
- Mitchell, D. 1987. Generating antialiased images at low sampling densities. Comput. Graphics 21, 65--72. Google ScholarDigital Library
- Oppenheim, A. and Schafer, R. 1989. Discrete-Time Signal Processing. Prentice-Hall, Englewood-Cliffs, NJ. Google ScholarDigital Library
- Park, S., Park, M., and Kang, M. 2003. Super-Resolution image reconstruction: A technical overview. IEEE Signal Process. Mag. 20, 21--36.Google ScholarCross Ref
- Raskar, R., Brown, M. S., Yang, R., Chen, W., Welch, G., and Towles, H. 1999. Multi-Projector displays using camera-based registration. In Proceedings of the IEEE Visualization Conference, 161--522. Google ScholarDigital Library
- Said, A. 2006. Analysis of subframe generation for superimposed images. In Proceedings of the IEEE International Conference on Image Processing (ICIP), 401--404.Google ScholarCross Ref
- Strang, G. and Nguyen, T. 1996. Wavelets and Filter Banks. Wellesley-Cambridge, Cambridge, MA.Google Scholar
- Surati, R. 1999. Scalable self-calibrating display technology for seamless large-scale displays. Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, Massachusetts. Google ScholarDigital Library
- Wang, L., Kang, S., Szeliski, R., and Shum, H. 2001. Optimal texture map reconstruction from multiple views. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 347--354. Google ScholarDigital Library
- Yao, K. and Thomas, J. 1967. On some stability and interpolatory properties of non-uniform sampling expansions. IEEE Trans. Circ. Theory 14, 404--408.Google ScholarCross Ref
- Zomet, A., Rav-Acha, A., and Peleg, S. 2001. Robust super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 645--650.Google Scholar
Index Terms
- Display supersampling
Recommendations
Amortized supersampling
We present a real-time rendering scheme that reuses shading samples from earlier time frames to achieve practical antialiasing of procedural shaders. Using a reprojection strategy, we maintain several sets of shading estimates at subpixel precision, and ...
High-quality shear-warp volume rendering using efficient supersampling and pre-integration technique
ICAT'06: Proceedings of the 16th international conference on Advances in Artificial Reality and Tele-ExistenceAs shear-warp volume rendering is the fastest rendering method, image quality is not good as that of other high-quality rendering methods. In this paper, we propose two methods to improve the image quality of shear-warp volume rendering. First, the ...
Error estimation for many-light rendering with supersampling
SA '18: SIGGRAPH Asia 2018 Technical BriefsMany-light rendering unifies the computation of various visual and illumination effects, which include anti-aliasing, depth of field, volumetric scattering, and subsurface scattering, into a simple direct illumination computation from many virtual point ...
Comments