Skip to main content
SpringerLink
Log in

Lumiproxy: A Hybrid Representation of Image-Based Models

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

In this paper, we present a hybrid representation of image-based models combining the textured planes and the hierarchical points. Taking a set of depth images as input, our method starts from classifying input pixels into two categories, indicating the planar and non-planar surfaces respectively. For the planar surfaces, the geometric coefficients are reconstructed to form the uniformly sampled textures. For nearly planar surfaces, some textured planes, called lumiproxies, are constructed to represent the equivalent visual appearance. The Hough transform is used to find the positions of these textured planes, and optic flow measures are used to determine their textures. For remaining pixels corresponding to the non-planar geometries, the point primitive is applied, reorganized as the OBB-tree structure. Then, texture mapping and point splatting are employed together to render the novel views, with the hardware acceleration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Shum H Y, Kang S B. A survey on image-based rendering-representation, sampling, and compression. Signal Processing: Image Communication, 2004, 19(1): 1–28.

    Article  Google Scholar 

  2. Gortler S J, Grzeszczuk R, Szeliski R, Cohen M F. The lumigraph. In Proc. SIGGRAPH 1996, New Orleans, USA, Aug. 4–9, 1996, pp.43–54.

  3. Levoy M, Hanrahan P. Light field rendering. In Proc. SIGGRAPH 1996, New Orleans, USA, Aug. 4–9, 1996, pp.31–42.

  4. Lorensen W E, Cline H E. Plenoptic modeling: An image-based rendering system. In Proc. SIGGRAPH 1995, Los Angeles, USA, Aug. 6–11, 1995, pp.39–46.

  5. Chang C F, Bishop G, Lastra A. LDI tree: A hierarchical representation for image-based rendering. In Proc. SIGGRAPH 1999, Los Angeles, USA, Aug. 8–13, 1999, pp.291–298.

  6. Mark W R, McMillan L, Bishop G. Post-rendering 3D warping. In Proc. Symposium on Interactive 3D Graphics 1997, Rhode Island, USA, April 27–30, 1997, pp.7–16.

  7. Popescu V, Lastra A, Aliaga D, Oliveira N M. Efficient warping for architectural walkthroughs using layered depth images. In Proc. IEEE Visualization 1998, North Carolina, USA, Oct. 18–23, 1998, pp. 211–215.

  8. Shade J, Gortler S, He L-W, Szeliski R. Layered depth images. In Proc. SIGGRAPH 1998, Orlando, USA, July 19–24, 1998, pp.231–242.

  9. Alexa M, Behr J., Cohen-Or D, Fleishman S, Levin D, Silva C T. Point set surfaces. In Proc. IEEE Visualization 2001, Washington DC, USA, Oct. 21–26, 2001, pp.21–28.

  10. Fleishman S, Cohen-Or D, Alexa M, Silva C T. Progressive point set surfaces. ACM Transaction on Graphics, 2003, 22(4): 997–1011.

    Article  Google Scholar 

  11. Grossman P, Dally W J. Point sample rendering. In Proc. Rendering Technique 1998, Vienna, Austria, June 29–July 1, 1998, pp.181–192.

  12. Coconu L, Hege H C. Hardware-accelerated point-based rendering of complex scenes. In Proc. the 13th Eurographics Workshop on Rendering, Pisa, Italy, June 26–28, 2002, pp.43–52.

  13. Adelson E H, Bergen J R. The plenoptic function and the elements of early vision. Computational Models of Visual Processing, 1991, 91(1): 3–20.

    Google Scholar 

  14. Buehler C, Bosse M, McMillan L, Gortler S, Cohen M. Unstructured lumigraph rendering. In Proc. SIGGRAPH 2001, New York, USA, Aug. 12–17, 2001, pp.425–432.

  15. Wang H, Yang R. Towards space: Time light field rendering. In Proc. SI3D 2005, Washington DC, USA, April 3–6, 2005, pp.125–132.

  16. Shum H Y, He L. Rendering with concentric mosaics. In Proc. SIGGRAPH 1999, Los Angeles, USA, Aug. 8–13, 1999, pp.299–306.

  17. Aliaga D G, Carlbom I. Plenoptic stitching: A scalable method for reconstructing 3d interactive walkthroughs. In Proc. SIGGRAPH 2001, Los Angeles, USA, Aug. 12–17, 2001, pp.443–450.

  18. Shum H-Y, Sun J, Yamazaki S, Li Y, Tang C-K. Pop-up light field: An interactive image-based modeling and rendering system. ACM Transaction on Graphics, 2004, 23(2): 143–162.

    Article  Google Scholar 

  19. Debevec P, Yu Y, Borshukov G. Efficient view-dependent image-based rendering with projective texture-mapping. In Proc. Rendering Technique, Vienna, Austria, 1998, pp.105–116.

  20. Pulli K, Cohen M F, Duchamp T, Hoppe H, Shapiro L, Stuetzle W. View-based rendering: Visualizing real objects from scanned range and color data. In Proc. Rendering Technique 1997, St. Etienne, France, June 16–18, 1997, pp.23–34.

  21. Chai J X, Tong X, Chan S C, Shum H Y. Plenoptic sampling. In Proc. SIGGRAPH 2000, New Orleans, USA, July 23–28, 2000, pp.307–318.

  22. Alexa M, Gross M, Pauly M, Pfister H, Stamminger M, Zwicker M. Point-based computer graphics. In Proc. SIGGRAPH 2004 Course Notes, Los Angeles, USA, Aug. 8–12, 2004, p.7.

  23. Rusinkiewicz S, Levoy M. Qsplat: A multiresolution point rendering system for large meshes. In Proc. SIGGRAPH 2000, New Orleans, USA, July 23–28, 2000, pp.343–352.

  24. Pfister H, Zwicker M, van Baar J, Gross M. Surfels: Surface elements as rendering primitives. In Proc. SIGGRAPH 2000, New Orleans, USA, July 23–28, 2000, pp.335–342.

  25. Zwicker M, Pfister H, van Baar J, Gross M. Surface splatting. In Proc. SIGGRAPH 2001, Los Angeles, USA, Aug.12–17, 2001. pp.371–378.

  26. Heckbert P. Fundamentals of texture mapping and image warping [Master’s Thesis]. University of California at Berkeley, 1989.

  27. Pauly M, Gross M. Spectral processing of point-sampled geometry. In Proc. SIGGRAPH 2001, Los Angeles, USA, Aug.12–17, 2001, pp.379–386.

  28. Wimmer M, Wonka P, Sillion F. Point-based impostors for real-time visualization. In Proc. the Eurographics Workshop on Rendering, London, UK, June 25–27, 2001, pp.163–176.

  29. Cohen J D, Aliaga D G, Zhang W. Hybrid simplification: Combining multi-resolution polygon and point rendering. In Proc. IEEE Visualization 2001, California, USA, Oct. 21–26, 2001, pp.37–44.

  30. Zhang Y, Liu X, Wu E. A hybrid representation of environment models in image-based real time walkthrough. In Proc. the 10th Pacific Conference on Computer Graphics and Applications, Beijing, China, Oct. 9–11, 2002, pp.335–345.

  31. Wand M, Fischer M, Peter I, auf der Heide F M, Straer W. The randomized z-buffer algorithm: Interactive rendering of highly complex scenes. In Proc. SIGGRAPH 2001, Los Angeles, USA, Aug. 12–17, 2001, pp.361–370.

  32. Gopi M, Krishnan S, Silva C T. Surface reconstruction based on lower dimensional localized Delaunay triangulation. Computer Graphic Forum, 2000, 19(3): 467–478.

    Article  Google Scholar 

  33. Wei L-Y, Levoy M. Fast texture synthesis using tree-structured vector quantization. In Proc. SIGGRAPH 2000, New Orleans, USA, July 23–28, 2000, pp.479–488.

  34. Lucas B D, Kanade T. An iterative image registration technique with an application to stereo vision. In Proc. the 7th International Joint Conference on Artificial Intelligence, Vancouver, Canada, August, 1981, pp.121–130.

  35. Gottschalk S, Lin M C, Manocha D. Obbtree: A hierarchical structure for rapid interference detection. In Proc. SIGGRAPH 1996, New Orleans, USA, Aug. 4–9, 1996, pp.171–180.

  36. Buehler C, Bosse M, McMillan L, Gortler S, Cohen M. Unstructured lumigraph rendering. In Proc. SIGGRAPH 2001, Los Angeles, USA, Aug. 12–17, 2001, pp.425–432.

  37. Wang W, Li K, Wu E. Stick textures for image-based rendering. Graphical Models, 2006, 68(3): 294–306.

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China

    Bin Sheng

  2. Faculty of Science and Technology, University of Macau, Macao, China

    Bin Sheng, Jian Zhu & En-Hua Wu (Member, CCF, ACM, IEEE)

  3. Institute of Software, Chinese Academy of Sciences, Beijing, 100190, China

    En-Hua Wu (Member, CCF, ACM, IEEE)

  4. Department of Informatics, University of Zurich, Zurich, 8050, Switzerland

    Yan-Ci Zhang

Authors
  1. Bin Sheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jian Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. En-Hua Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yan-Ci Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bin Sheng.

Additional information

Supported by the National Basic Research 973 Program of China under Grant No. 2009CB320802, the National High-Tech Research and Development 863 Program of China under Grant No. 2008AA01Z301, the National Natural Science Foundation of China under Grant No. 60833007, the Research Grant from University of Macau, RGC Research Grant (Ref. 416007), UGC Direct Grant (No. 2050349).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sheng, B., Zhu, J., Wu, EH. et al. Lumiproxy: A Hybrid Representation of Image-Based Models. J. Comput. Sci. Technol. 24, 578–587 (2009). https://doi.org/10.1007/s11390-009-9247-y

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-009-9247-y

Keywords

Search

Navigation