Skip to main content
SpringerLink
Log in

Covering photo-realistic properties of outdoor components with the effects of sky color in mixed reality

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Outdoor rendering is an attractive topic in computer graphics. In this paper our main concern is to reveal the interaction between sky color and virtual objects in Mixed Reality environments. Although registration and tracking are two of the main issues in building effective Augmented Reality (AR) systems the creation of more realistic virtual objects indistinguishable from their real-world counterparts is our target which is currently the ultimate goal in AR. Two classes of sky color generation are employed to reveal the outdoor-element interaction. Virtual Sky Modelling (VSM) based on the Perez Model is capable of generating the sky color in a specific location, date and time. The second technique is to generate a virtual model based on the real image of the sky which is called in this paper Real Sky Modelling (RSM). Subsequently, preprocessing of the sky color bleeding is based on the radiosity technique to give the sky color effect to the virtual objects as well as the real ones. Through designing a test AR set-up and applying software and hardware the goal of a robust generation of realistic virtual objects with effect of sky color is achieved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Agusanto K, Li L, Chuangui Z, Sing NW (2003) Photorealistic rendering for augmented reality using environment illumination. In: Proceedings of the 2nd IEEE and ACM international symposium on mixed and augmented reality, pp 208–216

  2. Azuma R (1997) A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6(6):355–385

    Google Scholar 

  3. Azuma R (1999) The challenge of making augmented reality work outdoors. In: 1st international symposium on mixed reality (ISMR ’99). Springer-Verlag, Yokohama, pp 379–390

    Google Scholar 

  4. Bimber O, Grundheimer A, Wetzstein G, Knodel S (2003) Consistent illumination within optical see-through augmented environments. In: Proceedings of the 2nd IEEE and ACM international symposium on mixed and augmented reality, pp 198–207

  5. Bittner J, Mattausch O, Silvennoinen A, Wimmer M (2011) Shadow caster culling for efficient shadow mapping. In: Symposium on interactive 3D graphics and games, I3D 11. ACM, New York, NY, pp 81–88

    Chapter  Google Scholar 

  6. Blinn JF (1982) Light refection functions for simulation of clouds and dusty surfaces. ACM Trans Graph 16:21–29

    Google Scholar 

  7. Cohen M, Wallace JR (1993) Radiosity and realistic image synthesis. Morgan Kaufmann, San Mateo, CA, pp 213–222

    MATH  Google Scholar 

  8. De Coret X (2005) N-buffers for efficient depth map query. Comput Graph Forum 24(3):393–400

    Article  Google Scholar 

  9. Debevec PE (1998) Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: SIGGRAPH ’98 conf. proc., pp 189–198

  10. Dobashi Y, Nishita T, Kaneda K, Yamashita H (1997) A fast display method of sky colour using basis functions. J Vis Comput Animat (8):115–127

  11. Duan LY, Guan T, Yang B (2009) Registration combining wide and narrow baseline feature tracking techniques for markerless AR systems. Sensors 9:10097–10116

    Article  Google Scholar 

  12. Fournier A, Gunawan AS, Romanzin C (1993) Common illumination between real and computer generated scenes. In: Proc. graphics interface ’93, pp 254–262

  13. Gibson S, Cook J, Howard T, Hubbold R (2003) Rapid shadow generation in real-world lighting environments. In: Proceedings of Eurographics symposium on rendering 2003, pp 219–229

  14. Goral C, Torrance KE, Greenberg DP, Battaile B (1984) Modelling the interaction of light between diffuse surfaces. Comput Graph 18(3):213–222

    Article  Google Scholar 

  15. Halawani SM, Sunar MS (2010) Interaction between sunlight and the sky color with 3d objects in the outdoor virtual environment. In: 4th international conference on mathematic/analytical modelling and computer simulation, pp 470–475

  16. Haller M (2004) Photorealism or/and non-photorealism in augmented reality. In: ACMSIGGRAPH international conference on virtual reality continuum and its applications in industry (VRCAI), pp 189–196

  17. Haller M, Drab S, Hartmann W (2003) A real-time shadow approach for an augmented reality application using shadow volumes. In: Proceedings of VRST 03, pp 56–65

  18. http://www.developerfusion.com/thread/27321/how-to-convert-bitmap-to-raw-image (2012)

  19. Iqbal M (1983) An introduction to solar radiation. Academic, New York, p 390

    Google Scholar 

  20. Jacobs K, Loscos C (2006) Classification of illumination methods for mixed reality. Comput Graph Forum 25(1):29–51

    Article  Google Scholar 

  21. Jensen BF, Laursen JS, Madsen JB, Pedersen TW (2009) Simplifying real time light source tracking and credible shadow generation for augmented reality. Institute for Media Technology, Aalborg University

  22. Kaneda K, Okamoto T, Nakamae E, Nishita T (1991) Photorealistic image synthesis for outdoor scenery under various atmospheric conditions. Vis Comput 7:247–258

    Article  Google Scholar 

  23. Klassen RV (1987) Modelling the effect of the atmosphere on light. ACM Trans Graph 6:215–237

    Article  Google Scholar 

  24. Kolivand H, Sunar MS (2011) Real-time sky color with effect of suns position. Int J Sci Eng Res 2(7):2229–5518

    Google Scholar 

  25. Kolivand H, Sunar MS (2012) Real-time outdoor rendering using hybrid shadow maps. Int J Innov Comput Inf Control (IJICIC) 8(10):7169–7184

    Google Scholar 

  26. Kolivand H, Sunar MS (2012) An overview on base real-time hard shadow techniques in virtual environments. TELKOMNIKA Indonesian Journal of Electrical Engineering 10(1):171–178

    Article  Google Scholar 

  27. Kolivand H, Amirshakarami A, Sunar MS (2011) Real-time projection shadow with respect to suns position in virtual environments. Int J Comput Sci Issues 8(6):80–84

    Google Scholar 

  28. Kolivand H, Sunar MS, Altameem A, Rehman A (2012) A new coherent technique for real-time shadow generation with respect to the sun’s position. Life Sci J 9(4):1039–1045

    Google Scholar 

  29. Koppen V, Siegmund N, Soffner M, Saake G (2009) An architecture for interoperability of embedded systems and virtual reality. IETE Tech Rev 26(5):350–356

    Article  Google Scholar 

  30. Lin L, Wang Y, Liu Y, Xiong C, Zeng K (2009) Marker-less registration based on template tracking for augmented reality. Multimed Tools Appl 41:235–252

    Article  MATH  Google Scholar 

  31. Liu Y, Granier X (2012) Online tracking of outdoor lighting for augmented reality with moving cameras. IEEE Trans Vis Comput Graph 18(4):573–580

    Article  Google Scholar 

  32. Liu Y, Qin X, Xu S, Nakamae E, Peng Q (2009) Light source estimation of outdoor scenes for mixed reality. Vis Comput 25(5):637–646

    Article  Google Scholar 

  33. Liu Y, Qin X, Xing G, Peng Q (2010) A new approach to outdoor illumination estimation based on statistical analysis for augmented reality. Computer Animation and Virtual Worlds 21(3–4):321–330

    Google Scholar 

  34. Loscos C, Drettakis G, Robert L (2000) Interactive virtual relighting of real scenes. IEEE Trans Vis Comput Graph 6(3):289–305

    Article  Google Scholar 

  35. Madsen CB, Laursen R (2007) A scalable gpu-based approach to shading and shadowing for photo-realistic real-time augmented reality. In: Proceedings international conference on graphics theory and applications, pp 252–261

  36. Madsen CB, Nielsen M (2008) Towards probe-less augmented reality. A Position Paper, Computer Vision and Media Technology Lab, Aalborg University, Aalborg, Denmark

  37. Madsen CB, Sorensen MKD, Vittrup M (2003) The important of shadows in augmented reality. In: Proceedings 6th annual international workshop on presence

  38. Mair SG (1994) Preliminary report on siggraph in the 21st century: rediscovering our fire. Comput Graph 28(4):288–296

    MathSciNet  Google Scholar 

  39. Margetis G, Zabulis X, Koutlemanis P, Antona M, Stephanidis Co (2012) Augmented interaction with physical books in an ambient intelligence learning environment. Multimed Tools Appl. doi:10.1007/s11042-011-0976-x

    Google Scholar 

  40. Nakamae E, Harada K, Ishizaki T, Nishita T (1986) A montage method: the overlaying of the computer generated images onto a background photograph. Comput Graph (SIGGRAPH ’86 Proc) 20:207–214

    Article  Google Scholar 

  41. Neumann U, You S, Cho Y, Lee J, Park J (1999) Augmented reality tracking in natural environments. In: International symposium on mixed realities

  42. Nishita T, Nakamae E, Dobashi Y (1996) Display of clouds and snow taking into account multiple anisotropic scattering and sky light. In: Rushmeier H (ed) SIGGRAPH 96 conference proceedings, annual conference series, pp 379–386

  43. Noh Z, Sunar MS (2010) Soft shadow rendering based on real light source estimation in augmented reality. Advances in Multimedia–An International Journal (AMIJ) 1(2):26–36

    Google Scholar 

  44. Perez R, Seals R, Michalsky J (1993) All-weather model for sky luminance distribution—preliminary configuration and validation. Sol Energy 50:235–245

    Article  Google Scholar 

  45. Preetham AJ, Shirley P, Smith B (1999) A practical analytic model for daylight. In: Computer graphics (SIGGRAPH ’99 proceedings), pp 91–110

  46. Ronnberg S (2004) Real-time rendering of natural illumination. Master Thesis

  47. Shao MZ, Badler NI (1993) A gathering and shooting progressive refinement radiosity method

  48. Sheng Y, Yapo TC, Cutler B (2010) Global illumination compensation for spatially augmented reality. Comput Graph Forum 29:387–396

    Article  Google Scholar 

  49. State A, Hirota G, Chen DT, Garrett B, Livingston M (1996) Superior augmented reality registration by integrating landmark tracking and magnetic tracking. In: SIGGRAPH ’96 conf. proc., pp 429–438

  50. Sugano N, Kato H, Tachibana K (2003) The effects of shadow representation of virtual objects in augmented reality. In: IEEE/ACM international symposium on mixed and augmented reality (ISMAR 2003). IEEE Computer Society, pp 76–83

  51. Sunar MS, Gordon NA (2001) Real-time daylight sky color modelling. In: Advances in computer graphics and virtual environment, pp 37–55

  52. Sunkavalli K, Matusik W, Pfister H, Rusinkiewicz S (2007) Factored time-lapse video. ACM Trans Graph 26:1–10

    Article  Google Scholar 

  53. Tadamura K, Nakamae E, Kaneda K, Baba M, Yamashita H, Nishita T (1993) Modeling of skylight and rendering of outdoor scenes. Comput Graph Forum 12:189–200

    Article  Google Scholar 

  54. Veas E, Grasset R, Kruijff E, Schmalstieg D (2012) Extended overview techniques for outdoor augmented reality. IEEE Trans Vis Comput Graph (Proceedings Virtual Reality 2012) 18:565–572

    Article  Google Scholar 

  55. Wallace JR, Elmquist KA, Haines EA (1989) A ray tracing algorithm for progressive radiosity. Comput Graph (Proceedings of SIGGRAPH 89) 23(4):315–324

    Article  Google Scholar 

  56. Whitted T (1980) An improved illumination model for shaded display. Commun ACM 6:343–349

    Article  Google Scholar 

  57. Xing G, Liu Y, Qin X, Peng Q (2011) On-line illumination estimation of outdoor scenes based on area selection for augmented reality. In: 12th international conference on computer-aided design and computer graphics (CAD/Graphics), 2011. IEEE, pp 43–442

  58. Xing G, Liu Y, Qin X, Peng Q (2012) A practica lapproach for real-time illumination estimation of outdoor videos. Comput Graph 36:857–865

    Article  Google Scholar 

  59. Yan F (2008) Estimation of light source environment for illumination consistency of augmented reality. In: 1st international congress on image and signal processing, vol 3, pp 771–775

Download references

Acknowledgements

This research was supported by Vot. J13000.7282.4F085 FRGS grant at the UTMVicubeLab, Department of Computer Graphics and Multimedia, Faculty of Computer Science and Information Systems, Universiti Teknologi Malaysia.

Author information

Authors and Affiliations

  1. UTM ViCubelab, Department of Computer Graphics and Multimedia, Faculty of Computer Science and Information Systems, Universiti Teknologi Malaysia, 81310, Skudai Johor, Malaysia

    Hoshang Kolivand & Mohd Shahrizal Sunar

Authors
  1. Hoshang Kolivand
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohd Shahrizal Sunar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hoshang Kolivand.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kolivand, H., Sunar, M.S. Covering photo-realistic properties of outdoor components with the effects of sky color in mixed reality. Multimed Tools Appl 72, 2143–2162 (2014). https://doi.org/10.1007/s11042-013-1494-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1494-9

Keywords

Search

Navigation