Skip to main content

Technologies Expand Aesthetic Dimensions: Visualization and Sonification of Embodied Penwald Drawings

  • Conference paper
  • First Online:
Arts and Technology (ArtsIT 2014)

Abstract

Even though defining art gets more and more difficult, reintegrating art and technology seems to be a clear trend. The present paper aims to show how technologies can expand aesthetic dimensions of art works. Michigan Tech researchers collaborated with a world-renowned artist, Tony Orrico in the immersive virtual environment. While he performed, multiple cameras tracked his body movements and physiological devices logged his biosignals (respiration, heart rate, etc.). Then, the system translated the data into visualization and sonification. Incremental aesthetic dimensions (representation-performance, 2d−3d, outside-inside) obtained based on this art-technology collaboration are discussed with research in progress.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kac, E.: Telepresence Art. Kulturdata. accessed in March 2014. http://www.ekac.org/telepresence.art_94.html (1993)

  2. Packer, R., Jordan, K.: Multimedia: From Wagner to Virtual Reality. W. W. Norton & Company Inc, New York (2001)

    Google Scholar 

  3. Bolter, J.D., Engberg, M., MacIntyre, B.: Media studies, mobile augmented reality, and interaction design. Interaction. 20(1), 36–45 (2013)

    Article  Google Scholar 

  4. Benjamin, W.: The Work of Art in the Age of Mechanical Reproduction (H. Zohn, trans.). Illuminations. Schocken Books, New York (1968)

    Google Scholar 

  5. Mitchell, W.J.T.: The Work of Art in the Age of Biocybernetic Reproduction. MODERNISM / modernity. 10(3), 481–500 (2003)

    Article  Google Scholar 

  6. Fishwick, P.A.: Aesthetic Computing. The MIT Press, MA (2006)

    Google Scholar 

  7. Davis, J.I., Markman, A.B.: The Future of Embodied Cognition. Topics in Cognitive Science. 4(4), 685–793 (2012)

    Article  Google Scholar 

  8. England, D., Bryan-Kinns, N.: Special Issue on Whole Body Interaction. International Journal of Arts and Technology 6(4), 320–409 (2013)

    Article  Google Scholar 

  9. Marshall, P., Antle, A., Van Den Hoven, E., Rogers, Y.: Special Issue on the Theory and Practice of Embodied Interaction in HCI and Interaction Design. ACM Transactions on Computer-Human Interaction (TOCHI). 20, 1 (2013)

    Google Scholar 

  10. Lim, Y.-K., Stolterman, E., Jung, H., Donaldson, J.: Interaction Gestalt and the Design of Aesthetic Interactions. In: Proceedings of the Designing Pleasurable Products and Interfaces, 22–25 August, Helsinki, Finland (2007)

    Google Scholar 

  11. Petersen, M.G., Iversen, O.S., Krogh, P.G., Ludvigsen, M.: Aesthetic Interaction - A Pragmatist’s Aesthetics of Interactive Systems. In: Proceedings of the DIS 2004, August 1–4, Cambridge, Massachusetts, USA (2004)

    Google Scholar 

  12. Wagner, R.: Outlines of the Artwork of the Future (1849). In: Packer, R., Jordan, K. (eds.) Multimedia: From Wagner to Virtual Reality. W. W. Norton & Company Inc, New York (2001)

    Google Scholar 

  13. Dissanayake, E.: Retrospective on Homo Aestheticus. Journal of the Canadian Association for Curriculum Studies. 1(2), 7–11 (2003)

    Google Scholar 

  14. http://tonyorrico.com/PENWALD_DRAWINGS.html (2014)

  15. Jeon, M., Smith, M.T., Walker, J.W., Kuhl, A.S.: Constructing the Immersive Interactive Sonification Platform (iISoP). In: Proceedings of the 16th International Conference on Human-Computer Interaction (HCII2014), Creta Maris, Heraklion, Crete, Creece, June 22 – 27 (2014)

    Google Scholar 

  16. Walker, B.N., Godfrey, M.T., Orlosky, J.E., Bruce, C., Sanford, J.: Aquarium Sonification: Soundscapes for Accessible Dynamic Informal Learning Environments. In: Proceedings of the 12th International Conference on Auditory Display (ICAD), London, UK (2006)

    Google Scholar 

  17. Hegel, G.W.F.: Aesthetics: Lectures on Fine Art (translated by T.M. Knox). Oxford University Press, New York (1975)

    Book  Google Scholar 

  18. Penny, S.G.: Someday. We Will Have Shakespeare of Computer Games. Humanist, Seoul (2009)

    Google Scholar 

  19. Jeon, M., Winton, R.J., Yim, J.-B., Bruce, C.M., Walker, B.N.: Aquarium Fugue: Interactive Sonification for Children and Visually Impaired Audience in Informal Learning Environments. In: Proceedings of the 18th International Conference on Auditory Display (ICAD) Atlanta GA, USA (2012)

    Google Scholar 

  20. Carvalho, R.: The Magical Features of Immersive Audiovisual Environments. Interaction 20(5), 32–37 (2013)

    Article  Google Scholar 

  21. Jeon, M., Winton, R.J., Henry, A.G., Oh, S., Bruce, C.M., Walker, B.N.: Designing Interactive Sonification for Live Aquarium Exhibits. In: Stephanidis, C. (ed.) HCII 2013, Part I. CCIS, vol. 373, pp. 332–336. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  22. Landry, G.S., Jeon, M., Ryan, D.J.: A Broad Spectrum of Sonic Interactions at Immersive Interactive Sonification Platform (iISoP). In: Proceedings of the 21th IEEE Virtual Reality Conference (Workshop in Sonic Interactions in Virtual Environments), Minneapolis, Minnesota, March 29 - April 1 (2014)

    Google Scholar 

Download references

Acknowledgments

The authors deeply appreciate Tony Orrico, and Anne Beffel and Carrie Flaspohler who planned and made this collaboration possible. The authors also thank Scott Kuhl and tri-M lab members for their help during the project.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Myounghoon Jeon .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Jeon, M., Landry, S., Ryan, J.D., Walker, J.W. (2015). Technologies Expand Aesthetic Dimensions: Visualization and Sonification of Embodied Penwald Drawings. In: Brooks, A., Ayiter, E., Yazicigil, O. (eds) Arts and Technology. ArtsIT 2014. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 145. Springer, Cham. https://doi.org/10.1007/978-3-319-18836-2_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-18836-2_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-18835-5

  • Online ISBN: 978-3-319-18836-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics