Skip to main content

Poetry of Separation: The Aesthetics of Spatial Montage and Generative Editing for Multi-layered Screens

  • Conference paper
  • First Online:
  • 1312 Accesses

Abstract

Poetry of Separation’ is a media artwork that utilizes an algorithmic generative editing system, selecting shots in real-time to be rendered over four screens arranged in layers. Editing in cinema reconstructs images by montage, deriving meaning from the juxtaposition of multiple shots. Although multi-screen projections have been used to present sectional montages that stress the simultaneity of events, spatially separated screens can disrupt attentiveness and affective involvement; the layered architecture avoids disruptive fragmentation. The generative editing system selects shots for the layered screens stochastically, with authorial constraints and probabilities using pre-determined shot criteria. Narrative flow and authorial intents are not damaged due to these criteria, but nevertheless unexpected effects arose from the stochastic system. The authorial intentions of improvisation and separation in the film content of ‘Poetry of Separations’ find resonance with the automatism of the generative editing system and multi-dimensionality of the screens.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Zettl, H.: Sight, Sound, Motion: Applied Media Aesthetics. Cengage Learning, USA (2013)

    Google Scholar 

  2. Orpen, V.: Film Editing: The Art of the Expressive, vol. 16. Wallflower Press, UK (2003)

    Google Scholar 

  3. Marchessault, J., Lord, S.: Multi-screens and future cinema: the labyrinth project at Expo 67. In: Marchessault, J., Lord, S. (eds.) Fluid Screens Expanded Cinema, pp. 29–51. University of Toronto Press, UK (2007)

    Google Scholar 

  4. Boden, M.A., Edmonds, E.A.: What is generative art? Digital Creativity 20(1–2), 21–46 (2009)

    Article  Google Scholar 

  5. Lobb, I.: Generative Cinema and Dialogue. University of Plymouth (2003)

    Google Scholar 

  6. Eisenstein, S.: A dialectic approach to film form. In: Leyda, J. (ed.) Film Form: Essays in Film Theory, pp. 45–63. Harcourt Inc, San Diego (1977)

    Google Scholar 

  7. Eisenstein, S., Gerould, D.: Montage of attractions: for enough stupidity in every wiseman. The Drama Review: TDR 18, 77–85 (1974)

    Article  Google Scholar 

  8. Bordwell, D.: The idea of montage in Soviet art and film. Cine. J. 11(2), 9–17 (1972)

    Article  Google Scholar 

  9. Trifonova, T.: A nonhuman eye: deleuze on cinema. SubStance 33(2), 134–152 (2004)

    Article  Google Scholar 

  10. Deleuze, G.: Cinema 2: The Time-Image (trans: Tomlinson, H., Galeta, R.), p. 77. University of Minnesota Press, Minneapolis (1989)

    Google Scholar 

  11. Bubb, J.: Back to the future: multi-image screen narrative in a digital age. J. Media Pract. 13(1), 45–60 (2012)

    Article  Google Scholar 

  12. Perrin, D.G.: A theory of multiple-image communication. Education Tech. Research Dev. 17(4), 368–382 (1969)

    Google Scholar 

  13. Manovich, L.: The language of new media. MIT press, Cambridge (2001)

    Google Scholar 

  14. Suzuki, R., Iwadate, Y., Nakatsu, R., Mihoh, M.: Multimedia Montage—Counterpoint synthesis of movies. Multimedia Tools Appl. 11(3), 311–331 (2000)

    Article  MATH  Google Scholar 

  15. Bizzocchi, J.: The fragmented frame: the poetics of the split-screen. la Web del Massachusets Intiture of Technology (2009). http://web.mit.edu/commforum/mit6/papers/Bizzocchi.pdf

  16. Dorin, A.: Chance and complexity: stochastic and generative processes in art and creativity. In: Proceedings of the Virtual Reality International Conference: Laval Virtual, p. 19. ACM (2013)

    Google Scholar 

  17. Leggett, M.: Generative systems and the cinematic spaces of film and installation art. Leonardo 40(2), 123–128 (2007)

    Article  MathSciNet  Google Scholar 

  18. Manovich, L., Kratky, A.: Soft Cinema Navigating the Database. DVD & Booklet. MIT press, Cambridge (2005)

    Google Scholar 

  19. Alain, L.: Galatema: A Framework for Generative Cinema. GA2010 – XIII Generative Art Conference – Politecnico di Milano University, Italy (2010)

    Google Scholar 

  20. Jasinschi, R.S., Moura, J.M.F.: Nonlinear editing by generative video. In: 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP-1996, vol. 2, pp. 1220-1223. IEEE (1996)

    Google Scholar 

  21. Petrovic, N., Ivanovic, A., Jojic, N.: Recursive estimation of generative models of video. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 79-86. IEEE (2006)

    Google Scholar 

  22. Carter, C.L.: Improvisation in dance. J. Aesthet. Art Criticism 58, 181–190 (2000)

    Article  Google Scholar 

  23. Riedl, M.O.: Incorporating authorial intent into generative narrative systems. In: AAAI Spring Symposium: Intelligent Narrative Technologies II, pp. 91-94 (2009)

    Google Scholar 

  24. Hosale, M.D.: Nonlinear media as interactive narrative. University of California at Santa Barbara (2008)

    Google Scholar 

  25. Deren, M., Miller, A., Thomas, D., Tyler, P.: Poetry and the film: a symposium. Film Culture 29, 55–63 (1963)

    Google Scholar 

Download references

Acknowledgments

We would like to express our great appreciations to all the contributing artists: performers Kyung Hwang, Tae Geon Lee, Jongook Wang, visual supervisor Kyung Suk Park, art and music director Sae On Im, cinematographer Won Suk Choi, assistant director Hyo Kyung Noh, jimmy jib operator Ju Cheon Moon, production managers Hyo Jin Sin, Hye Jin Kim, Hyn Jin Oh. We would also like to extend our thanks to Prof. Jin Hee Kim and Prof. Yi Kyung Kim and Rooni Lee who provided insights and improvement for this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Graham Wakefield .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Bahng, S.J., Yoo, D.W., Hutchings, P., Shi, C.K., Wakefield, G. (2015). Poetry of Separation: The Aesthetics of Spatial Montage and Generative Editing for Multi-layered Screens. In: Brooks, A., Ayiter, E., Yazicigil, O. (eds) Arts and Technology. ArtsIT 2014. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 145. Springer, Cham. https://doi.org/10.1007/978-3-319-18836-2_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-18836-2_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-18835-5

  • Online ISBN: 978-3-319-18836-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics