Skip to main content
Log in

The Application of Video Semantics and Theme Representation in Automated Video Editing

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper considers the automated generation of humorous video sequences from arbitrary video material. We present a simplified model of the editing process. We then outline our approach to narrativity and visual humour, discuss the problems of context and shot-order in video and consider influences on the editing process. We describe the role of themes and semantic fields in the generation of content oriented video scenes. We then present the architecture of AUTEUR, an experimental system that embodies mechanisms to interpret, manipulate and generate video. An example of a humorous video sequence generated by AUTEUR is described.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. T.G. Aguierre Smith and G. Davenport, “The stratification system. A design environment for random access video,” in ACM Workshop on Networking and Operating System Support for Digital Audio and Video, San Diego: California, 1992.

  2. G.R. Bloch, “Elements d'une Machine de Montage Pour l'Audio-Visuel,” Ph.D., Ecole Nationale Supérieure Des Télécommunications, 1986.

  3. G.R. Bloch, “From concepts to film sequences,” in RIAO 88, MIT Cambridge: MA, pp. 760–767, 1988.

    Google Scholar 

  4. D. Bordwell, Making Meaning—Inference and Rhetoric in the Interpretation of Cinema, Harvard University Press: Cambridge, Massachusetts, 1989.

    Google Scholar 

  5. S. Butler, “Automatic intelligent video editing, an implementation and some cinema theoretic consequences,” (Technical report), Lancaster University, 1995.

  6. J.M. Carroll, Toward a Structural Psychology of Cinema, Mouton Publishers: The Hague, 1980.

    Google Scholar 

  7. M. Davis, “Media streams: Representing Video for Retrieval and Repurposing,” Ph.D., MIT, 1995.

  8. U. Eco, Einführung in Die Semiotik, Wilhelm Fink Verlag: München, 1985.

    Google Scholar 

  9. S. Freud, Jokes and their Relation to the Unconscious, Routledge & Kegan Paul Ltd: London, 1960.

    Google Scholar 

  10. U. Frith and J.E. Robson, “Perceiving the language of film,” Perception, Vol. 4, pp. 97–103, 1975.

    Google Scholar 

  11. A.S. Gordon and E.A. Domeshek, “Conceptual indexing for video retrieval,” in IJCAI 95-Workshop on Intelligent Multimedia Information Retrieval, Montréal, Canada, 19th of Aug. 1995.

  12. J.R. Gregory, “Some Psychological Aspects of Motion Picture Montage,” Ph.D. Thesis, University of Illinois, 1961.

  13. J.P. Isenhour, “The effects of context and order in film editing,” AV Communication Review, Vol. 23, No. 1, pp. 69–80, 1975.

    Google Scholar 

  14. L. Kuleshov, Kuleshov on Film—Writing of Lev Kuleshov, University of California Press: Berkeley, 1974.

    Google Scholar 

  15. L. La Fave, J. Haddad, and W.A. Maesen, “Superiority, enhanced self-esteem, and perceived incongruity humour theory,” in Humor and Laughter: Theory, Research and Applications, T. Chapman and H. Foot (Eds.), John Wiley & Sons: New York, pp. 63–91, 1976.

    Google Scholar 

  16. W.G. Lehnert, M.G. Dyer, P.N. Johnson, C.J. Yang, and S. Harley, “BORIS—An experiment in in-depth understanding of narratives,” Artificial Intelligence, Vol. 20, pp. 15–62, 1983.

    Google Scholar 

  17. C. Metz, Film Language: A Semiotic of the Cinema, Oxford University Press: New York, 1974.

    Google Scholar 

  18. F. Nack and A. Parkes, “The role of video semantics in automated video editing,” (Technical report— unpublished), Lancaster University, 1994.

  19. A.P. Parkes, “An Artificial Intelligence Approach to the Conceptual Description of Videodisc Images,” Ph.D. Thesis, Lancaster University, 1989a.

  20. A.P. Parkes, “The prototype CLORIS system: Describing, retrieving and discussing videodisc stills and sequences,” Information Processing and Management, Vol. 25, No. 2, pp. 171–186, 1989b.

    Google Scholar 

  21. A.P. Parkes, “Settings and the settings structure: The description and automated propagation of networks for perusing videodisk image atates,” in SIGIR'89, N.J. Belkin and C.J. van Rijsbergen (Eds.), Cambridge, MA, pp. 229–238, 1989c.

  22. V. Petric, Constructivism in Film, Cambridge University Press: Cambridge, 1987.

    Google Scholar 

  23. V.I. Pudovkin, Film Technique and Film Acting, Vision Press Limited: London, 1968.

    Google Scholar 

  24. W. Sack, “Coding news and popular culture,” in The International Joint Conference on Artificial Intelligence (IJCA93) Workshop on Models of Teaching and Models of Learning, Chambery, Savoie, France, 1993.

  25. W. Sack and M. Davis, “IDIC: Assembling video sequences from story plans and content annotations,” in IEEE International Conference on Multimedia Computing and Systems, Boston, Ma, May 14–19, 1994.

  26. W. Sack and A. Don, Splicer: An Intelligent Video Editor (Unpublished Working Paper), MIT, 1993.

  27. G. Salomon and A.A. Cohen, “Television formats, mastery of mental skills, and the acquisition of knowledge,” Journal of Educational Psychology, Vol. 69, pp. 612–619, 1977.

    Google Scholar 

  28. R. Schank, Dynamic Memory, Cambridge University Press: New York, 1982.

    Google Scholar 

  29. R. Schank and R. Abelson, Scripts, Plans, Goals and Understanding, Hillsdale, Lawrence Erlbaum Associates: New Jersey, 1977.

    Google Scholar 

  30. T.R. Shultz, “A cognitive-developmental analysis of humor,” in Humor and Laughter: Theory, Research and Applications, T. Chapman and H. Foot (Eds.), John Wiley and Sons: New York, pp. 11–36, 1976.

    Google Scholar 

  31. D. Swanberg, C.F. Shu, and R. Jain, “Architecture of a multimedia information system for content based retrieval,” in Third International Workshop On Network And Operating System Support For Digital Audio And Video, San Diego: California, pp. 345–350, 1992.

  32. Y. Tonomura, A. Akutsu, Y. Taniguchi, and G. Suzuki, “Structured video computing,” IEEE MultiMedia, Vol. 1, No. 3, pp. 34–43, 1994.

    Google Scholar 

  33. A. Tudor, Image and Influence, George Allen & Unwin Ltd.: London, 1974.

    Google Scholar 

  34. H. Ueda, T. Miyatake, S. Sumino, and A. Nagasaka, “Automatic structure visualization for video editing,” in ACM & IFIP INTERCHI'93, pp. 137–141, 1993.

  35. R. Wilensky, “Points: A theory of the structure of stories in memory,” in Strategies for Natural Language Processing,W.G. Lehnert and M.H. Ringle (Eds.), Hillsdale, Lawrence Erlbaum Associates: New Jersey, pp. 345–376, 1983a.

    Google Scholar 

  36. R. Wilensky, “Story grammars versus story points,” The Behavioral and Brain Sciences, Vol. 6, No. 4, pp. 579–623, 1983b.

    Google Scholar 

  37. P. Wollen, Signs and Meaning in the Cinema, Thames & Hudson: London, 1970.

    Google Scholar 

  38. H.J. Wulff, “Der plan macht's,” in Handbuch der Filmmontage—Praxis und Prinzipien des Filmschnitts, München: TR-Verlagsunion, H. Beller (Ed.), pp. 178–189, 1993.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nack, F., Parkes, A. The Application of Video Semantics and Theme Representation in Automated Video Editing. Multimedia Tools and Applications 4, 57–83 (1997). https://doi.org/10.1023/A:1009682315690

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1009682315690

Navigation