Abstract
This paper considers the automated generation of humorous video sequences from arbitrary video material. We present a simplified model of the editing process. We then outline our approach to narrativity and visual humour, discuss the problems of context and shot-order in video and consider influences on the editing process. We describe the role of themes and semantic fields in the generation of content oriented video scenes. We then present the architecture of AUTEUR, an experimental system that embodies mechanisms to interpret, manipulate and generate video. An example of a humorous video sequence generated by AUTEUR is described.
Similar content being viewed by others
References
T.G. Aguierre Smith and G. Davenport, “The stratification system. A design environment for random access video,” in ACM Workshop on Networking and Operating System Support for Digital Audio and Video, San Diego: California, 1992.
G.R. Bloch, “Elements d'une Machine de Montage Pour l'Audio-Visuel,” Ph.D., Ecole Nationale Supérieure Des Télécommunications, 1986.
G.R. Bloch, “From concepts to film sequences,” in RIAO 88, MIT Cambridge: MA, pp. 760–767, 1988.
D. Bordwell, Making Meaning—Inference and Rhetoric in the Interpretation of Cinema, Harvard University Press: Cambridge, Massachusetts, 1989.
S. Butler, “Automatic intelligent video editing, an implementation and some cinema theoretic consequences,” (Technical report), Lancaster University, 1995.
J.M. Carroll, Toward a Structural Psychology of Cinema, Mouton Publishers: The Hague, 1980.
M. Davis, “Media streams: Representing Video for Retrieval and Repurposing,” Ph.D., MIT, 1995.
U. Eco, Einführung in Die Semiotik, Wilhelm Fink Verlag: München, 1985.
S. Freud, Jokes and their Relation to the Unconscious, Routledge & Kegan Paul Ltd: London, 1960.
U. Frith and J.E. Robson, “Perceiving the language of film,” Perception, Vol. 4, pp. 97–103, 1975.
A.S. Gordon and E.A. Domeshek, “Conceptual indexing for video retrieval,” in IJCAI 95-Workshop on Intelligent Multimedia Information Retrieval, Montréal, Canada, 19th of Aug. 1995.
J.R. Gregory, “Some Psychological Aspects of Motion Picture Montage,” Ph.D. Thesis, University of Illinois, 1961.
J.P. Isenhour, “The effects of context and order in film editing,” AV Communication Review, Vol. 23, No. 1, pp. 69–80, 1975.
L. Kuleshov, Kuleshov on Film—Writing of Lev Kuleshov, University of California Press: Berkeley, 1974.
L. La Fave, J. Haddad, and W.A. Maesen, “Superiority, enhanced self-esteem, and perceived incongruity humour theory,” in Humor and Laughter: Theory, Research and Applications, T. Chapman and H. Foot (Eds.), John Wiley & Sons: New York, pp. 63–91, 1976.
W.G. Lehnert, M.G. Dyer, P.N. Johnson, C.J. Yang, and S. Harley, “BORIS—An experiment in in-depth understanding of narratives,” Artificial Intelligence, Vol. 20, pp. 15–62, 1983.
C. Metz, Film Language: A Semiotic of the Cinema, Oxford University Press: New York, 1974.
F. Nack and A. Parkes, “The role of video semantics in automated video editing,” (Technical report— unpublished), Lancaster University, 1994.
A.P. Parkes, “An Artificial Intelligence Approach to the Conceptual Description of Videodisc Images,” Ph.D. Thesis, Lancaster University, 1989a.
A.P. Parkes, “The prototype CLORIS system: Describing, retrieving and discussing videodisc stills and sequences,” Information Processing and Management, Vol. 25, No. 2, pp. 171–186, 1989b.
A.P. Parkes, “Settings and the settings structure: The description and automated propagation of networks for perusing videodisk image atates,” in SIGIR'89, N.J. Belkin and C.J. van Rijsbergen (Eds.), Cambridge, MA, pp. 229–238, 1989c.
V. Petric, Constructivism in Film, Cambridge University Press: Cambridge, 1987.
V.I. Pudovkin, Film Technique and Film Acting, Vision Press Limited: London, 1968.
W. Sack, “Coding news and popular culture,” in The International Joint Conference on Artificial Intelligence (IJCA93) Workshop on Models of Teaching and Models of Learning, Chambery, Savoie, France, 1993.
W. Sack and M. Davis, “IDIC: Assembling video sequences from story plans and content annotations,” in IEEE International Conference on Multimedia Computing and Systems, Boston, Ma, May 14–19, 1994.
W. Sack and A. Don, Splicer: An Intelligent Video Editor (Unpublished Working Paper), MIT, 1993.
G. Salomon and A.A. Cohen, “Television formats, mastery of mental skills, and the acquisition of knowledge,” Journal of Educational Psychology, Vol. 69, pp. 612–619, 1977.
R. Schank, Dynamic Memory, Cambridge University Press: New York, 1982.
R. Schank and R. Abelson, Scripts, Plans, Goals and Understanding, Hillsdale, Lawrence Erlbaum Associates: New Jersey, 1977.
T.R. Shultz, “A cognitive-developmental analysis of humor,” in Humor and Laughter: Theory, Research and Applications, T. Chapman and H. Foot (Eds.), John Wiley and Sons: New York, pp. 11–36, 1976.
D. Swanberg, C.F. Shu, and R. Jain, “Architecture of a multimedia information system for content based retrieval,” in Third International Workshop On Network And Operating System Support For Digital Audio And Video, San Diego: California, pp. 345–350, 1992.
Y. Tonomura, A. Akutsu, Y. Taniguchi, and G. Suzuki, “Structured video computing,” IEEE MultiMedia, Vol. 1, No. 3, pp. 34–43, 1994.
A. Tudor, Image and Influence, George Allen & Unwin Ltd.: London, 1974.
H. Ueda, T. Miyatake, S. Sumino, and A. Nagasaka, “Automatic structure visualization for video editing,” in ACM & IFIP INTERCHI'93, pp. 137–141, 1993.
R. Wilensky, “Points: A theory of the structure of stories in memory,” in Strategies for Natural Language Processing,W.G. Lehnert and M.H. Ringle (Eds.), Hillsdale, Lawrence Erlbaum Associates: New Jersey, pp. 345–376, 1983a.
R. Wilensky, “Story grammars versus story points,” The Behavioral and Brain Sciences, Vol. 6, No. 4, pp. 579–623, 1983b.
P. Wollen, Signs and Meaning in the Cinema, Thames & Hudson: London, 1970.
H.J. Wulff, “Der plan macht's,” in Handbuch der Filmmontage—Praxis und Prinzipien des Filmschnitts, München: TR-Verlagsunion, H. Beller (Ed.), pp. 178–189, 1993.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Nack, F., Parkes, A. The Application of Video Semantics and Theme Representation in Automated Video Editing. Multimedia Tools and Applications 4, 57–83 (1997). https://doi.org/10.1023/A:1009682315690
Issue Date:
DOI: https://doi.org/10.1023/A:1009682315690