Abstract
In the past decade, we have witnessed a dramatic increase in the availability of online academic lecture videos. There are technical problems in the use of recorded lectures for learning: the problem of easy access to the multimedia lecture video content and the problem of finding the semantically appropriate information very quickly. The retrieval of audiovisual lecture recordings is a complex task comprising many objects. In our solution, speech recognition is applied to create a tentative and deficient transcription of the lecture video recordings. The transcription and the words from the power point slides are sufficient to generate semantic metadata serialized in an OWL file. Each video segment (the lecturer is speaking about one power point slide) represent a learning object. A question-answering system based on these learning objects is presented. The annotation process is discussed, evaluated and compared to a perfectly annotated OWL file and, further, to an annotation based on a corrected transcript of the lecture. Furthermore, the consideration of the chronological order of the learning objects leads to a better MRR value. Our approach out-performs the Google Desktop Search based on the question keywords.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baader, F., Calvanese, D., McGuinness, D.L., Nardi, D., Patel-Schneider, P.F. (eds.): The Description Logic Handbook: Theory, Implementation, and Applications. Cambridge University Press, Cambridge (2003)
Baeza-Yates, R.A., Ribeiro-Neto, B.A.: Modern Information Retrieval. ACM Press / Addison-Wesley (1999)
Bertini, M., Bimbo, A.D., Torniai, C., Cucchiara, R., Grana, C.: Mom: Multimedia ontology manager. a framework for automatic annotation and semantic retrieval of video sequences. In: Bimbo, A.D., Torniai, C., Cucchiara, R., Grana, C. (eds.) ACM SIGMM, pp. 787–788. ACM Press, New York (2006)
Engelhardt, M., Hildebrand, A., Lange, D., Schmidt, T.C.: Reasoning about eLearning Multimedia Objects. In: International Workshop on Semantic Web Annotations for Multimedia (SWAMM) (2006)
Haubold, A., Kender, J.R.: Augmented segmentation and visualization for presentation videos (2005)
Hürst, W., Kreuzer, T., Wiesenhütter, M.: A qualitative study towards using large vocabulary automatic speech recognition to index recorded presentations for search and access over the web. In: IADIS Internatinal Conference WWW/Internet (ICWI), pp. 135–143 (2002)
Jaimes, A., Nagamine, T., Liu, J., Omura, K., Sebe, N.: Affective meeting video analysis. In: IEEE Multimedia and Expo., pp. 1412–1415 (2005)
Karam, N., Linckels, S., Meinel, C.: Semantic composition of lecture subparts for a personalized e-learning. In: Franconi, E., Kifer, M., May, W. (eds.) ESWC 2007. LNCS, vol. 4519, pp. 716–728. Springer, Heidelberg (2007)
Linckels, S., Meinel, C.: Resolving ambiguities in the semantic interpretation of natural language questions. In: Corchado, E., Yin, H., Botti, V., Fyfe, C. (eds.) IDEAL 2006. LNCS, vol. 4224, pp. 612–619. Springer, Heidelberg (2006)
Mertens, R., Schneider, H., Müller, O., Vornberger, O.: Hypermedia navigation concepts for lecture recordings. In: E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, pp. 2480–2847 (2004)
Ngo, C.-W., Wang, F., Pong, T.-C.: Structuring lecture videos for distance learning applications. In: Multimedia Software Engineering, pp. 215–222 (2003)
Porter, M.: An algorithm for suffix stripping. Program 14(3), 130–137 (1980)
Repp, S., Linckels, S., Meinel, C.: Towards to an automatic semantic annotation for multimedia learning objects. In: Proceedings of the International Workshop on Educational Multimedia and Multimedia Education 2007, Augsburg, Bavaria, Germany, September 28, 2007, pp. 19–26. ACM, New York (2007)
Repp, S., Meinel, C.: Segmenting of recorded lecture videos - the algorithm voiceseg. In: Proceedings of the 1th Signal Processing and Multimedia Applications (Sigmap), Setubal, Portugal, pp. 317–322 (August 2006)
Repp, S., Meinel, C.: Semantic indexing for recorded educational lecture videos. In: 4th IEEE Conference on Pervasive Computing and Communications Workshops (PerCom 2006 Workshops), Pisa, Italy, March 13-17, 2006, pp. 240–245. IEEE Computer Society, Los Alamitos (2006)
Repp, S., Waitelonis, J., Sack, H., Meinel, C.: Segmentation and annotation of audiovisual recordings based on automated speech recognition. In: Yin, H., Tino, P., Corchado, E., Byrne, W., Yao, X. (eds.) IDEAL 2007. LNCS, vol. 4881, pp. 620–629. Springer, Heidelberg (2007)
Sack, H., Waitelonis, J.: Integrating social tagging and document annotation for content-based search in multimedia data. In: Semantic Authoring and Annotation Workshop (SAAW) (2006)
Schmidt, R.A.: Terminological representation, natural language & relation algebra. In: Ohlbach, H.J. (ed.) GWAI 1992. LNCS, vol. 671, pp. 357–371. Springer, Heidelberg (1993)
Voorhees, E.M.: The trec-8 question answering track report. In: TREC (1999)
W. W. W. C. W3C. OWL Web Ontology Language (2004), http://www.w3.org/TR/owl-features/
Wolf, P., Putz, W., Stewart, A., Steinmetz, A., Hemmje, M., Neuhold, E.: Lecturelounge – experience education beyond the borders of the classroom. International Journal on Digital Libraries 4(1), 39–41 (2004)
Yamamoto, N., Ogata, J., Ariki, Y.: Topic segmentation and retrieval system for lecture videos based on spontaneous speech recognition. In: European Conference on Speech Communication and Technology, pp. 961–964 (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Repp, S., Linckels, S., Meinel, C. (2008). Question Answering from Lecture Videos Based on Automatically-Generated Learning Objects. In: Li, F., Zhao, J., Shih, T.K., Lau, R., Li, Q., McLeod, D. (eds) Advances in Web Based Learning - ICWL 2008. ICWL 2008. Lecture Notes in Computer Science, vol 5145. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85033-5_50
Download citation
DOI: https://doi.org/10.1007/978-3-540-85033-5_50
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85032-8
Online ISBN: 978-3-540-85033-5
eBook Packages: Computer ScienceComputer Science (R0)