Qiyam Tung
ABSTRACT
We present a system that assists users in viewing videos of lectures on small screen devices, such as cell phones. It automatically identifies semantic units on the slides, such as bullets, groups of bullets, and images. As the participant views the lecture, the system magnifies the appropriate semantic unit while it is the focus of the discussion. The system makes this decision based on cues from laser pointer gestures and spoken words that are read off the slide. It then magnifies the semantic element using the slide image and the homography between the slide image and the video frame. Experiments suggest that the semantic units of laser-based events identified by our algorithm closely match those identified by humans. In the case of identifying bullets through spoken words, results are more limited but are a good starting point for more complex methods. Finally, we show that this kind of magnification has potential for improving learning of technical content from video lectures when the resolution of the video is limited, such as when being viewed on hand held devices.
- "MIT OpenCourseWare," 2010, http://ocw.mit.edu/OcwWeb/web/home/home/index.htm.Google Scholar
- "Stanford on iTunes," 2010, itunes.stanford.edu/.Google Scholar
- "UC Berkeley Extension Online," 2009, http://learn.berkeley.edu/.Google Scholar
- Q. Fan, K. Barnard, A. Amir, A. Efrat, and M. Lin, "Matching slides to presentation videos using sift and scene background matching," .Google Scholar
- K. Fan, Q.and Barnard, A. Amir, and A. Efrat, "Accurate alignment of presentation slides with educational video," .Google Scholar
- X. Wang and M. Kankanhalli, "Robust alignment of presentation videos with slides," .Google Scholar
- G. Gigonzac, F. Pitie, and A. Kokaram, "Electronic slide matching and enhancement of a lecture video," in Visual Media Production, 2007. IETCVMP. 4th European Conference on. IET, 2008, pp. 1--7.Google Scholar
- J. Attewell and C. Savill-Smith, "Learning with mobile devices: research and development," mLearn 2003 book of papers, 2003.Google Scholar
- Patricia Thornton and Chris Houser, "Using mobile phones in education," in WMTE'04: Proceedings of the 2nd IEEE International Workshop on Wireless and Mobile Technologies in Education (WMTE'04). Google ScholarDigital Library
- L.E. Dyson, A. Litchfield, E. Lawrence, R. Raban, and P. Leijdekkers, "Advancing the m-learning research agenda for active, experiential learning: Four case studies," Australasian Journal of Educational Technology, vol. 25, no. 2, pp. 250--267, 2009.Google Scholar
- "ECMA," 2008, http://www.ecma-international.org.Google Scholar
- R. Swaminathan, M. E. Thompson, S. Fong, A. Efrat, A. Amir, and K. Barnard, "Improving and aligning speech with presentation slides" Int. Conf. Pattern Recognition (ICPR) 2010. Google ScholarDigital Library
- A. Winslow, Q. Tung, Q. Fan, J. Torkkola, R. Swaminathan, K. Barnard, A. Amir, A. Efrat, and C. Gniady, "Studying on the move: enriched presentation video for mobile devices," in 2nd IEEE Workshop on Mobile Video Delivery (MoViD), in conjunction with INFOCOM, 2009. Google ScholarDigital Library
Index Terms
- Expanding the point: automatic enlargement of presentation video elements
Recommendations
On the perception of "segmental intonation": F0 context effects on sibilant identification in German
In normal modally voiced utterances, voiceless fricatives like [s], [ź], [f], and [x] vary such that their aperiodic pitch impressions mirror the pitch level of the adjacent F0 contour. For instance, if the F0 contour creates a high or low pitch context,...
Research and Realization on Real-Time Interaction in m-Learning
NSWCTC '09: Proceedings of the 2009 International Conference on Networks Security, Wireless Communications and Trusted Computing - Volume 01This paper mainly discusses about real-time interaction in m-Learning based on mobile devices. The traditional measure of interaction in m-Learning is unable to achieve real-time interaction. The method researched in the paper practically breaks through ...
SlidePacer: Improving Class Pace for Deaf and Hard-of-Hearing Students
ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & AccessibilityFollowing multimedia lectures in mainstream classrooms in university education is challenging for deaf and hard-of-hearing (DHH) students even when they are provided accommodations to best address their individual needs. Due to multiple visual sources ...
Comments