Abstract
The role of computers in school education is briefly discussed. Multimodal interfaces development history is shortly reviewed. Examples of applications of multimodal interfaces for learners with special educational needs are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with facial expression and speech stretching audio interface representing audio modality. Intelligent and adaptive algorithms application to the developed multimodal interfaces is discussed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Xu, R., Da, Y.: A Computer Vision based Whiteboard Capture System. In: IEEE Workshop on Applications of Computer Vision, WACV 2008, pp. 1–6 (2008)
Maes, P., Mistry, P.: Unveiling the ”Sixth Sense”, game-changing wearable tech. In: TED 2009, Long Beach, CA, USA (2009)
Mistry, P., Maes, P.: SixthSense – A Wearable Gestural Interface. In: SIGGRAPH Asia 2009, Emerging Technologies.Yokohama, Japan (2009)
Lech, M., Kostek, B.: Fuzzy Rule-based Dynamic Gesture Recognition Employing Camera & Multimedia Projector. In: Advances in Intelligent and Soft Computing: Multimedia & Network Information System. Springer, Heidelberg (2010)
Lech, M., Kostek, B.: Gesture-based Computer Control System Applied to the Interactive Whiteboard. In: 2nd International Conference on Information Technology ICIT 2010, Gdansk, June 28-30, pp. 75–78 (2010)
Kalman, R.R.: A New Approach to Linear Filtering and Prediction Problems. Transaction of the ASME – Journal of Basic Engineering, 35–45 (1960)
Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision with the OpenCV Library. O’Reilly, Sebastopol (2008)
Kupryjanow, A., Czyzewski, A.: Real-time speech-rate modification experiments. Audio Engineering Society Convention, preprint No. 8052, London, GB, May 22-25 (2010)
Moattar, M., Homayounpour, M., Kalantari, N.: A new approach for robust realtime voice activity detection using spectral pattern. In: ICASSP Conference, March 14-19 (2010)
Zheng, J., Franco, H., Weng, F., Sankar, A., Bratt, H.: Word-level rate-of-speech modeling using rate-specific phones and pronunciations. In: Proc. IEEE Int. Conf. Acoust. Speech Signal Process, Istanbul, vol. 3, pp. 1775–1778 (2000)
Pesce, F.: Realtime-Stretching of Speech Signals. In: Proceedings of the COST G-6 Conference on Digital Audio Effects (DAFX 2000), Verona, Italy, December 7-9 (2000)
Verhelst, W., Roelands, M.: An overlap-add technique based on waveform similarity (WSOLA) for high quality time-scale modification of speech. In: ICASSP 1993, Minneapolis, USA, April 27-April 30, vol. 2 (1993)
Kupryjanow, A., Czyzewski, A.: Time-scale modification of speech signals for supporting hearing impaired schoolchildren. In: Proc. of International Conference NTAV/SPA, New Trends in Audio and Video, Signal Processing: Algorithms, Architectures, Arrangements and Applications, Poznań, September 24-25 , pp. 159–162 (2009)
Kaszuba, K., Kopaczewski, K., Odya, P., Kostek, B.: Biofeedback-based brain hemispheric synchronizing employing man-machine interface. In: Tsihrintzis, G.A., et al. (eds.) The 3rd International Symposium on Intelligent and Interactive Multimedia: Systems and Services KES 2010, Baltimore, USA, July 28-30, pp. 2010–2030. Springer, Heidelberg (2010)
Kupryjanow, A., Kunka, B., Kostek, B.: UPDRS tests for Diagnosis of Parkinson’s Disease Employing Virtual-Touchpad. In: 4th International Workshop on Management and Interaction with Multimodal Information Content – MIMIC 2010, Bilbao, Spain, August 30-September 3 (2010)
Kosikowski, L., Czyzewski, A., Dalka, P.: Multimedia Browser Controlled by Head Movements. In: 37 Conf. and Exhibition on Computer Graphics and Interactive Techniques, SIGGRAPH, Los Angeles, USA, July 25-29 (2010)
Odya, P., Czyzewski, A., Grabkowska, A., Grabkowski, M.: Smart Pen – new multimodal computer control tool for graphomotorical therapy. Intelligent Decision Technologies Journal 4(3), 197–209 (2010)
Smulko, J., Kotarski, M., Czyzewski, A.: Fluctuation-enhanced scent sensing using a single gas sensor. Sensors & Actuators: B. Chemical (to be printed in 2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Czyzewski, A., Kostek, B. (2011). Intelligent Multimedia Solutions Supporting Special Education Needs. In: Kryszkiewicz, M., Rybinski, H., Skowron, A., Raś, Z.W. (eds) Foundations of Intelligent Systems. ISMIS 2011. Lecture Notes in Computer Science(), vol 6804. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21916-0_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-21916-0_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21915-3
Online ISBN: 978-3-642-21916-0
eBook Packages: Computer ScienceComputer Science (R0)