Guiseppe Getto
Mary Lourdes Silva
ABSTRACT
In this paper, we describe the methodology known as Systemic Functional Multimodal Discourse Analysis (SF-MDA), as well as how it can be easily paired with a variety of technologies and research methods to successfully analyze and make sense of any combination of communicative modes, while leaving plenty of room for tailoring data visualizations for a variety of audiences, both scholarly and professional. Our ultimate goal is to provide researchers and practitioners with a simplified workflow of this methodology for employment in a variety of contexts.
- O'Halloran, K. 2009. Multimodal analysis and digital technology. In A. Baldry and E. Montagna, Eds., Interdisciplinary Perspectives on Multimodality: Theory and Practice. Retrieved from http://courses.nus.edu.sg/Course/ellkoh/docs/O'Halloran%20(2008)%20-%20edited.pdf.Google Scholar
- Halliday, M. 1978. Language as Social Semiotic: The Social Interpretation of Language and Meaning. University Park Press, Baltimore, MD.Google Scholar
- Bezemer, J., and Kress, G. Writing in multimodal texts: A social semiotic account of designs for learning. Written Communication. 25, 2 (April. 2008), 166--195.Google ScholarCross Ref
- Slattery, S. Undistributing work through writing: How technical communicators manage texts in complex information environments. Technical Communication Quarterly. 16, 3, (December. 2007), 311--325.Google ScholarCross Ref
- Witte, S. Research in activity: An analysis of speed bumps as mediational means. Written Communication. 22, 2 (April. 2005), 127--165.Google ScholarCross Ref
- Flewitt, R. Using video to investigate preschool classroom interaction: Education research assumptions and methodological practices. Visual Communication. 5, 1 (February. 2006), 25--50.Google ScholarCross Ref
- Blythe. S. 2007. Coding digital texts and multimedia. In H. McKee and D. DeVoss, Eds. Digital Writing Research: Technologies, Methodologies, and Ethical Issues. Hampton, Cresskill, NJ, 203--228.Google Scholar
- O'Toole, M. 1994. The Language of Displayed Art. Leicester University Press, London.Google Scholar
- Kress, G., and van Leeuwen, T. 1996. Reading Images: The Grammar of Visual Design. Routledge, London.Google Scholar
Index Terms
- Doing multimodal research the easy way: a workflow for making sense of technologically complex communication situations
Recommendations
Hand Motion Gesture Frequency Properties and Multimodal Discourse Analysis
Gesture and speech are co-expressive and complementary channels of a single human language system. While speech carries the major load of symbolic presentation, gesture provides the imagistic content. We investigate the role of oscillatory/cyclical hand ...
The Transcribing and Encoding Scheme of Multimodal Dynamic Genres
ISCID '14: Proceedings of the 2014 Seventh International Symposium on Computational Intelligence and Design - Volume 01Dynamic genres where pictures move, sound plays and language comes in changing combinations of speech, song and writing are ubiquitous throughout our lives. Yet the problem as to how we can go about analyzing them in blend with image, movement, sound, ...
Comments