On the Chief Modes of Multimodal Prose
Issue: Vol 10 No. 3 (2014)
Journal: Linguistics and the Human Sciences
Subject Areas: Writing and Composition Linguistics
Abstract:
There are mainly four forms of modes, that is, language, pictures, music and songs and video productions, among which language and picture modes can be further divided into hand operation and automatic operation. They can be combined in various ways, resulting in different modality combinations, but we still need to explore the regularities of these groupings, in particular the causes and functions which lead to these regularities. Therefore, the article discusses three chief points: (a) the meaning of a particular piece of multimodal prose to be realized by different modes; (b) these modes to be used singly or jointly; and (c) one or two modes playing the chief role, and the rest complementary roles under the circumstance when multiple modes were chosen. This endeavour may help with our creation and appreciation of multimodal prose.
Author: Hu Zhuanglin
References :
Halliday, M. A. K. (1978) Language as Social Semiotic: The Social Interpretation of Language and Meaning. London: Edward Arnold.
Halliday, M. A. K. (1994) An Introduction to Functional Grammar (2nd edn). London: Edward Arnold.
Hu, Z. (2004a) Hypertextual discourse analysis. Shandong Foreign Language Teaching 5: 3–8.
Hu, Z. (2004b) Oration, literacy, and hypertext: On the changes of the relation between and perceptive modes. Computer-Assisted Foreign Language Education 6: 2–8.
Hu, Z. (2007) Multimodalization in sociolinguistic research. Language Teaching and Research 1: 1–10.
Hu, Z. (2010) The growth and development of multimodal prose. Computer-assisted Foreign Language Education 4: 3–9.
Hu, Z. and Dong, J. (2006) Multimodal construction of meaning: Discourse analysis of a PPT presentation contest. Computer-assisted Foreign Language Education 3: 3–12.
Iedema, R. (2003) Multimodality, resemiotizaion: Extending the analysis of discourse as multisemiotic process. Visual Communication 2 (1): 29–57. http://dx.doi.org/10.1177/1470357203002001751
Kress, G. and van Leeuwen, T. (1996) Reading Images: The Grammar of Visual Design. (1st edn) London and New York: Routledge.
Li, M. (2009) Translation of film captions of ‘The Bright Sunny Days’: Under multimodal conditions. Film Literature 7: 159–160.
Li, Z. (2003) Sociosemiotic analysis of multimodal discourse. Foreign Language Research 5: 1–8.
O’Halloran, K. L. (2008) Multimodal analysis and digital technology. In A. Baldry and E. Montagna (eds) Interdisciplinary Perspectives on Multimodality: Theory and Practice 1–26. Campobasso: Palladino.
O’Toole, M. (1994) The Language of Displayed Art. Rutherford: Fairleigh-Dickinson University Press.
de Saussure, F. (2001) Course in General Linguistics. Beijing: Foreign Language and Research Press.
Scallon, R. and Philip, L. (2004) Multiple Discourse Analysis as the Confluence of Discourse and Technology. Washington, DC.: Georgetown University Press.
Scollon, R. and Levine, P. (Eds) (2004) Discourse and Technology: Multimodal Discourse Analysis. Washington, DC: Georgetown University Press.
van Leuween, T. (2005) Introducing Social Semiotics. London: Routledge.
Wei, X. (2009) Multimodal analysis of cartoon discourse. Journal of Writers 3: 259–60.
Yang, X. (2009) Multimodal discourse analysis and systemic functional linguistics. Foreign Language Education 30 (4): 11–4.
Zhang, D. (2009) Exploring an integral theoretical framework for multimodal discourse analysis. Foreign Languages in China 1: 24–30.
Zhu, Y. (2007) The theoretical foundation and research method of multimodal discourse analysis. Journal of Foreign Languages 5: 82–86.