In multimdodal analysis there is a need to ‘read’ more than traditional text, such as images and film.
Reading Images by Günther Kress and Theo van Leeuwen (2006) is described by the publisher as,
Reading Images focuses on the structures or ‘grammar’ of visual design – colour, perspective, framing and composition – provides the reader with an invaluable ‘tool-kit’ for reading images and makes it a must for anyone interested in communication, the media and the arts.
There is also the conference presentation “Reading Images: Multimodality, Representation and New Media” (Günter Kress, 2004), where you can read the paper and watch/listen to the presentation. The embedded film works without problems with Google Chrome but you may experience difficulties watching if you are using other browsers.
Kress, G.R. (1990). Reading images. Deakin, Victoria: Deakin univ., Press.
Kress, G. R., & Van Leeuwen, T. (1996). Reading images: The grammar of visual design. Psychology Press.
Kress, G.R. & Van Leeuwen, T. (2006). Reading images: the grammar of visual design. (2. ed.) London: Routledge. (extract at Google books)
Bateman, J and Schmidt, H (2012) Multimodal Film Analysis: How Films Mean. London: Routledge
Burn A & Parker D (2001), ‘Making your Mark: Digital Inscription, Animation, and a New Visual Semiotic’, Education, Communication & Information, Vol. 1, No. 2, pp 155-179
van Leeuwen, T (1985) ‘Rhythmic Structure of the Film Text’, in van Dijk (ed), Discourse and Communication, Berlin: de Gruyter.