A method for analysing multimodal research material: audio description in focus

Författare

• Maija Hirvonen University of Tampere
• Liisa Tiittula University of Helsinki

DOI:

https://doi.org/10.61200/mikael.129674

Nyckelord:

methodology, multimodality, translation analysis, audio description

Abstract

A modern text is seldom a stand-alone product consisting merely of writing, but a multimodal body of signs from different meaning-making systems. The multimodal context and the new forms of translation, in which the concept of ‘text’ goes beyond language, have become increasingly relevant in contemporary translation research and practice. In order to study multimodal context and intermodal forms of translation accurately, research methodology has to be adapted. The aim of this article is to present a systematic method for analyzing multimodal material, or 'text', from the point of view of translation analysis, and intermodal translation that takes place in this context. The method is applied to study audio description, a form of translation in which visual information is compensated by verbal descriptions in order to make a text more intelligible to blind and visually impaired audiences. As an illustration, the article looks at how space is constructed in a film and its audio description, and presents a model which allows it to expose and contrast the multiple modes of meaning-making that are at play: in this case, the visual, auditory and linguistic representations of space. The outcome is a systematic presentation of complex audiovisual material in a textual form. The method can be applied to cases whose research material is multimodal and/or which undertake the challenge of understanding intermodal translation.