Visual Interpretation of Film Translation
DOI:
https://doi.org/10.46991/TSTP/2023.3.2.080Keywords:
Visual interpretation, audiovisual translation, intermodal translation, artificial intelligenceAbstract
Which references are considered necessary for understanding and empathy in visual interpretation of translated feature films? This is the starting point for this article on audiovisual translation and visual interpretation. Visual interpretation is a scientifically relatively unexplored field of research that can be linked to both cognitive science, semiotics, and audiovisual translation. Just over a decade ago, there was little or no research into visual interpretation in Sweden or the Nordic countries. The first Swedish research initiatives started in the form of workshops in sight interpretation organized by Jana Holsanova, Mats Andrén and Cecilia Wadensjö (2010-2014) and resulted in a report on sight interpretation (Holsanova et al. 2016). The task of the visual interpreter is to select and describe relevant information such as events, environments, people, characters and their appearance, facial expressions, gestures, and body movements in television programs, cinema, or theater performances by giving verbal descriptions of visual scenes to evoke vivid mental images and audience empathy. Visual interpretation should contribute to our understanding and convey impressions and mood. It is a so-called intermodal translation, because the visual interpreter transfers content from image to words (Jakobson 1959; Reviers 2017). Through the language, those who listen should be able to follow along in the action. But they should not only know what is happening, but also be able to laugh at the same time as everyone else, understand why a certain sound occurs when it is heard and know who is doing what. It is thus about a completion of what is missing in the multimodal interaction (Holsanova 2020: 4). According to professional visual interpreters, the aim is to use a neutral voice to be clear, concise, and descriptive, so that the target group can imagine what something looks like with the help of internal images. In today’s rapid technological development, we also want to reflect on the opportunities and challenges of automated visual interpretation and translation, using ChatGPT.
References
Holsanova, Jana. 2020b. “Uncovering Scientific and Multimodal Literacy through Audio Description.” Journal of Visual Literacy, Special Issue 39(3). DOI: 10.1080/1051144X.2020.1826219
Holsanova, Jana. 2020a. Att beskriva det som syns men inte hörs. Om syntolkning. Humanetten, 44 (2020): 125-146. DOI: 10.15626/hn.20204406
Holsanova, Jana, Johansson, Roger, and Lyberg-Åhlander, Viveka. 2020. “How the Blind Audiences Receive and Experience Audio Descriptions of Visual Events.” - a project presentation. Book of Extended Abstracts. 3rd Swiss Conference on Barrier-free Communication, 39-41.
Holsanova, Jana. 2016. “Cognitive Approach to Audio Description.” In Researching Audio Description: New Approaches edited by A. Matamala. & P. Orero, 49–73. London: Palgrave Macmillan.
Holsanova, Jana, Wadensjö, Cecilia, and Andrén, Mats (Eds.). 2016. “Syntolkning – forskning och praktik.” Lund University Cognitive Studies 166 / Myndigheten för tillgängliga medier, rapport nr. 4.
Holsanova, Jana, Hildén, Anita, Salmson, Maria, and Kesen Tundell, Veronica. 2015. “Syntolkning och uppläst text - en studie om hur användarna vill ha det.” In Med riktlinjer för audiovisuella medier. Stockholm: Tundell Salmson Lär.
Pedersen, Jan. 2016. “Översättningsvetenskaplig forskning om syntolkning,” i Holsanova, Jana Andrén, Mats & Wadensjö, Cecilia (eds.), “Syntolkning – forskning och praktik.” Lund University Cognitive Studies 166/Myndigheten för tillgängliga medier, rapport nr. 4: 53–59.
Remael, Aline, Reviers, Nina, and Vandekerckhove, Reinhild. 2016. “Audiovisual Translation. Theoretical and Methodological Challenges: Some Research Trends.” In Audiovisual Translation. Theoretical and Methodological Challenges, special issue, Target 28(2): 248–260, edited by Y. Gambier & S. Ramos Pinto.
Remael, Aline, and Reviers, Nina. 2015. “Recreating Multimodal Cohesion in Audio-Description: The Case of Audio-Subtitling in Dutch Multilingual Films.” New Voices in Translation Studies 13: 50–78.
Reviers, Nina. 2018. A Corpus-Based Study into the Linguistic Features of a New, Multimodal Text Type [PhD thesis]. University of Antwerp. Summary.
Reviers, Nina. 2017. Audio Description in Dutch. A Corpus-Based Study into the Linguistic Features of a New, Multimodal Text Type [PhD thesis]. University of Antwerp.
Stärnfeldt, Emmeli. 2020. Handbok för syntolkning Malmö stad. Stadskontoret Malmö.
Vercauteren, Gert. 2016. A Narratological Approach to Content Selection in Audio Description [PhD thesis]. University of Antwerp.
Riktlinjer för undertextning i Sverige - Medietextarna, 2020. Accessed August 25, 2023.https://portal.research.lu.se/portal/sv/projects/audio-description--research-and-practices(043b472d-afcd-4b8f-a829-73236270c740).html
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Thérèse Eng
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.