1 00:00:07,280 --> 00:00:10,720 EASIT: Easy Access for Social Inclusion Training 2 00:00:12,520 --> 00:00:14,880 This is unit 1, Media accessibility; 3 00:00:15,080 --> 00:00:17,680 element 4, What is media accessibility?; 4 00:00:17,880 --> 00:00:20,880 video lecture "Understanding the audiovisual text". 5 00:00:21,120 --> 00:00:24,400 I am Anna Matamala, from Universitat Autònoma de Barcelona. 6 00:00:24,760 --> 00:00:29,000 And in this short lecture I will explain the concept of audiovisual text 7 00:00:29,120 --> 00:00:31,760 and link it to that of multimodality. 8 00:00:32,320 --> 00:00:35,920 When we talk about a text, we often think about a written text: 9 00:00:36,040 --> 00:00:38,640 a newspaper article, a written essay. 10 00:00:38,880 --> 00:00:43,080 However, the concept of text is not limited to the written word. 11 00:00:43,640 --> 00:00:48,120 One can talk about an "audio text", about an "audiovisual text", 12 00:00:48,320 --> 00:00:50,680 even about a "multimodal text". 13 00:00:51,040 --> 00:00:54,080 Let's focus on the concept of "audiovisual text", 14 00:00:54,280 --> 00:00:57,760 which is at the centre of audiovisual translation studies. 15 00:00:58,560 --> 00:00:59,720 An audiovisual text 16 00:00:59,840 --> 00:01:04,240 is made of audio (or acoustic) elements and visual elements. 17 00:01:04,600 --> 00:01:08,000 These elements can include both linguistic (or verbal) 18 00:01:08,400 --> 00:01:11,400 and non-linguistic (or non-verbal) elements. 19 00:01:12,040 --> 00:01:16,160 Non-linguistic sound elements would include music, sound effects, 20 00:01:16,280 --> 00:01:19,160 special effects and paralinguistic sounds, 21 00:01:19,280 --> 00:01:22,840 such as sneezes, clicks, cries, coughs, etc., 22 00:01:23,040 --> 00:01:25,880 but also silence, which can be really meaningful. 23 00:01:26,280 --> 00:01:29,440 These sounds can be part of the story being told 24 00:01:29,760 --> 00:01:31,760 known as diegetic sounds 25 00:01:32,000 --> 00:01:36,280 or may have been added afterwards, during the postproduction process 26 00:01:36,600 --> 00:01:39,240 extradiegetic sounds, in this case. 27 00:01:39,520 --> 00:01:42,320 Imagine someone is playing the piano in a movie. 28 00:01:42,640 --> 00:01:44,680 The music is part of the story. 29 00:01:45,120 --> 00:01:48,560 The characters in the story hear this music. 30 00:01:48,960 --> 00:01:50,520 This sound is diegetic. 31 00:01:51,120 --> 00:01:54,880 Now imagine that in a scene piano music is added. 32 00:01:55,080 --> 00:01:59,240 The characters are not hearing the music because it has been added 33 00:01:59,360 --> 00:02:00,960 during the film editing. 34 00:02:01,240 --> 00:02:03,760 This sound is extradiegetic. 35 00:02:04,440 --> 00:02:08,360 In respect of the sound elements of a linguistic nature there are: 36 00:02:08,480 --> 00:02:10,720 monologues, narrations, 37 00:02:10,840 --> 00:02:12,600 dialogues, polylogues and lyrics. 38 00:02:13,080 --> 00:02:15,080 These linguistic elements can be 39 00:02:15,240 --> 00:02:17,560 in the main language of the audiovisual text 40 00:02:17,800 --> 00:02:21,640 or in another language, especially in multilingual productions. 41 00:02:22,320 --> 00:02:25,640 Among the visual elements which are non-linguistic, 42 00:02:25,960 --> 00:02:28,840 we can find images and all related aspects 43 00:02:28,960 --> 00:02:31,280 (photography, light, costumes, etc.), 44 00:02:31,680 --> 00:02:35,000 and visual features associated with text on screen 45 00:02:35,440 --> 00:02:39,640 (for instance, the colour, font type or size of a caption on screen). 46 00:02:40,560 --> 00:02:44,120 Finally, visual elements of a linguistic nature 47 00:02:44,400 --> 00:02:46,640 include different types of text on screen: 48 00:02:46,840 --> 00:02:50,080 logos, film credits, superimposed captions, graphs, 49 00:02:50,200 --> 00:02:52,000 maps, subtitles, etc. 50 00:02:52,280 --> 00:02:55,480 Also, written information which is part of the plot: 51 00:02:56,040 --> 00:02:58,120 a sign at the entrance of a city, 52 00:02:58,320 --> 00:03:00,680 an email written on a laptop screen. 53 00:03:01,160 --> 00:03:05,840 And again, these visual elements can be diegetic or extradiegetic. 54 00:03:06,320 --> 00:03:09,240 They can be part of the story or may have been added 55 00:03:09,360 --> 00:03:11,400 during the postproduction phase. 56 00:03:12,080 --> 00:03:14,640 The distribution of audio and visual elements, 57 00:03:15,080 --> 00:03:17,640 of linguistic and non-linguistic elements, 58 00:03:17,760 --> 00:03:19,840 may change in each audiovisual text. 59 00:03:20,240 --> 00:03:23,680 Prototypical examples, such as contemporary Hollywood films, 60 00:03:24,040 --> 00:03:26,280 will include elements of all types, 61 00:03:26,480 --> 00:03:30,280 whereas non-prototypical examples may be lacking one element. 62 00:03:30,600 --> 00:03:33,800 For instance, a silent film with intertitles. 63 00:03:34,600 --> 00:03:38,720 Audio and visual elements can have different types of relationship: 64 00:03:39,120 --> 00:03:44,040 the information being presented orally may be reinforced visually 65 00:03:44,400 --> 00:03:48,120 or, on the contrary, the information may be contradictory. 66 00:03:48,400 --> 00:03:50,800 If you are interested in this topic, 67 00:03:50,920 --> 00:03:54,200 I recommend you to read the papers by Patrick Zabalbeascoa. 68 00:03:54,840 --> 00:03:58,880 In any case, if you are a professional and work on an audiovisual text 69 00:03:59,040 --> 00:04:02,880 or if you are a researcher and want to analyse an audiovisual text, 70 00:04:03,760 --> 00:04:06,400 there are some questions that you may want to ask yourself: 71 00:04:06,760 --> 00:04:08,920 Who created the audiovisual text? 72 00:04:09,320 --> 00:04:10,760 When was it created? 73 00:04:10,960 --> 00:04:11,720 Why? 74 00:04:11,960 --> 00:04:14,040 For whom was it created? 75 00:04:14,200 --> 00:04:16,880 What type of audiovisual text is it? 76 00:04:17,160 --> 00:04:20,160 Where and how will the audience enjoy this text? 77 00:04:20,360 --> 00:04:23,560 At what stage is it? Is it finished or not? 78 00:04:23,680 --> 00:04:25,640 Is it content on the making? 79 00:04:26,240 --> 00:04:29,760 Replying to these questions will allow you to better understand 80 00:04:30,040 --> 00:04:33,480 the source audiovisual text that you may want to translate 81 00:04:33,680 --> 00:04:35,600 or render accessible. 82 00:04:36,120 --> 00:04:39,440 Similarly, you can ask most of the previous questions 83 00:04:39,600 --> 00:04:44,280 about the target audiovisual text that you want to create or analyse. 84 00:04:45,080 --> 00:04:48,160 Although I have put the focus on the audiovisual text, 85 00:04:48,360 --> 00:04:50,880 a key concept you should also be familiar with 86 00:04:51,000 --> 00:04:52,920 is that of "multimodal text". 87 00:04:53,240 --> 00:04:57,480 A multimodal text can be understood as a text that combines 88 00:04:57,600 --> 00:05:00,640 more than one mode in a specific context. 89 00:05:01,040 --> 00:05:03,720 In this sense, an audiovisual text 90 00:05:03,840 --> 00:05:06,560 could be seen as a type of multimodal text. 91 00:05:06,760 --> 00:05:08,640 But let me posit another example. 92 00:05:09,000 --> 00:05:11,920 A written text could be combined with images 93 00:05:12,440 --> 00:05:14,880 and that would make it a multimodal text. 94 00:05:15,000 --> 00:05:18,360 In fact, we could take this example a step further 95 00:05:18,680 --> 00:05:23,440 and make sure that the images contain alternative written text 96 00:05:23,800 --> 00:05:27,480 and that the written text is also available in an audio version. 97 00:05:28,040 --> 00:05:30,160 Multimodal texts construct meaning 98 00:05:30,280 --> 00:05:32,680 through the interaction of different modes. 99 00:05:33,080 --> 00:05:37,360 Multimodal texts can also be an excellent way to convey meaning 100 00:05:37,480 --> 00:05:38,760 through different modes, 101 00:05:38,880 --> 00:05:42,560 guaranteeing access to a wider range of users. 102 00:05:43,040 --> 00:05:46,760 In any case, always bear in mind that a text is not only 103 00:05:46,880 --> 00:05:50,320 a printed paper or a digital file with words in it. 104 00:05:50,640 --> 00:05:54,880 A text here goes beyond the concept of written text. 105 00:05:56,200 --> 00:05:58,840 This video lecture has been prepared by Anna Matamala, 106 00:05:58,960 --> 00:06:01,120 from Universitat Autònoma de Barcelona. 107 00:06:01,320 --> 00:06:04,880 You can reach me at anna.matamala@uab.cat. 108 00:06:06,120 --> 00:06:07,040 Pictures. 109 00:06:07,640 --> 00:06:11,160 Source: pixabay.com, pexels.com. 110 00:06:11,680 --> 00:06:15,160 License: Pixabay License, Pexels License. 111 00:06:16,720 --> 00:06:18,920 The project EASIT has received funding 112 00:06:19,040 --> 00:06:20,480 from the European Commission 113 00:06:20,600 --> 00:06:22,880 under the Erasmus+ Strategic Partnerships 114 00:06:23,000 --> 00:06:24,640 for Higher Education programme, 115 00:06:24,840 --> 00:06:31,880 grant agreement 2018-1-ES01-KA203-05275. 116 00:06:32,200 --> 00:06:35,600 The European Commission support for the production of this publication 117 00:06:35,720 --> 00:06:38,280 does not constitute an endorsement of the contents, 118 00:06:38,400 --> 00:06:40,800 which reflect the views only of the authors, 119 00:06:40,920 --> 00:06:43,000 and the Commission cannot be held responsible 120 00:06:43,120 --> 00:06:46,800 for any use which may be made of the information contained therein. 121 00:06:47,480 --> 00:06:49,920 This work is licensed under a Creative Commons 122 00:06:50,040 --> 00:06:53,880 Attribution-ShareAlike 4.0 International License. 123 00:06:54,480 --> 00:06:56,240 Partners of the EASIT project: 124 00:06:56,680 --> 00:06:58,920 Universitat Autònoma de Barcelona, 125 00:06:59,200 --> 00:07:01,440 Università degli Studi di Trieste, 126 00:07:01,560 --> 00:07:03,160 Universidade de Vigo, 127 00:07:03,480 --> 00:07:05,520 Stiftung Universität Hildesheim, 128 00:07:05,760 --> 00:07:06,920 SDI München, 129 00:07:07,160 --> 00:07:08,640 Dyslexiförbundet, 130 00:07:08,800 --> 00:07:10,560 Radiotelevisija Slovenija, 131 00:07:10,760 --> 00:07:12,000 Zavod Risa. 132 00:07:18,920 --> 00:07:22,440 EASIT: Easy Access for Social Inclusion Training