Machine translation evaluation through post-editing measures in audio description
Fernández Torné, Ana (Universitat Autònoma de Barcelona)

Date: 2016
Abstract: The number of accessible audiovisual products and the pace at which audiovisual content is made accessible need to be increased, reducing costs whenever possible. The implementation of different technologies which are already available in the translation field, specifically machine translation technologies, could help reach this goal in audio description for the blind and partially sighted. Measuring machine translation quality is essential when selecting the most appropriate machine translation engine to be implemented in the audio description field for the English-Catalan language combination. Automatic metrics and human assessments are often used for this purpose in any specific domain and language pair. This article proposes a methodology based on both objective and subjective measures for the evaluation of five different and free online machine translation systems. Their raw machine translation outputs and the post-editing effort that is involved are assessed using eight different scores. Results show that there are clear quality differences among the systems assessed and that one of them is the best rated in six out of the eight evaluation measures used. This engine would therefore yield the best freely machine-translated audio descriptions in Catalan presumably reducing the audio description process turnaround and costs.
Note: Departament de Traducció i Interpretació
Rights: Aquest document està subjecte a una llicència d'ús Creative Commons. Es permet la reproducció total o parcial i la comunicació pública de l'obra, sempre que no sigui amb finalitats comercials, i sempre que es reconegui l'autoria de l'obra original. No es permet la creació d'obres derivades. Creative Commons
Language: Anglès
Document: Article ; recerca ; Versió publicada
Subject: Accessibility ; Media accessibility ; Audio description ad ; Audiovisual translation ; Machine assisted translation ; Post-editing ; Catalan language
Published in: Intralinea on line translation journal, Vol. 18 (2016) , ISSN 1827-000X

Adreça alternativa: https://www.intralinea.org/archive/article/2200


10 p, 825.0 KB

The record appears in these collections:
Articles > Research articles
Articles > Published articles

 Record created 2017-03-30, last modified 2023-07-24



   Favorit i Compartir