O'Brien, Sharon, Towards predicting post-editing productivity, Machine Translation 25(3), 2012, 197-215.

Type of publication: 
article
Language: 
English
Abstract in a language other than English: 

Machine Translation (MT) quality is generally measured via automatic metrics, producing scores that have no meaning for translators who are required to post-edit MT output or for project managers who have to plan and budget for translation projects. This paper investigates correlations between two such automatic metrics (General Text Matcher and Translation Edit Rate) and post-editing productivity. For the purposes of this paper, productivity is measured via processing speed and cognitive measures of effort using eye tracking as a tool. Processing speed, average fixation time and count are found to correlate well with the scores for groups of segments. Segments with high GTM and TER scores require substantially less time and cognitive effort than medium or low-scoring segments. Future research involving score thresholds and confidence estimation is suggested.

Authors from TREC: 
Year: 
Sunday, January 1, 2012
Keywords in a language other than English: 
Post-editing productivity
cognitive effort
automatic metrics for MT
eye tracking
English keywords: 
cognitive effort
eye tracking

 

Project initiator:        
https://wa.amu.edu.pl/wa/en/
 
 
 
 

 
 
 
  univ-warsaw_.jpg
 

 

Campus d'excel·lència internacional U A B