Human evaluation of three machine translation systems: from quality to attitudes by professional translators
DOI:
https://doi.org/10.35869/vial.v0i18.3366Keywords:
machine translation, quality evaluation, human evaluation, automatic metrics, post-editing effortAbstract
This article aims to compare three machine translation systems with a focus on human evaluation. The systems under analysis are a domain-adapted statistical machine translation system, a domain-adapted neural machine translation system and a generic machine translation system. The comparison is carried out on translation from Spanish into German with industrial documentation of machine tool components and processes. The focus is on the human evaluation of the machine translation output, specifically on: fluency, adequacy and ranking at the segment level; fluency, adequacy, need for post-editing, ease of post-editing, and mental effort required in post-editing at the document level; productivity (post-editing speed and post-editing effort) and attitudes. Emphasis is placed on human factors in the evaluation process.
Downloads
Downloads
Published
Issue
Section
License
Revistas_UVigo es el portal de publicación en acceso abierto de las revistas de la Universidade de Vigo. La puesta a disposición y comunicación pública de las obras en el portal se efectúa bajo licencias Creative Commons (CC).
Para cuestiones de responsabilidades, propiedad intelectual y protección de datos consulte el aviso legal de la Universidade de Vigo.