Conference article

Translation Quality Assessment: A Brief Survey on Manual and Automatic Methods

Lifeng Han

Gareth J. F. Jones

Alan F. Smeaton

Download article

Published in: Proceedings of the First Workshop on Modelling Translation - Translatology in the Digital Age

Linköping Electronic Conference Proceedings 179:3, p. 15-33

NEALT Proceedings Series 46:3, p. 15-33

Show more +

Published: 2021-05-24

ISBN: 978-91-7929-613-1

ISSN: 1650-3686 (print), 1650-3740 (online)

Abstract

To facilitate effective translation modeling and translation studies, one of the crucial questions to address is how to assess translation quality. From the perspectives of accuracy, reliability, repeatability and cost, translation quality assessment (TQA) itself is a rich and challenging task. In this work, we present a high-level and concise survey of TQA methods, including both manual judgement criteria and automated evaluation metrics, which we classify into further detailed sub-categories. We hope that this work will be an asset for both translation model researchers and quality assessment researchers. In addition, we hope that it will enable practitioners to quickly develop a better understanding of the conventional TQA field, and to find corresponding closely relevant evaluation solutions for their own needs. This work may also serve inspire further development of quality assessment and evaluation methodologies for other natural language processing (NLP) tasks in addition to machine translation (MT), such as automatic text summarization (ATS), natural language understanding (NLU) and natural language generation (NLG). 1

Keywords

No keywords available

References

No references available

Citations in Crossref