Transcription of BLEU: a Method for Automatic Evaluation of Machine …
{{id}} {{{paragraph}}}
BLEU: a MethodforAutomaticEvaluationofMachineTra nslationKishore Papineni,SalimRoukos,ToddWard,andWei-Jin gZhuIBMT. J. monthstofinishandin-volve proposea methodofautomaticma-chinetranslationeval uationthatis quick,inexpensive,andlanguage-independen t,thatcorrelateshighlywithhumanevalu-ati on, presentthismethodasanauto-matedunderstud yto (MT)weighmany aspectsoftranslation,includingade-quacy, fidelity, andfluencyofthetranslation(Hovy,1999;Whi teandO Connell,1994).Acompre-hensive catalogofMTevaluationtechniquesandtheirr ichliteratureis givenbyReeder(2001).Forthemostpart,these varioushumanevaluationap-proachesarequit eexpensive (Hovy, 1999).More-over, they cantakeweeksormonthsto believe thatMTprogressstemsfromevaluationandthat thereis a logjamoffruitfulresearchideaswaitingtobe releasedfrom1 Sowecallourmethodthebilingualevaluationu nderstudy, automaticevaluationthatisquick,language- independent, machinetranslationis to a professionalhumantranslation,thebetterit judgethequalityofa machinetranslation,onemeasuresitsclosene sstooneormorereferencehumantranslationsa ccord-ingtoa ,ourMTevaluationsystemrequirestwo numerical translationcloseness corpusofgoodqualityhumanreferencetrans-l ationsWe fashionourclosenessmetricafterthehighlys uc-cessfulword errorratemetricusedbyth
tion method in this paper. 1.2 Viewpoint How does one measure translation performance? The closer a machine translation is to a professional human translation, the better it is. This is the cen-tral idea behind our proposal. To judge the quality of a machine translation, one measures its closeness to one or more reference human translations accord-
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}