Transcription of BLEU: a Method for Automatic Evaluation of Machine …
{{id}} {{{paragraph}}}
BLEU: a MethodforAutomaticEvaluationofMachineTra nslationKishore Papineni,SalimRoukos,ToddWard,andWei-Jin gZhuIBMT. J. monthstofinishandin-volve proposea methodofautomaticma-chinetranslationeval uationthatis quick,inexpensive,andlanguage-independen t,thatcorrelateshighlywithhumanevalu-ati on, presentthismethodasanauto-matedunderstud yto (MT)weighmany aspectsoftranslation,includingade-quacy, fidelity, andfluencyofthetranslation(Hovy,1999;Whi teandO Connell,1994).Acompre-hensive catalogofMTevaluationtechniquesandtheirr ichliteratureis givenbyReeder(2001).Forthemostpart,these varioushumanevaluationap-proachesarequit eexpensive (Hovy, 1999).More-over, they cantakeweeksormonthsto believe thatMTprogressstemsfromevaluationandthat thereis a logjamoffruitfulresearchideaswaitingtobe releasedfrom1 Sowecallourmethodthebilingualevaluationu nderstudy, automaticevaluationthatisquick,language- independent, machinetranslationis to a professionalhumantranslation,thebetterit judgethequalityofa
stems from evaluation and that there is a logjam of fruitful research ideas waiting to be released from 1So we call our method the bilingual evaluation understudy, BLEU. the evaluation bottleneck. Developers would bene-fit from an inexpensive automatic evaluation that is quick, language-independent, and correlates highly with human evaluation.
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}