Transcription of arXiv:2005.14165v4 [cs.CL] 22 Jul 2020
{{id}} {{{paragraph}}}
Example: marketing
arXiv:2005.14165v4 [cs.CL] 22 Jul 2020
Language Models are Few-Shot LearnersTom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla DhariwalArvind NeelakantanPranav ShyamGirish SastryAmanda AskellSandhini AgarwalAriel Herbert-VossGretchen KruegerTom HenighanRewon ChildAditya RameshDaniel M. ZieglerJeffrey WuClemens WinterChristopher HesseMark ChenEric SiglerMateusz LitwinScott GrayBenjamin ChessJack ClarkChristopher BernerSam McCandlishAlec RadfordIlya SutskeverDario AmodeiOpenAIAbstractRecent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-trainingon a large corpus of text followed by fine-tuning on a specific task.
Figure 1.2: Larger models make increasingly efficient use of in-context information. We show in-context learning performance on a simple task requiring the model to remove random symbols from a word, both with and without a
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: