It's Not Just Size That Matters: Small Language Models Are ...

Small Language Models Are Also Few-Shot Learners Timo Schick1;2 and Hinrich Schütze1 1 Center for Information and Language Processing, LMU Munich, Germany 2 Sulzer GmbH, Munich, Germany timo.schick@sulzer.de Abstract When scaled to hundreds of billions of pa-rameters, pretrained language models such as GPT-3 (Brown et al.,2020) achieve remark-

  Language, Model, Host, Learners, Language model, Shot learners