Transcription of Cross-lingual Language Model Pretraining
{{id}} {{{paragraph}}}
Example: bankruptcy
Cross-lingual Language Model Pretraining
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau . Facebook AI Research Facebook AI Research Sorbonne Universit es Universit e Le Mans Abstract et al., 2013) or natural Language inference (Bow- man et al., 2015; Williams et al., 2017). Al- Recent studies have demonstrated the ef- though there has been a surge of interest in learn- ficiency of generative Pretraining for En- [ ] 22 Jan 2019. ing general-purpose sentence representations, re- glish natural Language understanding. In search in that area has been essentially monolin- this work, we extend this approach to mul- gual, and largely focused around English bench- tiple languages and show the effectiveness marks (Conneau and Kiela, 2018; Wang et al., of Cross-lingual Pretraining . We propose 2018).
Cross-lingual Language Model Pretraining Guillaume Lample Facebook AI Research Sorbonne Universit´es glample@fb.com Alexis Conneau Facebook AI Research
Loading..
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: