Transcription of arXiv:1301.3781v3 [cs.CL] 7 Sep 2013
{{id}} {{{paragraph}}}
Example: marketing
arXiv:1301.3781v3 [cs.CL] 7 Sep 2013
Efficient Estimation of Word Representations inVector SpaceTomas MikolovGoogle Inc., Mountain View, ChenGoogle Inc., Mountain View, CorradoGoogle Inc., Mountain View, DeanGoogle Inc., Mountain View, propose two novel model architectures for computing continuous vector repre-sentations of words from very large data sets. The quality of these representationsis measured in a word similarity task, and the results are compared to the previ-ously best performing techniques based on different types of neural networks. Weobserve large improvements in accuracy at much lower computational cost, ittakes less than a day to learn high quality word vectors from a billion wordsdata set. Furthermore, we show that these vectors provide state-of-the-art perfor-mance on our test set for measuring syntactic and semantic word IntroductionMany current NLP systems and techniques treat words as atomic units - there is no notion of similar-ity between words, as these are represented as indices in a vocabulary.
For all the following models, the training complexity is proportional to O = E T Q; (1) where E is number of the training epochs, T is the number of …
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: