Transcription of Abstract - arxiv.org
{{id}} {{{paragraph}}}
Example: quiz answers
Abstract - arxiv.org
Representation Learning withContrastive Predictive CodingAaron van den supervised learning has enabled great progress in many applications, unsu-pervised learning has not seen such widespread adoption, and remains an importantand challenging endeavor for artificial intelligence. In this work, we propose auniversal unsupervised learning approach to extract useful representations fromhigh-dimensional data, which we call Contrastive Predictive Coding. The key in-sight of our model is to learn such representations by predicting the future inlatentspace by using powerful autoregressive models. We use a probabilistic contrastiveloss which induces the latent space to capture information that is maximally usefulto predict future samples.
important stepping stone towards robust and generic representation learning. Despite its importance, unsupervised learning is yet to see a breakthrough similar to supervised learning: modeling high-level representations from raw observations remains elusive. Further, it
Loading..
Tags:
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: