PDF4PRO ⚡AMP

Modern search engine that looking for books and documents around the web

Example: dental hygienist

Neural Discrete Representation Learning

Neural Discrete Representation LearningAaron van den useful representations without supervision remains a key challenge inmachine Learning . In this paper, we propose a simple yet powerful generativemodel that learns such Discrete representations. Our model, the Vector Quantised-Variational AutoEncoder (VQ-VAE), differs from VAEs in two key ways: theencoder network outputs Discrete , rather than continuous, codes; and the prioris learnt rather than static. In order to learn a Discrete latent Representation , weincorporate ideas from vector quantisation (VQ). Using the VQ method allows themodel to circumvent issues of posterior collapse - where the latents are ignoredwhen they are paired with a powerful autoregressive decoder - typically observedin the VAE framework.

1 Introduction Recent advances in generative modelling of images [38, 12, 13, 22, 10], audio [37, 26] and videos [20, 11] have yielded impressive samples and applications [24, 18]. At the same time, challenging tasks such as few-shot learning [34], domain adaptation [17], or reinforcement learning [35] heavily

Loading..

Tags:

  Introduction, Learning, Representation, Reinforcement, Reinforcement learning, Representation learning

Information

Domain:

Source:

Link to this page:

Please notify us if you found a problem with this document:

Spam in document Broken preview Other abuse

Transcription of Neural Discrete Representation Learning

Related search queries