Transcription of Deep Reinforcement Learning with Double Q-learning - arXiv
{{id}} {{{paragraph}}}
Example: bachelor of science
Deep Reinforcement Learning with Double Q-learning - arXiv
Deep Reinforcement Learning with Double Q-learningHado van HasseltandArthur GuezandDavid SilverGoogle DeepMindAbstractThe popular Q- Learning algorithm is known to overestimateaction values under certain conditions. It was not previouslyknown whether, in practice, such overestimations are com-mon, whether they harm performance, and whether they cangenerally be prevented. In this paper, we answer all thesequestions affirmatively. In particular, we first show that therecent DQN algorithm, which combines Q- Learning with adeep neural network, suffers from substantial overestimationsin some games in the Atari 2600 domain. We then show thatthe idea behind the Double Q- Learning algorithm, which wasintroduced in a tabular setting, can be generalized to workwith large-scale function approximation.
that even if the value estimates are on average correct, esti-mation errors of any source can drive the estimates up and away from the true optimal values. The lower bound in Theorem 1 decreases with the num-ber of actions. This is an artifact of considering the lower bound, which requires very specific values to be attained.
Loading..
Tags:
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: