Transcription of Abstract - arXiv
{{id}} {{{paragraph}}}
Example: biology
Abstract - arXiv
Offline Reinforcement Learning as One BigSequence Modeling ProblemMichael JannerQiyang LiSergey LevineUniversity of California at Berkeley{janner, learning (RL) is typically concerned with estimating stationarypolicies or single-step models, leveraging the Markov property to factorize prob-lems in time. However, we can also view RL as a generic sequence modelingproblem, with the goal being to produce a sequence of actions that leads to asequence of high rewards. Viewed in this way, it is tempting to consider whetherhigh-capacity sequence prediction models that work well in other domains, suchas natural-language processing, can also provide effective solutions to the RLproblem. To this end, we explore how RL can be tackled with the tools of sequencemodeling, using a Transformer architecture to model distributions over trajectoriesand repurposing beam search as a planning algorithm.}
problem, with the goal being to produce a sequence of actions that leads to a sequence of high rewards. Viewed in this way, it is tempting to consider whether ... representational capacity of the sequence model rather than algorithmic sophistication.
Loading..
Tags:
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: