Transcription of networks - arXiv.org e-Print archive
{{id}} {{{paragraph}}}
Example: confidence
networks - arXiv.org e-Print archive
Overcoming catastrophic forgetting in neuralnetworksJames Kirkpatricka, Razvan Pascanua, Neil Rabinowitza, Joel Venessa, Guillaume Desjardinsa,Andrei A. Rusua, Kieran Milana, John Quana, Tiago Ramalhoa, Agnieszka Grabska-Barwinskaa,Demis Hassabisa, Claudia Clopathb, Dharshan Kumarana, and Raia HadsellaaDeepMind, London, N1C 4AG, United KingdombBioengineering department, Imperial College London, SW7 2AZ, London, United KingdomAbstractThe ability to learn tasks in a sequential fashion is crucial to the development ofartificial intelligence. Neural networks are not, in general, capable of this and ithas been widely thought thatcatastrophic forgettingis an inevitable feature ofconnectionist models. We show that it is possible to overcome this limitation andtrain networks that can maintain expertise on tasks which they have not experiencedfor a long time. Our approach remembers old tasks by selectively slowing downlearning on the weights important for those tasks.
Overcoming catastrophic forgetting in neural networks James Kirkpatrick a, Razvan Pascanu , Neil Rabinowitz , Joel Veness , Guillaume Desjardinsa, Andrei A. Rusu a, Kieran Milan , John Quan , Tiago Ramalho , Agnieszka Grabska-Barwinska a, Demis Hassabis a, Claudia Clopathb, Dharshan Kumaran , and Raia Hadsella aDeepMind, London, N1C 4AG, United Kingdom …
Loading..
Tags:
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: