Gradient Episodic Memory for Continual Learning

proceedings.neurips.cc

In this section, we propose Gradient Episodic Memory (GEM), a model for continual learning, as introduced in Section 2. The main feature of GEM is an episodic memory M t, which stores a subset of the observed examples from task t. For simplicity, we assume integer task descriptors, and use them to index the episodic memory.

  Memory, Derating, Episodic, Gradient episodic memory