SAGA: A Fast Incremental Gradient Method With Support for ...

papers.nips.cc

SAGA is preferred over SVRG both theoretically and in practice. For neural networks, where no theory is available for either method, the storage of gradients is generally more expensive than the

  With, Methods, Support, Fast, Saga, Derating, Incremental, A fast incremental gradient method with support