stock
tags
optimization
blog
Minibatched Scaled Conjugate Gradient with Gradient Accumulation
An overview of SCG and how gradient accumulation can help optimization when using minibatches for training neural nets.
Jason Stock
|
04.13.2023