Why Learned Optimizers Outperform Standard Optimizers like Adam

Google Brain research reveals how learned optimizers outperform hand-designed algorithms like Adam by discovering novel optimization mechanisms automatically.