Stochastic gradient descent and Adam are optimization algorithms that update model parameters from estimated gradients, but ...