Predict first: Select an edge. Before revealing the gradient, decide its sign: should increasing this weight raise or lower the loss for the current target?
Lecture 12 · Backpropagation
See a parameter gradient as upstream gradient × local derivative, then connect it directly to the SGD update.