Predict first: If a model has enough capacity but the learning rate is poor, what should the loss curve and decision surface look like? How would that differ from a model that simply cannot represent the boundary?
Lectures 11–12 · Bringing it together
Use the same dataset and initialization to distinguish representational limits, optimization problems, and generalization gaps.