Lecture 11 · Forward pass

Forward-pass microscope

Expose the arithmetic inside each node: contributions → preactivation → activation → logits → probabilities.

z vs hedge contributionssoftmax
Predict first: If x₁ increases slightly, which hidden unit will change most? Do not answer from the diagram alone; use the signs and magnitudes of its incoming weights.
1. weighted contributions2. preactivation z3. activation h4. logits5. softmax