Lecture 10 · Fisher linear discriminant

What makes a good projection?

Large separation of projected means is not enough. Fisher’s criterion also penalizes within-class spread.

Predict first: Should the best projection always point directly from one class mean toward the other?

Rotate the projection axis

Projected distributions

Projected mean gap²—
Within variance sum—
Fisher J(w)—
Best angle—