Lecture 10 · Nonlinear features

Feature lifting solves what a line cannot

A classifier can remain linear in its parameters while becoming nonlinear in the original input space.

Predict first: XOR cannot be separated by a line in (x₁,x₂). What single extra feature would make it trivial?

Original space

Extra feature view