Predict first: A hidden ReLU unit is a nonlinear feature, but its boundary is still a line. How can several such units create a curved-looking or enclosed decision region?
h₁ activation
h₂ activation
h₃ activation
output near 0output near 1black line = hᵢ preactivation 0