The interactive film is in the book's Companion

Play it, pause it, turn it and drag it with Mathematics for AI and Machine Learning.

Get the book

Linear Regression Uses All Four Subspaces

Chapter 3 · Mathematics for AI and Machine Learning · Advanced · 1:41

An interactive live film: in the space of targets, y splits into a prediction in C(X) and a residual in N(X^T); in the space of coefficients, a redundant feature makes N(X) a line along which predictions do not change. Find the coefficients with no null-space part.

Narration

Three samples and three features. The third feature is the first one measured in other units: exactly twice it.

On the left is the space of targets. The columns of X span the blue plane, the column space, and the target y sits off it.

The rest of the narration is in the book's Companion.

More from Chapter 3

Interactive1:47The Four Fundamental SubspacesChapter 3Preview1:45Orthonormal Matrices: Lengths Survive, Even through Many LayersChapter 3Preview1:36Euler's Formula: Complex Multiplication Is a RotationChapter 3