The interactive film is in the book's Companion

Play it, pause it, turn it and drag it with Mathematics for AI and Machine Learning.

Get the book

Randomized SVD: Catching the Top Directions

Chapter 8 · Mathematics for AI and Machine Learning · Advanced · 1:47

An interactive live film: the spectrum of a large matrix and how much of each singular direction a random sketch catches; a flat spectrum fails and power iteration repairs it. Find the fewest power iterations.

Narration

Here is a large matrix, seen through its singular values: the back row of bars, falling from left to right. We want its top five singular directions, without computing the full SVD.

Randomized SVD multiplies A by a few random vectors: k plus p of them, five plus five oversampling. Every column of A times omega is a random mixture of the columns of A.

The rest of the narration is in the book's Companion.

More from Chapter 8

Interactive1:49SVD: Rotate, Stretch, RotateChapter 8Preview1:31Energy from Singular Values: Rebuild a Picture Layer by LayerChapter 8Preview1:33Double Descent at the Interpolation ThresholdChapter 8Preview1:32The Marchenko-Pastur Law and the Escaping EigenvalueChapter 8Preview1:43Eckart-Young: the Best Low-Rank ApproximationChapter 8Preview1:46The Pseudoinverse: the Shortest SolutionChapter 8Preview1:31Polar Decomposition: Stretch, then RotateChapter 8