Randomized SVD: Catching the Top Directions
An interactive live film: the spectrum of a large matrix and how much of each singular direction a random sketch catches; a flat spectrum fails and power iteration repairs it. Find the fewest power iterations.
Narration
Here is a large matrix, seen through its singular values: the back row of bars, falling from left to right. We want its top five singular directions, without computing the full SVD.
Randomized SVD multiplies A by a few random vectors: k plus p of them, five plus five oversampling. Every column of A times omega is a random mixture of the columns of A.
The rest of the narration is in the book's Companion.
More from Chapter 8
Interactive1:49SVD: Rotate, Stretch, RotateChapter 8
Preview1:31Energy from Singular Values: Rebuild a Picture Layer by LayerChapter 8
Preview1:33Double Descent at the Interpolation ThresholdChapter 8
Preview1:32The Marchenko-Pastur Law and the Escaping EigenvalueChapter 8
Preview1:43Eckart-Young: the Best Low-Rank ApproximationChapter 8
Preview1:46The Pseudoinverse: the Shortest SolutionChapter 8
Preview1:31Polar Decomposition: Stretch, then RotateChapter 8