Entropic Optimal Transport and Sinkhorn
An interactive live film: the transport plan as 3D bars, Sinkhorn rescaling rows and columns step by step, and the temperature epsilon blurring the plan from sharp transport to the independent coupling.
Narration
On the left wall is a distribution p over eight positions, on the back wall a distribution q. A transport plan moves the mass of p onto q: the bar in row i and column j says how much goes from position i to position j.
Moving mass far is expensive: the cost is the squared distance. Optimal transport keeps the bars on a narrow path near the diagonal.
The rest of the narration is in the book's Companion.
More from Chapter 14
Interactive1:42KL Divergence: Two Orders, Two Different FitsChapter 14
Preview1:57Entropy, Cross-Entropy and KL: the Wasted BitsChapter 14
Preview1:58The ELBO: a Hill under the EvidenceChapter 14
Preview1:45Wasserstein Distance: the Cheapest Way to Move the EarthChapter 14
Preview2:04Fisher Information: the Curvature of KLChapter 14
Preview1:53The InfoNCE BoundChapter 14