The interactive film is in the book's Companion

Play it, pause it, turn it and drag it with Mathematics for AI and Machine Learning.

Get the book

Entropic Optimal Transport and Sinkhorn

Chapter 14 · Mathematics for AI and Machine Learning · Advanced · 1:38

An interactive live film: the transport plan as 3D bars, Sinkhorn rescaling rows and columns step by step, and the temperature epsilon blurring the plan from sharp transport to the independent coupling.

Narration

On the left wall is a distribution p over eight positions, on the back wall a distribution q. A transport plan moves the mass of p onto q: the bar in row i and column j says how much goes from position i to position j.

Moving mass far is expensive: the cost is the squared distance. Optimal transport keeps the bars on a narrow path near the diagonal.

The rest of the narration is in the book's Companion.

More from Chapter 14

Interactive1:42KL Divergence: Two Orders, Two Different FitsChapter 14Preview1:57Entropy, Cross-Entropy and KL: the Wasted BitsChapter 14Preview1:58The ELBO: a Hill under the EvidenceChapter 14Preview1:45Wasserstein Distance: the Cheapest Way to Move the EarthChapter 14Preview2:04Fisher Information: the Curvature of KLChapter 14Preview1:53The InfoNCE BoundChapter 14