Posterior Collapse: When Latents Vanish into the Prior

Variational autoencoders optimize the evidence lower bound, balancing two opposing objectives: reconstruction fidelity and divergence from the prior distribution.

The reconstruction term encourages the encoder to retain maximum detail. Simultaneously, the relative entropy term pulls each posterior distribution toward the standard Gaussian prior.

The rest of the narration is in the book's Companion.