Skip to content
Sign in

Generative Models

Generative Adversarial Nets

L4 · ExpertGoodfellow, Pouget-Abadie, Mirza, Xu, Warde-Farley, Ozair, Courville, Bengio · 2014 · NeurIPS 2014

TL;DR

Trains two networks against each other, a generator that fabricates samples and a discriminator that tries to spot fakes, until the fakes are convincing.

Why it matters

GANs were the breakthrough that made sharp, realistic image synthesis possible and dominated generative modeling for years. The adversarial-training idea reappears across the field.

Key ideas

  • A minimax game: the generator fools the discriminator; the discriminator resists.
  • No explicit likelihood is needed, the discriminator provides the training signal.
  • At equilibrium the generator's samples are indistinguishable from real data.
  • Notoriously tricky to train (instability, mode collapse).

Related concepts

deep-learningmultimodal-ai
Read the paper on arXiv