about
Self-Attention Generative Adversarial Networks [pdf] (arxiv.org)
15 points by stablemap on May 23, 2018 | hide | past | pdf | discuss on HN

In plain words: Each part of the image can look at every other part to decide what details to draw, instead of nearby pixels, and the checker does the same to catch mismatched details. On ImageNet this raised the image-quality score to 52.52, beating the old best.

Abstract · Self-Attention Generative Adversarial Networks

In this paper, we propose the Self-Attention Generative Adversarial Network (SAGAN) which allows attention-driven, long-range dependency modeling for image generation tasks. Traditional convolutional GANs generate high-resolution details as a function of only spatially local points in lower-resolution feature maps. In SAGAN, details can be generated using cues from all feature locations. Moreover, the discriminator can check that highly detailed features in distant portions of the image are consistent with each other. Furthermore, recent work has shown that generator conditioning affects GAN performance. Leveraging this insight, we apply spectral normalization to the GAN generator and find that this improves training dynamics. The proposed SAGAN achieves the state-of-the-art results, boosting the best published Inception score from 36.8 to 52.52 and reducing Frechet Inception distance from 27.62 to 18.65 on the challenging ImageNet dataset. Visualization of the attention layers shows that the generator leverages neighborhoods that correspond to object shapes rather than local regions of fixed shape.

Han Zhang, Ian Goodfellow, Dimitris Metaxas, Augustus Odena
arXiv:1805.08318 · stat.ML, cs.LG · submitted May 21, 2018 · updated Jun 14, 2019
abstract · pdf · html

add comment on HN
Also discussed: May 2018 (1 point, 0 comments) · May 2018 (3 points, 0 comments)