Transcription of Self-Attention Generative Adversarial Networks
{{id}} {{{paragraph}}}
Self-Attention Generative Adversarial NetworksHan Zhang1 2 Ian Goodfellow2 Dimitris Metaxas1 Augustus Odena2 AbstractIn this paper, we propose the Self-Attention Gen-erative Adversarial Network (SAGAN) whichallows attention -driven, long-range dependencymodeling for image generation tasks. Traditionalconvolutional GANs generate high-resolution de-tails as a function of only spatially local pointsin lower-resolution feature maps. In SAGAN, de-tails can be generated using cues from all featurelocations. Moreover, the discriminator can checkthat highly detailed features in distant portionsof the image are consistent with each other. Fur-thermore, recent work has shown that generatorconditioning affects GAN performance.
to represent them, optimization algorithms may have trou- ... known to be unstable and sensitive to the choices of hyper-parameters. Several works have attempted to stabilize the ... layer by a scale parameter and add back the input feature map. Therefore, the final output is given by, y i = o i + x i; (3) where
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}