genera ve adversarial networks
play

Genera&ve Adversarial Networks NTT - PowerPoint PPT Presentation

Genera&ve Adversarial Networks NTT 2020 6 10 @JSAI2020 KS-02 AI MIRU2020


  1. ������� Genera&ve Adversarial Networks ��������� NTT ���������������� �� �� 2020 � 6 � 10 � @JSAI2020 KS-02 ��� AI – MIRU2020 �����

  2. ���� 2014. 4 � NTT ���������������� • 2017. 4 � 2020.3 ���� �2�������� • ������ �������� ������ �������� CF GAN DTLC- GAN GAN -PF GAN -PF for STFT GAN -VC [CVPR 2017] [CVPR 2018] [ICASSP 2017] [Interspeech 2017] [Interspeech 2017] �S������� ������������� CycleGAN-VC r GAN † CP- GAN † NR- GAN † Cycle GAN -VC Cycle GAN -VC2 Star GAN -VC2 [CVPR 2019] [BMVC 2019] [CVPR 2020] [EUSIPCO 2018] [ICASSP 2019] [Interspeech 2019] �I����������� ������������������ � ���������� �

  3. ���S 2014. 4 � NTT ���������������� • 2017. 4 � 2020.3 ���� �����3���� • ��������������� ���������������� CF GAN DTLC- GAN GAN -PF GAN -PF for STFT GAN -VC [CVPR 2017] [CVPR 2018] [ICASSP 2017] [Interspeech 2017] [Interspeech 2017] ������� �� I����N��� ������������� CycleGAN-VC r GAN † CP- GAN † NR- GAN † Cycle GAN -VC Cycle GAN -VC2 Star GAN -VC2 [CVPR 2019] [BMVC 2019] [CVPR 2020] [EUSIPCO 2018] [ICASSP 2019] [Interspeech 2019] ��G������N��� ����A������������� � �3�������� �

  4. GAN ����������� �4 �� → Q1. ������������� • – �� = ������������4�������� ��������� T. Karras et al., “Analyzing and Improving the Image Quality of StyleGAN,” arXiv 2019. �

  5. GAN ����������� �� �� → Q1. 5������������ • 2���� – �� = 5�������������������� ��������� ��������� T. Karras et al., “Analyzing and Improving the Image Quality of StyleGAN,” arXiv 2019. �

  6. GAN ����������� Q2. ��������������6�����?������� • �� � � �� by Monet �� ���� � � �� ���� JY. Zhu et al., “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks,” ICCV 2017. �

  7. GAN ����������� Q2. �7�������������������������� • �� � ������ �� by Monet �� �������� ���� � �� ���� JY. Zhu et al., “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks,” ICCV 2017. �

  8. GAN ����������� Q3. ��������������� • ���� ��� �� � � ��� T. Kaneko et al., “Generative Attribute Controller with Conditional Filtered Generative Adversarial Networks,” CVPR 2017. �

  9. GAN ����������� Q3. ��������������� ���������� • ����� �� �� �� ��� �� ��� ���9� http://www.kecl.ntt.co.jp/people/kaneko.takuhiro/projects/gac/index.html T. Kaneko et al., “Genera2ve A5ribute Controller with Condi2onal Filtered Genera2ve Adversarial Networks,” CVPR 2017. �

  10. GAN ���������� ( ��� ) ���� StyleGAN2 [Karras+arXiv2019] ���� ���� CycleGAN [Zhu+ICCV2017] CFGAN [Kaneko+CVPR2017] ��

  11. GAN ���������� ( ��� ) ���� ������ StyleGAN2 [Karras+arXiv2019] ������ ���� ���� CycleGAN [Zhu+ICCV2017] CFGAN [Kaneko+CVPR2017] ��

  12. �� ��� ���� ���� ��� �� �� ��(1���� �����(��)��2 † ���� † h$p://www.kecl.n$.co.jp/people/kaneko.takuhiro/#talks ��

  13. �� ��� ���� ���� ��� �� �� ��

  14. �������� ���������1���� ����� ( Generator ) ��� • ����� ����� � ������� ������4 ������4 Pictures: A. Brock et al., “Large Scale GAN Training for High Fidelity Natural Image Synthesis,” ICLR 2019. ��

  15. ������������ ��1��������������5� • ����� ������������1�� ����1�� �������5���� ����������������1��� ������� � ������� Pictures: A. Brock et al., “Large Scale GAN Training for High Fidelity Natural Image Synthesis,” ICLR 2019. ��

  16. <latexit sha1_base64="Xnt9lX2cNEUMxaHM7bxRUcRtMvU=">AB9HicbVBNS8NAEJ3Ur1q/qh69LBahHixJFfQiFL14rGA/oI1ls920SzebuLsp1tDf4cWDIl79Md78N27bHLT1wcDjvRlm5nkRZ0rb9reVWVpeWV3Lruc2Nre2d/K7e3UVxpLQGgl5KJseVpQzQWuaU6bkaQ48DhteIPrid8YUqlYKO70KJugHuC+YxgbST3EV0i/z45cbFp+NOvmCX7CnQInFSUoAU1U7+q90NSRxQoQnHSrUcO9JugqVmhNxrh0rGmEywD3aMlTgCo3mR49RkdG6SI/lKaERlP190SCA6VGgWc6A6z7at6biP95rVj7F27CRBRrKshskR9zpEM0SQB1maRE85EhmEhmbkWkjyUm2uSUMyE48y8vknq5JyWyrdnhcpVGkcWDuAQiuDAOVTgBqpQAwIP8Ayv8GYNrRfr3fqYtWasdGYf/sD6/AHauJDa</latexit> <latexit sha1_base64="QLlkCjr28Ua3oZ3AMcbE39dZsPg=">AB73icbVBNSwMxEJ31s9avqkcvwSLUS9mtgl6EohePFewHtEvJptk2NJusSVasS/+EFw+KePXvePfmLZ70NYHA4/3ZpiZF8ScaeO6387S8srq2npuI7+5tb2zW9jb2iZKELrRHKpWgHWlDNB64YZTluxojgKOG0Gw+uJ3ygSjMp7swopn6E+4KFjGBjpdYTukRh6fGkWyi6ZXcKtEi8jBQhQ61b+Or0JEkiKgzhWOu258bGT7EyjHA6zncSTWNMhrhP25YKHFHtp9N7x+jYKj0USmVLGDRVf0+kONJ6FAW2M8JmoOe9ifif105MeOGnTMSJoYLMFoUJR0aiyfOoxQlho8swUQxeysiA6wMTaivA3Bm395kTQqZe+0XLk9K1avsjhycAhHUAIPzqEKN1CDOhDg8Ayv8ObcOy/Ou/Mxa1yspkD+APn8wd9o70</latexit> ������� �M���V�N�A�� AR , Flow , VAE , GAN • �M�G� ��M� ��M� ���� ���� ��� ��6��-��-����-����-1 �� ��� �����6����1���6�-����-� �-�-��6��-����-������1��-6����� ��� (Chain Rule) ���� �F��� ����� �1������-�����-1 ���N x = f − 1 ( z ) z = f ( x ) Reference: I. Goodfellow, “NIPS 2016 Tutorial: GeneraBve Aversarial Networks,” NIPS 2016. �

  17. ������� �����c����M� AR , Flow , VAE , GAN • ��A������Nd ��F������ ����� e��� ���� �i�� �i�G ��� �7���-��-����-����-1 �� ��� ����������1��7��-����-� �-�-�����-����-������1��-������ ��� (Chain Rule) �N�i g��Va ����� �1������-�����-1 �b�� Reference: I. Goodfellow, “NIPS 2016 Tutorial: GeneraBve Aversarial Networks,” NIPS 2016. �

  18. GAN 1/4 Generative Adversarial Networks [Goodfellow+2014] • – ��� ( Generator ) ���� ( Discriminator ) � ��� ��� D Random Real image G x Real/Fake Discriminator Latent code Fake image D ( x ) Generator z G ( z ) – Min-Max ���� Generator vs. Discriminator � I. Goodfellow et al., “Generative Adversarial Nets,” NIPS 2014. ��

  19. GAN 2/4 Genera&ve Adversarial Networks [Goodfellow+2014] • – ��� ( Generator ) ���� ( Discriminator ) � ��� ��� D Random Real image G x Real/Fake Discriminator Latent code Fake image D ( x ) Generator z G ( z ) �1���9�� – Min-Max ���� Generator vs. Discriminator � Fake ����� Discriminator � ��� ��� ��� I. Goodfellow et al., “Generative Adversarial Nets,” NIPS 2014. ��

  20. GAN 3/4 Genera&ve Adversarial Networks [Goodfellow+2014] • – ��� ( Generator ) ���� ( Discriminator ) � ��� ��� D Random Real image G x Real/Fake Discriminator Latent code Fake image D ( x ) Generator z G ( z ) Real/Fake ��� – Min-Max �0�� Generator vs. Discriminator � Real/Fake ����� Generator � �������� �0� I. Goodfellow et al., “Generative Adversarial Nets,” NIPS 2014. ��

  21. GAN 4/4 Genera&ve Adversarial Networks [Goodfellow+2014] • – ��� ( Generator ) ���� ( Discriminator ) � ��� ��� D Random Real image G x Real/Fake Discriminator Latent code Fake image D ( x ) Generator z G ( z ) �������� 21 Real/Fake ��� – Min-Max ���� Generator vs. Discriminator � Generator � Discriminator � Min-Max �21 ���� Generator ����������������� I. Goodfellow et al., “Generative Adversarial Nets,” NIPS 2014. ��

  22. �� ��� ���� ���� ��� �� �� ��

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend