Adversarial Networks : When fake never looked so real Evan Ntavelis - - PowerPoint PPT Presentation

adversarial networks
SMART_READER_LITE
LIVE PREVIEW

Adversarial Networks : When fake never looked so real Evan Ntavelis - - PowerPoint PPT Presentation

Generative Adversarial Networks : When fake never looked so real Evan Ntavelis 1,2 Dr. Iason Kastanis 1 Philipp Schmid 1 {ens, iks, psd}@csem.ch 1. Robotics & Machine Learning CSEM SA 2. Computer Vision Lab ETH Zrich CSEM at a glance


slide-1
SLIDE 1

Generative Adversarial Networks: When fake never looked so real

Evan Ntavelis1,2

  • Dr. Iason Kastanis1

Philipp Schmid1 {ens, iks, psd}@csem.ch

  • 1. Robotics & Machine Learning

CSEM SA

  • 2. Computer Vision Lab

ETH Zürich

slide-2
SLIDE 2

2

CSEM at a glance – Close to industry

N A L M Z

Zürich Muttenz Neuchâtel Alpnach Landquart

83.0

Turnover (mio CHF)

450

Persons

175

Industrial clients

64

European projects

slide-3
SLIDE 3

3

Technologies in focus at CSEM

slide-4
SLIDE 4

4

Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks Zhu et al. 2017

slide-5
SLIDE 5

5

AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks} Xu et al 2018

slide-6
SLIDE 6

6

A Style-Based Generator Architecture for Generative Adversarial Networks Karras et al. 2018

slide-7
SLIDE 7

7

Semantic Image Synthesis with Spatially-Adaptive Normalization Park et al. 2019

slide-8
SLIDE 8

8

Source: datagrid.co.jp 2019

slide-9
SLIDE 9

9

Few-Shot Adversarial Learning of Realistic Neural Talking Head Models Zakharov et al. 2019

slide-10
SLIDE 10

10

Generative Adversarial Nets

  • Introduced in 2014 by Ian

Goodfellow

  • Rapidly Adopted
  • Unprecedented Generational

Quality

slide-11
SLIDE 11

11

Generative Adversarial Nets

  • An adversarial game between

two subnets:

  • The Generator
  • The Discriminator
slide-12
SLIDE 12

12

  • In the era of Fake News do highly realistic images harbor dangers to

the society?

Deep Fakes

slide-13
SLIDE 13

13

Defense Mechanisms

slide-14
SLIDE 14

14

How can we use GANs in the industry? The important question…

slide-15
SLIDE 15

15

  • Gathering data is tedious and

costly

  • Good quality labels require

even more effort

The Problem

slide-16
SLIDE 16

16

  • Adversarial Domain Adaptation
  • Train on a simulated data and

adapt for the use case

  • Data Augmentation
  • Learn how to generate new

samples to train with

  • Generate images with desired

attributes

A Solution Using Adversarial Networks

Sources: CyCADA: Cycle-Consistent Adversarial Domain Adaptation Hoffman et al. 2017, GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification Frid-Adar et al, 2018

slide-17
SLIDE 17

17

  • GANs are not a panacea
  • Nascent technology
  • Difficult to train
  • Require abundance of data
  • Clever schemes may reduce the

effort

  • Yet, very promising results
  • Worth the effort!

But…

slide-18
SLIDE 18

18

Are you interested in being part of a highly stimulating environment working on the latest Deep Learning Technologies?

We are hiring!

That’s all folks!