Image2Vec: Learning image representation for reasoning Lerrel J. - - PowerPoint PPT Presentation

▶

Dec 08, 2022 6 likes •132 views

Image2Vec: Learning image representation for reasoning Lerrel J. Pinto, Gunnar A. Sigurdsson Word2Vec Learning the meaning of words along with semantic relationships Vector representations encode linguistic regularities and patterns

SLIDE 1

Image2Vec: Learning image representation for reasoning

Lerrel J. Pinto, Gunnar A. Sigurdsson

SLIDE 2

Word2Vec

Learning the meaning of words along with

semantic relationships

Vector representations encode linguistic

regularities and patterns

Sparse representations > Dense representations
Learning enforces contextually similar words get

encoded similarly

Want to play around with Word2Vec? : https://www.kaggle.com/c/word2vec-nlp-tutorial

SLIDE 3

So What?

SLIDE 4

So What?

‘Rome’ ~ ‘Paris’ - ‘France’ +‘Italy’ ‘Queen’ ~ ‘King’ - ‘Man’ + ‘Woman’ ‘Tiger Woods’ ~ ‘Michael Jordan’ - ‘basketball’ + ‘golf’

Vector Arithmetic holds!

Check out more word arithmetic :http://www.thisplusthat.me http://nlp.stanford.edu/projects/glove/

SLIDE 5

Can we do this with images?

SLIDE 6

=

= +

Can we do this?

SLIDE 7

Image2Vec

Learning a ‘Deep’ Dictionary of attributes

SLIDE 8

Image2Vec

Learning a ‘Deep’ Dictionary of attributes CNNs to learn interpretable dictionary

SLIDE 9

Image2Vec

Learning a ‘Deep’ Dictionary of attributes CNNs to learn interpretable dictionary Can we supervise the learning of attributes?

SLIDE 10

How do we learn this?

SLIDE 11

How do we learn this?

SLIDE 12