Dual-view Hashing MOHAMMAD RASTEGARI JONGHYUN CHOI SHOBEIR - - PowerPoint PPT Presentation

▶
dual view hashing
SMART_READER_LITE
LIVE PREVIEW

Dual-view Hashing MOHAMMAD RASTEGARI JONGHYUN CHOI SHOBEIR - - PowerPoint PPT Presentation

Sep 28, 2022 118 likes •283 views

Predictable Dual-view Hashing MOHAMMAD RASTEGARI JONGHYUN CHOI SHOBEIR FAKHRAEI* HAL DAUM III LARRY S. DAVIS University of Maryland, College Park, MD, USA Integrate information from different modalities Text - Image Human Riding

slide-1
SLIDE 1

Predictable Dual-view Hashing

MOHAMMAD RASTEGARI JONGHYUN CHOI SHOBEIR FAKHRAEI* HAL DAUMÉ III LARRY S. DAVIS

University of Maryland, College Park, MD, USA

slide-2
SLIDE 2

ICML 2013 | Atlanta | Predictable Dual-view Hashing

Integrate information from different modalities

  • Text - Image

Human Riding Horse

  • Sound - Text
slide-3
SLIDE 3

ICML 2013 | Atlanta | Predictable Dual-view Hashing

Dual-View Hashing

Textual Space Visual Space

Human riding a horse Person laughing at restaurant Cow standing in a farm

010111010 101010101 110010101 Hamming Space

slide-4
SLIDE 4

ICML 2013 | Atlanta | Predictable Dual-view Hashing

1 1 1 001 101

Binary code assignments with splits

slide-5
SLIDE 5

ICML 2013 | Atlanta | Predictable Dual-view Hashing

  • 20
  • 15
  • 10
  • 5

5 10 15 20 25

  • 2

2 4 6 8 10 12 14

01?101

Predictability

slide-6
SLIDE 6

ICML 2013 | Atlanta | Predictable Dual-view Hashing

  • 20
  • 15
  • 10
  • 5

5 10 15 20 25

  • 2

2 4 6 8 10 12 14

100110 010110 110110 010011 01?101

Predictability

slide-7
SLIDE 7

ICML 2013 | Atlanta | Predictable Dual-view Hashing

Predictability

  • 20
  • 15
  • 10
  • 5

5 10 15 20 25

  • 2

2 4 6 8 10 12 14

CCA

slide-8
SLIDE 8

ICML 2013 | Atlanta | Predictable Dual-view Hashing

Predictability

  • 20
  • 15
  • 10
  • 5

5 10 15 20 25

  • 2

2 4 6 8 10 12 14

PDH CCA

margin

slide-9
SLIDE 9

ICML 2013 | Atlanta | Predictable Dual-view Hashing

Optimization

Solved by a block coordinate descent algorithm

slide-10
SLIDE 10

ICML 2013 | Atlanta | Predictable Dual-view Hashing

Predictable dual-view hashing

1101 0010 1010 0101 1110 0101 1110 1010 0101 1001

label Modality 2 Modality 1

slide-11
SLIDE 11

ICML 2013 | Atlanta | Predictable Dual-view Hashing

Predictable dual-view hashing

1101 0010 1010 0101 1110 0101 1110 1010 0101 1001

label Modality 2 Modality 1

slide-12
SLIDE 12

ICML 2013 | Atlanta | Predictable Dual-view Hashing

Image  image (with 32 bits)

slide-13
SLIDE 13

ICML 2013 | Atlanta | Predictable Dual-view Hashing

Text  Image (with 32 bits)

slide-14
SLIDE 14

ICML 2013 | Atlanta | Predictable Dual-view Hashing

Image Retrieval

Pascal Sentence [Farhadi et al] Sun Attribute [Peterson et al]

slide-15
SLIDE 15

Thank you

Predictable Dual-view Hashing

Mohammad Rastegari, Jonghyun Choi, Shobeir Fakhraei*, Hal Daumé III and Larry S. Davis

University of Maryland, College Park, MD, USA