Matching fashion products with image similarity Eddie Bell - - PowerPoint PPT Presentation

matching fashion products with image similarity eddie
SMART_READER_LITE
LIVE PREVIEW

Matching fashion products with image similarity Eddie Bell - - PowerPoint PPT Presentation

Matching fashion products with image similarity Eddie Bell eddie@lyst.com @ejlbell 2 we collect the world of fashion into a customisable shopping experience 3 3 A python data startup that happens to be in fashion 4 What makes us di fg


slide-1
SLIDE 1

Matching fashion products with image similarity

slide-2
SLIDE 2

2

Eddie Bell eddie@lyst.com @ejlbell

slide-3
SLIDE 3

3 3

we collect the world of fashion into a customisable shopping experience

slide-4
SLIDE 4

A python data startup that happens to be in fashion

4

slide-5
SLIDE 5

5

What makes us difgerent?

All data is scraped from retailers 400 spiders (scrapy), 9000 designers Almost everything is automated SEO, recommendation, classification, sales This architecture comes with a few problems

slide-6
SLIDE 6

6

Duplicates

slide-7
SLIDE 7

7

Why do we get duplicates

There is no ISBN for fashion

inter-retailer intra-retailer intra-retailer burberry selfridges

slide-8
SLIDE 8

8

How we used to fjnd duplicates

Lucene fuzzy string matching yoox.com 3000 products called ‘dress’ doesn’t really work 7000 products called ‘shirt’

slide-9
SLIDE 9

9

BRISK image descriptors

How we detect duplicates now

Leutenegger, Chli and Siegwart BRISK: Binary Robust Invariant Scalable Keypoints. ICCV 2011: 2548-2555.

slide-10
SLIDE 10

10

How we detect duplicates now

Brisk Octaves

slide-11
SLIDE 11

11

From descriptors to image similarity

k-means n x 64 n x 1 bag of words 1 x k

slide-12
SLIDE 12

12

Architecture

Started in Storm / Java very painful Ended up in Celery much nicer Matching is done in elastic search

slide-13
SLIDE 13

13

Architecture

slide-14
SLIDE 14

Results

14

slide-15
SLIDE 15

Bonus Colour variants

15

slide-16
SLIDE 16

Bonus Matching sets

16

slide-17
SLIDE 17

Bonus Model detection

17

slide-18
SLIDE 18

Moderation

18

slide-19
SLIDE 19

19

What’s next?

Reverse image search Similar textual features Dual image / text vector embeddings

slide-20
SLIDE 20

thank you