Your Business Depends on Supporting Open Source! Doug Turnbull, - - PowerPoint PPT Presentation

your business depends on supporting open source
SMART_READER_LITE
LIVE PREVIEW

Your Business Depends on Supporting Open Source! Doug Turnbull, - - PowerPoint PPT Presentation

Your Business Depends on Supporting Open Source! Doug Turnbull, http://o19s.com/doug CTO OpenSource Connections MICES 2018 MICES ONE VENDOR TO SELL IT ALL Hi my name is... MICES AND IN ONE PLATFORM BIND THEM Hi my name is... MICES


slide-1
SLIDE 1

MICES

Your Business Depends

  • n Supporting Open

Source!

Doug Turnbull, http://o19s.com/doug CTO OpenSource Connections MICES 2018

slide-2
SLIDE 2

MICES

Hi my name is...

ONE VENDOR TO SELL IT ALL

slide-3
SLIDE 3

MICES

Hi my name is...

AND IN ONE PLATFORM BIND THEM

slide-4
SLIDE 4

MICES Such Core Wow Core Secondary Amazon Average Amazon Merchant W e a r e h e r e : S e a r c h / I R i m p

  • r

t a n t t

  • u

r b u s i n e s s ! Nearly Secondary

… We have skin in the 'search game'... "If it’s a core business function — do it yourself, no matter what." - Joel Spolsky

Core value-ness

slide-5
SLIDE 5

MICES

FREEEEEEEEEDOM!!!!

We needs ta control oaaour destiny!!

slide-6
SLIDE 6

MICES Amazon Average Shopify Merchant Us

… Most of us have skin in the 'search game'...

Freedom requirements

Customization: complete Licensing: certain Mindshare: static Customization: some Licensing: certain Mindshare: broad community Customization: little/no Licensing: who cares Mindshare: doesn't matter (aka 'bus factor') (aka 'will the software go away')

slide-7
SLIDE 7

MICES Amazon Average Shopify Merchant Us

… Most of us have skin in the 'search game'...

Resource Constraints

Search Team? 100s? 1000s? Working on search - able to build custom stack 10s working on search

  • must 'stand on

shoulders of others' somehow One merchant?

slide-8
SLIDE 8

MICES

Empowerment "Always be yourself, unless you can be

  • batman. Then always be

batman"

Actually having the tools to do our job

slide-9
SLIDE 9

MICES

Wasted $$ when we don't have good tools

Ideation Industry Plunger Invented (1850-1900) Plunger, a fancy plumbers tool Out of box 'open source' Out of box 'open source' Table Stakes Table Stakes Secret Sauce Secret Sauce Wasting our limited resources: every plumber reinvents the wheel/plunger Faster time to market, more

  • pportunity to

differentiate Where does your team spend it's time?

slide-10
SLIDE 10

MICES

We need to commoditize repeat/busy work

Ideation Industry Commodity Plunger Invented (1850-1900) Anyone can plunge their toilet Plunging, a plumber's method

slide-11
SLIDE 11

MICES

Example: LTR building blocks getting easier

Academia Industry Commodity LambdaMART (2010) Solr LTR Plugin (2015) ES LTR Plugin (2017) Siloed LambdaMART wheels reinvented

slide-12
SLIDE 12

MICES

Two ways to solve these probs

VS

Product Open Source

  • Innovates faster /

specific focus

  • Less freedom

(mindshare, license, extensibility, IP)

  • Innovates slower /

broader focus

  • More freedom

(mindshare, license, extensibility, IP)

slide-13
SLIDE 13

MICES

Products, trade freedom for features

  • Lost freedom: Historically, tend to be acquired or be deprecated (Endeca,

FAST, GSA)

  • 'Cognitive Search' - Search products lately depend on black-box, (oft over

promised) hard to manage/customize machine learning

  • Pro Services - Search product companies rely on a lot of pro services to

make it work on for your specific problem (especially w/ relevance)

HOW DARE YOU QUESTION THE ALMIGHTY COGNITIVE SEARCH ENGINE YOU PUNY MORTAL

(note many teams don't need this freedom, so products can be a good thing!)

slide-14
SLIDE 14

MICES

...Open source can waste our time...

Ideation Industry Plunger Invented (1850-1900) Plunger, a fancy plumbers tool Out of box 'open source' Out of box 'open source' "Table Stakes" Grunt work you have to do "Table Stakes" Grunt work you have to do Secret Sauce Secret Sauce ~2010? Today Stand up Solr, index data, throw a UI in front of it!

Significant gaps in what we need from

  • pen source

Let's see why...

slide-15
SLIDE 15

MICES

10 ? Is modern search?

OR

slide-16
SLIDE 16

MICES

ical? Is modern search?

OR

slide-17
SLIDE 17

MICES Analytics

Is modern relevance?

search refine click Judgments

OR

Knobs & dials

Knobs & Dials https://commons.wikimedia.org/wiki/File:USS_Bowfin_-_Dials,_Valves_and_Knobs_(8326504403).jpg USS Bowfin - Dials, Valves and Knobs, Daniel Ramirez

LTR

slide-18
SLIDE 18

MICES

Whatcha get:

Search Analytics Store

Enrich

Whatcha need:

App/Browser Telemetry

Serving Search System Learn Content Stage

Content Features

slide-19
SLIDE 19

MICES

Modern serving search system reqs

  • Match beyond the Lexical
  • Arbitrary tensor/vector math
  • Built-in intent classification
  • Aware of the user
  • NLP-first query/doc analysis

Are Solr/ES up to the task?

slide-20
SLIDE 20

MICES

Lack of cohesive e-commerce search community

  • Lack of perspective on commonly

solved problems

  • Beyond tech to techniques and

strategies

  • We keep reinventing the wheel
  • ver and over and over...
slide-21
SLIDE 21

MICES

slide-22
SLIDE 22

MICES

slide-23
SLIDE 23

MICES

Not open sourcing harms us all

Often an attitude against sharing/open sourcing at orgs, which in the long-term collectively harms mid-sized companies, wasting limited resources reinventing, not innovating

slide-24
SLIDE 24

MICES

...Baby open source proj… ...we want it to grow up…

slide-25
SLIDE 25

MICES

...many threats…

slide-26
SLIDE 26

MICES Building this rounded rolly thing!

If only someone would build 'Connections' in 'Open Source'

Building this rounded rolly thing! Building this rounded rolly thing! Building this rounded rolly thing! Building this rounded rolly thing!

slide-27
SLIDE 27

MICES

Our mission: empowering relevance teams Our BHAG: In 10 years, we want open source to be solution for the best relevance teams

YOU can do this, without vendors, including US!

slide-28
SLIDE 28

MICES

Our perspective: turn silos into plungers

Protect Sea Turtles What wheels do we see reinvented? Who can we partner with to fund/build open source? How can we market/community build? How can we add product vision for broader adoption?

slide-29
SLIDE 29

MICES

Most common gaps we see in e-commerce search OSS

  • Search Analytics
  • Merchandising-oriented search management

tools

  • Standard ways of interpreting/using clickstream
  • Product Diversity & Serendipity, not just

relevance

  • Practices for balancing relevance w/ inventory,

profit, etc

slide-30
SLIDE 30

MICES

Partners Needed

TO BUILD OPEN SOURCE Join the Search Relevance Community

http://o19s.com/slack (projects (Elastic LTR!), chat, conferences (Haystack!), book authors, and more…)