Search Relevance Organizational Maturity Model MICES 2019 Berlin | - - PowerPoint PPT Presentation

▶
search relevance organizational maturity model
SMART_READER_LITE
LIVE PREVIEW

Search Relevance Organizational Maturity Model MICES 2019 Berlin | - - PowerPoint PPT Presentation

Mar 19, 2024 186 likes •383 views

Search Relevance Organizational Maturity Model MICES 2019 Berlin | Eric Pugh | @dep4b Search Relevance Organizational Maturity Model The Missing Ingredient MICES 2019 Berlin | Eric Pugh | @dep4b People are the Magic Ingredient!

slide-1
SLIDE 1

Search Relevance Organizational Maturity Model

MICES 2019 Berlin | Eric Pugh | @dep4b

slide-2
SLIDE 2

Search Relevance Organizational Maturity Model “The Missing Ingredient”

MICES 2019 Berlin | Eric Pugh | @dep4b

slide-3
SLIDE 3

MICES 2019 Berlin | Eric Pugh | @dep4b

People are the Magic Ingredient!

Sebastian leading the conversation at yesterday’s E-commerce Search for Product Managers class

3

slide-4
SLIDE 4

4

slide-5
SLIDE 5

5

slide-6
SLIDE 6

MICES 2019 Berlin | Eric Pugh | @dep4b OSC’s Maturity Model for Search Teams

6

Business Understand User Needs Search Tech Experiment Driven UX Content Enrichment Advanced Data Inventory Business stakeholders use real-time KPIs Producing quality data from analytics Develops custom plugins Ops supports A/B testing &

  • ffline tests

Innovative Discovery (chatbots, etc) NLP & Data science team Varied, complex, large-scale data Practitioner Occasional reporting Some user testing / basic analytics Complex relevance config; uses plugins Available, but complex experiments UI supports findability Taxonomies / Ontologies Moderate data complexity Baseline Business impact not measured No query logs or user testing Stock or moderately tweak config Test search manually, deployed rarely 10 search links on page Minor enrichment (synonyms) Very simple data model

slide-7
SLIDE 7

MICES 2019 Berlin | Eric Pugh | @dep4b OSC’s Maturity Model for Search Teams

7

Business Understand User Needs Search Tech Experiment Driven UX Content Enrichment Advanced Data Inventory Business stakeholders use real-time KPIs Producing quality data from analytics Develops custom plugins Ops supports A/B testing &

  • ffline tests

Innovative Discovery (chatbots, etc) NLP & Data science team Varied, complex, large-scale data Practitioner Occasional reporting Some user testing / basic analytics Complex relevance config; uses plugins Available, but complex experiments UI supports findability Taxonomies / Ontologies Moderate data complexity Baseline Business impact not measured No query logs or user testing Stock or moderately tweak config Test search manually, deployed rarely 10 search links on page Minor enrichment (synonyms) Very simple data model

slide-8
SLIDE 8

MICES 2019 Berlin | Eric Pugh | @dep4b OSC’s Maturity Model for Search Teams

8

Business Understand User Needs Search Tech Experiment Driven UX Content Enrichment Advanced Data Inventory Business stakeholders use real-time KPIs Producing quality data from analytics Develops custom plugins Ops supports A/B testing &

  • ffline tests

Innovative Discovery (chatbots, etc) NLP & Data science team Varied, complex, large-scale data Practitioner Occasional reporting Some user testing / basic analytics Complex relevance config; uses plugins Available, but complex experiments UI supports findability Taxonomies / Ontologies Moderate data complexity Baseline Business impact not measured No query logs or user testing Stock or moderately tweak config Test search manually, deployed rarely 10 search links on page Minor enrichment (synonyms) Very simple data model

slide-9
SLIDE 9

MICES 2019 Berlin | Eric Pugh | @dep4b OSC’s Maturity Model for Search Teams

9

Business Understand User Needs Search Tech Experiment Driven UX Content Enrichment Advanced Data Inventory Business stakeholders use real-time KPIs Producing quality data from analytics Develops custom plugins Ops supports A/B testing &

  • ffline tests

Innovative Discovery (chatbots, etc) NLP & Data science team Varied, complex, large-scale data Practitioner Occasional reporting Some user testing / basic analytics Complex relevance config; uses plugins Available, but complex experiments UI supports findability Taxonomies / Ontologies Moderate data complexity Baseline Business impact not measured No query logs or user testing Stock or moderately tweak config Test search manually, deployed rarely 10 search links on page Minor enrichment (synonyms) Very simple data model

slide-10
SLIDE 10

MICES 2019 Berlin | Eric Pugh | @dep4b

Maturity Model Lays

  • ut where you are,

now do we have the team to get there?

10

slide-11
SLIDE 11

MICES 2019 Berlin | Eric Pugh | @dep4b Step 1: Brainstorming “The Work” of the Search Team

11

slide-12
SLIDE 12

MICES 2019 Berlin | Eric Pugh | @dep4b

Step 2: Cluster the Tasks

12

slide-13
SLIDE 13

MICES 2019 Berlin | Eric Pugh | @dep4b Step 2: Clustering Tasks Together

13

slide-14
SLIDE 14

MICES 2019 Berlin | Eric Pugh | @dep4b Step 3: Naming the Roles

14

slide-15
SLIDE 15

MICES 2019 Berlin | Eric Pugh | @dep4b

Trying to Learn to Rank before they can Walk!

15

slide-16
SLIDE 16

MICES 2019 Berlin | Eric Pugh | @dep4b

“App and Ops Focused” Team Starting to Think about Relevance

16

slide-17
SLIDE 17

MICES 2019 Berlin | Eric Pugh | @dep4b

“Search is a Team Sport”

17

slide-18
SLIDE 18

MICES 2019 Berlin | Eric Pugh | @dep4b

Thanks!

Lets talk: epugh@o19s.com www.o19s.com @dep4b

18