(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation - - PowerPoint PPT Presentation

clojure
SMART_READER_LITE
LIVE PREVIEW

(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation - - PowerPoint PPT Presentation

(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation Entity linking Reflector overview Represent the data A bit code Learnings MOTIVATION practicing Clojure How will the backend &


slide-1
SLIDE 1

@Sojoner

ENTITY LINKING IN FOR FUN

(CLOJURE)

slide-2
SLIDE 2

AGENDA

Motivation

Entity linking

Reflector overview

Represent the data

A bit code

Learnings

slide-3
SLIDE 3

MOTIVATION

practicing Clojure backend & frontend

using core.async

learning about FP

Gödel-Escher-Bach like information revealer

How will the Wikipedia reflect a given text when thrown against it ?

slide-4
SLIDE 4

is the task of determining the identity of entities mentioned in text […] Wikipedia

You can improve search experience by enriching documents with entities e.g facet search for persons locations a.o

ENTITY LINKING

& SEARCH

slide-5
SLIDE 5

ENTITY LINKING

SYSTEMS & CHALLENGES

Simple stuff ;-)

  • 1. spotting
  • 2. searching
  • 3. disambiguation
  • 4. prune irrelevant stuff
slide-6
SLIDE 6

REFLECTOR OVERVIEW

& TECHNOLOGIES

slide-7
SLIDE 7

REFLECTOR OVERVIEW

& TECHNOLOGIES

slide-8
SLIDE 8

REFLECTOR OVERVIEW

& TECHNOLOGIES

slide-9
SLIDE 9

REFLECTOR OVERVIEW

& SYSTEM

titles articles

categories

back front storage

slide-10
SLIDE 10

REPRESENT THE DATA

& DATA EXAMPLES

slide-11
SLIDE 11

REPRESENT THE DATA

& DATA EXAMPLES AMBIGUOUS UNIQUE

slide-12
SLIDE 12

A BIT CODE

& BACK

slide-13
SLIDE 13

A BIT CODE

& BACK

main starts components

http is the external interface

communicator sends massages

linker does entity linking with solr

search searches pages in ES

wikigraph computes paths

switch glues the core.async channels together

slide-14
SLIDE 14

A BIT CODE

& BACK

slide-15
SLIDE 15

A BIT CODE

& BACK

slide-16
SLIDE 16

A BIT CODE

& BACK

slide-17
SLIDE 17

A BIT CODE

& BACK

slide-18
SLIDE 18

A BIT CODE

& BACK

slide-19
SLIDE 19

A BIT CODE

& FRONT

core handles communication and app state

ui OM components

channels just the definitions

slide-20
SLIDE 20

A BIT CODE

& FRONT

slide-21
SLIDE 21

A BIT CODE

& FRONT

slide-22
SLIDE 22

A BIT CODE

& FRONT

slide-23
SLIDE 23

A BIT CODE

& FRONT

slide-24
SLIDE 24

LEARNINGS

& FIN

Structure clojure code via components

Same language full stack

Async communication from front to back

use favorite datastores with clojure

learn about wikipedia

slide-25
SLIDE 25

SHOULDERS

& FIN

https://github.com/OpenSextant/SolrTextTagger https://github.com/stuartsierra/component https://github.com/clojure/core.async https://github.com/swannodette/om https://github.com/elasticsearch/elasticsearch-river-wikipedia

https://github.com/matthiasn/BirdWatch