(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation - - PowerPoint PPT Presentation

▶
clojure
SMART_READER_LITE
LIVE PREVIEW

(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation - - PowerPoint PPT Presentation

Jan 31, 2024 480 likes •741 views

(CLOJURE) ENTITY LINKING IN FOR FUN @Sojoner AGENDA Motivation Entity linking Reflector overview Represent the data A bit code Learnings MOTIVATION practicing Clojure How will the backend &

slide-1
SLIDE 1

@Sojoner

ENTITY LINKING IN FOR FUN

(CLOJURE)

slide-2
SLIDE 2

AGENDA

★

Motivation

★

Entity linking

★

Reflector overview

★

Represent the data

★

A bit code

★

Learnings

slide-3
SLIDE 3

MOTIVATION

★

practicing Clojure backend & frontend

★

using core.async

★

learning about FP

★

Gödel-Escher-Bach like information revealer

★

How will the Wikipedia reflect a given text when thrown against it ?

slide-4
SLIDE 4

★

is the task of determining the identity of entities mentioned in text […] Wikipedia

★

You can improve search experience by enriching documents with entities e.g facet search for persons locations a.o

ENTITY LINKING

& SEARCH

slide-5
SLIDE 5

ENTITY LINKING

SYSTEMS & CHALLENGES

Simple stuff ;-)

  • 1. spotting
  • 2. searching
  • 3. disambiguation
  • 4. prune irrelevant stuff
slide-6
SLIDE 6

REFLECTOR OVERVIEW

& TECHNOLOGIES

slide-7
SLIDE 7

REFLECTOR OVERVIEW

& TECHNOLOGIES

slide-8
SLIDE 8

REFLECTOR OVERVIEW

& TECHNOLOGIES

slide-9
SLIDE 9

REFLECTOR OVERVIEW

& SYSTEM

titles articles

categories

back front storage

slide-10
SLIDE 10

REPRESENT THE DATA

& DATA EXAMPLES

slide-11
SLIDE 11

REPRESENT THE DATA

& DATA EXAMPLES AMBIGUOUS UNIQUE

slide-12
SLIDE 12

A BIT CODE

& BACK

slide-13
SLIDE 13

A BIT CODE

& BACK

★

main starts components

★

http is the external interface

★

communicator sends massages

★

linker does entity linking with solr

★

search searches pages in ES

★

wikigraph computes paths

★

switch glues the core.async channels together

slide-14
SLIDE 14

A BIT CODE

& BACK

slide-15
SLIDE 15

A BIT CODE

& BACK

slide-16
SLIDE 16

A BIT CODE

& BACK

slide-17
SLIDE 17

A BIT CODE

& BACK

slide-18
SLIDE 18

A BIT CODE

& BACK

slide-19
SLIDE 19

A BIT CODE

& FRONT

★

core handles communication and app state

★

ui OM components

★

channels just the definitions

slide-20
SLIDE 20

A BIT CODE

& FRONT

slide-21
SLIDE 21

A BIT CODE

& FRONT

slide-22
SLIDE 22

A BIT CODE

& FRONT

slide-23
SLIDE 23

A BIT CODE

& FRONT

slide-24
SLIDE 24

LEARNINGS

& FIN

★

Structure clojure code via components

★

Same language full stack

★

Async communication from front to back

★

use favorite datastores with clojure

★

learn about wikipedia

slide-25
SLIDE 25

SHOULDERS

& FIN

https://github.com/OpenSextant/SolrTextTagger https://github.com/stuartsierra/component https://github.com/clojure/core.async https://github.com/swannodette/om https://github.com/elasticsearch/elasticsearch-river-wikipedia

https://github.com/matthiasn/BirdWatch