P2P Web Search: Make It Light, Make It Fly Matthias Bender , Tom - - PowerPoint PPT Presentation

p2p web search make it light make it fly
SMART_READER_LITE
LIVE PREVIEW

P2P Web Search: Make It Light, Make It Fly Matthias Bender , Tom - - PowerPoint PPT Presentation

Motivation MINERVA System Model Demo P2P Web Search: Make It Light, Make It Fly Matthias Bender , Tom Crecelius, Sebastian Michel, Josiane Xavier Parreira Max-Planck-Institut f ur Informatik Saarbr ucken, Germany Jan 8, 2007 Matthias


slide-1
SLIDE 1

Motivation MINERVA System Model Demo

P2P Web Search: Make It Light, Make It Fly

Matthias Bender, Tom Crecelius, Sebastian Michel, Josiane Xavier Parreira

Max-Planck-Institut f¨ ur Informatik Saarbr¨ ucken, Germany

Jan 8, 2007

Matthias Bender P2P Web Search: Make It Light, Make It Fly 1 / 16

slide-2
SLIDE 2

Motivation MINERVA System Model Demo

Outline

1 Motivation 2 MINERVA System Model 3 Demo

Matthias Bender P2P Web Search: Make It Light, Make It Fly 2 / 16

slide-3
SLIDE 3

Motivation MINERVA System Model Demo

Motivation

Potential of peer-to-peer (P2P) systems scalable efficient resilient to failures and dynamics P2P Web Search benefit from intellectual input of user community prevent information-resource monopolies Key Challenge: Make it usable Bingo! (Focused Web crawler), MINERVA (P2P Web Search), Cloudscape (Database Backend) ⇒ Easy user deployment, common GUI

Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16

slide-4
SLIDE 4

Motivation MINERVA System Model Demo

Architectural Model

Peers autonomously and independently crawl the web build local indexes can execute queries on local indexes

Matthias Bender P2P Web Search: Make It Light, Make It Fly 4 / 16

slide-5
SLIDE 5

Motivation MINERVA System Model Demo

Architectural Model

share per-key statistics about local indexes form conceptually global directory Each directory peer responsible for randomized subset of keys

Matthias Bender P2P Web Search: Make It Light, Make It Fly 5 / 16

slide-6
SLIDE 6

Motivation MINERVA System Model Demo

Architectural Model

use directory to identify promising peers (Query Routing) send query to selected peers merge results appropriately

Matthias Bender P2P Web Search: Make It Light, Make It Fly 6 / 16

slide-7
SLIDE 7

Motivation MINERVA System Model Demo

  • 1. Step: Import Bookmark File

Click Start button to import bookmark file

Matthias Bender P2P Web Search: Make It Light, Make It Fly 7 / 16

slide-8
SLIDE 8

Motivation MINERVA System Model Demo

  • 2. Step: Crawl the Web

BINGO! fetches bookmark documents, builds classifier Web crawl starts automatically, can be stopped anytime Start Minerva

Matthias Bender P2P Web Search: Make It Light, Make It Fly 8 / 16

slide-9
SLIDE 9

Motivation MINERVA System Model Demo

  • 3. Step: Instantiate Minerva

Enter nickname, network settings Click Create Ring (or Join Ring, if exists)

Matthias Bender P2P Web Search: Make It Light, Make It Fly 9 / 16

slide-10
SLIDE 10

Motivation MINERVA System Model Demo

  • 4. Step: Update Minerva Index

Update Index imports current data from Bingo!, computes metadata

Matthias Bender P2P Web Search: Make It Light, Make It Fly 10 / 16

slide-11
SLIDE 11

Motivation MINERVA System Model Demo

  • 5. Step: Publish Metadata to directory

Use Show Widgets menu to open Received-Posts panel Click Post All button Click Refresh button to inspect directory

Matthias Bender P2P Web Search: Make It Light, Make It Fly 11 / 16

slide-12
SLIDE 12

Motivation MINERVA System Model Demo

  • 6. Step: Execute Query

Enter Query, click Execute query Inspect Results

Matthias Bender P2P Web Search: Make It Light, Make It Fly 12 / 16

slide-13
SLIDE 13

Motivation MINERVA System Model Demo

  • 7. Step: Tag Documents

Right-click on document, Add New Tag for URL Add desired tag(s)

Matthias Bender P2P Web Search: Make It Light, Make It Fly 13 / 16

slide-14
SLIDE 14

Motivation MINERVA System Model Demo

  • 8. Step: Retrieve Annotations for Document

Right-click on document, Retrieve all Tags for URL Inspected submitted tags

Matthias Bender P2P Web Search: Make It Light, Make It Fly 14 / 16

slide-15
SLIDE 15

Motivation MINERVA System Model Demo

  • 9. Step: Query for Annotated Documents

Enter query as tag=value, possibly combine with keywords Inspect results

Matthias Bender P2P Web Search: Make It Light, Make It Fly 15 / 16

slide-16
SLIDE 16

Motivation MINERVA System Model Demo

Thank you for your attention

Download and more details available at: http://www.minerva-project.org

Matthias Bender P2P Web Search: Make It Light, Make It Fly 16 / 16