NORDUShare Click to edit Master subtitle style tf-storage 2010, - - PowerPoint PPT Presentation

nordushare
SMART_READER_LITE
LIVE PREVIEW

NORDUShare Click to edit Master subtitle style tf-storage 2010, - - PowerPoint PPT Presentation

NORDUnet NORDUnet Nordic Infrastructure for Research & Education Nordic infrastructure for Research & Education NORDUShare Click to edit Master subtitle style tf-storage 2010, Utrecht 04-03-10 NORDUnet NORDUnet Nordic


slide-1
SLIDE 1

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

NORDUShare tf-storage 2010, Utrecht

slide-2
SLIDE 2

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

What is NORDUshare?

slide-3
SLIDE 3

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

NORDUshare is a data distribution platform based on bittorrent technology

slide-4
SLIDE 4

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

OK so what does it look like?

(yes hopefully there will be a demo)

slide-5
SLIDE 5

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Superficially NORDUshare looks like most torrent sites but with auth and authz

(federated of course)

slide-6
SLIDE 6

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Use-cases

  • Sensor networks
  • Provisioning of bulk content (eg video, SCORM
  • bjects) for shared LMS or media distribution

systems

  • Distributed ”FTP” service
  • VO data sharing
slide-7
SLIDE 7

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Design goals

  • Programmable – a RESTful API is a MUST
  • Extremely easy to integrate with – curl+ctorrent

should be enough

  • Basic client for entry-level users (java-based)
  • Compatible with current thinking around

federation VOs (entitlements)

  • Scalable – no single point of storage!
  • Behave well in the face of mobile, intermittent and

varying quality of Internet connectivity

slide-8
SLIDE 8

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Non-goals

  • Duplicate filsender use-cases
  • In fact we belive filesender could be a very nice frontend

to nordushare

  • Become a distributed filesystem
  • No way José!
slide-9
SLIDE 9

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Components of NORDUshare

  • A tracker (there could be more)
  • nly permits whitelisted torrents to be tracked
  • A set of seeders (storage nodes)
  • A web UI (there could be more of those too...)
  • Federated auth
  • authz based on eduPersonEntitlement
  • A few clients
  • java webstart, upload of raw torrent-file, simple cmdline
  • A RESTful API
  • time-limited bearer tokens (aka API keys) for auth

carrying a set of entitlements

slide-10
SLIDE 10

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10 Storage BT Storage BT NORDUshare web Storage BT Status NORDUshare tracker Torrent registration BT Status Register torrent with tracker

slide-11
SLIDE 11

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Some consequences of the design

slide-12
SLIDE 12

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

  • RSS/ATOM based on tags
  • Run a storage-node for your community
  • Automatically download everything for your VO
  • Resume for all datatransfers
  • BT does this for you
  • Swarming helps with downloads
  • BT is ”supported” in common SOHO network

equipment

  • The java webstart client uses UPNP to establish NAT port

mappings

slide-13
SLIDE 13

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Demo

slide-14
SLIDE 14

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Status and Plans

slide-15
SLIDE 15

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Public Beta in May 2010 using Kalmar Union

(eduGAIN is also a possibility)

slide-16
SLIDE 16

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Tracking our progress!

git://git.nordu.net/lobber.git git://git.nordu.net/lobber-client.git

slide-17
SLIDE 17

NORDUnet

Nordic infrastructure for Research & Education

NORDUnet

Nordic Infrastructure for Research & Education

Click to edit Master subtitle style 04-03-10

Q & A