SLIDE 1
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
NORDUShare Click to edit Master subtitle style tf-storage 2010, - - PowerPoint PPT Presentation
NORDUShare Click to edit Master subtitle style tf-storage 2010, - - PowerPoint PPT Presentation
NORDUnet NORDUnet Nordic Infrastructure for Research & Education Nordic infrastructure for Research & Education NORDUShare Click to edit Master subtitle style tf-storage 2010, Utrecht 04-03-10 NORDUnet NORDUnet Nordic
SLIDE 2
SLIDE 3
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
NORDUshare is a data distribution platform based on bittorrent technology
SLIDE 4
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
OK so what does it look like?
(yes hopefully there will be a demo)
SLIDE 5
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
Superficially NORDUshare looks like most torrent sites but with auth and authz
(federated of course)
SLIDE 6
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
Use-cases
- Sensor networks
- Provisioning of bulk content (eg video, SCORM
- bjects) for shared LMS or media distribution
systems
- Distributed ”FTP” service
- VO data sharing
SLIDE 7
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
Design goals
- Programmable – a RESTful API is a MUST
- Extremely easy to integrate with – curl+ctorrent
should be enough
- Basic client for entry-level users (java-based)
- Compatible with current thinking around
federation VOs (entitlements)
- Scalable – no single point of storage!
- Behave well in the face of mobile, intermittent and
varying quality of Internet connectivity
SLIDE 8
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
Non-goals
- Duplicate filsender use-cases
- In fact we belive filesender could be a very nice frontend
to nordushare
- Become a distributed filesystem
- No way José!
SLIDE 9
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
Components of NORDUshare
- A tracker (there could be more)
- nly permits whitelisted torrents to be tracked
- A set of seeders (storage nodes)
- A web UI (there could be more of those too...)
- Federated auth
- authz based on eduPersonEntitlement
- A few clients
- java webstart, upload of raw torrent-file, simple cmdline
- A RESTful API
- time-limited bearer tokens (aka API keys) for auth
carrying a set of entitlements
SLIDE 10
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10 Storage BT Storage BT NORDUshare web Storage BT Status NORDUshare tracker Torrent registration BT Status Register torrent with tracker
SLIDE 11
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
Some consequences of the design
SLIDE 12
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
- RSS/ATOM based on tags
- Run a storage-node for your community
- Automatically download everything for your VO
- Resume for all datatransfers
- BT does this for you
- Swarming helps with downloads
- BT is ”supported” in common SOHO network
equipment
- The java webstart client uses UPNP to establish NAT port
mappings
SLIDE 13
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
Demo
SLIDE 14
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
Status and Plans
SLIDE 15
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
Public Beta in May 2010 using Kalmar Union
(eduGAIN is also a possibility)
SLIDE 16
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education
Click to edit Master subtitle style 04-03-10
Tracking our progress!
git://git.nordu.net/lobber.git git://git.nordu.net/lobber-client.git
SLIDE 17
NORDUnet
Nordic infrastructure for Research & Education
NORDUnet
Nordic Infrastructure for Research & Education