P2P filesystem Sam Prentice & Sudeep Pillai Central Extent - - PowerPoint PPT Presentation

p2p filesystem
SMART_READER_LITE
LIVE PREVIEW

P2P filesystem Sam Prentice & Sudeep Pillai Central Extent - - PowerPoint PPT Presentation

P2P filesystem Sam Prentice & Sudeep Pillai Central Extent Server YFS YFS YFS YFS Lock Extent Server Server Distributed Extents YFS YFS YFS YFS Local Extent Local Extent Local Extent Local Extent Light-weight extent


slide-1
SLIDE 1

P2P filesystem

Sam Prentice & Sudeep Pillai

slide-2
SLIDE 2

YFS YFS YFS YFS Lock Server

Central Extent Server

Extent Server

slide-3
SLIDE 3

YFS YFS YFS YFS

Light-weight extent membership service

Lock Server

Distributed Extents

Local Extent Local Extent Local Extent Local Extent

slide-4
SLIDE 4

Shared+Exclusive Locking

  • Shared access: Multiple readers
  • acquire_read
  • Exclusive access: Single writer
  • acquire_write
  • Pitfalls
  • Writer Starvation: Lock contention where writer

waits on same lock that several readers request

– Lock granted to either single writer in queue head

OR

– Lock granted to group of readers in queue head

slide-5
SLIDE 5

Optimizations

  • Typical lock transition mechanism
  • acquire-revoke-release-retry cycle
  • Lock upgrading/downgrading
  • Upgrading (R->W): Revoke read access for every
  • ther client
  • Downgrading (W->R): Clients with write access

permitted to read until revocation

– Optimize special cases: new read requests not preceded

by write request granted immediately

slide-6
SLIDE 6

Distributed Extents

  • Extents reside distributed across clients
  • Freshest extents are directly read by clients

via P2P

  • Avoid flushing data to central extent server
  • Extent ID membership held centrally
  • Latest writer/owner is tracked
  • Peers can request for latest owner for fresh copies
  • Allows distributing of hot-spots in filesystem
slide-7
SLIDE 7

Load Balancing

  • Load distributed

evenly across clients

  • Reduced bandwidth

per client compared to central extent server which did the heavy-lifting

P2P Load balancing test with 10 clients

slide-8
SLIDE 8

Benchmarking

Centralized Extent Server Distributed Extents

  • Handles well with hot-spots of file-system

usage

slide-9
SLIDE 9

Thanks!

slide-10
SLIDE 10

Sequential consistency

  • Readers and writers see the most recent

extent copy

  • Modifications only made by exclusive writer
  • Difficulties
  • Ensure extent attribute synchronization
slide-11
SLIDE 11

Benchmarking

  • RPC counts

Central P2P test-lab-3-c 1400 400 Central P2P test-lab-3-c

~1600 ms ~1250 ms

  • Timing
  • Bandwidth

Central P2P test-lab-3-c 27.02 MB 14.31 MB