Pithos^2 Panos Louridas louridas@grnet.gr Antony Chazapis|Panagiotis - PowerPoint PPT Presentation

Pithos^2 Panos Louridas louridas@grnet.gr Antony Chazapis|Panagiotis Kanavos |Sofia Papagiannaki | Georgios Tsoukalas | Georgios Papagiannaki | Georgios Tsoukalas | Georgios Verigakis 17 June 2011 9th TF ‐ Storage Meeting 1

9883 17 June 2011 9th TF ‐ Storage Meeting 2

645,343 17 June 2011 9th TF ‐ Storage Meeting 3

3646 2 GB t 3646.2 GBytes 17 June 2011 9th TF ‐ Storage Meeting 4

1 Jettison J2EE 1. Jettison J2EE 17 June 2011 9th TF ‐ Storage Meeting 5

2 OpenStack API 2. OpenStack API 17 June 2011 9th TF ‐ Storage Meeting 6

3 Block Storage 3. Block Storage 17 June 2011 9th TF ‐ Storage Meeting 7

4 Access 4. Access 17 June 2011 9th TF ‐ Storage Meeting 8

5 Last but not Least 5. Last but not Least 17 June 2011 9th TF ‐ Storage Meeting 9

1 Jettison J2EE 1. Jettison J2EE 17 June 2011 9th TF ‐ Storage Meeting 10

1. Jettison J2EE 17 June 2011 9th TF ‐ Storage Meeting 11

1. Jettison J2EE 17 June 2011 9th TF ‐ Storage Meeting 12

1. Jettison J2EE 17 June 2011 9th TF ‐ Storage Meeting 13

2 OpenStack API 2. OpenStack API 17 June 2011 9th TF ‐ Storage Meeting 14

2. OpenStack API 17 June 2011 9th TF ‐ Storage Meeting 15

2. OpenStack API 17 June 2011 9th TF ‐ Storage Meeting 16

2. OpenStack API 17 June 2011 9th TF ‐ Storage Meeting 17

3 Block Storage 3. Block Storage 17 June 2011 9th TF ‐ Storage Meeting 18

3. Block Storage content ‐ based b d addressing for blocks 17 June 2011 9th TF ‐ Storage Meeting 19

3. Block Storage write: hashmap = [] for block in blocksplit(data, backend.block_size): hashmap.append(backend.put_block(block)) meta = {'hash': hashmap_hash(hashmap)} self.backend.update_object_hashmap(container, object, len(data), hashmap, meta, True) 17 June 2011 9th TF ‐ Storage Meeting 20

3. Block Storage read: size, hashmap = self.backend.get_object_hashmap(container, object) buf = [] for hash in hashmap: buf.append(backend.get_block(hash)) data = ''.join(buf)[:size] return data[offset:offset + nbyte] 17 June 2011 9th TF ‐ Storage Meeting 21

3. Block Storage deduplication 17 June 2011 9th TF ‐ Storage Meeting 22

3. Block Storage 17 June 2011 9th TF ‐ Storage Meeting 23

3. Block Storage synchronization synchronization rsync VCDIFF RFC 3229 rsync, VCDIFF, RFC 3229 17 June 2011 9th TF ‐ Storage Meeting 24

3. Block Storage partial updates partial updates 17 June 2011 9th TF ‐ Storage Meeting 25

4 Access 4. Access 17 June 2011 9th TF ‐ Storage Meeting 26

4. Access web ‐ based web ‐ based 17 June 2011 9th TF ‐ Storage Meeting 27

4. Access CLI CLI 17 June 2011 9th TF ‐ Storage Meeting 28

4. Access 17 June 2011 9th TF ‐ Storage Meeting 29

5 Last but not Least 5. Last but not Least 17 June 2011 9th TF ‐ Storage Meeting 30

5. Last but not Least i integration with: i i h ~okeanos gr/SSaaS 17 June 2011 9th TF ‐ Storage Meeting 31

Antony Chazapis Chazapis Georgios Tsoukalas Sofia Papagiannaki p g Giorgos Verigakis i Panagiotis Kanavos 17 June 2011 9th TF ‐ Storage Meeting 32

5. Last but not Least http://code.grnet.gr/projects/pithos 17 June 2011 9th TF ‐ Storage Meeting 33