Data storage and preservation Ceph striping Object 0 Object 1 Object 2 Object 3 Object 4 Unit 0 Unit 1 Unit 2 Unit 3 Unit 4 Unit 5 Unit 6 Unit 7 Unit 8 Unit 9 Unit 10 Unit 11 Unit 12 Unit 13 Unit 14 Object 0 Object 1 Object 2 Object 3 Object 4 Object 5 Object 6 Object 7 Object 8 Object 9 Unit 15 Unit 16 Unit 17 Unit 18 Unit 19 Unit 20 Unit 21 Unit 22 Unit 23 Unit 24 Unit 25 Unit 26 Unit 27 Unit 28 Unit 29 Object 5 Object 6 Object 7 Object 8 Object 9 striping mapreduce 17/62 S.Ponce-CERN
Data storage and preservation 17 / 62 S. Ponce - CERN devices // risks consistency safety c/c striping mapreduce Ceph striping Object 0 Unit 0 Unit 5 Unit 10 Object 0 Object 1 Unit 1 Unit 6 Unit 11 Object 1 Object 2 Unit 2 Unit 7 Unit 12 Object 2 Object 3 Unit 3 Unit 8 Unit 13 Object 3 Object 4 Unit 4 Unit 9 Unit 14 Object 4 Object 5 Unit 15 Unit 20 Unit 25 Object 5 Object 6 Unit 16 Unit 21 Unit 26 Object 6 Object 7 Unit 17 Unit 22 Unit 27 Object 7 Object 8 Unit 18 Unit 23 Unit 28 Object 8 Object 9 Unit 19 Unit 24 Unit 29 Object 9 Stripe Unit 4 Stripe 2 Object 0 Disk 3 Object Set 1
Data storage and preservation Ceph striping Object 0 Object 1 Object 2 Object 3 Object 4 Unit 0 Unit 1 Unit 2 Unit 3 Unit 4 Stripe Unit 4 Unit 5 Unit 6 Unit 7 Unit 8 Unit 9 Unit 10 Unit 11 Unit 12 Unit 13 Unit 14 Object 0 Object 1 Object 2 Object 3 Object 4 Object 5 Object 6 Object 7 Object 8 Object 9 Unit 15 Unit 16 Unit 17 Unit 18 Unit 19 Unit 20 Unit 21 Unit 22 Unit 23 Unit 24 Unit 25 Unit 26 Unit 27 Unit 28 Unit 29 Object 5 Object 6 Object 7 Object 8 Object 9 striping mapreduce 17/62 S.Ponce-CERN
Data storage and preservation 17 / 62 S. Ponce - CERN devices // risks consistency safety c/c striping mapreduce Ceph striping Object 0 Unit 0 Unit 5 Unit 10 Object 0 Object 1 Unit 1 Unit 6 Unit 11 Object 1 Object 2 Unit 2 Unit 7 Unit 12 Object 2 Object 3 Unit 3 Unit 8 Unit 13 Object 3 Object 4 Unit 4 Unit 9 Unit 14 Object 4 Object 5 Unit 15 Unit 20 Unit 25 Object 5 Object 6 Unit 16 Unit 21 Unit 26 Object 6 Object 7 Unit 17 Unit 22 Unit 27 Object 7 Object 8 Unit 18 Unit 23 Unit 28 Object 8 Object 9 Unit 19 Unit 24 Unit 29 Object 9 Stripe Unit 4 Stripe 2 Object 0 Disk 3 Object Set 1
Data storage and preservation Ceph striping Object 0 Object 1 Object 2 Object 3 Object 4 Unit 0 Unit 1 Unit 2 Unit 3 Unit 4 Stripe Unit 4 Unit 5 Unit 6 Unit 7 Unit 8 Unit 9 Unit 10 Unit 11 Unit 12 Unit 13 Unit 14 Stripe 2 Object 0 Object 1 Object 2 Object 3 Object 4 Object 5 Object 6 Object 7 Object 8 Object 9 Unit 15 Unit 16 Unit 17 Unit 18 Unit 19 Unit 20 Unit 21 Unit 22 Unit 23 Unit 24 Unit 25 Unit 26 Unit 27 Unit 28 Unit 29 Object 5 Object 6 Object 7 Object 8 Object 9 striping mapreduce 17/62 S.Ponce-CERN
Data storage and preservation 17 / 62 S. Ponce - CERN devices // risks consistency safety c/c striping mapreduce Ceph striping Object 0 Unit 0 Unit 5 Unit 10 Object 0 Object 1 Unit 1 Unit 6 Unit 11 Object 1 Object 2 Unit 2 Unit 7 Unit 12 Object 2 Object 3 Unit 3 Unit 8 Unit 13 Object 3 Object 4 Unit 4 Unit 9 Unit 14 Object 4 Object 5 Unit 15 Unit 20 Unit 25 Object 5 Object 6 Unit 16 Unit 21 Unit 26 Object 6 Object 7 Unit 17 Unit 22 Unit 27 Object 7 Object 8 Unit 18 Unit 23 Unit 28 Object 8 Object 9 Unit 19 Unit 24 Unit 29 Object 9 Stripe Unit 4 Stripe 2 Object 0 Disk 3 Object Set 1
Data storage and preservation Ceph striping Object 0 Object 0 Object 1 Object 2 Object 3 Object 4 Unit 0 Unit 1 Unit 2 Unit 3 Unit 4 Stripe Unit 4 Unit 5 Unit 6 Unit 7 Unit 8 Unit 9 Unit 10 Unit 11 Unit 12 Unit 13 Unit 14 Stripe 2 Object 0 Object 1 Object 2 Object 3 Object 4 Object 5 Object 6 Object 7 Object 8 Object 9 Unit 15 Unit 16 Unit 17 Unit 18 Unit 19 Unit 20 Unit 21 Unit 22 Unit 23 Unit 24 Unit 25 Unit 26 Unit 27 Unit 28 Unit 29 Object 5 Object 6 Object 7 Object 8 Object 9 striping mapreduce 17/62 S.Ponce-CERN
Data storage and preservation 17 / 62 S. Ponce - CERN devices // risks consistency safety c/c striping mapreduce Ceph striping Object 0 Unit 0 Unit 5 Unit 10 Object 0 Object 1 Unit 1 Unit 6 Unit 11 Object 1 Object 2 Unit 2 Unit 7 Unit 12 Object 2 Object 3 Unit 3 Unit 8 Unit 13 Object 3 Object 4 Unit 4 Unit 9 Unit 14 Object 4 Object 5 Unit 15 Unit 20 Unit 25 Object 5 Object 6 Unit 16 Unit 21 Unit 26 Object 6 Object 7 Unit 17 Unit 22 Unit 27 Object 7 Object 8 Unit 18 Unit 23 Unit 28 Object 8 Object 9 Unit 19 Unit 24 Unit 29 Object 9 Stripe Unit 4 Stripe 2 Object 0 Disk 3 Object Set 1
Data storage and preservation Ceph striping Object 0 Object 0 Object 1 Object 2 Object 3 Object 4 Unit 0 Unit 1 Unit 2 Unit 3 Unit 4 Stripe Unit 4 Unit 5 Unit 6 Unit 7 Unit 8 Unit 9 Unit 10 Unit 11 Unit 12 Unit 13 Unit 14 Stripe 2 Object 0 Object 1 Object 2 Object 3 Object 4 Object 5 Object 6 Object 7 Object 8 Object 9 Unit 15 Unit 16 Unit 17 Unit 18 Unit 19 Unit 20 Unit 21 Unit 22 Unit 23 Unit 24 Unit 25 Unit 26 Unit 27 Unit 28 Unit 29 Object 5 Object 6 Object 7 Object 8 Object 9 Disk 3 striping mapreduce 17/62 S.Ponce-CERN
Data storage and preservation 17 / 62 S. Ponce - CERN devices // risks consistency safety c/c striping mapreduce Ceph striping Object 0 Unit 0 Unit 5 Unit 10 Object 0 Object 1 Unit 1 Unit 6 Unit 11 Object 1 Object 2 Unit 2 Unit 7 Unit 12 Object 2 Object 3 Unit 3 Unit 8 Unit 13 Object 3 Object 4 Unit 4 Unit 9 Unit 14 Object 4 Object 5 Unit 15 Unit 20 Unit 25 Object 5 Object 6 Unit 16 Unit 21 Unit 26 Object 6 Object 7 Unit 17 Unit 22 Unit 27 Object 7 Object 8 Unit 18 Unit 23 Unit 28 Object 8 Object 9 Unit 19 Unit 24 Unit 29 Object 9 Stripe Unit 4 Stripe 2 Object 0 Disk 3 Object Set 1