1 / 16

Cloud Storage Consistency

Cloud Storage Consistency . … Explained through Baseball. Doug Terry Microsoft Research Silicon Valley. Data Replication in the Cloud. Question : What consistency choices should cloud storage systems offer applications?. Some Popular Systems. Amazon S3 – eventual consistency

cisco
Download Presentation

Cloud Storage Consistency

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Cloud Storage Consistency … Explained through Baseball Doug Terry Microsoft Research Silicon Valley

  2. Data Replication in the Cloud Question: What consistency choices should cloud storage systems offer applications?

  3. Some Popular Systems • Amazon S3 – eventual consistency • Amazon Simple DB – eventual or strong • Google App Engine – strong or eventual • Yahoo! PNUTS – eventual or strong • Windows Azure Storage – strong (or eventual) • Cassandra – eventual or strong (if R+W > N) • ...

  4. A Spectrum of Consistency Strong Consistency Intermediate Consistency Eventual Consistency Lots of consistencies proposed in research community: probabilistic quorums, session guarantees, epsilon serializability, fork consistency, causal consistency, demarcation, continuous consistency, ...

  5. My FavoriteRead Consistency Guarantees

  6. Comparing Consistency strength Strong metric = set of allowable read results Prefix Bounded Monotonic RMW Eventual

  7. Consistency Trade-offs performance consistency availability

  8. The Game of Baseball for inning = 1 .. 9 outs = 0; while outs < 3 visiting player bats; for each run scored score = Read (“visitors”); Write (“visitors”, score + 1); outs = 0; while outs < 3 home player bats; for each run scored score = Read (“home”); Write (“home”, score + 1); end game;

  9. Official Scorekeeper Desired consistency? Strong = Read My Writes! score = Read (“visitors”); Write (“visitors”, score + 1);

  10. Umpire Desired consistency? Strong consistency if middle of 9th inning then vScore = Read (“visitors”); hScore = Read (“home”); if vScore < hScore end game;

  11. Radio Reporter do { BeginTx(); vScore = Read (“visitors”); hScore = Read (“home”); EndTx(); report vScore and hScore; sleep (30 minutes); } Desired consistency? Consistent Prefix Monotonic Reads or Bounded Staleness

  12. Sportswriter While not end of game { drink beer; smoke cigar; } go out to dinner; vScore = Read (“visitors”); hScore = Read (“home”); write article; Desired consistency? Eventual? Strong = Bounded Staleness

  13. Statistician Desired consistency? Strong Consistency (1st read) Read My Writes (2nd read) Wait for end of game; score = Read (“home”); stat = Read (“season-runs”); Write (“season-runs”, stat + score);

  14. Stat Watcher Desired consistency? Eventual Consistency do { stat = Read (“season-runs”); discuss stats with friends; sleep (1 day); }

  15. Read My Writes Official scorekeeper: score = Read (“visitors”); Write(“visitors”, score + 1); Statistician: Wait for end of game; score = Read (“home”); stat = Read (“season-runs”); Write (“season-runs”, stat + score); Umpire: if middle of 9th inning then vScore= Read (“visitors”); hScore = Read (“home”); if vScore < hScore end game; Radio reporter: do { vScore = Read (“visitors”); hScore = Read (“home”); report vScore and hScore; sleep (30 minutes); } Sportswriter: While not end of game { drink beer; smoke cigar; } go out to dinner; vScore= Read (“visitors”); hScore = Read (“home”); write article; Stat watcher: stat = Read (“season-runs”); discuss stats with friends; Bounded Staleness Strong Consistency Strong Consistency Read My Writes Consistent Prefix Monotonic Reads Eventual Consistency

  16. Conclusions • Replication schemes involve tradeoffs between consistency, performance, and availability • Consistency choices can benefit applications • But we, the research community, must provide better definitions, analysis, and tools

More Related