Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Harvest, Yield, and the Promises Our (Storage) ...

Jordan West
February 25, 2016

Harvest, Yield, and the Promises Our (Storage) Services Make

An overview of Harvest and Yield from Fox and Brewer's "Harvest, Yield, and Scalable Tolerant Systems" and a discussion about how infrastructure developers communicate trade-offs to their users.

Jordan West

February 25, 2016
Tweet

More Decks by Jordan West

Other Decks in Technology

Transcript

  1. AGENDA Context Harvest & Yield: Definition Harvest & Yield: Back

    to CAP Harvest & Yield: Criticism Discussion
  2. - Fox & Brewer “In practice, many applications are best

    described in terms of reduced consistency or availability”
  3. - Fox & Brewer “The model can be applied in

    the case of ‘single- location’ updates..that affect reachable nodes occur correctly but have limited visibility (a form of reduced harvest), while those that require unreachable nodes fail (reducing yield)”
  4. – Fox and Brewer “In the presence of faults there

    is typically a tradeoff between providing no answer (reducing yield) and providing an imperfect answer (maintaining yield, but reducing harvest).”
  5. Y I E L D H
 A R V E

    S T 0 100% 100%
  6. Y I E L D H
 A R V E

    S T Strong Consistency 0 100% 100%
  7. Y I E L D H
 A R V E

    S T Strong Consistency 0 100% 100%
  8. Y I E L D H
 A R V E

    S T Strong Consistency Eventual Consistency 0 100% 100%
  9. Y I E L D H
 A R V E

    S T Strong Consistency Eventual Consistency 0 100% 100%
  10. Y I E L D H
 A R V E

    S T Eventual Consistency 0 100% 100%
  11. Y I E L D H
 A R V E

    S T 0 100% 100%
  12. Y I E L D H
 A R V E

    S T Cassandra 0 100% 100%
  13. Y I E L D H
 A R V E

    S T Cassandra 0 100% 100%
  14. Y I E L D H
 A R V E

    S T Cassandra 0 100% 100%
  15. Y I E L D H
 A R V E

    S T Cassandra Riak 0 100% 100%
  16. Y I E L D H
 A R V E

    S T Cassandra Riak 0 100% 100%
  17. Y I E L D H
 A R V E

    S T Cassandra Riak 0 100% 100%
  18. Y I E L D H
 A R V E

    S T Cassandra Riak 0 100% 100% Writes & Reads via Consensus
  19. Y I E L D H
 A R V E

    S T Cassandra Riak 0 100% 100% Writes & Reads via Consensus
  20. Y I E L D H
 A R V E

    S T Cassandra Riak 0 100% 100% Writes & Reads via Consensus Writes via Consensus, Read Any Replica
  21. Y I E L D H
 A R V E

    S T Cassandra Riak 0 100% 100% Writes & Reads via Consensus Writes via Consensus, Read Any Replica
  22. Y I E L D H
 A R V E

    S T 0 100% 100%
  23. Y I E L D H
 A R V E

    S T All CAP Says is “Can’t have both 100% Harvest and 100% Yield” 0 100% 100%
  24. Y I E L D H
 A R V E

    S T All CAP Says is “Can’t have both 100% Harvest and 100% Yield” 0 100% 100% Can Have: CP
  25. Y I E L D H
 A R V E

    S T All CAP Says is “Can’t have both 100% Harvest and 100% Yield” 0 100% 100% Can Have: CP Or Have: AP
  26. – Abadi “if there is a partition (P), how does

    the system trade off availability and consistency (A and C); else (E), when the system is running normally in the absence of partitions, how does the system trade off latency (L) and consistency (C).”
  27. - Fox, Brewer and West (Kingsbury) “Yield…is the probability of

    completing a request within an acceptable latency bound”