Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Riak CS Introduction

Riak CS Introduction

Intro to Riak CS presentation. Covers architecture, features, operations, stats and interfaces.

Basho Technologies

April 02, 2013
Tweet

More Decks by Basho Technologies

Other Decks in Technology

Transcript

  1. Riak CS is... enterprise cloud storage Riak S3-compatibility multi-tenancy per

    user reporting built on top of large object storage
  2. Enabling you to host your own PUBLIC PRIVATE & CLOUDS

    or…. Reliable Storage Behind Apps
  3. Riak Dynamo-inspired key/value store Written in Erlang with C/C++ Open

    source under Apache 2 license Thousands of production deployments
  4. Riak Masterless •  No master/slave or different roles •  All

    nodes are equal •  Write availability and scalability •  All nodes can accept/route requests
  5. Riak No Sharding •  Consistent hashing •  Prevents “hot spots”

    •  Lowers operational burden of scale •  Data rebalanced automatically
  6. Riak Availability and Fault-Tolerance •  Automatically replicates data •  Read

    and write data during hardware failure and network partition •  Hinted handoff
  7. Riak
 Node Riak
 Node Riak
 Node Riak
 Node Riak
 Node

    Large Object Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API Riak CS
 S3 API Reporting API 1. User uploads an object 1 MB 2. Riak CS
 breaks object into 1 MB chunks 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 3. Riak CS
 streams chunks to Riak nodes 4. Riak replicates and stores chunks
  8. Riak CS Large Object Support •  Started with 5GB /

    object •  Now have multipart upload •  Content agnostic
  9. Riak CS S3-Compatible API •  Use existing S3 libraries and

    tools •  RESTful operations •  Multipart upload •  S3-style ACLs for object/bucket permissions •  S3 authentication scheme
  10. Riak CS Administration and Users •  Interface for user creation,

    deletion, and credentials •  Configure so only admins can create users
  11. Riak CS New Stuff in Riak 1.3 •  Multipart upload:

    parts between 5MB and 5GB •  Support for GET range queries •  Restrict access to buckets based on source IP
  12. Riak CS Packages •  Debian •  Ubuntu •  FreeBSD • 

    Mac •  Red Hat Enterprise •  Fedora •  SmartOS •  Solaris •  Source
  13. stats DTrace
 & built-in
 support track access & storage per

    user monitor total cluster ops inspect ops with DTrace probes
  14. OPERATIONAL STATS exposed via HTTP resource: /riak-cs/stats block bucket object

    GET, PUT, DELETE LIST KEYS, CREATE, DELETE, GET/PUT ACL GET, PUT, DELETE HEAD, GET/PUT ACL HISTOGRAMS & COUNTERS
  15. QUERY USAGE STATS Storage and access statistics tracked on per-user

    basis, as rollups for slices of time •  Operations, Count, BytesIn, BytesOut, + system and user error •  Objects, Bytes
  16. Citrix CloudStack •  Combined platform for compute and storage • 

    Summer ‘13: integrated authentication support •  Videos on our blog
  17. Multi-Datacenter Replication •  For active backups, availability zones, disaster recovery,

    global traffic •  Real-time or full-sync •  24/7 support •  Per-node or storage-based pricing
  18. Q&A