Upgrade to Pro — share decks privately, control downloads, hide ads and more …

design for cloud - jax 2012

Avatar for Mathias Meyer Mathias Meyer
April 18, 2012
Programming
2
300

design for cloud - jax 2012

Avatar for Mathias Meyer

Mathias Meyer

April 18, 2012
Tweet

More Decks by Mathias Meyer

See All by Mathias Meyer
Building and Scaling an Distributed and Inclusive Team
Avatar for Mathias Meyer roidrage
0
1.3k
cooking infrastructure with chef
Avatar for Mathias Meyer roidrage
4
230
The Message Queue is Dead, Long Live the Message Queue
Avatar for Mathias Meyer roidrage
4
700
riak-js
Avatar for Mathias Meyer roidrage
1
280
designing for concurrency with riak
Avatar for Mathias Meyer roidrage
11
1.8k
metrics, monitoring, logging
Avatar for Mathias Meyer roidrage
82
15k
A Riak Query Tale
Avatar for Mathias Meyer roidrage
5
1k
Don't Use NoSQL
Avatar for Mathias Meyer roidrage
10
1.1k
Designing Applications for Amazon Web Services (GOTO Aarhus)
Avatar for Mathias Meyer roidrage
6
350

Other Decks in Programming

See All in Programming
Perplexity Slack Botを作ってAI活用を進めた話 / AI Engineering Summit プレイベント
Avatar for yukyan n3xem
0
330
ts-morph実践：型を利用するcodemodのテクニック
Avatar for ypresto ypresto
1
580
TypeScript エンジニアが Android 開発の世界に飛び込んだ話
Avatar for Yui Sakamoto yuisakamoto
6
1k
プロダクト開発でも使おう 関数のオーバーロード
Avatar for yoiwamoto yoiwamoto
0
110
推論された型の移植性エラーTS2742に挑む
Avatar for teamLab teamlab
PRO
0
170
ワンバイナリWebサービスのススメ
Avatar for mackee mackee
10
7.6k
バランスを見極めよう！実装の意味を明示するための型定義 TSKaigi 2025 Day2 (5/24)
Avatar for whatasoda whatasoda
2
810
TypeScript LSP の今までとこれから
Avatar for Yosuke Kurami quramy
1
410
Zennの運営完全に理解した #完全に理解したTalk
Avatar for Yusuke Wada wadayusuke
1
170
Agent Rules as Domain Parser
Avatar for Yoda Keisuke yodakeisuke
1
440
少数精鋭エンジニアがフルスタック力を磨く理由 -そしてAI時代へ-
Avatar for 株式会社Rebase_エンジニアリング rebase_engineering
0
150
イベントストーミングから始めるドメイン駆動設計
Avatar for おだかとしゆき jgeem
3
720

Featured

See All Featured
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
48
5.4k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
63
7.8k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
PRO
20
1.3k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
31
1.2k
Fontdeck: Realign not Redesign
Avatar for Paul Robert Lloyd paulrobertlloyd
84
5.5k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
92
6.1k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
Designing Experiences People Love
Avatar for Jonathan Moore moore
142
24k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
430
65k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
178
9.8k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
30
5.8k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
161
15k

Transcript

  1. design for cloud mathias meyer, jax 2012

  2. None

  3. Me — infrastructure — code — databases @roidrage www.paperplanes.de

  4. None

  5. the cloud

  6. None
  7. None
  8. None

  9. 10,000 feet

  10. amazon web services

  11. ec2

  12. on-demand computing

  13. api

  14. pay as you go

  15. multiple regions

  16. multiple datacenters

  17. high cpu vs. high memory

  18. elastic block store

  19. more aws products s3 cloudfront cloudformation cloudwatch rds auto scaling

    simpledb route 53 load balancing queue service notification service elastic mapreduce

  20. what’s scalarium?

  21. automates: setup configuration one-click deploy

  22. ...for ec2 ...on ec2

  23. the dream: configure a cluster push a button boom!

  24. None
  25. None

  26. configuration + cookbooks/manifests + chef/puppet = configured cluster

  27. configuration: chef server rightscale json scalarium

  28. None

  29. in the beginning...

  30. Scalarium

  31. None
  32. None
  33. None

  34. ec2 is not a traditional datacenter

  35. None
  36. None

  37. multi-tenant

  38. high chance of failure

  39. faulty instances

  40. datacenter outage

  41. network partition

  42. more instances = higher chance of failure

  43. mtbf

  44. 21/04/2011

  45. None

  46. 7/8/2011

  47. None

  48. don’t fear failure

  49. plan for failure

  50. test failure

  51. None

  52. plan for recovery

  53. mttr

  54. None

  55. disaster recovery plan

  56. multi-datacenter deployments

  57. replication

  58. None

  59. multi-region deployments

  60. $$$

  61. relax consistency requirements

  62. latency

  63. keep data local

  64. None

  65. keep data in memory

  66. cache is king

  67. use raids for ebs

  68. use local storage

  69. use bigger instances

  70. scalarium is ~monolithic

  71. cloud ≠ monolithic

  72. cloud ☠ centralized

  73. small, independent services

  74. self-contained

  75. independently deployable

  76. well defined apis

  77. http/json thrift protocol buffers

  78. sinatra dropwizard spark scalatra

  79. fail fast

  80. retry

  81. internal queues

  82. design for resilience

  83. “think about your software running.” theo schlossnagle, omniti

  84. understand your code’s breaking points

  85. isn’t all that what you do at large scale?

  86. cloud == large scale

  87. scalarium today

  88. scalarium runs on scalarium

  89. None
  90. None
  91. None

  92. lack of visibility

  93. don’t fall for service level agreements

  94. amazon only handles infrastructure

  95. how you build on it is up to you

  96. fun fact

  97. amazon.com is served off ec2

  98. thank you!