Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Running in multiple data centers

Running in multiple data centers

The applications that we build for today's world have a lot of requirements. They need to provide the best user experience and to be always up and running. To achieve this in a massive scale you need a multi data center architecture. When we have more than one data centers, even if one of them goes down, the other can handle the traffic and your users will continue to use your application uninterrupted. Also by having datacenters in different locations around the world you can you take advantage of lower latencies and provide a better usability. But to take advantage of all those benefits you need to architect your application in a special way. During the talk we’ll explore the different multi data center configurations and the tradeoff of each one of them. We’ll also go over the ways to do failover and some useful processes to facilitate it better. Moreover, we’ll see how each layer of the application is affected by such architecture, all the way down to the database and the data model. Finally, I’ll share what technologies help Uber to run in multiple data centers and the lessons we learned by doing so.

Nikolay Stoitsev

November 17, 2017
Tweet

More Decks by Nikolay Stoitsev

Other Decks in Technology

Transcript

  1. 16 – 17 November, Sofia ISTACON.ORG How the Internet Kept

    Humming During 2 Hurricanes https://www.nytimes.com/2017/09/18/us/harvey-irma-internet.html
  2. mod 3 DC 1 DC 2 user_id = 0 =

    1 DC 3 = 2 Partitioning
  3. 16 – 17 November, Sofia ISTACON.ORG DC 1 DC 2

    San Francisco Los Angeles New York Toronto
  4. 16 – 17 November, Sofia ISTACON.ORG DC 1 DC 2

    San Francisco Los Angeles New York Toronto
  5. 16 – 17 November, Sofia ISTACON.ORG DC 1 Master Slave

    DC 2 Slave Master DC 3 Master Slave DC 4 Slave Master
  6. 16 – 17 November, Sofia ISTACON.ORG Multi-zone topics Producer Producer

    Topic Topic Consumer Group Consumer Group replication
  7. 16 – 17 November, Sofia ISTACON.ORG Multi-zone consumers Producer Topic

    Topic Consumer Group Consumer Group replication offset sync
  8. 16 – 17 November, Sofia ISTACON.ORG “ The best way

    to avoid failure is to fail constantly. http://techblog.netflix.com/2010/12/5-lessons-weve-learned-using-aws.html
  9. 16 – 17 November, Sofia ISTACON.ORG Thank you! @stoitsev Nikolay

    Stoitsev http://careersinfo.uber.com/sofia-engineering