Switching from HAProxy to Samaritan

Transcript

1. Switching from HAProxy to Samaritan github.com/eleme/samaritan
2. Server-side load balancing LB C Service A Service A Service C Service A Service A Service D LB D Service A:1 Service A:2 Service B:1 Service B:2 Service A:3 Service B:3
3. Server-side load balancing LB C Service A Service A Service C Service A Service A Service D LB D Service A:1 Service A:2 Service B:1 Service B:2 Service A:3 Service B:3 LB C LB D
4. Server-side load balancing LB C Service A Service A Service C Service A Service A Service D LB D Service A:1 Service A:2 Service B:1 Service B:2 Service A:3 Service B:3 LB C LB D 1. Single point of failure 2. Performance bottleneck
5. Server-side load balancing LB C Service A Service A Service C Service A Service A Service D LB D Service A:1 Service A:2 Service B:1 Service B:2 Service A:3 Service B:3 LB C LB D LB C LB C LB C LB C LB C LB D
6. Server-side load balancing LB C Service A Service A Service C Service A Service A Service D LB D Service A:1 Service A:2 Service B:1 Service B:2 Service A:3 Service B:3 LB C LB D LB C LB C LB C LB C LB C LB D 1. Single point of failure 2. Performance bottleneck 3. Hardware cost 4. Hard to deploy & maintain
7. Client-side load balancing Service A LB A Service B LB B Service A Service A Service C Service A Service A Service D LB C Service A Service A Service C Service A Service A Service D LB D Service A:1 Service A:2 Service B:1 Service B:2 Service A:3 Service B:3 LB C LB D LB C LB C LB C LB C LB C LB D
8. HAProxy HAProxy Client Server Server Server Configuration File
9. Sam HAProxy Client Server Server Server Configuration File Sam Client ZooKeeper Dog Conf Monitor Server Server Server Sash Monitor Generate
10. HAProxy as client-side LB Service X Client Node A Node B Client 1. Node A 2. Node B HAProxy HAProxy Configuration File 1. Node A 2. Node B
11. Scale-out with HAProxy Service X Client Node A Node B Client 1. Node A 2. Node B HAProxy HAProxy Configuration File 1. Node A 2. Node B Node C 3. Node C 3. Node C Scale-in is similar
12. Scale-out with HAProxy Service X Client Node A Node B Client 1. Node A 2. Node B HAProxy HAProxy Configuration File 1. Node A 2. Node B Node C 3. Node C 3. Node C Scale-in is similar O(n)
13. Sam as client-side LB Service X Client Node A Node B Client Sam Sam ZooKeeper Register Pull
14. Scale-out with Sam Service X Client Node A Node B Client Node C Sam Sam ZooKeeper Register Pull ZooKeeper Scale-in is similar
15. Scale-out with Sam Service X Client Node A Node B Client Node C Sam Sam ZooKeeper Register Pull ZooKeeper Scale-in is similar O(1)
16. Features • Zero client-side configuration • Hot re-configuration without down time • Auto failure detection, handling and recovery • Provide metrics for individual backend service • Single process
17. Q & A mail2tevin@gmail.com