Monolith to Reactive Microservices

Monolith to Reactive Microservices

Transcript

1. MONOLITH TO REACTIVE MICROSERVICES
2. s.id/jvm3slide2
3. MONOLITH TO REACTIVE MICROSERVICES EKO KURNIAWAN KHANNEDY ▸ Principal Software Development Engineer at Blibli.com ▸ Part of Research and Development Team at Blibli.com ▸ Code Java almost 10 years, but sometimes code Scala and Go-Lang.
4. THIS MATERIAL IS BASED ON OUR EXPERIENCE AT BLIBLI.COM
5. MONOLITH TO REACTIVE MICROSERVICES AGENDA ▸ Blibli.com ▸ Before : Monolith ▸ After : Microservices ▸ Future : Reactive
6. BLIBLI.COM MONOLITH TO REACTIVE MICROSERVICES
7. MONOLITH TO REACTIVE MICROSERVICES BLIBLI.COM ▸ The first online mall in Indonesia (since 2011). ▸ A subsidiary of Djarum Group. ▸ More than 500 employees. ▸ https://www.youtube.com/watch?v=ymvL5n2MxSc #DSTOUR16
8. MONOLITH TO REACTIVE MICROSERVICES BLIBLI.COM TECH ▸ More than 150 engineers. ▸ More than 80 microservices. ▸ More than 400 nodes in production. ▸ Almost all microservices build using JVM ▸ Spring is our favorite framework (90% microservices).
9. MONOLITH TO REACTIVE MICROSERVICES THIS PAGE NOT SERVED BY SINGLE APP
10. MONOLITH TO REACTIVE MICROSERVICES THIS PAGE NOT SERVED BY SINGLE APP CART
 SERVICE
11. MONOLITH TO REACTIVE MICROSERVICES THIS PAGE NOT SERVED BY SINGLE APP AUTH
 SERVICE CART
 SERVICE
12. MONOLITH TO REACTIVE MICROSERVICES THIS PAGE NOT SERVED BY SINGLE APP SEARCH
 SERVICE AUTH
 SERVICE CART
 SERVICE
13. MONOLITH TO REACTIVE MICROSERVICES THIS PAGE NOT SERVED BY SINGLE APP SEARCH
 SERVICE AUTH
 SERVICE PROMO
 SERVICE CART
 SERVICE
14. MONOLITH TO REACTIVE MICROSERVICES THIS PAGE NOT SERVED BY SINGLE APP SEARCH
 SERVICE AUTH
 SERVICE PROMO
 SERVICE CATEGORY
 SERVICE CART
 SERVICE
15. MONOLITH TO REACTIVE MICROSERVICES THIS PAGE NOT SERVED BY SINGLE APP SEARCH
 SERVICE AUTH
 SERVICE PROMO
 SERVICE CATEGORY
 SERVICE PULSA
 SERVICE CART
 SERVICE
16. MONOLITH TO REACTIVE MICROSERVICES THIS PAGE NOT SERVED BY SINGLE APP SEARCH
 SERVICE AUTH
 SERVICE PROMO
 SERVICE CATEGORY
 SERVICE PULSA
 SERVICE TRAVEL
 SERVICE CART
 SERVICE
17. MONOLITH TO REACTIVE MICROSERVICES JVM MEETUP #2 - MICROSERVICES (SPEAKER : ENDY MUHARDIN) https://www.youtube.com/watch?v=-pgvQScDohw
18. BEFORE MONOLITH TO REACTIVE MICROSERVICES
19. MONOLITH
20. MONOLITH TO REACTIVE MICROSERVICES BLIBLI.COM HISTORY MONOLITH 2011
21. MONOLITH TO REACTIVE MICROSERVICES MONOLITH PROBLEM ▸ The large monolithic code base intimidates developers. ▸ Overloaded IDE. ▸ Overloaded web container. ▸ Scaling the application can be difficult. ▸ Requires a long-term commitment to a technology stack.
22. AFTER MONOLITH TO REACTIVE MICROSERVICES
23. MICROSERVICES
24. MONOLITH TO REACTIVE MICROSERVICES BLIBLI.COM HISTORY MICROSERVICES 2016
25. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES LOAD BALANCER INTERNET FRONTEND SERVER FRONTEND SERVER FRONTEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER THIRD PARTY DATABASE DATABASE
26. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES LOAD BALANCER INTERNET FRONTEND SERVER FRONTEND SERVER FRONTEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER THIRD PARTY DATABASE DATABASE LET’S SAY LATENCY GOES UP HERE
27. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES LOAD BALANCER INTERNET FRONTEND SERVER FRONTEND SERVER FRONTEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER THIRD PARTY DATABASE DATABASE THREAD BLOCKED HERE
28. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES LOAD BALANCER INTERNET FRONTEND SERVER FRONTEND SERVER FRONTEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER THIRD PARTY DATABASE DATABASE LATENCY GOES UP HERE
29. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES LOAD BALANCER INTERNET FRONTEND SERVER FRONTEND SERVER FRONTEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER THIRD PARTY DATABASE DATABASE THREAD BLOCKED HERE
30. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES LOAD BALANCER INTERNET FRONTEND SERVER FRONTEND SERVER FRONTEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER THIRD PARTY DATABASE DATABASE AND HERE
31. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES LOAD BALANCER INTERNET FRONTEND SERVER FRONTEND SERVER FRONTEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER THIRD PARTY DATABASE DATABASE HERE TOO
32. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES LOAD BALANCER INTERNET FRONTEND SERVER FRONTEND SERVER FRONTEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER THIRD PARTY DATABASE DATABASE AND THERE
33. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES LOAD BALANCER INTERNET FRONTEND SERVER FRONTEND SERVER FRONTEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER BACKEND SERVER THIRD PARTY DATABASE DATABASE AND THERE AND DOWN!
34. MICROSERVICES IS JUST A DISTRIBUTED MONOLITH
35. MICROSERVICES IS JUST A DISTRIBUTED MONOLITH IF NOT REACTIVE
36. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES PROBLEM ▸ Response time increase because too many communication with other systems. ▸ Network failures is your best friend ▸ Microservices mean you will have farms, not pets. ▸ Don’t trust other services
37. FUTURE MONOLITH TO REACTIVE MICROSERVICES
38. GO REACTIVE
39. MONOLITH TO REACTIVE MICROSERVICES BLIBLI.COM TODAY MICROSERVICES 2017 REACTIVE
40. MONOLITH TO REACTIVE MICROSERVICES REACTIVE SYSTEM
41. MONOLITH TO REACTIVE MICROSERVICES REACTIVE ON BLIBLI ▸ Asynchronous ▸ Non-blocking ▸ Location transparency ▸ Fault Tolerance ▸ Back-pressure ▸ Message-Driven
42. MONOLITH TO REACTIVE MICROSERVICES ASYNCHRONOUS
43. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES
44. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES MICROSERVICES
45. MONOLITH TO REACTIVE MICROSERVICES MICROSERVICES MICROSERVICES EDGE SERVICE / 
 API GATEWAY
46. MONOLITH TO REACTIVE MICROSERVICES START FROM EDGE SERVICE / API GATEWAY
47. MONOLITH TO REACTIVE MICROSERVICES EDGE SERVICE EDGE
 SERVICE / API
 GATEWAY ANDROID ORDER
 SERVICE MEMBER
 SERVICE AUTH
 SERVICE CART
 SERVICE WISHLIST
 SERVICE … WEB RISK
 SERVICE LOGISTIC
 SERVICE PAYMENT
 SERVICE
48. MONOLITH TO REACTIVE MICROSERVICES CLIENT NETWORK LATENCY EDGE
 SERVICE / API
 GATEWAY
49. MONOLITH TO REACTIVE MICROSERVICES SERVER NETWORK LATENCY EDGE
 SERVICE / API
 GATEWAY
50. MONOLITH TO REACTIVE MICROSERVICES RXJAVA Single<Member> member = memberClient.findById(userId) Single<Order> order = orderClient.findByOrderId(orderId) Single<Payment> payment = paymentClient.findByOrderId(orderId) return Single.zip(member, order, response, (a, b, c) -> { return Response.of(a,b,c) })
51. MONOLITH TO REACTIVE MICROSERVICES NON-BLOCKING
52. MONOLITH TO REACTIVE MICROSERVICES TOMCAT THREADPOOL ▸ minThread (default is 25) ▸ maxThread (default is 200) ▸ maxQueueSize (default is Integer.MAX_VALUE)
53. MONOLITH TO REACTIVE MICROSERVICES NON BLOCKING JVM ▸ Use Netty ▸ Use Servlet 3 Async Support
54. MONOLITH TO REACTIVE MICROSERVICES SPRING MVC + RXJAVA @RequestMapping(“/action”) public Single<Response> action(@Valid Request request){ service.action(request).map(result -> { Response.from(result); }) }
55. MONOLITH TO REACTIVE MICROSERVICES LOCATION TRANSPARENCY
56. MONOLITH TO REACTIVE MICROSERVICES PETS VS FARMS
57. MONOLITH TO REACTIVE MICROSERVICES SERVER SIDE LOAD BALANCER AUTH SERVICE AUTH SERVICE MEMBER SERVICE MEMBER SERVICE ORDER SERVICE ORDER SERVICE LOAD
 BALANCER LOAD
 BALANCER LOAD
 BALANCER EDGE SERVICE
58. MONOLITH TO REACTIVE MICROSERVICES CLIENT SIDE LOAD BALANCER
59. MONOLITH TO REACTIVE MICROSERVICES CLIENT SIDE LOAD BALANCER AUTH SERVICE AUTH SERVICE MEMBER SERVICE MEMBER SERVICE ORDER SERVICE ORDER SERVICE SERVICE
 REGISTRY EDGE SERVICE EDGE SERVICE CART SERVICE CART SERVICE
60. MONOLITH TO REACTIVE MICROSERVICES SPRING CLOUD + FEIGN + CONSUL @FeignClient(name=“authFeign”, serviceId=“authService”) public class AuthFeign{ @RequestMapping(value = “/users/_login”, method=RequestMethod.POST) Single<Response> login(@RequestBody LoginRequest request); }
61. MONOLITH TO REACTIVE MICROSERVICES FAULT TOLERANCE
62. MONOLITH TO REACTIVE MICROSERVICES FAILURE IS YOUR BEST FRIEND ▸ Network Timeout ▸ Http Internal Server Error ▸ Exception
63. MONOLITH TO REACTIVE MICROSERVICES USER DETAIL UI
64. MONOLITH TO REACTIVE MICROSERVICES USER DETAILS API RESPONSE { “email” : “echo.khannedy@gmail.com”, “firstName” : “Eko Kurniawan”, “lastName” : “Khannedy”, “wishlistCount” : 100, “carts” : […], “…” }
65. MONOLITH TO REACTIVE MICROSERVICES USER DETAILS BACKEND Single<Member> member = memberFeign.findById(userId) Single<Integer> count = wishlistFeign.count(userId) Single<List<Item>> carts = cartFeign.getCurrentCarts(userId) return Single.zip(member, count, carts, (a, b, c) -> { return Response.of(a,b,c) })
66. MONOLITH TO REACTIVE MICROSERVICES WISHLIST FEIGN @FeignClient(name=“wishlistFeign”, serviceId=“wishlistService”, fallback=WishlistFeignFallback.class) public class WishlistFeign{ @RequestMapping(value = “/items/_count”, method=RequestMethod.GET) Single<Integer> count(@RequestParam String userId); }
67. MONOLITH TO REACTIVE MICROSERVICES WISHLIST FEIGN FALLBACK (POWERED BY HYSTRIX) public class WishlistFeignFallback implements WishlistFeign{ public Single<Integer> count(String userId){ return Single.just(0); } }
68. MONOLITH TO REACTIVE MICROSERVICES BACK-PRESSURE
69. MONOLITH TO REACTIVE MICROSERVICES BACK-PRESSURE DILEMA CLIENT SERVER 10 ops / sec 1 ops / sec
70. MONOLITH TO REACTIVE MICROSERVICES BACK-PRESSURE DILEMA CLIENT SERVER 1 ops / sec 10 ops / sec
71. MONOLITH TO REACTIVE MICROSERVICES BACK-PRESSURE DILEMA CLIENT SERVER 1 ops / sec 10 ops / sec MAILBOX / QUEUE
72. MONOLITH TO REACTIVE MICROSERVICES HYSTRIX THREADPOOL CONFIGURATION hystrix.threadpool.default.coreSize = 10 hystrix.threadpool.default.maximumSize = 20 hystrix.threadpool.default.maxQueueSize = 100
73. MONOLITH TO REACTIVE MICROSERVICES BACK-PRESSURE WITH FEIGN + HYSTRIX CLIENT SERVER 1 ops / sec 10 ops / sec MAILBOX / QUEUE SIZE = 100 FALLBACK
74. MONOLITH TO REACTIVE MICROSERVICES PROMO FEIGN FALLBACK (POWERED BY HYSTRIX) public class PromoFeignFallback implements PromoFeign{ public Single<Boolean> redeem(@RequestParam String voucher){ return Single.just(Boolean.FALSE); } }
75. MONOLITH TO REACTIVE MICROSERVICES MESSAGE-DRIVEN
76. MONOLITH TO REACTIVE MICROSERVICES TRADITIONAL SYSTEM ORDER
 SERVICE RISK
 SERVICE LOGISTIC
 SERVICE PAYMENT
 SERVICE EDGE
 SERVICE CART
 SERVICE
77. MONOLITH TO REACTIVE MICROSERVICES TRADITIONAL SYSTEM ORDER
 SERVICE RISK
 SERVICE LOGISTIC
 SERVICE PAYMENT
 SERVICE EDGE
 SERVICE CART
 SERVICE PURCHASE
 ORDER
78. MONOLITH TO REACTIVE MICROSERVICES TRADITIONAL SYSTEM ORDER
 SERVICE RISK
 SERVICE LOGISTIC
 SERVICE PAYMENT
 SERVICE EDGE
 SERVICE CART
 SERVICE PURCHASE
 ORDER MOVE
 CART
79. MONOLITH TO REACTIVE MICROSERVICES TRADITIONAL SYSTEM ORDER
 SERVICE RISK
 SERVICE LOGISTIC
 SERVICE PAYMENT
 SERVICE EDGE
 SERVICE CART
 SERVICE PURCHASE
 ORDER MOVE
 CART INSERT
 ORDER
80. MONOLITH TO REACTIVE MICROSERVICES TRADITIONAL SYSTEM ORDER
 SERVICE RISK
 SERVICE LOGISTIC
 SERVICE PAYMENT
 SERVICE EDGE
 SERVICE CART
 SERVICE PURCHASE
 ORDER MOVE
 CART INSERT
 ORDER CONFIRM
 PAYMENT
81. MONOLITH TO REACTIVE MICROSERVICES TRADITIONAL SYSTEM ORDER
 SERVICE RISK
 SERVICE LOGISTIC
 SERVICE PAYMENT
 SERVICE EDGE
 SERVICE CART
 SERVICE PURCHASE
 ORDER MOVE
 CART INSERT
 ORDER CALCULATE
 RISK SCORE CONFIRM
 PAYMENT
82. MONOLITH TO REACTIVE MICROSERVICES TRADITIONAL SYSTEM ORDER
 SERVICE RISK
 SERVICE LOGISTIC
 SERVICE PAYMENT
 SERVICE EDGE
 SERVICE CART
 SERVICE PURCHASE
 ORDER MOVE
 CART INSERT
 ORDER CALCULATE
 RISK SCORE CREATE
 AWB CONFIRM
 PAYMENT
83. MONOLITH TO REACTIVE MICROSERVICES TRADITIONAL SYSTEM ORDER
 SERVICE RISK
 SERVICE LOGISTIC
 SERVICE PAYMENT
 SERVICE EDGE
 SERVICE CART
 SERVICE PURCHASE
 ORDER MOVE
 CART INSERT
 ORDER CALCULATE
 RISK SCORE CREATE
 AWB CONFIRM
 PAYMENT ERROR ERROR
84. MONOLITH TO REACTIVE MICROSERVICES MOVE LONG RUNNING TASK TO MESSAGE DRIVEN
85. MONOLITH TO REACTIVE MICROSERVICES MESSAGE-DRIVEN SYSTEM ORDER
 SERVICE RISK
 SERVICE LOGISTIC
 SERVICE PAYMENT
 SERVICE EDGE
 SERVICE CART
 SERVICE PURCHASE
 ORDER INSERT
 ORDER MESSAGE BROKER RABBIT MQ / KAFKA STOCK
 SERVICE
86. MONOLITH TO REACTIVE MICROSERVICES IN BLIBLI.COM ORDER
 SERVICE RISK
 SERVICE EDGE
 SERVICE RABBIT MQ STOCK
 SERVICE KAFKA ANALYTIC
 SERVICE RECOMMENDATION
 SERVICE TRANSACTIONAL USER ACTIVITY
87. MONOLITH TO REACTIVE MICROSERVICES ONE MORE THING
88. MONOLITH TO REACTIVE MICROSERVICES TIMEOUT
89. MONOLITH TO REACTIVE MICROSERVICES RIBBON & HYSTRIX TIMEOUT CONFIGURATION hystrix.command.default.execution.timeout.enabled=true hystrix.command.default.execution.isolation.thread.timeoutInMilliseconds=5000 authService.ribbon.ConnectTimeout=2000 authService.ribbon.ReadTimeout=2000
90. THANKS
91. MONOLITH TO REACTIVE MICROSERVICES REFERENCES ▸ https://medium.com/netflix-techblog/embracing-the-differences-inside-the-netflix-api-redesign-15fd8b3dc49d ▸ https://medium.com/netflix-techblog/announcing-zuul-edge-service-in-the-cloud-ab3af5be08ee ▸ http://www.reactivemanifesto.org/ ▸ http://microservices.io/ ▸ https://www.nginx.com/blog/service-discovery-in-a-microservices-architecture/ ▸ http://cloud.spring.io/spring-cloud-netflix/spring-cloud-netflix.html ▸ https://www.slideshare.net/jboner/without-resilience-nothing-else-matters-56053062 ▸ https://www.slideshare.net/jboner/go-reactive-42084559 ▸ https://articles.microservices.com/monolithic-vs-microservices-architecture-5c4848858f59