Future of Jira Software Powered by Kotlin - JavaDay Istanbul 2020

Transcript

2. MARTIN VARGA | SOFTWARE DEVELOPER | @MARTINTEEVARGA Future of Jira Software Powered by Kotlin
4. kotlinlang.org
6. Google Pixel 2 Just Black Simply drop your screenshot on to this media placeholder TRELLO MOBILE
7. Jira For cloud and server Confluence For cloud and server OpsGenie Alerting and On-call management Not just Trello
8. Not just mobile!
9. FUTURE OF JIRA SOFTWARE POWERED BY KOTLIN
10. JIRA SOFTWARE?
11. Plan, track and release software. JIRA SOFTWARE
13. The Story of Jira From the developer’s perspective
14. Server Cloud 1001001 0 0 1 0 0 1 0 0 1 0 0 1 1101010 1010101 0 0 1 0 0 1 1110001001 0011110010 1100101011 01111110001 Single Code Base
15. Server Cloud 1001001 0 0 1 0 0 1 0 0 1 0 0 1 1101010 1010101 0 0 1 0 0 1
16. 1101010 1010101 0 0 1 0 0 1 1101010 1010101 0 0 1 0 0 1
18. 1101010 1010101 0 0 1 0 0 1
19. 11010101010101 0010010101001 00101010111010 1010101010010 0101010010010 10101110101010
20. 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101
22. 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101
23. 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101
24. 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101 010010010101001001010101 110101010101010010010101 001001010101110101010101
25. 1101010101010100 1001010100100101 0101110101010101 010010010101001 0010101011101010 1010101001001010 1001001010101110 1 0 1 0 1 0 1010111 001001
26. 1101010101 010100100 101010010 0101010111 0 1 0 1 0 1 1011100 1 0 0 1 0 1 1 0 1 0 1 0 1010111 001001
27. 1101010 1010101 001001 0 1 0 1 0 1 1011100 1 0 0 1 0 1 1 0 1 0 1 0 1010111 001001 0 1 0 1 0 1 1011100 1 0 0 1 0 1
28. 1101010 1010101 001001 0 1 0 1 0 1 1011100 1 0 0 1 0 1 1 0 1 0 1 0 1010111 001001 0 1 0 1 0 1 1011100 1 0 0 1 0 1
29. 1101010 1010101 001001 0 1 0 1 0 1 1011100 1 0 0 1 0 1
31. How Atlassian builds services Making developers productive with platform as a service
32. PaaS that allows devs to create and deploy a service in matter of minutes. MICROS
33. MICROS
34. name: "animalfacts" compose: animalfacts: image: internal.docker.repo/animalfacts tag: 'PROJECT_VERSION' ports: - 8080:8080 MICROS DESCRIPTOR
35. links: healthcheck: uri: heartbeat port: 8080 source: url: "git@bitbucket.org:atlassianlabs/animal-facts- graphql-gateway-demo.git" notifications: email: "animalfactsowner@atlassian.com" resources: - type: dynamo-db name: facts attributes: ReadWriteCapacityMode: ON_DEMAND
36. Jira Software Tech Stack DynamoDB or PostgreSQL Depends on the application. Project Reactor Mature reactive library. Kotlin For all new services. Spring Boot Custom wrapper that makes monitoring etc. easier.
37. Powered by Kotlin Making developers happy
38. final Integer length = bob != null && bob.department != null && bob.department.text != null ? bob.department.text.length() : null; WHY KOTLIN? https://www.kotlinvsjava.com/
39. val length = bob?.department?.text?.length WHY KOTLIN? https://www.kotlinvsjava.com/
40. val length : Int = bob?.department?.text?.length WHY KOTLIN? https://www.kotlinvsjava.com/
41. Experience Have we learned Kotlin enough? Was it a success? Compatibility How well is it going to play with our current tech stacks? Staffing Are we going to have enough Kotlin developers available? Adopting Kotlin
42. Velocity Does it make our developers more productive? Industry Is it already adopted by the developers community? Adopting Kotlin
43. ❤
44. Experienced with Kotlin. Android Developer Ad
45. Experience or interest in Kotlin development. Software Engineer, Developer Productivity, Jira Cloud Ad
46. We happen to have a variety of languages within our stack including Kotlin, Python, and Ruby. Senior Backend Developer Ad
47. A case for a reactive app A real world example of an app that we built
48. LATENCY 250ms 250ms 250ms 750ms
49. LATENCY 10ms 250ms 10ms 10ms 280ms
50. Operators Useful for modifying and combining sources. Allows composition of libraries that add resilience, tracing etc. Async Calls a service, then does mostly nothing and waits. Perfect fit. Project reactor Clean code No callback hell.
51. val currentBoard = “5”.toMono() MONO 5
52. val recentBoards = listOf("0", "1", "2").toFlux() FLUX 0 1 2
53. val currentBoard = "5".toMono() val recentBoards = listOf("0", "1", "2").toFlux() currentBoard.concatWith(recentBoards) COMPOSITION & CLEAN CODE 5 0 1 2 0 1 2 5
54. val currentBoard = "5".toMono() val recentBoards = listOf("0", "1", "2").toFlux() currentBoard.concatWith(recentBoards) .map { boardService.getName(it) } .take(3) .subscribe { println(it) } COMPOSITION & CLEAN CODE
55. Surfboard Skateboard Ironing board COMPOSITION & CLEAN CODE
56. currentBoard.concatWith(recentBoards) .map { boardService.getName(it) } .timeout(Duration.ofMillis(2500)) .onErrorReturn("Recent board”) .take(3) .subscribe { println(it) } COMPOSITION & CLEAN CODE
57. Surfboard Recent board Ironing board COMPOSITION & CLEAN CODE
58. val currentBoard = currentBoardServiceMono() val recentBoards = recentBoardsServiceFlux() return currentBoard.concatWith(recentBoards) .map { boardService.getName(it) } .timeout(Duration.ofMillis(2500)) .onErrorReturn("Recent board”) .take(3) REAL WORLD EXAMPLE
59. Get exactly what you want Query multiple sources at once, specify what you want. Strongly typed schema Schema is a living documentation. Mature web clients Clients like Apollo let us remove dependency on Redux in ReactJs web apps. GraphQL
60. type Query { board(id: ID): Board } type Board { id: ID name: String issues: [Issue] } type Issue { id: ID key: String } SCHEMA
61. POST /jsw/graphql query { board(id: 42) { name issues { key } } } QUERY
62. { "data": { "board": { "name": "Software board” "issues": [ { "key": "KEY-1" } ] } } } RESPONSE
63. Project Reactor + GraphQL Java OUR SOLUTION
64. DataFetching Environment Subscriber Context PROJECT REACTOR GRAPHQL-JAVA
65. Let’s write some code GraphQL gateway, Jira Software style
66. GET https://catfact.ninja/fact { "fact": "The leopard is the most widespread of all big cats.", "length": 51 } CAT FACTS API
67. GET https://some-random-api.ml/facts/dog { "fact": "A dogs' first sense to develop is touch." } DOG FACTS API
68. Cat Facts Dog Facts
69. WHY NOT BOTH?
70. POST https://animalfactsgateway.com/grapqhl query { dog { fact length } cat { fact length } } ANIMAL FACTS GRAPHQL API
71. { "data": { "dog": { "fact": "Dog fact", "length": 8 }, "cat": { "fact": "Cat fact", "length": 8 } } }
72. dependencies { implementation("org.springframework.boot:spring-boot- starter-webflux") implementation("com.fasterxml.jackson.module:jackson- module-kotlin") implementation("org.jetbrains.kotlin:kotlin-reflect") implementation("org.jetbrains.kotlin:kotlin-stdlib-jdk8") implementation("com.graphql-java:graphql-java:11.0") }
73. package com.atlassian.jsw.factsdemo import o.s.b.autoconfigure.SpringBootApplication import o.s.b.runApplication @SpringBootApplication class DemoApplication fun main(args: Array<String>) { runApplication<DemoApplication>(*args) } APPLICATION
74. type Query { cat: Fact dog: Fact } type Fact { fact: String length: Int } GRAPHQL SCHEMA
75. interface FactFetcher: DataFetcher<CompletionStage<Fact?>> FETCHERS public interface DataFetcher<T> { T get(DataFetchingEnvironment env) throws Exception; }
76. data class Fact(val fact: String, val length: Int) FACT CLASS
77. @Component class CatFactFetcher(val webClient: WebClient) : FactFetcher { override fun get(environment: DataFetchingEnvironment): CompletionStage<Fact?> = webClient.get().uri("https://catfact.ninja/fact") .retrieve() .bodyToMono(CatFact::class.java) .map { Fact(it.fact, it.length) } .toFuture() } data class CatFact(val fact: String, val length: Int) CAT FACTS FETCHER
78. @Component class DogFactFetcher(val webClient: WebClient) : FactFetcher { override fun get(environment: DataFetchingEnvironment): CompletionStage<Fact?> = webClient.get().uri("https://.../facts/dog") .retrieve() .bodyToMono(DogFact::class.java) .map { Fact(it.fact, it.fact.length) } .toFuture() } data class DogFact(val fact: String) DOG FACTS FETCHER
79. @Configuration class GraphqlConfig { @Bean fun schema(wiring: RuntimeWiring): GraphQLSchema = SchemaGenerator().makeExecutableSchema( parseSchema(“/graphql/schema.graphqls"), wiring ) } GRAPHQL CONFIGURATION
80. @Configuration class GraphqlConfig { @Bean fun factsWiring( dogFactFetcher: DogFactFetcher, catFactFetcher: CatFactFetcher ): RuntimeWiring = RuntimeWiring.newRuntimeWiring() .type( newTypeWiring("Query") .dataFetcher("dog", dogFactFetcher) .dataFetcher("cat", catFactFetcher) ) .build() }
81. override fun processQuery( query: String ): Mono<ExecutionResult> = Mono.fromFuture( GraphQL .newGraphQL(graphQLSchema) .build() .executeAsync( ExecutionInput.newExecutionInput() .query(query) .build() ) ) SERVICE METHOD
82. @PostMapping( path = ["/graphql"], consumes = [MediaType.APPLICATION_JSON_VALUE], produces = [MediaType.APPLICATION_JSON_VALUE] ) fun graphql( @RequestBody body: Map<String, Any> ): Mono<Map<String, Any>> { val query: String = body["query"] as String? ?: "{}" return graphQLService.processQuery(query) .map { it.toSpecification() } } REACTIVE API
83. { "data": { "dog": { "fact": "“Him” and “Her” were the names of President Lyndon Johnson's two beagles.", "length": 73 }, "cat": { "fact": "Jaguars are the only big cats that don't roar.", "length": 46 } } } RESULT
84. Resilience Protect the downstream services from the upstream.
85. 250ms 380ms 380ms
86. CAT FACTS BROKEN 250ms 30s 30s
87. { "data": { "dog": {…}, "cat": null }, "errors": [ { "message": "Exception while fetching data (/cat) : Operation timed out", "path": [ "cat" ] } ] }
88. TIMEOUT 250ms 5000ms 5000ms
89. class CatFactFetcher( val webClient: WebClient ) : FactFetcher { override fun get(environment: DataFetchingEnvironment): CompletionStage<Fact?> = webClient.get().uri("https://catfact.ninja/fact") .retrieve() .bodyToMono(CatFact::class.java) .map { … } .timeout(Duration.ofMillis(5000)) .toFuture() } CAT FACTS WITH TIMEOUT
90. { "data": { "dog": {…}, "cat": null }, "errors": [ { "message": "Exception while fetching data (/cat) : Did not observe any item or terminal signal within 5000ms in 'map' (and no fallback has been configured)", "path": [ “cat" ] } ] }
91. CIRCUIT BREAKER 250ms 0ms 250ms
92. CIRCUIT BREAKER Closed Open Half-open
93. class CatFactFetcher( val webClient: WebClient, val catBreaker: CircuitBreaker ) : FactFetcher { override fun get(environment: DataFetchingEnvironment): CompletionStage<Fact?> = webClient.get()
 … .timeout(Duration.ofMillis(2500)) .transform( CircuitBreakerOperator.of(catBreaker) ) .toFuture() } CAT FACTS FETCHER WITH CIRCUIT BREAKER
94. @Bean fun catCircuitBreaker(): CircuitBreaker { val circuitBreakerConfig = CircuitBreakerConfig.custom() .ringBufferSizeInClosedState(3) .ringBufferSizeInHalfOpenState(3) .waitDurationInOpenState(Duration.ofMillis(5000)) .failureRateThreshold(0.5f) .build() return circuitBreakerRegistry.circuitBreaker( "CatCCB", circuitBreakerConfig ) }
95. { "data": { "dog": {…}, "cat": null }, "errors": [ { "message": "Exception while fetching data (/cat) : CircuitBreaker 'CatCCB' is OPEN and does not permit further calls", "path": [ "cat" ] } ] }
96. CIRCUIT BREAKER 250ms 0ms 250ms But we might miss some cat facts.
97. Takeaways Even if you forget everything else I said, please try…
98. GraphQL For APIs consumed from the front-end. Resilience To prevent propagating errors downstream. Reactive For I/O heavy apps. Takeaways
99. Beyond Future Because you were going to ask about coroutines…
100. GraphQL Java There are already pure Kotlin libraries. Spring boot has a set of starters too. Coroutines Support in Spring. New utilities for Project reactor. Alternatives
101. Resources Write your own reactive and resilient GraphQL gateway in Kotlin
102. 1 2 3 Animal Facts GraphQL Gateway https://bitbucket.org/atlassianlabs/animal-facts-graphql-gateway-demo/src/ master/ graphql-java https://www.graphql-java.com/ Resilience4j https://github.com/resilience4j/resilience4j Resources / Code
103. 4 GraphiQL https://github.com/graphql/graphiql Resources / Code 5 Coroutines-reactor https://github.com/Kotlin/kotlinx.coroutines/tree/master/reactive/kotlinx-coroutines- reactor
104. 1 2 3 Kotlin at Trello Trello tech blog:
 https://tech.trello.com/kotlin-at-trello/ Engineering stateless, high-availability cloud services at Atlassian Atlassian Engineering Blog: https://www.atlassian.com/blog/technology/aws-scaling-multi-region-low-latency- service More about Micros Slightly outdated, but still relevant.
 https://www.youtube.com/watch?v=dc2nqzgqH24 Resources / Further information
105. 1 Why not both? https://knowyourmeme.com/memes/why-not-both-why-dont-we-have-both Resources / Other 2 We are hiring! Jira Software is looking for engineers, Java and Kotlin http://go.atlassian.com/jsw-hiring
106. MARTIN VARGA | SOFTWARE DEVELOPER | @MARTINTEEVARGA Future of Jira Software Powered by Kotlin