Scaling Android Builds in Pandemic Times

Droidcon America

Transcript

1. Scaling Android Builds in Pandemic Times Iñaki Villar @inyaki_mwc
2. BUILD
3. BUILD GRADLE PLUGINS .GRADLE .KTS
4. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP
5. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP
6. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP ~/.gradle — wrapper — caches — modules-2 — files-1 — …
7. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP
8. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP ./gradlew clean
9. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP
10. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP LOCAL CACHE
11. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP
12. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP
13. - Task Type / Classpath - Build Stack Components (Gradle, AGP, KGP, builders…) - Build script when affects execution of the task - Names of the output properties Build Cache Key
14. - Task Type / Classpath Build cache key for task 'generateDebugBuildConfig' is d7ac6c5c1072df6d3f86efda018f0136 - Build Stack Components (Gradle, AGP, KGP, builders…) - Build script when affects execution of the task - Names of the output properties Build Cache Key
15. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP
16. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP ./gradlew clean
17. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP
18. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP GRADLE REMOTE
19. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP
20. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP rm -rf ~/.gradle/caches
21. BUILD GRADLE PLUGINS .GRADLE .KTS DEP DEP DEP DEP DEP DEP
22. BUILD LOCAL CACHE REMOTE CACHE
23. BUILD LOCAL CACHE REMOTE CACHE GRADLE ENTERP. REDIS S3
24. buildCache { local { enabled = !gradle.ext.isCi } remote(HttpBuildCache) { url = buildCacheUrl push = gradle.ext.isCi } }
25. buildCache { local { enabled = !gradle.ext.isCi } remote(HttpBuildCache) { url = buildCacheUrl push = gradle.ext.isCi } }
26. buildCache { local { enabled = !gradle.ext.isCi } remote(HttpBuildCache) { url = buildCacheUrl push = gradle.ext.isCi } } https://docs.gradle.org/current/dsl/org.gradle.caching.http.HttpBuildCache.html
27. buildCache { local { enabled = !gradle.ext.isCi } remote(HttpBuildCache) { url = buildCacheUrl push = gradle.ext.isCi } }
28. buildCache { local { enabled = !gradle.ext.isCi } remote(HttpBuildCache) { url = buildCacheUrl push = gradle.ext.isCi } } buildCache { registerBuildCacheService(S3.class, S3CacheFactory.class) remote(S3.class) { enabled = true push = true region = AWS_REGION bucket = AWS_BUCKET awsAccessKeyId = AWS_KEY awsSecretKey = AWS_SECRET awsSessionToken = AWS_TOKEN } }
29. buildCache { local { enabled = !gradle.ext.isCi } remote(HttpBuildCache) { url = buildCacheUrl push = gradle.ext.isCi } } buildCache { registerBuildCacheService(S3.class, S3CacheFactory.class) remote(S3.class) { enabled = true push = true region = AWS_REGION bucket = AWS_BUCKET awsAccessKeyId = AWS_KEY awsSecretKey = AWS_SECRET awsSessionToken = AWS_TOKEN } }
30. buildCache { local { enabled = !gradle.ext.isCi } remote(HttpBuildCache) { url = buildCacheUrl push = gradle.ext.isCi } } buildCache { registerBuildCacheService(S3.class, S3CacheFactory.class) remote(S3.class) { enabled = true push = true region = AWS_REGION bucket = AWS_BUCKET awsAccessKeyId = AWS_KEY awsSecretKey = AWS_SECRET awsSessionToken = AWS_TOKEN } }
32. CI BUILD REMOTE CACHE LOCAL BUILD LOCAL BUILD LOCAL BUILD
34. Task Task Task Task Task Task Task Task Task
35. Task Task Task Task Task Task Task Task Task
36. Task Task Task Task Task Task Task Task Task 2k tasks
37. Task Task Task Task Task Task Task Task Task 2k tasks
38. Task Task Task Task Task Task Task Task Task 2k tasks 13m 42s
39. Task Task Task Task Task Task Task Task Task 2k tasks 13m 42s 99% Hit Ratio
40. Task Task Task Task Task Task Task Task Task 6k tasks
41. Task Task Task Task Task Task Task Task Task 6k tasks 3m 10s 100% Hit Ratio
42. CI BUILD LOCAL BUILD
43. CI BUILD LOCAL BUILD
44. CI BUILD LOCAL BUILD —scan
45. Task requested from cache 6805 Hit 6805 100% Local disabled Remote 6805 100% Miss 0 CI BUILD LOCAL BUILD
46. Task requested from cache 6805 Hit 6805 100% Local disabled Remote 6805 100% Miss 0 CI BUILD LOCAL BUILD
47. Task requested from cache 6805 Hit 6805 100% Local disabled Remote 6805 100% Miss 0 CI BUILD LOCAL BUILD
48. Task requested from cache 6805 Hit 6805 100% Local disabled Remote 6805 100% Miss 0 CI BUILD LOCAL BUILD
49. Task requested from cache 6805 Hit 6805 100% Local disabled Remote 6805 100% Miss 0 Task requested from cache 6805 Hit 6755 99% Local 2728 40% Remote 4027 59% Miss 50 CI BUILD LOCAL BUILD
50. Task requested from cache 6805 Hit 6805 100% Local disabled Remote 6805 100% Miss 0 Task requested from cache 6805 Hit 6755 99% Local 2728 40% Remote 4027 59% Miss 50 CI BUILD LOCAL BUILD
51. Task requested from cache 6805 Hit 6805 100% Local disabled Remote 6805 100% Miss 0 Task requested from cache 6805 Hit 6755 99% Local 2728 40% Remote 4027 59% Miss 50 CI BUILD LOCAL BUILD
52. Task requested from cache 6805 Hit 6805 100% Local disabled Remote 6805 100% Miss 0 Task requested from cache 6805 Hit 6755 99% Local 2728 40% Remote 4027 59% Miss 50 CI BUILD LOCAL BUILD
53. Task requested from cache 6805 Hit 6805 100% Local disabled Remote 6805 100% Miss 0 Task requested from cache 6805 Hit 6755 99% Local 2728 40% Remote 4027 59% Miss 50 Remote Cache (HTTP) Operations Hit 4027 Miss library:ui:kaptDebugKotlin library:ui:compileDebugKotlin app:kaptDebugKotlin app:compileDebugKotlin … CI BUILD LOCAL BUILD
54. Task requested from cache 6805 Hit 6805 100% Local disabled Remote 6805 100% Miss 0 Task requested from cache 6805 Hit 6755 99% Local 2728 40% Remote 4027 59% Miss 50 Remote Cache (HTTP) Operations Hit 4027 Miss library:ui:kaptDebugKotlin library:ui:compileDebugKotlin app:kaptDebugKotlin app:compileDebugKotlin … CI BUILD LOCAL BUILD
60. Infrastructure
61. Switches
64. gradleEnterprise { buildScan { isCaptureTaskInputFiles = true } }
65. gradleEnterprise { buildScan { isCaptureTaskInputFiles = true } } ./gradlew build -Dscan.capture-task-input-files
74. ./gradlew build -PisStrictModeEnabled=true
75. Cache misses
76. Cache misses Directory is only declared as an input in build A
77. Cache misses
78. Cache misses
79. Cache misses
80. Cache misses
81. Cache misses
82. https://developers.soundcloud.com/blog/gradle-remote-build-cache-misses-part-2 https://developers.soundcloud.com/blog/gradle-remote-build-cache-misses By Nelson Osacky Cache misses
83. Analyzing Local Builds
84. -Dorg.gradle.caching.debug=true Analyzing Local Builds
85. > Task :library:data:generateDebugBuildConfig 'appPackageName' to build cache key: f6bd6b3389b872033d462029172c8612 'buildConfigPackageName' to build cache key: 314a123772713f0e033d60dfa62e8a83 'buildTypeName' to build cache key: 1d2b35e3e2924d8f29639aa6b3873a11 'debuggable' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'enableGradleWorkers' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'flavorName' to build cache key: f1d3ff8443297732862df21dc4e57262 'itemValues' to build cache key: 8222d82255460164427051d7537fa305 'library' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'versionCode' to build cache key: 8d6fc65b288946cac11b2aaa4ef11de5 'versionName' to build cache key: f13b59d185c6ccc578fb0e600efd5f05 'mergedManifests' to build cache key: 5fd1e7396e8de4cb5c23dc6aadd7787a Appending output property name to build cache key: sourceOutputDir Build cache key for task ':library:data:generateDebugBuildConfig' is d7ac6c5c1072df6d3f86efda018f0136
86. > Task :library:data:generateDebugBuildConfig 'appPackageName' to build cache key: f6bd6b3389b872033d462029172c8612 'buildConfigPackageName' to build cache key: 314a123772713f0e033d60dfa62e8a83 'buildTypeName' to build cache key: 1d2b35e3e2924d8f29639aa6b3873a11 'debuggable' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'enableGradleWorkers' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'flavorName' to build cache key: f1d3ff8443297732862df21dc4e57262 'itemValues' to build cache key: 8222d82255460164427051d7537fa305 'library' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'versionCode' to build cache key: 8d6fc65b288946cac11b2aaa4ef11de5 'versionName' to build cache key: f13b59d185c6ccc578fb0e600efd5f05 'mergedManifests' to build cache key: 5fd1e7396e8de4cb5c23dc6aadd7787a Appending output property name to build cache key: sourceOutputDir Build cache key for task ':library:data:generateDebugBuildConfig' is d7ac6c5c1072df6d3f86efda018f0136
87. > Task :library:data:generateDebugBuildConfig 'appPackageName' to build cache key: f6bd6b3389b872033d462029172c8612 'buildConfigPackageName' to build cache key: 314a123772713f0e033d60dfa62e8a83 'buildTypeName' to build cache key: 1d2b35e3e2924d8f29639aa6b3873a11 'debuggable' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'enableGradleWorkers' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'flavorName' to build cache key: f1d3ff8443297732862df21dc4e57262 'itemValues' to build cache key: 8222d82255460164427051d7537fa305 'library' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'versionCode' to build cache key: 8d6fc65b288946cac11b2aaa4ef11de5 'versionName' to build cache key: f13b59d185c6ccc578fb0e600efd5f05 'mergedManifests' to build cache key: 5fd1e7396e8de4cb5c23dc6aadd7787a Appending output property name to build cache key: sourceOutputDir Build cache key for task ':library:data:generateDebugBuildConfig' is d7ac6c5c1072df6d3f86efda018f0136
88. > Task :library:data:generateDebugBuildConfig 'appPackageName' to build cache key: f6bd6b3389b872033d462029172c8612 'buildConfigPackageName' to build cache key: 314a123772713f0e033d60dfa62e8a83 'buildTypeName' to build cache key: 1d2b35e3e2924d8f29639aa6b3873a11 'debuggable' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'enableGradleWorkers' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'flavorName' to build cache key: f1d3ff8443297732862df21dc4e57262 'itemValues' to build cache key: 8222d82255460164427051d7537fa305 'library' to build cache key: f6d7ed39fe24031e22d54f3fe65b901c 'versionCode' to build cache key: 8d6fc65b288946cac11b2aaa4ef11de5 'versionName' to build cache key: f13b59d185c6ccc578fb0e600efd5f05 'mergedManifests' to build cache key: 5fd1e7396e8de4cb5c23dc6aadd7787a Appending output property name to build cache key: sourceOutputDir Build cache key for task ':library:data:generateDebugBuildConfig' is d7ac6c5c1072df6d3f86efda018f0136
89. CI BUILD LOCAL BUILD
90. coroutinesStr$kotlin_gradle_plugin sourceCompatibility targetCompatibility classpath commonSourceSet CI BUILD LOCAL BUILD incrementalCompilationEnabled
91. f6bd6b3389b872033d462029172c8612 f6bd6b3389b872033d462029172c8612 coroutinesStr$kotlin_gradle_plugin incrementalCompilationEnabled sourceCompatibility targetCompatibility classpath commonSourceSet 314a123772713f0e033d60dfa62e8a83 1d2b35e3e2924d8f29639aa6b3873a11 8d6fc65b288946cac11b2aaa4ef11de5 314a123772713f0e033d60dfa62e8a83 1d2b35e3e2924d8f29639aa6b3873a11 8d6fc65b288946cac11b2aaa4ef11de5 5fd1e7396e8de4cb5c23dc6aadd7787a 5fd1e7396e8de4cb5c23dc6aadd7787a CI BUILD LOCAL BUILD f6d7ed39fe24031e22d54f3fe65b901c 8222d82255460164427051d7537fa305
92. f6bd6b3389b872033d462029172c8612 f6bd6b3389b872033d462029172c8612 coroutinesStr$kotlin_gradle_plugin sourceCompatibility targetCompatibility classpath commonSourceSet 314a123772713f0e033d60dfa62e8a83 1d2b35e3e2924d8f29639aa6b3873a11 8d6fc65b288946cac11b2aaa4ef11de5 314a123772713f0e033d60dfa62e8a83 1d2b35e3e2924d8f29639aa6b3873a11 8d6fc65b288946cac11b2aaa4ef11de5 5fd1e7396e8de4cb5c23dc6aadd7787a 5fd1e7396e8de4cb5c23dc6aadd7787a f6d7ed39fe24031e22d54f3fe65b901c 8222d82255460164427051d7537fa305 CI BUILD LOCAL BUILD incrementalCompilationEnabled
93. 100%?
94. 100%?
95. https://github.com/gradle/android-cache-fix-gradle-plugin
96. https://github.com/gradle/android-cache-fix-gradle-plugin
97. https://github.com/gradle/android-cache-fix-gradle-plugin
98. https://github.com/gradle/android-cache-fix-gradle-plugin plugins { id(“org.gradle.android.cache-fix”).version(“1.0.13") }
100. BUILD ENVIRONMENT CI REMOTE CACHE LOCAL BUILD LOCAL BUILD LOCAL BUILD
101. REMOTE CACHE LOCAL BUILD LOCAL BUILD LOCAL BUILD CI INTERNAL BUILD ENVIRONMENT EXTERNAL BUILD ENVIRONMENT
102. REMOTE CACHE LOCAL BUILD LOCAL BUILD LOCAL BUILD POPULATE CACHE JOB CI INTERNAL BUILD ENVIRONMENT EXTERNAL BUILD ENVIRONMENT REPOSITORY
103. CI BUILD EXTERNAL BUILD ENVIRONMENT REPOSITORY CI BUILD CI BUILD CI BUILD
104. CI BUILD EXTERNAL BUILD ENVIRONMENT REPOSITORY CI BUILD CI BUILD CI BUILD BUILD CACHE
105. CI BUILD EXTERNAL BUILD ENVIRONMENT REPOSITORY CI BUILD CI BUILD CI BUILD BUILD CACHE S3 BUCKET
106. CI BUILD EXTERNAL BUILD ENVIRONMENT REPOSITORY CI BUILD CI BUILD CI BUILD BUILD CACHE S3 BUCKET AWS-CLI AWS ROLE AES_256
107. RESULTS
108. RESULTS
109. f6bd6b3389b872033d462029172c8612 Task X COMMIT MAIN
110. f6bd6b3389b872033d462029172c8612 Task X COMMIT MAIN POPULATE CACHE
111. f6bd6b3389b872033d462029172c8612 Task X COMMIT MAIN POPULATE CACHE REPO LOCAL BUILD
112. f6bd6b3389b872033d462029172c8612 Task X COMMIT MAIN POPULATE CACHE REPO LOCAL BUILD f6bd6b3389b872033d462029172c8612 Task X
113. f6bd6b3389b872033d462029172c8612 Task X COMMIT MAIN POPULATE CACHE REPO LOCAL BUILD f6bd6b3389b872033d462029172c8612 Task X
114. f6bd6b3389b872033d462029172c8612 8222d82255460164427051d7537fa305 Task X COMMIT MAIN POPULATE CACHE REPO LOCAL BUILD Task X
115. f6bd6b3389b872033d462029172c8612 314a123772713f0e033d60dfa62e8a83 Task X COMMIT MAIN POPULATE CACHE REPO LOCAL BUILD Task X
116. ? POPULATE CACHE
117. ? POPULATE CACHE BUILD STACK GRADLE AGP KGP BULDSRC INVALIDATE CACHE
118. PR PR PR PR
119. + + + + BUILD STACK CHANGE GRADLE AGP KGP BULDSRC PR PR PR PR
120. + + + + BUILD STACK CHANGE GRADLE AGP KGP BULDSRC REMOTE CACHE 314a123772713f0e033d60dfa62e8a83 1d2b35e3e2924d8f29639aa6b3873a11 8d6fc65b288946cac11b2aaa4ef11de5 5fd1e7396e8de4cb5c23dc6aadd7787a PR PR PR PR
121. + + + + BUILD STACK CHANGE GRADLE AGP KGP BULDSRC REMOTE CACHE LOCAL BUILD LOCAL BUILD LOCAL BUILD LOCAL BUILD 314a123772713f0e033d60dfa62e8a83 1d2b35e3e2924d8f29639aa6b3873a11 8d6fc65b288946cac11b2aaa4ef11de5 5fd1e7396e8de4cb5c23dc6aadd7787a PR PR PR PR
122. RESULTS
123. RESULTS
124. Thanks
125. @ZacSweers @AutonomousApps @CesarDielo @arunkumar_9t2 @VladimirSitnikv @Louis_CAD @ubiratanfsoares @ychescale9 @sboishtyan @CristianGM_dev @nellyspageli @vRallev @artem_zin Thanks @anton_malinskiy @stepango @joenrv @schatchenko @___mokkun___ @jeoj
126. Thanks Iñaki Villar @inyaki_mwc