Scaling Emulators for Better Testing: Droidcon 2025

Transcript

1. Scaling Emulators for Better Testing Amanjeet Singh https://www.amanjeet.me/
2. • Open source • Community > 5k+ members • Stars ~ 9k ⭐ • Cross Platform Maestro: E2E testing Framework
3. Why Moving to Cloud?
4. Why Moving to Cloud? “Running parallel tests, faster feedback for releasing apps”
5. How to run on cloud?
6. Cloud Providers
7. Cloud Providers
8. Self Hosted
9. Self Hosted
10. Self Hosted
11. Self Hosted
12. Why Self Hosted?
13. Why Self Hosted in 500 mg app?
14. Why Self Hosted in 500 mg app? • Add to cart fl ow in fl aky network.
15. • Launching 500mg consumer app on TvOS/WatchOS • Add to cart fl ow in fl aky network. Why Self Hosted in 500 mg app?
16. • Supporting 500mg app for multiple locale • Launching 500mg consumer app on TvOS/WatchOS • Add to cart fl ow in fl aky network. Why Self Hosted in 500 mg app?
17. • Supporting 500mg app for multiple locale • Launching 500mg consumer app on TvOS/WatchOS • Add to cart fl ow in fl aky network. • You don’t want to spend money 🤣 Why Self Hosted in 500 mg app?
18. • Supporting 500mg app for multiple locale • Launching 500mg consumer app on TvOS/WatchOS • Add to cart fl ow in fl aky network. • You don’t want to spend money 🤣 More Control Why Self Hosted in 500 mg app?
19. Helping Tom 👨💻 From 500mg
20. Project: Setup Emulators Infra
21. • Setup Android Virtual Devices (AVDs) • Giving AVDs superpowers • Deployment of AVDs and Launching them Project: Setup Emulators Infra
22. Setup Android Virtual Devices (AVDs) • CLI ✅, Android Studio GUI ❌
23. Setup Android Virtual Devices (AVDs) • CLI ✅, Android Studio GUI ❌ • CLI ✅, Android Studio GUI Creating AVD Downloading AVDs Selecting the con fi gurations
24. • Download and Creating AVDs Setup Android Virtual Devices (AVDs)
25. • Applying con fi guration to AVD Setup Android Virtual Devices (AVDs)
26. Super Powers Unlocked
27. Super Powers Unlocked Issue I: API 29 breaks in every other release - Crash rate stuck at ~94% 📉
28. Super Powers Unlocked Issue I: API 29 breaks in every other release - Crash rate stuck at ~94% 📉
29. Super Powers Unlocked Issue II: Expanding to watchOS + tvOS — need platform parity ⌚📺
30. Super Powers Unlocked Issue II: Expanding to watchOS + tvOS — need platform parity ⌚📺
31. Super Powers Unlocked Issue III: New Android versions every year — must stay ahead 🚀
32. Super Powers Unlocked Issue III: New Android versions every year — must stay ahead 🚀
33. Setup Android Virtual Devices (AVDs) Project: Setup Emulators Infra ✅ android-36, 8 Gib emulator, arm-64, 4 CPU core 👉
34. Setup Android Virtual Devices (AVDs) Project: Setup Emulators Infra ✅ Launch Emulators ✅
35. Let’s Deploy 🚀
36. It works, But 🥲
37. Issue Category I
38. Issue Category I • Issue I: Chrome Welcome Screen
39. Issue Category I • Issue I: Chrome Welcome Screen • Issue II: Timing issues, due to animations
40. Issue Category I • Issue I: Chrome Welcome Screen • Issue III: Different apps interfering • Issue II: Timing issues, due to animations
41. Issue Category I • Issue I: Chrome Welcome Screen • Issue III: Different apps interfering • Issue II: Timing issues, due to animations • Issue IV: I don’t know where my test taps
42. Issue Category I • Issue V: Screen recording limit of 3 mins • Issue I: Chrome Welcome Screen • Issue III: Different apps interfering • Issue II: Timing issues, due to animations • Issue IV: I don’t know where my test taps https://maestro.dev/blog/ fi xing-androids-3-minute-screen-recording-limitation
43. Tom-Man got Covered 👨💻
44. Tom-Man got Covered 👨💻
45. Tom-Man got Covered 👨💻 Super Power: Emulator Snapshots
46. Emulator Snapshots
47. Emulator Snapshots • Boot Emulator
48. Emulator Snapshots • Boot Emulator • Apply the adb con fi gurations
49. Emulator Snapshots • Boot Emulator • Apply the adb con fi gurations • Backup the qcow2 image and swap it with original
50. Emulator Snapshots • Boot Emulator • Apply the adb con fi gurations • Backup the qcow2 image and swap it with original • Launch the emulator and don’t save snapshot during test fi nish
51. Issue Category II Product Team @ 500mg
52. Requirement I • Requirement I: We need to test 500 mg with different locales
53. Tom-Man discovering Powers! 👨💻
54. Locale Superpower ✅
55. Requirement II • We must test 500mg under flaky, edge-speed networks, because users are not able to order
56. Super Power: Emulator Options 👨💻
57. Super Power: Emulator Options 👨💻
58. Super Power: Emulator Options 👨💻
59. • We must test 500 mg in low ram device Super Power: Emulator Options 👨💻
60. Issue Category III
61. Issue Category III • Emulator disconnects in middle of test, adbd dies randomly.
62. Issue Category III • Emulator disconnects in middle of test, adbd dies randomly. • 500 mg flow for KYC works locally but not on cloud 🥲
63. Issue Category III • Emulator disconnects in middle of test, adbd dies randomly. • 500 mg flow for KYC works locally but not on cloud 🥲 Issue X: Only happens on cloud and not local 👉
64. Super Power: Emulator Logs 👨💻
65. Super Power: Emulator Logs 👨💻 Idea: Using emulator logs around the time of failure for better debugging
66. Super Power: Emulator Logs 👨💻 Idea: Using emulator logs around the time of failure for better debugging
67. Super Power: Emulator Logs 👨💻 Idea: Using emulator logs around the time of failure for better debugging
68. POV of CI at 500mg! • Emulator Snapshots • Emulator Command line Options • Emulator logs • 500mg Test Driver APK for Locale
69. Finally Works ✅
70. Fin 🙋