Screenshot your Entire App with Screengrab and Firebase

Presentation from the GDG Munich Android meetup

Transcript

1. Screenshot your Entire App Edward Dale Freeletics © Edward Dale, 2016 1
2. Screenshot your Entire App with Screengrab and Firebase Edward Dale Freeletics © Edward Dale, 2016 2
3. Find the bug(s) © Edward Dale, 2016 3
4. © Edward Dale, 2016 4
5. © Edward Dale, 2016 5
6. Some things are best verified visually ! Screenshot © Edward Dale, 2016 6
7. Screenshots are useful for • Acceptance testing • Edge case • Localization • Multiple devices • Regression testing © Edward Dale, 2016 7
8. Screenshot testing tools • Espresso tests • Dependency injection • Dependency mocking • Screengrab • Firebase Cloud Test Lab for Android © Edward Dale, 2016 8
9. Espresso test setup @MediumTest public class BuyCoachScreenGrab { @Inject DummyUserManager mUserManager; @Rule public ActivityTestRule<BuyCoachActivity> mActivityRule = new ActivityTestRule<>(BuyCoachActivity.class, false, false); © Edward Dale, 2016 9
10. Automated localized screenshots of your Android app on every device Screengrab ▶ Fastlane ▶ Fabric ▶ Twitter Combination of command-line tool and classes used in tests © Edward Dale, 2016 10
11. Screengrab test @Test public void testTestimonialMale() { when(mUserManager.getUser().getGender()).thenReturn(Gender.MALE); mActivityRule.launchActivity(new Intent()); onView(withId(R.id.feature_pager_videos)).perform(scrollTo()); Screengrab.screenshot("buy_coach_male_testimonial"); } © Edward Dale, 2016 11
12. Screengrab test @Test public void testTestimonialMale() { when(mUserManager.getUser().getGender()).thenReturn(Gender.MALE); mActivityRule.launchActivity(new Intent()); onView(withId(R.id.feature_pager_videos)).perform(scrollTo()); Screengrab.screenshot("buy_coach_male_testimonial"); } @Test public void testTestimonialFemale() { when(mUserManager.getUser().getGender()).thenReturn(Gender.FEMALE); mActivityRule.launchActivity(new Intent()); onView(withId(R.id.feature_pager_videos)).perform(scrollTo()); Screengrab.screenshot("buy_coach_female_testimonial"); } © Edward Dale, 2016 12
13. Screengrab configuration app_package_name 'com.freeletics.debug' app_apk_path 'Freeletics-debug.apk' tests_apk_path 'Freeletics-debug-androidTest.apk' locales ['en-US', 'fr-FR', 'it-IT', 'de-DE', 'pt-PT', 'es-ES', 'tr-TR', 'ja-JA'] use_tests_in_classes ['com.freeletics.coach.view.BuyCoachScreenGrab'] © Edward Dale, 2016 13
14. Running Screengrab $ ./gradlew clean assembleDebug assembleDebugTest $ screengrab © Edward Dale, 2016 14
15. Firebase Cloud Test Lab for Android Test your app on devices hosted in a Google datacenter. Combination of command-line tool and classes used in tests Also supports virtual devices © Edward Dale, 2016 15
16. Firebase Cloud Test Lab for Android Test your app on devices hosted in a Google datacenter. Combination of command-line tool and classes used in tests Also supports virtual devices $€£¥ © Edward Dale, 2016 16
17. Firebase test @Test public void testTestimonialMale() { when(mUserManager.getUser().getGender()).thenReturn(Gender.MALE); Activity activity = mActivityRule.launchActivity(new Intent()); onView(withId(R.id.feature_pager_videos)).perform(scrollTo()); ScreenShotter.takeScreenshot("buy_coach_male_testimonial", activity); } © Edward Dale, 2016 17
18. Screengrab Screengrab.screenshot("buy_coach_male_testimonial"); Firebase ScreenShotter.takeScreenshot("buy_coach_male_testimonial", activity); © Edward Dale, 2016 18
19. Running Firebase gcloud beta test android run --type instrumentation --app Freeletics-debug.apk --test Freeletics-debug-androidTest.apk --device-ids Nexus6 --os-version-ids 21 --locales en-US,fr-FR,it-IT,de-DE,pt-PT,es-ES,tr-TR,ja-JA --orientations portrait --test-targets "class com.freeletics.coach.view.BuyCoachScreenGrab" Also possible to stick this in a YML configuration file. © Edward Dale, 2016 19
20. Screengrab vs Firebase Fight! © Edward Dale, 2016 20
21. Screengrab • ✅ Free • ✅ No waiting for a free device • ❌ Limited by your devices © Edward Dale, 2016 21
22. Firebase • ✅ Easy to setup a test matrix • ✅ Fits well with a CI system • ❌ Have to wait your turn • ❌ Costs money • $5/hour for real device • $1/hour for virtual device © Edward Dale, 2016 22
23. My suggestion Use both © Edward Dale, 2016 23
24. Cross-platform test @Test public void testTestimonialMale() { when(mUserManager.getUser().getGender()).thenReturn(Gender.MALE); Activity activity = mActivityRule.launchActivity(new Intent()); onView(withId(R.id.feature_pager_videos)).perform(scrollTo()); ScreenShotter.takeScreenshot("buy_coach_male_testimonial", activity); Screengrab.screenshot("buy_coach_male_testimonial"); } Screengrab for daily development Firebase for CI regression testing © Edward Dale, 2016 24
25. Thanks! Edward Dale (@scompt) Freeletics (We're hiring) © Edward Dale, 2016 25