Firebase Test Lab for Android reduced American Express app test costs by 50% Introduction The AMEX mobile app, with a million Android downloads, is used by Card Members to track spending and rewards, find offers, pay bills, and enjoy app-only features. To facilitate frequent updates, American Express built a device lab to test code changes in their app across all platforms before release.

Challenge With dozens of devices running various Android releases, the lab was tough to scale. Adding new tests decreased productivity because of the device lab’s limited throughput, and when new team members joined, the increased number of code changes added even more load. Maintaining the device lab was time-consuming and costly, diverting the attention of engineers who otherwise would have been focused on enhancements to drive additional value for Card Members. The devices commonly had issues that required manual intervention, often forcing reruns of the entire test suite. Problematic devices were regularly removed from the device lab, and replacing them often created down-time while the team awaited the arrival of new devices.

Solution During the product’s alpha period, the frequency of updates to the AMEX app, commitment to high-quality releases, and willingness of engineers to collaborate provided an ideal environment for the Firebase Test Lab team. American Express, in turn, provided valuable feedback that helped to shape the released version of the product. Firebase Test Lab integrated with American Express’ complex suite of hundreds of instrumentation tests. Even while Test Lab was in early development, American Express was able to switch all of their continuous integration testing to Test Lab and successfully retire much of their device lab. This enabled the engineers maintaining the devices to shift their focus to shipping new features to Card Members while also writing and running tests to ensure high product quality.

Results

30% more

tests in half the time

2X+

faster execution of full test suite, with no slowdown when adding tests

50%

lower cost vs. internal device lab

Learn more Find tools and infrastructure you need to build better apps and grow successful businesses across platforms, Android, iOS, and Web at: https://firebase.google.com



In addition, American Express was able to scale the number of tests without worrying about slowing down test-suite execution and scaling up a homegrown device lab. This includes handling surges in the number of tests as new team members join and generating additional code changes. American Express now runs over 1,000 instrumentation tests on every pull request, which equals hundreds of thousands of tests per public release. Running so many concurrent tests dramatically increases their ability to prevent new and recurring bugs, all thanks to Firebase Test Lab’s ability to massively parallelize testing.

Firebase Test Lab enables American Express to execute our entire extensive Android test suite for every pull request. Firebase takes care of scaling the test infrastructure, so our engineers can focus on the code, driving improvements to the app and corresponding changes to our test suite.

DISCLAIMER: Results may vary.

Michael Bailey, VP and Principal Engineer, American Express

30% more 2X+ 50% - Firebase

Introduction. The AMEX mobile app, with a million Android downloads, is used by. Card Members to track spending and rewards, find offers, pay bills, and.

76KB Sizes 0 Downloads 112 Views

Recommend Documents

2 weeks 50% 2500 - Firebase
analyzed and made accessible in mobile and web apps in real time. The company serves customers in the NHL, NCAA, EPL and other leagues. Challenge ... With Firebase Realtime Database, we felt we had built the best force-plate.

2 weeks 50% 2500 - Firebase
analyzed and made accessible in mobile and web apps in real time. The company ... analyze that data in the cloud and deliver the analytics instantly to coaches.

$50 or More - Be a Freelance Blogger
Contributor Bio: Yes, with a photo and links to your website or social media profiles. .... pays a $50 bonus for the 10 most popular posts on the site each month.

2X 7000 Developers
PARKING A BREEZE WITH ANDROID PAY. THE CHALLENGE. Barrier to entry. Parking in any city is tough. Searching for coins is less than ideal. PayByPhone,.

Halfbrick uses Firebase Predictions to boost ... - Firebase
Based on the results of the experiment, we decided to roll-out the in-game promotion to our entire user base. Now, any user that Predictions identifies as 'will churn' receives a gift of 2000 gold coins and 25 gacha tokens. We can't wait to test. Pre

PDF 30 Minute Ketogenic Cooking: 50+ Mouthwatering ...
PDF 30 Minute Ketogenic Cooking: 50+ Mouthwatering Low-Carb. Recipes to Save You Time and Money Download Online. Book Synopsis none. Book details.

Hawkin Dynamics - Firebase
Internet-connected force plates collect athletes' data, which is then analyzed ... company serves customers in the NHL, NCAA, EPL and other leagues. Challenge ... With Firebase Realtime Database, we felt we had built the best force-plate.

30-days-to-a-more-powerful-vocabulary.pdf
There was a problem previewing this document. Retrying... Download. Connect more apps... Try one of the apps below to open or edit this item.

eBook Download 30 Minute Ketogenic Cooking: 50+ ...
Money Read PDF ... Recipes to Save You Time and Money, pdf epub free download 30 Minute Ketogenic Cooking: 50+ ..... favorite fast and flavorful breakfasts,.