How the #1 Neobank Used Mobot to Eliminate Manual Testing


#1 US Neobank

With over 12 million users, our customer is the number one neobank in the US. Founded as an alternative to traditional banking, with a mission of creating financial peace of mind, this company provides fee-free mobile banking services. When you open a bank account, you get a Visa Debit Card® and a Spending Account that can be managed directly from their mobile app, an optional savings account, the ability to send & receive money, and access to tens of thousands of Fee-Free ATMs. While technically not a bank, this neobank provides users with fantastic financial technology and services through their native iOS and Android apps. With over 1,500 employees, and over $1B in capital raised, they are not lacking in human or financial resources to get the job done. 

The Challenge

When you deal with people’s money, there is an extra level of scrutiny compared to other types of apps. Building trust with consumers is paramount, and nothing erodes trust faster than an app that doesn’t work.

This neobank’s app has a variety of complex features - new user account creation including sensitive bank account information, multi-factor authentication, check deposits, money transfers between devices, multi-device messaging to invite friends, and more. Many of these tests are very challenging to automate using traditional frameworks, and are not feasible using emulators or virtual devices. The customer has roughly 150 test cases that fall into this category, requiring manual testing from their team.

Adding to their already complex test cases, device and OS coverage are essential to ensure their millions of users have a seamless user experience. Building and maintaining the amount of physical devices needed for testing is costly and time-intensive.

To serve their ever growing user base, the customer releases to the app stores once per week with new products, upgrades, and general updates. In preparation for the weekly release, a US-based team member is designated as the person responsible for manually executing the test suite on the two physical devices in-house. On average, this manual testing would take 20+ hours each week.

  • 12 million users are spread across a large array of device and OS combinations
  • Has 150 test cases that are complex and very difficult to automate
  • Manual testing for each release takes 20+ hours per week
  • Number of physical devices available for testing is very limited

Mobot Solution

The neobank was introduced to the Mobot solution in 2021, while searching for ways to improve their release process. Their goals were to improve physical device coverage, eliminate manual testing for their internal team, and ensure they’re shipping the highest quality product to the app stores.

After a comprehensive onboarding consultation with the customer’s team, the Mobot CSM team designed and implemented a reliable and adaptable testing workflow. Using the customer’s existing test case checklist, the Mobot team built a suite of over 150 tests to be automated by the mechanical robots. 

To achieve the customer’s goal of increased device coverage, the teams worked together using the customer’s usage data to identify a rotating selection of 50 physical devices and operating systems that would be used in the tests. 

To ensure tight coordination and communication, a shared Slack channel was set up between the teams, and test results were integrated into the customer’s TestRails account.

The customer’s dedicated CSM became incredibly knowledgeable regarding their test cases and app, understanding when robot-reported results were bugs vs. design changes, and saving their engineering team countless hours sifting through data.

The Results

Today, the customer’s team can spend their time on higher-value work like exploratory testing, usability testing, and writing automation code. This new system where all critical manual testing is handled by Mobot’s human supervised, mechanical robots frees up over 20 hours per week of high value development time while also giving their team peace of mind.

Some highlights of the partnership:

  • 150+ test cases automated
  • Increased device coverage by 2,100%
  • Saved 20+ hours of manual testing per week. Almost 3 full person-days of work
  • Caught over 1,500 bugs before releasing to production

Customer Feedback

We've helped leading development teams around the world to improve their testing processes

5 star icon

Mobot is amazing! Great partner to make sure we don’t have any surprises when we release new versions of our SDK! This has been a huge game changer for our mobile team and has saved us and our customers a ton of time and headache.

Lewis Chung
Engineering Manager at Persona
5 star icon

Can’t say enough about how much better I feel with each release now that Mobot is part of the pipeline. Our stability rating for iOS is now at 100%!!!

Swamy R
CTO/COO of Sandboxx
5 star icon

MySwimPro members rely on us to reach their fitness goals, and we rely on Mobot to make that happen. When a swimmer is at peak performance in the final Sprint set of a 2000-meter workout, they expect the MySwimPro Coach on their Apple Watch to be at peak performance as well. To help us ensure that, the team at Mobot rolled up their sleeves and created some innovative robotic technology that had never been used for wearable QA before. They're pushing the boundaries of Mobile QA so that our members can push their fitness boundaries.

Nick Newell
VP of Engineering at MySwimPro
Browse All Success Stories →
5 star icon

More Case Studies You'd Enjoy

Upside Uses Mobot to Expedite Deep Link Testing and Improve Mobile Campaign Performance

Upside, a digital marketplace that connects millions of consumers with brick and mortar retailers nationwide, found a valuable ally in Mobot. Discover how Mobot has played a pivotal role in boosting Upside's confidence in mobile campaign testing and performance, fostering deeper user engagement, and swiftly resolving issues related to broken deep links.

Read Case Study →
View All Case Studies →