Over the last few years, we’ve talked to various of our clients across different industries and got to know their test challenges and needs. During these discussions, we learned about the real importance of unlimited device concurrency for enterprises and how it can help make the most of the allocated testing time. In this article, we’ll look at four of these critical use cases for testing with unlimited device concurrency.
Note: if you’re unsure what unlimited concurrency is, check the facts in our article here.
Case 1: Stay Confident with Fluctuating Demands in Testing
When and how do you test your mobile app? Imagine a blank diagram.
On the y-axis, we have the number of executed tests, and on the x-axis the project’s development time. Now imagine what that diagram would look like for your app. Would you end up with a perfectly straight line, a gentle wave, rugged or steep mountains?
Testing isn’t a consistent process, so we dare say that ending up with a straight line is unlikely. Most businesses would draw a wave-like line to represent their mobile app testing in the diagram. If you think about when tests are usually executed, this makes sense: right before the app or a new version of this app is released. Often, this is one of the most stressful times during an app’s development cycle. Things probably didn’t go as planned during development, and now you have less time than calculated until the release. As a result, you have to scale up your test resources to run as many tests as possible in the remaining time.
As thoroughly explained in our article on device testing concurrency, executing tests on as many devices as needed simultaneously saves time. Thanks to the flexibility that comes with unlimited parallelism, companies can scale up and down as needed. A tool or environment that supports this functionality grants you the ability to design workflows according to your needs, not the other way around.
Of course, a service that offers limited concurrency – let’s say 20 devices at a time – will provide you with faster results than running tests on one device at a time. However, we’ve found that our customers enjoy our service’s unlimited device concurrency because its scalability removes any bottleneck introduced by constraints.
Case 2: Split Tests Across Multiple Copies of the Same Device Combos
We are often amazed at how our customers use our real device cloud and its flexibility to work in their favor. The second use case is about “split testing” and how this method helps to achieve more in less time.
Imagine you have a test script that takes approximately 30 minutes to run. We’ve seen worse, but 30 minutes is still a long time, especially if you have several such test cases.
To save time, some of our customers create multiple copies of the same device configuration. Then, they split their test scripts into parts and execute them on the previously created devices concurrently. Instead of waiting 30 minutes for the test to finish, companies can view the test results after a few minutes.
The prerequisite for this procedure is that tests are only executed with the same device configuration – i.e., on the same model and operating system. Otherwise, you’d end up with inaccurate test results. Also, it is straightforward to see why unlimited device concurrency is perfect for split testing. If you divide your test script into n parts, you also need to run them on n devices at once. Otherwise, you’ll still encounter bottlenecks that hinder your app’s timely release.
Case 3: Avoid Long Waiting Times for Global Teams and Test at Once
In today’s work environment, it has become the norm that several teams work on the same project. Intelligent planning and communication tools have made it easy to collaborate with people working at the other end of the world (or at the other end of the building). Especially for large enterprises, the coordination of several teams with different tools is part of the daily work routine.
Let’s say your mobile teams use the same private, cloud-based device testing service with 100 connected devices. With this tool, however, only 20 devices can be tested simultaneously.
Once your teams reach the limit of running 20 devices at once, other users must wait. As a result, part of the production cycle comes to a standstill, and teams are facing idle times during which they probably can not work on anything else. Now imagine this happening multiple times per day – lots of valuable time may get wasted this way.
When we start thinking about how to tackle this challenge and make sure teams can be productive, the benefits of unlimited device concurrency come to mind. No matter how many developers and testers need to execute their tests on real devices – unlimited device concurrency lets everyone conduct tests whenever necessary. No one faces bottlenecks or idle time because they have to wait for test equipment.
Case 4: Test Under Different Development Environments Simultaneously
Developing and testing mobile apps requires not only the work of multiple teams but also the use of different environments.
Your developers probably use different settings for development, staging, and production to ensure the release of well-functioning and stable apps. If you follow the principles of continuous testing, you make sure you test early, frequently, and everywhere. Thus you can view working with different environments a prerequisite for effective and efficient continuous testing.
If you don’t use a test service that lets you run tests on an unlimited number of devices in parallel, you will experience similar issues, as in Case 3 above. If your team has to run tests when and where they are needed, you need a service that supports unlimited device concurrency.
As a result, no developer, or tester has to wait for others to finish their tests and can get the most out of the available time. What’s more, you can only get real benefits out of continuous testing when you don’t have to overcome unnecessary bottlenecks.
Wrapping Up – the Importance of Unlimited Device Testing Concurrency
Even if unlimited device concurrency sounded somewhat abstract at first, we hope our use cases help you gain a better and more complete understanding of its importance. Do you already have an idea of how to use the feature for your business, or would you like to experiment with it first? We invite you to try our real device cloud for free to experience the benefits of unlimited device concurrency yourself.
Image by nile via [source link] (copyright-free)