Deep Dive on DevOps in Mobile App Testing

Deep Dive on Mobile DevOps

Dear Testdroiders,

Mobile is more important than ever. The increasing competition with mobile apps and user acquisition has pushed companies to act quickly with its development and operations. Getting that app ‘right’ in the first place, and working properly with a myriad of different device configurations is a task that should be considered way before mobile app is published. In this the DevOps culture, process and tools have a significant role.

We’ll deep dive into definitions of DevOps and what it means in the mobile app dev and test context.

deep-dive-on-devops-820x410

DevOps is no doubt one of the buzz words for today’s agile business culture. DevOps have been adopted widely in variety of different types of software companies building yet more different types of products. What DevOps actually mean and what are the implications of this approach for mobile app development and testing? As defined by Wikipedia:

“Practices that emphasize the collaboration and communication of both software developers and other information-technology (IT) professionals while automating the process of software delivery and infrastructure changes.” Wikipedia

What drives companies towards this type of DevOps thinking? First of all, there are always business requirements and demand that drives the adoption of any sort of process or culture changes within companies. With DevOps approach the apparent benefits for business are the full adoption into agile methodology, getting things done faster and with focused mentality on support, operations and services. And when these two are combined businesses want to get both as efficiently as possible.

Despite the bar has been set high for mobile apps to be successful, there are lots of different characters, things that should be considered when adopting DevOps approach for mobile app development and testing. These requirements are driven by app developers, business, and most importantly, the end users. Get our free ebook to adopt DevOps and succeed in your mobile projects.

What is Mobile DevOps?

The DevOps thinking has become an established part of companies and development teams relying on agile methodologies. The combination of agile methodologies and DevOps are in essence to provide continuous integration and continuous deployment to speed up the integration, deployment and testing, plus improve the quality of application. Getting the mobile app instantly from the build system to real device where application can be thoroughly tested improves the overall process velocity and makes the bug fixing easier and faster.

mobile-devops-deconstructed

The DevOps in mobile means incorporating the continuous integration and testing process tightly with the delivery and deployment, and wrapping up everything in continuous operations. Developers – and development in general – focus on building the actual product while relying on their own relevant tools for them. The quality assurance (QA) is stakeholder that is interested (and responsible) in testing those regressions, performance of the product, and preferably automating as many aspects of the testing flow as possible. The operations maintain the continuous build, integration, deployment and delivery environments, and take care of those releases. When combining all these three different functions into one holistic approach Mobile DevOps can be used as a definition.

3 Rule of Thumbs in Mobile DevOps

Mobile DevOps is an approach that focus on communication, integration, deployment, automation and measurement of collaboration between app developers, testers (QA folks) and the operations. The whole thing is to acknowledge the interdependence nature of this approach and rely on the right tools, methods and infrastructure in order to develop, deliver and test apps faster and more efficiently.

Develop and Test Against Real Environment

The most important thing for mobile developers is that the end-product works across on all its target devices. Using emulators or simulators are acceptable in the earliest phase of the development, but when app becomes more sophisticated and have the features that end-users will see, the only acceptable way is to test mobile apps on real devices.

Nowadays, it’s not a cost issue and nevertheless organizations spend significant sums in their hardware infrastructure. It’s well justified to not to try to save in the most important hardware cost – the real mobile devices – to get the app thoroughly and comprehensively tested out. As said, not everything should be acquired by organization itself, but using a cloud service that contains the right set of mobile devices is a perfect fit for today’s mobile devops toolchain.

Deploy and Test Frequently (Many Times, Every Day)

Agile methodology praises the use of continuous integration and delivery tools. There are plenty of great open source as well as commercial tools available that help organizations to build, deploy, test and release their apps. The most meaningful value-add to this flow is the mobile test automation that can accommodate frequent builds to testing context and enable instant bug hunting.

The continuous development and testing integration can enable companies to respond to market and competitive changes in timely manner. Reusing the code, back-end implementations, APIs and other infrastructure to build a new version of the mobile application is easier, as well as testing of that when infrastructure is in place. The frequent deployment and testing also enhances ability to automate functional, compatibility and performance testing of the application, against an array of devices and different form factors.

Continuously Consider and Validate Quality Characteristics

The modern mobile devops is (all) about continuous everything. The DevOps approach should always strive to improve things, process, culture, and even reconsider what devops tools should be in use. The continuous evaluation of the efficiency and productivity can get insights to real performance issues and how to make things smoother and work seamlessly in the next regression.

Changing the devops tools should be considered every now and then, especially if there are any doubts about the current environment, its capability to deliver and work as efficiently as possible. And this doesn’t apply only for devops tools but also how mobile devices and device infrastructure is used. The requirements are constantly moving and that primarily due to demand by end-users. The quality characteristics of mobile app are set from the first line of code until it’s on hands of end-users, and everything that happens between that should be measured, validated and fixed – if needed.

3 Business-Critical Mobile DevOps Considerations

From the business perspective, the ability to quickly introduce new app, features in it, and bug fix releases is one of the most critical tasks for companies with mobile-first strategy. In essence, the core of DevOps methodology aims at speeding up the app development, delivery and process by getting developers and operation specialists to collaborate throughout the end-to-end app development and deployment process.

Continuous Integration and Continuous Delivery

Continuous integration and delivery can be measured with various different metrics. However, what are the most important ones for mobile app development and testing matter the most. For example:

  • Frequency of deployment and tests executed (against each regression).
  • How many new features, lines of code or other integrations have been deployed by each build.
  • What is the actual time between the development (when it started) and test finalization.
  • Percentage and total number of failures vs. successful tests.
  • Urgency to get mobile app published.
  • Performance of automation. Do you need to tweak in something manually?

Now, these metrics are valid for every regression of the app. Each and every time when source code is modified and new build is deployed, it should be thoroughly tested. With test automation that’s not a challenge but really a smooth process that gets instant results without any manual intervention.

Application and Infrastructure Testing and Monitoring

When talking about mobile apps it’s not only about the APK or IPA deployed on device, but more often there is tremendous number of dependencies to other applications, backends, and network(s). Developing, deploying and testing in the infrastructure context also improves insights of how well the entire environment does and how application performs. In this context, it’s also much easier to drive iterations to make usability, UI and user experience aspects better: If something lags or performs bad in the system it will have an impact to all other pieces of the system.

Monitoring mobile apps, websites, APIs and all other relevant parts is also important. While app may perform just fine there are other entities that doesn’t necessarily provide the same level of performance. Accurate performance analysis with the real data helps improving the overall development flow.

Comprehensive Dev&Test Process and Mobile App Delivery

It’s always important to remember that organizations that use agile methodology should reduce things that get done manually. Things that get done manually (especially testing) are never agile. The agile development sprints that include test automation will be faster and generally the adoption of the right tools, methods and technologies speed up the development and testing tremendously. Agile development is the epicenter of today’s mobile app development process, culture, and should be reflected in tools used by developers.

We’ll continue with the mobile devops theme in our next blog, so stay tuned and keep testing! 


Manifesto: Everything about Mobile DevOps

Learn how to properly adopt DevOps approach for your mobile team and get the most out of it.

Download

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close