Software testing and QA is sometimes given low priority during development. The idea of treating software testers as adversaries by the developers seems old-fashioned and is short-sighted. Itโs hard to believe that such an attitude can still exist, and yet it still persists, even in a modern DevOps team. But a DevOps-focused software team benefits when it considers QA/testing as an integral part of developing high-quality applications.
In a business setting, the hidden costs of buggy or unsecure software are lost productivity, revenue and extra work by the development team (and even extra work by users, if the software isnโt running right). QA/testing helps test for system flaws, vulnerabilities and security issues, so why wouldnโt a DevOps team be supportive?
QA/testing can help an enterprise avoid big mistakes. In fact, the DevOps Institute notes, โWith the advent of DevOps and the movement to break down silos between developers and operations, it becomes critically important that all members of an IT teamโregardless of what tools they use, or role they playโunderstand the essentials of testing.โ And, according to Puppet, a standard for automating the delivery and operation of software, high-performing enterprises build quality testing into each stage of their software development process.
Make QA/Testing a Priority
Whether your DevOps-focused developers are handling the QA/testing themselves or passing it along to QA/testing specialists, itโs something that must be done. Ideally, developers themselves would handle QA/testing in an integrated DevOps environment, and thatโs why some developers see it as an unwelcome chore. Itโs not something theyโre usually trained in, and they might struggle with it or see it as a burden. That could be the reason why some DevOps teams hit a โsoftware testing bottleneck.โ As data from a Vanson Bourne survey commissioned by Appvance shows, 73 percent of 200 enterprise IT decision makers in the United States have adopted DevOps processes, but 57 percent of those adoptees experienced a bottleneck during software testing that impacts how quickly new and updated software can be released.
On the flip side, the developerโs company may have QA/testing professionals in-house, so the developers are hands-off in that area. Needless to say, the relationship between developer and the QA/testing pro could get a little rocky. Just think about it: The role of the QA/testing specialist is to find problems and point out issues with the developerโs code. Or, perhaps the developer or engineering staff is lagging behind schedule, so the team inevitably needs QA/testing to rush its processes, further creating a tense or adversarial relationship between the two groups.
At one of my startups a while back, we worked for months on our first software release of a web application for an online marketplace. Late on a Wednesday night, we let the CEO of our company try it outโand the app immediately crashed. โGee,โ I said, โIt was working on my computer.โ Of course, it really wasnโt. We had synchronization problems, which are common in multi-threaded applications that access the same information for multiple users. And we made the mistake of letting the CEO be the first simultaneous user to try it out (creating a bad impression), instead of making organized QA/testing a priority at our company.
QA/testing in a DevOps environment can help your team avoid mistakes, so passion for app functionality doesnโt supersede quality and robust bug-free software. In the end, what you need from your team is passion for both functionality and quality/testing. Otherwise, youโll deliver a faulty product and lose customers or usersโunnecessarilyโbecause of a bad first impression by your software.
Two Approaches for Integrating QA/Testing with DevOps
When youโre integrating QA/testing into your DevOps environment, there are two different approaches or procedures to ponder. First is the more traditional test of the full system, sometimes called integration testing. The second is test driven development (TDD), which is popular in Agile and Scrum methodologies. The main difference between the two is in how software code is tested. During integration testing, developers review and test the code. Then, for critical facets of the software, a peer review of code is completed. Afterward, testers create scripts and deploy an array of integration and system tests. These could include scalability testing, load testing, stress testing and very importantly, security testing. Code vulnerability, SQL injections and malicious code would be things to think about.
Under TDD, the order in which testing appears in the cycle is reversed. Each developer first writes โunit testsโ and then writes the code. This is done iteratively in such a way that every discrete section of code is automatically tested. When new code is sent to the integration server, the tests go with it. The server itself runs unit tests for all the code that developers deposit in the server. On top of this, testers design system and integration tests to run automatically by the integration server. Finally, testers perform any manual tests that are impossible to automate. In this way, the integrity and quality of the code is constantly guaranteed.
Academic studies and field experience suggest that TDD increases development time by approximately 15 percent โฆ but hold on. Experience also shows that total cost of ownership of TDD-developed software is lower than software using integration testing only. Itโs worth noting that by using TDD and integration testing, a company can deploy software of world-class quality that exhibits less than 0.3 errors per 1,000 lines of code during 18 months of use.
QA/Testing: A Partner in Your Softwareโs Success
If youโre hesitant about integrating QA/testing into your DevOps team and instead tempted to outsource it, you may want to push pause. Itโs actually quite challenging if you do development in-house and expect to simply outsource what you think is independent QA with cheap testers. Outsourcing QA/testing and assuming that piece is done is not really outsourcingโitโs staff augmentation at a distance and it usually doesnโt work. You donโt want a โsiloed teamโ to handle a critical component such as QA/testing. Instead, outsource QA/testing and bring your in-house and outsourced teams together around a common DevOps culture and mindset.
DevOps experts Bob Aiello and Leslie Sachs, in an IBM report, say quality software โโฆ requires not only a shift in behavior, but a dramatic shift in the organizational culture as well.โ So whether you outsource or have an in-house squad, your developers and the entire team should take ownership of QA/testing, and remain open to new ways to test code efficiently.
Ultimately, QA/testing should not be viewed as a time-consuming, disruptive chore by anyone on your team or in your enterprise. Think of it as a partner in your softwareโs successโnot an adversary.
About the Author / Steve Mezak
Steve Mezak is founder and CEO of Accelerance, a leader in global software development outsourcing, as well as the author of “Software Without Borders,” co-author of, “Outsource or Else: How a VP of Software Saved His Company,” and a CIO columnist.



