Situation
Our client provides payment processing for restaurants and stores, and needed to automate over 32,000 regression test cases. Initially, testing efforts were focused on critical functionalities.
Our client now has confidence in the quality and reliability of test regression cycle releases delivered to customers.
However, as they adopted more frequent release cycles to stay competitive and deliver new features, the demand for thorough testing increased. This required a more extensive testing effort since manual regression testing had become impractical and time-consuming.
To keep up with the fast pace of development, they needed a testing strategy to maintain software quality.
Application architecture was complex due to Web, API and integration systems.
Action
We completed a comprehensive optimization of the regression suite, meticulously removing obsolete test cases and eliminating redundancy. This refinement process involved categorizing the suite based on the criticality and priority of each test case, ensuring that the most important functionalities were tested first.
Through this strategic approach, we achieved complete automation of the regression suite which enabled our customer to execute the full regression cycle efficiently, thereby restoring their confidence in the quality and reliability of the releases delivered to their end-users.
In addition, we developed a “single pane of glass” dashboard for end-to-end test coverage. This dashboard integrated seamlessly with our client’s Continuous Integration/Continuous Deployment (CI/CD) pipeline using Jenkins.
The dashboard provides a comprehensive view of all testing activities, results, and environments in one accessible interface. This integration facilitates real-time monitoring and management of the testing process, enhancing transparency and control.
Results
Our script development stabilized the testing framework, providing high visibility of test cases, leading to:
- Increased productivity, reduction of risks, and optimization of the large regression test suite.
- Efficient monitoring and continuous improvement.
- Seamless integration within the development lifecycle.
Script development stabilized the testing framework for test cases.
We developed a “single pane of glass” dashboard for end-to-end test coverage.
The dashboard facilitates real-time monitoring and management of the testing process.
-
40%
Optimized regression test suite (from 33k to 18k) -
-
95%
Reduction in risk with regression test coverage -
-
60%
Improvement in automation scripting productivity