Approaching E2E UI test automation technology acquisition through proof of concept

Abstract

Software testing is one of the key disciplines affecting the success rate of software projects. In DevOps, automation is seen as one of the cornerstones, as is continuous testing. This thesis suggests an approach which can support a decision process of selecting a feasible test automation technology. It does so through a practical case study where a realistic set of requirements limits the quality assurance process possible to that of a black box. Two enterprise-centric E2E UI frameworks – Tricentis Tosca and UFT One – are shortlisted for in-depth benchmarking using a selected set of metrics based on the specified case study’s requirements. These metrics are populated with the results of a several-month process involving the development of two PoC’s with the aforementioned frameworks and quantified to support the decision process regarding a test automation technology acquisition for the software project. Within the case study context, Tricentis Tosca is selected as the more suitable E2E UI testing framework for usage at scale, and the impact of these results is critically evaluated regarding its potential for reusability in other contexts.