Design and evaluation of a Robot Framework-based test suite for the test editor feature of a Telecom Call Manager
Kühnis, Lars (2026)
Kandidaatintyö
2026
School of Energy Systems, Sähkötekniikka
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi-fe2026032122339
https://urn.fi/URN:NBN:fi-fe2026032122339
Tiivistelmä
This bachelor's thesis studies the automation of GUI-based testing for the Test Editor feature of an internal telecommunications Call Manager tool. The aim is to replace current manual regression tests with a time-saving and maintainable Robot Framework test suite executed through a TAM and to quantitatively analyze how much faster automated testing is compared to manual execution.
The thesis combines theoretical background on the fundamentals of software testing, test design techniques, and agile practices. A master test plan was created based on the theoretical background, from which 27 GUI-level test cases from the Test Editor feature were implemented as Robot Framework scripts using SeleniumLibrary and other Robot keywords. The manual benchmark was set using three experienced test engineers executing the same 27 test cases with exactly the same test steps manually while recording their screens. The timing data was developed from video recordings and Robot logs and quantitatively analyzed.
The results from the analysis show that the automated test suite executed roughly 3.9 times faster than manual testing, considering the productive time, and roughly 2.7 times faster when considering the full end-to-end test duration. This equates to a reduction of 75% and 63% respectively. The findings from this thesis show that the Call Manager's Test Editor feature can effectively be automated using Robot Framework and an internal TAM, and that automation reduces execution time significantly while also supporting higher cadence regression testing within an agile environment.
The thesis combines theoretical background on the fundamentals of software testing, test design techniques, and agile practices. A master test plan was created based on the theoretical background, from which 27 GUI-level test cases from the Test Editor feature were implemented as Robot Framework scripts using SeleniumLibrary and other Robot keywords. The manual benchmark was set using three experienced test engineers executing the same 27 test cases with exactly the same test steps manually while recording their screens. The timing data was developed from video recordings and Robot logs and quantitatively analyzed.
The results from the analysis show that the automated test suite executed roughly 3.9 times faster than manual testing, considering the productive time, and roughly 2.7 times faster when considering the full end-to-end test duration. This equates to a reduction of 75% and 63% respectively. The findings from this thesis show that the Call Manager's Test Editor feature can effectively be automated using Robot Framework and an internal TAM, and that automation reduces execution time significantly while also supporting higher cadence regression testing within an agile environment.