Assume that you are the TAE responsible for the correct functioning of a TAS, deployed in a test environment that consists of a few machines running the same version of the operating system. The TAS has been working and stable since its deployment, it has been used to run an automated test suite consisting of many similar automated test. The infrastructure team is planning to update the operating system on these machines by installing a new the service pack for security reasons. Since the vendor of the operating system assurance full backward compatibility, the infrastructure team assurance that there will be no impacts on the functioning of the TAS.
What is the BEST approach to confirm the correct functioning of the TAS in this scenario?
In a first possible implementation, the automated test scripts within a suite locate and interact with elements of a web UI indirectly through the browsers using browser-specific drivers and APIs, provided by an automated test tool used as part of the TAS. In an alternative implementation, these test scripts locate and interact with elements of the same web UI directly at the HTML level by accessing the DOM (Document Object Model) and internal JavaScript code. The first possible implementation:
Consider a TAS associated to dynamically changing software frequent releases. Your goal is to determine the amount of effort required to maintain the automated tests of the regression test suite for each new release of the SUT.
What is the MOST important metric to collect to achieve your goal?
A TAS is used to run on a test environment a suite of automated regression tests, written at the UI level, on different releases of a web app: all executions complete successfully, always providing correct results (i.e., producing neither false positives nor false negatives). The tests, all independent of each other, consist of executable test scripts based on the flow model pattern which has been implemented in a three-layer TAF (test scripts, business logic, core libraries) by expanding the page object model via the façade pattern. Currently the suite takes too long to run, and the test scripts are considered too long in terms of LOC (Lines of Code). Which of the following recommendations would you provide for improving the TAS (assuming it is possible to perform all of them)?