Performance of automated tests must be optimized by design and implementation, to achieve best coverage in shortest time possible within the constraints of the context.

This should be achieved by use of configurable synchronization parameters, proper design of automated test cases and test scenarios.

Failure criteria:

• Execution of knowingly failed test cases, i.e. execution of test case with dependency on previous one(s) that have just been failed.
• Semi-manual execution, where bits of execution are automated, but manual intervention is constantly required in between of executions.