When a test fails

A failed test isn’t always a problem with the test. Sometimes it has found a real bug in your application, which is a good failure. Other failures come from how the test was built or from changes in the page. Use this checklist to tell which it is.

What to do

1. Read the error. Open the failing step on the results page and read its error message.
2. Compare screenshots. Look at the screenshot taken during the run and compare it with the baseline.
3. Reproduce it by hand. If you suspect a bug, perform the steps manually to see whether you can reproduce the problem.
4. Check the common causes. Most failures fall into a few categories with known fixes. See Common failures and error messages.

If the cause is still unclear, ask CloudQA for help: select the failed test cases in the Test Recorder and select Assist me.