Documentation

Testing History

Testing History

Testing History stores evidence from completed and previous testing runs.

What history can contain

A saved run can include:

  • Instance
  • Test
  • Status
  • Start time
  • Duration
  • Step status
  • Step duration
  • Failure details
  • Screenshots
  • Comparison screenshots
  • Diff screenshots
  • Visual difference percentage

Review a run

  1. Open Testing History.
  2. Find the appropriate run.
  3. Open its detail view.
  4. Review the overall outcome.
  5. Inspect failed steps.
  6. Review screenshots and diffs.
  7. Compare with earlier runs when necessary.

What to investigate first

Prioritize:

  1. Fatal or availability failures.
  2. Authentication/admin failures.
  3. Critical functional failures.
  4. Missing assets.
  5. Unexpected visual changes.
  6. Slow steps.

Before-and-after comparison

History is most useful when both a baseline and a post-change run exist.

Compare:

  • Tests selected
  • Environment
  • Failures
  • Durations
  • Screenshots
  • Visual diffs

Using history for release decisions

A successful run is evidence, not an absolute guarantee.

Consider:

  • Whether the correct tests were selected.
  • Whether critical business workflows were covered.
  • Whether warnings were reviewed.
  • Whether external integrations were realistically represented.

Troubleshooting old failures

Historical evidence lets you determine whether a newly noticed problem actually began with the latest update.

Look for the earliest run showing the same failure.

On this page