Compare Test Results

OctoPerf allows you to compare from two to four test results in the same report by clicking on the Create Comparison button in the reports page:

Then you can select the results to compare:

These comparison report are like standard reports, except the fact that your can select a test result when editing a metric.

Result labels

The comparison reports starts with a header that lists the compared tests, with their start date, end date and duration:

By default, bench results are referred to by their run number: Run 4, Run 5, etc.

In the legend of every report item, these names are used to identify each result:

Note

The Delta Table can be used to compare a single metric value for each compared test result.

Update labels

You can use the Report configuration page to edit the labels associated with each test:

This will update the labels on all the graphs and menus:

The report header and the time range configuration use these labels too:

Note

Updating test labels will not affect the blocs of text and titles, these will have to be changed manually.

Time range

Once the tests are finished, you can restrict the comparison to a part of each test, for example to compare the steady state of two tests without their ramp-up. Use Set Up Time range from the report actions menu: each compared test gets its own interval.

All the items of the report are then computed on the interval of each test. Check the time range configuration page for more details.

Edit Metrics

When editing metrics (for Line Chart curves or Table columns), you can select the bench result: