Passfail criteria does not work properly

book

Article ID: 220449

calendar_today

Updated On:

Products

BlazeMeter

Issue/Introduction

A Performance test kicked off from a Taurus YML file which contains a reporting->criteria section fails to report any criteria failures even though some of the configured criteria limits are exceeded.  In addition, the Failure Criteria report is not generated for the test.

Cause

There were spaces around each of the configured criteria condition operators which caused the criteria to be ignored.  The following is an example of an incorrectly configured reporting->criteria section in a Taurus YML file:

reporting:
- criteria:
  - avg-rt of  myElementLabe>  >500ms, continue as failed
  - fail of myElementLabel >1%, continue as failed
  - p90 of myElementLabel >3s, continue as failed

Environment

Release : SAAS

Component : BLAZEMETER PERFORMANCE TESTING

Resolution

Per the instructions in the Taurus Pass/Fail Criteria article, no spaces should surround the operator.

The correct syntax for the sample reporting->criteria section would be:

reporting:
- criteria:
  - avg-rt of myElementLabel>500ms, continue as failed
  - fail of myElementLabel>1%, continue as failed
  - p90 of myElementLabel>3s, continue as failed