taurus.yml rc500 option is not working since upgrading to taurus 1.13.8 to 1.15.2

Products

• BlazeMeter

Issue/Introduction

 

Good day,
We are experiencing an issue with one of our tests in BlazeMeter where we use pass-fail module via a taurus.yml and use the rc500 as a criteria.
We have discovered that since the update any rc criteria are not working anymore.
According to Taurus docs, this option should still be available
https://gettaurus.org/docs/PassFail/
When we verify our taurus.yml we get the following error on verification in BlazeMeter;
Criteria string is malformed in its subject part:
subject rc500 is not supported

Can you inform us if this feature is still working as intended or that there are known issues with it?

Environment

 

BLAZEMETER PERFORMANCE TESTING
SAAS

Resolution

 

Based on the error, the validator does not like line 58, which is a pass/fail criteria for checking for 500 response codes in a single second.
This pass/fail criterion does not work in BlazeMeter, thus, the validation is picking it up and throwing the error we see.
The reason this is happening now is due to the change we made earlier this year where converted pass/fail criteria to BlazeMeter fail criteria, where possible.
(this was a new Check put in place to prevent problems)
If the line is commented out, the validation will pass, as can be seen in the attached screenshot.