Not able to get DevTest Metrics for Suites Executed through lisa-invoke

Products

• Service Virtualization

Issue/Introduction

We used to get monthly suite executions when we used ANT to trigger the suites. Now that we are using Lisa-Invoke we are not able to capture how many suites were executed for a specific time period. 

We pull this report from the Enterprise Dashboard using the Export Usage Audit Data. Select time period.

Environment

All supported DevTest releases.

Cause

Timing issue.

 

It takes some time, by default 60 minutes, when data is sent to Enterprise Dashboard. The columns are read from the Enterprise Dashboard database so if there is no data for Workstation (or data has not been sent from the Registry to the Enterprise Dashboard, then it will not show up on the report.

Resolution

Test invoke API can return suite information for suites executed by time period. Refer to section "Test Invoke API", in the documentation of the version of DevTest being run.

Of these counts: 

These counts are passed/aborted/failed tests in Suites that were executed. 

To get statistics about how many suites were executed, 

"http://localhost:1505/lisa-test-invoke/api/v1/suites/reports?startTime=2018-09-11T00:00:00-0700&endTime=2018-09-26T16:33:00-0000"

In the report there is "count" field with the total suites number.

Additional Information

Will see the Workstation column if the reports were executed from the Workstation.

Will see a DevTest Portal column if executing from DevTest Portal.

Regression runner should show if executing from Jenkins.   Regression Runner column only shows up if a report was run from a user with a role of Runtime User.