diff options
| author |   Miroslav Miklus <mmiklus@cisco.com> | 2016-05-19 13:59:30 +0200 |
|---|---|---|
| committer | Miroslav Miklus <mmiklus@cisco.com> | 2016-05-23 13:42:57 +0000 |
| commit | 5db24a985316c70a707f2a11b30dd00f7a98dca7 (patch) | |
| tree | d90d796239697f3b894bde336ad6e7075eac5884 /resources/libraries/robot/performance.robot | |
| parent | 3be854caa158bd5f150b6e0f50981ec2da73473a (diff) | |
Capture VPP stats for Long and Short tests
JIRA: CSIT-71
- remove warmup for short runs
- clear and collect stats for short run
- run short test with no failure for long test with NDR/PDR rate
Change-Id: I1b8879c3b891165072822207d0781687d8159336
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
Diffstat (limited to 'resources/libraries/robot/performance.robot')
| -rw-r--r-- | resources/libraries/robot/performance.robot | 30 |
1 files changed, 18 insertions, 12 deletions
diff --git a/resources/libraries/robot/performance.robot b/resources/libraries/robot/performance.robot index 8201ae405f..6c06288f53 100644 --- a/resources/libraries/robot/performance.robot +++ b/resources/libraries/robot/performance.robot @@ -181,8 +181,9 @@ | | Linear Search | ${start_rate} | ${topology_type} | | ${rate_per_stream}= | Verify Search Result | | Display result of NDR search | ${rate_per_stream} | ${framesize} | 2 -| | Clear and show runtime stats with running traffic | ${duration} -| | ... | ${rate_per_stream}pps | ${framesize} | ${topology_type} +| | Traffic should pass with no loss | ${duration} | ${rate_per_stream}pps +| | ... | ${framesize} | ${topology_type} +| | ... | fail_on_loss=${False} | Find NDR using binary search and pps | | [Documentation] | Find throughput by using RFC2544 binary search @@ -197,8 +198,9 @@ | | Binary Search | ${binary_min} | ${binary_max} | ${topology_type} | | ${rate_per_stream}= | Verify Search Result | | Display result of NDR search | ${rate_per_stream} | ${framesize} | 2 -| | Clear and show runtime stats with running traffic | ${duration} -| | ... | ${rate_per_stream}pps | ${framesize} | ${topology_type} +| | Traffic should pass with no loss | ${duration} | ${rate_per_stream}pps +| | ... | ${framesize} | ${topology_type} +| | ... | fail_on_loss=${False} | Find NDR using combined search and pps | | [Documentation] | Find throughput by using RFC2544 combined search @@ -215,8 +217,9 @@ | | Combined Search | ${start_rate} | ${topology_type} | | ${rate_per_stream}= | Verify Search Result | | Display result of NDR search | ${rate_per_stream} | ${framesize} | 2 -| | Clear and show runtime stats with running traffic | ${duration} -| | ... | ${rate_per_stream}pps | ${framesize} | ${topology_type} +| | Traffic should pass with no loss | ${duration} | ${rate_per_stream}pps +| | ... | ${framesize} | ${topology_type} +| | ... | fail_on_loss=${False} | Display result of NDR search | | [Documentation] | Display result of NDR search in packet per seconds (total @@ -230,17 +233,20 @@ | Traffic should pass with no loss | | [Arguments] | ${duration} | ${rate} | ${framesize} | ${topology_type} -| | Clear and show runtime stats with running traffic | ${duration} +| | ... | ${fail_on_loss}=${True} +| | Clear and show runtime counters with running traffic | ${duration} | | ... | ${rate} | ${framesize} | ${topology_type} +| | Clear all counters on all DUTs | | Send traffic on tg | ${duration} | ${rate} | ${framesize} -| | ... | ${topology_type} -| | No traffic loss occurred +| | ... | ${topology_type} | warmup_time=0 +| | Show statistics on all DUTs +| | Run Keyword If | ${fail_on_loss} | No traffic loss occurred -| Clear and show runtime stats with running traffic +| Clear and show runtime counters with running traffic | | [Arguments] | ${duration} | ${rate} | ${framesize} | ${topology_type} | | Send traffic on tg | -1 | ${rate} | ${framesize} | | ... | ${topology_type} | warmup_time=0 | async_call=True -| | Clear runtime statistics on all DUTs +| | Clear runtime counters on all DUTs | | Sleep | ${duration} -| | Show runtime statistics on all DUTs +| | Show runtime counters on all DUTs | | Stop traffic on tg |