aboutsummaryrefslogtreecommitdiffstats
path: root/tests/suites/performance
diff options
context:
space:
mode:
authorpmikus <pmikus@cisco.com>2016-06-10 07:05:38 +0100
committerpmikus <pmikus@cisco.com>2016-06-13 08:43:55 +0100
commit23d5e7c58dff725043bf15d2099e2e168050f256 (patch)
treed5b14f01de8602b78e3eec223f0d8a73cc0b508c /tests/suites/performance
parentf54659a337045921002d508c48696359d913b044 (diff)
Adjust short test treshold based on latest results
Change-Id: Iad121a9f047e85f6e8cd8539af1aff829c10c875 Signed-off-by: pmikus <pmikus@cisco.com>
Diffstat (limited to 'tests/suites/performance')
-rw-r--r--tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot12
-rw-r--r--tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot8
-rw-r--r--tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot6
-rw-r--r--tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot12
4 files changed, 19 insertions, 19 deletions
diff --git a/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot
index f17b2f8a70..4066840300 100644
--- a/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot
@@ -91,14 +91,14 @@
| | Then Traffic should pass with no loss | ${duration} | ${rate}
| | ... | ${framesize} | 3-node-IPv4
-| 2core VPP with rxqueues 1 passes 64B frames through IPv4 forwarding with COP at 2x 7.5Mpps in 3-node topology
+| 2core VPP with rxqueues 1 passes 64B frames through IPv4 forwarding with COP at 2x 6.6Mpps in 3-node topology
| | [Documentation]
| | ... | VPP with 2 cores should pass 64B frames through IPv4 forwarding
-| | ... | at 2x 7.5Mpps (2x 10Gbps) in 3-node topology with COP.
+| | ... | at 2x 6.6Mpps in 3-node topology with COP.
| | [Tags] | 2_THREAD_NOHTT_RXQUEUES_1 | MULTI_THREAD
| | ${framesize}= | Set Variable | 64
| | ${duration}= | Set Variable | 10
-| | ${rate}= | Set Variable | 7.5mpps
+| | ${rate}= | Set Variable | 6.6mpps
| | Given Add '2' worker threads and rxqueues '1' without HTT to all DUTs
| | And Add all PCI devices to all DUTs
| | And Add No Multi Seg to all DUTs
@@ -156,14 +156,14 @@
| | Then Traffic should pass with no loss | ${duration} | ${rate}
| | ... | ${framesize} | 3-node-IPv4
-| 4core VPP with rxqueues 2 passes 64B frames through IPv4 forwarding with COP at 2x 7.8Mpps in 3-node topology
+| 4core VPP with rxqueues 2 passes 64B frames through IPv4 forwarding with COP at 2x 10.0Mpps in 3-node topology
| | [Documentation]
| | ... | VPP with 4 cores and rxqueues 2 should pass 64B frames through IPv4
-| | ... | forwarding at 2x 7.8Mpps in 3-node topology with COP.
+| | ... | forwarding at 2x 10.0Mpps in 3-node topology with COP.
| | [Tags] | 4_THREAD_NOHTT_RXQUEUES_2 | MULTI_THREAD
| | ${framesize}= | Set Variable | 64
| | ${duration}= | Set Variable | 10
-| | ${rate}= | Set Variable | 7.8mpps
+| | ${rate}= | Set Variable | 10.0mpps
| | Given Add '4' worker threads and rxqueues '2' without HTT to all DUTs
| | And Add all PCI devices to all DUTs
| | And Add No Multi Seg to all DUTs
diff --git a/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot
index 505cb99e6f..bf8c3dd030 100644
--- a/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot
@@ -78,7 +78,7 @@
| 2core VPP with rxqueues 1 passes 64B frames through IPv4 forwarding at 2x 7.5Mpps in 3-node topology
| | [Documentation]
| | ... | VPP with 2 cores should pass 64B frames through IPv4 forwarding
-| | ... | at 2x 7.5Mpps (2x 10Gbps) in 3-node topology.
+| | ... | at 2x 7.5Mpps in 3-node topology.
| | [Tags] | 2_THREAD_NOHTT_RXQUEUES_1 | MULTI_THREAD | NDR
| | ${framesize}= | Set Variable | 64
| | ${duration}= | Set Variable | 10
@@ -122,14 +122,14 @@
| | Then Traffic should pass with no loss | ${duration} | ${rate}
| | ... | ${framesize} | 3-node-IPv4
-| 4core VPP with rxqueues 2 passes 64B frames through IPv4 forwarding at 2x 7.8Mpps in 3-node topology
+| 4core VPP with rxqueues 2 passes 64B frames through IPv4 forwarding at 2x 10.0Mpps in 3-node topology
| | [Documentation]
| | ... | VPP with 4 cores and rxqueues 2 should pass 64B frames through IPv4
-| | ... | forwarding at 2x 7.8Mpps in 3-node topology.
+| | ... | forwarding at 2x 10.0Mpps in 3-node topology.
| | [Tags] | 4_THREAD_NOHTT_RXQUEUES_2 | MULTI_THREAD | NDR
| | ${framesize}= | Set Variable | 64
| | ${duration}= | Set Variable | 10
-| | ${rate}= | Set Variable | 7.8mpps
+| | ${rate}= | Set Variable | 10.0mpps
| | Given Add '4' worker threads and rxqueues '2' without HTT to all DUTs
| | And Add all PCI devices to all DUTs
| | And Add No Multi Seg to all DUTs
diff --git a/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot
index 3b7103cc28..81ffdd8f0b 100644
--- a/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot
@@ -24,14 +24,14 @@
| Documentation | Minimal throughput acceptance test cases
*** Test Cases ***
-| 1core VPP passes 78B frames through IPv6 forwarding with COP at 2x 2.9Mpps in 3-node topology
+| 1core VPP passes 78B frames through IPv6 forwarding with COP at 2x 2.8Mpps in 3-node topology
| | [Documentation]
| | ... | VPP with 1 core should pass 78B frames through IPv6 forwarding
-| | ... | at 2x 2.9Mpps in 3-node topology with COP.
+| | ... | at 2x 2.8Mpps in 3-node topology with COP.
| | [Tags] | 1_THREAD_NOHTT_RXQUEUES_1 | SINGLE_THREAD | NDR
| | ${framesize}= | Set Variable | 78
| | ${duration}= | Set Variable | 10
-| | ${rate}= | Set Variable | 2.9mpps
+| | ${rate}= | Set Variable | 2.8mpps
| | Given Add '1' worker threads and rxqueues '1' without HTT to all DUTs
| | And Add all PCI devices to all DUTs
| | And Add No Multi Seg to all DUTs
diff --git a/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot b/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot
index 6559ba1a82..576a66f74c 100644
--- a/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot
+++ b/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot
@@ -105,16 +105,16 @@
| | Then Traffic should pass with no loss | ${duration} | ${rate}
| | ... | ${framesize} | 3-node-xconnect
-| 2core VPP with rxqueues 1 passes 64B frames through VLAN dot1q sub-interfaces inter-connected using L2 cross connect at 2x5.8Mpps in 3-node topology
+| 2core VPP with rxqueues 1 passes 64B frames through VLAN dot1q sub-interfaces inter-connected using L2 cross connect at 2x7.0Mpps in 3-node topology
| | [Documentation]
| | ... | VPP with 2 cores should pass 64B frames through VLAN dot1q
-| | ... | sub-interfaces inter-connected using L2 cross connect at 2x5.8Mpps in
+| | ... | sub-interfaces inter-connected using L2 cross connect at 2x7.0Mpps in
| | ... | 3-node topology. Tagging is applied between DUTs inserting 4B VLAN ID
| | ... | into a packet header.
| | [Tags] | 2_THREAD_NOHTT_RXQUEUES_1 | MULTI_THREAD | NDR
| | ${framesize}= | Set Variable | 64
| | ${duration}= | Set Variable | 10
-| | ${rate}= | Set Variable | 5.8mpps
+| | ${rate}= | Set Variable | 7.0mpps
| | Given Add '2' worker threads and rxqueues '1' without HTT to all DUTs
| | And Add all PCI devices to all DUTs
| | And Add No Multi Seg to all DUTs
@@ -182,16 +182,16 @@
| | Then Traffic should pass with no loss | ${duration} | ${rate}
| | ... | ${framesize} | 3-node-xconnect
-| 4core VPP with rxqueues 2 passes 64B frames through VLAN dot1q sub-interfaces inter-connected using L2 cross connect at 2x9.0Mpps in 3-node topology
+| 4core VPP with rxqueues 2 passes 64B frames through VLAN dot1q sub-interfaces inter-connected using L2 cross connect at 2x11Mpps in 3-node topology
| | [Documentation]
| | ... | VPP with 4 cores and rxqueues 2 should pass 64B frames through VLAN dot1q
-| | ... | sub-interfaces inter-connected using L2 cross connect at 2x9.0Mpps in
+| | ... | sub-interfaces inter-connected using L2 cross connect at 2x11Mpps in
| | ... | 3-node topology. Tagging is applied between DUTs inserting 4B VLAN ID
| | ... | into a packet header.
| | [Tags] | 4_THREAD_NOHTT_RXQUEUES_2 | MULTI_THREAD | NDR
| | ${framesize}= | Set Variable | 64
| | ${duration}= | Set Variable | 10
-| | ${rate}= | Set Variable | 9.0mpps
+| | ${rate}= | Set Variable | 11.0mpps
| | Given Add '4' worker threads and rxqueues '2' without HTT to all DUTs
| | And Add all PCI devices to all DUTs
| | And Add No Multi Seg to all DUTs