From d637af34421fffe61417bb16e45a7105aae118b9 Mon Sep 17 00:00:00 2001 From: Miroslav Miklus Date: Wed, 9 Mar 2016 15:48:59 +0100 Subject: DropRateSearch library - linear search - t-rex DropRateSearch implementation - long perf bridge_domain test - introduced PERFORMANCE_SHORT, PERFORMANCE_LONG test tags Change-Id: I497b72f3e6d58a67ca5a386403d1e84dcf433ec4 Signed-off-by: Miroslav Miklus --- tests/suites/performance/long_bridge_domain.robot | 66 ++++++++++++++++++++++ tests/suites/performance/short_bridge_domain.robot | 4 +- tests/suites/performance/short_ipv4.robot | 4 +- tests/suites/performance/short_xconnect.robot | 4 +- 4 files changed, 72 insertions(+), 6 deletions(-) create mode 100644 tests/suites/performance/long_bridge_domain.robot (limited to 'tests') diff --git a/tests/suites/performance/long_bridge_domain.robot b/tests/suites/performance/long_bridge_domain.robot new file mode 100644 index 0000000000..43076b38aa --- /dev/null +++ b/tests/suites/performance/long_bridge_domain.robot @@ -0,0 +1,66 @@ +# Copyright (c) 2016 Cisco and/or its affiliates. +# Licensed under the Apache License, Version 2.0 (the "License"); +# you may not use this file except in compliance with the License. +# You may obtain a copy of the License at: +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +*** Settings *** +| Resource | resources/libraries/robot/default.robot +| Resource | resources/libraries/robot/interfaces.robot +| Resource | resources/libraries/robot/bridge_domain.robot +| Resource | resources/libraries/robot/performance.robot +| Resource | resources/libraries/robot/counters.robot +| Library | resources.libraries.python.TrafficGenerator +| Library | resources.libraries.python.TrafficGenerator.TGDropRateSearchImpl +| Library | resources.libraries.python.NodePath +| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | PERFTEST_LONG +| Suite Setup | 3-node Performance Suite Setup +| Suite Teardown | 3-node Performance Suite Teardown +| Test Setup | Setup all DUTs before test +| Test Teardown | Run Keyword If Test Failed | Show statistics on all DUTs +| Documentation | Throughput search suite (long running test suite based on RFC2544). + +*** Test Cases *** +| Find NDR by using linear search and 64B frames through bridge domain in 3-node topology +| | Given L2 bridge domain initialized in a 3-node circular topology +| | Then Find NDR using linear search and pps | 64 | 4600000 | 100000 +| | ... | 3-node-bridge | 14000000 | 100000 + +*** Keywords *** + +| 3-node Performance Suite Setup +| | 3-node circular Topology Variables Setup +| | Initialize traffic generator | ${tg} | ${tg_if1} | ${tg_if2} +| | ... | ${dut1} | ${dut1_if1} | ${dut1_if2} +| | ... | ${dut2} | ${dut2_if1} | ${dut2_if2} +| | ... | L2 + +| 3-node Performance Suite Teardown +| | Teardown traffic generator | ${tg} + +| L2 bridge domain initialized in a 3-node circular topology +| | Vpp l2bd forwarding setup | ${dut1} | ${dut1_if1} | ${dut1_if2} +| | Vpp l2bd forwarding setup | ${dut2} | ${dut2_if1} | ${dut2_if2} +| | All Vpp Interfaces Ready Wait | ${nodes} + +| Find NDR using linear search and pps +| | [Arguments] | ${framesize} | ${start_rate} | ${step_rate} +| | ... | ${topology_type} | ${min_rate} | ${max_rate} +| | Set Duration | 60 +| | Set Search Rate Boundaries | 14000000 | 100000 +| | Set Search Linear Step | ${step_rate} +| | Set Search Rate Type pps +| | Linear Search | ${start_rate} | ${topology_type} +| | ${result_rate}= | Verify Search Result +| | Set Test Message | FINAL_RATE: ${result_rate} pps + +| Show statistics on all DUTs +| | Sleep | 10 | Waiting for statistics to be collected +| | Vpp show stats | ${dut1} +| | Vpp show stats | ${dut2} diff --git a/tests/suites/performance/short_bridge_domain.robot b/tests/suites/performance/short_bridge_domain.robot index 669450307b..96a8be3323 100644 --- a/tests/suites/performance/short_bridge_domain.robot +++ b/tests/suites/performance/short_bridge_domain.robot @@ -18,7 +18,7 @@ | Resource | resources/libraries/robot/counters.robot | Library | resources.libraries.python.TrafficGenerator | Library | resources.libraries.python.NodePath -| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV +| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | PERFTEST_SHORT | Suite Setup | 3-node Performance Suite Setup | Suite Teardown | 3-node Performance Suite Teardown | Test Setup | Setup all DUTs before test @@ -56,7 +56,7 @@ | Traffic should pass with no loss | | [Arguments] | ${duration} | ${rate} | ${framesize} | ${topology_type} -| | Send traffic on | ${nodes} | ${duration} +| | Send traffic on | ${tg} | ${duration} | | ... | ${rate} | ${framesize} | ${topology_type} | | No traffic loss occured diff --git a/tests/suites/performance/short_ipv4.robot b/tests/suites/performance/short_ipv4.robot index d89039e849..067646b4f8 100644 --- a/tests/suites/performance/short_ipv4.robot +++ b/tests/suites/performance/short_ipv4.robot @@ -22,7 +22,7 @@ | Library | resources.libraries.python.InterfaceUtil | Library | resources.libraries.python.IPv4Setup.Dut | ${nodes['DUT1']} | WITH NAME | dut1_v4 | Library | resources.libraries.python.IPv4Setup.Dut | ${nodes['DUT2']} | WITH NAME | dut2_v4 -| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV +| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | PERFTEST_SHORT | Suite Setup | 3-node Performance Suite Setup | Suite Teardown | 3-node Performance Suite Teardown | Test Setup | Setup all DUTs before test @@ -78,7 +78,7 @@ | Traffic should pass with no loss | | [Arguments] | ${duration} | ${rate} | ${framesize} | ${topology_type} -| | Send traffic on | ${nodes} | ${duration} +| | Send traffic on | ${tg} | ${duration} | | ... | ${rate} | ${framesize} | ${topology_type} | | No traffic loss occured diff --git a/tests/suites/performance/short_xconnect.robot b/tests/suites/performance/short_xconnect.robot index 7c33d4f545..7eff81cdce 100644 --- a/tests/suites/performance/short_xconnect.robot +++ b/tests/suites/performance/short_xconnect.robot @@ -19,7 +19,7 @@ | Library | resources.libraries.python.TrafficGenerator | Library | resources.libraries.python.InterfaceUtil | Library | resources.libraries.python.NodePath -| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV +| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV| PERFTEST_SHORT | Suite Setup | 3-node Performance Suite Setup | Suite Teardown | 3-node Performance Suite Teardown | Test Setup | Setup all DUTs before test @@ -57,7 +57,7 @@ | Traffic should pass with no loss | | [Arguments] | ${duration} | ${rate} | ${framesize} | ${topology_type} -| | Send traffic on | ${nodes} | ${duration} +| | Send traffic on | ${tg} | ${duration} | | ... | ${rate} | ${framesize} | ${topology_type} | | No traffic loss occured -- cgit 1.2.3-korg