From ad71afc5baa8008bd5d4ea26f51a71eefe3fbe62 Mon Sep 17 00:00:00 2001 From: Peter Mikus Date: Tue, 10 Jul 2018 06:10:41 +0000 Subject: Refactor perf test cases - Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus --- ...2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot | 144 ++++----------------- ...-ethip6-ip6base-copwhtlistbase-ndrpdrdisc.robot | 36 +++--- ...0ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot | 144 ++++----------------- ...520-ethip6-ip6base-iacldstbase-ndrpdrdisc.robot | 36 +++--- .../perf/ip6/10ge2p1x520-ethip6-ip6base-mrr.robot | 144 ++++----------------- .../10ge2p1x520-ethip6-ip6base-ndrpdrdisc.robot | 36 +++--- .../ip6/10ge2p1x520-ethip6-ip6scale200k-mrr.robot | 144 ++++----------------- ...0ge2p1x520-ethip6-ip6scale200k-ndrpdrdisc.robot | 36 +++--- .../ip6/10ge2p1x520-ethip6-ip6scale20k-mrr.robot | 144 ++++----------------- ...10ge2p1x520-ethip6-ip6scale20k-ndrpdrdisc.robot | 36 +++--- .../ip6/10ge2p1x520-ethip6-ip6scale2m-mrr.robot | 144 ++++----------------- .../10ge2p1x520-ethip6-ip6scale2m-ndrpdrdisc.robot | 36 +++--- ...2p1x710-ethip6-ip6base-copwhtlistbase-mrr.robot | 144 ++++----------------- ...0ge2p1x710-ethip6-ip6base-iacldstbase-mrr.robot | 144 ++++----------------- .../perf/ip6/10ge2p1x710-ethip6-ip6base-mrr.robot | 144 ++++----------------- .../ip6/10ge2p1x710-ethip6-ip6scale200k-mrr.robot | 144 ++++----------------- .../ip6/10ge2p1x710-ethip6-ip6scale20k-mrr.robot | 144 ++++----------------- .../ip6/10ge2p1x710-ethip6-ip6scale2m-mrr.robot | 144 ++++----------------- .../perf/ip6/40ge2p1xl710-ethip6-ip6base-mrr.robot | 144 ++++----------------- .../40ge2p1xl710-ethip6-ip6base-ndrpdrdisc.robot | 12 +- 20 files changed, 452 insertions(+), 1648 deletions(-) (limited to 'tests/vpp/perf/ip6') diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot index 1a06a0fc73..f7904c2380 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot @@ -26,6 +26,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 whitelist test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -52,21 +54,26 @@ | ${traffic_profile} | trex-sl-3n-ethip6-ip6src253 *** Keywords *** -| Check RR for ip6base-copwhtlistbase +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with ${wt} \ -| | ... | thread(s), ${wt} phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with +| | ... | ${phy_cores} phy core(s). +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${get_framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -85,148 +92,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=1 | rxq=1 | framesize=${78} +| | phy_cores=${1} | framesize=${78} | tc02-1518B-1t1c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=1 | rxq=1 | framesize=${1518} +| | phy_cores=${1} | framesize=${1518} | tc03-9000B-1t1c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=1 | rxq=1 | framesize=${9000} +| | phy_cores=${1} | framesize=${9000} | tc04-IMIX-1t1c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=2 | rxq=1 | framesize=${78} +| | phy_cores=${2} | framesize=${78} | tc06-1518B-2t2c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=2 | rxq=1 | framesize=${1518} +| | phy_cores=${2} | framesize=${1518} | tc07-9000B-2t2c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=2 | rxq=1 | framesize=${9000} +| | phy_cores=${2} | framesize=${9000} | tc08-IMIX-2t2c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=4 | rxq=2 | framesize=${78} +| | phy_cores=${4} | framesize=${78} | tc10-1518B-4t4c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=4 | rxq=2 | framesize=${1518} +| | phy_cores=${4} | framesize=${1518} | tc11-9000B-4t4c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=4 | rxq=2 | framesize=${9000} +| | phy_cores=${4} | framesize=${9000} | tc12-IMIX-4t4c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-copwhtlistbase-ndrpdrdisc.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-copwhtlistbase-ndrpdrdisc.robot index e11df36848..b2d3f7134a 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-copwhtlistbase-ndrpdrdisc.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-copwhtlistbase-ndrpdrdisc.robot @@ -70,7 +70,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -100,7 +100,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -131,7 +131,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -161,7 +161,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -192,7 +192,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | When Initialize IPv6 forwarding in 3-node circular topology @@ -221,7 +221,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | When Initialize IPv6 forwarding in 3-node circular topology @@ -251,7 +251,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -281,7 +281,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -312,7 +312,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -342,7 +342,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -373,7 +373,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | When Initialize IPv6 forwarding in 3-node circular topology @@ -402,7 +402,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | When Initialize IPv6 forwarding in 3-node circular topology @@ -432,7 +432,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -462,7 +462,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -493,7 +493,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -523,7 +523,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -554,7 +554,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | When Initialize IPv6 forwarding in 3-node circular topology @@ -583,7 +583,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | When Initialize IPv6 forwarding in 3-node circular topology diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot index 7e8bfa1db5..2e27749802 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot @@ -25,6 +25,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 iAcl whitelist test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -50,21 +52,26 @@ | ${traffic_profile} | trex-sl-3n-ethip6-ip6src253 *** Keywords *** -| Check RR for ip6base-iacldstbase +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with ${wt} \ -| | ... | thread(s), ${wt} phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with +| | ... | ${phy_cores} phy core(s). +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${get_framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -76,148 +83,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=1 | rxq=1 | framesize=${78} +| | phy_cores=${1} | framesize=${78} | tc02-1518B-1t1c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=1 | rxq=1 | framesize=${1518} +| | phy_cores=${1} | framesize=${1518} | tc03-9000B-1t1c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=1 | rxq=1 | framesize=${9000} +| | phy_cores=${1} | framesize=${9000} | tc04-IMIX-1t1c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=2 | rxq=1 | framesize=${78} +| | phy_cores=${2} | framesize=${78} | tc06-1518B-2t2c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=2 | rxq=1 | framesize=${1518} +| | phy_cores=${2} | framesize=${1518} | tc07-9000B-2t2c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=2 | rxq=1 | framesize=${9000} +| | phy_cores=${2} | framesize=${9000} | tc08-IMIX-2t2c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=4 | rxq=2 | framesize=${78} +| | phy_cores=${4} | framesize=${78} | tc10-1518B-4t4c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=4 | rxq=2 | framesize=${1518} +| | phy_cores=${4} | framesize=${1518} | tc11-9000B-4t4c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=4 | rxq=2 | framesize=${9000} +| | phy_cores=${4} | framesize=${9000} | tc12-IMIX-4t4c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-iacldstbase-ndrpdrdisc.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-iacldstbase-ndrpdrdisc.robot index 49e8240e4f..15581383e7 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-iacldstbase-ndrpdrdisc.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-iacldstbase-ndrpdrdisc.robot @@ -68,7 +68,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -91,7 +91,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -115,7 +115,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -138,7 +138,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -162,7 +162,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology @@ -184,7 +184,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology @@ -207,7 +207,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -230,7 +230,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -254,7 +254,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -277,7 +277,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -301,7 +301,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology @@ -323,7 +323,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology @@ -346,7 +346,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -369,7 +369,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -393,7 +393,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -416,7 +416,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -440,7 +440,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology @@ -462,7 +462,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-mrr.robot index 5e5e98f6e0..dd43716841 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-mrr.robot @@ -24,6 +24,8 @@ | Test Setup | Set up performance test | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 routing test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -48,21 +50,26 @@ | ${traffic_profile} | trex-sl-3n-ethip6-ip6src253 *** Keywords *** -| Check RR for ethip6-ip6base +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with ${wt} thread(s), ${wt}\ -| | ... | phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing config. +| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -73,148 +80,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 1 phy core,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${78} | wt=1 | rxq=1 +| | framesize=${78} | phy_cores=${1} | tc02-1518B-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 1 phy core,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${1518} | wt=1 | rxq=1 +| | framesize=${1518} | phy_cores=${1} | tc03-9000B-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 1 phy core,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${9000} | wt=1 | rxq=1 +| | framesize=${9000} | phy_cores=${1} | tc04-IMIX-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 2 phy cores,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${78} | wt=2 | rxq=1 +| | framesize=${78} | phy_cores=${2} | tc06-1518B-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 2 phy cores,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${1518} | wt=2 | rxq=1 +| | framesize=${1518} | phy_cores=${2} | tc07-9000B-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 2 phy cores,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${9000} | wt=2 | rxq=1 +| | framesize=${9000} | phy_cores=${2} | tc08-IMIX-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 4 phy cores,\ -| | ... | 2 receive queues per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${78} | wt=4 | rxq=2 +| | framesize=${78} | phy_cores=${4} | tc10-1518B-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 4 phy cores,\ -| | ... | 2 receive queues per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${1518} | wt=4 | rxq=2 +| | framesize=${1518} | phy_cores=${4} | tc11-9000B-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 4 phy cores,\ -| | ... | 2 receive queues per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${9000} | wt=4 | rxq=2 +| | framesize=${9000} | phy_cores=${4} | tc12-IMIX-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-ndrpdrdisc.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-ndrpdrdisc.robot index faadd24f22..0222b99df7 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-ndrpdrdisc.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6base-ndrpdrdisc.robot @@ -66,7 +66,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -87,7 +87,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -109,7 +109,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -130,7 +130,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -152,7 +152,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology @@ -172,7 +172,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology @@ -193,7 +193,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -214,7 +214,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -236,7 +236,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -257,7 +257,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -279,7 +279,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology @@ -299,7 +299,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology @@ -320,7 +320,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -341,7 +341,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -363,7 +363,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -384,7 +384,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -406,7 +406,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology @@ -426,7 +426,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding in 3-node circular topology diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale200k-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale200k-mrr.robot index 5986b1f440..18f206f49f 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale200k-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale200k-mrr.robot @@ -25,6 +25,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 routing test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -52,21 +54,26 @@ | ${traffic_profile} | trex-sl-3n-ethip6-ip6dst${rts_per_flow} *** Keywords *** -| Check RR for ip6base-ip6scale +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with ${wt} \ -| | ... | thread(s), ${wt} phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing config. +| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${get_framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -78,148 +85,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${78} +| | phy_cores=${1} | framesize=${78} | tc02-1518B-1t1c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${1518} +| | phy_cores=${1} | framesize=${1518} | tc03-9000B-1t1c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${9000} +| | phy_cores=${1} | framesize=${9000} | tc04-IMIX-1t1c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${78} +| | phy_cores=${2} | framesize=${78} | tc06-1518B-2t2c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${1518} +| | phy_cores=${2} | framesize=${1518} | tc07-9000B-2t2c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${9000} +| | phy_cores=${2} | framesize=${9000} | tc08-IMIX-2t2c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${78} +| | phy_cores=${4} | framesize=${78} | tc10-1518B-4t4c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${1518} +| | phy_cores=${4} | framesize=${1518} | tc11-9000B-4t4c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${9000} +| | phy_cores=${4} | framesize=${9000} | tc12-IMIX-4t4c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale200k-ndrpdrdisc.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale200k-ndrpdrdisc.robot index 225c5d4a7d..26b94f8919 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale200k-ndrpdrdisc.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale200k-ndrpdrdisc.robot @@ -69,7 +69,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -91,7 +91,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -114,7 +114,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -136,7 +136,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -159,7 +159,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -180,7 +180,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -202,7 +202,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -224,7 +224,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -247,7 +247,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -269,7 +269,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -292,7 +292,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -313,7 +313,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -335,7 +335,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -357,7 +357,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -380,7 +380,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -402,7 +402,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -425,7 +425,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -446,7 +446,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale20k-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale20k-mrr.robot index 2e8be63d51..2be3e5e875 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale20k-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale20k-mrr.robot @@ -25,6 +25,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 routing test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -52,21 +54,26 @@ | ${traffic_profile} | trex-sl-3n-ethip6-ip6dst${rts_per_flow} *** Keywords *** -| Check RR for ip6base-ip6scale +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with ${wt} \ -| | ... | thread(s), ${wt} phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing config. +| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${get_framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -78,148 +85,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${78} +| | phy_cores=${1} | framesize=${78} | tc02-1518B-1t1c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${1518} +| | phy_cores=${1} | framesize=${1518} | tc03-9000B-1t1c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${9000} +| | phy_cores=${1} | framesize=${9000} | tc04-IMIX-1t1c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${78} +| | phy_cores=${2} | framesize=${78} | tc06-1518B-2t2c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${1518} +| | phy_cores=${2} | framesize=${1518} | tc07-9000B-2t2c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${9000} +| | phy_cores=${2} | framesize=${9000} | tc08-IMIX-2t2c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${78} +| | phy_cores=${4} | framesize=${78} | tc10-1518B-4t4c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${1518} +| | phy_cores=${4} | framesize=${1518} | tc11-9000B-4t4c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${9000} +| | phy_cores=${4} | framesize=${9000} | tc12-IMIX-4t4c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale20k-ndrpdrdisc.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale20k-ndrpdrdisc.robot index 4d5b30a4fb..79101a07c1 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale20k-ndrpdrdisc.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale20k-ndrpdrdisc.robot @@ -69,7 +69,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -91,7 +91,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -114,7 +114,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -136,7 +136,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -159,7 +159,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -180,7 +180,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -202,7 +202,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -224,7 +224,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -247,7 +247,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -269,7 +269,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -292,7 +292,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -313,7 +313,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -335,7 +335,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -357,7 +357,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -380,7 +380,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -402,7 +402,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -425,7 +425,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -446,7 +446,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale2m-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale2m-mrr.robot index 124934d283..2b241e3c61 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale2m-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale2m-mrr.robot @@ -25,6 +25,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 routing test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -52,21 +54,26 @@ | ${traffic_profile} | trex-sl-3n-ethip6-ip6dst${rts_per_flow} *** Keywords *** -| Check RR for ip6base-ip6scale +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with ${wt} \ -| | ... | thread(s), ${wt} phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing config. +| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${get_framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -78,148 +85,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${78} +| | phy_cores=${1} | framesize=${78} | tc02-1518B-1t1c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${1518} +| | phy_cores=${1} | framesize=${1518} | tc03-9000B-1t1c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${9000} +| | phy_cores=${1} | framesize=${9000} | tc04-IMIX-1t1c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${78} +| | phy_cores=${2} | framesize=${78} | tc06-1518B-2t2c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${1518} +| | phy_cores=${2} | framesize=${1518} | tc07-9000B-2t2c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${9000} +| | phy_cores=${2} | framesize=${9000} | tc08-IMIX-2t2c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${78} +| | phy_cores=${4} | framesize=${78} | tc10-1518B-4t4c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${1518} +| | phy_cores=${4} | framesize=${1518} | tc11-9000B-4t4c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${9000} +| | phy_cores=${4} | framesize=${9000} | tc12-IMIX-4t4c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 \ No newline at end of file diff --git a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale2m-ndrpdrdisc.robot b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale2m-ndrpdrdisc.robot index 1570d777e3..f196c0d707 100644 --- a/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale2m-ndrpdrdisc.robot +++ b/tests/vpp/perf/ip6/10ge2p1x520-ethip6-ip6scale2m-ndrpdrdisc.robot @@ -69,7 +69,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -91,7 +91,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -114,7 +114,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -136,7 +136,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -159,7 +159,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -180,7 +180,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -202,7 +202,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -224,7 +224,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -247,7 +247,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -269,7 +269,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -292,7 +292,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -313,7 +313,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -335,7 +335,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -357,7 +357,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -380,7 +380,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -402,7 +402,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Apply startup configuration on all VPP DUTs @@ -425,7 +425,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology @@ -446,7 +446,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Apply startup configuration on all VPP DUTs | | And Initialize IPv6 forwarding with scaling in 3-node circular topology diff --git a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-copwhtlistbase-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-copwhtlistbase-mrr.robot index 016979ca74..dbc9bd2d78 100644 --- a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-copwhtlistbase-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-copwhtlistbase-mrr.robot @@ -26,6 +26,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 whitelist test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -52,21 +54,26 @@ | ${traffic_profile}= | trex-sl-3n-ethip6-ip6src253 *** Keywords *** -| Check RR for ip6base-copwhtlistbase +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with ${wt} \ -| | ... | thread(s), ${wt} phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with +| | ... | ${phy_cores} phy core(s). +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${get_framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -85,148 +92,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=1 | rxq=1 | framesize=${78} +| | phy_cores=${1} | framesize=${78} | tc02-1518B-1t1c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=1 | rxq=1 | framesize=${1518} +| | phy_cores=${1} | framesize=${1518} | tc03-9000B-1t1c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=1 | rxq=1 | framesize=${9000} +| | phy_cores=${1} | framesize=${9000} | tc04-IMIX-1t1c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=2 | rxq=1 | framesize=${78} +| | phy_cores=${2} | framesize=${78} | tc06-1518B-2t2c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=2 | rxq=1 | framesize=${1518} +| | phy_cores=${2} | framesize=${1518} | tc07-9000B-2t2c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=2 | rxq=1 | framesize=${9000} +| | phy_cores=${2} | framesize=${9000} | tc08-IMIX-2t2c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=4 | rxq=2 | framesize=${78} +| | phy_cores=${4} | framesize=${78} | tc10-1518B-4t4c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=4 | rxq=2 | framesize=${1518} +| | phy_cores=${4} | framesize=${1518} | tc11-9000B-4t4c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=4 | rxq=2 | framesize=${9000} +| | phy_cores=${4} | framesize=${9000} | tc12-IMIX-4t4c-ethip6-ip6base-copwhtlistbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ip6base-copwhtlistbase -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-iacldstbase-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-iacldstbase-mrr.robot index fa069bdca2..92297eeb64 100644 --- a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-iacldstbase-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-iacldstbase-mrr.robot @@ -25,6 +25,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 iAcl whitelist test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -50,21 +52,26 @@ | ${traffic_profile}= | trex-sl-3n-ethip6-ip6src253 *** Keywords *** -| Check RR for ip6base-iacldstbase +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with ${wt} \ -| | ... | thread(s), ${wt} phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with +| | ... | ${phy_cores} phy core(s). +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${get_framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -76,148 +83,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=1 | rxq=1 | framesize=${78} +| | phy_cores=${1} | framesize=${78} | tc02-1518B-1t1c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=1 | rxq=1 | framesize=${1518} +| | phy_cores=${1} | framesize=${1518} | tc03-9000B-1t1c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=1 | rxq=1 | framesize=${9000} +| | phy_cores=${1} | framesize=${9000} | tc04-IMIX-1t1c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=2 | rxq=1 | framesize=${78} +| | phy_cores=${2} | framesize=${78} | tc06-1518B-2t2c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=2 | rxq=1 | framesize=${1518} +| | phy_cores=${2} | framesize=${1518} | tc07-9000B-2t2c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=2 | rxq=1 | framesize=${9000} +| | phy_cores=${2} | framesize=${9000} | tc08-IMIX-2t2c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=4 | rxq=2 | framesize=${78} +| | phy_cores=${4} | framesize=${78} | tc10-1518B-4t4c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=4 | rxq=2 | framesize=${1518} +| | phy_cores=${4} | framesize=${1518} | tc11-9000B-4t4c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=4 | rxq=2 | framesize=${9000} +| | phy_cores=${4} | framesize=${9000} | tc12-IMIX-4t4c-ethip6-ip6base-iacldstbase-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing and whitelist filters config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ip6base-iacldstbase -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-mrr.robot index 83574bdd58..88043d7193 100644 --- a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6base-mrr.robot @@ -24,6 +24,8 @@ | Test Setup | Set up performance test | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 routing test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -48,21 +50,26 @@ | ${traffic_profile}= | trex-sl-3n-ethip6-ip6src253 *** Keywords *** -| Check RR for ethip6-ip6base +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with ${wt} thread(s), ${wt}\ -| | ... | phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing config. +| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -73,148 +80,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 1 phy core,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${78} | wt=1 | rxq=1 +| | framesize=${78} | phy_cores=${1} | tc02-1518B-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 1 phy core,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${1518} | wt=1 | rxq=1 +| | framesize=${1518} | phy_cores=${1} | tc03-9000B-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 1 phy core,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${9000} | wt=1 | rxq=1 +| | framesize=${9000} | phy_cores=${1} | tc04-IMIX-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 2 phy cores,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${78} | wt=2 | rxq=1 +| | framesize=${78} | phy_cores=${2} | tc06-1518B-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 2 phy cores,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${1518} | wt=2 | rxq=1 +| | framesize=${1518} | phy_cores=${2} | tc07-9000B-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 2 phy cores,\ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${9000} | wt=2 | rxq=1 +| | framesize=${9000} | phy_cores=${2} | tc08-IMIX-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 4 phy cores,\ -| | ... | 2 receive queues per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${78} | wt=4 | rxq=2 +| | framesize=${78} | phy_cores=${4} | tc10-1518B-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 4 phy cores,\ -| | ... | 2 receive queues per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${1518} | wt=4 | rxq=2 +| | framesize=${1518} | phy_cores=${4} | tc11-9000B-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 4 phy cores,\ -| | ... | 2 receive queues per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single\ -| | ... | trial throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${9000} | wt=4 | rxq=2 +| | framesize=${9000} | phy_cores=${4} | tc12-IMIX-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale200k-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale200k-mrr.robot index d434dcff87..28872e58c7 100644 --- a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale200k-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale200k-mrr.robot @@ -25,6 +25,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 routing test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -52,21 +54,26 @@ | ${traffic_profile}= | trex-sl-3n-ethip6-ip6dst${rts_per_flow} *** Keywords *** -| Check RR for ip6base-ip6scale +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with ${wt} \ -| | ... | thread(s), ${wt} phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing config. +| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${get_framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -78,148 +85,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${78} +| | phy_cores=${1} | framesize=${78} | tc02-1518B-1t1c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${1518} +| | phy_cores=${1} | framesize=${1518} | tc03-9000B-1t1c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${9000} +| | phy_cores=${1} | framesize=${9000} | tc04-IMIX-1t1c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${78} +| | phy_cores=${2} | framesize=${78} | tc06-1518B-2t2c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${1518} +| | phy_cores=${2} | framesize=${1518} | tc07-9000B-2t2c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${9000} +| | phy_cores=${2} | framesize=${9000} | tc08-IMIX-2t2c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${78} +| | phy_cores=${4} | framesize=${78} | tc10-1518B-4t4c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${1518} +| | phy_cores=${4} | framesize=${1518} | tc11-9000B-4t4c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${9000} +| | phy_cores=${4} | framesize=${9000} | tc12-IMIX-4t4c-ethip6-ip6base-ip6scale200k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale20k-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale20k-mrr.robot index 6c78447762..f38bcfb877 100644 --- a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale20k-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale20k-mrr.robot @@ -25,6 +25,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 routing test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -52,21 +54,26 @@ | ${traffic_profile}= | trex-sl-3n-ethip6-ip6dst${rts_per_flow} *** Keywords *** -| Check RR for ip6base-ip6scale +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with ${wt} \ -| | ... | thread(s), ${wt} phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing config. +| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${get_framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -78,148 +85,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${78} +| | phy_cores=${1} | framesize=${78} | tc02-1518B-1t1c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${1518} +| | phy_cores=${1} | framesize=${1518} | tc03-9000B-1t1c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${9000} +| | phy_cores=${1} | framesize=${9000} | tc04-IMIX-1t1c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${78} +| | phy_cores=${2} | framesize=${78} | tc06-1518B-2t2c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${1518} +| | phy_cores=${2} | framesize=${1518} | tc07-9000B-2t2c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${9000} +| | phy_cores=${2} | framesize=${9000} | tc08-IMIX-2t2c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${78} +| | phy_cores=${4} | framesize=${78} | tc10-1518B-4t4c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${1518} +| | phy_cores=${4} | framesize=${1518} | tc11-9000B-4t4c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${9000} +| | phy_cores=${4} | framesize=${9000} | tc12-IMIX-4t4c-ethip6-ip6base-ip6scale20k-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale2m-mrr.robot b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale2m-mrr.robot index 8fb9eec6e3..20f0f8c708 100644 --- a/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale2m-mrr.robot +++ b/tests/vpp/perf/ip6/10ge2p1x710-ethip6-ip6scale2m-mrr.robot @@ -25,6 +25,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 routing test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -52,21 +54,26 @@ | ${traffic_profile}= | trex-sl-3n-ethip6-ip6dst${rts_per_flow} *** Keywords *** -| Check RR for ip6base-ip6scale +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with ${wt} \ -| | ... | thread(s), ${wt} phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing config. +| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_limit} | ${get_framesize} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -78,148 +85,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${78} +| | phy_cores=${1} | framesize=${78} | tc02-1518B-1t1c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${1518} +| | phy_cores=${1} | framesize=${1518} | tc03-9000B-1t1c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=${9000} +| | phy_cores=${1} | framesize=${9000} | tc04-IMIX-1t1c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 1 phy core, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=1 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${1} | framesize=IMIX_v4_1 | tc05-78B-2t2c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${78} +| | phy_cores=${2} | framesize=${78} | tc06-1518B-2t2c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${1518} +| | phy_cores=${2} | framesize=${1518} | tc07-9000B-2t2c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=${9000} +| | phy_cores=${2} | framesize=${9000} | tc08-IMIX-2t2c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 2 phy cores, 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=2 | rxq=1 | framesize=IMIX_v4_1 +| | phy_cores=${2} | framesize=IMIX_v4_1 | tc09-78B-4t4c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 78B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${78} +| | phy_cores=${4} | framesize=${78} | tc10-1518B-4t4c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${1518} +| | phy_cores=${4} | framesize=${1518} | tc11-9000B-4t4c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=${9000} +| | phy_cores=${4} | framesize=${9000} | tc12-IMIX-4t4c-ethip6-ip6base-ip6scale2m-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with \ -| | ... | 4 phy cores, 2 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B; 16x570B; 4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ip6base-ip6scale -| | wt=4 | rxq=2 | framesize=IMIX_v4_1 +| | phy_cores=${4} | framesize=IMIX_v4_1 diff --git a/tests/vpp/perf/ip6/40ge2p1xl710-ethip6-ip6base-mrr.robot b/tests/vpp/perf/ip6/40ge2p1xl710-ethip6-ip6base-mrr.robot index a0b41cbe52..99b882edf8 100644 --- a/tests/vpp/perf/ip6/40ge2p1xl710-ethip6-ip6base-mrr.robot +++ b/tests/vpp/perf/ip6/40ge2p1xl710-ethip6-ip6base-mrr.robot @@ -25,6 +25,8 @@ | ... | Test Teardown | Tear down performance mrr test | ... +| Test Template | Local template +| ... | Documentation | *Raw results IPv6 routing test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology @@ -51,23 +53,28 @@ | ${traffic_profile} | trex-sl-3n-ethip6-ip6src253 *** Keywords *** -| Check RR for ethip6-ip6base +| Local template | | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with ${wt} thread(s), ${wt}\ -| | ... | phy core(s), ${rxq} receive queue(s) per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for ${framesize} frames using single\ +| | ... | [Cfg] DUT runs IPv6 routing config. +| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. +| | ... | [Ver] Measure MaxReceivedRate for ${framesize}B frames using single\ | | ... | trial throughput test. | | ... -| | [Arguments] | ${framesize} | ${wt} | ${rxq} +| | ... | *Arguments:* +| | ... | - framesize - Framesize in Bytes in integer or string (IMIX_v4_1). +| | ... | Type: integer, string +| | ... | - phy_cores - Number of physical cores. Type: integer +| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer +| | ... +| | [Arguments] | ${phy_cores} | ${framesize} | ${rxq}=${None} | | ... -| | # Test Variables required for test teardown | | Set Test Variable | ${framesize} | | ${get_framesize}= | Get Frame Size | ${framesize} | | ${max_rate}= | Calculate pps | ${s_24.5G} | ${get_framesize} | | ${max_rate}= | Set Variable If | | ... | ${max_rate} > ${s_18.75Mpps} | ${s_18.75Mpps} | ${max_rate} | | ... -| | Given Add '${wt}' worker threads and '${rxq}' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | ${phy_cores} | ${rxq} | | And Add PCI devices to all DUTs | | And Run Keyword If | ${get_framesize} < ${1522} | | ... | Add no multi seg to all DUTs @@ -80,148 +87,49 @@ *** Test Cases *** | tc01-78B-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 1 phy core, \ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${78} | wt=1 | rxq=1 +| | framesize=${78} | phy_cores=${1} | tc02-1518B-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 1 phy core, \ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${1518} | wt=1 | rxq=1 +| | framesize=${1518} | phy_cores=${1} | tc03-9000B-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 1 phy core, \ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${9000} | wt=1 | rxq=1 +| | framesize=${9000} | phy_cores=${1} | tc04-IMIX-1t1c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 1 phy core, \ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | ... | | [Tags] | IMIX | 1C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=IMIX_v4_1 | wt=1 | rxq=1 +| | framesize=IMIX_v4_1 | phy_cores=${1} | tc05-78B-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 2 phy cores, \ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${78} | wt=2 | rxq=1 +| | framesize=${78} | phy_cores=${2} | tc06-1518B-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 2 phy cores, \ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${1518} | wt=2 | rxq=1 +| | framesize=${1518} | phy_cores=${2} | tc07-9000B-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 2 phy cores, \ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${9000} | wt=2 | rxq=1 +| | framesize=${9000} | phy_cores=${2} | tc08-IMIX-2t2c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 2 phy cores, \ -| | ... | 1 receive queue per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | ... | | [Tags] | IMIX | 2C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=IMIX_v4_1 | wt=2 | rxq=1 +| | framesize=IMIX_v4_1 | phy_cores=${2} | tc09-78B-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 4 phy cores, \ -| | ... | 2 receive queues per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 64B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 78B | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${78} | wt=4 | rxq=2 +| | framesize=${78} | phy_cores=${4} | tc10-1518B-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 4 phy cores, \ -| | ... | 2 receive queues per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 1518B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 1518B | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${1518} | wt=4 | rxq=2 +| | framesize=${1518} | phy_cores=${4} | tc11-9000B-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 4 phy cores, \ -| | ... | 2 receive queues per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for 9000B frames using single trial\ -| | ... | throughput test. -| | ... | | [Tags] | 9000B | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=${9000} | wt=4 | rxq=2 +| | framesize=${9000} | phy_cores=${4} | tc12-IMIX-4t4c-ethip6-ip6base-mrr -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config with 4 phy cores, \ -| | ... | 2 receive queues per NIC port. -| | ... | [Ver] Measure MaxReceivedRate for IMIX_v4_1 frames using single trial\ -| | ... | throughput test. -| | ... | IMIX_v4_1 = (28x64B;16x570B;4x1518B) -| | ... | | [Tags] | IMIX | 4C -| | ... -| | [Template] | Check RR for ethip6-ip6base -| | framesize=IMIX_v4_1 | wt=4 | rxq=2 +| | framesize=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/40ge2p1xl710-ethip6-ip6base-ndrpdrdisc.robot b/tests/vpp/perf/ip6/40ge2p1xl710-ethip6-ip6base-ndrpdrdisc.robot index a78019ab5c..55c61b99fa 100644 --- a/tests/vpp/perf/ip6/40ge2p1xl710-ethip6-ip6base-ndrpdrdisc.robot +++ b/tests/vpp/perf/ip6/40ge2p1xl710-ethip6-ip6base-ndrpdrdisc.robot @@ -68,7 +68,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Add DPDK dev default RXD to all DUTs | 2048 @@ -91,7 +91,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '1' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 1 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Add DPDK dev default RXD to all DUTs | 2048 @@ -114,7 +114,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Add DPDK dev default RXD to all DUTs | 2048 @@ -137,7 +137,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '2' worker threads and '1' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 2 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Add DPDK dev default RXD to all DUTs | 2048 @@ -160,7 +160,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Add DPDK dev default RXD to all DUTs | 2048 @@ -183,7 +183,7 @@ | | ${binary_min}= | Set Variable | ${min_rate} | | ${binary_max}= | Set Variable | ${max_rate} | | ${threshold}= | Set Variable | ${min_rate} -| | Given Add '4' worker threads and '2' rxqueues in 3-node single-link circular topology +| | Given Add worker threads and rxqueues to all DUTs | 4 | | And Add PCI devices to all DUTs | | And Add no multi seg to all DUTs | | And Add DPDK dev default RXD to all DUTs | 2048 -- cgit 1.2.3-korg