diff options
author | Vratko Polak <vrpolak@cisco.com> | 2020-01-03 16:01:30 +0100 |
---|---|---|
committer | Jan Gelety <jgelety@cisco.com> | 2020-01-10 16:08:42 +0100 |
commit | b55e324d526e5b05baef015c3614b9743c955992 (patch) | |
tree | 1e42006c4513bdcdee35eb5f677e055b64c06e86 /tests/vpp/perf/ip6 | |
parent | 5147d3ac0844b31852a3c221759f31915744b1c7 (diff) |
Autogen: Generate also NIC drivers.
+ Disallowed -avf- (or -rdma-) as "template" suites.
+ GBP suite switched to DPDK driver in repo.
+ Each NIC has its own list of supported drivers, in Constants.
+ Updated tag expressions for daily jobs:
+ Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts
are tested only with vfio-pci.
+ Other (base, dot1q, dot1ad) tested with all drivers.
+ Setup actions currently depend on driver, generated.
- The performance_rdma action is trivial for now.
- Several tests fail, to be fixed later, e.g. by performance_rdma.
+ Reconf tests are also supported.
+ Added DRV_VFIO_PCI tags missing, mainly in density tests.
- Vhost suites (density, reconf) are failing, but suites look good.
- TCP suites do not support NIC drivers yet.
- DPDK obviously not supported.
+ Use Python 3 in regenerate scripts.
+ Fix typos binded => bound.
+ File open modes set either u"rt" or u"wt" everywhere.
+ Remove a trailing space in an environment variable name.
Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Diffstat (limited to 'tests/vpp/perf/ip6')
11 files changed, 1 insertions, 1337 deletions
diff --git a/tests/vpp/perf/ip6/10ge2p1x710-avf-dot1q-ip6base-ndrpdr.robot b/tests/vpp/perf/ip6/10ge2p1x710-avf-dot1q-ip6base-ndrpdr.robot deleted file mode 100644 index d738c756d8..0000000000 --- a/tests/vpp/perf/ip6/10ge2p1x710-avf-dot1q-ip6base-ndrpdr.robot +++ /dev/null @@ -1,139 +0,0 @@ -# Copyright (c) 2019 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -*** Settings *** -| Resource | resources/libraries/robot/shared/default.robot -| -| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR -| ... | NIC_Intel-X710 | ETH | IP6FWD | BASE | DOT1Q | IP6BASE | DRV_AVF -| -| Suite Setup | Setup suite single link | performance_avf -| Suite Teardown | Tear down suite | performance -| Test Setup | Setup test -| Test Teardown | Tear down test | performance -| -| Test Template | Local Template -| -| Documentation | *RFC2544: Pkt throughput IPv6 routing with IEEE 802.1Q test -| ... | cases* -| -| ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology\ -| ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv6 for IPv6 routing. IEEE 802.1Q\ -| ... | tagging is applied on link between DUT1 and DUT2. -| ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with IPv6\ -| ... | routing and two static IPv6 /64 route entries. DUT1 and DUT2 are tested\ -| ... | with ${nic_name} with VF enabled. -| ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop\ -| ... | Rate) with zero packet loss tolerance and throughput PDR (Partial Drop\ -| ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage\ -| ... | of packets transmitted. NDR and PDR are discovered for different\ -| ... | Ethernet L2 frame sizes using MLRsearch library.\ -| ... | Test packets are\ -| ... | generated by TG on links to DUTs. TG traffic profile contains two L3\ -| ... | flow-groups (flow-group per direction, 253 flows per flow-group) with\ -| ... | all packets containing Ethernet header, IPv6 header with IP\ -| ... | no next header and static payload. MAC addresses are matching MAC\ -| ... | addresses of the TG node interfaces. -| ... | *[Ref] Applicable standard specifications:* RFC2544. - -*** Variables *** -| @{plugins_to_enable}= | avf_plugin.so -| ${crypto_type}= | ${None} -| ${nic_name}= | Intel-X710 -| ${nic_driver}= | avf -| ${osi_layer}= | L3 -| ${overhead}= | ${4} -| ${subid}= | 10 -| ${tag_rewrite}= | pop-1 -# TG subnets used by T-Rex -| ${tg_if1_net}= | 2001:1::0 -| ${tg_if2_net}= | 2001:2::0 -# Traffic profile: -| ${traffic_profile}= | trex-sl-3n-ethip6-ip6src253 - -*** Keywords *** -| Local Template -| | [Documentation] -| | ... | [Cfg] Each DUT runs IPv6 routing with VLAN and uses ${phy_cores}\ -| | ... | physical core(s) for worker threads. -| | ... | [Ver] Measure NDR and PDR values using MLRsearch algorithm.\ -| | -| | ... | *Arguments:* -| | ... | - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). -| | ... | Type: integer, string -| | ... | - phy_cores - Number of physical cores. Type: integer -| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer -| | -| | [Arguments] | ${frame_size} | ${phy_cores} | ${rxq}=${None} -| | -| | Set Test Variable | \${frame_size} -| | -| | Given Set Max Rate And Jumbo -| | And Add worker threads to all DUTs | ${phy_cores} | ${rxq} -| | And Pre-initialize layer driver | ${nic_driver} -| | And Apply startup configuration on all VPP DUTs -| | When Initialize layer driver | ${nic_driver} -| | And Initialize layer interface -| | And Initialize IPv6 forwarding with VLAN dot1q sub-interfaces in circular topology -| | ... | ${tg_if1_net} | ${tg_if2_net} | ${subid} | ${tag_rewrite} -| | Then Find NDR and PDR intervals using optimized search - -*** Test Cases *** -| tc01-78B-1c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 78B | 1C -| | frame_size=${78} | phy_cores=${1} - -| tc02-78B-2c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 78B | 2C -| | frame_size=${78} | phy_cores=${2} - -| tc03-78B-4c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 78B | 4C -| | frame_size=${78} | phy_cores=${4} - -| tc04-1518B-1c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 1518B | 1C -| | frame_size=${1518} | phy_cores=${1} - -| tc05-1518B-2c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 1518B | 2C -| | frame_size=${1518} | phy_cores=${2} - -| tc06-1518B-4c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 1518B | 4C -| | frame_size=${1518} | phy_cores=${4} - -| tc07-9000B-1c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 9000B | 1C -| | frame_size=${9000} | phy_cores=${1} - -| tc08-9000B-2c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 9000B | 2C -| | frame_size=${9000} | phy_cores=${2} - -| tc09-9000B-4c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 9000B | 4C -| | frame_size=${9000} | phy_cores=${4} - -| tc10-IMIX-1c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | IMIX | 1C -| | frame_size=IMIX_v4_1 | phy_cores=${1} - -| tc11-IMIX-2c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | IMIX | 2C -| | frame_size=IMIX_v4_1 | phy_cores=${2} - -| tc12-IMIX-4c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | IMIX | 4C -| | frame_size=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6base-ndrpdr.robot b/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6base-ndrpdr.robot deleted file mode 100644 index 1b5a343f36..0000000000 --- a/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6base-ndrpdr.robot +++ /dev/null @@ -1,130 +0,0 @@ -# Copyright (c) 2019 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -*** Settings *** -| Resource | resources/libraries/robot/shared/default.robot -| -| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR -| ... | NIC_Intel-X710 | ETH | IP6FWD | BASE | IP6BASE | DRV_AVF -| -| Suite Setup | Setup suite single link | performance_avf -| Suite Teardown | Tear down suite | performance -| Test Setup | Setup test -| Test Teardown | Tear down test | performance -| -| Test Template | Local Template -| -| Documentation | *RFC2544: Pkt throughput IPv6 routing test cases* -| -| ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology\ -| ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv6 for IPv6 routing. -| ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with IPv6\ -| ... | routing and two static IPv6 /64 route entries. DUT1 and DUT2\ -| ... | tested with ${nic_name} with VF enabled. -| ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop\ -| ... | Rate) with zero packet loss tolerance and throughput PDR (Partial Drop\ -| ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage\ -| ... | of packets transmitted. NDR and PDR are discovered for different\ -| ... | Ethernet L2 frame sizes using MLRsearch library.\ -| ... | Test packets are generated by TG on links to DUTs. TG traffic profile\ -| ... | contains two L3 flow-groups (flow-group per direction, 253 flows per\ -| ... | flow-group) with all packets containing Ethernet header, IPv6 header\ -| ... | with IP no next header and static payload. MAC addresses are matching\ -| ... | MAC addresses of the TG node interfaces. -| ... | *[Ref] Applicable standard specifications:* RFC2544. - -*** Variables *** -| @{plugins_to_enable}= | avf_plugin.so -| ${crypto_type}= | ${None} -| ${nic_name}= | Intel-X710 -| ${nic_driver}= | avf -| ${osi_layer}= | L3 -| ${overhead}= | ${0} -# Traffic profile: -| ${traffic_profile}= | trex-sl-3n-ethip6-ip6src253 - -*** Keywords *** -| Local Template -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config.\ -| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. -| | ... | [Ver] Measure NDR and PDR values using MLRsearch algorithm.\ -| | -| | ... | *Arguments:* -| | ... | - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). -| | ... | Type: integer, string -| | ... | - phy_cores - Number of physical cores. Type: integer -| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer -| | -| | [Arguments] | ${frame_size} | ${phy_cores} | ${rxq}=${None} -| | -| | Set Test Variable | \${frame_size} -| | -| | Given Set Max Rate And Jumbo -| | And Add worker threads to all DUTs | ${phy_cores} | ${rxq} -| | And Pre-initialize layer driver | ${nic_driver} -| | And Apply startup configuration on all VPP DUTs -| | When Initialize layer driver | ${nic_driver} -| | And Initialize layer interface -| | And Initialize IPv6 forwarding in circular topology -| | Then Find NDR and PDR intervals using optimized search - -*** Test Cases *** -| tc01-78B-1c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 78B | 1C -| | frame_size=${78} | phy_cores=${1} - -| tc02-78B-2c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 78B | 2C -| | frame_size=${78} | phy_cores=${2} - -| tc03-78B-4c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 78B | 4C -| | frame_size=${78} | phy_cores=${4} - -| tc04-1518B-1c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 1518B | 1C -| | frame_size=${1518} | phy_cores=${1} - -| tc05-1518B-2c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 1518B | 2C -| | frame_size=${1518} | phy_cores=${2} - -| tc06-1518B-4c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 1518B | 4C -| | frame_size=${1518} | phy_cores=${4} - -| tc07-9000B-1c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 9000B | 1C -| | frame_size=${9000} | phy_cores=${1} - -| tc08-9000B-2c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 9000B | 2C -| | frame_size=${9000} | phy_cores=${2} - -| tc09-9000B-4c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 9000B | 4C -| | frame_size=${9000} | phy_cores=${4} - -| tc10-IMIX-1c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | IMIX | 1C -| | frame_size=IMIX_v4_1 | phy_cores=${1} - -| tc11-IMIX-2c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | IMIX | 2C -| | frame_size=IMIX_v4_1 | phy_cores=${2} - -| tc12-IMIX-4c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | IMIX | 4C -| | frame_size=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6scale200k-ndrpdr.robot b/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6scale200k-ndrpdr.robot deleted file mode 100644 index 5ac49991aa..0000000000 --- a/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6scale200k-ndrpdr.robot +++ /dev/null @@ -1,133 +0,0 @@ -# Copyright (c) 2019 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -*** Settings *** -| Resource | resources/libraries/robot/shared/default.robot -| -| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR -| ... | NIC_Intel-X710 | ETH | IP6FWD | SCALE | FIB_200K | DRV_AVF -| -| Suite Setup | Setup suite single link | performance_avf -| Suite Teardown | Tear down suite | performance -| Test Setup | Setup test -| Test Teardown | Tear down test | performance -| -| Test Template | Local Template -| -| Documentation | *RFC2544: Pkt throughput IPv6 routing test cases* -| -| ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology\ -| ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv6 for IPv6 routing. -| ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with IPv6\ -| ... | routing and 2x100k static IPv6 /64 route entries. DUT1 and DUT2 tested\ -| ... | with ${nic_name} with VF enabled. -| ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop\ -| ... | Rate) with zero packet loss tolerance and throughput PDR (Partial Drop\ -| ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage\ -| ... | of packets transmitted. NDR and PDR are discovered for different\ -| ... | Ethernet L2 frame sizes using MLRsearch library.\ -| ... | Test packets are generated by TG on links to DUTs. TG traffic profile\ -| ... | contains two L3 flow-groups (flow-group per direction, 100k flows per\ -| ... | flow-group) with all packets containing Ethernet header, IPv6 header\ -| ... | with IP and static payload. MAC addresses are matching MAC addresses\ -| ... | of the TG node interfaces. Incrementing of IP.dst (IPv6 destination\ -| ... | address) field is applied to both streams. -| ... | *[Ref] Applicable standard specifications:* RFC2544. - -*** Variables *** -| @{plugins_to_enable}= | avf_plugin.so -| ${crypto_type}= | ${None} -| ${nic_name}= | Intel-X710 -| ${nic_driver}= | avf -| ${osi_layer}= | L3 -| ${overhead}= | ${0} -| ${rts_per_flow}= | ${100000} -# Traffic profile: -| ${traffic_profile}= | trex-sl-3n-ethip6-ip6dst${rts_per_flow} - -*** Keywords *** -| Local Template -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config.\ -| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. -| | ... | [Ver] Measure NDR and PDR values using MLRsearch algorithm.\ -| | -| | ... | *Arguments:* -| | ... | - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). -| | ... | Type: integer, string -| | ... | - phy_cores - Number of physical cores. Type: integer -| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer -| | -| | [Arguments] | ${frame_size} | ${phy_cores} | ${rxq}=${None} -| | -| | Set Test Variable | \${frame_size} -| | -| | Given Set Max Rate And Jumbo -| | And Add worker threads to all DUTs | ${phy_cores} | ${rxq} -| | And Pre-initialize layer driver | ${nic_driver} -| | And Apply startup configuration on all VPP DUTs -| | When Initialize layer driver | ${nic_driver} -| | And Initialize layer interface -| | And Initialize IPv6 forwarding with scaling in circular topology -| | ... | ${rts_per_flow} -| | Then Find NDR and PDR intervals using optimized search - -*** Test Cases *** -| tc01-78B-1c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 78B | 1C -| | frame_size=${78} | phy_cores=${1} - -| tc02-78B-2c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 78B | 2C -| | frame_size=${78} | phy_cores=${2} - -| tc03-78B-4c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 78B | 4C -| | frame_size=${78} | phy_cores=${4} - -| tc04-1518B-1c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 1518B | 1C -| | frame_size=${1518} | phy_cores=${1} - -| tc05-1518B-2c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 1518B | 2C -| | frame_size=${1518} | phy_cores=${2} - -| tc06-1518B-4c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 1518B | 4C -| | frame_size=${1518} | phy_cores=${4} - -| tc07-9000B-1c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 9000B | 1C -| | frame_size=${9000} | phy_cores=${1} - -| tc08-9000B-2c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 9000B | 2C -| | frame_size=${9000} | phy_cores=${2} - -| tc09-9000B-4c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 9000B | 4C -| | frame_size=${9000} | phy_cores=${4} - -| tc10-IMIX-1c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | IMIX | 1C -| | frame_size=IMIX_v4_1 | phy_cores=${1} - -| tc11-IMIX-2c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | IMIX | 2C -| | frame_size=IMIX_v4_1 | phy_cores=${2} - -| tc12-IMIX-4c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | IMIX | 4C -| | frame_size=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6scale20k-ndrpdr.robot b/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6scale20k-ndrpdr.robot deleted file mode 100644 index 5b5c7a992b..0000000000 --- a/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6scale20k-ndrpdr.robot +++ /dev/null @@ -1,133 +0,0 @@ -# Copyright (c) 2019 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -*** Settings *** -| Resource | resources/libraries/robot/shared/default.robot -| -| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR -| ... | NIC_Intel-X710 | ETH | IP6FWD | SCALE | FIB_20K | DRV_AVF -| -| Suite Setup | Setup suite single link | performance_avf -| Suite Teardown | Tear down suite | performance -| Test Setup | Setup test -| Test Teardown | Tear down test | performance -| -| Test Template | Local Template -| -| Documentation | *RFC2544: Pkt throughput IPv6 routing test cases* -| -| ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology\ -| ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv6 for IPv6 routing. -| ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with IPv6\ -| ... | routing and 2x10k static IPv6 /64 route entries. DUT1 and DUT2 tested\ -| ... | with ${nic_name} with VF enabled. -| ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop\ -| ... | Rate) with zero packet loss tolerance and throughput PDR (Partial Drop\ -| ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage\ -| ... | of packets transmitted. NDR and PDR are discovered for different\ -| ... | Ethernet L2 frame sizes using MLRsearch library.\ -| ... | Test packets are generated by TG on links to DUTs. TG traffic profile\ -| ... | contains two L3 flow-groups (flow-group per direction, 10k flows per\ -| ... | flow-group) with all packets containing Ethernet header, IPv6 header\ -| ... | with IP and static payload. MAC addresses are matching MAC addresses\ -| ... | of the TG node interfaces. Incrementing of IP.dst (IPv6 destination\ -| ... | address) field is applied to both streams. -| ... | *[Ref] Applicable standard specifications:* RFC2544. - -*** Variables *** -| @{plugins_to_enable}= | avf_plugin.so -| ${crypto_type}= | ${None} -| ${nic_name}= | Intel-X710 -| ${nic_driver}= | avf -| ${osi_layer}= | L3 -| ${overhead}= | ${0} -| ${rts_per_flow}= | ${10000} -# Traffic profile: -| ${traffic_profile}= | trex-sl-3n-ethip6-ip6dst${rts_per_flow} - -*** Keywords *** -| Local Template -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config.\ -| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. -| | ... | [Ver] Measure NDR and PDR values using MLRsearch algorithm.\ -| | -| | ... | *Arguments:* -| | ... | - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). -| | ... | Type: integer, string -| | ... | - phy_cores - Number of physical cores. Type: integer -| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer -| | -| | [Arguments] | ${frame_size} | ${phy_cores} | ${rxq}=${None} -| | -| | Set Test Variable | \${frame_size} -| | -| | Given Set Max Rate And Jumbo -| | And Add worker threads to all DUTs | ${phy_cores} | ${rxq} -| | And Pre-initialize layer driver | ${nic_driver} -| | And Apply startup configuration on all VPP DUTs -| | When Initialize layer driver | ${nic_driver} -| | And Initialize layer interface -| | And Initialize IPv6 forwarding with scaling in circular topology -| | ... | ${rts_per_flow} -| | Then Find NDR and PDR intervals using optimized search - -*** Test Cases *** -| tc01-78B-1c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 78B | 1C -| | frame_size=${78} | phy_cores=${1} - -| tc02-78B-2c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 78B | 2C -| | frame_size=${78} | phy_cores=${2} - -| tc03-78B-4c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 78B | 4C -| | frame_size=${78} | phy_cores=${4} - -| tc04-1518B-1c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 1518B | 1C -| | frame_size=${1518} | phy_cores=${1} - -| tc05-1518B-2c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 1518B | 2C -| | frame_size=${1518} | phy_cores=${2} - -| tc06-1518B-4c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 1518B | 4C -| | frame_size=${1518} | phy_cores=${4} - -| tc07-9000B-1c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 9000B | 1C -| | frame_size=${9000} | phy_cores=${1} - -| tc08-9000B-2c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 9000B | 2C -| | frame_size=${9000} | phy_cores=${2} - -| tc09-9000B-4c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 9000B | 4C -| | frame_size=${9000} | phy_cores=${4} - -| tc10-IMIX-1c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | IMIX | 1C -| | frame_size=IMIX_v4_1 | phy_cores=${1} - -| tc11-IMIX-2c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | IMIX | 2C -| | frame_size=IMIX_v4_1 | phy_cores=${2} - -| tc12-IMIX-4c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | IMIX | 4C -| | frame_size=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6scale2m-ndrpdr.robot b/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6scale2m-ndrpdr.robot deleted file mode 100644 index 6a6d552e6e..0000000000 --- a/tests/vpp/perf/ip6/10ge2p1x710-avf-ethip6-ip6scale2m-ndrpdr.robot +++ /dev/null @@ -1,133 +0,0 @@ -# Copyright (c) 2019 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -*** Settings *** -| Resource | resources/libraries/robot/shared/default.robot -| -| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR -| ... | NIC_Intel-X710 | ETH | IP6FWD | SCALE | FIB_2M | DRV_AVF -| -| Suite Setup | Setup suite single link | performance_avf -| Suite Teardown | Tear down suite | performance -| Test Setup | Setup test -| Test Teardown | Tear down test | performance -| -| Test Template | Local Template -| -| Documentation | *RFC2544: Pkt throughput IPv6 routing test cases* -| -| ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology\ -| ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv6 for IPv6 routing. -| ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with IPv6\ -| ... | routing and 2x1M static IPv6 /64 route entries. DUT1 and DUT2 tested\ -| ... | with ${nic_name} with VF enabled. -| ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop\ -| ... | Rate) with zero packet loss tolerance and throughput PDR (Partial Drop\ -| ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage\ -| ... | of packets transmitted. NDR and PDR are discovered for different\ -| ... | Ethernet L2 frame sizes using MLRsearch library.\ -| ... | Test packets are generated by TG on links to DUTs. TG traffic profile\ -| ... | contains two L3 flow-groups (flow-group per direction, 1M flows per\ -| ... | flow-group) with all packets containing Ethernet header, IPv6 header\ -| ... | with IP and static payload. MAC addresses are matching MAC addresses\ -| ... | of the TG node interfaces. Incrementing of IP.dst (IPv6 destination\ -| ... | address) field is applied to both streams. -| ... | *[Ref] Applicable standard specifications:* RFC2544. - -*** Variables *** -| @{plugins_to_enable}= | avf_plugin.so -| ${crypto_type}= | ${None} -| ${nic_name}= | Intel-X710 -| ${nic_driver}= | avf -| ${osi_layer}= | L3 -| ${overhead}= | ${0} -| ${rts_per_flow}= | ${1000000} -# Traffic profile: -| ${traffic_profile}= | trex-sl-3n-ethip6-ip6dst${rts_per_flow} - -*** Keywords *** -| Local Template -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config.\ -| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. -| | ... | [Ver] Measure NDR and PDR values using MLRsearch algorithm.\ -| | -| | ... | *Arguments:* -| | ... | - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). -| | ... | Type: integer, string -| | ... | - phy_cores - Number of physical cores. Type: integer -| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer -| | -| | [Arguments] | ${frame_size} | ${phy_cores} | ${rxq}=${None} -| | -| | Set Test Variable | \${frame_size} -| | -| | Given Set Max Rate And Jumbo -| | And Add worker threads to all DUTs | ${phy_cores} | ${rxq} -| | And Pre-initialize layer driver | ${nic_driver} -| | And Apply startup configuration on all VPP DUTs -| | When Initialize layer driver | ${nic_driver} -| | And Initialize layer interface -| | And Initialize IPv6 forwarding with scaling in circular topology -| | ... | ${rts_per_flow} -| | Then Find NDR and PDR intervals using optimized search - -*** Test Cases *** -| tc01-78B-1c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 78B | 1C -| | frame_size=${78} | phy_cores=${1} - -| tc02-78B-2c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 78B | 2C -| | frame_size=${78} | phy_cores=${2} - -| tc03-78B-4c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 78B | 4C -| | frame_size=${78} | phy_cores=${4} - -| tc04-1518B-1c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 1518B | 1C -| | frame_size=${1518} | phy_cores=${1} - -| tc05-1518B-2c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 1518B | 2C -| | frame_size=${1518} | phy_cores=${2} - -| tc06-1518B-4c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 1518B | 4C -| | frame_size=${1518} | phy_cores=${4} - -| tc07-9000B-1c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 9000B | 1C -| | frame_size=${9000} | phy_cores=${1} - -| tc08-9000B-2c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 9000B | 2C -| | frame_size=${9000} | phy_cores=${2} - -| tc09-9000B-4c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 9000B | 4C -| | frame_size=${9000} | phy_cores=${4} - -| tc10-IMIX-1c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | IMIX | 1C -| | frame_size=IMIX_v4_1 | phy_cores=${1} - -| tc11-IMIX-2c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | IMIX | 2C -| | frame_size=IMIX_v4_1 | phy_cores=${2} - -| tc12-IMIX-4c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | IMIX | 4C -| | frame_size=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-dot1q-ip6base-ndrpdr.robot b/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-dot1q-ip6base-ndrpdr.robot deleted file mode 100644 index 28c951edf0..0000000000 --- a/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-dot1q-ip6base-ndrpdr.robot +++ /dev/null @@ -1,139 +0,0 @@ -# Copyright (c) 2019 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -*** Settings *** -| Resource | resources/libraries/robot/shared/default.robot -| -| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR -| ... | NIC_Intel-X710 | ETH | IP6FWD | BASE | DOT1Q | IP6BASE | DRV_AVF -| -| Suite Setup | Setup suite single link | performance_avf -| Suite Teardown | Tear down suite | performance -| Test Setup | Setup test -| Test Teardown | Tear down test | performance -| -| Test Template | Local Template -| -| Documentation | *RFC2544: Pkt throughput IPv6 routing with IEEE 802.1Q test -| ... | cases* -| -| ... | *[Top] Network Topologies:* TG-DUT1-TG 2-node circular topology with\ -| ... | single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv6 for IPv6 routing. IEEE 802.1Q\ -| ... | tagging is applied on link between DUT1-if2 and TG-if2. -| ... | *[Cfg] DUT configuration:* DUT1 is configured with IPv6 routing and\ -| ... | two static IPv6 /64 route entries. DUT1 is tested with ${nic_name}\ -| ... | with VF enabled. -| ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop\ -| ... | Rate) with zero packet loss tolerance and throughput PDR (Partial Drop\ -| ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage\ -| ... | of packets transmitted. NDR and PDR are discovered for different\ -| ... | Ethernet L2 frame sizes using MLRsearch library.\ -| ... | Test packets are\ -| ... | generated by TG on links to DUT1. TG traffic profile contains two L3\ -| ... | flow-groups (flow-group per direction, 253 flows per flow-group) with\ -| ... | all packets containing Ethernet header, IPv6 header with IP\ -| ... | no next header and static payload. MAC addresses are matching MAC\ -| ... | addresses of the TG node interfaces. -| ... | *[Ref] Applicable standard specifications:* RFC2544. - -*** Variables *** -| @{plugins_to_enable}= | avf_plugin.so -| ${crypto_type}= | ${None} -| ${nic_name}= | Intel-X710 -| ${nic_driver}= | avf -| ${osi_layer}= | L3 -| ${overhead}= | ${4} -| ${subid}= | 10 -| ${tag_rewrite}= | pop-1 -# TG subnets used by T-Rex -| ${tg_if1_net}= | 2001:1::0 -| ${tg_if2_net}= | 2001:2::0 -# Traffic profile: -| ${traffic_profile}= | trex-sl-2n-dot1qip6asym-ip6src253 - -*** Keywords *** -| Local Template -| | [Documentation] -| | ... | [Cfg] Each DUT runs IPv6 routing with VLAN and uses ${phy_cores}\ -| | ... | physical core(s) for worker threads. -| | ... | [Ver] Measure NDR and PDR values using MLRsearch algorithm.\ -| | -| | ... | *Arguments:* -| | ... | - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). -| | ... | Type: integer, string -| | ... | - phy_cores - Number of physical cores. Type: integer -| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer -| | -| | [Arguments] | ${frame_size} | ${phy_cores} | ${rxq}=${None} -| | -| | Set Test Variable | \${frame_size} -| | -| | Given Set Max Rate And Jumbo -| | And Add worker threads to all DUTs | ${phy_cores} | ${rxq} -| | And Pre-initialize layer driver | ${nic_driver} -| | And Apply startup configuration on all VPP DUTs -| | When Initialize layer driver | ${nic_driver} -| | And Initialize layer interface -| | And Initialize IPv6 forwarding with VLAN dot1q sub-interfaces in circular topology -| | ... | ${tg_if1_net} | ${tg_if2_net} | ${subid} | ${tag_rewrite} -| | Then Find NDR and PDR intervals using optimized search - -*** Test Cases *** -| tc01-78B-1c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 78B | 1C -| | frame_size=${78} | phy_cores=${1} - -| tc02-78B-2c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 78B | 2C -| | frame_size=${78} | phy_cores=${2} - -| tc03-78B-4c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 78B | 4C -| | frame_size=${78} | phy_cores=${4} - -| tc04-1518B-1c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 1518B | 1C -| | frame_size=${1518} | phy_cores=${1} - -| tc05-1518B-2c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 1518B | 2C -| | frame_size=${1518} | phy_cores=${2} - -| tc06-1518B-4c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 1518B | 4C -| | frame_size=${1518} | phy_cores=${4} - -| tc07-9000B-1c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 9000B | 1C -| | frame_size=${9000} | phy_cores=${1} - -| tc08-9000B-2c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 9000B | 2C -| | frame_size=${9000} | phy_cores=${2} - -| tc09-9000B-4c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | 9000B | 4C -| | frame_size=${9000} | phy_cores=${4} - -| tc10-IMIX-1c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | IMIX | 1C -| | frame_size=IMIX_v4_1 | phy_cores=${1} - -| tc11-IMIX-2c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | IMIX | 2C -| | frame_size=IMIX_v4_1 | phy_cores=${2} - -| tc12-IMIX-4c-avf-dot1q-ip6base-ndrpdr -| | [Tags] | IMIX | 4C -| | frame_size=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6base-ndrpdr.robot b/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6base-ndrpdr.robot deleted file mode 100644 index 8c93ec8c12..0000000000 --- a/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6base-ndrpdr.robot +++ /dev/null @@ -1,130 +0,0 @@ -# Copyright (c) 2019 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -*** Settings *** -| Resource | resources/libraries/robot/shared/default.robot -| -| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR -| ... | NIC_Intel-X710 | ETH | IP6FWD | BASE | IP6BASE | DRV_AVF -| -| Suite Setup | Setup suite single link | performance_avf -| Suite Teardown | Tear down suite | performance -| Test Setup | Setup test -| Test Teardown | Tear down test | performance -| -| Test Template | Local Template -| -| Documentation | *RFC2544: Pkt throughput IPv6 routing test cases* -| -| ... | *[Top] Network Topologies:* TG-DUT1-TG 2-node circular topology\ -| ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv6 for IPv6 routing. -| ... | *[Cfg] DUT configuration:* DUT1 is configured with IPv6 routing and two\ -| ... | static IPv6 /64 route entries. DUT1 tested with ${nic_name} with VF\ -| ... | enabled. -| ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop\ -| ... | Rate) with zero packet loss tolerance and throughput PDR (Partial Drop\ -| ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage\ -| ... | of packets transmitted. NDR and PDR are discovered for different\ -| ... | Ethernet L2 frame sizes using MLRsearch library.\ -| ... | Test packets are generated by TG on links to DUTs. TG traffic profile\ -| ... | contains two L3 flow-groups (flow-group per direction, 253 flows per\ -| ... | flow-group) with all packets containing Ethernet header, IPv6 header\ -| ... | with IP no next header and static payload. MAC addresses are matching\ -| ... | MAC addresses of the TG node interfaces. -| ... | *[Ref] Applicable standard specifications:* RFC2544. - -*** Variables *** -| @{plugins_to_enable}= | avf_plugin.so -| ${crypto_type}= | ${None} -| ${nic_name}= | Intel-X710 -| ${nic_driver}= | avf -| ${osi_layer}= | L3 -| ${overhead}= | ${0} -# Traffic profile: -| ${traffic_profile}= | trex-sl-2n-ethip6-ip6src253 - -*** Keywords *** -| Local Template -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config.\ -| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. -| | ... | [Ver] Measure NDR and PDR values using MLRsearch algorithm.\ -| | -| | ... | *Arguments:* -| | ... | - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). -| | ... | Type: integer, string -| | ... | - phy_cores - Number of physical cores. Type: integer -| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer -| | -| | [Arguments] | ${frame_size} | ${phy_cores} | ${rxq}=${None} -| | -| | Set Test Variable | \${frame_size} -| | -| | Given Set Max Rate And Jumbo -| | And Add worker threads to all DUTs | ${phy_cores} | ${rxq} -| | And Pre-initialize layer driver | ${nic_driver} -| | And Apply startup configuration on all VPP DUTs -| | When Initialize layer driver | ${nic_driver} -| | And Initialize layer interface -| | And Initialize IPv6 forwarding in circular topology -| | Then Find NDR and PDR intervals using optimized search - -*** Test Cases *** -| tc01-78B-1c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 78B | 1C -| | frame_size=${78} | phy_cores=${1} - -| tc02-78B-2c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 78B | 2C -| | frame_size=${78} | phy_cores=${2} - -| tc03-78B-4c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 78B | 4C -| | frame_size=${78} | phy_cores=${4} - -| tc04-1518B-1c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 1518B | 1C -| | frame_size=${1518} | phy_cores=${1} - -| tc05-1518B-2c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 1518B | 2C -| | frame_size=${1518} | phy_cores=${2} - -| tc06-1518B-4c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 1518B | 4C -| | frame_size=${1518} | phy_cores=${4} - -| tc07-9000B-1c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 9000B | 1C -| | frame_size=${9000} | phy_cores=${1} - -| tc08-9000B-2c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 9000B | 2C -| | frame_size=${9000} | phy_cores=${2} - -| tc09-9000B-4c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | 9000B | 4C -| | frame_size=${9000} | phy_cores=${4} - -| tc10-IMIX-1c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | IMIX | 1C -| | frame_size=IMIX_v4_1 | phy_cores=${1} - -| tc11-IMIX-2c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | IMIX | 2C -| | frame_size=IMIX_v4_1 | phy_cores=${2} - -| tc12-IMIX-4c-avf-ethip6-ip6base-ndrpdr -| | [Tags] | IMIX | 4C -| | frame_size=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6scale200k-ndrpdr.robot b/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6scale200k-ndrpdr.robot deleted file mode 100644 index 232ebb9d2d..0000000000 --- a/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6scale200k-ndrpdr.robot +++ /dev/null @@ -1,133 +0,0 @@ -# Copyright (c) 2019 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -*** Settings *** -| Resource | resources/libraries/robot/shared/default.robot -| -| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR -| ... | NIC_Intel-X710 | ETH | IP6FWD | SCALE | FIB_200K | DRV_AVF -| -| Suite Setup | Setup suite single link | performance_avf -| Suite Teardown | Tear down suite | performance -| Test Setup | Setup test -| Test Teardown | Tear down test | performance -| -| Test Template | Local Template -| -| Documentation | *RFC2544: Pkt throughput IPv6 routing test cases* -| -| ... | *[Top] Network Topologies:* TG-DUT1-TG 2-node circular topology\ -| ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv6 for IPv6 routing. -| ... | *[Cfg] DUT configuration:* DUT1 is configured with IPv6 routing and\ -| ... | 2x100k static IPv6 /64 route entries. DUT1 is tested with ${nic_name}\ -| ... | with VF enabled. -| ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop\ -| ... | Rate) with zero packet loss tolerance and throughput PDR (Partial Drop\ -| ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage\ -| ... | of packets transmitted. NDR and PDR are discovered for different\ -| ... | Ethernet L2 frame sizes using MLRsearch library.\ -| ... | Test packets are generated by TG on links to DUT1. TG traffic profile\ -| ... | contains two L3 flow-groups (flow-group per direction, 100k flows per\ -| ... | flow-group) with all packets containing Ethernet header, IPv6 header\ -| ... | with IP and static payload. MAC addresses are matching MAC addresses\ -| ... | of the TG node interfaces. Incrementing of IP.dst (IPv6 destination\ -| ... | address) field is applied to both streams. -| ... | *[Ref] Applicable standard specifications:* RFC2544. - -*** Variables *** -| @{plugins_to_enable}= | avf_plugin.so -| ${crypto_type}= | ${None} -| ${nic_name}= | Intel-X710 -| ${nic_driver}= | avf -| ${osi_layer}= | L3 -| ${overhead}= | ${0} -| ${rts_per_flow}= | ${100000} -# Traffic profile: -| ${traffic_profile}= | trex-sl-3n-ethip6-ip6dst${rts_per_flow} - -*** Keywords *** -| Local Template -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config.\ -| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. -| | ... | [Ver] Measure NDR and PDR values using MLRsearch algorithm.\ -| | -| | ... | *Arguments:* -| | ... | - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). -| | ... | Type: integer, string -| | ... | - phy_cores - Number of physical cores. Type: integer -| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer -| | -| | [Arguments] | ${frame_size} | ${phy_cores} | ${rxq}=${None} -| | -| | Set Test Variable | \${frame_size} -| | -| | Given Set Max Rate And Jumbo -| | And Add worker threads to all DUTs | ${phy_cores} | ${rxq} -| | And Pre-initialize layer driver | ${nic_driver} -| | And Apply startup configuration on all VPP DUTs -| | When Initialize layer driver | ${nic_driver} -| | And Initialize layer interface -| | And Initialize IPv6 forwarding with scaling in circular topology -| | ... | ${rts_per_flow} -| | Then Find NDR and PDR intervals using optimized search - -*** Test Cases *** -| tc01-78B-1c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 78B | 1C -| | frame_size=${78} | phy_cores=${1} - -| tc02-78B-2c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 78B | 2C -| | frame_size=${78} | phy_cores=${2} - -| tc03-78B-4c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 78B | 4C -| | frame_size=${78} | phy_cores=${4} - -| tc04-1518B-1c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 1518B | 1C -| | frame_size=${1518} | phy_cores=${1} - -| tc05-1518B-2c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 1518B | 2C -| | frame_size=${1518} | phy_cores=${2} - -| tc06-1518B-4c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 1518B | 4C -| | frame_size=${1518} | phy_cores=${4} - -| tc07-9000B-1c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 9000B | 1C -| | frame_size=${9000} | phy_cores=${1} - -| tc08-9000B-2c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 9000B | 2C -| | frame_size=${9000} | phy_cores=${2} - -| tc09-9000B-4c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | 9000B | 4C -| | frame_size=${9000} | phy_cores=${4} - -| tc10-IMIX-1c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | IMIX | 1C -| | frame_size=IMIX_v4_1 | phy_cores=${1} - -| tc11-IMIX-2c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | IMIX | 2C -| | frame_size=IMIX_v4_1 | phy_cores=${2} - -| tc12-IMIX-4c-avf-ethip6-ip6scale200k-ndrpdr -| | [Tags] | IMIX | 4C -| | frame_size=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6scale20k-ndrpdr.robot b/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6scale20k-ndrpdr.robot deleted file mode 100644 index fcb5def20d..0000000000 --- a/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6scale20k-ndrpdr.robot +++ /dev/null @@ -1,133 +0,0 @@ -# Copyright (c) 2019 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -*** Settings *** -| Resource | resources/libraries/robot/shared/default.robot -| -| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR -| ... | NIC_Intel-X710 | ETH | IP6FWD | SCALE | FIB_20K | DRV_AVF -| -| Suite Setup | Setup suite single link | performance_avf -| Suite Teardown | Tear down suite | performance -| Test Setup | Setup test -| Test Teardown | Tear down test | performance -| -| Test Template | Local Template -| -| Documentation | *RFC2544: Pkt throughput IPv6 routing test cases* -| -| ... | *[Top] Network Topologies:* TG-DUT1-TG 2-node circular topology\ -| ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv6 for IPv6 routing. -| ... | *[Cfg] DUT configuration:* DUT1 is configured with IPv6 routing and two\ -| ... | static IPv6 /64 route entries. DUT1 tested with ${nic_name} with VF\ -| ... | enabled. -| ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop\ -| ... | Rate) with zero packet loss tolerance and throughput PDR (Partial Drop\ -| ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage\ -| ... | of packets transmitted. NDR and PDR are discovered for different\ -| ... | Ethernet L2 frame sizes using MLRsearch library.\ -| ... | Test packets are generated by TG on links to DUT1. TG traffic profile\ -| ... | contains two L3 flow-groups (flow-group per direction, 1M flows per\ -| ... | flow-group) with all packets containing Ethernet header, IPv6 header\ -| ... | with IP and static payload. MAC addresses are matching MAC addresses\ -| ... | of the TG node interfaces. Incrementing of IP.dst (IPv6 destination\ -| ... | address) field is applied to both streams. -| ... | *[Ref] Applicable standard specifications:* RFC2544. - -*** Variables *** -| @{plugins_to_enable}= | avf_plugin.so -| ${crypto_type}= | ${None} -| ${nic_name}= | Intel-X710 -| ${nic_driver}= | avf -| ${osi_layer}= | L3 -| ${overhead}= | ${0} -| ${rts_per_flow}= | ${10000} -# Traffic profile: -| ${traffic_profile}= | trex-sl-3n-ethip6-ip6dst${rts_per_flow} - -*** Keywords *** -| Local Template -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config.\ -| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. -| | ... | [Ver] Measure NDR and PDR values using MLRsearch algorithm.\ -| | -| | ... | *Arguments:* -| | ... | - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). -| | ... | Type: integer, string -| | ... | - phy_cores - Number of physical cores. Type: integer -| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer -| | -| | [Arguments] | ${frame_size} | ${phy_cores} | ${rxq}=${None} -| | -| | Set Test Variable | \${frame_size} -| | -| | Given Set Max Rate And Jumbo -| | And Add worker threads to all DUTs | ${phy_cores} | ${rxq} -| | And Pre-initialize layer driver | ${nic_driver} -| | And Apply startup configuration on all VPP DUTs -| | When Initialize layer driver | ${nic_driver} -| | And Initialize layer interface -| | And Initialize IPv6 forwarding with scaling in circular topology -| | ... | ${rts_per_flow} -| | Then Find NDR and PDR intervals using optimized search - -*** Test Cases *** -| tc01-78B-1c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 78B | 1C -| | frame_size=${78} | phy_cores=${1} - -| tc02-78B-2c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 78B | 2C -| | frame_size=${78} | phy_cores=${2} - -| tc03-78B-4c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 78B | 4C -| | frame_size=${78} | phy_cores=${4} - -| tc04-1518B-1c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 1518B | 1C -| | frame_size=${1518} | phy_cores=${1} - -| tc05-1518B-2c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 1518B | 2C -| | frame_size=${1518} | phy_cores=${2} - -| tc06-1518B-4c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 1518B | 4C -| | frame_size=${1518} | phy_cores=${4} - -| tc07-9000B-1c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 9000B | 1C -| | frame_size=${9000} | phy_cores=${1} - -| tc08-9000B-2c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 9000B | 2C -| | frame_size=${9000} | phy_cores=${2} - -| tc09-9000B-4c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | 9000B | 4C -| | frame_size=${9000} | phy_cores=${4} - -| tc10-IMIX-1c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | IMIX | 1C -| | frame_size=IMIX_v4_1 | phy_cores=${1} - -| tc11-IMIX-2c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | IMIX | 2C -| | frame_size=IMIX_v4_1 | phy_cores=${2} - -| tc12-IMIX-4c-avf-ethip6-ip6scale20k-ndrpdr -| | [Tags] | IMIX | 4C -| | frame_size=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6scale2m-ndrpdr.robot b/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6scale2m-ndrpdr.robot deleted file mode 100644 index 4e25b82467..0000000000 --- a/tests/vpp/perf/ip6/2n1l-10ge2p1x710-avf-ethip6-ip6scale2m-ndrpdr.robot +++ /dev/null @@ -1,133 +0,0 @@ -# Copyright (c) 2019 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -*** Settings *** -| Resource | resources/libraries/robot/shared/default.robot -| -| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR -| ... | NIC_Intel-X710 | ETH | IP6FWD | SCALE | FIB_2M | DRV_AVF -| -| Suite Setup | Setup suite single link | performance_avf -| Suite Teardown | Tear down suite | performance -| Test Setup | Setup test -| Test Teardown | Tear down test | performance -| -| Test Template | Local Template -| -| Documentation | *RFC2544: Pkt throughput IPv6 routing test cases* -| -| ... | *[Top] Network Topologies:* TG-DUT1-TG 2-node circular topology\ -| ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv6 for IPv6 routing. -| ... | *[Cfg] DUT configuration:* DUT1 is configured with IPv6 routing and\ -| ... | 2x1M static IPv6 /64 route entries. DUT1 is tested with ${nic_name}\ -| ... | with VF enabled. -| ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop\ -| ... | Rate) with zero packet loss tolerance and throughput PDR (Partial Drop\ -| ... | Rate) with non-zero packet loss tolerance (LT) expressed in percentage\ -| ... | of packets transmitted. NDR and PDR are discovered for different\ -| ... | Ethernet L2 frame sizes using MLRsearch library.\ -| ... | Test packets are generated by TG on links to DUT1. TG traffic profile\ -| ... | contains two L3 flow-groups (flow-group per direction, 1M flows per\ -| ... | flow-group) with all packets containing Ethernet header, IPv6 header\ -| ... | with IP and static payload. MAC addresses are matching MAC addresses\ -| ... | of the TG node interfaces. Incrementing of IP.dst (IPv6 destination\ -| ... | address) field is applied to both streams. -| ... | *[Ref] Applicable standard specifications:* RFC2544. - -*** Variables *** -| @{plugins_to_enable}= | avf_plugin.so -| ${crypto_type}= | ${None} -| ${nic_name}= | Intel-X710 -| ${nic_driver}= | avf -| ${osi_layer}= | L3 -| ${overhead}= | ${0} -| ${rts_per_flow}= | ${1000000} -# Traffic profile: -| ${traffic_profile}= | trex-sl-3n-ethip6-ip6dst${rts_per_flow} - -*** Keywords *** -| Local Template -| | [Documentation] -| | ... | [Cfg] DUT runs IPv6 routing config.\ -| | ... | Each DUT uses ${phy_cores} physical core(s) for worker threads. -| | ... | [Ver] Measure NDR and PDR values using MLRsearch algorithm.\ -| | -| | ... | *Arguments:* -| | ... | - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). -| | ... | Type: integer, string -| | ... | - phy_cores - Number of physical cores. Type: integer -| | ... | - rxq - Number of RX queues, default value: ${None}. Type: integer -| | -| | [Arguments] | ${frame_size} | ${phy_cores} | ${rxq}=${None} -| | -| | Set Test Variable | \${frame_size} -| | -| | Given Set Max Rate And Jumbo -| | And Add worker threads to all DUTs | ${phy_cores} | ${rxq} -| | And Pre-initialize layer driver | ${nic_driver} -| | And Apply startup configuration on all VPP DUTs -| | When Initialize layer driver | ${nic_driver} -| | And Initialize layer interface -| | And Initialize IPv6 forwarding with scaling in circular topology -| | ... | ${rts_per_flow} -| | Then Find NDR and PDR intervals using optimized search - -*** Test Cases *** -| tc01-78B-1c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 78B | 1C -| | frame_size=${78} | phy_cores=${1} - -| tc02-78B-2c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 78B | 2C -| | frame_size=${78} | phy_cores=${2} - -| tc03-78B-4c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 78B | 4C -| | frame_size=${78} | phy_cores=${4} - -| tc04-1518B-1c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 1518B | 1C -| | frame_size=${1518} | phy_cores=${1} - -| tc05-1518B-2c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 1518B | 2C -| | frame_size=${1518} | phy_cores=${2} - -| tc06-1518B-4c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 1518B | 4C -| | frame_size=${1518} | phy_cores=${4} - -| tc07-9000B-1c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 9000B | 1C -| | frame_size=${9000} | phy_cores=${1} - -| tc08-9000B-2c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 9000B | 2C -| | frame_size=${9000} | phy_cores=${2} - -| tc09-9000B-4c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | 9000B | 4C -| | frame_size=${9000} | phy_cores=${4} - -| tc10-IMIX-1c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | IMIX | 1C -| | frame_size=IMIX_v4_1 | phy_cores=${1} - -| tc11-IMIX-2c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | IMIX | 2C -| | frame_size=IMIX_v4_1 | phy_cores=${2} - -| tc12-IMIX-4c-avf-ethip6-ip6scale2m-ndrpdr -| | [Tags] | IMIX | 4C -| | frame_size=IMIX_v4_1 | phy_cores=${4} diff --git a/tests/vpp/perf/ip6/regenerate_testcases.py b/tests/vpp/perf/ip6/regenerate_testcases.py index b3048a23fc..f6bbf0a102 100755 --- a/tests/vpp/perf/ip6/regenerate_testcases.py +++ b/tests/vpp/perf/ip6/regenerate_testcases.py @@ -1,4 +1,4 @@ -#!/usr/bin/env python +#!/usr/bin/env python3 # Copyright (c) 2019 Cisco and/or its affiliates. # Licensed under the Apache License, Version 2.0 (the "License"); |