diff options
Diffstat (limited to 'resources/libraries/robot/performance')
| -rw-r--r-- | resources/libraries/robot/performance/performance_setup.robot | 251 |
1 files changed, 1 insertions, 250 deletions
diff --git a/resources/libraries/robot/performance/performance_setup.robot b/resources/libraries/robot/performance/performance_setup.robot index 9350c65beb..3e27c18d6a 100644 --- a/resources/libraries/robot/performance/performance_setup.robot +++ b/resources/libraries/robot/performance/performance_setup.robot @@ -200,36 +200,6 @@ | | Set Suite Variable | ${dut2_if1_2} | | Set Suite Variable | ${dut2_if2} -| Tear down guest VM -| | [Documentation] -| | ... | Stop all qemu processes running on nodes. -| | ... -| | Run Keyword | vnf_manager.Kill All VMs - -| Tear down guest VM with dpdk-testpmd -| | [Documentation] -| | ... | Stop all qemu processes with dpdk-testpmd running on ${dut_node}. -| | ... | Argument is dictionary of all qemu nodes running with its names. -| | ... | Dpdk-testpmd is stopped gracefully with printing stats. -| | ... -| | ... | *Arguments:* -| | ... | - dut_node - Node where to clean qemu. Type: dictionary -| | ... | - dut_vm_refs - VM references on node. Type: dictionary -| | ... -| | ... | *Example:* -| | ... -| | ... | \| Tear down guest VM with dpdk-testpmd \| ${node['DUT1']} \ -| | ... | \| ${dut_vm_refs} \| -| | ... -| | [Arguments] | ${dut_node} | ${dut_vm_refs} -| | ${vms_number}= | Get Length | ${dut_vm_refs} -| | ${index}= | Set Variable | ${0} -| | :FOR | ${vm_name} | IN | @{dut_vm_refs} -| | | ${vm}= | Get From Dictionary | ${dut_vm_refs} | ${vm_name} -| | | ${index}= | Evaluate | ${index} + 1 -| | | Dpdk Testpmd Stop | ${vm} -| | | Run Keyword If | '${index}' == '${vms_number}' | ${vm_name}.Qemu Kill All - # Suite setups | Set up 2-node performance topology with DUT's NIC model @@ -581,20 +551,6 @@ | | Set Linux interface up | ${tg} | ${intf_name} | | Install wrk | ${tg} -# Suite teardowns - -| Tear down 2-node performance topology -| | [Documentation] -| | ... | Suite teardown phase with traffic generator teardown. -| | ... -| | Teardown traffic generator | ${tg} - -| Tear down 3-node performance topology -| | [Documentation] -| | ... | Suite teardown phase with traffic generator teardown. -| | ... -| | Teardown traffic generator | ${tg} - # Tests setups | Set up performance test @@ -656,210 +612,5 @@ | | Start VPP in all '${container_group}' containers | | Restart VPP service on all DUTs | ${nodes} | | Verify VPP on all DUTs | ${nodes} +| | Save VPP PIDs | | Append To List | ${container_groups} | ${container_group} - -# Tests teardowns - -| Tear down performance test -| | [Documentation] | Common test teardown for performance tests. -| | ... -| | ... | TODO: Rename to "Tear down VPP performance test"? -| | ... | most steps do not apply to DPDK nor other vswitch solutions. -| | ... | TODO: Document at least some steps this keyword takes. -| | ... -| | ... | To save space in suites, this keyword does not accept -| | ... | any explicit arguments. Instead, it requires few variables -| | ... | to be defined in at least test scope. -| | ... -| | ... | *Test Variables needed:* -| | ... | - frame_size - L2 Frame Size [B]. Type: integer -| | ... | - traffic_profile - Profile name to run debug trial with. Type: string -| | ... | - nodes - Parsed information object. Type: dict -| | ... -| | ... | *Example:* -| | ... -| | ... | \| Set Test Variable \| \${frame_size} \| 64 \| -| | ... | \| Tear down performance test \| -| | ... -| | Remove All Added Ports On All DUTs From Topology | ${nodes} -| | Show PAPI History On All DUTs | ${nodes} -| | Get Core Files on All Nodes | ${nodes} -| | Set Test Variable | ${pkt_trace} | ${True} -| | Run Keyword If Test Failed -| | ... | Traffic should pass with no loss | ${perf_trial_duration} | 10000pps -| | ... | ${frame_size} | ${traffic_profile} | fail_on_loss=${False} - -| Tear down performance test with container -| | [Documentation] -| | ... | Common test teardown for performance tests which uses containers. -| | ... -| | ... | TODO: Call Tear down performance test? -| | ... -| | :FOR | ${container_group} | IN | @{container_groups} -| | | Destroy all '${container_group}' containers - -| Tear down performance test with vhost -| | [Documentation] | Common test teardown for performance tests which use -| | ... | vhost(s) and VM(s). -| | ... -| | Tear down performance test -| | Show VPP vhost on all DUTs | ${nodes} -| | Tear down guest VM - -| Tear down performance test with vhost and VM with dpdk-testpmd -| | [Documentation] | Common test teardown for performance tests which use -| | ... | vhost(s) and VM(s) with dpdk-testpmd. -| | ... -| | ... | *Test Variables needed:* -| | ... | - frame_size - L2 Frame Size [B]. Type: integer -| | ... | - traffic_profile - Profile name to run debug trial with. Type: string -| | ... -| | ... | *Arguments:* -| | ... | - dut1_node - Node where to clean qemu. Type: dictionary -| | ... | - dut1_vm_refs - VM references on node. Type: dictionary -| | ... | - dut2_node - Node where to clean qemu. Type: dictionary -| | ... | - dut2_vm_refs - VM references on node. Type: dictionary -| | ... -| | ... | *Example:* -| | ... -| | ... | \| Tear down performance test with vhost and VM with dpdk-testpmd \ -| | ... | \| ${node['DUT1']} \| ${dut_vm_refs} \ -| | ... | \| ${node['DUT2']} \| ${dut_vm_refs} \| -| | ... -| | [Arguments] | ${dut1_node}=${None} | ${dut1_vm_refs}=${None} -| | ... | ${dut2_node}=${None} | ${dut2_vm_refs}=${None} -| | ... -| | Tear down performance test -| | Show VPP vhost on all DUTs | ${nodes} -| | Run keyword unless | ${dut1_node}==${None} -| | ... | Tear down guest VM with dpdk-testpmd | ${dut1} | ${dut1_vm_refs} -| | Run keyword unless | ${dut2_node}==${None} -| | ... | Tear down guest VM with dpdk-testpmd | ${dut2} | ${dut2_vm_refs} - -| Tear down performance test with vhost and VM with dpdk-testpmd and ACL -| | [Documentation] | Common test teardown for performance tests which use -| | ... | vhost(s) and VM(s) with ACL and dpdk-testpmd. -| | ... -| | ... | *Test Variables needed:* -| | ... | - frame_size - L2 Frame Size [B]. Type: integer -| | ... | - traffic_profile - Profile name to run debug trial with. Type: string -| | ... -| | ... | *Arguments:* -| | ... | - dut1_node - Node where to clean qemu. Type: dictionary -| | ... | - dut1_vm_refs - VM references on node. Type: dictionary -| | ... | - dut2_node - Node where to clean qemu. Type: dictionary -| | ... | - dut2_vm_refs - VM references on node. Type: dictionary -| | ... -| | [Arguments] | ${dut1_node}=${None} | ${dut1_vm_refs}=${None} -| | ... | ${dut2_node}=${None} | ${dut2_vm_refs}=${None} -| | ... -| | Tear down performance test with vhost and VM with dpdk-testpmd -| | ... | ${dut1_node} | ${dut1_vm_refs} -| | ... | ${dut2_node} | ${dut2_vm_refs} -| | Run Keyword If Test Failed | Vpp Log Plugin Acl Settings | ${dut1} -| | Run Keyword If Test Failed | Run Keyword And Ignore Error -| | ... | Vpp Log Plugin Acl Interface Assignment | ${dut1} - -| Tear down DPDK 2-node performance topology -| | [Documentation] -| | ... | Suite teardown phase with traffic generator teardown. -| | ... | Cleanup DPDK test environment. -| | ... -| | ... | TODO: Add "Traffic should pass with no loss" with min rate -| | ... | on failure, as in the VPP test teardown? -| | ... -| | Teardown traffic generator | ${tg} -| | Cleanup DPDK Environment | ${dut1} | ${dut1_if1} | ${dut1_if2} - -| Tear down DPDK 3-node performance topology -| | [Documentation] -| | ... | Suite teardown phase with traffic generator teardown. -| | ... | Cleanup DPDK test environment. -| | ... -| | ... | TODO: Add "Traffic should pass with no loss" with min rate -| | ... | on failure, as in the VPP test teardown? -| | ... -| | Teardown traffic generator | ${tg} -| | Cleanup DPDK Environment | ${dut1} | ${dut1_if1} | ${dut1_if2} -| | Cleanup DPDK Environment | ${dut2} | ${dut2_if1} | ${dut2_if2} - -| Tear down performance test with NAT -| | [Documentation] | Common test teardown for performance \ -| | ... | tests with NAT feature used. -| | ... -| | ... | *Test Variables needed:* -| | ... | - frame_size - L2 Frame Size [B]. Type: integer -| | ... | - traffic_profile - Profile name to run debug trial with. Type: string -| | ... -| | ... | *Example:* -| | ... -| | ... | \| Tear down performance test with NAT \| -| | ... -| | Tear down performance test -| | Show NAT verbose | ${dut1} -| | Show NAT verbose | ${dut2} - -| Tear down performance test with ACL -| | [Documentation] | Common test teardown for performance \ -| | ... | tests with ACL feature used. -| | ... -| | ... | *Test Variables needed:* -| | ... | - frame_size - L2 Frame Size [B]. Type: integer -| | ... | - traffic_profile - Profile name to run debug trial with. Type: string -| | ... -| | ... | *Example:* -| | ... -| | ... | \| Tear down performance test with ACL \| -| | ... -| | Tear down performance test -| | Run Keyword If Test Failed | Vpp Log Plugin Acl Settings | ${dut1} -| | Run Keyword If Test Failed | Run Keyword And Ignore Error -| | ... | Vpp Log Plugin Acl Interface Assignment | ${dut1} - -| Tear down performance test with MACIP ACL -| | [Documentation] | Common test teardown for performance \ -| | ... | tests with MACIP ACL feature used. -| | ... -| | ... | *Test Variables needed:* -| | ... | - frame_size - L2 Frame Size [B]. Type: integer -| | ... | - traffic_profile - Profile name to run debug trial with. Type: string -| | ... -| | ... | *Example:* -| | ... -| | ... | \| Tear down performance test with MACIP ACL \| -| | ... -| | Tear down performance test -| | Run Keyword If Test Failed | Run Keyword And Ignore Error -| | ... | Vpp Log Macip Acl Settings | ${dut1} -| | Run Keyword And Ignore Error -| | ... | Vpp Log Macip Acl Interface Assignment | ${dut1} - -| Tear down performance test with Ligato Kubernetes -| | [Documentation] | Common test teardown for performance \ -| | ... | tests with Ligato Kubernetes. -| | ... -| | ... | TODO: Call Tear down performance test? -| | ... -| | Run Keyword If Test Failed -| | ... | Get Kubernetes logs on all DUTs | ${nodes} | csit -| | Run Keyword If Test Failed -| | ... | Describe Kubernetes resource on all DUTs | ${nodes} | csit -| | Delete Kubernetes resource on all DUTs | ${nodes} | csit - -| Tear down performance test with SRv6 with encapsulation -| | [Documentation] | Common test teardown for performance \ -| | ... | tests with SRv6 with encapsulation feature used. -| | ... -| | ... | *Test Variables needed:* -| | ... | - frame_size - L2 Frame Size [B]. Type: integer -| | ... | - traffic_profile - Profile name to run debug trial with. Type: string -| | ... -| | ... | *Example:* -| | ... -| | ... | \| Tear down performance test with SRv6 with encapsulation \| -| | ... -| | Tear down performance test -| | Run Keyword If Test Failed | Show SR Policies on all DUTs | ${nodes} -| | Run Keyword If Test Failed -| | ... | Show SR Steering Policies on all DUTs | ${nodes} -| | Run Keyword If Test Failed | Show SR LocalSIDs on all DUTs | ${nodes} |