aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot/performance
AgeCommit message (Collapse)AuthorFilesLines
2018-04-20FIX: Restart VPP in container before each testPeter Mikus1-0/+2
Change-Id: Iec7045aadc0675e04b8c74cbe28f8b3f193bcf1f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-20FIX: Configure number of memif queus properlyPeter Mikus1-6/+6
Change-Id: I2dcb0300829bc961c80cc30d972d0563aeba9364 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-19FIX: Memif tests failingPeter Mikus1-1/+6
- CSIT-1049 Change-Id: I073c1e6d8cdda835fbb955cbf79e982bc2cc6228 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-11Cleanup perf bootstrapPeter Mikus1-16/+6
- Remove the DPDK_TEST variable and replace it by internal global variable - Unify all perf boostrap for merge in future. - Cleanup ligato perf bootstrap. Change-Id: Id47d6614c8dd18a701493e00056ef17d2e37fc5c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-10FIX: Crypto execution orderPeter Mikus1-5/+1
Currently, VAT history looks like this: sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up sw_interface_dump sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up sw_interface_add_del_address sw_if_index 2 192.168.10.1/24 sw_interface_add_del_address sw_if_index 1 172.168.1.1/24 ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40 ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9 ip_add_del_route 10.0.0.0/8 via 192.168.10.2 sw_if_index 2 resolve-attempts 10 count 1 exec exec /tmp/ipsec_create_tunnel_dut1.config It should be like this: sw_interface_add_del_address sw_if_index 2 192.168.10.1/24 sw_interface_add_del_address sw_if_index 1 172.168.1.1/24 ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40 ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9 ip_add_del_route 10.0.0.0/8 via 192.168.10.2 sw_if_index 2 resolve-attempts 10 count 1 exec exec /tmp/ipsec_create_tunnel_dut1.config sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up Change-Id: I4e943436dee00166966b4f53d9d0a40440bbf1e4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-30Change the default plugin behavior in perf testsPeter Mikus1-9/+9
Currently we are selectively disabling plugins by creating list of disabled plugins for performance tests. Thanks to the new API in VPP we can revert the logic to selectivly enable plugins. This is more stable for future onboarding of new plugins into VPP. Change-Id: Ibdd56d6097230d095a304bbb6984b565d9428f51 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-26Optimize Qemu installation to speed up vhost testsPeter Mikus1-16/+30
Currently Qemu is being installed if there is a change of qsz parameter between tests/suites. Qemu is installed always into the same directory. This patch changes the default behavior to install qemu over and install pathced version to separate directory. It also disables force install. Change-Id: I0d7493a02b026a6ae4a5ea8bacf54656de9db567 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-21CSIT-998: MRR testsJan Gelety1-2/+1
- CSIT-1001: MRR tests: IP4 - ip4 - 10ge2p1x520-ethip4-ip4base-copwhtlistbase-mrr.robot - 10ge2p1x520-ethip4-ip4base-iacldstbase-mrr.robot - 10ge2p1x520-ethip4-ip4base-ipolicemarkbase-mrr.robot - 10ge2p1x520-ethip4-ip4scale200k-mrr.robot - 10ge2p1x520-ethip4-ip4scale20k-mrr.robot - 10ge2p1x520-ethip4-ip4scale2m-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-nat44-mrr.robot - 10ge2p1x520-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot - 40ge2p1xl710-ethip4-ip4base-mrr.robot - ip4_tunnels - 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-ethip4vxlan-l2xcbase-mrr.robot - 10ge2p1x520-ethip4lispip4-ip4base-mrr.robot Change-Id: Ibfd03aea9b97d29a8fa05e2956f6df54603a2208 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-03-21Fix bug in dpdk-testpmd-mac KWTibor Frank1-6/+0
Change-Id: I6711e186062a72700552418eeee11b031e8c8ce4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-20Add max-pkt-len parameter to dpdk testpmd startTibor Frank1-61/+100
Change-Id: I114c187f007c10223502669c2ba85c63d09cd84a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-16Add vhost and memif MRR suitePeter Mikus1-0/+27
Change-Id: Iaded13af82383955c2ff093ddc96e09682d95776 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-08CSIT-989 Fix: Reflect latest memif API changesPeter Mikus1-12/+10
Change-Id: I0c9cb073a42a8b4b7e573023e784ab9e72d0ad55 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-27Performance KW optimizationsPeter Mikus2-6/+0
- Reducing test time by removing redundant KW. Change-Id: I03eeb0332cb88a11eff06df6f5e79d905df317a2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23Raw results chk keywords and initial TCPeter Mikus3-51/+124
- Implementation of Display raw results - Implementation of Traffic should pass with maximum rate - Code optimizations - L2BD, L2XC, IP4, IP6 TC Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23FIX: Qemu path overridePeter Mikus1-6/+6
Currently there is bug that Qemu path is not correctly composed and cannot be properly overriden due to race condition in code. This patch is fixing functions to properly work with path. Change-Id: I276458d2d23c7a14441a4de4a56eff6431242ab9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-09Disable all plugins except DPDK by defaultJan Gelety1-0/+21
- enable corresponding plugin for ACL, NAT, MEMIF tests Change-Id: Ie8bfdcbf1734283b6412ef3015215a00ce3ebdf6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-01-17CSIT-675: SRv6 performance testsJan Gelety3-13/+124
- update L1 KWs - update L2 KWs - tests with one SID (no SRH insertion) - tests with two SIDs (SRH inserted) and decapsulation - tests with two SIDs (SRH inserted) without decapsulation - enabled packet traces and logged packet traces in the test case tear down if test failed Change-Id: I3a0f4c350eed3f42509c6d49e832faa78fe64dbb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-01-16CSIT-898: WRK improvmentsTibor Frank1-0/+7
Change-Id: I92aafaaedce5891727a983b8cf024a0fb0db7524 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-01-10CSIT-866: wrk onboarding in CSITTibor Frank1-1/+53
- CSIT-867: Low Level Description - CSIT-868: wrk traffic profile - parsing - CSIT-869: wrk implementation into CSIT Change-Id: I65e1037f5ae05b3a5b2020e4a6c54462766ae1b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-01-02CSIT-870 Kubernetes/Ligato integrationPeter Mikus1-0/+26
- Update overall Kubernetes/Ligato integration - CSIT-871 Update infrastructure / images - CSIT-872 Update of KubernetesUtils.py Change-Id: I7833f56abd351c694d3d3e1c9c45e649aec892e1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-12-15CSIT-861: SW cryptodev perf testsJan Gelety1-3/+9
Change-Id: I687216ca43569542d38be681ca04c898010fc65d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-11-10CSIT-843: Update actual topology in case of new/updated/deleted interfaceJan Gelety1-0/+5
Change-Id: I6adfe86bd0b9cdf3d194a1b871e52481c333d8e7 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-23FIX: use correct IF name in Vpp Route Add in case of multi-VMs configJan Gelety1-4/+4
Change-Id: Iab5a6db1eac11798e2a3ec56f7d68043f6c8c2ab Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-19FIX: apply changes implemented for FIB settingsJan Gelety1-52/+64
Change-Id: I00c3407f4324e282c438cb8fcd44470c331089c5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-17FIX: Log MACIP ACL settings only if test failedJan Gelety1-1/+2
Change-Id: I6d51c662d8b23789adcd9c3d1b1e8736f71d5279 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-12CSIT-748 vnf-agent integrationPeter Mikus2-4/+1
CSIT-773 Implement RF keywords for k8s - Implementation of Test Suite Setup for Ligato vnf-agent testing - Implementation of KubernetesUtil for controlling kubectl - Yaml templates for L2XC topology with 1cswitch and 1cnf - Yaml templates for L2BD topology with 1cswitch and 1cnf - ligato bootstrap script for creating vnf-agent image Change-Id: Iebefde0eb984a27a0afcdf29fe549ca4edf8a61e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-11CSIT-778: Add mac-ip binding acl l2bd perf testJan Gelety2-58/+54
Change-Id: Iaced68458b0e4070f861be7854ee428ae8ca4e13 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-09CSIT-768: Refactor Python container librariesPeter Mikus2-7/+22
CSIT-769: Implement L2 RF keywords for container orchestration Change-Id: I7637d1ecc3a45111522b8d6c578b3f88369aff6b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-28FIX: Vhost tests waiting for VirtualEthernet UPPeter Mikus1-6/+0
Due to the change in VPP #8472 When changing the admin state of a vhost-user interface, do not put it in link-up mode if the interface is not actually ready. We have to remove "All Vpp Interfaces Ready Wait" for VirtualEthernet interfaces. Change-Id: I70d60b9f54a75b18b179f3315b636b763962acdd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-22CSIT-796: l2bd-memif perf testsJan Gelety1-2/+49
Change-Id: Ic714fa7baec49dcba1a8eb6a578183c6771e3493 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-08CSIT-665: Re-write L1 robot keywords in pythonDasa Simkova2-15/+19
Change-Id: Iddd823375ddd17b9abd5f02ee3aea3bfcb625149 Signed-off-by: Dasa Simkova <dspropagacie@gmail.com>
2017-08-28FIX: SNAT -> NAT renaming of APIPeter Mikus2-9/+9
- Based on https://gerrit.fd.io/r/#/c/8146/ Change-Id: I774483c7e2b419a9b9b6be78812ecf53a5c91eab Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-16CSIT-777: L2 keywords for MACIP ACL testsJan Gelety2-8/+183
Change-Id: I678d87770405105555ccc30ce0003f704d7ca82e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-01CSIT-699: Add l2bd+dot1q perf testsJan Gelety1-0/+37
Change-Id: I3d8cbb235918331b3c60147f7870a4aa90036748 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-20FIX: run build qemu only for the 1st VM on DUTJan Gelety1-18/+20
Change-Id: Ib0fd10e9cb0c6eaeb75ec96e4459d5fb27c656bf Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-20FIX: fix of multiple perf test issuesJan Gelety1-2/+2
Change-Id: I24c823352b2832eb6da2aad0fd70570beb990f3f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-19FIX: typo issues in teardown for ACL perf testsJan Gelety1-2/+2
Change-Id: I2232b010efb4f4b071a0fe3efaaeb85f2830bf3c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-19CSIT-704: Add ACL IP4BASE perf testsJan Gelety2-3/+68
Change-Id: I1fada28f2855534faf3b3051a3efe1cbb4dcdd03 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-18FIX: Initialize L2BD keywordPeter Mikus1-2/+13
Currently in Performance the "Initialize L2 bridge domain" keyword is adding interfaces to L2DB per node and at the same time waiting until interfaces become UP. This may be an issue if physical interfaces interconnecting DUTs required to be administratively UP on both DUTs to physical link state became UP. This fix is supposed to check the link state after all DUTs are initialized. Change-Id: I430b4285967f6168e6c74e0089a3e0d037b251d1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-17FIX: remove previous QEMU build when needed to change qszJan Gelety1-4/+12
Change-Id: I949f8800b45354c205c5a5d36ab2abeeb93409dc Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-06CSIT-622: Stateful Security Groups perf testsJan Gelety1-0/+106
1. add L2BD iACL statefull and stateless tests with 1, 10 and 50 not-hitting ACEs in combination with 100, 10k and 100k flows per direction 2. add L2BD oACL statefull and stateless tests with 1, 10 and 50 not-hitting ACEs in combination with 100, 10k and 100k flows per direction Change-Id: Ia38589aa81b50c5ccdf2813ad6fadd22b46fffeb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-06CSIT-660: add vring1024 tuned CFS for vpp workers and guest-testpmdJan Gelety1-9/+13
- add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 1024 and tuned CFS setting Change-Id: Ief8b4b86cdecfa39bf8cf0ec90fb844edfc6f396 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-06CSIT-661: re-add vring256 tuned CFS for vpp workers and guest-testpmdJan Gelety1-23/+59
1. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and tuned CFS setting 2. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and default CFS setting Change-Id: I25aae6839d3e621316d35f5c9525389a6faabd56 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-04CSIT-651 Add keywords and template for memifPeter Mikus3-0/+61
Add keywords and template for memif Change-Id: I8bd5cfe345260750a74930c8ef55690be5f2dd5e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-29CSIT-687: Directory structure reorganizationTibor Frank3-0/+2674
Change-Id: I772c9e214be2461adf58124998d272e7d795220f Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>