aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot/performance
AgeCommit message (Collapse)AuthorFilesLines
2018-07-24CSIT-1097: Migrate vm_vhost to NDRPDR and edit MRRVratko Polak1-0/+4
Change-Id: Id5eb8fe46b219426803d3e7d135319ce5117738c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1201 Create L2patch perf testsPeter Mikus1-0/+11
- XL710, XXV710, X710 - 2n, 3n - all pkt.size groups - ndrpdr, mrr Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add srv6 NDRPDR suitesVratko Polak1-18/+114
Delete the corresponding ndrpdrdisc suites. MRR suites are also edited, to make them less different from NDRPDR suites. Now, there is a script to re-generate testcases of selected suites. For that, resources/libraries/python/autogen is created, with Regenerator holding the most of script logic. The script looks at files matching a glob expression, reuses a "prolog", but overwites test cases with the default template and hardcoded set of testcase arguments. Also, handling of overhead size has been simplified, using new keyword Get Max Rate And Jumbo And Handle Multi Seg. Default value for search timeout is increased to 12 minutes to make timeout failures less frequent. Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-16Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710Peter Mikus1-2/+20
- CSIT-1161 Add 2-node L2XC tests - CSIT-1160 Add 2-node L2BD tests - CSIT-1157 Add 2-node IP4 tests - CSIT-1153 Add 2-node IP6 KW - CSIT-1158 Add 2-node IP6 tests Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Refactor perf test casesPeter Mikus1-19/+37
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak1-42/+32
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-09CSIT-1142 2-node topology - keywordsPeter Mikus2-65/+72
- Clean up of 2-node setup KWs Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-03VTS VXLAN vhost-user with single DUT, TG sends VXLANPeter Ginchev2-0/+94
Change-Id: I63539af2cdbdbd02a67068e48d0fdf2743da3b1e Signed-off-by: Peter Ginchev <pginchev@cisco.com>
2018-06-08CSIT-1081 Container VPP configuration refactorPeter Mikus1-6/+86
Adopt code for various topology configurations. Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-01VPP link bonding - lacp modeJan Gelety2-21/+142
CSIT-1072 CSIT-1083 CSIT-1084 Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-31DPDK link bonding: xor modeJan Gelety1-2/+117
CSIT-1073 CSIT-1074 CSIT-1077 Change-Id: I248e079021c30988210fd792b32d5afdca71aadb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-23CSIT-1087: Add SRv6 MRR testsTibor Frank1-3/+18
Change-Id: Ia90a9bff6791518ba08fa81e6167e96aea7714d5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-16CSIT-992: Fix intermediate phases MDR parameterVratko Polak1-6/+6
Also add TODOs and improve comments. Change-Id: I50bd652c83c272c3f7662dd487ab617be2b7de08 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-10CSIT-992: Give MDR parameters official namesVratko Polak1-15/+16
Change-Id: I1da9a64fb06e015f2b2a0aacb46a53d70349b4b6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-10CSIT-1071 Add traffic evaluation criteria to MRRPeter Mikus1-1/+3
- Fail the testcase if there is no traffic pass. Change-Id: I162187073aafa286793ce488fda9fd065bb55213 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-04CSIT-992: Shorten MDR search test messageVratko Polak1-9/+6
Change-Id: I79c78d4d8ca1611a287bd117e480c4317d27e287 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04CSIT-992: Add libraries for optimized searchVratko Polak1-0/+161
+ Place the libraries into resources/libraries/python/search/. + Except OptimizedTrexSearch in TrafficGenerator.py + Change traffic generator to support floats for duration and warmup. + Remove explicit type conversions where not needed. + Add robot keywords to performance_utils.robot + for calling the optimized search. + for reporting the resulting values. + for checking the minimal performance has been reached. + for running five second "Traffic should pass with no loss" after the search. - Add methodology documentation in subsequent Change. - Add simulator for testing algorithm correctness in a subsequent Change. - Add tests using the libraries in subsequent Change. Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04FIX: TCP perf testsTibor Frank1-0/+7
Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23CSIT-1009: SRv6 proxy testsJan Gelety3-1/+127
- SRv6 with endpoint to SR-unaware Service Function via static proxy - SRv6 with endpoint to SR-unaware Service Function via dynamic proxy - SRv6 with endpoint to SR-unaware Service Function via masquerading proxy Change-Id: I6a6062cb41d810bf9e27dacfd866181bfde4c693 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-20FIX: Restart VPP in container before each testPeter Mikus1-0/+2
Change-Id: Iec7045aadc0675e04b8c74cbe28f8b3f193bcf1f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-20FIX: Configure number of memif queus properlyPeter Mikus1-6/+6
Change-Id: I2dcb0300829bc961c80cc30d972d0563aeba9364 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-19FIX: Memif tests failingPeter Mikus1-1/+6
- CSIT-1049 Change-Id: I073c1e6d8cdda835fbb955cbf79e982bc2cc6228 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-11Cleanup perf bootstrapPeter Mikus1-16/+6
- Remove the DPDK_TEST variable and replace it by internal global variable - Unify all perf boostrap for merge in future. - Cleanup ligato perf bootstrap. Change-Id: Id47d6614c8dd18a701493e00056ef17d2e37fc5c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-10FIX: Crypto execution orderPeter Mikus1-5/+1
Currently, VAT history looks like this: sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up sw_interface_dump sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up sw_interface_add_del_address sw_if_index 2 192.168.10.1/24 sw_interface_add_del_address sw_if_index 1 172.168.1.1/24 ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40 ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9 ip_add_del_route 10.0.0.0/8 via 192.168.10.2 sw_if_index 2 resolve-attempts 10 count 1 exec exec /tmp/ipsec_create_tunnel_dut1.config It should be like this: sw_interface_add_del_address sw_if_index 2 192.168.10.1/24 sw_interface_add_del_address sw_if_index 1 172.168.1.1/24 ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40 ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9 ip_add_del_route 10.0.0.0/8 via 192.168.10.2 sw_if_index 2 resolve-attempts 10 count 1 exec exec /tmp/ipsec_create_tunnel_dut1.config sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up Change-Id: I4e943436dee00166966b4f53d9d0a40440bbf1e4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-30Change the default plugin behavior in perf testsPeter Mikus1-9/+9
Currently we are selectively disabling plugins by creating list of disabled plugins for performance tests. Thanks to the new API in VPP we can revert the logic to selectivly enable plugins. This is more stable for future onboarding of new plugins into VPP. Change-Id: Ibdd56d6097230d095a304bbb6984b565d9428f51 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-26Optimize Qemu installation to speed up vhost testsPeter Mikus1-16/+30
Currently Qemu is being installed if there is a change of qsz parameter between tests/suites. Qemu is installed always into the same directory. This patch changes the default behavior to install qemu over and install pathced version to separate directory. It also disables force install. Change-Id: I0d7493a02b026a6ae4a5ea8bacf54656de9db567 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-21CSIT-998: MRR testsJan Gelety1-2/+1
- CSIT-1001: MRR tests: IP4 - ip4 - 10ge2p1x520-ethip4-ip4base-copwhtlistbase-mrr.robot - 10ge2p1x520-ethip4-ip4base-iacldstbase-mrr.robot - 10ge2p1x520-ethip4-ip4base-ipolicemarkbase-mrr.robot - 10ge2p1x520-ethip4-ip4scale200k-mrr.robot - 10ge2p1x520-ethip4-ip4scale20k-mrr.robot - 10ge2p1x520-ethip4-ip4scale2m-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-nat44-mrr.robot - 10ge2p1x520-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot - 40ge2p1xl710-ethip4-ip4base-mrr.robot - ip4_tunnels - 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-ethip4vxlan-l2xcbase-mrr.robot - 10ge2p1x520-ethip4lispip4-ip4base-mrr.robot Change-Id: Ibfd03aea9b97d29a8fa05e2956f6df54603a2208 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-03-21Fix bug in dpdk-testpmd-mac KWTibor Frank1-6/+0
Change-Id: I6711e186062a72700552418eeee11b031e8c8ce4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-20Add max-pkt-len parameter to dpdk testpmd startTibor Frank1-61/+100
Change-Id: I114c187f007c10223502669c2ba85c63d09cd84a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-16Add vhost and memif MRR suitePeter Mikus1-0/+27
Change-Id: Iaded13af82383955c2ff093ddc96e09682d95776 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-08CSIT-989 Fix: Reflect latest memif API changesPeter Mikus1-12/+10
Change-Id: I0c9cb073a42a8b4b7e573023e784ab9e72d0ad55 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-27Performance KW optimizationsPeter Mikus2-6/+0
- Reducing test time by removing redundant KW. Change-Id: I03eeb0332cb88a11eff06df6f5e79d905df317a2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23Raw results chk keywords and initial TCPeter Mikus3-51/+124
- Implementation of Display raw results - Implementation of Traffic should pass with maximum rate - Code optimizations - L2BD, L2XC, IP4, IP6 TC Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23FIX: Qemu path overridePeter Mikus1-6/+6
Currently there is bug that Qemu path is not correctly composed and cannot be properly overriden due to race condition in code. This patch is fixing functions to properly work with path. Change-Id: I276458d2d23c7a14441a4de4a56eff6431242ab9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-09Disable all plugins except DPDK by defaultJan Gelety1-0/+21
- enable corresponding plugin for ACL, NAT, MEMIF tests Change-Id: Ie8bfdcbf1734283b6412ef3015215a00ce3ebdf6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-01-17CSIT-675: SRv6 performance testsJan Gelety3-13/+124
- update L1 KWs - update L2 KWs - tests with one SID (no SRH insertion) - tests with two SIDs (SRH inserted) and decapsulation - tests with two SIDs (SRH inserted) without decapsulation - enabled packet traces and logged packet traces in the test case tear down if test failed Change-Id: I3a0f4c350eed3f42509c6d49e832faa78fe64dbb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-01-16CSIT-898: WRK improvmentsTibor Frank1-0/+7
Change-Id: I92aafaaedce5891727a983b8cf024a0fb0db7524 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-01-10CSIT-866: wrk onboarding in CSITTibor Frank1-1/+53
- CSIT-867: Low Level Description - CSIT-868: wrk traffic profile - parsing - CSIT-869: wrk implementation into CSIT Change-Id: I65e1037f5ae05b3a5b2020e4a6c54462766ae1b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-01-02CSIT-870 Kubernetes/Ligato integrationPeter Mikus1-0/+26
- Update overall Kubernetes/Ligato integration - CSIT-871 Update infrastructure / images - CSIT-872 Update of KubernetesUtils.py Change-Id: I7833f56abd351c694d3d3e1c9c45e649aec892e1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-12-15CSIT-861: SW cryptodev perf testsJan Gelety1-3/+9
Change-Id: I687216ca43569542d38be681ca04c898010fc65d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-11-10CSIT-843: Update actual topology in case of new/updated/deleted interfaceJan Gelety1-0/+5
Change-Id: I6adfe86bd0b9cdf3d194a1b871e52481c333d8e7 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-23FIX: use correct IF name in Vpp Route Add in case of multi-VMs configJan Gelety1-4/+4
Change-Id: Iab5a6db1eac11798e2a3ec56f7d68043f6c8c2ab Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-19FIX: apply changes implemented for FIB settingsJan Gelety1-52/+64
Change-Id: I00c3407f4324e282c438cb8fcd44470c331089c5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-17FIX: Log MACIP ACL settings only if test failedJan Gelety1-1/+2
Change-Id: I6d51c662d8b23789adcd9c3d1b1e8736f71d5279 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-12CSIT-748 vnf-agent integrationPeter Mikus2-4/+1
CSIT-773 Implement RF keywords for k8s - Implementation of Test Suite Setup for Ligato vnf-agent testing - Implementation of KubernetesUtil for controlling kubectl - Yaml templates for L2XC topology with 1cswitch and 1cnf - Yaml templates for L2BD topology with 1cswitch and 1cnf - ligato bootstrap script for creating vnf-agent image Change-Id: Iebefde0eb984a27a0afcdf29fe549ca4edf8a61e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-11CSIT-778: Add mac-ip binding acl l2bd perf testJan Gelety2-58/+54
Change-Id: Iaced68458b0e4070f861be7854ee428ae8ca4e13 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-09CSIT-768: Refactor Python container librariesPeter Mikus2-7/+22
CSIT-769: Implement L2 RF keywords for container orchestration Change-Id: I7637d1ecc3a45111522b8d6c578b3f88369aff6b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-28FIX: Vhost tests waiting for VirtualEthernet UPPeter Mikus1-6/+0
Due to the change in VPP #8472 When changing the admin state of a vhost-user interface, do not put it in link-up mode if the interface is not actually ready. We have to remove "All Vpp Interfaces Ready Wait" for VirtualEthernet interfaces. Change-Id: I70d60b9f54a75b18b179f3315b636b763962acdd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-22CSIT-796: l2bd-memif perf testsJan Gelety1-2/+49
Change-Id: Ic714fa7baec49dcba1a8eb6a578183c6771e3493 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-08CSIT-665: Re-write L1 robot keywords in pythonDasa Simkova2-15/+19
Change-Id: Iddd823375ddd17b9abd5f02ee3aea3bfcb625149 Signed-off-by: Dasa Simkova <dspropagacie@gmail.com>