aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot/performance.robot
AgeCommit message (Collapse)AuthorFilesLines
2016-12-14vhost perf testing with Qemu 5t5pcpmikus1-12/+10
Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is not enough anymore as we are testing VPP with 4t4pc. This patch is supposed to increase the number of core used by testpmd. Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-16CSIT-470 Add option to configure CFS scheduler priority for QEMUpmikus1-0/+3
Add option to configure CFS scheduler priority for QEMU Change-Id: I76da7f536e70a23a57cf5215ab60002f95532b19 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-15Switch to nested image 1.5 in perfpmikus1-1/+1
Change-Id: I9116eac4a5377258b73b62214ca876161d9ef171 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-458 Use node aware config in all perf TCspmikus1-2/+2
- Use node aware config in all perf TCs Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-25CSIT-453: Switch Nested VM to 1.4 in perfpmikus1-6/+2
Currently in performance testing we are using Nested VM v1.3 with DPDK16.07. This patch will change the Nested VM to version 1.4 which includes DPDK16.09. Change-Id: I7cf2edda09f677ad9ddd3cc882000b9537bcc74c Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-17FIX: LISP performance 6o4 failingpmikus1-2/+2
Change-Id: I08cecbe8310fd21356287ffbb33c3be58b721f10 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-10Ipv6 TEST fixesMiroslav Miklus1-2/+2
- Increase interactive terminal timeout - ip6 heapsize - performance lib fix Change-Id: Iac6beb041200c4b0c5cf29dceb5113df64c6c9b0 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-03CSIT-416: Remove performance rate variablespmikus1-164/+0
Change-Id: I15ee953990f2ac11be361f3d0954bc12b3a9351d Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-21Measure latency returns -1 if rate<=10kppsMiroslav Miklus1-16/+17
Change-Id: I25dca3e6ce7da1304211d87f1af72fceda6dc23b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-408 sub-NDR latency measurementsMiroslav Miklus1-7/+63
- measure latency at 10% and 50% of found NDR. - fix the accuracy reported by T-REX (round to usec) Change-Id: I9fe2b5f942cb816db6fd0bb4262b48b8da6dac2f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-404 Adjust DPDK testpmd startup parameterspmikus1-8/+8
Change-Id: If0f58e725e15aa01b61bc43b222c6254af9cd07e Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-08CSIT-390 Replace rate calculation Ipmikus1-0/+1
- Replace static max rate variables by calculation of max rate based on nic limits Change-Id: I0f7f7e46c6f46f87dfa5f34b9b9fdb4610513081 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-25CSIT-275 IPv4 DP - QoS - performancepmikus1-0/+30
- Add libraries for DUT setup - Add test cases with various packet size and DUT startup setup Change-Id: I52a19f8e398f515cc231bb7190cd98299ca989ce Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-25CSIT-323 L2dp - Cross-connect - baseline vhost-userpmikus1-0/+26
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: Ie810ea06622ed8a37d3552f7bb8e38ebe9f04c2a Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-23CSIT-218 L2XC VXLANoIPv4 - performancepmikus1-0/+42
- Add libraries for DUT setup - Add test cases with various packet size and DUT startup setup Change-Id: I4839cdf37481975f9bd7cf22c806c061882066a3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-22CSIT-324 L2dp - Bridge domain - baseline vhost-userpmikus1-0/+33
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: Id0e508d50288d89b39bc5c321eeab0c908f3e2ba Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-22CSIT-366 IPv4dp - baseline vhost-userpmikus1-0/+172
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: I598e70221b939b2b08aa324d2c98059eee8b6857 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-18CSIT-200: Lisp performance testAndrej Kozemcak1-0/+250
Change-Id: I8a54b79ee03c2f5defc4eeba486086d793484668 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-17CSIT-312 VPP vhost-user - VPP vhost-user driver, virtio in VMpmikus1-0/+125
- Add libraries and keywords to control Qemu VM and VMapp Change-Id: Iaaedfe240afe394f507ccaf0cf7a77c8b863acd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-10CSIT-321 L2 Cross-connect - baseline - NIC-to-NIC(XL710)Miroslav Miklus1-46/+22
Change-Id: I0c78d17242eedbfa573f1e2c20dc491a71b8dd4a Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-08-03CSIT-213 IPv6 iACL - performancepmikus1-0/+20
- create topology with Classify iACL white-list applied on interfaces using IPv6 in 3-node topology - create ipv6_iacl test cases (78B, 1518B, 9000B) Change-Id: Idae635e6a45b52086515fea33a38112209975e8a Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-01CSIT-179 IPv6 Scale - performancepmikus1-0/+40
- Add libraries for ipv6 scale setup - Add test cases for testing 10k/100k/1M fib entries - Add t-rex profiles for large scale testing Change-Id: I4260405c960afe659db7e0764a68a87b9e8de0b2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-28CSIT-169 IPv4 Scale - performancepmikus1-0/+42
- Add libraries for ipv4 scale setup - Add test cases for testing 10k/100k/1M fib entries - Add t-rex profiles for large scale testing Change-Id: If085e0d834e5ffe5538ba76756e8b9d0e8255cb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-28CSIT-136 IMIX T-REX driverMiroslav Miklus1-0/+22
Change-Id: Ife7c543d07bcac4bad82894eea0f4e0e5a8db4bb Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-07-26CSIT-106 Vpp config - use only test-related interfacesMiroslav Miklus1-4/+8
Current behaviour is to add all interfaces from topology, we only want to add interfaces from computed path. Change-Id: I9c5d4e765dbe399ee06dd13f0d25c48d3d8e5127 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-07-22PATCH: Fix add ip neigbour in IPV6 librariespmikus1-8/+4
- fix vrf key error for IPv6 performance library Change-Id: I3b80d350b3a524bcdea76012c717edbecff9c154 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-20CSIT-215 Improve documentation - performancepmikus1-1/+0
- Improve documentation in performance libraries Change-Id: Idf3d8e5f0107de78776c955259b31f0e41e04585 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-19CSIT-215 Improve documentation - performancepmikus1-131/+275
- Improve documentation in performance libraries Change-Id: I66e5b0782497c5759c737556f207cf2fd3383923 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-19CSIT-102: Add latency measurement to performance testingPeter Mikus1-10/+27
- Add latency stream as a background stream in both directions - Latency background stream is not using the VM transformation engine. Raw stream with single packet is created. - Latency background stream has 1kpps rate with packet of same size as traffic stream. - Display latency values (min/avg/max) in results of TC and reporting remaining data including histogram and jitter inside of the search/pass keyword. Change-Id: I78ce4659b57caab08d5729f51a1e14d518fd3273 Signed-off-by: Peter Mikus <pmikus@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-13CSIT-60: Create l2-vlan-dot1ad libraries for perf testingPeter Mikus1-52/+69
- create topology with VLAN dot1ad sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1ad test cases (64B, 1514B, 9000B) Change-Id: Ib25d5e8f09fb83d80596982608e93b1e511e8b8e Signed-off-by: Peter Mikus <pmikus@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-11TB2 XL710 topology filesMiroslav Miklus1-0/+15
JIRA: CSIT-106 Change-Id: If3e76d971c7196da3f83a8daacd1308c6374c786 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-302-node topology keywordsMiroslav Miklus1-1/+70
JIRA: CSIT-182 Change-Id: I593c2d6b0e7a1ee344b879f7b54bb9443ab8c516 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-28TG init changes for n-node topologyMiroslav Miklus1-4/+4
JIRA: CSIT-182 For TG node we only need to know the interfaces on TG node and the adjecent nodes interfaces for any n-node topology. Change-Id: I0129b9513356df976364b58e6749dfab3ca5e2ae Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-28PATCH: Fix MAC address variables in perf librariespmikus1-4/+2
Change-Id: I0f7b51349d2323bd501f6d6ae75474cc225e94bb Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-14CSIT-163: Add show vpp version verbosepmikus1-0/+2
- Add output of vpp version verbose Change-Id: Ia74b97be4636d55b115246d495a5d6eea0a94bb7 Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-26Find PDR using binary searchPeter Mikus1-4/+292
- JIRA: CSIT-72 - modify libraries for PDR search evaluation - write robot framework keywords for PDR search - write Performance Test Cases using PDR Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Patch: Set duration of performance long tests to 10sPeter Mikus1-3/+3
- JIRA: CSIT-77 Decrease duration time from 60 second to 10 second for all long performance tests. This patch is preparation for replacement of linear search for binary search. Change-Id: I61fbec1dcaca73ba383690e695c3030d182a90f9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Replace linear search with binary searchPeter Mikus1-0/+36
- JIRA: CSIT-97 - Replace linear search with binary search for long performance testing Change-Id: I19cbcf3d9f7f5e6ec5128287b58a2ea3aceff00c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Add test cases with "dpdk no-multi-seg" in vpp startup configPeter Mikus1-2/+2
- JIRA: CSIT-73 - Add ability to configure no-multi-seg parameter in VPP startup configuration - Add keywords to selectively configure parameters in startup configuration - Modify testcases Change-Id: I3c5c0a1cc2b1156d5a87ff36628b50793dd9ac5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Capture VPP stats for Long and Short testsMiroslav Miklus1-12/+18
JIRA: CSIT-71 - remove warmup for short runs - clear and collect stats for short run - run short test with no failure for long test with NDR/PDR rate Change-Id: I1b8879c3b891165072822207d0781687d8159336 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-23Performance l2-vlan-dot1q library and short/long test casespmikus1-0/+10
- JIRA: CSIT-59 - create topology with VLAN dot1q sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1q test cases (64B, 1518B, 9000B) Change-Id: Ic5f31b4451965bb7f5d3d5b7061c6600f63da898 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-18T-REX stl traffic send improvement for async callsMiroslav Miklus1-6/+25
JIRA: CSIT-68 - show runtime statistics with running traffic - T-REX driver async. driver Change-Id: Ie5eb7021f610fb58383b033dda5b1b867f7d3d2c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-11Performance IPv6 library and short/long test casespmikus1-4/+32
- JIRA: CSIT-2 - Create IPv6 test cases for long/short/singlethread/multithread performance testing - Create robot KWs for IPv6 performance testing - Add T-Rex IPv6 profile Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-03Patch to reset default VPP configuration in perf.pmikus1-1/+5
- JIRA: CSIT-57 - fix situation when vpp startup configuration is replaced by default with no interface configuration Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-26Extend host topology with NIC type filteringMiroslav Miklus1-0/+37
JIRA: CSIT-1 Changes to allow filtering based on NIC model. Switched xconnect perf test to use filtered topology. Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-22Reformat python libraries.Matej Klotton1-1/+1
PEP8 reformat fix typos docstrings reformat Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-15Change the performance result messagepmikus1-6/+21
- change the result message of performance search to more verbose level (rate per stream, rate total, throughput in Gbps) Change-Id: I7562d6d33c525654131c75ebcc776cba438f68f4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-11Combined DropRateSearchpmikus1-0/+24
- combined search algorithm using linear and binary search - add KWs into performance library for binary and combined search - remove short_bridge_domain_binary.robot as binary and combined search KWs are in library for optional use - PEP8 fixes Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-01Long perf testspmikus1-0/+72
- added new long tests for ipv4 and xconnect - modified long bridge domain test - added 64B, 1518B and 9000B frame sizes Change-Id: I88f75c375345f2d708df3fd24dd50d77bc63c495 Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-07Performance suite reorg, v4 testsMiroslav Miklus1-0/+37
- perf suite splitted to 1.xconnect 2.bridge-domain 3.IPv4 - IPv4 perf tests implemented - renamed perf tests prefix 2core -> 1core Change-Id: I9ef2dbdfcfdcb36e8865989e6255d69ced33269c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>