aboutsummaryrefslogtreecommitdiffstats
path: root/tests/suites/performance
AgeCommit message (Collapse)AuthorFilesLines
2016-06-02IPv6 COP - performancePeter Mikus2-0/+761
- JIRA: CSIT-109 - create topology with COP white-list applied on interfaces using IPv6 in 3-node topology - create necessary keywords to be used in test cases - create ipv6_cop test cases (78B, 1518B, 9000B) Change-Id: I2618971610f066b847c00e1ea18dc396555a9923 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-06-02IPv4 COP - performancePeter Mikus2-0/+766
- JIRA: CSIT-105 - create topology with COP white-list applied on interfaces using IPv4 in 3-node topology - create necessary keywords to be used in test cases - create ipv4_cop test cases (64B, 1518B, 9000B) Change-Id: I0aeaaf3c295e9691f99fc2e03c57f67e7d568ed4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-26Find PDR using binary searchPeter Mikus10-129/+1280
- JIRA: CSIT-72 - modify libraries for PDR search evaluation - write robot framework keywords for PDR search - write Performance Test Cases using PDR Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-25Patch: Remove show stats keyword from teardown phasePeter Mikus10-20/+10
- JIRA: CSIT-104 - Remove duplicity of showing stats - Remove "Show statistics on all DUTs" from "Test Teardown" Change-Id: Ic8e913396144c1ee50e878d9b0f85dffceee5287 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Replace linear search with binary searchPeter Mikus5-475/+457
- JIRA: CSIT-97 - Replace linear search with binary search for long performance testing Change-Id: I19cbcf3d9f7f5e6ec5128287b58a2ea3aceff00c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Add test cases with "dpdk no-multi-seg" in vpp startup configPeter Mikus10-371/+636
- JIRA: CSIT-73 - Add ability to configure no-multi-seg parameter in VPP startup configuration - Add keywords to selectively configure parameters in startup configuration - Modify testcases Change-Id: I3c5c0a1cc2b1156d5a87ff36628b50793dd9ac5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Performance l2-vlan-dot1q library and short/long test casespmikus2-0/+506
- JIRA: CSIT-59 - create topology with VLAN dot1q sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1q test cases (64B, 1518B, 9000B) Change-Id: Ic5f31b4451965bb7f5d3d5b7061c6600f63da898 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-18Explicitly list the NIC type for perf testsMiroslav Miklus8-7/+22
JIRA: CSIT-74 - FIX test names - list NICs Change-Id: Ic5dba9381b7bf7129cb0944deb33a86ccdbf2c7b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-11Performance IPv6 library and short/long test casespmikus2-0/+352
- JIRA: CSIT-2 - Create IPv6 test cases for long/short/singlethread/multithread performance testing - Create robot KWs for IPv6 performance testing - Add T-Rex IPv6 profile Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Extend ranges of binary search in ipv4 perf testingPeter Mikus1-5/+5
- Extend ranges of binary search in Long IPv4 testing to reflect the performance variability Change-Id: I7632bbda361cb278be0776ec31461554297fe852 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-04Update T-rex version to v2.00pmikus3-60/+60
- JIRA: CSIT-14 - Update T-rex version to v2.00 with latest API - Compatibility fixes of affected libraries and robot files - T-rex performance tuning Change-Id: I3a90553032d6d82e6e03df7e0b52e205d3f6ba4e Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-03Patch to reset default VPP configuration in perf.pmikus6-12/+6
- JIRA: CSIT-57 - fix situation when vpp startup configuration is replaced by default with no interface configuration Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39 Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-02Topo installation script fixMiroslav Miklus2-9/+9
-more logging -use single SSH instance -dpkg --force-all -update referece vpp version and reference short test threshold Change-Id: Ie67633755f451dba9d6a3ee1fc431d2c3f3b506f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-26Extend host topology with NIC type filteringMiroslav Miklus1-1/+3
JIRA: CSIT-1 Changes to allow filtering based on NIC model. Switched xconnect perf test to use filtered topology. Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-22Performance test casespmikus6-127/+443
- JIRA: CSIT-10 - Add 1518B and 9000B test for multicore tests - Fine tune threshold for short tests based on previous benchmarks - Fix SI units Change-Id: I5c4657dfd881a24b2e40c91ea80a979003754258 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-17Multicore VPP setup for performance testingpmikus6-74/+455
- add multithread TAGS documentation - add methods to VppConfigGenerator for RSS configuration - create KW for multithread setup - create sample test case using multithread vpp setup - add Documentation into TCs Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-13documentation: long_xconnect test suite documentationMiroslav Miklus1-1/+16
Generate testdoc by using: python -m robot.testdoc long_xconnect.robot perf_long_xconnect.html Change-Id: I12d83de4abb1af4d94e6fd78d05c46018ee5d7d7 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-11Combined DropRateSearchpmikus1-65/+0
- combined search algorithm using linear and binary search - add KWs into performance library for binary and combined search - remove short_bridge_domain_binary.robot as binary and combined search KWs are in library for optional use - PEP8 fixes Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-01Long perf testspmikus6-170/+175
- added new long tests for ipv4 and xconnect - modified long bridge domain test - added 64B, 1518B and 9000B frame sizes Change-Id: I88f75c375345f2d708df3fd24dd50d77bc63c495 Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-24Binary DropRateSearchpmikus1-0/+65
- binary search - short perf bridge_domain with binary Change-Id: I50538738b356cc8fef4cfcb4974c43c5123827d1 Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-17DropRateSearch libraryMiroslav Miklus4-6/+72
- linear search - t-rex DropRateSearch implementation - long perf bridge_domain test - introduced PERFORMANCE_SHORT, PERFORMANCE_LONG test tags Change-Id: I497b72f3e6d58a67ca5a386403d1e84dcf433ec4 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-03-07Performance suite reorg, v4 testsMiroslav Miklus4-117/+221
- perf suite splitted to 1.xconnect 2.bridge-domain 3.IPv4 - IPv4 perf tests implemented - renamed perf tests prefix 2core -> 1core Change-Id: I9ef2dbdfcfdcb36e8865989e6255d69ced33269c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-26T-REX: startup config generationMiroslav Miklus1-1/+1
- T-rex startup config generated based on computed path - move t-rex tooling to t-rex directory Change-Id: I3ac698f41f98934bcce4af35dc3a755a8948e887 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-25Performance suite: introduced suite variablesMiroslav Miklus1-26/+28
- perf suite variables - T-REX setup fix Change-Id: I608581e45d0e5f80e8f75c2a07c994bf0e0d0df3 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-22performance tests: 2core, test teardown, remove UDP headerMiroslav Miklus1-7/+10
- testing on 2 core VPP - show statistics only if test fails - remove UDP header from packet Change-Id: I5b47330a0bbc4602e8e8eb19fcc481a7635bd2a5 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-19Add hw/vm tags, add single link tag.Stefan Kobza1-1/+1
Add HW_EVN and VM_ENV tags to specify limitations on where the given test could be run. For tests that should be run only on bare metal, author of the test should add tag HW_ENV to it. Add 3_NODE_SINGLE_LINK_TOPO tag, to specify requirement on topology, where only one link is required in between any two nodes in the topology. Change-Id: I38c9a9732cad608bb6a9e4a2c5f1997236cd48b9 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-02-19Performance suite: xconnect fix, show commandsMiroslav Miklus1-7/+25
- adjust L2 xconnect to changed xconnect library - show [interface stats, hardware, errors, runtime] Change-Id: I9dffebdd0abbde5107c6dc926210ba725e1e039c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-19T-REX: change relative rate values to absolute unitsMiroslav Miklus1-36/+31
Instead of using realative values expressed in percentage of linerate rather use absolute values to assure consistency of results across NICs with various speeds (10G, 40G, 100G, ...) Change-Id: Ifd455d823e80002c277deaf8cb8295c81b59bf4a Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-17Test VIRL connection.Stefan Kobza1-1/+1
Change-Id: I812ff9c8c9669b63907469c643c839e8bd3b419a Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-02-12Last bulk update of CSIT.Stefan Kobza1-13/+71
Change-Id: I815e4d54e74a49fd19a9927554ce5c37a2719f7e Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-02-08New version of RF tests.Stefan Kobza1-0/+41
Change-Id: I241a2b7a7706e65f71cfd4a62e2a40f053fc5d07 Signed-off-by: Stefan Kobza <skobza@cisco.com>