aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-05-30Add DHCP Client libs and VPP sends DHCPv4 Discover testMatej Klotton5-0/+299
-JIRA: CSIT-100 Change-Id: I4b6fc5d974ebe500d6c6bc74c14e1db7b3d10c3a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-30Update Honeycomb testsselias7-30/+63
- add new test cases based on reported bugs - minor fixes Change-Id: I8b7464bc1f4e786e3a0ef67ba64d81e1c25ae5cf Signed-off-by: selias <samelias@cisco.com>
2016-05-26Find PDR using binary searchPeter Mikus15-139/+1692
- JIRA: CSIT-72 - modify libraries for PDR search evaluation - write robot framework keywords for PDR search - write Performance Test Cases using PDR Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-26Rename topology files with correct NIC namesMiroslav Miklus4-3/+3
JIRA: CSIT-106 Change-Id: I3bb33d0025c99f1cf0defe542a86f0d620b80730 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-25Patch: Remove show stats keyword from teardown phasePeter Mikus10-20/+10
- JIRA: CSIT-104 - Remove duplicity of showing stats - Remove "Show statistics on all DUTs" from "Test Teardown" Change-Id: Ic8e913396144c1ee50e878d9b0f85dffceee5287 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Patch: Set duration of performance long tests to 10sPeter Mikus1-3/+3
- JIRA: CSIT-77 Decrease duration time from 60 second to 10 second for all long performance tests. This patch is preparation for replacement of linear search for binary search. Change-Id: I61fbec1dcaca73ba383690e695c3030d182a90f9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Replace linear search with binary searchPeter Mikus6-475/+493
- JIRA: CSIT-97 - Replace linear search with binary search for long performance testing Change-Id: I19cbcf3d9f7f5e6ec5128287b58a2ea3aceff00c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Add test cases with "dpdk no-multi-seg" in vpp startup configPeter Mikus13-392/+751
- JIRA: CSIT-73 - Add ability to configure no-multi-seg parameter in VPP startup configuration - Add keywords to selectively configure parameters in startup configuration - Modify testcases Change-Id: I3c5c0a1cc2b1156d5a87ff36628b50793dd9ac5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Add temporary fix for CSIT-90 by flushing QGA's input bufferCarsten Koester1-0/+16
This is not a final fix. The final fix SHOULD send a "guest-sync" request as per" http://wiki.qemu.org/Features/QAPI/GuestAgent#QEMU_Guest_Agent_Protocol However, this temporary fix will eliminate the nested VM startup failures triggered by the nested VM's guest-agent receiving a partial guest-ping request. Change-Id: Ice409b7c966a527b03cb71c042b476e1771676d0 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-05-23Capture VPP stats for Long and Short testsMiroslav Miklus6-23/+79
JIRA: CSIT-71 - remove warmup for short runs - clear and collect stats for short run - run short test with no failure for long test with NDR/PDR rate Change-Id: I1b8879c3b891165072822207d0781687d8159336 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-23Patch: Start binary search from max range ratePeter Mikus1-7/+13
- JIRA: CSIT-96 - Add option to start binary search with max range rate value first and then continue the binary search of half interval. Change-Id: Ia6d2f4aa6fc20ca2ee4d43d0ddb3966422b28144 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Performance l2-vlan-dot1q library and short/long test casespmikus6-2/+560
- JIRA: CSIT-59 - create topology with VLAN dot1q sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1q test cases (64B, 1518B, 9000B) Change-Id: Ic5f31b4451965bb7f5d3d5b7061c6600f63da898 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-22TB3 topology file with X520-DA2 NICsMiroslav Miklus2-1/+65
JIRA: CSIT-8 Change-Id: I95baf116cfcde85fdbaaaac079f27c898a959f58 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-20VPP in host user-mode, part IIZdeno Olsovsky5-44/+305
- JIRA: CSIT-61 Change-Id: I688b1013a78a1fa3ecdb44c2072f8bd1b46364fb Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-05-20Add Honeycomb TAP interface testselias9-13/+277
JIRA: CSIT-75 - add test suite for TAP interface management through Honeycomb - add keywords required for TAP interface tests - move Honeycomb suite setup and teardown to new __init__ file - cleanup unused imports in Honeycomb test case files - modify "...should be empty" keywords to allow more reuse Change-Id: Ie3dc9069678b60c359f69c5a216e452e856a0107 Signed-off-by: selias <samelias@cisco.com>
2016-05-20Tests for vhost-user interface configurationTibor Frank5-0/+366
JIRA: CSIT-76 - add tests for vhost-user interface manipulation: - create, modify, delete - add negative tests: - wrong interface type - wrong configuration Change-Id: I09239ef099a6f9672895f9540762e5044123f7ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-19TB1 topology file with X520-DA2 NICs onlyMiroslav Miklus2-1/+66
JIRA: CSIT-8 Change-Id: I9c4d5d5502ed6e387a93e545c30278618a14a7fc Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-19Parse robot output.xml for performance reportingpmikus2-0/+178
- JIRA: CSIT-58 - parse robot framework output.xml file - find performance related data - write formatted json to specified file - copy archive artifact to directory Change-Id: I47e45bcb68c06044a23192cb1fca46f43782941e Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-18T-REX stl traffic send improvement for async callsMiroslav Miklus8-116/+325
JIRA: CSIT-68 - show runtime statistics with running traffic - T-REX driver async. driver Change-Id: Ie5eb7021f610fb58383b033dda5b1b867f7d3d2c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-18PERF bootstrap, apply global PYBOT args to all test typesMiroslav Miklus1-6/+12
Change-Id: Ia51a437d03e33df8e27da0afc099f808e255937c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-18Explicitly list the NIC type for perf testsMiroslav Miklus9-11/+26
JIRA: CSIT-74 - FIX test names - list NICs Change-Id: Ic5dba9381b7bf7129cb0944deb33a86ccdbf2c7b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-18Patch: Detection of running t-rex instance before initializingPeter Mikus1-0/+3
- JIRA: CSIT-89 - Add detection of running t-rex traffic generator before new instance is initialized. Change-Id: I77009b0c5e83bb6e162b9800d02b4e5a2abd541f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-16Update vpp stable build used in csit-vpp-verify-weekly jenkins jobJan Gelety1-1/+1
- vpp build version updated to release 1.0.0-451~g686a5a5_amd64 Change-Id: Ic7d177d72a6d50c083d5b9733c8f63298eebd7c6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-16Add IPsec traffic scriptMatus Fabian1-0/+208
JIRA: CSIT-28 Change-Id: Iaebea917ade85965b0dbaf35d58ea1ee14d76e3f Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-05-16CIMANAGE-5: update bootstrap for csit-vpp-verify-weekly jobJan Gelety1-3/+8
- file rename - usage of vpp-verified build Change-Id: I61b7ef4121d02149cf5b24514176b375e660b2ae Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-16Add VIRL host selection mechanism to bootstrapCarsten Koester1-12/+52
Add a mechanism to the bootstrap script that allows it to select one out of multiple candidate VIRL hosts. In addition, fix a few cosmetic issues wrt. connecting to the VIRL host: * Use consistent set of SSH options * Consistently use constant instead of hardcoded key filename * Use relative path names for start-/stop-testcase scripts Change-Id: I0d2972f170de82dd5d98da88656f5f962fca2415 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-05-16Add Honeycomb VxLAN test suiteselias6-77/+302
JIRA: CSIT-47 - add test suite for VxLAN management through Honeycomb - add keywords required for VxLAN management tests - add resource file with additional variables for testing - increment bridge domain test suite index Change-Id: Ica0d7ae15f5b7058832a944d5ca0c72026ba299c Signed-off-by: selias <samelias@cisco.com>
2016-05-16CSIT-18: Add GRE tunnel libraries and tests.Matej Klotton7-2/+465
Change-Id: I91ccd65a26ea1782611bccc3badd91e64366a162 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-16Update Honeycomb bridge domain testsselias2-12/+22
- fix interface assignment verification through VAT - add verification of split horizon group setting through VAT - clean up documentation of high level bridge domain keywords Change-Id: I7552494d68c6bbc86d3e5ddea4e29c6a7444d50c Signed-off-by: selias <samelias@cisco.com>
2016-05-16Add keyword to manipulate vhost-user parametersTibor Frank1-0/+68
JIRA: CSIT-70 - add a keyword to be able to: - configure all vhost-user parameters at once - configure vhost-user parameters one by one - remove a vhost-user parameter - remove all vhost-user parameters at once - add a keyword which adds a new vhost-user interface Change-Id: I144bc035b959a1e4eb37c6a3d554e6843ddab4a7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-13CSIT-65: Add new test for LISP APIAndrej Kozemcak16-0/+1116
Test set and unset this API: lisp_add_del_locator_set lisp_add_del_locator lisp_add_del_local_eid lisp_add_del_map_resolver lisp_gpe_add_del_iface Change-Id: I9c701fc421d4106147891a7e75e5d68885b9ba59 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
2016-05-13Add keyword to manipulate interface TAP parametersTibor Frank1-0/+67
JIRA: CSIT-69 - add a keyword to be able to: - configure all TAP parameters at once - configure TAP parameters one by one - remove a TAP parameter - remove all TAP parameters at once - add a keyword which adds a new TAP interface Change-Id: I5620adc3f777f7a337bbd737e685891b425d4e09 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-13Add possibility to create a VxLAN interface.Tibor Frank3-13/+86
JIRA: CSIT-51 - add a keyword which adds a new VxLAN interface - change InterfaceUtil.vxlan_dump to be able to return info about all VxLAN interfaces. Change-Id: I8ad3dc1d414924e74ea1ecea1f316ca5c648e2d0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-12Add possibility to change VxLAN parameters at onceTibor Frank1-12/+20
JIRA: CSIT-51 - modify existing keyword "configure_interface_vxlan" to be able to: - configure all VxLAN parameters at once - configure VxLAN parameters one by one - remove a parameter - remove all parameters at once Change-Id: I50551fbc3ae5c6aa147d531fc66b583af36bb541 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-12Update of vpp build for perf testsMiroslav Miklus1-1/+1
build: 1.0.0-437~g8f15e92_amd64 Change-Id: Ie0d0f693bcae0d0e56472c25b6353890d07e85d9 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-12Update Honeycomb interface IPv4 testselias4-28/+69
- add verification of ipv4 subnet prefix support - modify keywords to allow setting ipv4 address with network prefix - fix variable definitions to evaluate numbers as ints, not strings - add exception to ipv4 netmask/prefix conversion method Change-Id: I9343ceb35856ddb33674d7067f1def6d40e99acc Signed-off-by: selias <samelias@cisco.com>
2016-05-12Add functions to get interface name or index from JSON interface dump.Matej Klotton2-0/+76
Change-Id: I4778c9fa72e418f6fea427f88fd9aa1ea579ac99 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-11Add library for set path variables for testing.Matej Klotton16-622/+483
Change-Id: Icb243bacc9329c4bf3bc28098fced473b4e3c991 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-11Performance IPv6 library and short/long test casespmikus8-14/+539
- JIRA: CSIT-2 - Create IPv6 test cases for long/short/singlethread/multithread performance testing - Create robot KWs for IPv6 performance testing - Add T-Rex IPv6 profile Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Extend ranges of binary search in ipv4 perf testingPeter Mikus1-5/+5
- Extend ranges of binary search in Long IPv4 testing to reflect the performance variability Change-Id: I7632bbda361cb278be0776ec31461554297fe852 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Move Honeycomb libraries to honeycomb subdirectory.Tibor Frank8-22/+40
- move all Honeycomb related libraries written in python to new directory resources/libraries/python/honeycomb - update all related includes in all source files Change-Id: Ifa96b8f670b456b14421929d6020ddf8e02d9cbc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-11Add iACL IPv4/IPv6 tests.Patrik Hrnciar11-2/+523
- IPv4: CSIT-15 - IPv6: CSIT-16 Change-Id: I6e66aa853dfaebf1388f1191dbb63f5216820325 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-05-11Add Max TX Queues configuration to VppConfigGeneratorpmikus1-1/+44
- Add ability to configure max-tx-queus parameter in VPP startup configuration Change-Id: Iaf857ed037c934fbda46eda6bfe1be4ef7faba15 Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-09CSIT-9: COP Whitelist/blacklistZdeno12-3/+633
- Included are also IPv6 tests - JIRA: CSIT-17 Change-Id: I89ae6c38cdc6742a597c0dc24ed1c033c1b5d155 Signed-off-by: Zdeno <zolsovsk@cisco.com>
2016-05-09CSIT-19: MAC split-horizon groupJan Gelety3-4/+126
- test case to test MAC split-horizon group functionality Change-Id: Iadee707f3670e5fc9c209bd8b072a65ea1af27cd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-09Add Honeycomb bridge domain management testsselias3-1/+285
JIRA: CSIT-41, CSIT-42, CSIT-43 - add test cases for Honecomb bridge domain management - add keywords used by these tests - prefix the names of Honeycomb test suites with numbers, so that they execute in a specific order - moved suite teardown with "Stop Honeycomb service" to bridge domain suite Note: Due to time constraints, the Honeycomb service cannot be restarted between executions of individual Honeycomb test suites. Therefore Honeycomb will be setup in the first test suite and shut down after the last one. Change-Id: I36b7f8335e5ba54985da5bd83730cf856d5ab48b Signed-off-by: selias <samelias@cisco.com>
2016-05-09QEMU VM guest-ping fixMatus Fabian1-1/+4
JIRA: CSIT-62 Change-Id: I0affda16af8f983895c50fbc306f45f30fbb69cd Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-05-09Interface VxLAN testTibor Frank4-0/+105
JIRA: CSIT-45 - add test: Honeycomb modifies interface configuration - VxLAN - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured VxLAN - fixed requirements.txt Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-05-08LF2 testbed topology fileMiroslav Miklus1-10/+182
Change-Id: I7c465a057640782219a8eb3b4c131d2d8edfcadc Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-06Add Honeycomb interface management tests (ipv4, ipv6, ethernet, routing)selias6-35/+380
- add test cases for managing ipv4, ipv6, ethernet and routing configuration on VPP interface - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured IP addresses - add method for converting between ipv4 netmasks and network prefixes - clean up documentation of older Honeycomb keywords Note: Test cases are tagged with a placeholder tag to allow manual test runs locally. It should be replaced with the appropriate environment tags once Honeycomb service is deployed on virl. Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78 Signed-off-by: selias <samelias@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>