aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-06-01Add Honeycomb sub-interface and VLAN testsTibor Frank7-8/+1024
JIRA: CSIT-94 JIRA: CSIT-48 - add Honeycomb sub-interface tests - add Honeycomb VLAN tests - add keywords for sub-interface tests - add keywords for VLAN tests Change-Id: I89cd3b41dd9c60bfd946e24567d0ff93e5ea9fff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-06-01CSIT-125: Add test for lisp remote static mappingAndrej Kozemcak10-7/+504
Test Lisp functionality and rename lisp file Testing this topology: - IPv4 lisp topology - IPv6 lisp topology - IPv4 over IPv6 - IPv6 over IPv4 Change-Id: Ie3439ca802f1c8ae82a1dfcfdebe579f9dc47089 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
2016-05-31CSIT-23 Add ARP request test.Patrik Hrnciar3-20/+241
Change-Id: Ibb48e6d84efc55f7fb656283a954fbaefc7154e7 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-05-31CIMANAGE-7: Bootstrap for csit-vpp-master-verify-semiweekly jobJan Gelety2-1/+430
- run func and perf_long tests in three test loops - updated REPO in /resources/tools/download_install_vpp_pkgs.sh Change-Id: Iff459b7719380404a242c80821806a9450271adf Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-31Sample test suite for vpp sample plugin (macswap)Miroslav Miklus5-0/+195
JIRA: CSIT-123 Change-Id: I4774ddf3a2f67c322fe27e5f9d366f508156e70f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-31CSIT-98: MAC split-horizon group, part IIJan Gelety3-18/+336
- test cases to test MAC split-horizon group functionality together with VXLAN tunnel over IPv4 and over IPv6 - two IPv6 tests tagged EXPECTED_FAILING until VPP-98 is closed - added update of bootstrap.sh - vpp build updated to version 16.09-rc0~33-g4b46c84~b200_amd64 Change-Id: I1da6a98b11f5c39cd114abb35bb8f398cbbebf63 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-31PATCH: Return pybot exit code in bootstrap-verify-perfPeter Mikus1-0/+13
- Return exit code from pybot instead of last command in bootstrap file. Change-Id: If8430426d7259c832c0ea78d2d165d09f8c4eda7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-31Remove obsolete boostrap-hw-tb2Peter Mikus1-30/+0
- Remove obsolete bootstrap-hw-tb2 as it was replaced by bootstrap-verify-perf and ci-management is updated. Change-Id: I23cfb5bcc4b3c1bede456936c978ec5428bba373 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-30Add DHCP Client libs and VPP sends DHCPv4 Discover testMatej Klotton5-0/+299
-JIRA: CSIT-100 Change-Id: I4b6fc5d974ebe500d6c6bc74c14e1db7b3d10c3a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-30Update Honeycomb testsselias7-30/+63
- add new test cases based on reported bugs - minor fixes Change-Id: I8b7464bc1f4e786e3a0ef67ba64d81e1c25ae5cf Signed-off-by: selias <samelias@cisco.com>
2016-05-26Find PDR using binary searchPeter Mikus15-139/+1692
- JIRA: CSIT-72 - modify libraries for PDR search evaluation - write robot framework keywords for PDR search - write Performance Test Cases using PDR Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-26Rename topology files with correct NIC namesMiroslav Miklus4-3/+3
JIRA: CSIT-106 Change-Id: I3bb33d0025c99f1cf0defe542a86f0d620b80730 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-25Patch: Remove show stats keyword from teardown phasePeter Mikus10-20/+10
- JIRA: CSIT-104 - Remove duplicity of showing stats - Remove "Show statistics on all DUTs" from "Test Teardown" Change-Id: Ic8e913396144c1ee50e878d9b0f85dffceee5287 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Patch: Set duration of performance long tests to 10sPeter Mikus1-3/+3
- JIRA: CSIT-77 Decrease duration time from 60 second to 10 second for all long performance tests. This patch is preparation for replacement of linear search for binary search. Change-Id: I61fbec1dcaca73ba383690e695c3030d182a90f9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Replace linear search with binary searchPeter Mikus6-475/+493
- JIRA: CSIT-97 - Replace linear search with binary search for long performance testing Change-Id: I19cbcf3d9f7f5e6ec5128287b58a2ea3aceff00c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Add test cases with "dpdk no-multi-seg" in vpp startup configPeter Mikus13-392/+751
- JIRA: CSIT-73 - Add ability to configure no-multi-seg parameter in VPP startup configuration - Add keywords to selectively configure parameters in startup configuration - Modify testcases Change-Id: I3c5c0a1cc2b1156d5a87ff36628b50793dd9ac5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Add temporary fix for CSIT-90 by flushing QGA's input bufferCarsten Koester1-0/+16
This is not a final fix. The final fix SHOULD send a "guest-sync" request as per" http://wiki.qemu.org/Features/QAPI/GuestAgent#QEMU_Guest_Agent_Protocol However, this temporary fix will eliminate the nested VM startup failures triggered by the nested VM's guest-agent receiving a partial guest-ping request. Change-Id: Ice409b7c966a527b03cb71c042b476e1771676d0 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-05-23Capture VPP stats for Long and Short testsMiroslav Miklus6-23/+79
JIRA: CSIT-71 - remove warmup for short runs - clear and collect stats for short run - run short test with no failure for long test with NDR/PDR rate Change-Id: I1b8879c3b891165072822207d0781687d8159336 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-23Patch: Start binary search from max range ratePeter Mikus1-7/+13
- JIRA: CSIT-96 - Add option to start binary search with max range rate value first and then continue the binary search of half interval. Change-Id: Ia6d2f4aa6fc20ca2ee4d43d0ddb3966422b28144 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Performance l2-vlan-dot1q library and short/long test casespmikus6-2/+560
- JIRA: CSIT-59 - create topology with VLAN dot1q sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1q test cases (64B, 1518B, 9000B) Change-Id: Ic5f31b4451965bb7f5d3d5b7061c6600f63da898 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-22TB3 topology file with X520-DA2 NICsMiroslav Miklus2-1/+65
JIRA: CSIT-8 Change-Id: I95baf116cfcde85fdbaaaac079f27c898a959f58 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-20VPP in host user-mode, part IIZdeno Olsovsky5-44/+305
- JIRA: CSIT-61 Change-Id: I688b1013a78a1fa3ecdb44c2072f8bd1b46364fb Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-05-20Add Honeycomb TAP interface testselias9-13/+277
JIRA: CSIT-75 - add test suite for TAP interface management through Honeycomb - add keywords required for TAP interface tests - move Honeycomb suite setup and teardown to new __init__ file - cleanup unused imports in Honeycomb test case files - modify "...should be empty" keywords to allow more reuse Change-Id: Ie3dc9069678b60c359f69c5a216e452e856a0107 Signed-off-by: selias <samelias@cisco.com>
2016-05-20Tests for vhost-user interface configurationTibor Frank5-0/+366
JIRA: CSIT-76 - add tests for vhost-user interface manipulation: - create, modify, delete - add negative tests: - wrong interface type - wrong configuration Change-Id: I09239ef099a6f9672895f9540762e5044123f7ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-19TB1 topology file with X520-DA2 NICs onlyMiroslav Miklus2-1/+66
JIRA: CSIT-8 Change-Id: I9c4d5d5502ed6e387a93e545c30278618a14a7fc Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-19Parse robot output.xml for performance reportingpmikus2-0/+178
- JIRA: CSIT-58 - parse robot framework output.xml file - find performance related data - write formatted json to specified file - copy archive artifact to directory Change-Id: I47e45bcb68c06044a23192cb1fca46f43782941e Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-18T-REX stl traffic send improvement for async callsMiroslav Miklus8-116/+325
JIRA: CSIT-68 - show runtime statistics with running traffic - T-REX driver async. driver Change-Id: Ie5eb7021f610fb58383b033dda5b1b867f7d3d2c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-18PERF bootstrap, apply global PYBOT args to all test typesMiroslav Miklus1-6/+12
Change-Id: Ia51a437d03e33df8e27da0afc099f808e255937c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-18Explicitly list the NIC type for perf testsMiroslav Miklus9-11/+26
JIRA: CSIT-74 - FIX test names - list NICs Change-Id: Ic5dba9381b7bf7129cb0944deb33a86ccdbf2c7b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-18Patch: Detection of running t-rex instance before initializingPeter Mikus1-0/+3
- JIRA: CSIT-89 - Add detection of running t-rex traffic generator before new instance is initialized. Change-Id: I77009b0c5e83bb6e162b9800d02b4e5a2abd541f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-16Update vpp stable build used in csit-vpp-verify-weekly jenkins jobJan Gelety1-1/+1
- vpp build version updated to release 1.0.0-451~g686a5a5_amd64 Change-Id: Ic7d177d72a6d50c083d5b9733c8f63298eebd7c6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-16Add IPsec traffic scriptMatus Fabian1-0/+208
JIRA: CSIT-28 Change-Id: Iaebea917ade85965b0dbaf35d58ea1ee14d76e3f Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-05-16CIMANAGE-5: update bootstrap for csit-vpp-verify-weekly jobJan Gelety1-3/+8
- file rename - usage of vpp-verified build Change-Id: I61b7ef4121d02149cf5b24514176b375e660b2ae Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-16Add VIRL host selection mechanism to bootstrapCarsten Koester1-12/+52
Add a mechanism to the bootstrap script that allows it to select one out of multiple candidate VIRL hosts. In addition, fix a few cosmetic issues wrt. connecting to the VIRL host: * Use consistent set of SSH options * Consistently use constant instead of hardcoded key filename * Use relative path names for start-/stop-testcase scripts Change-Id: I0d2972f170de82dd5d98da88656f5f962fca2415 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-05-16Add Honeycomb VxLAN test suiteselias6-77/+302
JIRA: CSIT-47 - add test suite for VxLAN management through Honeycomb - add keywords required for VxLAN management tests - add resource file with additional variables for testing - increment bridge domain test suite index Change-Id: Ica0d7ae15f5b7058832a944d5ca0c72026ba299c Signed-off-by: selias <samelias@cisco.com>
2016-05-16CSIT-18: Add GRE tunnel libraries and tests.Matej Klotton7-2/+465
Change-Id: I91ccd65a26ea1782611bccc3badd91e64366a162 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-16Update Honeycomb bridge domain testsselias2-12/+22
- fix interface assignment verification through VAT - add verification of split horizon group setting through VAT - clean up documentation of high level bridge domain keywords Change-Id: I7552494d68c6bbc86d3e5ddea4e29c6a7444d50c Signed-off-by: selias <samelias@cisco.com>
2016-05-16Add keyword to manipulate vhost-user parametersTibor Frank1-0/+68
JIRA: CSIT-70 - add a keyword to be able to: - configure all vhost-user parameters at once - configure vhost-user parameters one by one - remove a vhost-user parameter - remove all vhost-user parameters at once - add a keyword which adds a new vhost-user interface Change-Id: I144bc035b959a1e4eb37c6a3d554e6843ddab4a7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-13CSIT-65: Add new test for LISP APIAndrej Kozemcak16-0/+1116
Test set and unset this API: lisp_add_del_locator_set lisp_add_del_locator lisp_add_del_local_eid lisp_add_del_map_resolver lisp_gpe_add_del_iface Change-Id: I9c701fc421d4106147891a7e75e5d68885b9ba59 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
2016-05-13Add keyword to manipulate interface TAP parametersTibor Frank1-0/+67
JIRA: CSIT-69 - add a keyword to be able to: - configure all TAP parameters at once - configure TAP parameters one by one - remove a TAP parameter - remove all TAP parameters at once - add a keyword which adds a new TAP interface Change-Id: I5620adc3f777f7a337bbd737e685891b425d4e09 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-13Add possibility to create a VxLAN interface.Tibor Frank3-13/+86
JIRA: CSIT-51 - add a keyword which adds a new VxLAN interface - change InterfaceUtil.vxlan_dump to be able to return info about all VxLAN interfaces. Change-Id: I8ad3dc1d414924e74ea1ecea1f316ca5c648e2d0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-12Add possibility to change VxLAN parameters at onceTibor Frank1-12/+20
JIRA: CSIT-51 - modify existing keyword "configure_interface_vxlan" to be able to: - configure all VxLAN parameters at once - configure VxLAN parameters one by one - remove a parameter - remove all parameters at once Change-Id: I50551fbc3ae5c6aa147d531fc66b583af36bb541 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-12Update of vpp build for perf testsMiroslav Miklus1-1/+1
build: 1.0.0-437~g8f15e92_amd64 Change-Id: Ie0d0f693bcae0d0e56472c25b6353890d07e85d9 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-12Update Honeycomb interface IPv4 testselias4-28/+69
- add verification of ipv4 subnet prefix support - modify keywords to allow setting ipv4 address with network prefix - fix variable definitions to evaluate numbers as ints, not strings - add exception to ipv4 netmask/prefix conversion method Change-Id: I9343ceb35856ddb33674d7067f1def6d40e99acc Signed-off-by: selias <samelias@cisco.com>
2016-05-12Add functions to get interface name or index from JSON interface dump.Matej Klotton2-0/+76
Change-Id: I4778c9fa72e418f6fea427f88fd9aa1ea579ac99 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-11Add library for set path variables for testing.Matej Klotton16-622/+483
Change-Id: Icb243bacc9329c4bf3bc28098fced473b4e3c991 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-11Performance IPv6 library and short/long test casespmikus8-14/+539
- JIRA: CSIT-2 - Create IPv6 test cases for long/short/singlethread/multithread performance testing - Create robot KWs for IPv6 performance testing - Add T-Rex IPv6 profile Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Extend ranges of binary search in ipv4 perf testingPeter Mikus1-5/+5
- Extend ranges of binary search in Long IPv4 testing to reflect the performance variability Change-Id: I7632bbda361cb278be0776ec31461554297fe852 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Move Honeycomb libraries to honeycomb subdirectory.Tibor Frank8-22/+40
- move all Honeycomb related libraries written in python to new directory resources/libraries/python/honeycomb - update all related includes in all source files Change-Id: Ifa96b8f670b456b14421929d6020ddf8e02d9cbc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-11Add iACL IPv4/IPv6 tests.Patrik Hrnciar11-2/+523
- IPv4: CSIT-15 - IPv6: CSIT-16 Change-Id: I6e66aa853dfaebf1388f1191dbb63f5216820325 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>