aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-06-07Add Honeycomb persistence testsselias9-5/+496
JIRA: CSIT-121 - add honeycomb persistence test suite - add keywords used by persistence tests - add methods for working with Honeycomb persistence files - make suite setup clear persisted data before Honeycomb startup Change-Id: Ief61c12b730d58a456566c4683c0091e08a09b56 Signed-off-by: selias <samelias@cisco.com>
2016-06-074 Vhosts setup testZdeno Olsovsky8-7/+838
-JIRA: CSIT-64 Change-Id: I0d6fc522f3214d1b4887e65d5639a323efdf7dd7 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-06-07iACL TCP/UDP testsPatrik Hrnciar8-63/+1167
- IPv4 CSIT-92 - IPv6 CSIT-107 Change-Id: Ia93e96f624ce73ef08b89d4b22334a67ebb69e13 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-06-06Add test VPP honors DHCPv4 lease timeMatej Klotton5-0/+315
-JIRA: CSIT-130 Change-Id: I1d0a92e8865021ac5c85e63256e1b75a839d4ce9 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-06-06Add test VPP sends DHCP REQUEST after OFFERMatej Klotton6-15/+345
-JIRA: CSIT-101 Change-Id: I9b92920f8ce324c447cb44ed4cd8d7f8c9c9ed88 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-06-03PATCH: Revert to T-rex version to v2.00pmikus4-11/+11
- Revert T-rex version to v2.00 without installation from robot Change-Id: I8d0c5fb57f01febc970d9fc9363965acd2e57ed4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-03Update T-rex version to v2.03 with installation from robotpmikus4-6/+14
- JIRA: CSIT-132 - Update T-rex version to v2.03 with installation from robot Change-Id: I7e222a61f88b1313273e6866dfc78d62b4d8ac93 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-02CSIT-128: Remove EXPECTED_FAILING tag from VXLAN over IPv6 test casesJan Gelety3-4/+4
- update vpp build to version 16.09-rc0~47-g3419d0b~b214_amd64 in bootstrap.sh and bootstrap-vpp-verify-weekly.sh - remove tag EXPECTED_FAILING from VXLAN over IPv6 test cases as the VPP-98 is closed Change-Id: I377f7ee931424e6d38e918aeb9fc7ab450875631 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-02Final result must be combination of all test runs in vpp-verify-weekly job.Jan Gelety1-1/+58
- log clear final result based on results of all runs - exit script with return code corresponding to final result Change-Id: If504b4c45a947502806011db9290ff41e4299490 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-02Add documentation and files related to initial host setupCarsten Koester33-0/+1369
Change-Id: I73deeb79e57ac7eca208faa49d04be37c7034163 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-06-02IPv6 COP - performancePeter Mikus2-0/+761
- JIRA: CSIT-109 - create topology with COP white-list applied on interfaces using IPv6 in 3-node topology - create necessary keywords to be used in test cases - create ipv6_cop test cases (78B, 1518B, 9000B) Change-Id: I2618971610f066b847c00e1ea18dc396555a9923 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-06-02IPv4 COP - performancePeter Mikus2-0/+766
- JIRA: CSIT-105 - create topology with COP white-list applied on interfaces using IPv4 in 3-node topology - create necessary keywords to be used in test cases - create ipv4_cop test cases (64B, 1518B, 9000B) Change-Id: I0aeaaf3c295e9691f99fc2e03c57f67e7d568ed4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-06-02Update T-rex version to v2.02Peter Mikus4-4/+4
- JIRA: CSIT-99 - Update T-rex version to v2.02 with stability fixed and to be able to measure latency Change-Id: Ic014c81c5889dbb738f1f3f279138a73dffb01f3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-06-02CSIT-114: Eliminate repeated download of PIP packagesCarsten Koester7-7/+7
Allow VirtualEnv to use existing system-wide packages if they already exist. Change-Id: I6f39178d56e81affea0bee7b9065bef66712ddaa Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-06-02CSIT-117: CSIT Vagrant+Virtualbox dev environment inoperative on UbuntuDave Wallace2-27/+19
Change-Id: I10d7a1cb194e8116324524e2ce6dff909620d077 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-06-02CSIT-117: CSIT Vagrant+Virtualbox dev environment inoperative on UbuntuDave Wallace2-11/+24
Change-Id: I05ea675a2eb6d0b240008efa0d27166616c6e741 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-06-02Update of vpp build in bootstrap-vpp-verify-weekly.shJan Gelety1-1/+1
- correction of REPO path Change-Id: Iff6012046c3d749692dcd63d30d9797f45fc64bc Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-02Update of vpp build in bootstrap-vpp-verify-weekly.shJan Gelety1-2/+2
- vpp build updated to version 16.09-rc0~33-g4b46c84~b200_amd64 Change-Id: I0efce483c804c51403e2d9c195cf48a931193fae Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-02Remove EXPECTED_FAILING tag from TCMatej Klotton1-1/+0
- JIRA: CSIT-120 Change-Id: Icec1119cdd2aff0937db5e2e2fea8ea2fb31b0fa Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-06-02CSIT-111: Add Packer based framework to auto-generate disk imagesCarsten Koester42-722/+5350
Change-Id: Ia18ea34a6288aec0f12f176f4cc264d0f215d1fd Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-06-01Add Honeycomb sub-interface and VLAN testsTibor Frank7-8/+1024
JIRA: CSIT-94 JIRA: CSIT-48 - add Honeycomb sub-interface tests - add Honeycomb VLAN tests - add keywords for sub-interface tests - add keywords for VLAN tests Change-Id: I89cd3b41dd9c60bfd946e24567d0ff93e5ea9fff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-06-01CSIT-125: Add test for lisp remote static mappingAndrej Kozemcak10-7/+504
Test Lisp functionality and rename lisp file Testing this topology: - IPv4 lisp topology - IPv6 lisp topology - IPv4 over IPv6 - IPv6 over IPv4 Change-Id: Ie3439ca802f1c8ae82a1dfcfdebe579f9dc47089 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
2016-05-31CSIT-23 Add ARP request test.Patrik Hrnciar3-20/+241
Change-Id: Ibb48e6d84efc55f7fb656283a954fbaefc7154e7 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-05-31CIMANAGE-7: Bootstrap for csit-vpp-master-verify-semiweekly jobJan Gelety2-1/+430
- run func and perf_long tests in three test loops - updated REPO in /resources/tools/download_install_vpp_pkgs.sh Change-Id: Iff459b7719380404a242c80821806a9450271adf Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-31Sample test suite for vpp sample plugin (macswap)Miroslav Miklus5-0/+195
JIRA: CSIT-123 Change-Id: I4774ddf3a2f67c322fe27e5f9d366f508156e70f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-31CSIT-98: MAC split-horizon group, part IIJan Gelety3-18/+336
- test cases to test MAC split-horizon group functionality together with VXLAN tunnel over IPv4 and over IPv6 - two IPv6 tests tagged EXPECTED_FAILING until VPP-98 is closed - added update of bootstrap.sh - vpp build updated to version 16.09-rc0~33-g4b46c84~b200_amd64 Change-Id: I1da6a98b11f5c39cd114abb35bb8f398cbbebf63 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-31PATCH: Return pybot exit code in bootstrap-verify-perfPeter Mikus1-0/+13
- Return exit code from pybot instead of last command in bootstrap file. Change-Id: If8430426d7259c832c0ea78d2d165d09f8c4eda7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-31Remove obsolete boostrap-hw-tb2Peter Mikus1-30/+0
- Remove obsolete bootstrap-hw-tb2 as it was replaced by bootstrap-verify-perf and ci-management is updated. Change-Id: I23cfb5bcc4b3c1bede456936c978ec5428bba373 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-30Add DHCP Client libs and VPP sends DHCPv4 Discover testMatej Klotton5-0/+299
-JIRA: CSIT-100 Change-Id: I4b6fc5d974ebe500d6c6bc74c14e1db7b3d10c3a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-30Update Honeycomb testsselias7-30/+63
- add new test cases based on reported bugs - minor fixes Change-Id: I8b7464bc1f4e786e3a0ef67ba64d81e1c25ae5cf Signed-off-by: selias <samelias@cisco.com>
2016-05-26Find PDR using binary searchPeter Mikus15-139/+1692
- JIRA: CSIT-72 - modify libraries for PDR search evaluation - write robot framework keywords for PDR search - write Performance Test Cases using PDR Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-26Rename topology files with correct NIC namesMiroslav Miklus4-3/+3
JIRA: CSIT-106 Change-Id: I3bb33d0025c99f1cf0defe542a86f0d620b80730 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-25Patch: Remove show stats keyword from teardown phasePeter Mikus10-20/+10
- JIRA: CSIT-104 - Remove duplicity of showing stats - Remove "Show statistics on all DUTs" from "Test Teardown" Change-Id: Ic8e913396144c1ee50e878d9b0f85dffceee5287 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Patch: Set duration of performance long tests to 10sPeter Mikus1-3/+3
- JIRA: CSIT-77 Decrease duration time from 60 second to 10 second for all long performance tests. This patch is preparation for replacement of linear search for binary search. Change-Id: I61fbec1dcaca73ba383690e695c3030d182a90f9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Replace linear search with binary searchPeter Mikus6-475/+493
- JIRA: CSIT-97 - Replace linear search with binary search for long performance testing Change-Id: I19cbcf3d9f7f5e6ec5128287b58a2ea3aceff00c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Add test cases with "dpdk no-multi-seg" in vpp startup configPeter Mikus13-392/+751
- JIRA: CSIT-73 - Add ability to configure no-multi-seg parameter in VPP startup configuration - Add keywords to selectively configure parameters in startup configuration - Modify testcases Change-Id: I3c5c0a1cc2b1156d5a87ff36628b50793dd9ac5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Add temporary fix for CSIT-90 by flushing QGA's input bufferCarsten Koester1-0/+16
This is not a final fix. The final fix SHOULD send a "guest-sync" request as per" http://wiki.qemu.org/Features/QAPI/GuestAgent#QEMU_Guest_Agent_Protocol However, this temporary fix will eliminate the nested VM startup failures triggered by the nested VM's guest-agent receiving a partial guest-ping request. Change-Id: Ice409b7c966a527b03cb71c042b476e1771676d0 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-05-23Capture VPP stats for Long and Short testsMiroslav Miklus6-23/+79
JIRA: CSIT-71 - remove warmup for short runs - clear and collect stats for short run - run short test with no failure for long test with NDR/PDR rate Change-Id: I1b8879c3b891165072822207d0781687d8159336 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-23Patch: Start binary search from max range ratePeter Mikus1-7/+13
- JIRA: CSIT-96 - Add option to start binary search with max range rate value first and then continue the binary search of half interval. Change-Id: Ia6d2f4aa6fc20ca2ee4d43d0ddb3966422b28144 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Performance l2-vlan-dot1q library and short/long test casespmikus6-2/+560
- JIRA: CSIT-59 - create topology with VLAN dot1q sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1q test cases (64B, 1518B, 9000B) Change-Id: Ic5f31b4451965bb7f5d3d5b7061c6600f63da898 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-22TB3 topology file with X520-DA2 NICsMiroslav Miklus2-1/+65
JIRA: CSIT-8 Change-Id: I95baf116cfcde85fdbaaaac079f27c898a959f58 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-20VPP in host user-mode, part IIZdeno Olsovsky5-44/+305
- JIRA: CSIT-61 Change-Id: I688b1013a78a1fa3ecdb44c2072f8bd1b46364fb Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-05-20Add Honeycomb TAP interface testselias9-13/+277
JIRA: CSIT-75 - add test suite for TAP interface management through Honeycomb - add keywords required for TAP interface tests - move Honeycomb suite setup and teardown to new __init__ file - cleanup unused imports in Honeycomb test case files - modify "...should be empty" keywords to allow more reuse Change-Id: Ie3dc9069678b60c359f69c5a216e452e856a0107 Signed-off-by: selias <samelias@cisco.com>
2016-05-20Tests for vhost-user interface configurationTibor Frank5-0/+366
JIRA: CSIT-76 - add tests for vhost-user interface manipulation: - create, modify, delete - add negative tests: - wrong interface type - wrong configuration Change-Id: I09239ef099a6f9672895f9540762e5044123f7ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-19TB1 topology file with X520-DA2 NICs onlyMiroslav Miklus2-1/+66
JIRA: CSIT-8 Change-Id: I9c4d5d5502ed6e387a93e545c30278618a14a7fc Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-19Parse robot output.xml for performance reportingpmikus2-0/+178
- JIRA: CSIT-58 - parse robot framework output.xml file - find performance related data - write formatted json to specified file - copy archive artifact to directory Change-Id: I47e45bcb68c06044a23192cb1fca46f43782941e Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-18T-REX stl traffic send improvement for async callsMiroslav Miklus8-116/+325
JIRA: CSIT-68 - show runtime statistics with running traffic - T-REX driver async. driver Change-Id: Ie5eb7021f610fb58383b033dda5b1b867f7d3d2c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-18PERF bootstrap, apply global PYBOT args to all test typesMiroslav Miklus1-6/+12
Change-Id: Ia51a437d03e33df8e27da0afc099f808e255937c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-18Explicitly list the NIC type for perf testsMiroslav Miklus9-11/+26
JIRA: CSIT-74 - FIX test names - list NICs Change-Id: Ic5dba9381b7bf7129cb0944deb33a86ccdbf2c7b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-18Patch: Detection of running t-rex instance before initializingPeter Mikus1-0/+3
- JIRA: CSIT-89 - Add detection of running t-rex traffic generator before new instance is initialized. Change-Id: I77009b0c5e83bb6e162b9800d02b4e5a2abd541f Signed-off-by: Peter Mikus <pmikus@cisco.com>