aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-06-13Adjust short test treshold based on latest resultspmikus4-19/+19
Change-Id: Iad121a9f047e85f6e8cd8539af1aff829c10c875 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-12CSIT-152: Detect if the T-rex is responding to API after startpmikus2-10/+105
Change-Id: I99c8dcbd210175fa5d1af193371249e525dc0102 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-11Process output of robot to XML file for Plot pluginpmikus2-95/+57
- JIRA: CSIT-135 - Process output of robot output.xml to XML file for Plot plugin Change-Id: I5e077d81f4c93f66eb208ecc2a38a9f6ca2fe307 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-10VPP startup config change (rss->txqueues)Miroslav Miklus17-658/+611
JIRA: CSIT-153 Change-Id: I6908670003e02e8dc2971c0308c27baffaf19b66 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-10Use files to store VPP stable build dataJan Gelety4-9/+14
- add VPP_REPO_URL file to store path to VPP build repository - add VPP_STABLE_VER file to store VPP stable build version - adapt bootstrap*.sh files to read VPP build repository path and VPP stable build version from files Change-Id: I2997320ec3df68eaf092795e5d553fb3f024d366 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-09CSIT-138: Cleanup of vpp packages.Miroslav Miklus1-2/+18
Change-Id: I489762a156f5860f40809c9e62b0603353adf934 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-09Fix Vagrant config for multi-user environmentAurélien Degeorges1-4/+9
Add support for an environment variable "VPP_VAGRANT_NET_PREFIX" to add a prefix before the name of vbox internal networks. Otherwise two users trying to do "vargrant up" on the same server will face conflicts with the name of vbox internal networks. Change-Id: I5ba7c06fe111944fcac3da25276d018d281aef4f Signed-off-by: Aurélien Degeorges <aurelien.degeorges@6wind.com>
2016-06-08Add Tests for Honeycomb VxLAN GPE supportTibor Frank8-35/+590
JIRA: CSIT-131 - add tests for Honeycomb VxLAN GPE support - add keywords needed for tests Change-Id: I460ecd30835bb95140958b20946b1d41ac6d9abc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-06-08Update T-rex to v2.03 part IIpmikus4-46/+46
- JIRA: CSIT-132 - Update Trex via autoinstall script Change-Id: I65753b35287d9322ef230642ea0dd3596f1da5c9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-07Add Honeycomb persistence testsselias9-5/+496
JIRA: CSIT-121 - add honeycomb persistence test suite - add keywords used by persistence tests - add methods for working with Honeycomb persistence files - make suite setup clear persisted data before Honeycomb startup Change-Id: Ief61c12b730d58a456566c4683c0091e08a09b56 Signed-off-by: selias <samelias@cisco.com>
2016-06-074 Vhosts setup testZdeno Olsovsky8-7/+838
-JIRA: CSIT-64 Change-Id: I0d6fc522f3214d1b4887e65d5639a323efdf7dd7 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-06-07iACL TCP/UDP testsPatrik Hrnciar8-63/+1167
- IPv4 CSIT-92 - IPv6 CSIT-107 Change-Id: Ia93e96f624ce73ef08b89d4b22334a67ebb69e13 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-06-06Add test VPP honors DHCPv4 lease timeMatej Klotton5-0/+315
-JIRA: CSIT-130 Change-Id: I1d0a92e8865021ac5c85e63256e1b75a839d4ce9 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-06-06Add test VPP sends DHCP REQUEST after OFFERMatej Klotton6-15/+345
-JIRA: CSIT-101 Change-Id: I9b92920f8ce324c447cb44ed4cd8d7f8c9c9ed88 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-06-03PATCH: Revert to T-rex version to v2.00pmikus4-11/+11
- Revert T-rex version to v2.00 without installation from robot Change-Id: I8d0c5fb57f01febc970d9fc9363965acd2e57ed4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-03Update T-rex version to v2.03 with installation from robotpmikus4-6/+14
- JIRA: CSIT-132 - Update T-rex version to v2.03 with installation from robot Change-Id: I7e222a61f88b1313273e6866dfc78d62b4d8ac93 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-02CSIT-128: Remove EXPECTED_FAILING tag from VXLAN over IPv6 test casesJan Gelety3-4/+4
- update vpp build to version 16.09-rc0~47-g3419d0b~b214_amd64 in bootstrap.sh and bootstrap-vpp-verify-weekly.sh - remove tag EXPECTED_FAILING from VXLAN over IPv6 test cases as the VPP-98 is closed Change-Id: I377f7ee931424e6d38e918aeb9fc7ab450875631 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-02Final result must be combination of all test runs in vpp-verify-weekly job.Jan Gelety1-1/+58
- log clear final result based on results of all runs - exit script with return code corresponding to final result Change-Id: If504b4c45a947502806011db9290ff41e4299490 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-02Add documentation and files related to initial host setupCarsten Koester33-0/+1369
Change-Id: I73deeb79e57ac7eca208faa49d04be37c7034163 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-06-02IPv6 COP - performancePeter Mikus2-0/+761
- JIRA: CSIT-109 - create topology with COP white-list applied on interfaces using IPv6 in 3-node topology - create necessary keywords to be used in test cases - create ipv6_cop test cases (78B, 1518B, 9000B) Change-Id: I2618971610f066b847c00e1ea18dc396555a9923 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-06-02IPv4 COP - performancePeter Mikus2-0/+766
- JIRA: CSIT-105 - create topology with COP white-list applied on interfaces using IPv4 in 3-node topology - create necessary keywords to be used in test cases - create ipv4_cop test cases (64B, 1518B, 9000B) Change-Id: I0aeaaf3c295e9691f99fc2e03c57f67e7d568ed4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-06-02Update T-rex version to v2.02Peter Mikus4-4/+4
- JIRA: CSIT-99 - Update T-rex version to v2.02 with stability fixed and to be able to measure latency Change-Id: Ic014c81c5889dbb738f1f3f279138a73dffb01f3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-06-02CSIT-114: Eliminate repeated download of PIP packagesCarsten Koester7-7/+7
Allow VirtualEnv to use existing system-wide packages if they already exist. Change-Id: I6f39178d56e81affea0bee7b9065bef66712ddaa Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-06-02CSIT-117: CSIT Vagrant+Virtualbox dev environment inoperative on UbuntuDave Wallace2-27/+19
Change-Id: I10d7a1cb194e8116324524e2ce6dff909620d077 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-06-02CSIT-117: CSIT Vagrant+Virtualbox dev environment inoperative on UbuntuDave Wallace2-11/+24
Change-Id: I05ea675a2eb6d0b240008efa0d27166616c6e741 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-06-02Update of vpp build in bootstrap-vpp-verify-weekly.shJan Gelety1-1/+1
- correction of REPO path Change-Id: Iff6012046c3d749692dcd63d30d9797f45fc64bc Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-02Update of vpp build in bootstrap-vpp-verify-weekly.shJan Gelety1-2/+2
- vpp build updated to version 16.09-rc0~33-g4b46c84~b200_amd64 Change-Id: I0efce483c804c51403e2d9c195cf48a931193fae Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-02Remove EXPECTED_FAILING tag from TCMatej Klotton1-1/+0
- JIRA: CSIT-120 Change-Id: Icec1119cdd2aff0937db5e2e2fea8ea2fb31b0fa Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-06-02CSIT-111: Add Packer based framework to auto-generate disk imagesCarsten Koester42-722/+5350
Change-Id: Ia18ea34a6288aec0f12f176f4cc264d0f215d1fd Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-06-01Add Honeycomb sub-interface and VLAN testsTibor Frank7-8/+1024
JIRA: CSIT-94 JIRA: CSIT-48 - add Honeycomb sub-interface tests - add Honeycomb VLAN tests - add keywords for sub-interface tests - add keywords for VLAN tests Change-Id: I89cd3b41dd9c60bfd946e24567d0ff93e5ea9fff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-06-01CSIT-125: Add test for lisp remote static mappingAndrej Kozemcak10-7/+504
Test Lisp functionality and rename lisp file Testing this topology: - IPv4 lisp topology - IPv6 lisp topology - IPv4 over IPv6 - IPv6 over IPv4 Change-Id: Ie3439ca802f1c8ae82a1dfcfdebe579f9dc47089 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
2016-05-31CSIT-23 Add ARP request test.Patrik Hrnciar3-20/+241
Change-Id: Ibb48e6d84efc55f7fb656283a954fbaefc7154e7 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-05-31CIMANAGE-7: Bootstrap for csit-vpp-master-verify-semiweekly jobJan Gelety2-1/+430
- run func and perf_long tests in three test loops - updated REPO in /resources/tools/download_install_vpp_pkgs.sh Change-Id: Iff459b7719380404a242c80821806a9450271adf Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-31Sample test suite for vpp sample plugin (macswap)Miroslav Miklus5-0/+195
JIRA: CSIT-123 Change-Id: I4774ddf3a2f67c322fe27e5f9d366f508156e70f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-31CSIT-98: MAC split-horizon group, part IIJan Gelety3-18/+336
- test cases to test MAC split-horizon group functionality together with VXLAN tunnel over IPv4 and over IPv6 - two IPv6 tests tagged EXPECTED_FAILING until VPP-98 is closed - added update of bootstrap.sh - vpp build updated to version 16.09-rc0~33-g4b46c84~b200_amd64 Change-Id: I1da6a98b11f5c39cd114abb35bb8f398cbbebf63 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-31PATCH: Return pybot exit code in bootstrap-verify-perfPeter Mikus1-0/+13
- Return exit code from pybot instead of last command in bootstrap file. Change-Id: If8430426d7259c832c0ea78d2d165d09f8c4eda7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-31Remove obsolete boostrap-hw-tb2Peter Mikus1-30/+0
- Remove obsolete bootstrap-hw-tb2 as it was replaced by bootstrap-verify-perf and ci-management is updated. Change-Id: I23cfb5bcc4b3c1bede456936c978ec5428bba373 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-30Add DHCP Client libs and VPP sends DHCPv4 Discover testMatej Klotton5-0/+299
-JIRA: CSIT-100 Change-Id: I4b6fc5d974ebe500d6c6bc74c14e1db7b3d10c3a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-30Update Honeycomb testsselias7-30/+63
- add new test cases based on reported bugs - minor fixes Change-Id: I8b7464bc1f4e786e3a0ef67ba64d81e1c25ae5cf Signed-off-by: selias <samelias@cisco.com>
2016-05-26Find PDR using binary searchPeter Mikus15-139/+1692
- JIRA: CSIT-72 - modify libraries for PDR search evaluation - write robot framework keywords for PDR search - write Performance Test Cases using PDR Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-26Rename topology files with correct NIC namesMiroslav Miklus4-3/+3
JIRA: CSIT-106 Change-Id: I3bb33d0025c99f1cf0defe542a86f0d620b80730 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-25Patch: Remove show stats keyword from teardown phasePeter Mikus10-20/+10
- JIRA: CSIT-104 - Remove duplicity of showing stats - Remove "Show statistics on all DUTs" from "Test Teardown" Change-Id: Ic8e913396144c1ee50e878d9b0f85dffceee5287 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Patch: Set duration of performance long tests to 10sPeter Mikus1-3/+3
- JIRA: CSIT-77 Decrease duration time from 60 second to 10 second for all long performance tests. This patch is preparation for replacement of linear search for binary search. Change-Id: I61fbec1dcaca73ba383690e695c3030d182a90f9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Replace linear search with binary searchPeter Mikus6-475/+493
- JIRA: CSIT-97 - Replace linear search with binary search for long performance testing Change-Id: I19cbcf3d9f7f5e6ec5128287b58a2ea3aceff00c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Add test cases with "dpdk no-multi-seg" in vpp startup configPeter Mikus13-392/+751
- JIRA: CSIT-73 - Add ability to configure no-multi-seg parameter in VPP startup configuration - Add keywords to selectively configure parameters in startup configuration - Modify testcases Change-Id: I3c5c0a1cc2b1156d5a87ff36628b50793dd9ac5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Add temporary fix for CSIT-90 by flushing QGA's input bufferCarsten Koester1-0/+16
This is not a final fix. The final fix SHOULD send a "guest-sync" request as per" http://wiki.qemu.org/Features/QAPI/GuestAgent#QEMU_Guest_Agent_Protocol However, this temporary fix will eliminate the nested VM startup failures triggered by the nested VM's guest-agent receiving a partial guest-ping request. Change-Id: Ice409b7c966a527b03cb71c042b476e1771676d0 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-05-23Capture VPP stats for Long and Short testsMiroslav Miklus6-23/+79
JIRA: CSIT-71 - remove warmup for short runs - clear and collect stats for short run - run short test with no failure for long test with NDR/PDR rate Change-Id: I1b8879c3b891165072822207d0781687d8159336 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-23Patch: Start binary search from max range ratePeter Mikus1-7/+13
- JIRA: CSIT-96 - Add option to start binary search with max range rate value first and then continue the binary search of half interval. Change-Id: Ia6d2f4aa6fc20ca2ee4d43d0ddb3966422b28144 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Performance l2-vlan-dot1q library and short/long test casespmikus6-2/+560
- JIRA: CSIT-59 - create topology with VLAN dot1q sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1q test cases (64B, 1518B, 9000B) Change-Id: Ic5f31b4451965bb7f5d3d5b7061c6600f63da898 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-22TB3 topology file with X520-DA2 NICsMiroslav Miklus2-1/+65
JIRA: CSIT-8 Change-Id: I95baf116cfcde85fdbaaaac079f27c898a959f58 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>