aboutsummaryrefslogtreecommitdiffstats
path: root/tests/suites
AgeCommit message (Collapse)AuthorFilesLines
2016-06-02IPv6 COP - performancePeter Mikus2-0/+761
- JIRA: CSIT-109 - create topology with COP white-list applied on interfaces using IPv6 in 3-node topology - create necessary keywords to be used in test cases - create ipv6_cop test cases (78B, 1518B, 9000B) Change-Id: I2618971610f066b847c00e1ea18dc396555a9923 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-06-02IPv4 COP - performancePeter Mikus2-0/+766
- JIRA: CSIT-105 - create topology with COP white-list applied on interfaces using IPv4 in 3-node topology - create necessary keywords to be used in test cases - create ipv4_cop test cases (64B, 1518B, 9000B) Change-Id: I0aeaaf3c295e9691f99fc2e03c57f67e7d568ed4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-06-02Remove EXPECTED_FAILING tag from TCMatej Klotton1-1/+0
- JIRA: CSIT-120 Change-Id: Icec1119cdd2aff0937db5e2e2fea8ea2fb31b0fa Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-06-01Add Honeycomb sub-interface and VLAN testsTibor Frank2-0/+486
JIRA: CSIT-94 JIRA: CSIT-48 - add Honeycomb sub-interface tests - add Honeycomb VLAN tests - add keywords for sub-interface tests - add keywords for VLAN tests Change-Id: I89cd3b41dd9c60bfd946e24567d0ff93e5ea9fff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-06-01CSIT-125: Add test for lisp remote static mappingAndrej Kozemcak3-1/+306
Test Lisp functionality and rename lisp file Testing this topology: - IPv4 lisp topology - IPv6 lisp topology - IPv4 over IPv6 - IPv6 over IPv4 Change-Id: Ie3439ca802f1c8ae82a1dfcfdebe579f9dc47089 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
2016-05-31CSIT-23 Add ARP request test.Patrik Hrnciar1-0/+58
Change-Id: Ibb48e6d84efc55f7fb656283a954fbaefc7154e7 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-05-31CSIT-98: MAC split-horizon group, part IIJan Gelety1-14/+332
- test cases to test MAC split-horizon group functionality together with VXLAN tunnel over IPv4 and over IPv6 - two IPv6 tests tagged EXPECTED_FAILING until VPP-98 is closed - added update of bootstrap.sh - vpp build updated to version 16.09-rc0~33-g4b46c84~b200_amd64 Change-Id: I1da6a98b11f5c39cd114abb35bb8f398cbbebf63 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-30Add DHCP Client libs and VPP sends DHCPv4 Discover testMatej Klotton1-0/+51
-JIRA: CSIT-100 Change-Id: I4b6fc5d974ebe500d6c6bc74c14e1db7b3d10c3a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-30Update Honeycomb testsselias2-15/+46
- add new test cases based on reported bugs - minor fixes Change-Id: I8b7464bc1f4e786e3a0ef67ba64d81e1c25ae5cf Signed-off-by: selias <samelias@cisco.com>
2016-05-26Find PDR using binary searchPeter Mikus10-129/+1280
- JIRA: CSIT-72 - modify libraries for PDR search evaluation - write robot framework keywords for PDR search - write Performance Test Cases using PDR Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-25Patch: Remove show stats keyword from teardown phasePeter Mikus10-20/+10
- JIRA: CSIT-104 - Remove duplicity of showing stats - Remove "Show statistics on all DUTs" from "Test Teardown" Change-Id: Ic8e913396144c1ee50e878d9b0f85dffceee5287 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Replace linear search with binary searchPeter Mikus5-475/+457
- JIRA: CSIT-97 - Replace linear search with binary search for long performance testing Change-Id: I19cbcf3d9f7f5e6ec5128287b58a2ea3aceff00c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Add test cases with "dpdk no-multi-seg" in vpp startup configPeter Mikus10-371/+636
- JIRA: CSIT-73 - Add ability to configure no-multi-seg parameter in VPP startup configuration - Add keywords to selectively configure parameters in startup configuration - Modify testcases Change-Id: I3c5c0a1cc2b1156d5a87ff36628b50793dd9ac5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Performance l2-vlan-dot1q library and short/long test casespmikus3-1/+507
- JIRA: CSIT-59 - create topology with VLAN dot1q sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1q test cases (64B, 1518B, 9000B) Change-Id: Ic5f31b4451965bb7f5d3d5b7061c6600f63da898 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-20VPP in host user-mode, part IIZdeno Olsovsky3-21/+161
- JIRA: CSIT-61 Change-Id: I688b1013a78a1fa3ecdb44c2072f8bd1b46364fb Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-05-20Add Honeycomb TAP interface testselias5-10/+103
JIRA: CSIT-75 - add test suite for TAP interface management through Honeycomb - add keywords required for TAP interface tests - move Honeycomb suite setup and teardown to new __init__ file - cleanup unused imports in Honeycomb test case files - modify "...should be empty" keywords to allow more reuse Change-Id: Ie3dc9069678b60c359f69c5a216e452e856a0107 Signed-off-by: selias <samelias@cisco.com>
2016-05-20Tests for vhost-user interface configurationTibor Frank1-0/+167
JIRA: CSIT-76 - add tests for vhost-user interface manipulation: - create, modify, delete - add negative tests: - wrong interface type - wrong configuration Change-Id: I09239ef099a6f9672895f9540762e5044123f7ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-18Explicitly list the NIC type for perf testsMiroslav Miklus8-7/+22
JIRA: CSIT-74 - FIX test names - list NICs Change-Id: Ic5dba9381b7bf7129cb0944deb33a86ccdbf2c7b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-16Add Honeycomb VxLAN test suiteselias4-11/+130
JIRA: CSIT-47 - add test suite for VxLAN management through Honeycomb - add keywords required for VxLAN management tests - add resource file with additional variables for testing - increment bridge domain test suite index Change-Id: Ica0d7ae15f5b7058832a944d5ca0c72026ba299c Signed-off-by: selias <samelias@cisco.com>
2016-05-16CSIT-18: Add GRE tunnel libraries and tests.Matej Klotton1-0/+128
Change-Id: I91ccd65a26ea1782611bccc3badd91e64366a162 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-16Update Honeycomb bridge domain testsselias1-2/+2
- fix interface assignment verification through VAT - add verification of split horizon group setting through VAT - clean up documentation of high level bridge domain keywords Change-Id: I7552494d68c6bbc86d3e5ddea4e29c6a7444d50c Signed-off-by: selias <samelias@cisco.com>
2016-05-13CSIT-65: Add new test for LISP APIAndrej Kozemcak1-0/+90
Test set and unset this API: lisp_add_del_locator_set lisp_add_del_locator lisp_add_del_local_eid lisp_add_del_map_resolver lisp_gpe_add_del_iface Change-Id: I9c701fc421d4106147891a7e75e5d68885b9ba59 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
2016-05-12Update Honeycomb interface IPv4 testselias1-13/+21
- add verification of ipv4 subnet prefix support - modify keywords to allow setting ipv4 address with network prefix - fix variable definitions to evaluate numbers as ints, not strings - add exception to ipv4 netmask/prefix conversion method Change-Id: I9343ceb35856ddb33674d7067f1def6d40e99acc Signed-off-by: selias <samelias@cisco.com>
2016-05-11Add library for set path variables for testing.Matej Klotton9-215/+258
Change-Id: Icb243bacc9329c4bf3bc28098fced473b4e3c991 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-11Performance IPv6 library and short/long test casespmikus2-0/+352
- JIRA: CSIT-2 - Create IPv6 test cases for long/short/singlethread/multithread performance testing - Create robot KWs for IPv6 performance testing - Add T-Rex IPv6 profile Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Extend ranges of binary search in ipv4 perf testingPeter Mikus1-5/+5
- Extend ranges of binary search in Long IPv4 testing to reflect the performance variability Change-Id: I7632bbda361cb278be0776ec31461554297fe852 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Add iACL IPv4/IPv6 tests.Patrik Hrnciar2-0/+257
- IPv4: CSIT-15 - IPv6: CSIT-16 Change-Id: I6e66aa853dfaebf1388f1191dbb63f5216820325 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-05-09CSIT-9: COP Whitelist/blacklistZdeno2-0/+225
- Included are also IPv6 tests - JIRA: CSIT-17 Change-Id: I89ae6c38cdc6742a597c0dc24ed1c033c1b5d155 Signed-off-by: Zdeno <zolsovsk@cisco.com>
2016-05-09CSIT-19: MAC split-horizon groupJan Gelety1-1/+49
- test case to test MAC split-horizon group functionality Change-Id: Iadee707f3670e5fc9c209bd8b072a65ea1af27cd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-09Add Honeycomb bridge domain management testsselias2-1/+83
JIRA: CSIT-41, CSIT-42, CSIT-43 - add test cases for Honecomb bridge domain management - add keywords used by these tests - prefix the names of Honeycomb test suites with numbers, so that they execute in a specific order - moved suite teardown with "Stop Honeycomb service" to bridge domain suite Note: Due to time constraints, the Honeycomb service cannot be restarted between executions of individual Honeycomb test suites. Therefore Honeycomb will be setup in the first test suite and shut down after the last one. Change-Id: I36b7f8335e5ba54985da5bd83730cf856d5ab48b Signed-off-by: selias <samelias@cisco.com>
2016-05-09Interface VxLAN testTibor Frank1-0/+13
JIRA: CSIT-45 - add test: Honeycomb modifies interface configuration - VxLAN - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured VxLAN - fixed requirements.txt Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-05-06Add Honeycomb interface management tests (ipv4, ipv6, ethernet, routing)selias1-2/+48
- add test cases for managing ipv4, ipv6, ethernet and routing configuration on VPP interface - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured IP addresses - add method for converting between ipv4 netmasks and network prefixes - clean up documentation of older Honeycomb keywords Note: Test cases are tagged with a placeholder tag to allow manual test runs locally. It should be replaced with the appropriate environment tags once Honeycomb service is deployed on virl. Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78 Signed-off-by: selias <samelias@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-04Update T-rex version to v2.00pmikus3-60/+60
- JIRA: CSIT-14 - Update T-rex version to v2.00 with latest API - Compatibility fixes of affected libraries and robot files - T-rex performance tuning Change-Id: I3a90553032d6d82e6e03df7e0b52e205d3f6ba4e Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-03Patch to reset default VPP configuration in perf.pmikus6-12/+6
- JIRA: CSIT-57 - fix situation when vpp startup configuration is replaced by default with no interface configuration Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39 Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-02Topo installation script fixMiroslav Miklus2-9/+9
-more logging -use single SSH instance -dpkg --force-all -update referece vpp version and reference short test threshold Change-Id: Ie67633755f451dba9d6a3ee1fc431d2c3f3b506f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-26Add qinq through xconnect tests.Patrik Hrnciar1-0/+49
Change-Id: Ia20f5959dab41290bf60490ead830f0e37ecff0d Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-04-26Add BD vpp-vm-vpp testsMatus Fabian1-2/+82
JIRA: CSIT-20 Change-Id: Id22102519cdc8afef63c0e727fb47e2a2f1d769b Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Extend host topology with NIC type filteringMiroslav Miklus1-1/+3
JIRA: CSIT-1 Changes to allow filtering based on NIC model. Switched xconnect perf test to use filtered topology. Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-26Honeycomb interface state management testselias2-37/+42
- add simple test for interface management through Honeycomb API - add status code 500 to honeycomb startup check whitelist, due to Honeycomb changes in https://gerrit.fd.io/r/772 - increase timeout value for Honeycomb startup check - modify Honeycomb setup keywords to allow starting Honeycomb on individual nodes - remove sanity test suite, tests now sorted by functional areas such as interfaces, bridge domains, VXlan,... Change-Id: I87f9cf69577706f3b00e24a8d2c01df52fc707c6 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-22Reformat python libraries.Matej Klotton1-1/+1
PEP8 reformat fix typos docstrings reformat Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-22Bridge domain tests and user keywords refactor.Jan Gelety2-71/+120
- BD tests changed to behavior-driven-test style - added documentation to BD tests - added documentation and examples to BD user KWs Change-Id: Ifad45df3ef0bb55f5295363a264fe5f4e54f5762 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-04-22Performance test casespmikus6-127/+443
- JIRA: CSIT-10 - Add 1518B and 9000B test for multicore tests - Fine tune threshold for short tests based on previous benchmarks - Fix SI units Change-Id: I5c4657dfd881a24b2e40c91ea80a979003754258 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-19Make VXLAN test dot1Q as noncritical for now.Stefan Kobza1-0/+1
Change-Id: I0d41aad3fc1f96b58b83c6f0aa5a0e7606868ee4 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-04-17Multicore VPP setup for performance testingpmikus6-74/+455
- add multithread TAGS documentation - add methods to VppConfigGenerator for RSS configuration - create KW for multithread setup - create sample test case using multithread vpp setup - add Documentation into TCs Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-15Update of bootstrap.sh file.Jan Gelety1-0/+1
- updated vpp build version - VIRL image switched to double-ring-nested topology - removed exclusion of 3_NODE_DOUBLE_LINK_TOPO test cases - included test cases with tags: - VM_ENV and 3_NODE_SINGLE_LINK_TOPO - VM_ENV and 3_NODE_DOUBLE_LINK_TOPO - added missing tags to TC VPP reports interfaces in Bridge Domain test suite Change-Id: Ia6a7a54ef9ad6245835b2762c303935fe39f4079 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-04-13VXLAN test with dot1q tagging.Matej Klotton5-30/+97
Change-Id: I3dbd12983736e338d757c580570d91680aedd83f Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-13Move methods from topology.py to more appropriate place.Matej Klotton4-7/+3
Change-Id: I2612a9466095b3d79a4a9d938fcdbf9f93133f69 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-13documentation: long_xconnect test suite documentationMiroslav Miklus1-1/+16
Generate testdoc by using: python -m robot.testdoc long_xconnect.robot perf_long_xconnect.html Change-Id: I12d83de4abb1af4d94e6fd78d05c46018ee5d7d7 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-11Combined DropRateSearchpmikus1-65/+0
- combined search algorithm using linear and binary search - add KWs into performance library for binary and combined search - remove short_bridge_domain_binary.robot as binary and combined search KWs are in library for optional use - PEP8 fixes Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-05Setup and check honeycomb on all DUTsselias1-0/+37
- methods implementing HTTP requests (PUT,GET,POST,DELETE) - methods for parsing HTTP responses - methods for honeycomb setup on DUT - updated constants.py - keywords for honeycomb setup and communication - simple honeycomb sanity test (not enabled for jenkins job runs) Change-Id: I589f0ca56cc01072b92fe9363aed16a4098aee40 Signed-off-by: selias <samuel.elias@pantheon.tech>