aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2016-05-18Explicitly list the NIC type for perf testsMiroslav Miklus8-7/+22
JIRA: CSIT-74 - FIX test names - list NICs Change-Id: Ic5dba9381b7bf7129cb0944deb33a86ccdbf2c7b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-16Add Honeycomb VxLAN test suiteselias4-11/+130
JIRA: CSIT-47 - add test suite for VxLAN management through Honeycomb - add keywords required for VxLAN management tests - add resource file with additional variables for testing - increment bridge domain test suite index Change-Id: Ica0d7ae15f5b7058832a944d5ca0c72026ba299c Signed-off-by: selias <samelias@cisco.com>
2016-05-16CSIT-18: Add GRE tunnel libraries and tests.Matej Klotton1-0/+128
Change-Id: I91ccd65a26ea1782611bccc3badd91e64366a162 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-16Update Honeycomb bridge domain testsselias1-2/+2
- fix interface assignment verification through VAT - add verification of split horizon group setting through VAT - clean up documentation of high level bridge domain keywords Change-Id: I7552494d68c6bbc86d3e5ddea4e29c6a7444d50c Signed-off-by: selias <samelias@cisco.com>
2016-05-13CSIT-65: Add new test for LISP APIAndrej Kozemcak1-0/+90
Test set and unset this API: lisp_add_del_locator_set lisp_add_del_locator lisp_add_del_local_eid lisp_add_del_map_resolver lisp_gpe_add_del_iface Change-Id: I9c701fc421d4106147891a7e75e5d68885b9ba59 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
2016-05-12Update Honeycomb interface IPv4 testselias1-13/+21
- add verification of ipv4 subnet prefix support - modify keywords to allow setting ipv4 address with network prefix - fix variable definitions to evaluate numbers as ints, not strings - add exception to ipv4 netmask/prefix conversion method Change-Id: I9343ceb35856ddb33674d7067f1def6d40e99acc Signed-off-by: selias <samelias@cisco.com>
2016-05-11Add library for set path variables for testing.Matej Klotton9-215/+258
Change-Id: Icb243bacc9329c4bf3bc28098fced473b4e3c991 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-11Performance IPv6 library and short/long test casespmikus2-0/+352
- JIRA: CSIT-2 - Create IPv6 test cases for long/short/singlethread/multithread performance testing - Create robot KWs for IPv6 performance testing - Add T-Rex IPv6 profile Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Extend ranges of binary search in ipv4 perf testingPeter Mikus1-5/+5
- Extend ranges of binary search in Long IPv4 testing to reflect the performance variability Change-Id: I7632bbda361cb278be0776ec31461554297fe852 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Add iACL IPv4/IPv6 tests.Patrik Hrnciar2-0/+257
- IPv4: CSIT-15 - IPv6: CSIT-16 Change-Id: I6e66aa853dfaebf1388f1191dbb63f5216820325 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-05-09CSIT-9: COP Whitelist/blacklistZdeno2-0/+225
- Included are also IPv6 tests - JIRA: CSIT-17 Change-Id: I89ae6c38cdc6742a597c0dc24ed1c033c1b5d155 Signed-off-by: Zdeno <zolsovsk@cisco.com>
2016-05-09CSIT-19: MAC split-horizon groupJan Gelety1-1/+49
- test case to test MAC split-horizon group functionality Change-Id: Iadee707f3670e5fc9c209bd8b072a65ea1af27cd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-09Add Honeycomb bridge domain management testsselias2-1/+83
JIRA: CSIT-41, CSIT-42, CSIT-43 - add test cases for Honecomb bridge domain management - add keywords used by these tests - prefix the names of Honeycomb test suites with numbers, so that they execute in a specific order - moved suite teardown with "Stop Honeycomb service" to bridge domain suite Note: Due to time constraints, the Honeycomb service cannot be restarted between executions of individual Honeycomb test suites. Therefore Honeycomb will be setup in the first test suite and shut down after the last one. Change-Id: I36b7f8335e5ba54985da5bd83730cf856d5ab48b Signed-off-by: selias <samelias@cisco.com>
2016-05-09Interface VxLAN testTibor Frank1-0/+13
JIRA: CSIT-45 - add test: Honeycomb modifies interface configuration - VxLAN - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured VxLAN - fixed requirements.txt Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-05-06Add Honeycomb interface management tests (ipv4, ipv6, ethernet, routing)selias1-2/+48
- add test cases for managing ipv4, ipv6, ethernet and routing configuration on VPP interface - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured IP addresses - add method for converting between ipv4 netmasks and network prefixes - clean up documentation of older Honeycomb keywords Note: Test cases are tagged with a placeholder tag to allow manual test runs locally. It should be replaced with the appropriate environment tags once Honeycomb service is deployed on virl. Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78 Signed-off-by: selias <samelias@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-04Update T-rex version to v2.00pmikus3-60/+60
- JIRA: CSIT-14 - Update T-rex version to v2.00 with latest API - Compatibility fixes of affected libraries and robot files - T-rex performance tuning Change-Id: I3a90553032d6d82e6e03df7e0b52e205d3f6ba4e Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-03Patch to reset default VPP configuration in perf.pmikus6-12/+6
- JIRA: CSIT-57 - fix situation when vpp startup configuration is replaced by default with no interface configuration Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39 Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-02Topo installation script fixMiroslav Miklus2-9/+9
-more logging -use single SSH instance -dpkg --force-all -update referece vpp version and reference short test threshold Change-Id: Ie67633755f451dba9d6a3ee1fc431d2c3f3b506f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-26Add qinq through xconnect tests.Patrik Hrnciar1-0/+49
Change-Id: Ia20f5959dab41290bf60490ead830f0e37ecff0d Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-04-26Add BD vpp-vm-vpp testsMatus Fabian1-2/+82
JIRA: CSIT-20 Change-Id: Id22102519cdc8afef63c0e727fb47e2a2f1d769b Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Extend host topology with NIC type filteringMiroslav Miklus1-1/+3
JIRA: CSIT-1 Changes to allow filtering based on NIC model. Switched xconnect perf test to use filtered topology. Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-26Honeycomb interface state management testselias2-37/+42
- add simple test for interface management through Honeycomb API - add status code 500 to honeycomb startup check whitelist, due to Honeycomb changes in https://gerrit.fd.io/r/772 - increase timeout value for Honeycomb startup check - modify Honeycomb setup keywords to allow starting Honeycomb on individual nodes - remove sanity test suite, tests now sorted by functional areas such as interfaces, bridge domains, VXlan,... Change-Id: I87f9cf69577706f3b00e24a8d2c01df52fc707c6 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-22Reformat python libraries.Matej Klotton1-1/+1
PEP8 reformat fix typos docstrings reformat Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-22Bridge domain tests and user keywords refactor.Jan Gelety2-71/+120
- BD tests changed to behavior-driven-test style - added documentation to BD tests - added documentation and examples to BD user KWs Change-Id: Ifad45df3ef0bb55f5295363a264fe5f4e54f5762 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-04-22Performance test casespmikus6-127/+443
- JIRA: CSIT-10 - Add 1518B and 9000B test for multicore tests - Fine tune threshold for short tests based on previous benchmarks - Fix SI units Change-Id: I5c4657dfd881a24b2e40c91ea80a979003754258 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-19Make VXLAN test dot1Q as noncritical for now.Stefan Kobza1-0/+1
Change-Id: I0d41aad3fc1f96b58b83c6f0aa5a0e7606868ee4 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-04-17Multicore VPP setup for performance testingpmikus6-74/+455
- add multithread TAGS documentation - add methods to VppConfigGenerator for RSS configuration - create KW for multithread setup - create sample test case using multithread vpp setup - add Documentation into TCs Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-15Update of bootstrap.sh file.Jan Gelety1-0/+1
- updated vpp build version - VIRL image switched to double-ring-nested topology - removed exclusion of 3_NODE_DOUBLE_LINK_TOPO test cases - included test cases with tags: - VM_ENV and 3_NODE_SINGLE_LINK_TOPO - VM_ENV and 3_NODE_DOUBLE_LINK_TOPO - added missing tags to TC VPP reports interfaces in Bridge Domain test suite Change-Id: Ia6a7a54ef9ad6245835b2762c303935fe39f4079 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-04-13VXLAN test with dot1q tagging.Matej Klotton5-30/+97
Change-Id: I3dbd12983736e338d757c580570d91680aedd83f Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-13Move methods from topology.py to more appropriate place.Matej Klotton4-7/+3
Change-Id: I2612a9466095b3d79a4a9d938fcdbf9f93133f69 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-13documentation: long_xconnect test suite documentationMiroslav Miklus1-1/+16
Generate testdoc by using: python -m robot.testdoc long_xconnect.robot perf_long_xconnect.html Change-Id: I12d83de4abb1af4d94e6fd78d05c46018ee5d7d7 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-11Combined DropRateSearchpmikus1-65/+0
- combined search algorithm using linear and binary search - add KWs into performance library for binary and combined search - remove short_bridge_domain_binary.robot as binary and combined search KWs are in library for optional use - PEP8 fixes Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-05Setup and check honeycomb on all DUTsselias1-0/+37
- methods implementing HTTP requests (PUT,GET,POST,DELETE) - methods for parsing HTTP responses - methods for honeycomb setup on DUT - updated constants.py - keywords for honeycomb setup and communication - simple honeycomb sanity test (not enabled for jenkins job runs) Change-Id: I589f0ca56cc01072b92fe9363aed16a4098aee40 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-01Long perf testspmikus6-170/+175
- added new long tests for ipv4 and xconnect - modified long bridge domain test - added 64B, 1518B and 9000B frame sizes Change-Id: I88f75c375345f2d708df3fd24dd50d77bc63c495 Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-24Binary DropRateSearchpmikus1-0/+65
- binary search - short perf bridge_domain with binary Change-Id: I50538738b356cc8fef4cfcb4974c43c5123827d1 Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-17DropRateSearch libraryMiroslav Miklus4-6/+72
- linear search - t-rex DropRateSearch implementation - long perf bridge_domain test - introduced PERFORMANCE_SHORT, PERFORMANCE_LONG test tags Change-Id: I497b72f3e6d58a67ca5a386403d1e84dcf433ec4 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-03-14Add vxlan tests using xconnectPatrik Hrnciar2-3/+44
Change-Id: I190689d5a624f1c876df90ce29b05a2b0b8a2df4 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-03-11Update VPP version downloaded from Nexus.Matej Klotton2-2/+2
Change-Id: Iae2ee6d576347262d9f3f9a9e9b9cc65dbc5bf5e Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-03-07Modify sweep ping test casesJuraj Sloboda3-20/+61
- Write separate sweep ping test cases for jumbo frames - Compute sweep ping end size from reported MTU on DUT interface - Set MTU on TG according to MTU on DUT interface - Log VPP packet traces on IPv4 and IPv6 tests failure - Remove VM_ENV tag from sweep ping test cases for jumbo frames Change-Id: I47aa7977bcff9c4366c67578aef542924a1d055b Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
2016-03-07Move Send and receive L2 traffic KWs to standalone file.Matej Klotton3-14/+14
Change-Id: I3c919a15d5fdbf91ff493d64b768fb69b8c21b65 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-03-07Performance suite reorg, v4 testsMiroslav Miklus4-117/+221
- perf suite splitted to 1.xconnect 2.bridge-domain 3.IPv4 - IPv4 perf tests implemented - renamed perf tests prefix 2core -> 1core Change-Id: I9ef2dbdfcfdcb36e8865989e6255d69ced33269c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-29Add VXLAN testMatej Klotton1-0/+27
Change-Id: Id1d37fda2697fbfb7aa7a79318f8316b80e96963 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-02-27Test both traffic directions for bidirectional topologyJan Gelety2-13/+17
- l2 bridge domain - l2 cross connects Change-Id: I45b4c1e5aa72e55ff05ed84f4748a0ea41c99a18 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-02-26T-REX: startup config generationMiroslav Miklus1-1/+1
- T-rex startup config generated based on computed path - move t-rex tooling to t-rex directory Change-Id: I3ac698f41f98934bcce4af35dc3a755a8948e887 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-25Performance suite: introduced suite variablesMiroslav Miklus1-26/+28
- perf suite variables - T-REX setup fix Change-Id: I608581e45d0e5f80e8f75c2a07c994bf0e0d0df3 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-23Instead of Sleep loop verification of interfacesMatus Fabian1-1/+2
Change-Id: I29a974182082f0e5c84a9dd21a539d21ef75b41b Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-02-22performance tests: 2core, test teardown, remove UDP headerMiroslav Miklus1-7/+10
- testing on 2 core VPP - show statistics only if test fails - remove UDP header from packet Change-Id: I5b47330a0bbc4602e8e8eb19fcc481a7635bd2a5 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-19Add hw/vm tags, add single link tag.Stefan Kobza5-4/+18
Add HW_EVN and VM_ENV tags to specify limitations on where the given test could be run. For tests that should be run only on bare metal, author of the test should add tag HW_ENV to it. Add 3_NODE_SINGLE_LINK_TOPO tag, to specify requirement on topology, where only one link is required in between any two nodes in the topology. Change-Id: I38c9a9732cad608bb6a9e4a2c5f1997236cd48b9 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-02-19Performance suite: xconnect fix, show commandsMiroslav Miklus1-7/+25
- adjust L2 xconnect to changed xconnect library - show [interface stats, hardware, errors, runtime] Change-Id: I9dffebdd0abbde5107c6dc926210ba725e1e039c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-19Convert ipv4 to use node_pathJuraj Sloboda1-27/+44
Change-Id: Ie5587d4de9accb852e8f7634c42b9ccd9292830b Signed-off-by: Juraj Sloboda <jsloboda@cisco.com> Signed-off-by: Stefan Kobza <skobza@cisco.com>