aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot
AgeCommit message (Collapse)AuthorFilesLines
2016-05-24Replace linear search with binary searchPeter Mikus1-0/+36
- JIRA: CSIT-97 - Replace linear search with binary search for long performance testing Change-Id: I19cbcf3d9f7f5e6ec5128287b58a2ea3aceff00c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Add test cases with "dpdk no-multi-seg" in vpp startup configPeter Mikus2-20/+74
- JIRA: CSIT-73 - Add ability to configure no-multi-seg parameter in VPP startup configuration - Add keywords to selectively configure parameters in startup configuration - Modify testcases Change-Id: I3c5c0a1cc2b1156d5a87ff36628b50793dd9ac5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Capture VPP stats for Long and Short testsMiroslav Miklus3-23/+55
JIRA: CSIT-71 - remove warmup for short runs - clear and collect stats for short run - run short test with no failure for long test with NDR/PDR rate Change-Id: I1b8879c3b891165072822207d0781687d8159336 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-23Performance l2-vlan-dot1q library and short/long test casespmikus2-1/+46
- JIRA: CSIT-59 - create topology with VLAN dot1q sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1q test cases (64B, 1518B, 9000B) Change-Id: Ic5f31b4451965bb7f5d3d5b7061c6600f63da898 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-20VPP in host user-mode, part IIZdeno Olsovsky1-8/+78
- JIRA: CSIT-61 Change-Id: I688b1013a78a1fa3ecdb44c2072f8bd1b46364fb Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-05-20Add Honeycomb TAP interface testselias2-1/+147
JIRA: CSIT-75 - add test suite for TAP interface management through Honeycomb - add keywords required for TAP interface tests - move Honeycomb suite setup and teardown to new __init__ file - cleanup unused imports in Honeycomb test case files - modify "...should be empty" keywords to allow more reuse Change-Id: Ie3dc9069678b60c359f69c5a216e452e856a0107 Signed-off-by: selias <samelias@cisco.com>
2016-05-20Tests for vhost-user interface configurationTibor Frank1-0/+182
JIRA: CSIT-76 - add tests for vhost-user interface manipulation: - create, modify, delete - add negative tests: - wrong interface type - wrong configuration Change-Id: I09239ef099a6f9672895f9540762e5044123f7ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-18T-REX stl traffic send improvement for async callsMiroslav Miklus2-8/+38
JIRA: CSIT-68 - show runtime statistics with running traffic - T-REX driver async. driver Change-Id: Ie5eb7021f610fb58383b033dda5b1b867f7d3d2c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-16Add Honeycomb VxLAN test suiteselias2-66/+172
JIRA: CSIT-47 - add test suite for VxLAN management through Honeycomb - add keywords required for VxLAN management tests - add resource file with additional variables for testing - increment bridge domain test suite index Change-Id: Ica0d7ae15f5b7058832a944d5ca0c72026ba299c Signed-off-by: selias <samelias@cisco.com>
2016-05-16CSIT-18: Add GRE tunnel libraries and tests.Matej Klotton1-0/+123
Change-Id: I91ccd65a26ea1782611bccc3badd91e64366a162 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-16Update Honeycomb bridge domain testsselias1-10/+20
- fix interface assignment verification through VAT - add verification of split horizon group setting through VAT - clean up documentation of high level bridge domain keywords Change-Id: I7552494d68c6bbc86d3e5ddea4e29c6a7444d50c Signed-off-by: selias <samelias@cisco.com>
2016-05-13CSIT-65: Add new test for LISP APIAndrej Kozemcak1-0/+349
Test set and unset this API: lisp_add_del_locator_set lisp_add_del_locator lisp_add_del_local_eid lisp_add_del_map_resolver lisp_gpe_add_del_iface Change-Id: I9c701fc421d4106147891a7e75e5d68885b9ba59 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
2016-05-12Update Honeycomb interface IPv4 testselias1-0/+18
- add verification of ipv4 subnet prefix support - modify keywords to allow setting ipv4 address with network prefix - fix variable definitions to evaluate numbers as ints, not strings - add exception to ipv4 netmask/prefix conversion method Change-Id: I9343ceb35856ddb33674d7067f1def6d40e99acc Signed-off-by: selias <samelias@cisco.com>
2016-05-12Add functions to get interface name or index from JSON interface dump.Matej Klotton1-0/+22
Change-Id: I4778c9fa72e418f6fea427f88fd9aa1ea579ac99 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-11Add library for set path variables for testing.Matej Klotton7-407/+225
Change-Id: Icb243bacc9329c4bf3bc28098fced473b4e3c991 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-11Performance IPv6 library and short/long test casespmikus1-4/+32
- JIRA: CSIT-2 - Create IPv6 test cases for long/short/singlethread/multithread performance testing - Create robot KWs for IPv6 performance testing - Add T-Rex IPv6 profile Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Move Honeycomb libraries to honeycomb subdirectory.Tibor Frank3-10/+9
- move all Honeycomb related libraries written in python to new directory resources/libraries/python/honeycomb - update all related includes in all source files Change-Id: Ifa96b8f670b456b14421929d6020ddf8e02d9cbc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-11Add iACL IPv4/IPv6 tests.Patrik Hrnciar2-1/+125
- IPv4: CSIT-15 - IPv6: CSIT-16 Change-Id: I6e66aa853dfaebf1388f1191dbb63f5216820325 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-05-09CSIT-9: COP Whitelist/blacklistZdeno2-0/+193
- Included are also IPv6 tests - JIRA: CSIT-17 Change-Id: I89ae6c38cdc6742a597c0dc24ed1c033c1b5d155 Signed-off-by: Zdeno <zolsovsk@cisco.com>
2016-05-09CSIT-19: MAC split-horizon groupJan Gelety1-2/+73
- test case to test MAC split-horizon group functionality Change-Id: Iadee707f3670e5fc9c209bd8b072a65ea1af27cd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-09Add Honeycomb bridge domain management testsselias1-0/+202
JIRA: CSIT-41, CSIT-42, CSIT-43 - add test cases for Honecomb bridge domain management - add keywords used by these tests - prefix the names of Honeycomb test suites with numbers, so that they execute in a specific order - moved suite teardown with "Stop Honeycomb service" to bridge domain suite Note: Due to time constraints, the Honeycomb service cannot be restarted between executions of individual Honeycomb test suites. Therefore Honeycomb will be setup in the first test suite and shut down after the last one. Change-Id: I36b7f8335e5ba54985da5bd83730cf856d5ab48b Signed-off-by: selias <samelias@cisco.com>
2016-05-09Interface VxLAN testTibor Frank1-0/+65
JIRA: CSIT-45 - add test: Honeycomb modifies interface configuration - VxLAN - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured VxLAN - fixed requirements.txt Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-05-06Add Honeycomb interface management tests (ipv4, ipv6, ethernet, routing)selias2-33/+281
- add test cases for managing ipv4, ipv6, ethernet and routing configuration on VPP interface - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured IP addresses - add method for converting between ipv4 netmasks and network prefixes - clean up documentation of older Honeycomb keywords Note: Test cases are tagged with a placeholder tag to allow manual test runs locally. It should be replaced with the appropriate environment tags once Honeycomb service is deployed on virl. Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78 Signed-off-by: selias <samelias@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-06Add "show error" output into vpp statsPeter Mikus1-0/+1
- Add "show error" debug output into VPP show stats as verbose subcommand is not parsed correctly in output of vpp_api_test Change-Id: I924c54bb86375e43770fd449b8d6aaa7a3413bcb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-03Patch to reset default VPP configuration in perf.pmikus1-1/+5
- JIRA: CSIT-57 - fix situation when vpp startup configuration is replaced by default with no interface configuration Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-26Add qinq through xconnect tests.Patrik Hrnciar1-0/+140
Change-Id: Ia20f5959dab41290bf60490ead830f0e37ecff0d Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-04-26Add BD vpp-vm-vpp testsMatus Fabian1-0/+54
JIRA: CSIT-20 Change-Id: Id22102519cdc8afef63c0e727fb47e2a2f1d769b Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Extend host topology with NIC type filteringMiroslav Miklus2-0/+48
JIRA: CSIT-1 Changes to allow filtering based on NIC model. Switched xconnect perf test to use filtered topology. Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-26Honeycomb interface state management testselias2-23/+90
- add simple test for interface management through Honeycomb API - add status code 500 to honeycomb startup check whitelist, due to Honeycomb changes in https://gerrit.fd.io/r/772 - increase timeout value for Honeycomb startup check - modify Honeycomb setup keywords to allow starting Honeycomb on individual nodes - remove sanity test suite, tests now sorted by functional areas such as interfaces, bridge domains, VXlan,... Change-Id: I87f9cf69577706f3b00e24a8d2c01df52fc707c6 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-22Reformat python libraries.Matej Klotton2-4/+4
PEP8 reformat fix typos docstrings reformat Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-22Bridge domain tests and user keywords refactor.Jan Gelety2-10/+170
- BD tests changed to behavior-driven-test style - added documentation to BD tests - added documentation and examples to BD user KWs Change-Id: Ifad45df3ef0bb55f5295363a264fe5f4e54f5762 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-04-17Multicore VPP setup for performance testingpmikus1-0/+54
- add multithread TAGS documentation - add methods to VppConfigGenerator for RSS configuration - create KW for multithread setup - create sample test case using multithread vpp setup - add Documentation into TCs Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-15Change the performance result messagepmikus1-6/+21
- change the result message of performance search to more verbose level (rate per stream, rate total, throughput in Gbps) Change-Id: I7562d6d33c525654131c75ebcc776cba438f68f4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-13VXLAN test with dot1q tagging.Matej Klotton2-43/+103
Change-Id: I3dbd12983736e338d757c580570d91680aedd83f Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-13Move methods from topology.py to more appropriate place.Matej Klotton2-5/+4
Change-Id: I2612a9466095b3d79a4a9d938fcdbf9f93133f69 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-11Combined DropRateSearchpmikus1-0/+24
- combined search algorithm using linear and binary search - add KWs into performance library for binary and combined search - remove short_bridge_domain_binary.robot as binary and combined search KWs are in library for optional use - PEP8 fixes Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-05Add "Stop and Clear QEMU" KWMatus Fabian1-1/+14
Change-Id: Ib1b3907cd30c20c89283bd20e84ed8b829540ca4 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-05Setup and check honeycomb on all DUTsselias1-0/+68
- methods implementing HTTP requests (PUT,GET,POST,DELETE) - methods for parsing HTTP responses - methods for honeycomb setup on DUT - updated constants.py - keywords for honeycomb setup and communication - simple honeycomb sanity test (not enabled for jenkins job runs) Change-Id: I589f0ca56cc01072b92fe9363aed16a4098aee40 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-01Long perf testspmikus2-0/+80
- added new long tests for ipv4 and xconnect - modified long bridge domain test - added 64B, 1518B and 9000B frame sizes Change-Id: I88f75c375345f2d708df3fd24dd50d77bc63c495 Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-14Add vxlan tests using xconnectPatrik Hrnciar1-10/+23
Change-Id: I190689d5a624f1c876df90ce29b05a2b0b8a2df4 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-03-11Add KW to build QEMU 2.2.1 on nodeMatus Fabian1-0/+52
Change-Id: I58271aff1ef558752f00593bbad5c3317d08288d Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-03-07Modify sweep ping test casesJuraj Sloboda3-19/+36
- Write separate sweep ping test cases for jumbo frames - Compute sweep ping end size from reported MTU on DUT interface - Set MTU on TG according to MTU on DUT interface - Log VPP packet traces on IPv4 and IPv6 tests failure - Remove VM_ENV tag from sweep ping test cases for jumbo frames Change-Id: I47aa7977bcff9c4366c67578aef542924a1d055b Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
2016-03-07change interface up calls to explicit keywordsselias4-2/+11
Remove implicit "set interface state" calls from ipv4 and ipv6 test keywords. Use robot keyword instead. Change-Id: I535a7a967910e77dded39eb167fb9c164187566e Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-03-07Move Send and receive L2 traffic KWs to standalone file.Matej Klotton3-30/+29
Change-Id: I3c919a15d5fdbf91ff493d64b768fb69b8c21b65 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-03-07Performance suite reorg, v4 testsMiroslav Miklus1-0/+37
- perf suite splitted to 1.xconnect 2.bridge-domain 3.IPv4 - IPv4 perf tests implemented - renamed perf tests prefix 2core -> 1core Change-Id: I9ef2dbdfcfdcb36e8865989e6255d69ced33269c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-03-02Transfer l2_xconnect setup to L2UtilPatrik Hrnciar1-1/+1
Change-Id: I7a661c9ce8b5f9ca8fbd36858f7a9cd6f1da8ffd Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-02-29Add VXLAN testMatej Klotton1-0/+68
Change-Id: Id1d37fda2697fbfb7aa7a79318f8316b80e96963 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-02-23Remove Interface.close, rename script argumentJuraj Sloboda1-1/+1
Change-Id: I5da20a12f801264821890e6516899344456576a8 Signed-off-by: Juraj Sloboda <jsloboda@cisco.com>
2016-02-23Instead of Sleep loop verification of interfacesMatus Fabian3-3/+6
Change-Id: I29a974182082f0e5c84a9dd21a539d21ef75b41b Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-02-19Performance suite: xconnect fix, show commandsMiroslav Miklus1-0/+8
- adjust L2 xconnect to changed xconnect library - show [interface stats, hardware, errors, runtime] Change-Id: I9dffebdd0abbde5107c6dc926210ba725e1e039c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>