aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot
AgeCommit message (Collapse)AuthorFilesLines
2017-07-25HC Test: bugfixes for hc2vpp ODL jobsselias1-0/+5
- add shutdown check for ODL client in teardown - stop VPP in teardown - add delay after HC startup HC features load asynchronously, no way to check if they're all running. Change-Id: I9d2c51b68ba51284d2d409a77d6cd9fd478e1725 Signed-off-by: selias <samelias@cisco.com> (cherry picked from commit 835cb6439afb359dc2ebef02355314c4bebde75e)
2017-07-20FIX: run build qemu only for the 1st VM on DUTJan Gelety1-18/+20
Change-Id: Ib0fd10e9cb0c6eaeb75ec96e4459d5fb27c656bf Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit e4071a518036fa008507e27e9d0be047fb32ae7e)
2017-07-20FIX: fix of multiple perf test issuesJan Gelety1-2/+2
Change-Id: I24c823352b2832eb6da2aad0fd70570beb990f3f Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 5906589057ce7ed9e1182bc93381dee42c79f2a4)
2017-07-19FIX: typo issues in teardown for ACL perf testsJan Gelety1-2/+2
Change-Id: I2232b010efb4f4b071a0fe3efaaeb85f2830bf3c Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 38d995705f36eec47ecefc927acea009e93cab19)
2017-07-19CSIT-704: Add ACL IP4BASE perf testsJan Gelety2-3/+68
Change-Id: I1fada28f2855534faf3b3051a3efe1cbb4dcdd03 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit cb6b9fd6499a6e2f0efbb87ee84a8e768a7df869)
2017-07-18FIX: Initialize L2BD keywordPeter Mikus1-2/+13
Currently in Performance the "Initialize L2 bridge domain" keyword is adding interfaces to L2DB per node and at the same time waiting until interfaces become UP. This may be an issue if physical interfaces interconnecting DUTs required to be administratively UP on both DUTs to physical link state became UP. This fix is supposed to check the link state after all DUTs are initialized. Change-Id: I430b4285967f6168e6c74e0089a3e0d037b251d1 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit e40cf5b489e36323d401b864c5b2e610de037e20)
2017-07-18CSIT-723: Source code auto-generation for 1707Tibor Frank1-0/+12
Change-Id: Ia178ac180fd344db620757dcc2b9cbb5010276c7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 997a1485635dd74aaf090ca5de608b6fdc25b74b)
2017-07-17FIX: remove previous QEMU build when needed to change qszJan Gelety1-4/+12
Change-Id: I949f8800b45354c205c5a5d36ab2abeeb93409dc Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit b4157d62463fc54621fed74b223fcada4811efd1)
2017-07-06CSIT-622: Stateful Security Groups perf testsJan Gelety1-0/+106
1. add L2BD iACL statefull and stateless tests with 1, 10 and 50 not-hitting ACEs in combination with 100, 10k and 100k flows per direction 2. add L2BD oACL statefull and stateless tests with 1, 10 and 50 not-hitting ACEs in combination with 100, 10k and 100k flows per direction Change-Id: Ia38589aa81b50c5ccdf2813ad6fadd22b46fffeb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-06CSIT-660: add vring1024 tuned CFS for vpp workers and guest-testpmdJan Gelety1-9/+13
- add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 1024 and tuned CFS setting Change-Id: Ief8b4b86cdecfa39bf8cf0ec90fb844edfc6f396 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-06CSIT-661: re-add vring256 tuned CFS for vpp workers and guest-testpmdJan Gelety1-23/+59
1. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and tuned CFS setting 2. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and default CFS setting Change-Id: I25aae6839d3e621316d35f5c9525389a6faabd56 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-05 Change the bootstrap script file and test the CI-management.Fangyin Hu1-17/+31
Debug the NSH SFC functional test. Change the test cases and not use the tcpdump. Delete the unused code. Change the directory structure. Change-Id: I52486b9ba4b02e305f702ffc8cdb84e941cb18ff Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-07-04CSIT-651 Add keywords and template for memifPeter Mikus5-1/+140
Add keywords and template for memif Change-Id: I8bd5cfe345260750a74930c8ef55690be5f2dd5e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-04XL710 Configure rxd/txd 2048Peter Mikus1-0/+34
Configure RX-desc and TX-desc to 2048 for FVL XL710 cards. Change-Id: I1876f332bdc6100bf24f2b2317de33c0d1a4c9bf Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-30CSIT-619 HC Test: Honeycomb performance testing - initial commitselias2-4/+202
- keywords and scripts for HC performance testing setup - basic performance suite: operational data read - traffic script and keywords used in tests Change-Id: Ic0290be73a7c925ea2561f8cd2524c5cb83fcda2 Signed-off-by: selias <samelias@cisco.com>
2017-06-30HC Test: bugfix for SLAAC and ODL testsselias2-4/+3
Change-Id: I0a09482e8dc9ef2f9e6cd54a26c8d8492409f68c Signed-off-by: selias <samelias@cisco.com>
2017-06-29CSIT-687: Directory structure reorganizationTibor Frank34-49/+49
Change-Id: I772c9e214be2461adf58124998d272e7d795220f Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-06-26HC Test: improve functional suite setup and teardownselias16-150/+245
Restart the whole stack (VPP+Honeycomb+-ODL) in between test suites. Add generic suite setup and suite teardown keywords for all func suites Re-enable NSH_SFC suite, cleanup test failures Change-Id: I71025b4ed3a7c4912dcd7b62aedef6082357990c Signed-off-by: selias <samelias@cisco.com>
2017-06-26CSIT-683: Re-organize L2 libraries - funcTibor Frank5-143/+44
Change-Id: I5444dfba68ea41d8190d6615e23505f3c08c377c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-23CSIT-614: Create PDRCHK testsTibor Frank1-0/+31
- CSIT-639: 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhost-1vm-pdrchk - CSIT-640: 10ge2p1x520-dot1q-l2xcbase-eth-2vhost-1vm-pdrchk - CSIT-641: 10ge2p1x520-ethip4-ip4base-eth-2vhost-1vm-pdrchk - CSIT-642: 10ge2p1x520-eth-l2xcbase-eth-2vhost-1vm-pdrchk Change-Id: Id676c69abe34e455ca298f7225fd065fc6cc8218 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-23Update of LXCUtil libraryPeter Mikus1-4/+8
Change-Id: I1a095e45960ca004413c4ecbfd410e41fb621c74 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-20CSIT-678: Re-organize L2 libraries - performanceTibor Frank3-1136/+1214
Change-Id: Ic4e37df31fbc10f15351e3671b541e6f047405bc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-15CSIT-649 Add library for creating lxc containerPeter Mikus1-0/+253
Add RF library for manipulating lxc container Add python library for manipulating lxc container Change-Id: I02140aa879c7ebd40360d588ab1438c58cf560a1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-13CSIT-664: Refactor setups and teardownsTibor Frank6-31/+230
- Add suite setup for performance IPSec tests - Add test teardown for performance SNAT tests - Add setups and teardowns for functional tests - Clean up the code Change-Id: Ia456e9f3ff0f0f2bb9a03f692f27c7f9a2817621 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-12CSIT-646 Refactor VPPConfigGenerator scriptPeter Mikus2-114/+44
Currently the VPPConfigGenerator script is not modular enough for creating all combinations of VPP startup configuration. This patch is supposed to implement unified structured way to create all configuration options. Change-Id: If3f9cf5dc838fe0a698ea1c601abff6c4c0468b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-09CSIT-663: Remove unused keywordsTibor Frank9-187/+10
Change-Id: Ib3f0edb0c3a48a760040886e5aedce81c9baeac2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-09 Add the NSH SFC functional test cases.Fangyin Hu1-0/+67
1. Proxy Inbound test with 152/256/512/1024/1280/1518 Bytes VxLAN-GPE + NSH packet 2. Proxy Outbound test with 128/256/512/1024/1280/1518 Bytes VxLAN packet 3. SFC SFF test with 152/256/512/1024/1280/1518 Bytes VxLAN-GPE + NSH packet Separate the functional test bootstrap file to another code review. Change-Id: I05cf6ab1d01c1b41c1c61044d6d31fd6219b86af Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-06-08CSIT-662: KWI - KW renamingTibor Frank39-645/+648
- plus: CSIT-656: Script to rename robot keywords. Change-Id: Ia69917e406a1b346b80e5ea742f6200c1c9e9d21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-07 TLDK udwfwd test case:Qun Wan1-0/+80
- ip fragement for ipv4 - ip reassemble for ipv4 - ip checksum for ipv4 - ip checksum for ipv6 - ip fragment for ipv6 added the genpcap.py script to generate the pcap files and corresponding test scripts Change-Id: I01329dbb0ecd3c3a5dd7a63ef1dea01b2e717da5 Signed-off-by: qun wan <qun.wan@intel.com>
2017-06-05CSIT-614: PDRCHK test for vpp-csit-verify-hw-perf jobTibor Frank1-0/+7
Create PDRCHK test: a. vpp-verify-perf-l2 i. 10Ge2P1X520-Eth-L2Bdbasemaclrn-pdrchk ii. 10Ge2P1X520-Eth-L2Xcbase-pdrchk b. vpp-verify-perf-ip4 i. 10Ge2P1X520-Ethip4-Ip4Base-pdrchk c. vpp-verify-perf-ip6 i. 10Ge2P1X520-Ethip6-Ip6Base-pdrchk ii. 10Ge2P1X520-Ethip6-Ip6Scale2M-pdrchk d. vpp-verify-perf-lisp i. 10Ge2P1X520-Ethip4Lispip4-Ip4Base-pdrchk ii. 10Ge2P1X520-Ethip4Lispip6-Ip4Base-pdrchk iii. 10Ge2P1X520-Ethip6Lispip4-Ip6Base-pdrchk iv. 10Ge2P1X520-Ethip6Lispip6-Ip6Base-pdrchk e. vpp-verify-perf-vxlan i. 10ge2p1x520-ethip4vxlan-l2xcbase-pdrchk Change-Id: If232b0375140b884f1b65c380faf5bd77c5df5c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-05CSIT-610 HC Test: add test cases for unnumbered interfaceselias3-6/+40
- add interface and sub-interface tests with unnumbered config - modify interface IPv4 address assignment to handle custom interfaces and sub-interfaces - pylint and style fixes Change-Id: Ic39df1655b4d44f0025a2acef9f7f968929aeff5 Signed-off-by: selias <samelias@cisco.com>
2017-05-30Do not fail test case when no vpp pid detected in the tear downJan Gelety1-1/+8
- currently when no pid (or more pids) detected in the test case tear down of successfully run test case not only the WARN message is logged but the whole test case is failed - to change this behaviour but keep test case failure if no vpp pid (or more vpp pids) detected in test case setup the low level KW "Get VPP PID" behaviour has been changed to return one or more pids or None w/o raising an error and check has been moved to higher level KW "Save VPP PIDs" - there was added suite name and test case name to WARN message when no pid or more pids detected in the test case tear down Change-Id: I04f8d81c1ca48a1e4a45bd0e58f00d36d51c6933 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-28 Add the DPDK l3fwd performance test case.Fangyin Hu1-0/+43
fix some code style issue and rebase the code. change the DPDK l3fwd test case name and rebase the code. fix the pylint errors. change the DPDK version to 17.05 Rebase the code. Fix the l3fwd test code like the l2fwd. Fix the run l3fwd script issues. Rebase the code and review. Fix the l3fwd script issues. verify-perf-dpdk-long Change-Id: I5c5625ebcd5ff16f47fbee361789be3fece1ddbc Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias1-5/+110
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias1-10/+6
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias15-135/+200
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil1-4/+350
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-05Use 'Qemu Kill All' in perf test teardownJan Gelety1-3/+3
- replace 'Qemu Kill' KW by 'Qemu Kill All' - use self.qemu_kill_all() in case of qemu_start(self) failure Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-03HC Test: Update honeycomb suite setupselias1-6/+6
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-04-25Vhost testsMatej Klotton1-0/+47
Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-04-25CSIT-534 HC Test: policer testsjan.hradil1-0/+163
Added empty lines where needed Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-19Use QEMU virtio queue size 1024 for perf testsJan Gelety1-6/+6
- use Build QEMU KW to apply patch to increase default virtio queue size - remove Set Scheduler Policy Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-18HC Test: update persistence suiteselias1-1/+23
- fix "enable persistence" is suite setup - update Jira links to persistence bug - log content of persistence file before each restart Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7 Signed-off-by: selias <samelias@cisco.com>
2017-04-18CSIT-545: Performance tests for SNATTibor Frank3-0/+195
- High level definition (HLD) - Low level definition (LLD) - Add keywords to set SNAT - Add tests according to HLD, LLD Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-12IPsectptLispGpe performance test suitepmikus1-16/+62
*[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes. *[Enc] Packet Encapsulations:* IPv4-IPSec-LISPGPE-IPv4. *[Cfg] DUT configuration:* Each DUT is configured with LISP and IPsec. IPsec is in transport mode. Tests cases are for IPsec configured both on RLOC interface. Change-Id: I7a95baf0305caac3d9f0702bbedb3feec27f1668 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-11CSIT-529 HC Test: SLAACjan.hradil1-0/+106
Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-10IPsec Multi-Tunnel performance test suiteKirill Rybalchenko3-7/+100
Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566 Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>
2017-04-09CSIT-441 vhost - Parametrized qemu installpmikus1-2/+25
Update the current QEMU installation script with option to override QEMU installation and to apply additional patches. Additional patches are applied from qemu_patches directory and subdir for specific QEMU version by run-parts. This means that all patches for particular version are applied. All keywords for build QEMU are updated. Change-Id: I0c874a96ac828dff657ee33eb87d88a8854128ad Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-07CSIT-553 Make QEMU bin configurablepmikus1-6/+12
Add option to set path for QEMU binary and make it configurable in perf testaces as global variable. Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-03Make testpmd txd/rxd/txq/rxq configurable in guestpmikus1-2/+6
- Add option to configure vring qsz for testpmd when running in guest [make 256 as default] - Add option to configure number of queues for testpmd when running in guest [make 1 as default] Change-Id: I4ecd24ba4a24d6d212b10cd6d24f5b016fb63fd9 Signed-off-by: pmikus <pmikus@cisco.com>