aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot
AgeCommit message (Collapse)AuthorFilesLines
2017-05-30Do not fail test case when no vpp pid detected in the tear downJan Gelety1-1/+8
- currently when no pid (or more pids) detected in the test case tear down of successfully run test case not only the WARN message is logged but the whole test case is failed - to change this behaviour but keep test case failure if no vpp pid (or more vpp pids) detected in test case setup the low level KW "Get VPP PID" behaviour has been changed to return one or more pids or None w/o raising an error and check has been moved to higher level KW "Save VPP PIDs" - there was added suite name and test case name to WARN message when no pid or more pids detected in the test case tear down Change-Id: I04f8d81c1ca48a1e4a45bd0e58f00d36d51c6933 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-28 Add the DPDK l3fwd performance test case.Fangyin Hu1-0/+43
fix some code style issue and rebase the code. change the DPDK l3fwd test case name and rebase the code. fix the pylint errors. change the DPDK version to 17.05 Rebase the code. Fix the l3fwd test code like the l2fwd. Fix the run l3fwd script issues. Rebase the code and review. Fix the l3fwd script issues. verify-perf-dpdk-long Change-Id: I5c5625ebcd5ff16f47fbee361789be3fece1ddbc Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias1-5/+110
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias1-10/+6
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias15-135/+200
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil1-4/+350
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-05Use 'Qemu Kill All' in perf test teardownJan Gelety1-3/+3
- replace 'Qemu Kill' KW by 'Qemu Kill All' - use self.qemu_kill_all() in case of qemu_start(self) failure Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-03HC Test: Update honeycomb suite setupselias1-6/+6
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-04-25Vhost testsMatej Klotton1-0/+47
Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-04-25CSIT-534 HC Test: policer testsjan.hradil1-0/+163
Added empty lines where needed Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-19Use QEMU virtio queue size 1024 for perf testsJan Gelety1-6/+6
- use Build QEMU KW to apply patch to increase default virtio queue size - remove Set Scheduler Policy Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-18HC Test: update persistence suiteselias1-1/+23
- fix "enable persistence" is suite setup - update Jira links to persistence bug - log content of persistence file before each restart Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7 Signed-off-by: selias <samelias@cisco.com>
2017-04-18CSIT-545: Performance tests for SNATTibor Frank3-0/+195
- High level definition (HLD) - Low level definition (LLD) - Add keywords to set SNAT - Add tests according to HLD, LLD Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-12IPsectptLispGpe performance test suitepmikus1-16/+62
*[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes. *[Enc] Packet Encapsulations:* IPv4-IPSec-LISPGPE-IPv4. *[Cfg] DUT configuration:* Each DUT is configured with LISP and IPsec. IPsec is in transport mode. Tests cases are for IPsec configured both on RLOC interface. Change-Id: I7a95baf0305caac3d9f0702bbedb3feec27f1668 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-11CSIT-529 HC Test: SLAACjan.hradil1-0/+106
Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-10IPsec Multi-Tunnel performance test suiteKirill Rybalchenko3-7/+100
Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566 Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>
2017-04-09CSIT-441 vhost - Parametrized qemu installpmikus1-2/+25
Update the current QEMU installation script with option to override QEMU installation and to apply additional patches. Additional patches are applied from qemu_patches directory and subdir for specific QEMU version by run-parts. This means that all patches for particular version are applied. All keywords for build QEMU are updated. Change-Id: I0c874a96ac828dff657ee33eb87d88a8854128ad Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-07CSIT-553 Make QEMU bin configurablepmikus1-6/+12
Add option to set path for QEMU binary and make it configurable in perf testaces as global variable. Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-03Make testpmd txd/rxd/txq/rxq configurable in guestpmikus1-2/+6
- Add option to configure vring qsz for testpmd when running in guest [make 256 as default] - Add option to configure number of queues for testpmd when running in guest [make 1 as default] Change-Id: I4ecd24ba4a24d6d212b10cd6d24f5b016fb63fd9 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-03CSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUTJan Gelety1-0/+42
- 10ge2p1x520-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc Change-Id: I9dc6888d5b94922835fa0fcae2b0763b3a1fa9a3 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-03HC Test: revert to using restconf over httpselias1-0/+1
- use http instead of https for restconf connection - add missing import to proxyARP robot library - use VAT interface dump to identify interfaces in VAT ip address dump Change-Id: Ic381ff3f9b56a6c633382450559134f5389956c2 Signed-off-by: selias <samelias@cisco.com>
2017-03-30HC Test: SPAN Port Mirroring Suitejan.hradil1-5/+28
Change-Id: Ideaae09aa0d062460f5dfb3e3732dee67d6a5aea Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-03-30HC Test: address and cleanup test failuresselias2-6/+3
Change-Id: If3c570dbc5036915fdc68ade7a9ccc45ad21299e Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-532 HC Test: IPv6 Neighbor Discovery proxyselias1-2/+120
Change-Id: I6495726a814e116191f7a183be71c661466e7053 Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-526 HC test: DHCP relayselias1-0/+94
Change-Id: I00d841bee1e5139a4530ce97d8bda17780caa0f1 Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-548: Add x520 IP4base perf test with 2 VMs per DUTJan Gelety1-3/+204
- 10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc Change-Id: I3f978914e11308898f3281183687b1a0f6c74ed2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-29Virl test: dot1q ip4baseMatej Klotton1-0/+26
Change-Id: I070bdbb0ea9cb609cb367ad744f7ad569b7115b9 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-03-27CSIT-547: Add x520 L2BD perf test with 2 VMs per DUTJan Gelety2-9/+109
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc Change-Id: If65a7cf21d1dbff88f39f319877d9ac1fc5d959e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-21CSIT-536 HC Test: support testing with ODL clientselias2-4/+34
Reuses existing restconf test cases to test Honeycomb's netconf interface. When seding the requests to ODL's Honeycomb mountpoint, ODL translates these requests to netconf RPCs. Add new tag "honeycomb_odl" that excludes incompatible test cases. Change-Id: Ie293449da0129b02db85e30aa4f3266928d7d9f6 Signed-off-by: selias <samelias@cisco.com>
2017-03-17CSIT-528 HC Test: proxyARP test suiteselias1-0/+74
Change-Id: I1f99d38aadee22a7354a1f89e9d7f395a401c96c Signed-off-by: selias <samelias@cisco.com>
2017-03-15HC Test: update URL paths for vpp-aclselias1-4/+5
- needed due to v3po model split https://gerrit.fd.io/r/5530 Change-Id: I8a82c22f1999e81e3bb19b287be3cf3c01b50333 Signed-off-by: selias <samelias@cisco.com>
2017-03-15CSIT-523 HC Test: routingselias1-0/+203
- add routing test suite, variables and keywords Change-Id: I57e180350c30221befe8d1fc4e3b146d394c4f5d Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: add test for vlan sub-interface ipv6 addressselias2-11/+129
Change-Id: I93e0e4caf9b8ed1be824c7f75f348c30e567b75f Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: create Vlan sub-interface using netconfselias1-2/+3
- add netconf test for specific issue HC2VPP-60 Change-Id: I8fc64bce40f1e43d93e7e92c952e564151bc8232 Signed-off-by: selias <samelias@cisco.com>
2017-03-10SPAN test - improvement of packet checkJan Gelety1-2/+2
Change-Id: Ic95fbe288495ee4cd75178d74c220f6af5d2b11a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-08CSIT-530: Add common setup and teardown to perf testsTibor Frank1-42/+108
Change-Id: I2e76de710b4b758eac1d24d447a9c5938f937385 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-03-01Remove unused VRF paramter from IP neighbour Add/delNeale Ranns1-2/+2
Change-Id: I4a348c696e4cacbf5aa0723f2b8070bbcce7666c Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-02-27CSIT-339: Add Keywords for SMTTibor Frank3-238/+458
- modify keywords in CpuUtils.py - add RF keywords Change-Id: I57230b3948254e8f149b2563a8e24e948bc2ec27 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-24VIRL test: Dot1Q-L2BD-vhost_user test (CSIT-502)Matej Klotton1-8/+26
- Create test cases to test Dot1Q+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I0823e2d22a36fce236c037cfda27d588ebcd1cc5 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-24CSIT-522 HC Test: tests for secondary IP addressselias1-22/+327
- fix and update ipv4 and ipv6 tests - add tests for ipv6 neighbor and vrf-id - add tests for secondary IP address on ipv4, ipv6 Change-Id: I1e422e61108493a63a65ad91f649e69dfff0842f Signed-off-by: selias <samelias@cisco.com>
2017-02-23Add pypcap python requirementMatej Klotton2-6/+10
Using pypcap's L2listen instead of standard AF_PACKET scapy can see received Dot1Q tag. Change-Id: Icb3dcb272a9611158a26a83fede7550bba3f367e Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-23QemuUtil lib change to work with ubuntu and centosMatej Klotton1-1/+1
- replace nc to socat for comunicating with qemu QGA - change disk type to use virtio driver - add check to bind only network interface for testpmd Change-Id: I19ab16cbd8fec1ec78263ccfb1309a144e5af845 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-15HC Test: ACL updatesselias1-28/+78
- update low level ACL based on yang model changes - remove ietf-ACL test suite and test data and keywords - add ACL-plugin test suite, test data and keywords The ietf model of ACLs is no longer supported in Honeycomb. It has been replaced by the ACL plugin. Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9 Signed-off-by: selias <samelias@cisco.com>
2017-02-13Introduce simple VAT history per test caseJan Gelety1-1/+4
- print list of VAT commands executed per DUT node during the test case in the func test teardown Change-Id: I18a750ebfb7560eff9f5c4f0826ef84c3f64b4a8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-10CSIT-518: Add testpmd numa awarenessTibor Frank1-33/+19
Change-Id: I982834de1fbe71cf5303808ea58d4b58e530ffcb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-03CSIT-516: Add keywords for 2-node topologyTibor Frank2-21/+130
Change-Id: Ib5a1e207f1dec99747329a755c3c365fef4bd64c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias3-19/+16
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-26Fix: Display of PDR latencypmikus1-3/+7
Fix the string in PDR latency output Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-26CSIT-512: Add x710, xl710 l2bd vhost testsTibor Frank1-24/+51
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank1-2/+82
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com>