aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot
AgeCommit message (Collapse)AuthorFilesLines
2017-04-18CSIT-545: Performance tests for SNATTibor Frank3-0/+195
- High level definition (HLD) - Low level definition (LLD) - Add keywords to set SNAT - Add tests according to HLD, LLD Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-12IPsectptLispGpe performance test suitepmikus1-16/+62
*[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes. *[Enc] Packet Encapsulations:* IPv4-IPSec-LISPGPE-IPv4. *[Cfg] DUT configuration:* Each DUT is configured with LISP and IPsec. IPsec is in transport mode. Tests cases are for IPsec configured both on RLOC interface. Change-Id: I7a95baf0305caac3d9f0702bbedb3feec27f1668 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-11CSIT-529 HC Test: SLAACjan.hradil1-0/+106
Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-10IPsec Multi-Tunnel performance test suiteKirill Rybalchenko3-7/+100
Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566 Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>
2017-04-09CSIT-441 vhost - Parametrized qemu installpmikus1-2/+25
Update the current QEMU installation script with option to override QEMU installation and to apply additional patches. Additional patches are applied from qemu_patches directory and subdir for specific QEMU version by run-parts. This means that all patches for particular version are applied. All keywords for build QEMU are updated. Change-Id: I0c874a96ac828dff657ee33eb87d88a8854128ad Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-07CSIT-553 Make QEMU bin configurablepmikus1-6/+12
Add option to set path for QEMU binary and make it configurable in perf testaces as global variable. Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-03Make testpmd txd/rxd/txq/rxq configurable in guestpmikus1-2/+6
- Add option to configure vring qsz for testpmd when running in guest [make 256 as default] - Add option to configure number of queues for testpmd when running in guest [make 1 as default] Change-Id: I4ecd24ba4a24d6d212b10cd6d24f5b016fb63fd9 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-03CSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUTJan Gelety1-0/+42
- 10ge2p1x520-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc Change-Id: I9dc6888d5b94922835fa0fcae2b0763b3a1fa9a3 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-03HC Test: revert to using restconf over httpselias1-0/+1
- use http instead of https for restconf connection - add missing import to proxyARP robot library - use VAT interface dump to identify interfaces in VAT ip address dump Change-Id: Ic381ff3f9b56a6c633382450559134f5389956c2 Signed-off-by: selias <samelias@cisco.com>
2017-03-30HC Test: SPAN Port Mirroring Suitejan.hradil1-5/+28
Change-Id: Ideaae09aa0d062460f5dfb3e3732dee67d6a5aea Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-03-30HC Test: address and cleanup test failuresselias2-6/+3
Change-Id: If3c570dbc5036915fdc68ade7a9ccc45ad21299e Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-532 HC Test: IPv6 Neighbor Discovery proxyselias1-2/+120
Change-Id: I6495726a814e116191f7a183be71c661466e7053 Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-526 HC test: DHCP relayselias1-0/+94
Change-Id: I00d841bee1e5139a4530ce97d8bda17780caa0f1 Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-548: Add x520 IP4base perf test with 2 VMs per DUTJan Gelety1-3/+204
- 10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc Change-Id: I3f978914e11308898f3281183687b1a0f6c74ed2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-29Virl test: dot1q ip4baseMatej Klotton1-0/+26
Change-Id: I070bdbb0ea9cb609cb367ad744f7ad569b7115b9 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-03-27CSIT-547: Add x520 L2BD perf test with 2 VMs per DUTJan Gelety2-9/+109
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc Change-Id: If65a7cf21d1dbff88f39f319877d9ac1fc5d959e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-21CSIT-536 HC Test: support testing with ODL clientselias2-4/+34
Reuses existing restconf test cases to test Honeycomb's netconf interface. When seding the requests to ODL's Honeycomb mountpoint, ODL translates these requests to netconf RPCs. Add new tag "honeycomb_odl" that excludes incompatible test cases. Change-Id: Ie293449da0129b02db85e30aa4f3266928d7d9f6 Signed-off-by: selias <samelias@cisco.com>
2017-03-17CSIT-528 HC Test: proxyARP test suiteselias1-0/+74
Change-Id: I1f99d38aadee22a7354a1f89e9d7f395a401c96c Signed-off-by: selias <samelias@cisco.com>
2017-03-15HC Test: update URL paths for vpp-aclselias1-4/+5
- needed due to v3po model split https://gerrit.fd.io/r/5530 Change-Id: I8a82c22f1999e81e3bb19b287be3cf3c01b50333 Signed-off-by: selias <samelias@cisco.com>
2017-03-15CSIT-523 HC Test: routingselias1-0/+203
- add routing test suite, variables and keywords Change-Id: I57e180350c30221befe8d1fc4e3b146d394c4f5d Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: add test for vlan sub-interface ipv6 addressselias2-11/+129
Change-Id: I93e0e4caf9b8ed1be824c7f75f348c30e567b75f Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: create Vlan sub-interface using netconfselias1-2/+3
- add netconf test for specific issue HC2VPP-60 Change-Id: I8fc64bce40f1e43d93e7e92c952e564151bc8232 Signed-off-by: selias <samelias@cisco.com>
2017-03-10SPAN test - improvement of packet checkJan Gelety1-2/+2
Change-Id: Ic95fbe288495ee4cd75178d74c220f6af5d2b11a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-08CSIT-530: Add common setup and teardown to perf testsTibor Frank1-42/+108
Change-Id: I2e76de710b4b758eac1d24d447a9c5938f937385 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-03-01Remove unused VRF paramter from IP neighbour Add/delNeale Ranns1-2/+2
Change-Id: I4a348c696e4cacbf5aa0723f2b8070bbcce7666c Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-02-27CSIT-339: Add Keywords for SMTTibor Frank3-238/+458
- modify keywords in CpuUtils.py - add RF keywords Change-Id: I57230b3948254e8f149b2563a8e24e948bc2ec27 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-24VIRL test: Dot1Q-L2BD-vhost_user test (CSIT-502)Matej Klotton1-8/+26
- Create test cases to test Dot1Q+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I0823e2d22a36fce236c037cfda27d588ebcd1cc5 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-24CSIT-522 HC Test: tests for secondary IP addressselias1-22/+327
- fix and update ipv4 and ipv6 tests - add tests for ipv6 neighbor and vrf-id - add tests for secondary IP address on ipv4, ipv6 Change-Id: I1e422e61108493a63a65ad91f649e69dfff0842f Signed-off-by: selias <samelias@cisco.com>
2017-02-23Add pypcap python requirementMatej Klotton2-6/+10
Using pypcap's L2listen instead of standard AF_PACKET scapy can see received Dot1Q tag. Change-Id: Icb3dcb272a9611158a26a83fede7550bba3f367e Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-23QemuUtil lib change to work with ubuntu and centosMatej Klotton1-1/+1
- replace nc to socat for comunicating with qemu QGA - change disk type to use virtio driver - add check to bind only network interface for testpmd Change-Id: I19ab16cbd8fec1ec78263ccfb1309a144e5af845 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-15HC Test: ACL updatesselias1-28/+78
- update low level ACL based on yang model changes - remove ietf-ACL test suite and test data and keywords - add ACL-plugin test suite, test data and keywords The ietf model of ACLs is no longer supported in Honeycomb. It has been replaced by the ACL plugin. Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9 Signed-off-by: selias <samelias@cisco.com>
2017-02-13Introduce simple VAT history per test caseJan Gelety1-1/+4
- print list of VAT commands executed per DUT node during the test case in the func test teardown Change-Id: I18a750ebfb7560eff9f5c4f0826ef84c3f64b4a8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-10CSIT-518: Add testpmd numa awarenessTibor Frank1-33/+19
Change-Id: I982834de1fbe71cf5303808ea58d4b58e530ffcb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-03CSIT-516: Add keywords for 2-node topologyTibor Frank2-21/+130
Change-Id: Ib5a1e207f1dec99747329a755c3c365fef4bd64c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias3-19/+16
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-26Fix: Display of PDR latencypmikus1-3/+7
Fix the string in PDR latency output Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-26CSIT-512: Add x710, xl710 l2bd vhost testsTibor Frank1-24/+51
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank1-2/+82
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-19Add unified latency output for PDRDISC and NDRDISCpmikus1-5/+7
Add same latency formatting for PDR as for NDR search results. This will help us to parse the data in same way. Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-17VIRL test: Replace IP probe for VXLAN testMatej Klotton1-2/+5
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-13VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)Jan Gelety2-19/+44
- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-11 Add the DPDK l2fwd performance test cases.Fangyin Hu2-9/+146
Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-01-10CSIT-482: HC Test - NATselias1-0/+174
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2017-01-10CSIT-499: Perf Tests - VXLAN + L2BD + vhostTibor Frank1-0/+44
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04CSIT-498: Packet throughput L2BD with VXLANoIPv4Tibor Frank1-0/+23
- Add performance tests for packet throughput L2BD with VXLANoIPv4 Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias1-0/+324
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-424: HC Test: JSON comparison function reworkselias3-5/+3
When comparing multi-level JSON trees, the exceptions raised carry more useful information. Keys and values not present in reference data are ignored. No longer puts chunks of honeycomb's log file into robot report. The entire log file will be archived after https://gerrit.fd.io/r/4171 Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7 Signed-off-by: selias <samelias@cisco.com>
2016-12-16Pylint fixesTibor Frank1-1/+1
- Fix PyLint errors - Fix comments in touched python modules Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias1-1/+13
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-14vhost perf testing with Qemu 5t5pcpmikus1-12/+10
Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is not enough anymore as we are testing VPP with 4t4pc. This patch is supposed to increase the number of core used by testpmd. Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27 Signed-off-by: pmikus <pmikus@cisco.com>