aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-04-07CSIT-553 Make QEMU bin configurablepmikus1-1/+5
Add option to set path for QEMU binary and make it configurable in perf testaces as global variable. Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-07HC Test: update ACL-plugil test suiteselias1-4/+12
- add EXPECTED_FAILING tags to IPv6 cases, next-header 17 (UDP) does not hit the classify node - fix MAC address mixup in reflexive cases Change-Id: I3d2a6c73835e23b6755b033ac3a0cc3f28d932df Signed-off-by: selias <samelias@cisco.com>
2017-04-06CSIT-552: Add xl710 perf test with 2 VMs per DUTJan Gelety3-0/+1812
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc - 40ge2p1xl710-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc - 40ge2p1xl710-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc Change-Id: I2d2f8e9b8966bd6e19014cf7a234c3c02bb9251c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-03CSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUTJan Gelety2-25/+589
- 10ge2p1x520-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc Change-Id: I9dc6888d5b94922835fa0fcae2b0763b3a1fa9a3 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-03HC Test: revert to using restconf over httpselias1-1/+1
- use http instead of https for restconf connection - add missing import to proxyARP robot library - use VAT interface dump to identify interfaces in VAT ip address dump Change-Id: Ic381ff3f9b56a6c633382450559134f5389956c2 Signed-off-by: selias <samelias@cisco.com>
2017-03-30HC Test: SPAN Port Mirroring Suitejan.hradil1-35/+76
Change-Id: Ideaae09aa0d062460f5dfb3e3732dee67d6a5aea Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-03-30HC Test: address and cleanup test failuresselias6-64/+37
Change-Id: If3c570dbc5036915fdc68ade7a9ccc45ad21299e Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-532 HC Test: IPv6 Neighbor Discovery proxyselias2-1/+109
Change-Id: I6495726a814e116191f7a183be71c661466e7053 Signed-off-by: selias <samelias@cisco.com>
2017-03-30HC Test: support testing using ipv6 management interface and httpsselias2-2/+2
Change-Id: Ia38388a87171ad3bec7307f9ca74eaa99adc2624 Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-526 HC test: DHCP relayselias1-0/+119
Change-Id: I00d841bee1e5139a4530ce97d8bda17780caa0f1 Signed-off-by: selias <samelias@cisco.com>
2017-03-30Update: NDRCHK rate values and typospmikus22-322/+322
Change-Id: I6c8c4f73cb69f53e0ad3ac96a566c4a6272b6d17 Signed-off-by: pmikus <pmikus@cisco.com>
2017-03-30Fix: Naming of perf suites following conventionspmikus38-0/+0
Change-Id: I39c3b6b1555a165f2103068a5296d92e0210f221 Signed-off-by: pmikus <pmikus@cisco.com>
2017-03-30CSIT-548: Add x520 IP4base perf test with 2 VMs per DUTJan Gelety4-17/+584
- 10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc Change-Id: I3f978914e11308898f3281183687b1a0f6c74ed2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-29Virl test: dot1q ip4baseMatej Klotton1-0/+107
Change-Id: I070bdbb0ea9cb609cb367ad744f7ad569b7115b9 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-03-27CSIT-547: Add x520 L2BD perf test with 2 VMs per DUTJan Gelety2-0/+565
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc Change-Id: If65a7cf21d1dbff88f39f319877d9ac1fc5d959e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-21CSIT-536 HC Test: support testing with ODL clientselias19-42/+53
Reuses existing restconf test cases to test Honeycomb's netconf interface. When seding the requests to ODL's Honeycomb mountpoint, ODL translates these requests to netconf RPCs. Add new tag "honeycomb_odl" that excludes incompatible test cases. Change-Id: Ie293449da0129b02db85e30aa4f3266928d7d9f6 Signed-off-by: selias <samelias@cisco.com>
2017-03-17CSIT-528 HC Test: proxyARP test suiteselias1-0/+80
Change-Id: I1f99d38aadee22a7354a1f89e9d7f395a401c96c Signed-off-by: selias <samelias@cisco.com>
2017-03-15CSIT-523 HC Test: routingselias1-0/+211
- add routing test suite, variables and keywords Change-Id: I57e180350c30221befe8d1fc4e3b146d394c4f5d Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: add test for vlan sub-interface ipv6 addressselias2-6/+65
Change-Id: I93e0e4caf9b8ed1be824c7f75f348c30e567b75f Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: add test for vlan sub-interface exact tag matchselias1-3/+20
Change-Id: Ie5feb1ac6c46f447a20d388680fc19854f2c7ef6 Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: create Vlan sub-interface using netconfselias1-0/+8
- add netconf test for specific issue HC2VPP-60 Change-Id: I8fc64bce40f1e43d93e7e92c952e564151bc8232 Signed-off-by: selias <samelias@cisco.com>
2017-03-10SPAN test - improvement of packet checkJan Gelety2-9/+11
Change-Id: Ic95fbe288495ee4cd75178d74c220f6af5d2b11a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-08CSIT-530: Add common setup and teardown to perf testsTibor Frank61-2828/+2691
Change-Id: I2e76de710b4b758eac1d24d447a9c5938f937385 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-03-01Remove unused VRF paramter from IP neighbour Add/delNeale Ranns17-85/+63
Change-Id: I4a348c696e4cacbf5aa0723f2b8070bbcce7666c Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-02-27HC Test: update plugin-ACL testsselias1-20/+29
- improve packet trace logging after each test - suppress IPv6RA on VPP because it interfered with ipv6 test cases - do not use fictional destination MAC address, doesn't work in VIRL - ignore errors when logging configuration - should not fail the test Change-Id: I16a3321670d4c2fa8f6434dc4badd243b7e4f9fc Signed-off-by: selias <samelias@cisco.com>
2017-02-27CSIT-339: Add Keywords for SMTTibor Frank2-72/+72
- modify keywords in CpuUtils.py - add RF keywords Change-Id: I57230b3948254e8f149b2563a8e24e948bc2ec27 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-24VIRL test: Dot1Q-L2BD-vhost_user test (CSIT-502)Matej Klotton1-0/+145
- Create test cases to test Dot1Q+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I0823e2d22a36fce236c037cfda27d588ebcd1cc5 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-24CSIT-522 HC Test: tests for secondary IP addressselias1-14/+126
- fix and update ipv4 and ipv6 tests - add tests for ipv6 neighbor and vrf-id - add tests for secondary IP address on ipv4, ipv6 Change-Id: I1e422e61108493a63a65ad91f649e69dfff0842f Signed-off-by: selias <samelias@cisco.com>
2017-02-23VIRL test: eth2p-ethip4-ip4base-eth-2vhost-1vmMatej Klotton1-0/+98
Change-Id: Icd21df2568df78f83f67d6ce36491afecb91d8f9 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-22The interface must be assigned to the VRF and then given a prefixNeale Ranns4-6/+6
Change-Id: I6a2fc503989576f806413ae98845e3e3676889b8 Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-02-16HC Test: address job failuresselias3-3/+5
- make HC package download script correctly use the OS variable - force HC restart after netconf suite, to clean up leftover interfaces - remove EXPECTED_FAILING tag from vhost-user suite, VPP bug was fixed - add EXPECTED_FAILING tag to reflexive test case of plugin-acl suite Change-Id: Id56eb52a5e22718de31aa5bef27159a5a531b244 Signed-off-by: selias <samelias@cisco.com>
2017-02-15HC Test: ACL updatesselias2-375/+700
- update low level ACL based on yang model changes - remove ietf-ACL test suite and test data and keywords - add ACL-plugin test suite, test data and keywords The ietf model of ACLs is no longer supported in Honeycomb. It has been replaced by the ACL plugin. Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9 Signed-off-by: selias <samelias@cisco.com>
2017-02-13Introduce simple VAT history per test caseJan Gelety24-140/+57
- print list of VAT commands executed per DUT node during the test case in the func test teardown Change-Id: I18a750ebfb7560eff9f5c4f0826ef84c3f64b4a8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-02Mark ipv4 ipfix test as non-criticalMatej Klotton2-2/+2
Change-Id: I8998cbc08979340a680d872fab48bfeca8091365 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias15-82/+59
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-27HC Test: Workaround for 17.04 jvpp version mismatchselias2-1/+3
- add workaround for mismatched jvpp versions in deb packages - disable NSH_SFC madule and test suite, it depends on outdated jvpp - cleanup package download script used in hc2vpp-csit-verify job Change-Id: I98526baa4de08bbbab2339c9e81f49cd189b57ac Signed-off-by: selias <samelias@cisco.com>
2017-01-27CSIT-507: Add perf tests for Cisco VIC-1385 L2BDMiroslav Miklus1-0/+348
- 40ge2p1vic1385-eth-l2bdbasemaclrn-ndrdisc Change-Id: I8e1f49b5d41a81544b8a03dd2d6be98c97b94d28 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2017-01-27CSIT-508: Add perf tests for Cisco VIC-1227 L2BDMiroslav Miklus1-0/+286
- 10ge2p1vic1227-eth-l2bdbasemaclrn-ndrdisc Change-Id: Ib0e99f8160ca951b58b0244de88fa587e61bd941 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2017-01-26CSIT-512: Add x710, xl710 l2bd vhost testsTibor Frank2-0/+1338
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-26csit-func-hc naming changeselias18-86/+86
- change test suite filenames - add numbering to all test cases more details at https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: I58e6c60f750c07e99c6949d8fe2510780fa9007a Signed-off-by: selias <samelias@cisco.com>
2017-01-25Remove _base from test suite dir namesJan Gelety21-0/+0
Change-Id: I2e495f99a88dedc47f64efcc14722bb629a25f02 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24csit-func-tc-naming-change - phase 1Jan Gelety95-3395/+5494
- change of ts directories - change of ts file names - splitting of former files to more files when suitable - more details: https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: Ifda1038f8323735f86c1be7ba7f93e3fda183618 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank3-1/+1411
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-20Mark VXLAN test as non criticalMatej Klotton1-0/+1
Change-Id: I1a788de4106d7e71d8cad6b68759b9a01d21bb4a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-19Fix: Adjust NDRCHK threshold valuespmikus2-12/+12
Adjust treshold values in NDRCHK tests based on latest data. Change-Id: I10f39b9a1a071bf0b38c91f904361ad7f54ccc92 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-18Renaming of all perf TCs.Tibor Frank54-937/+973
Change-Id: Id71abf4f52d7fc555ed9c3ec19563d54f5db9ec5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-17VIRL test: Replace IP probe for VXLAN testMatej Klotton1-0/+4
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-13VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)Jan Gelety1-8/+141
- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-12CSIT-501: Perf tests re-taggingTibor Frank54-904/+848
- Implement tags introduced by https://gerrit.fd.io/r/#/c/3856/ Change-Id: I59313f43f338e2b4a1ad5caf9521b1a0da84d1d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-10CSIT-482: HC Test - NATselias1-0/+104
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>