aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-02-16HC Test: address job failuresselias4-4/+6
- make HC package download script correctly use the OS variable - force HC restart after netconf suite, to clean up leftover interfaces - remove EXPECTED_FAILING tag from vhost-user suite, VPP bug was fixed - add EXPECTED_FAILING tag to reflexive test case of plugin-acl suite Change-Id: Id56eb52a5e22718de31aa5bef27159a5a531b244 Signed-off-by: selias <samelias@cisco.com>
2017-02-16Fix ssh prompts for centosMatej Klotton2-4/+6
Change-Id: I864f97b4559fc1d692bfba80266150a3d06dd6bb Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-16CSIT-514: Kill Qemu when it does not respondTibor Frank3-4/+12
Change-Id: Id13c7fd51e693a273637c80cb35a159434be4826 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-15Fix Centos Virl deployment and image build want listMatej Klotton3-25/+23
Change-Id: I65d54fff4f936444bed3382ee21a260cf718bafd Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-15HC Test: ACL updatesselias11-807/+1495
- update low level ACL based on yang model changes - remove ietf-ACL test suite and test data and keywords - add ACL-plugin test suite, test data and keywords The ietf model of ACLs is no longer supported in Honeycomb. It has been replaced by the ACL plugin. Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9 Signed-off-by: selias <samelias@cisco.com>
2017-02-15HC Test: Update sNAT tests due to API changesselias2-6/+13
- add protocol value to expected VAT data - add protocol value to snat_static_mapping_dump parser - add temp workaround for returned "error:misc" on Ubuntu14.04 Change-Id: I42776b62b04eac65d03dcae1ec6a386a765b2e52 Signed-off-by: selias <samelias@cisco.com>
2017-02-15HC Test: Add temporary workaround for VAT issues on Ubuntu14.04selias1-0/+18
Some VAT commands return "error:misc" in addition to their normal JSON output. This causes the JSON parser to complain about extra data. Change-Id: I0da9739f371998dd6e2e6d6f70c1e8a3d82b6350 Signed-off-by: selias <samelias@cisco.com>
2017-02-14HC Test: Add branch and os parameters to honeycomb scriptsselias4-37/+94
- partial cherrypick of https://gerrit.fd.io/r/4933 - add OS argument to scripts in preparation for Ubuntu16 and Centos7 Change-Id: I14119703be0f73766a731478e09e0126078f84ba Signed-off-by: selias <samelias@cisco.com>
2017-02-13Introduce simple VAT history per test caseJan Gelety27-143/+159
- print list of VAT commands executed per DUT node during the test case in the func test teardown Change-Id: I18a750ebfb7560eff9f5c4f0826ef84c3f64b4a8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-13Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.04-rc0~231-ge4ad8cc~b1855_amd64 - build tested by semiweekly job: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/1/ Change-Id: Ibd405c9de7dd75c3ab989987487bbbe4405d006e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-10CSIT-518: Add testpmd numa awarenessTibor Frank12-1878/+259
Change-Id: I982834de1fbe71cf5303808ea58d4b58e530ffcb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-09Enable to pass vpp pacakges to VIRL in case of vpp patchJan Gelety1-2/+2
Change-Id: Ibab23153b698470e640530c44d95ca6f3c4898b2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-09Upgrade T-rex to newer versionPeter Mikus5-6/+6
Change-Id: I8b918a3c1d8109fb64bfdeec8e5c9afe45a86d21 Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-08csit rls1701 report nits and updates:Maciek Konstantynowicz15-30/+72
- Completed paragraph for each thput and latency graph in report describing: graphs title, x-axis, y-axis, legend. Change-Id: Ia45e2da2623b909123f6b3d4abe65e6caf72e058 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-02-07Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: - build tested by semiweekly job: 17.04-rc0~200-g460bc63~b1824_amd64 https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1080/ Change-Id: I5a17095bccf1e8b11dc2a0f52cfd27a8621f6f74 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-07CSIT-517: DPDK initialization and teardownTibor Frank4-42/+68
Change-Id: Iff42549e3be610c88b7a7d5518ef2cbb88c75ed2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-07CSIT doc autogen: Add media wiki formatTibor Frank1-8/+54
Change-Id: I4231cf4f056b2370e0a7a7f8a7267859bbeccd6f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-07Add perf tests for DPDK L2XCTibor Frank4-0/+1648
- 10ge2p1vic1227-eth-l2xcbase-ndrdisc - 10ge2p1x710-eth-l2xcbase-ndrdisc - 40ge2p1vic1385-eth-l2xcbase-ndrdisc - 40ge2p1x1710-eth-l2xcbase-ndrdisc Change-Id: I1bd125c5d384fbece47d885a950226990e801837 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-06Fix: Add apt-get update for report-genPeter Mikus1-1/+2
Change-Id: Id98c370be0a74b16667dd3b43fc44e36c286fdf0 Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-06csit rls1701 report edits:Maciek Konstantynowicz76-915/+1351
- simplified section structure for clarity and readability, - updated overview sections, - moved not rls related content from rls_notes to overview sections, - removed section title suffixes: HW, VIRL. - completed vpp_unit_tests and vpp_unittest_results sections. - updated all documentation sections. - updated rls_notes sections for vpp performance and vpp functional. Change-Id: Id2c2abbf9d3531ec9f63ecd353f385a0b55ae1ba Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-02-03Revert "Fix: CSIT 1701 report files and script AD1"Peter Mikus1-1/+1
This reverts commit 8e3e798d302bef12d490c2963056bbcceedb8b13. Change-Id: I90c40e51b2f0e364ca33fb92fa36f8cae3e5829c Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-03Fix: CSIT 1701 report files and script AD1Peter Mikus1-1/+1
fix libxslt-dev package Change-Id: I9ee8f23faa3a30a4e5894045b8375f983d05adc1 Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-03CSIT 1701 report files and script AD1pmikus26-2209/+2504
CSIT 1701 report files and script addendum 1 Edits to correct and align all Overview sub-sections. Updates in Performance CSIT Release Notes - added more NDR and PDR performance changes. Change-Id: I52b6ee89e9c536fb4ab9d30dc27cca8dbdd88a20 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-03Fix: Timeout during VPP installationPeter Mikus1-2/+2
Increase timeout during installation of VPP packages to 60s. Change-Id: I9384564a45951bbfb648c99f25d8de70b79ab783 Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-03CSIT-516: Add keywords for 2-node topologyTibor Frank3-23/+156
Change-Id: Ib5a1e207f1dec99747329a755c3c365fef4bd64c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-02Mark ipv4 ipfix test as non-criticalMatej Klotton2-2/+2
Change-Id: I8998cbc08979340a680d872fab48bfeca8091365 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-01CSIT 1701 report files and scriptpmikus61-0/+16068
Add RST source files and script to generate CSIT 1701 report Change-Id: I4345564547270ba10c64d6beebf2c2b5a83de459 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-31CSIT doc: Add chapter numberingTibor Frank5-76/+72
Change-Id: I5cdcda0461e6f4bdabd91ea440edf7a71db9afd9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-30HC Test: Fix jvpp workaround for 17.04selias1-2/+2
- original commit at https://gerrit.fd.io/r/4683 Change-Id: I0b2d77f66830fbbc2d27e9015ec67ea9cd9a9885 Signed-off-by: selias <samelias@cisco.com>
2017-01-30Add exception processing to output.xml parserTibor Frank2-23/+43
Change-Id: Ie7d7a004ae540233efcb3c3114d46d40d5d1f07d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-30Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.04-rc0~175-gd9aad29~b1798_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1078/ Change-Id: Ib51e4fc98edf463ea440dbeb655956382e11b5c6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias25-124/+155
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-27HC Test: Workaround for 17.04 jvpp version mismatchselias5-48/+60
- add workaround for mismatched jvpp versions in deb packages - disable NSH_SFC madule and test suite, it depends on outdated jvpp - cleanup package download script used in hc2vpp-csit-verify job Change-Id: I98526baa4de08bbbab2339c9e81f49cd189b57ac Signed-off-by: selias <samelias@cisco.com>
2017-01-27CSIT-507: Add perf tests for Cisco VIC-1385 L2BDMiroslav Miklus1-0/+348
- 40ge2p1vic1385-eth-l2bdbasemaclrn-ndrdisc Change-Id: I8e1f49b5d41a81544b8a03dd2d6be98c97b94d28 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2017-01-27CSIT-508: Add perf tests for Cisco VIC-1227 L2BDMiroslav Miklus2-0/+294
- 10ge2p1vic1227-eth-l2bdbasemaclrn-ndrdisc Change-Id: Ib0e99f8160ca951b58b0244de88fa587e61bd941 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2017-01-27Add Centos specific bootstrap files.Thomas F Herbert8-366/+1215
Add download and install script for rpms. Add topology virl file for Centos. Change VPP repo urls for centos. JIRA: CSIT-356 Change-Id: I3a0a88958a712d1b652f19c76e5e1b019796d0ae Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2017-01-26Fix: Display of PDR latencypmikus1-3/+7
Fix the string in PDR latency output Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-26CSIT-511: Add script to generate report with TC resultsTibor Frank1-100/+286
Change-Id: Iee1c3310e445487bb216c4e9c6a3bc7ee7879788 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-26CSIT-512: Add x710, xl710 l2bd vhost testsTibor Frank3-24/+1389
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-26csit-func-hc naming changeselias18-86/+86
- change test suite filenames - add numbering to all test cases more details at https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: I58e6c60f750c07e99c6949d8fe2510780fa9007a Signed-off-by: selias <samelias@cisco.com>
2017-01-26CSIT doc gen: remove "package" and change "module" to "suite"Tibor Frank1-5/+5
Change-Id: I36664eb4c1ade7c2c96df457ed939f8681ba2dce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-25Centos 7.3 image Version 1.2 Add dhcp client to VIRL base imageThomas F Herbert4-1/+70
Change-Id: Ibedc2002f26824cc763eb2ff62de09d5f262e0c3 Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2017-01-25Remove _base from test suite dir namesJan Gelety22-1/+1
Change-Id: I2e495f99a88dedc47f64efcc14722bb629a25f02 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24Correction of dpdk packages download when vpp deb packages providedJan Gelety3-10/+17
Change-Id: I7cefd0797103e5062eb48df95ad2e48cdddc19b6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24csit-func-tc-naming-change - phase 1Jan Gelety96-3396/+5495
- change of ts directories - change of ts file names - splitting of former files to more files when suitable - more details: https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: Ifda1038f8323735f86c1be7ba7f93e3fda183618 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank4-3/+1493
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-23Update of VPP_STABLE_VERJan Gelety5-7/+19
- use new vpp ref build: 17.04-rc0~134-g2ce7f98~b1759_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1076/ - use new path for DPDK packages Change-Id: I1001ee3a22817f97a60b3a6555e3026d2b153913 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-20Mark VXLAN test as non criticalMatej Klotton1-0/+1
Change-Id: I1a788de4106d7e71d8cad6b68759b9a01d21bb4a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-19Fix: Adjust NDRCHK threshold valuespmikus2-12/+12
Adjust treshold values in NDRCHK tests based on latest data. Change-Id: I10f39b9a1a071bf0b38c91f904361ad7f54ccc92 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-19Add unified latency output for PDRDISC and NDRDISCpmikus1-5/+7
Add same latency formatting for PDR as for NDR search results. This will help us to parse the data in same way. Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b Signed-off-by: pmikus <pmikus@cisco.com>