aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-09-25Add memif to TEST_TAG casesJan Gelety1-0/+17
- implement possibility to manually triger memif perf tests in case of csit as well as vpp patch Change-Id: I6bec350a496ba138bcb8ffb8da01c81672187bac Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-22CSIT-796: l2bd-memif perf testsJan Gelety3-5/+285
Change-Id: Ic714fa7baec49dcba1a8eb6a578183c6771e3493 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-22Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- we need to use the latest vpp build were vpp runs correctly in lxc/docker with dpdk plugin disabled in CSIT - use new vpp ref build - ubuntu 16.04: 17.10-rc0~334-gce41a5c~b2870_amd64 - use new vpp ref build - centos7: 17.10-rc0~334_gce41a5c~b2867.x86_64 Change-Id: I87f306d0d7f6e78db8670a1969ae1a8e66b92c8a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-18Ignore unexpected ICMPv6 Neighbor Discovery - Neighbor Solicitation packetsJan Gelety22-424/+631
We need to adapt all functional traffic scripts related to functional IPv6 tests to ingore receiving of unexpected ICMPv6ND_NS (ICMPv6 Neighbor Discovery - Neighbor Solicitation) packets that are sent automatically and we cannot avoid to receive them. The reason is to prevent false negative test results in case of csit functional tests that could block creation of new operational branch (csit weekly jobs), usage of new vpp builds (csit semiweekly jobs) and merging patches - csit as well as vpp. Change-Id: I43c90e7c766762fa769a81661338759a11b401a1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-18Update of VPP_STABLE_VER files and DPDK_STABLE_VER fileJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~337-g2f9b0c0~b2873_amd64 - use new vpp ref build - centos7: 17.10-rc0~337_g2f9b0c0~b2870.x86_64 - use new dpdk version> 17.08-vpp1 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/73/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/73/ Change-Id: I20245e50f5acf93af5d2f2bfae0307f7774f0c3b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-08CSIT-665: Re-write L1 robot keywords in pythonDasa Simkova8-108/+148
Change-Id: Iddd823375ddd17b9abd5f02ee3aea3bfcb625149 Signed-off-by: Dasa Simkova <dspropagacie@gmail.com>
2017-09-06HC Test: re-enable NSH tests, minor fixesselias9-61/+43
NSH plugin was fixed in https://gerrit.fd.io/r/8218 - updated lispGPE test data - added missing teardown to multi-IP traffic test - marked L2-fib update revert case as failing Change-Id: I5cf8c718e808d5d8cb69e2f769c829c868bf9924 Signed-off-by: selias <samelias@cisco.com>
2017-09-04Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~263-gedfa2fd~b2799_amd64 - use new vpp ref build - centos7: 17.10-rc0~263_gedfa2fd~b2796.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/69/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/69/ Change-Id: I510d288a4a5444f980769d7fd13ab1ff46d227a5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-04CSIT-786 L2FIB scale testingPeter Mikus11-76/+2320
L2FIB scale testing for 10k, 100k, 1m FIB entries ./l2: 10ge2p1x520-eth-l2bdscale10kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale1mmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale10kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale100kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale1mmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc Change-Id: I7e3884bd5ab5294c289030a3465ec5b6def83cf7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-03Update T-rex to v2.29Peter Mikus5-5/+5
Change-Id: Id60525182cbe5870f40aebf165e8bd86c101d267 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28FIX: SNAT -> NAT renaming of APIPeter Mikus31-479/+459
- Based on https://gerrit.fd.io/r/#/c/8146/ Change-Id: I774483c7e2b419a9b9b6be78812ecf53a5c91eab Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28Fix: Do not validate LXC imagePeter Mikus1-2/+3
Change-Id: I476f463ad7dd91f1d80a1e4b537a2cb3dd4ddee5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28Update of VPP_STABLE_VER filesPeter Mikus2-2/+2
- use new vpp ref build - ubuntu 16.04: vpp-17.10-rc0~206-g5f22f4d~b2740_amd64-deb - build tested by semiweekly job: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/???/ NOTE: centos7 build not updated because of issue with deletion of tap interface Change-Id: I1df4c10f40d983952c1dad4a94f2dcdb2534c00e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-25Update T-rex to v2.28Peter Mikus5-5/+5
Change-Id: I506589c3785eec3a2eaa9fdb32bfc3375388d6f4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-25HC Test: Disable NSH plugin installation and testsselias3-11/+15
- VPP refuses to start with vpp-nsh-plugin installed Change-Id: If1ca45295c63094d2542fc829b8eae7dc0e4977c Signed-off-by: selias <samelias@cisco.com>
2017-08-16CSIT-777: L2 keywords for MACIP ACL testsJan Gelety3-10/+187
Change-Id: I678d87770405105555ccc30ce0003f704d7ca82e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-16CSIT-770 Installation of prerequisites on physical hostsPeter Mikus3-5/+46
- Update ansible to install kubernetes and docker Change-Id: Ibf57d4fa697f7c9b58f2e4925387b0c4e8b67274 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-15HC Test: cleanup test failuresselias5-33/+49
- have unnumbered interface cases use a real interface instead of local0 - add EXPECTED_FAILING tag and Jira link to known failing test cases Change-Id: I8bc0f4a74ea1949289a3f12dd54168acdf9edc39 Signed-off-by: selias <samelias@cisco.com>
2017-08-14CSIT-777: L1 keywords for MACIP ACL testsJan Gelety6-5/+143
Change-Id: I90eb824cbabaaece6798812268177ad9bd4eff65 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-14Update of VPP_STABLE_VER filesJan Gelety1-1/+1
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~154-gb2215d6~b2690_amd64 - build tested by semiweekly job: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/63/ NOTE: centos7 build not updated because of issue with deletion of tap interface Change-Id: I937ea3d106f7e62ccd977bcd3114b17326912e82 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-10Fix: Memif API changePeter Mikus1-4/+4
Due to changes in API in latest VPP, Memif/LXC test are failing. This patch is supposed to change Memif config in LXC. Change-Id: I5c3844fd7559eba948bcb5619c8969611eb200c2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-09CSIT-767: Add acl 64B 4t4c perf testsJan Gelety72-0/+1728
Change-Id: Id1b187c195c955d0e533d8d6864fff6a3fa8332e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-09CSIT-611: HC Test: Lisp suite updates + LispGPEselias14-144/+1678
- added LispGPE test suite - added IPv6 tests to Lisp suite - added traffic tests to Lisp suite Change-Id: I3b699149cd73ebf5856072d3f26e98a370dbfc4b Signed-off-by: selias <samelias@cisco.com>
2017-08-08HC Test: re-enable VxLAN GPE test suiteselias1-3/+9
VPP crash partially fixed in https://gerrit.fd.io/r/7267 Still occuring in IPv6 case. Change-Id: Iff6cd99098c6273fc56940b475e5262889076775 Signed-off-by: selias <samelias@cisco.com>
2017-08-07HC Test: test data updates for HC bump to ODL-Carbon dependenciesselias3-4/+4
related Honeycomb change: https://gerrit.fd.io/r/6924 Change-Id: I290a65428c8d64304be6e35dad5d21755a925f86 Signed-off-by: selias <samelias@cisco.com>
2017-08-07Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~121-g63a46fc~b2656_amd64 - use new vpp ref build - centos7: 17.10-rc0~121_g63a46fc~b2653.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/61/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/61/ Change-Id: Ifea4b98550c28619289a170508a20e496aaa30b9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-07Use 100kpps step for ACL 64B perf testsJan Gelety72-576/+576
ACL 64B tests take a long time. Usage of 100kpps will provide results with adequate accurancy and test exectuion time. Change-Id: I6818963f3ce16b9aaae72cf579294f87d10a24a9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-02Fix: Release report PDF generation bugPeter Mikus1-5/+3
QXcbConnection: Could not connect to display Change-Id: Ie6e99f7dc3a0372768955c28f32c90c542e0be78 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-02CSIT-744 Update report content for proper parsingPeter Mikus22-2930/+341
Follow the good practices for formatting. Update the content of release report RST files to use the proper directives like :cite:, :footnote:, :abbr:, :captions: etc.With these markings we will be able to format output in proper way and style it in various sphinx output builders. Change-Id: Ibbb538d43c3bd364a6acdcc990097a477f49de00 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-02CSIT-742: Add manual trigger for ACL perf testsJan Gelety1-0/+9
Impelmenting needed change in bootstrap-verify-perf.sh file to provide manual trigger that will allow to run 1T1C (1 core, 1 thread) and 2T2C (2 core, 2 threads) ACL tests per VPP patch when required. Change-Id: I3d9cc403ca8ea90da23aca524c4b4ddbf26eb217 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-01CSIT-699: Add l2bd+dot1q perf testsJan Gelety3-6/+362
Change-Id: I3d8cbb235918331b3c60147f7870a4aa90036748 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-01 Test TLDK tcpdump command not found issue.Fangyin Hu2-10/+28
Use the new VIRL image to test. Add the debug information for the test. Change-Id: I8343a17d38dffbf84039e39a06fc5c5a65aaf201 Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-08-01CSIT-727 Add the tcpdump application into the VIRL imagePeter Mikus12-15/+428
- Reqested by TLDK Change-Id: Iac94a946005fe2e919334309c77b8774af1a1573 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-31Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~94-g03a6213~b2626_amd64 - use new vpp ref build - centos7: 17.10-rc0~94_g03a6213~b2623.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/59/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/59/ Change-Id: Ifce15bc885f38e9c3407688fcc702efbee42a7dd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-31CSIT-618 Add LaTeX support to release reportPeter Mikus33-1218/+3102
- Add option to generate PDF from release report. - Conditional content - Static plot conversion Change-Id: I7c4f0b41898791d1cab446d0fc3b07220380e1b8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-28FIX: remove import of non-existing vrf resource fileJan Gelety1-1/+0
Change-Id: I532beccc9f5034f7f6fa09a8757e5ff6bfbcd88a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-28HC Test: add mising sudo to ODL client statupselias1-1/+1
Change-Id: I5231cb131f09edc0271c99095aacbf68144e7ded Signed-off-by: selias <samelias@cisco.com>
2017-07-26Add memif to reportTibor Frank3-2/+4
Change-Id: Ie62a4d8b324e6557d9fdf9e37835bb79770bb7e5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-26FIX: typo in tc02-64B-1t1c-ethip4udp-ip4base-iacl50-stateful-flows100k-pdrdiscJan Gelety1-1/+1
Change-Id: I31db1ee3f661715e9066035bdc4819fdc9171bb7 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-26CSIT-618 Update release report datapointsPeter Mikus4-16/+22
Change-Id: Id1fe7dc826bb22e4267c29cce2a544c314ac0648 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-26Fix pylint errorsTibor Frank5-28/+27
Change-Id: I9b8d69978ee35bf7610cdfd372135ce3515eec96 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25report content - honeycomb, part 3selias2-3/+4
Change-Id: Ib87ef43e2ccdcd12b942f623051a4f268dda1a42 Signed-off-by: selias <samelias@cisco.com>
2017-07-25CSIT-618 Release report update VIIIPeter Mikus13-88/+82
Change-Id: Idec390861aa5ac8a1a485d5996fbfef444ac8a29 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-25report content - honeycomb, part2selias2-27/+23
Change-Id: I0e49be2c78130b3a289b8d04839ed005b6a5ad7e Signed-off-by: selias <samelias@cisco.com>
2017-07-25Report: Use rounded valuesTibor Frank1-2/+3
Change-Id: I218ea0900ec6f5d3e513f5dfc15f6f4f3db16a66 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25Display "change" in format "xx.x%"Tibor Frank1-2/+2
Change-Id: I79e9abc28926759e3c4ce775ab2afa9fed79a377 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25CSIT-618 Update report data points.Peter Mikus1-1/+1
Change-Id: I9294e81690eabd198fe1b6d4974c5c4186e06d89 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24FIX: Path in run_report.shPeter Mikus1-1/+1
Change-Id: I2341a23b6165d0cec760021980937a3dc8dde7f0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24FIX: Typo in report_genPeter Mikus2-2/+2
Change-Id: Ia8826ccf79b405d35025e06cafb8a80b877dc77d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24Report - fix generation of performance improvementsTibor Frank1-1/+1
Change-Id: I93ef628f7abb82b880a02a5deddc36e626389e04 Signed-off-by: Tibor Frank <tifrank@cisco.com>