aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-09-08CSIT-665: Re-write L1 robot keywords in pythonDasa Simkova8-108/+148
Change-Id: Iddd823375ddd17b9abd5f02ee3aea3bfcb625149 Signed-off-by: Dasa Simkova <dspropagacie@gmail.com>
2017-09-06HC Test: re-enable NSH tests, minor fixesselias9-61/+43
NSH plugin was fixed in https://gerrit.fd.io/r/8218 - updated lispGPE test data - added missing teardown to multi-IP traffic test - marked L2-fib update revert case as failing Change-Id: I5cf8c718e808d5d8cb69e2f769c829c868bf9924 Signed-off-by: selias <samelias@cisco.com>
2017-09-04Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~263-gedfa2fd~b2799_amd64 - use new vpp ref build - centos7: 17.10-rc0~263_gedfa2fd~b2796.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/69/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/69/ Change-Id: I510d288a4a5444f980769d7fd13ab1ff46d227a5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-04CSIT-786 L2FIB scale testingPeter Mikus11-76/+2320
L2FIB scale testing for 10k, 100k, 1m FIB entries ./l2: 10ge2p1x520-eth-l2bdscale10kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale1mmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale10kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale100kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale1mmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc Change-Id: I7e3884bd5ab5294c289030a3465ec5b6def83cf7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-03Update T-rex to v2.29Peter Mikus5-5/+5
Change-Id: Id60525182cbe5870f40aebf165e8bd86c101d267 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28FIX: SNAT -> NAT renaming of APIPeter Mikus31-479/+459
- Based on https://gerrit.fd.io/r/#/c/8146/ Change-Id: I774483c7e2b419a9b9b6be78812ecf53a5c91eab Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28Fix: Do not validate LXC imagePeter Mikus1-2/+3
Change-Id: I476f463ad7dd91f1d80a1e4b537a2cb3dd4ddee5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28Update of VPP_STABLE_VER filesPeter Mikus2-2/+2
- use new vpp ref build - ubuntu 16.04: vpp-17.10-rc0~206-g5f22f4d~b2740_amd64-deb - build tested by semiweekly job: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/???/ NOTE: centos7 build not updated because of issue with deletion of tap interface Change-Id: I1df4c10f40d983952c1dad4a94f2dcdb2534c00e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-25Update T-rex to v2.28Peter Mikus5-5/+5
Change-Id: I506589c3785eec3a2eaa9fdb32bfc3375388d6f4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-25HC Test: Disable NSH plugin installation and testsselias3-11/+15
- VPP refuses to start with vpp-nsh-plugin installed Change-Id: If1ca45295c63094d2542fc829b8eae7dc0e4977c Signed-off-by: selias <samelias@cisco.com>
2017-08-16CSIT-777: L2 keywords for MACIP ACL testsJan Gelety3-10/+187
Change-Id: I678d87770405105555ccc30ce0003f704d7ca82e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-16CSIT-770 Installation of prerequisites on physical hostsPeter Mikus3-5/+46
- Update ansible to install kubernetes and docker Change-Id: Ibf57d4fa697f7c9b58f2e4925387b0c4e8b67274 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-15HC Test: cleanup test failuresselias5-33/+49
- have unnumbered interface cases use a real interface instead of local0 - add EXPECTED_FAILING tag and Jira link to known failing test cases Change-Id: I8bc0f4a74ea1949289a3f12dd54168acdf9edc39 Signed-off-by: selias <samelias@cisco.com>
2017-08-14CSIT-777: L1 keywords for MACIP ACL testsJan Gelety6-5/+143
Change-Id: I90eb824cbabaaece6798812268177ad9bd4eff65 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-14Update of VPP_STABLE_VER filesJan Gelety1-1/+1
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~154-gb2215d6~b2690_amd64 - build tested by semiweekly job: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/63/ NOTE: centos7 build not updated because of issue with deletion of tap interface Change-Id: I937ea3d106f7e62ccd977bcd3114b17326912e82 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-10Fix: Memif API changePeter Mikus1-4/+4
Due to changes in API in latest VPP, Memif/LXC test are failing. This patch is supposed to change Memif config in LXC. Change-Id: I5c3844fd7559eba948bcb5619c8969611eb200c2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-09CSIT-767: Add acl 64B 4t4c perf testsJan Gelety72-0/+1728
Change-Id: Id1b187c195c955d0e533d8d6864fff6a3fa8332e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-09CSIT-611: HC Test: Lisp suite updates + LispGPEselias14-144/+1678
- added LispGPE test suite - added IPv6 tests to Lisp suite - added traffic tests to Lisp suite Change-Id: I3b699149cd73ebf5856072d3f26e98a370dbfc4b Signed-off-by: selias <samelias@cisco.com>
2017-08-08HC Test: re-enable VxLAN GPE test suiteselias1-3/+9
VPP crash partially fixed in https://gerrit.fd.io/r/7267 Still occuring in IPv6 case. Change-Id: Iff6cd99098c6273fc56940b475e5262889076775 Signed-off-by: selias <samelias@cisco.com>
2017-08-07HC Test: test data updates for HC bump to ODL-Carbon dependenciesselias3-4/+4
related Honeycomb change: https://gerrit.fd.io/r/6924 Change-Id: I290a65428c8d64304be6e35dad5d21755a925f86 Signed-off-by: selias <samelias@cisco.com>
2017-08-07Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~121-g63a46fc~b2656_amd64 - use new vpp ref build - centos7: 17.10-rc0~121_g63a46fc~b2653.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/61/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/61/ Change-Id: Ifea4b98550c28619289a170508a20e496aaa30b9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-07Use 100kpps step for ACL 64B perf testsJan Gelety72-576/+576
ACL 64B tests take a long time. Usage of 100kpps will provide results with adequate accurancy and test exectuion time. Change-Id: I6818963f3ce16b9aaae72cf579294f87d10a24a9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-02Fix: Release report PDF generation bugPeter Mikus1-5/+3
QXcbConnection: Could not connect to display Change-Id: Ie6e99f7dc3a0372768955c28f32c90c542e0be78 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-02CSIT-744 Update report content for proper parsingPeter Mikus22-2930/+341
Follow the good practices for formatting. Update the content of release report RST files to use the proper directives like :cite:, :footnote:, :abbr:, :captions: etc.With these markings we will be able to format output in proper way and style it in various sphinx output builders. Change-Id: Ibbb538d43c3bd364a6acdcc990097a477f49de00 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-02CSIT-742: Add manual trigger for ACL perf testsJan Gelety1-0/+9
Impelmenting needed change in bootstrap-verify-perf.sh file to provide manual trigger that will allow to run 1T1C (1 core, 1 thread) and 2T2C (2 core, 2 threads) ACL tests per VPP patch when required. Change-Id: I3d9cc403ca8ea90da23aca524c4b4ddbf26eb217 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-01CSIT-699: Add l2bd+dot1q perf testsJan Gelety3-6/+362
Change-Id: I3d8cbb235918331b3c60147f7870a4aa90036748 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-01 Test TLDK tcpdump command not found issue.Fangyin Hu2-10/+28
Use the new VIRL image to test. Add the debug information for the test. Change-Id: I8343a17d38dffbf84039e39a06fc5c5a65aaf201 Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-08-01CSIT-727 Add the tcpdump application into the VIRL imagePeter Mikus12-15/+428
- Reqested by TLDK Change-Id: Iac94a946005fe2e919334309c77b8774af1a1573 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-31Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~94-g03a6213~b2626_amd64 - use new vpp ref build - centos7: 17.10-rc0~94_g03a6213~b2623.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/59/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/59/ Change-Id: Ifce15bc885f38e9c3407688fcc702efbee42a7dd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-31CSIT-618 Add LaTeX support to release reportPeter Mikus33-1218/+3102
- Add option to generate PDF from release report. - Conditional content - Static plot conversion Change-Id: I7c4f0b41898791d1cab446d0fc3b07220380e1b8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-28FIX: remove import of non-existing vrf resource fileJan Gelety1-1/+0
Change-Id: I532beccc9f5034f7f6fa09a8757e5ff6bfbcd88a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-28HC Test: add mising sudo to ODL client statupselias1-1/+1
Change-Id: I5231cb131f09edc0271c99095aacbf68144e7ded Signed-off-by: selias <samelias@cisco.com>
2017-07-26Add memif to reportTibor Frank3-2/+4
Change-Id: Ie62a4d8b324e6557d9fdf9e37835bb79770bb7e5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-26FIX: typo in tc02-64B-1t1c-ethip4udp-ip4base-iacl50-stateful-flows100k-pdrdiscJan Gelety1-1/+1
Change-Id: I31db1ee3f661715e9066035bdc4819fdc9171bb7 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-26CSIT-618 Update release report datapointsPeter Mikus4-16/+22
Change-Id: Id1fe7dc826bb22e4267c29cce2a544c314ac0648 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-26Fix pylint errorsTibor Frank5-28/+27
Change-Id: I9b8d69978ee35bf7610cdfd372135ce3515eec96 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25report content - honeycomb, part 3selias2-3/+4
Change-Id: Ib87ef43e2ccdcd12b942f623051a4f268dda1a42 Signed-off-by: selias <samelias@cisco.com>
2017-07-25CSIT-618 Release report update VIIIPeter Mikus13-88/+82
Change-Id: Idec390861aa5ac8a1a485d5996fbfef444ac8a29 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-25report content - honeycomb, part2selias2-27/+23
Change-Id: I0e49be2c78130b3a289b8d04839ed005b6a5ad7e Signed-off-by: selias <samelias@cisco.com>
2017-07-25Report: Use rounded valuesTibor Frank1-2/+3
Change-Id: I218ea0900ec6f5d3e513f5dfc15f6f4f3db16a66 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25Display "change" in format "xx.x%"Tibor Frank1-2/+2
Change-Id: I79e9abc28926759e3c4ce775ab2afa9fed79a377 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25CSIT-618 Update report data points.Peter Mikus1-1/+1
Change-Id: I9294e81690eabd198fe1b6d4974c5c4186e06d89 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24FIX: Path in run_report.shPeter Mikus1-1/+1
Change-Id: I2341a23b6165d0cec760021980937a3dc8dde7f0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24FIX: Typo in report_genPeter Mikus2-2/+2
Change-Id: Ia8826ccf79b405d35025e06cafb8a80b877dc77d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24Report - fix generation of performance improvementsTibor Frank1-1/+1
Change-Id: I93ef628f7abb82b880a02a5deddc36e626389e04 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-24FIX: Typo in run_report scriptPeter Mikus1-1/+1
Change-Id: I267b1bcc2aad6ccf1a162376950c27f96de7c03f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24CSIT-618 Release report update VIIPeter Mikus5-44/+105
Change-Id: Ide7771b59cc3ee7619502a6805c8401528a8c874 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24Static report content - Honeycombselias18-102/+421
Change-Id: I39899747f99684b932bb9c88268391e55b6fc779 Signed-off-by: selias <samelias@cisco.com>
2017-07-24CSIT-726: Automate data collection for csv files for perf improvmentsTibor Frank12-53/+276
Change-Id: Ia161ecf9af94fd7193bba045be56738b323e4e2e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-24FIX: add missing PDRDISC tagJan Gelety4-8/+8
Change-Id: Ide3963cb7d776d94f512009b9f34c6b4b6554253 Signed-off-by: Jan Gelety <jgelety@cisco.com>