aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-08-09CSIT-611: HC Test: Lisp suite updates + LispGPEselias14-144/+1678
- added LispGPE test suite - added IPv6 tests to Lisp suite - added traffic tests to Lisp suite Change-Id: I3b699149cd73ebf5856072d3f26e98a370dbfc4b Signed-off-by: selias <samelias@cisco.com>
2017-08-08HC Test: re-enable VxLAN GPE test suiteselias1-3/+9
VPP crash partially fixed in https://gerrit.fd.io/r/7267 Still occuring in IPv6 case. Change-Id: Iff6cd99098c6273fc56940b475e5262889076775 Signed-off-by: selias <samelias@cisco.com>
2017-08-07HC Test: test data updates for HC bump to ODL-Carbon dependenciesselias3-4/+4
related Honeycomb change: https://gerrit.fd.io/r/6924 Change-Id: I290a65428c8d64304be6e35dad5d21755a925f86 Signed-off-by: selias <samelias@cisco.com>
2017-08-07Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~121-g63a46fc~b2656_amd64 - use new vpp ref build - centos7: 17.10-rc0~121_g63a46fc~b2653.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/61/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/61/ Change-Id: Ifea4b98550c28619289a170508a20e496aaa30b9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-07Use 100kpps step for ACL 64B perf testsJan Gelety72-576/+576
ACL 64B tests take a long time. Usage of 100kpps will provide results with adequate accurancy and test exectuion time. Change-Id: I6818963f3ce16b9aaae72cf579294f87d10a24a9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-02Fix: Release report PDF generation bugPeter Mikus1-5/+3
QXcbConnection: Could not connect to display Change-Id: Ie6e99f7dc3a0372768955c28f32c90c542e0be78 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-02CSIT-744 Update report content for proper parsingPeter Mikus22-2930/+341
Follow the good practices for formatting. Update the content of release report RST files to use the proper directives like :cite:, :footnote:, :abbr:, :captions: etc.With these markings we will be able to format output in proper way and style it in various sphinx output builders. Change-Id: Ibbb538d43c3bd364a6acdcc990097a477f49de00 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-02CSIT-742: Add manual trigger for ACL perf testsJan Gelety1-0/+9
Impelmenting needed change in bootstrap-verify-perf.sh file to provide manual trigger that will allow to run 1T1C (1 core, 1 thread) and 2T2C (2 core, 2 threads) ACL tests per VPP patch when required. Change-Id: I3d9cc403ca8ea90da23aca524c4b4ddbf26eb217 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-01CSIT-699: Add l2bd+dot1q perf testsJan Gelety3-6/+362
Change-Id: I3d8cbb235918331b3c60147f7870a4aa90036748 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-01 Test TLDK tcpdump command not found issue.Fangyin Hu2-10/+28
Use the new VIRL image to test. Add the debug information for the test. Change-Id: I8343a17d38dffbf84039e39a06fc5c5a65aaf201 Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-08-01CSIT-727 Add the tcpdump application into the VIRL imagePeter Mikus12-15/+428
- Reqested by TLDK Change-Id: Iac94a946005fe2e919334309c77b8774af1a1573 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-31Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~94-g03a6213~b2626_amd64 - use new vpp ref build - centos7: 17.10-rc0~94_g03a6213~b2623.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/59/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/59/ Change-Id: Ifce15bc885f38e9c3407688fcc702efbee42a7dd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-31CSIT-618 Add LaTeX support to release reportPeter Mikus33-1218/+3102
- Add option to generate PDF from release report. - Conditional content - Static plot conversion Change-Id: I7c4f0b41898791d1cab446d0fc3b07220380e1b8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-28FIX: remove import of non-existing vrf resource fileJan Gelety1-1/+0
Change-Id: I532beccc9f5034f7f6fa09a8757e5ff6bfbcd88a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-28HC Test: add mising sudo to ODL client statupselias1-1/+1
Change-Id: I5231cb131f09edc0271c99095aacbf68144e7ded Signed-off-by: selias <samelias@cisco.com>
2017-07-26Add memif to reportTibor Frank3-2/+4
Change-Id: Ie62a4d8b324e6557d9fdf9e37835bb79770bb7e5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-26FIX: typo in tc02-64B-1t1c-ethip4udp-ip4base-iacl50-stateful-flows100k-pdrdiscJan Gelety1-1/+1
Change-Id: I31db1ee3f661715e9066035bdc4819fdc9171bb7 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-26CSIT-618 Update release report datapointsPeter Mikus4-16/+22
Change-Id: Id1fe7dc826bb22e4267c29cce2a544c314ac0648 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-26Fix pylint errorsTibor Frank5-28/+27
Change-Id: I9b8d69978ee35bf7610cdfd372135ce3515eec96 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25report content - honeycomb, part 3selias2-3/+4
Change-Id: Ib87ef43e2ccdcd12b942f623051a4f268dda1a42 Signed-off-by: selias <samelias@cisco.com>
2017-07-25CSIT-618 Release report update VIIIPeter Mikus13-88/+82
Change-Id: Idec390861aa5ac8a1a485d5996fbfef444ac8a29 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-25report content - honeycomb, part2selias2-27/+23
Change-Id: I0e49be2c78130b3a289b8d04839ed005b6a5ad7e Signed-off-by: selias <samelias@cisco.com>
2017-07-25Report: Use rounded valuesTibor Frank1-2/+3
Change-Id: I218ea0900ec6f5d3e513f5dfc15f6f4f3db16a66 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25Display "change" in format "xx.x%"Tibor Frank1-2/+2
Change-Id: I79e9abc28926759e3c4ce775ab2afa9fed79a377 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25CSIT-618 Update report data points.Peter Mikus1-1/+1
Change-Id: I9294e81690eabd198fe1b6d4974c5c4186e06d89 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24FIX: Path in run_report.shPeter Mikus1-1/+1
Change-Id: I2341a23b6165d0cec760021980937a3dc8dde7f0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24FIX: Typo in report_genPeter Mikus2-2/+2
Change-Id: Ia8826ccf79b405d35025e06cafb8a80b877dc77d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24Report - fix generation of performance improvementsTibor Frank1-1/+1
Change-Id: I93ef628f7abb82b880a02a5deddc36e626389e04 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-24FIX: Typo in run_report scriptPeter Mikus1-1/+1
Change-Id: I267b1bcc2aad6ccf1a162376950c27f96de7c03f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24CSIT-618 Release report update VIIPeter Mikus5-44/+105
Change-Id: Ide7771b59cc3ee7619502a6805c8401528a8c874 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24Static report content - Honeycombselias18-102/+421
Change-Id: I39899747f99684b932bb9c88268391e55b6fc779 Signed-off-by: selias <samelias@cisco.com>
2017-07-24CSIT-726: Automate data collection for csv files for perf improvmentsTibor Frank12-53/+276
Change-Id: Ia161ecf9af94fd7193bba045be56738b323e4e2e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-24FIX: add missing PDRDISC tagJan Gelety4-8/+8
Change-Id: Ide3963cb7d776d94f512009b9f34c6b4b6554253 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-24Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~78-g161c59c~b2610_amd64 - use new vpp ref build - centos7: 17.10-rc0~78_g161c59c~b2607.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/57/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/57/ Change-Id: I2ea6e6be1aa111be275d9bef8003e64c10a581c2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-24CSIT-618 Update plot data pointsPeter Mikus1-1/+1
Change-Id: I07102a162fbaad578b38f77e6069d277bb98517c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-23CSIT-618 Update plot data points.Peter Mikus1-1/+1
Change-Id: I7d7074af7506c4ec88061360e1cc88cadb52786c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-21FIX: Report script typoPeter Mikus1-2/+2
Change-Id: I05bdcad4b2602f961d353aa6dce2b5dac62eef3a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-21CSIT-618 Release report update VIPeter Mikus1-6/+6
Change-Id: If78280fb0edc9b34478eeca6f7b972361e179d05 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-21CSIT-618 CSIT rls1707 Report - Update VPeter Mikus2-267/+312
Change-Id: Ie83a9410d0dffae5db337160984655e9d0c61b6e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-21rls1707 report: edits of vpp_functional_tests/rls_notesJan Gelety2-22/+22
- updated section "Changes in CSIT" - updated section "Known Issues" Change-Id: I32e014889d4846f1a915e302a1c8fe93146444b8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-21HC Test: update HC config file locationsselias3-3/+3
Config location changed in: https://gerrit.fd.io/r/#/c/7345/ https://gerrit.fd.io/r/#/c/7411/ Change-Id: I6eac14581f5cc4b23885e38753612962f7b807c7 Signed-off-by: selias <samelias@cisco.com>
2017-07-21rls1707 report: updates in vpp_unit_tests/overview.rstMaciek Konstantynowicz1-1/+8
Change-Id: Idf00f16ade648ebf5653e5dca1c0759997f37589 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-07-21rls1707 report: edits in introduction/csit_design.rstMaciek Konstantynowicz1-77/+80
Change-Id: I9f89ebbfc6b999dc4bb0cf0d938ecc03ef42c2fb Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-07-21rls1707 report: methodology content updates in ↵Maciek Konstantynowicz1-76/+66
vpp_performance_tests/overview.rst Change-Id: I99d8671528ad20600f44a5aab967782561d5207c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-07-20HC Test: update bootstrap for HC performance jobselias1-1/+1
missing in change https://gerrit.fd.io/r/7221 Change-Id: Ib372ae70864fa9bdf6e6b7df1e4c60ed8507b691 Signed-off-by: selias <samelias@cisco.com>
2017-07-20FIX: run build qemu only for the 1st VM on DUTJan Gelety1-18/+20
Change-Id: Ib0fd10e9cb0c6eaeb75ec96e4459d5fb27c656bf Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-20HC Test: bugfixes for hc2vpp ODL jobsselias2-4/+40
- add shutdown check for ODL client in teardown - stop VPP in teardown - add delay after HC startup HC features load asynchronously, no way to check if they're all running. Change-Id: I9d2c51b68ba51284d2d409a77d6cd9fd478e1725 Signed-off-by: selias <samelias@cisco.com>
2017-07-20rls1707 report: edits of vpp_performance_tests/rls_notesMaciek Konstantynowicz1-26/+82
Change-Id: Ia7fbe0fbfa83c7f61f59850ea98e00405fc82711 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-07-20FIX: Report script typoPeter Mikus1-4/+4
Change-Id: I80cafa86157869a03dfd5d0a0f6d6c0affd2df75 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-20FIX: 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-ndrpdrdiscJan Gelety1-1/+1
Change-Id: I5ca0649875c74bcd86106e53ba77d64f833cf28f Signed-off-by: Jan Gelety <jgelety@cisco.com>