aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/report_gen
AgeCommit message (Collapse)AuthorFilesLines
2017-07-25CSIT-618 Release report update VIIIPeter Mikus2-5/+7
Change-Id: Idec390861aa5ac8a1a485d5996fbfef444ac8a29 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 1e2bf354994a7ec53c1acee2d1c2fe2208f7c905)
2017-07-25report content - honeycomb, part2selias1-1/+1
Change-Id: I0e49be2c78130b3a289b8d04839ed005b6a5ad7e Signed-off-by: selias <samelias@cisco.com> (cherry picked from commit 69a8a040b70ed67bbc7d3a820166871f815f1d9c)
2017-07-25Report: Use rounded valuesTibor Frank1-2/+3
Change-Id: I218ea0900ec6f5d3e513f5dfc15f6f4f3db16a66 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a0ff7c5d45f49e06d72071ad926274fd4c0bb061)
2017-07-25Display "change" in format "xx.x%"Tibor Frank1-2/+2
Change-Id: I79e9abc28926759e3c4ce775ab2afa9fed79a377 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit dbc81d911fb43d76b255d11fd0dbfebff38bd261)
2017-07-25CSIT-618 Update report data points.Peter Mikus1-1/+1
Change-Id: I9294e81690eabd198fe1b6d4974c5c4186e06d89 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 7ab64cd86a58dd5f2039fd0cf79cd4045c1b2789)
2017-07-24FIX: Path in run_report.shPeter Mikus1-1/+1
Change-Id: I2341a23b6165d0cec760021980937a3dc8dde7f0 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit f4a86c6f5432c16394b98f339030c5ea04d435e2)
2017-07-24FIX: Typo in report_genPeter Mikus2-2/+2
Change-Id: Ia8826ccf79b405d35025e06cafb8a80b877dc77d Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 267795011019bb2ee9df3c0e568d54aa2281908d)
2017-07-24Report - fix generation of performance improvementsTibor Frank1-1/+1
Change-Id: I93ef628f7abb82b880a02a5deddc36e626389e04 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 601d8e63eed1d7db19a001923298b6fe209787b0)
2017-07-24FIX: Typo in run_report scriptPeter Mikus1-1/+1
Change-Id: I267b1bcc2aad6ccf1a162376950c27f96de7c03f Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 71e61ec941914c658dba7442cb828b8479b90b83)
2017-07-24CSIT-618 Release report update VIIPeter Mikus1-22/+56
Change-Id: Ide7771b59cc3ee7619502a6805c8401528a8c874 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 61407a72649b7b355472350c2186aa36bf8182e7)
2017-07-24Static report content - Honeycombselias3-2/+21
Change-Id: I39899747f99684b932bb9c88268391e55b6fc779 Signed-off-by: selias <samelias@cisco.com> (cherry picked from commit cd8d4dc1498a69b4f9541fb4405fd31fd61d81d9)
2017-07-24CSIT-726: Automate data collection for csv files for perf improvmentsTibor Frank3-0/+227
Change-Id: Ia161ecf9af94fd7193bba045be56738b323e4e2e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1911067935bdf6481fc9b89f40d79ca61f2448d0)
2017-07-24CSIT-618 Update plot data pointsPeter Mikus1-1/+1
Change-Id: I07102a162fbaad578b38f77e6069d277bb98517c Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit d351379e46964bf50f3dd27dc94c302596cd6110)
2017-07-23CSIT-618 Update plot data points.Peter Mikus1-1/+1
Change-Id: I7d7074af7506c4ec88061360e1cc88cadb52786c Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 6281fac904be991f5b80bbd7b42b8b8177bc3823)
2017-07-21FIX: Report script typoPeter Mikus1-2/+2
Change-Id: I05bdcad4b2602f961d353aa6dce2b5dac62eef3a Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 113052a53f9a771f465ea26ccd64344b46b78cf9)
2017-07-21CSIT-618 Release report update VIPeter Mikus1-6/+6
Change-Id: If78280fb0edc9b34478eeca6f7b972361e179d05 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 20ee7a806931d09c5b773ca0987a29eafb202ed2)
2017-07-21CSIT-618 CSIT rls1707 Report - Update VPeter Mikus2-267/+312
Change-Id: Ie83a9410d0dffae5db337160984655e9d0c61b6e Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 4a4f4d6d0f4aafc3c7a97d525879503fdf0e8ad0)
2017-07-20FIX: Report script typoPeter Mikus1-4/+4
Change-Id: I80cafa86157869a03dfd5d0a0f6d6c0affd2df75 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 173ce06df28d56769eab6d76a36d609a32459d27)
2017-07-20FIX: Report script typoPeter Mikus1-5/+5
Change-Id: I1358fcf558f1156f2e1bc559652f6f98c5438b36 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 2656fed5d73b3ffde2b8b7496a68b527e9e32045)
2017-07-20CSIT-618 CSIT rls1707 Report - Update IVPeter Mikus2-116/+108
Change-Id: Iff48d515ebdae40920660627b4b3b2e35351b3a1 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 0956f4f87140b878a3a4da2e192dddd2c9ecc975)
2017-07-19FIX: CSIT rls1707 Report - Update IIIPeter Mikus3-54/+92
Change-Id: Ic857e004136b2d936c2a8affb779ada238eb007c Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit be82f49dda573dfc7010a56d6f76f8e161beac16)
2017-07-18CSIT-618 CSIT rls1707 Report - Update IIPeter Mikus1-25/+52
Change-Id: I50a210930c0571ca910ead1724de7848c0911646 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 4457640600a2b875da17e97dba2dcab8a411eb95)
2017-07-14CSIT-618 CSIT rls1707 Report - Update IPeter Mikus2-52/+66
Change-Id: I7c3af55db6cc89f03004db6ddf6fcf67965132a7 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit d9a08e59581aafe44d446b5bc1ce6ff86b2b173b)
2017-07-04Fix: Run-report scriptPeter Mikus1-1/+1
Change-Id: I98afcbca606caeaf49172c968174c4868579cf6a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-04CSIT-702 Update static content after optimizationsPeter Mikus3-430/+107
Update the mechanics of script for generating report to reflect the latest changes. Update some static content. Change-Id: If60f7b74245138cc3044a49c46ff06d5850732de Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-29CSIT-687: Directory structure reorganizationTibor Frank1-2/+2
Change-Id: I772c9e214be2461adf58124998d272e7d795220f Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-06-05CSIT-524: Traffic generator using python profilesTibor Frank1-2/+2
Profile name structure: [trex|ixia]-[sl|sf]-[topo]-[packet structure]-[scale] - Traffic generator - T-rex (trex) or Ixia (ixia) - Stateless (sl) or statefull (sf) - Topology - 2-node topology (2n) or 3-node topology (3n) - Packet structure - eth | ip4/6 | udp - Scale - e.g. ip4dst1, ip6dst10000, 4000u15p Traffic types changed to stream profiles: - From: 2-node-bridge To: trex-sl-2n-ethip4-ip4src253 - From: 3-node-bridge To: trex-sl-3n-ethip4-ip4src254 - From: 3-node-IPv4-dst-1000000 To: trex-sl-3n-ethip4-ip4dst1000000 - From: 3-node-IPv4-dst-100000 To: trex-sl-3n-ethip4-ip4dst100000 - From: 3-node-IPv4-dst-10000 To: trex-sl-3n-ethip4-ip4dst10000 - From: 3-node-IPv4-dst-1000 To: trex-sl-3n-ethip4-ip4dst1000 - From: 3-node-IPv4-dst-100 To: trex-sl-3n-ethip4-ip4dst100 - From: 3-node-IPv4-dst-1 To: trex-sl-3n-ethip4-ip4dst1 - From: 3-node-IPv4 To: trex-sl-3n-ethip4-ip4src253 - From: 3-node-IPv6-dst-1000000 To: trex-sl-3n-ethip6-ip6dst1000000 - From: 3-node-IPv6-dst-100000 To: trex-sl-3n-ethip6-ip6dst100000 - From: 3-node-IPv6-dst-10000 To: trex-sl-3n-ethip6-ip6dst10000 - From: 3-node-IPv6 To: trex-sl-3n-ethip6-ip6src253 - From: 3-node-xconnect To: trex-sl-3n-ethip4-ip4src254 - From: 3-node-IPv4-SNAT-1000u-15p To: trex-sl-3n-ethip4udp-1000u15p - From: 3-node-IPv4-SNAT-100u-15p To: trex-sl-3n-ethip4udp-100u15p - From: 3-node-IPv4-SNAT-10u-15p To: trex-sl-3n-ethip4udp-10u15p - From: 3-node-IPv4-SNAT-1u-15p To: trex-sl-3n-ethip4udp-1u15p - From: 3-node-IPv4-SNAT-1u-1p To: trex-sl-3n-ethip4udp-1u1p - From: 3-node-IPv4-SNAT-2000u-15p To: trex-sl-3n-ethip4udp-2000u15p - From: 3-node-IPv4-SNAT-4000u-15p To: trex-sl-3n-ethip4udp-4000u15p Change-Id: If6a3cf204c93ff9f2cdccc5fd395e26b05483b58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-02CSIT-572: Add script for data collection for reportTibor Frank1-0/+331
- Add script which picks required data from RF output.xml and saves it in JSON format. - Run this script automatically when the output.xml is generated. - Archive the output. Change-Id: I89589369975e14fc8d8e4afa88abfa34260c09cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-05-25CSIT-612 Report: Minimization of hand-crafted content.Peter Mikus1-5/+27
- replace dynamic text content and links by variables. Change-Id: I1a7ec371fc80af3c9dd416bf91dd2c639097cf1e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Fix Honeycomb source data path for report.Peter Mikus1-1/+1
Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Update links with source data for rls reportPeter Mikus1-65/+65
Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Update data points for rls1704 reportPeter Mikus1-3/+3
Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-28csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.Maciek Konstantynowicz1-1/+1
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27Report-gen updatePeter Mikus1-11/+11
- fix header in IPsec sections - fix IP4 regexp to include SNAT - update source data for perf trending - fix rendering of Trex section Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26Fix: Report table layout in RTD SphinxPeter Mikus1-1/+1
Change-Id: Ibdac46c7ec6d8381da89ea9bb7e407b91c5029df Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26CSIT rls1704 report - small updatesJan Gelety1-1/+1
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT doc gen: Use html <pre> tag for data from teardown.Jan Gelety1-6/+16
Change-Id: Ie8d856d0a7b90eeecffcb38cd8e8b0647a534d8d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26Update run_report.sh script for generating reportPeter Mikus1-89/+103
Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26Update: report source data linksPeter Mikus1-3/+3
Change-Id: I74b9b1070380dcc5f721d695989f3bd676b6df91 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-25rls1704 report - updated sections:Maciek Konstantynowicz1-1/+1
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25Fix: CSIT report gen for policerJan Gelety1-1/+1
Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25Fix: CSIT report gen - teardonw data + run_report.shJan Gelety2-21/+27
Change-Id: Ie846ff0503d14f861738b2753328bb6a64ac8216 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25Update report links to source dataPeter Mikus1-1/+1
Change-Id: Ifd5689eac5251316e24283fb94526ad52567d1ac Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-25CSIT doc gen: Add configurations and operational data.Jan Gelety1-4/+186
- vpp perf configurations and operational data - vpp func configurations Change-Id: I634682e55a2862b927546e2657aabb242c730be1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT doc gen: Script to get data from teardown.Jan Gelety1-0/+619
- generate rst/html/md/wiki file with required data from teardown per TC - implemented: - VAT command history of all DUTs per TC - ouptup of CLI command "Show Runtime" (VPP operational data) Change-Id: I0771f3e0c20dfff9d00df62bdcc6013a32ef9001 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-24Fix: Report generationPeter Mikus2-22/+20
- Add IPsec plots - Fix plots rendering Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-22Update data source for release reportPeter Mikus1-3/+3
Change-Id: Ifccd3fd895ae52c78b1ae7a6d0d30d9334d30a05 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-22Fix typo in run_reportPeter Mikus1-1/+1
Change-Id: Ide358bf67fd70717b7545bdf2a56562169cdef8a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-22Fix run_report.shPeter Mikus1-8/+8
- fix sed delimiter to eliminate / Change-Id: I4d6253d7845937ee452da342819d1c390ca28054 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-21Report generation script updatespmikus4-145/+510
- Add new type of throughput plots - Update Sphinx, Sphinx-rtd-theme and Plotly packages - Add auto generation of detailed test results - Small fixes Change-Id: I706777160a7f166e0a335c64428d10cb546fa854 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>