aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2019-10-07Trending: Send alerts when regression occursTibor Frank3-30/+53
Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-07Report: Set the backgroud of graphsTibor Frank1-0/+12
Change-Id: Icd5f2ed496128b4cdc5f1113c778f66bbef5def3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-04FIX: Add SRIOV cleanupPeter Mikus1-11/+19
If Jenkins interrupt pybot during AVF tests (that is happening more frequently as coverage increased) the interfaces remains in link UP state. Next run VPP cannot grab interfaces as they are in UP state in and kernel driver. This results in testcase failing. Patch is supposed to do put interfaces in topology down so VPP can bind them back to vfio-pci. Change-Id: I2aa9e5944d39474965eac3c5f1b472f58e9aa8b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-10-03Trending: Report also nr of passed tests in emailTibor Frank3-128/+172
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-03PAL: Set plot.ly version to 4.1.1Tibor Frank3-16/+21
Change-Id: I137ee807a2802fa1f7b5b635e1162bf7fff07a57 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-02PAL: Accept reconf time in scientific notationVratko Polak1-5/+5
+ Otherwise "9.58828205237e-05" is understood as "9.58828205237". + Replace "[0-9]" with "\d". Change-Id: I7ecf6d0116fe704ecdba46f3a0e7975aba79aa62 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-27Report: Fix: Legend in reconf testsTibor Frank1-1/+1
Change-Id: I04806de7bf02af6c9b2119c45e75f8e0bc88bdd7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-26Report: Reconf tests: set autorange for y axisTibor Frank1-11/+1
Change-Id: Ie1ba26d3d76a8905698d0be33e9c5e61daff0e48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-24Add support for HDRhistogramVratko Polak3-148/+62
+ Enable hdrh in trex server. + Append hdrh coded output after min/avg/max/. + Read (not show nor decode) hdrh value in PAL. + Also, remove old ndrpdrdisc code. Change-Id: I99d99f10386a621772b5419ca1f36080fa15aca7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-24Reconf tests: Fix async measurementsVratko Polak2-6/+32
TRex does not zero the server counters. It copies the values to use as reference, and subtracts them when asked for results. But the reference is stored in the client (not the server). And CSIT uses different scripts to start and stop async traffic, which means different clients. This patch introduces a workaround. Async start will return xstats objects to use as reference, and async stop will use the objects to compute the correct results. The xstats objects are stored in TrafficGenerator instance. Sync measurement does not export the counters, to shorten logs. Other improvements: + Make stop_traffic_on_tg return measurement results directly. + Rename --async to --async_start as "async" is reserved in Python 3.7 + Minor pylint, docstring and typo fixes. Change-Id: I5fc56a0763afb7d62cfa7c0651f96b6867de3e15 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-23PAL: Fix unit for packets lostVratko Polak1-4/+3
+ update the static content Change-Id: I8c4852195e09d7b00555ebb4a7378743c3df45f2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-17Report: Enable pdf versionTibor Frank1-2/+2
Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Trending: Fix removing of old input filesTibor Frank1-18/+0
Change-Id: I67ff7944a1eb576bd6e739202a94eb12be9e0e1b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Trending: Reduce input dataTibor Frank2-70/+107
Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-15Report: Add dataTibor Frank1-0/+2
Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-13Report: FixesTibor Frank2-13/+13
Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-13Report: Add dataTibor Frank1-353/+438
Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Support unidirection in all searchesVratko Polak2-26/+28
+ Rename bool unidirection to int traffic_directions. + Rename "untagged" to "initial" for bandwidth calculation. + Fix latency measurement for unidirectional traffic. + Remove duplicate colon in soak test message. + Edit PAL to accept both forms. + Fix minor documentation issues. Change-Id: I6c76f2dc090ae493f2fbd7e9ccd45229d2306dea Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12Report: Add nfv reconfTibor Frank1-13384/+13212
Change-Id: If773f5d05c845b0d15bd8f60a44a36adcbf65b82 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12PAL: Add NFV reconf testsTibor Frank4-13521/+13888
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Report: Temporarily remove pdf versionTibor Frank1-2/+2
Change-Id: Iab5909defc86ec31ba726eb2a1a4b6530cf7d63d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12TRex: 2.61Peter Mikus3-3/+3
- HDRhistogram can be rebased and used in separate patch. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic7ce752344c6e1791af7cf7b7effde65ac2be680
2019-09-12Report: Configure 1908.38Tibor Frank2-2/+2
Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Ansible: Cascadelake includePeter Mikus13-17/+148
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iecb18e9d94ff715e40152564fb778650d43a48d3
2019-09-11Report: Remove NFV full dataTibor Frank1-2/+0
Change-Id: I51402892df91cfc5e8f2c18f18ef67bab634bcdf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Ansible: Trex installationPeter Mikus13-64/+94
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5ab8fe05074a842301a511bbd3ab5e67f8d1a9f0
2019-09-11Report: Add dataTibor Frank2-3/+7
Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10Report: Add pdf versionTibor Frank1-2/+2
Change-Id: I8897a6ef87b3813db0485fa081fdd44b4e501e41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10PAL: Add replacing of data in tablesTibor Frank5-528/+1040
+ vhost data Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Add dnv mrr dataTibor Frank1-2/+158
Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Fix tsh and dnv plotsTibor Frank1-317/+317
Change-Id: I1d40849bc15f4433117af91f71e951a61924d732 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Add soak testsTibor Frank1-108/+107
Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-06Report: Add 3n-dnv plots and tablesTibor Frank1-40/+587
Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Add 2n-dnv plots and tablesTibor Frank1-19/+304
Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Add DNV dataTibor Frank3-327/+295
Change-Id: I020373b1553300459654ded31d940b0a5562eb8a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Fix listing order of new vs. see footnoteTibor Frank1-8/+56
Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Fix hsw vs. skx comparison tableTibor Frank1-9/+9
Change-Id: Id16b161ad27102891a58d084185d17a2b8fcae6a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Configure Report 1908.37Tibor Frank2-2/+4
Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-04docs: added 3n-tsh testbed tests to report_test_groups.txtMaciek Konstantynowicz1-6/+42
Change-Id: Ib2249ce6c28f4c07878eb5fc2919c56dd8637376 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-09-04Report: ixgbe for tshTibor Frank1-313/+313
Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-04Report: Add dataTibor Frank2-162/+50
Change-Id: I6a32e0bdd1a693550214e7bea49b76313449f24d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: Comparison tablesTibor Frank1-10/+14
Change-Id: I108e1292c5de8024060c220b877b668b8843c68f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: Comparison tablesTibor Frank1-6/+6
Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: Comparison tablesTibor Frank2-62/+98
Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: add dataTibor Frank2-45/+208
Change-Id: I51fd0b9e07d09224452f842689925d1166246f19 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank1-4/+6
Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank2-77/+81
Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02PAL: list all sel tests in table_performance_comparisonTibor Frank1-3/+17
Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02PAL: list all sel tests in table_performance_comparison_nicTibor Frank2-51/+18
Change-Id: I21bb76aab4a1e627a13057f896ea7bfc34c03463 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02Report: Add dataTibor Frank1-667/+657
Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2 Signed-off-by: Tibor Frank <tifrank@cisco.com>