aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2018-04-27CSIT-1041: Trending dashboard - coloursTibor Frank1-1/+13
Change-Id: I781e901e81f201d1335708c99eb52783f349725c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit eb6840a319390feb18b2ca32854edf1a6ad15e95)
2018-04-26Trending: switch back to 3*stdevVratko Polak2-7/+7
Reporting many fake pro/regressions is worse then missing few of the real ones. Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 3c510d8dd18bd8ceb2c5d86ed058976e72ddead4)
2018-04-26Report: Add historical data to performance changes tableTibor Frank1-2/+2
Change-Id: Ia1e224ecade79c54b373ba3e8ac53c21c054f648 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5d040b65766fa5d7d6ad111def619abb8c878b87)
2018-04-26Report: Add historical data to performance changes tableTibor Frank1-9/+12
Change-Id: I6ae8d3a36ada557a2119f6e7f46dde040e4db574 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e7f9cb1bc6f96ca79fdba328fd14ce197e28c7a7)
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-11/+10
Change-Id: If7bce2c86b2fb352368c433c5db81a4a4bc976ed Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 52cb667958d954d6233d0865a59d90cca82db026)
2018-04-26CSIT-1041: Trending dashboardTibor Frank2-13/+2
Change-Id: I7aa7f01738649fc3f3b10572d7e08af580293748 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0740688e5798f7ab7162fd7f4bc5eb8455164a7c)
2018-04-26Trending: use 2*stdevTibor Frank2-9/+9
Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d5d53957f4686398727469e0f5b1774a5b6560fe)
2018-04-26Report: Add dataTibor Frank2-4/+7
Change-Id: I043a50f9d55dd784039a483da034cfe4db65d003 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b892452e1fe2d226f526f9a0685b1095e36b8050)
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-2/+4
Change-Id: I9d6ff6021db4356c0b06555c79841b9ed602f671 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e7fe3850f2777db5c5b6d1fbd0877ebd7cac0f18)
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-25/+61
Change-Id: Ia29ff844e44575020e71fb3f613e77508bda8b24 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 623eb22347f7d5218d3536f620d6911cc312d7dd)
2018-04-26CSIT-1041: Use TMM for trending lineVratko Polak2-40/+38
+ Make also pro/re-gression detection use TMM. + Update graphs. - Do not update dashboard tables yet. Change-Id: Iae526c846b329ad99549be61481532e197704fb0 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit fde192bc8a6ba1a4e2b4cf5b3297fb076efd58fc)
2018-04-25CSIT-1041: Trending dashboardTibor Frank1-3/+3
Change-Id: If2e06d59fa8986ccf24abc118628b42d1deb6e39 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a1728c4f56cc44b9acb45614c20fc0a546ee3161)
2018-04-25CSIT-1041: Trending dashboardTibor Frank2-14/+27
Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0f662ea0defa9b30fa7a7d9256857fce92d20a6e)
2018-04-25CSIT-1041: Trending dashboardTibor Frank1-142/+63
Change-Id: I1d6aae1839a9d6d44407c90ff257bc37495f0cfa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6e1a15acc7bd3685d71f9d34238181c681dcd4c0)
2018-04-25CSIT-1041: Do not treat positive jumps as outliersVratko Polak1-2/+2
Change-Id: If6e65faae3b5a31c56f942a7975b5a35f5f6d6a4 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 0a8855adbb30a6079a538bea179a13988fdc20c0)
2018-04-25Report: add dataTibor Frank1-0/+9
- https://jenkins.fd.io/job/csit-vpp-perf-1804-all/17/ - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/18/ Change-Id: I3cfebb535c1c1806530ec16e86a5088a94ce3141 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 59e06f5e3143bf093bdb6b53c0186b050668e3d4)
2018-04-25FIX: Do not ignore zeros while creating csv fileTibor Frank1-1/+2
Change-Id: I0f1f63b9969399258c44176e6ed5a326fd0a5549 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d420e98c6838831877f1aad6aa924844fc009195) (cherry picked from commit 2f5a43baecf26ebe978772efc8f6186509cff1c7)
2018-04-25FIX: Remove feature plots from base graphsTibor Frank1-6/+6
Change-Id: I4118a19bd6204858e96cbf8029aea045478efca7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cbd331c63db1db3ac51133732a0eb63ea8dc0712)
2018-04-24Use stable/1804 vpp builds for NSH_SFC testsJan Gelety1-15/+17
Change-Id: Iaaf1af31fa526108ebdcf3610bca76346d186183 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-24Report: Add data sourcesTibor Frank1-22/+28
- https://jenkins.fd.io/job/csit-vpp-perf-1804-all/14/ - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/16/ Change-Id: I7603a41f797a6dd5438c3daa40e883b1643ae712 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 53e9d835462c85738a61ce6f069a05d090645ac8)
2018-04-24CSIT-1041: Trending dashboardTibor Frank1-2/+6
Change-Id: I815e61432d418d0f741ed57f5450460951f7191f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9dad3f95c2624808aeb9892049c236fa788a55d9)
2018-04-24CSIT-1041: Trending dashboardTibor Frank1-1/+1
Change-Id: I1e05f75545d97ab186fbc48df44bfe17472d6cfd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 971bf6f4d091e15952199f0172119228d59f584a)
2018-04-24CSIT-1041: Trending dashboardTibor Frank3-22/+17
Change-Id: Ida3dfcc4a7ae21424e7f6b6db597a80bc633b9da Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 79e508504fcd6b5b677e567eb09092c5e0821790)
2018-04-23CSIT-1041: Trending dashboardTibor Frank2-32/+58
Change-Id: I8d53c68643acb18bf2b5ab171672b0de02d2d135 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 52f64f232293130904d54a62609eaffc1b145608)
2018-04-23Report: fix performance comparision tablesTibor Frank2-12/+21
Change-Id: Ieae746412427980fb86512253cc58ebcee991317 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6f8266f81bb052e2c0e51b029e47f0eb4f04a7ed)
2018-04-23CSIT-1041: Trending dashboardTibor Frank1-5/+7
Change-Id: I3b8e545bd198281af502acc6e23268e840112423 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7aa0d625baca67d9789b5db3da2ee468597d254b)
2018-04-23CSIT-1041: Trending dashboardTibor Frank1-1/+2
Change-Id: I99b7acbbf6c773a4d2c5fc74cf7ba02aa6f98fa3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cd330b5a1bf1a289e7dad68420679a5d94de1eda)
2018-04-23Report: dataTibor Frank2-56/+38
Change-Id: I63a4a6f65aa80a4edb11b1ea3ece9787a148f6f2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 85a5bd538583f33dc63e072cfa4b3b6750958191)
2018-04-23Report: dataTibor Frank1-2/+2
Change-Id: I3fd24ba9030a62f9307a24e8774e703fa8232692 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d94b0d05bad404db4d44bc12a96f29a838394c94)
2018-04-23CSIT-1041: Trending dashboardTibor Frank2-44/+35
- add long term classification Change-Id: Iec8d2275c01da3b1e41435b9abfb70ec3fe98fd3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7aff808942440ba9729bf60888738b920c024324)
2018-04-23PAL Trending: fix in remove_outliersTibor Frank2-2/+3
Change-Id: Iec4d1683b8bb97224971d803821aced3c37144bd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7cfdac0cf07e3a7d9a8b53b7621f8b7500fd1515)
2018-04-23FIX: Use rolling window for outlier detectionVratko Polak3-40/+55
+ Rename find_outliers to split_outliers. + Make remove_ouliers call split_outliers internally. + Add "window" argument to both functions. + Add TODOs to call sites not setting window size explicitly. + Improve docstrings. Change-Id: I24961e2859ddbfa62b543031284517c7389a2abb Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 4f5872c1bb23873b3a93cb471aae8700d5ca029d)
2018-04-20CSIT-1053: csit-dpdk-perf-1804-all dataTibor Frank1-20/+15
Change-Id: I38f6260bdaf94c39c105c0faa9779773d76cb972 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4cc8b3a4b890ecd7cefcb22a5f2a2acd1036cf78)
2018-04-20CSIT-1041: Trending dashboardTibor Frank2-2/+3
Change-Id: I56437bdb0c0b7309e2bdf4a81fd9e9b20843b040 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0bd0db7f4e5333bcc93fc981594bb90a2ed140fb)
2018-04-19CSIT-1041: Trending dashboardTibor Frank1-2/+68
Change-Id: Ide76682e210412fdcd945a21946fa9957429109d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bb81ef05b86154d000128ef15bd3ecffe997ef9a)
2018-04-19CSIT-1041: Trending dashboardTibor Frank1-1/+1
Change-Id: Id5a6a431261443eb8616c9d6ff4cc43b6f054791 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a0f580f21995185fcbd02aac905d83275faeda72)
2018-04-19CSIT-1041: Trending dashboardTibor Frank1-28/+63
Change-Id: I175bf9269a9f958dc35d592a2810b7a6f37268a3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1265b8792b8edd44407c8073aeba2ca24dc0ad82)
2018-04-19CSIT-1052: Remove HC Performance from 1804 reportTibor Frank1-10/+20
Change-Id: I924028fd6d56fff1859bc1fd27d7a5273d54435f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 98f7c4743d36b03cbe9952ff7e3e60e39f851e2d)
2018-04-19CSIT-1041: Trending dashboardTibor Frank2-68/+88
Change-Id: I2b08c3c1859302437092456da4bb8f1ebe4756bf Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6942369b1102a8b9a3b705f9192f1ecb959382d1)
2018-04-18CSIT-1041: Trending dashboardTibor Frank1-2/+4
Change-Id: I98db049e4a8a3fedce73290815cf84e7d281f6ec Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 56b9eabf3b4c2f80c831c6440c67d0d65826461d)
2018-04-17Report, trendingTibor Frank4-9/+14
Change-Id: Ib71be16f2ddf172c381b43d289a9a0000dad10b6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2387340f7050112311cd231f7d30d06731da4836)
2018-04-17Report: Compare MRR dataTibor Frank2-15/+217
Change-Id: I66bfb11568401d0640e809b5d70fc414b09d5011 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e3554783146e2c4f2b6b5084c8afc707787d6922)
2018-04-17CSIT-1041: Trending dashboardTibor Frank4-73/+115
Change-Id: I983c5cccd165fb32742d395cf7e8aa02c7f9394a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 23731f392ad8705b17cf37f9c2d397b20305f924)
2018-04-16CSIT-1041: Trending dashboardTibor Frank6-67/+157
Change-Id: Ic706612218e0ac6b991a15abc4d67e16905e8087 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9821b058c2f4901a9b4d66667018da214513ab28)
2018-04-16CSIT-1041: Trending dashboardTibor Frank1-1/+1
Change-Id: Ib095a5cb1e825ffd4be09414b52fb0bbb133828c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c1768398d4b5e4b26154eefae85ddd1bf193cbf6)
2018-04-15CSIT-1041: Trending dashboardTibor Frank1-2/+2
Change-Id: I4f2068503cc02091b439ebfb15ebe92aa203252d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 99d4cc007624691f87f8c21a89eab73aec3a08fa)
2018-04-15CSIT-1041: Trending dashboardTibor Frank2-6/+16
Change-Id: I4cedfaab7f6e5d854a5107c4ac69413eb89186d0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b6de6fb4bcf50cd347df181121602db9ac2c9eec)
2018-04-15CSIT-1041: Trending dashboardTibor Frank1-10/+17
Change-Id: I74b2c5d56ccf764868759fd5d7f2301d4ad3d725 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 29035746be0145db942832b55555b695da2323d7)
2018-04-15CSIT-1041: Trending dashboardTibor Frank1-2/+6
Change-Id: I1905039550283d7eb23d02b32bb5fb837215e37e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4914a78f593124788c754695b79be146c3916c6f)
2018-04-15CSIT-1041: Trending dashboardTibor Frank5-154/+169
Change-Id: I18f06b67af7ce8894bfbddbd70d2a9c1f33435be Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f2f19bad6847e315366e5e9ab4952fded0097b1f)