aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-04-27CSIT-1041: Trending dashboard - coloursTibor Frank2-1/+14
Change-Id: I781e901e81f201d1335708c99eb52783f349725c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit eb6840a319390feb18b2ca32854edf1a6ad15e95)
2018-04-27New section: trending analysis methodologyMaciek Konstantynowicz1-2/+220
Change-Id: I09ec04759a5f1f01c3835349c3ae094ae459226e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 2cc56891f5e5b399bd5fbe761c64fcd937e46750)
2018-04-26Trending: switch back to 3*stdevVratko Polak2-7/+7
Reporting many fake pro/regressions is worse then missing few of the real ones. Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 3c510d8dd18bd8ceb2c5d86ed058976e72ddead4)
2018-04-26Report: Add historical data to performance changes tableTibor Frank1-2/+2
Change-Id: Ia1e224ecade79c54b373ba3e8ac53c21c054f648 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5d040b65766fa5d7d6ad111def619abb8c878b87)
2018-04-26Report: Add historical data to performance changes tableTibor Frank1-9/+12
Change-Id: I6ae8d3a36ada557a2119f6e7f46dde040e4db574 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e7f9cb1bc6f96ca79fdba328fd14ce197e28c7a7)
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-11/+10
Change-Id: If7bce2c86b2fb352368c433c5db81a4a4bc976ed Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 52cb667958d954d6233d0865a59d90cca82db026)
2018-04-26CSIT-1041: Trending dashboardTibor Frank2-13/+2
Change-Id: I7aa7f01738649fc3f3b10572d7e08af580293748 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0740688e5798f7ab7162fd7f4bc5eb8455164a7c)
2018-04-26Trending: use 2*stdevTibor Frank2-9/+9
Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d5d53957f4686398727469e0f5b1774a5b6560fe)
2018-04-26Report: remove VPP unit testsTibor Frank1-1/+0
Change-Id: I1fb0dd1e2d135fab29014d627e003e08ff0a98d4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1090a73a99ea3980fd6bbc9b8acd4ccc47b4fb61)
2018-04-26Report: Add dataTibor Frank2-4/+7
Change-Id: I043a50f9d55dd784039a483da034cfe4db65d003 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b892452e1fe2d226f526f9a0685b1095e36b8050)
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-2/+4
Change-Id: I9d6ff6021db4356c0b06555c79841b9ed602f671 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e7fe3850f2777db5c5b6d1fbd0877ebd7cac0f18)
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-25/+61
Change-Id: Ia29ff844e44575020e71fb3f613e77508bda8b24 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 623eb22347f7d5218d3536f620d6911cc312d7dd)
2018-04-26CSIT-1041: Use TMM for trending lineVratko Polak2-40/+38
+ Make also pro/re-gression detection use TMM. + Update graphs. - Do not update dashboard tables yet. Change-Id: Iae526c846b329ad99549be61481532e197704fb0 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit fde192bc8a6ba1a4e2b4cf5b3297fb076efd58fc)
2018-04-26Update report contentPeter Mikus4-162/+116
- Update report content to match with rls1804 and master Change-Id: Ib50df2482635f07c94ba92f0ed766bd95bc8e52c Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 1261ada9edd22c784a7763d861c5acf87ccd1ae1)
2018-04-25Use VPP release 18.04 buildsJan Gelety2-2/+2
Change-Id: I2fdece7633774ba24660b78a465eb4b74bbf26a9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-25CSIT-1041: Trending dashboardTibor Frank1-3/+3
Change-Id: If2e06d59fa8986ccf24abc118628b42d1deb6e39 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a1728c4f56cc44b9acb45614c20fc0a546ee3161)
2018-04-25CSIT-1041: Trending dashboardTibor Frank3-16/+31
Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0f662ea0defa9b30fa7a7d9256857fce92d20a6e)
2018-04-25CSIT-1041: Trending dashboardTibor Frank3-142/+67
Change-Id: I1d6aae1839a9d6d44407c90ff257bc37495f0cfa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6e1a15acc7bd3685d71f9d34238181c681dcd4c0)
2018-04-25CSIT-1041: Do not treat positive jumps as outliersVratko Polak1-2/+2
Change-Id: If6e65faae3b5a31c56f942a7975b5a35f5f6d6a4 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 0a8855adbb30a6079a538bea179a13988fdc20c0)
2018-04-25Edits of intro to perf trending dashboardMaciek Konstantynowicz1-25/+20
Change-Id: Ide9a38ac5798ba5a2c37f42232dc86b186502085 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 28f9f057aadad0b744dc91df3240caac7e311424)
2018-04-25Report: add dataTibor Frank1-0/+9
- https://jenkins.fd.io/job/csit-vpp-perf-1804-all/17/ - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/18/ Change-Id: I3cfebb535c1c1806530ec16e86a5088a94ce3141 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 59e06f5e3143bf093bdb6b53c0186b050668e3d4)
2018-04-25FIX: Do not ignore zeros while creating csv fileTibor Frank1-1/+2
Change-Id: I0f1f63b9969399258c44176e6ed5a326fd0a5549 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d420e98c6838831877f1aad6aa924844fc009195) (cherry picked from commit 2f5a43baecf26ebe978772efc8f6186509cff1c7)
2018-04-25FIX: Remove feature plots from base graphsTibor Frank1-6/+6
Change-Id: I4118a19bd6204858e96cbf8029aea045478efca7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cbd331c63db1db3ac51133732a0eb63ea8dc0712)
2018-04-24Use stable/1804 vpp builds for NSH_SFC testsJan Gelety2-24/+22
Change-Id: Iaaf1af31fa526108ebdcf3610bca76346d186183 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-24Report: Add data sourcesTibor Frank1-22/+28
- https://jenkins.fd.io/job/csit-vpp-perf-1804-all/14/ - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/16/ Change-Id: I7603a41f797a6dd5438c3daa40e883b1643ae712 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 53e9d835462c85738a61ce6f069a05d090645ac8)
2018-04-24CSIT-1041: Trending dashboardTibor Frank1-2/+6
Change-Id: I815e61432d418d0f741ed57f5450460951f7191f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9dad3f95c2624808aeb9892049c236fa788a55d9)
2018-04-24CSIT-1041: Trending dashboardTibor Frank1-1/+1
Change-Id: I1e05f75545d97ab186fbc48df44bfe17472d6cfd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 971bf6f4d091e15952199f0172119228d59f584a)
2018-04-24FIX: TCP perf testsTibor Frank1-1/+1
Change-Id: I6424722641b0cefdf1945b57996bf2c48dc86a3b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit de0aa31e85515e2d8a2a5db24e4520e1db26936d)
2018-04-24CSIT-1041: Trending dashboardTibor Frank3-22/+17
Change-Id: Ida3dfcc4a7ae21424e7f6b6db597a80bc633b9da Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 79e508504fcd6b5b677e567eb09092c5e0821790)
2018-04-23CSIT-1041: Trending dashboardTibor Frank2-32/+58
Change-Id: I8d53c68643acb18bf2b5ab171672b0de02d2d135 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 52f64f232293130904d54a62609eaffc1b145608)
2018-04-23Report: fix performance comparision tablesTibor Frank2-12/+21
Change-Id: Ieae746412427980fb86512253cc58ebcee991317 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6f8266f81bb052e2c0e51b029e47f0eb4f04a7ed)
2018-04-23CSIT-1041: Trending dashboardTibor Frank1-5/+7
Change-Id: I3b8e545bd198281af502acc6e23268e840112423 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7aa0d625baca67d9789b5db3da2ee468597d254b)
2018-04-23CSIT-1009: SRv6 proxy testsJan Gelety18-20/+1068
- SRv6 with endpoint to SR-unaware Service Function via static proxy - SRv6 with endpoint to SR-unaware Service Function via dynamic proxy - SRv6 with endpoint to SR-unaware Service Function via masquerading proxy Change-Id: I6a6062cb41d810bf9e27dacfd866181bfde4c693 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 73a01b1a7fc836c964627eea2c08106df0da5aee)
2018-04-23CSIT-1041: Trending dashboardTibor Frank1-1/+2
Change-Id: I99b7acbbf6c773a4d2c5fc74cf7ba02aa6f98fa3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cd330b5a1bf1a289e7dad68420679a5d94de1eda)
2018-04-23Report: dataTibor Frank2-56/+38
Change-Id: I63a4a6f65aa80a4edb11b1ea3ece9787a148f6f2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 85a5bd538583f33dc63e072cfa4b3b6750958191)
2018-04-23Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 18.04-rc2~18-gfd2e376~b37_amd64 - use new vpp ref build - centos7: 18.04-rc2~18_gfd2e376~b38.x86_64 Change-Id: I597c9189afd0501141aa3417fc7bff235d33d7ef Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-23Report: dataTibor Frank1-2/+2
Change-Id: I3fd24ba9030a62f9307a24e8774e703fa8232692 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d94b0d05bad404db4d44bc12a96f29a838394c94)
2018-04-23CSIT-1041: Trending dashboardTibor Frank2-44/+35
- add long term classification Change-Id: Iec8d2275c01da3b1e41435b9abfb70ec3fe98fd3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7aff808942440ba9729bf60888738b920c024324)
2018-04-23PAL Trending: fix in remove_outliersTibor Frank2-2/+3
Change-Id: Iec4d1683b8bb97224971d803821aced3c37144bd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7cfdac0cf07e3a7d9a8b53b7621f8b7500fd1515)
2018-04-23FIX: Use rolling window for outlier detectionVratko Polak3-40/+55
+ Rename find_outliers to split_outliers. + Make remove_ouliers call split_outliers internally. + Add "window" argument to both functions. + Add TODOs to call sites not setting window size explicitly. + Improve docstrings. Change-Id: I24961e2859ddbfa62b543031284517c7389a2abb Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 4f5872c1bb23873b3a93cb471aae8700d5ca029d)
2018-04-20FIX: Restart VPP in container before each testPeter Mikus14-11/+47
Change-Id: Iec7045aadc0675e04b8c74cbe28f8b3f193bcf1f Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit f3d66d9ca20e7fb2b153d83d809f005a93b76a8f)
2018-04-20CSIT-1053: csit-dpdk-perf-1804-all dataTibor Frank1-20/+15
Change-Id: I38f6260bdaf94c39c105c0faa9779773d76cb972 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4cc8b3a4b890ecd7cefcb22a5f2a2acd1036cf78)
2018-04-20CSIT-1041: Trending dashboardTibor Frank2-2/+3
Change-Id: I56437bdb0c0b7309e2bdf4a81fd9e9b20843b040 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0bd0db7f4e5333bcc93fc981594bb90a2ed140fb)
2018-04-20FIX: Configure number of memif queus properlyPeter Mikus16-37/+49
Change-Id: I2dcb0300829bc961c80cc30d972d0563aeba9364 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit c8b2f57cd09355e0e89e6b9d28930281573bec23)
2018-04-19CSIT-1041: Trending dashboardTibor Frank9-2/+164
Change-Id: Ide76682e210412fdcd945a21946fa9957429109d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bb81ef05b86154d000128ef15bd3ecffe997ef9a)
2018-04-19CSIT-1041: Trending dashboardTibor Frank1-1/+1
Change-Id: Id5a6a431261443eb8616c9d6ff4cc43b6f054791 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a0f580f21995185fcbd02aac905d83275faeda72)
2018-04-19CSIT-1041: Trending dashboardTibor Frank2-45/+82
Change-Id: I175bf9269a9f958dc35d592a2810b7a6f37268a3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1265b8792b8edd44407c8073aeba2ca24dc0ad82)
2018-04-19CSIT-1052: Remove HC Performance from 1804 reportTibor Frank10-223/+21
Change-Id: I924028fd6d56fff1859bc1fd27d7a5273d54435f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 98f7c4743d36b03cbe9952ff7e3e60e39f851e2d)
2018-04-19FIX: Memif tests failingPeter Mikus4-2/+21
- CSIT-1049 Change-Id: I073c1e6d8cdda835fbb955cbf79e982bc2cc6228 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 30c94055dd6ec2fe1cb83455cf6eb4bca8648d45) (cherry picked from commit 04cf5c92a82b11f8eb2cafc3a07793474e84a322)
2018-04-19CSIT-1041: Trending dashboardTibor Frank3-87/+108
Change-Id: I2b08c3c1859302437092456da4bb8f1ebe4756bf Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6942369b1102a8b9a3b705f9192f1ecb959382d1)