aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-04-27HC tests: reenable NSH plugin (CSIT-994)Marek Gradzki6-26/+16
Reverts https://gerrit.fd.io/r/#/c/11088/ Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-04-27Report: delete tmp dirTibor Frank3-43/+45
Change-Id: I6ab1eefa9a53419d47fda829c365ce9fab7db3c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27Report: add dataTibor Frank1-8/+8
Change-Id: Ic1c072f41ed967855214570f7b7dbbcacc2a6295 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27CSIT-1041: Do not include last week for long termVratko Polak1-2/+3
Change-Id: Ib7682f24ce22e2e3dc3de74dcef6f70c1785d1c8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-27Report: Add CentOS func testsTibor Frank4-8/+93
Change-Id: Id8e08778f199535cec013d08c0b4ab51e51e5d27 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27FIX: Add api-segment conf to TCP testsTibor Frank2-1/+4
Change-Id: Idf778d8427c8dabf716090cdaeba189e8cccfb98 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27Report: Add dataTibor Frank1-45/+49
Change-Id: I9bce23e0430f5b4b375cdc814251a95245897a53 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27FIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrrJan Gelety1-1/+1
Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-27CSIT-1041: Trending dashboard - coloursTibor Frank2-1/+14
Change-Id: I781e901e81f201d1335708c99eb52783f349725c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27New section: trending analysis methodologyMaciek Konstantynowicz1-2/+220
Change-Id: I09ec04759a5f1f01c3835349c3ae094ae459226e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-04-26Trending: switch back to 3*stdevVratko Polak2-7/+7
Reporting many fake pro/regressions is worse then missing few of the real ones. Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank1-2/+2
Change-Id: Ia1e224ecade79c54b373ba3e8ac53c21c054f648 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank1-9/+12
Change-Id: I6ae8d3a36ada557a2119f6e7f46dde040e4db574 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-11/+10
Change-Id: If7bce2c86b2fb352368c433c5db81a4a4bc976ed Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26CSIT-1041: Trending dashboardTibor Frank2-13/+2
Change-Id: I7aa7f01738649fc3f3b10572d7e08af580293748 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Trending: use 2*stdevTibor Frank2-9/+9
Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: remove VPP unit testsTibor Frank1-1/+0
Change-Id: I1fb0dd1e2d135fab29014d627e003e08ff0a98d4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add dataTibor Frank2-4/+7
Change-Id: I043a50f9d55dd784039a483da034cfe4db65d003 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-2/+4
Change-Id: I9d6ff6021db4356c0b06555c79841b9ed602f671 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-25/+61
Change-Id: Ia29ff844e44575020e71fb3f613e77508bda8b24 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26CSIT-1041: Use TMM for trending lineVratko Polak2-40/+38
+ Make also pro/re-gression detection use TMM. + Update graphs. - Do not update dashboard tables yet. Change-Id: Iae526c846b329ad99549be61481532e197704fb0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-26Update report contentPeter Mikus4-162/+116
- Update report content to match with rls1804 and master Change-Id: Ib50df2482635f07c94ba92f0ed766bd95bc8e52c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-25CSIT-1041: Trending dashboardTibor Frank1-3/+3
Change-Id: If2e06d59fa8986ccf24abc118628b42d1deb6e39 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25CSIT-1041: Trending dashboardTibor Frank3-16/+31
Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25CSIT-1041: Trending dashboardTibor Frank3-142/+67
Change-Id: I1d6aae1839a9d6d44407c90ff257bc37495f0cfa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25CSIT-1041: Do not treat positive jumps as outliersVratko Polak1-2/+2
Change-Id: If6e65faae3b5a31c56f942a7975b5a35f5f6d6a4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-25Edits of intro to perf trending dashboardMaciek Konstantynowicz1-25/+20
Change-Id: Ide9a38ac5798ba5a2c37f42232dc86b186502085 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-04-25Fix warnings reported by gen_doc.shVratko Polak57-542/+563
+ Docstring warnings fixed. + Multiline param descriptions indented by 4 spaces. - Except the PacketVerifier.py one - I have tried several quote-like blocks, nothing works. - Rst warnings not fixed. - How can I fix them? They refer to temporarily created files. + Other improvements: + Python lines no longer than 80 characters. + :return: -> :returns: + Notes before params. + :raises + closing colon after exception class. + Description is a sentence. + Present tense in conditional sentences. + Bumped copyright year in edited files. Change-Id: I462c194eeecb666dc146e26858486a07c990be9b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-25Report: add dataTibor Frank1-0/+9
- https://jenkins.fd.io/job/csit-vpp-perf-1804-all/17/ - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/18/ Change-Id: I3cfebb535c1c1806530ec16e86a5088a94ce3141 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25FIX: SSH socket reading errorPeter Mikus2-19/+18
Currently if the command timeouts due to the nature of script execution we are trying to again read from socket after timeout on seesion expired. This patch is supposed to fix the behaviour and eliminate the second read from channel after it was cloed. Change-Id: Ib0028e901eb6ff4d10ca77d2ea19f9e770e6cef4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-25FIX: Do not ignore zeros while creating csv fileTibor Frank1-1/+2
Change-Id: I0f1f63b9969399258c44176e6ed5a326fd0a5549 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25FIX: Remove feature plots from base graphsTibor Frank1-6/+6
Change-Id: I4118a19bd6204858e96cbf8029aea045478efca7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-24CSIT-1019: Fix PacketVerifier.RxQueue receive timeout issueLucian Banu1-28/+23
Change-Id: I0f7f54e721843b0252ac969ddfabc769a632c1a0 Signed-off-by: Lucian Banu <lucian.banu@enea.com>
2018-04-24Report: Add data sourcesTibor Frank1-22/+28
- https://jenkins.fd.io/job/csit-vpp-perf-1804-all/14/ - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/16/ Change-Id: I7603a41f797a6dd5438c3daa40e883b1643ae712 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-24CSIT-1041: Trending dashboardTibor Frank1-2/+6
Change-Id: I815e61432d418d0f741ed57f5450460951f7191f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-24Use /64 prefix for IPv6 subnet on vhost interfaceNeale Ranns1-1/+1
Change-Id: Iee512d6f5c107e7b2e5fdc7412e07d34a1c6bbd0 Signed-off-by: Neale Ranns <nranns@cisco.com>
2018-04-24CSIT-1041: Trending dashboardTibor Frank1-1/+1
Change-Id: I1e05f75545d97ab186fbc48df44bfe17472d6cfd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-24FIX: TCP perf testsTibor Frank1-1/+1
Change-Id: I6424722641b0cefdf1945b57996bf2c48dc86a3b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-24CSIT-1041: Trending dashboardTibor Frank3-22/+17
Change-Id: Ida3dfcc4a7ae21424e7f6b6db597a80bc633b9da Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23CSIT-1041: Trending dashboardTibor Frank2-32/+58
Change-Id: I8d53c68643acb18bf2b5ab171672b0de02d2d135 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23Report: fix performance comparision tablesTibor Frank2-12/+21
Change-Id: Ieae746412427980fb86512253cc58ebcee991317 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23CSIT-1041: Trending dashboardTibor Frank1-5/+7
Change-Id: I3b8e545bd198281af502acc6e23268e840112423 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23CSIT-1009: SRv6 proxy testsJan Gelety18-20/+1068
- SRv6 with endpoint to SR-unaware Service Function via static proxy - SRv6 with endpoint to SR-unaware Service Function via dynamic proxy - SRv6 with endpoint to SR-unaware Service Function via masquerading proxy Change-Id: I6a6062cb41d810bf9e27dacfd866181bfde4c693 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-23CSIT-1041: Trending dashboardTibor Frank1-1/+2
Change-Id: I99b7acbbf6c773a4d2c5fc74cf7ba02aa6f98fa3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23Report: dataTibor Frank2-56/+38
Change-Id: I63a4a6f65aa80a4edb11b1ea3ece9787a148f6f2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~81-g00cd22d~b4139_amd64 - use new vpp ref build - centos7: 18.07-rc0~81_g00cd22d~b4106.x86_64 Change-Id: I9a86d6535c1bdbdf7865dfa1e0aac85c54457fa5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-23Report: dataTibor Frank1-2/+2
Change-Id: I3fd24ba9030a62f9307a24e8774e703fa8232692 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23CSIT-1041: Trending dashboardTibor Frank2-44/+35
- add long term classification Change-Id: Iec8d2275c01da3b1e41435b9abfb70ec3fe98fd3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23PAL Trending: fix in remove_outliersTibor Frank2-2/+3
Change-Id: Iec4d1683b8bb97224971d803821aced3c37144bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23FIX: Use rolling window for outlier detectionVratko Polak3-40/+55
+ Rename find_outliers to split_outliers. + Make remove_ouliers call split_outliers internally. + Add "window" argument to both functions. + Add TODOs to call sites not setting window size explicitly. + Improve docstrings. Change-Id: I24961e2859ddbfa62b543031284517c7389a2abb Signed-off-by: Vratko Polak <vrpolak@cisco.com>