aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-06-18CSIT-1126: Detection and reporting of failed MRR testsTibor Frank10-245/+669
Change-Id: Iafdd12a573b58ab3ba9c69699cd97c5a4e598601 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-986: Implement proposed MDR improvementsVratko Polak22-139/+1357
+ Use first intermediate with goal in initial phase. + Measure above MRR if that got zero loss. + Always prioritizes NDR in internal search. + Rename classes. + Copy code for standalone PyPI publishing. - Original files will be deleted after publish. Change-Id: I5169d602d1e5e35a1894645cd52e70d791871608 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-18CSIT-1110: Update code after jumpavg 0.1.2 releaseTibor Frank4-3/+8
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I29284a258b24f9991379719313f30cce0349c2bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15Update Ansible with new Skylake machinesPeter Mikus21-61/+131
Change-Id: Ia5d0b680deaf7da60696bf2d0260cf7fbea78322 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-15CSIT-1085 eth-l2xcbase-eth-1memif-1dcrPeter Mikus5-0/+1166
Test case definitions Change-Id: I03736ef003d3839859dc450745323362b21aa75e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-15Revert "CSIT-1110: Update code after jumpavg 0.1.2 release"Tibor Frank4-8/+3
This reverts commit f7c46f067a8fb594d2460aaadbe1ca9282b657a8. Change-Id: I409335daac8f9e02bea4e12f2141ab9ceb338964 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15CSIT-1110: Update code after jumpavg 0.1.2 releaseVratko Polak4-3/+8
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I0146efcc7c0b7eefc068464739afa605eda2b2d8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Use jumpavg library from pipVratko Polak23-19/+124
+ Move the jumpavg library code to separate directory. - Bump to 0.1.2 has to be done later. Change-Id: I9722ede48f00e99eeb68ca3f91e0bdeee2937973 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Add files for PyPI migrationVratko Polak7-1/+302
Change-Id: I3414d4391f339ee67066491382b59239a81db241 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Prepare for migrating the new detectionVratko Polak13-28/+90
+ Do not declare BitCountingClassifier.classify() as class method. + Make BitCountingGroupList subclass of list. + Inherit from abstract classes whenever possible. + Drop unneeded imports. + Add module docstrings and class docstrings anywhere. + Add TODOs hinting at possible improvements. Change-Id: Iccfff5c0e7be0607d6cfa74314083fcfe5a4d7d9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-14CSIT-PERF: New trigger designPeter Mikus4-90/+260
- CSIT-1128 - This patch is implementing processing of TAGS specified as part of commit message Change-Id: Iad0923d22fae369dfe923a917e1c0d47d5cbf656 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-13FIX: TAG processingPeter Mikus1-1/+1
Change-Id: I08815de519532e8a20873f8b172d3f42ccfa33fb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-13FIX: TAG processingPeter Mikus3-14/+20
- Improve TAG post processing Change-Id: I5a36f5874ea747cbcae2562fc58c9f5abe9bac02 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-13CSIT-942: RCA - Option 1: Analysing Archived VPP ResultsTibor Frank4-70/+260
- CSIT-953: LLD Change-Id: I0baefd8495f6ae8dc6f95f1cf29f5ccb8053d58d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-13CSIT-1110: Fix dashboard anomaly count rangeVratko Polak2-7/+10
+ Dashboard tables should now report anomalies from last week only. + Changed handling of Nan to report regression. Change-Id: I624b0bc84a93702a31fc79fd670bd645b963f1f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13link for start-testcase-DMMsharath1-0/+5
Change-Id: I2687f6408483cd88a2c820d6da03df511e087ba4 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-06-12CSIT-1110 PAL: Fix warnings by moving new docsVratko Polak17-1/+1
Change-Id: Ie6483e9245872bc6991ed1f3c7aab60131e1eeb1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-12CSIT-1110 PAL: Use group averages for term changesVratko Polak1-41/+23
+ Apply only to trending dashboard tables. + Remove outlier column. - Dashboard description not updated yet. Change-Id: I30e5267c4621564cd4d3ae8bd969d2ef72531d81 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-12Mask out LBOND_DPDK tags from per patch verificationPeter Mikus1-2/+7
Change-Id: I47a5261e9a9b590a408bda093a9310dc38c85873 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-11CSIT-1110: Cherry-pick edits into new detectionVratko Polak21-401/+3381
+ Edit methodology documentation. Change-Id: I441e17862aba4a8572c7c532ed8995790111b4d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Integrate anomaly detection into PALVratko Polak38-0/+14667
+ Keep the original detection, + add the new one as subdirectory (both in source and in rendered tree). - The new detection is not rebased over "Add dpdk mrr tests to trending". New detection features: + Do not remove (nor detect) outliers. + Trend line shows the constant average within a group. + Anomaly circles are placed at the changed average. + Small bias against too similar averages. + Should be ready for moving the detection library out to pip. Change-Id: I7ab1a92b79eeeed53ba65a071b1305e927816a89 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11Trending: Add link to testbed HW specification.Tibor Frank1-0/+6
Change-Id: Ib000f2146bf0612b88c605413108b22fa4a99210 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-08CSIT-1116: Add dpdk mrr tests to trendingTibor Frank7-356/+959
- Add static content - Add models to specification - Add plots - Add dpdk tests to dashboard - Add dpdk to csv and pretty ASCII tables - Get DPDK version from output.xml Change-Id: I2d9a911d882c205f82432125b601b125807f0ca0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-08CSIT-1114 Add DPDK download to bootstrapPeter Mikus6-20/+35
- Add downloading artifacts to bootstrap to be able to use latest dpdk version Change-Id: I5f07e8207780b81ad85b6053db99639c47448409 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-08CSIT-1081 Container VPP configuration refactorPeter Mikus24-37/+245
Adopt code for various topology configurations. Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-08Add DPDK IMIX tests to trendingTibor Frank1-1/+4
Change-Id: Ibacb08a72b939346c90489282b10ebc001446f4b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-07CSIT-1122: Add link bonding tests for x710 to the TrendingTibor Frank2-0/+159
Change-Id: I199195bd771fcf9d363a91037cf98254b2d0b923 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-07CSIT-1121: Add "Get DPDK version" KW to DPDK testsTibor Frank3-5/+3
Change-Id: I6152b3b7d4895a376914166d03ee9ca15ea9eb32 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-06Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~278-gb2371c2~b4361_amd64 - use new vpp ref build - centos7: 18.07-rc0~278_gb2371c2~b4311.x86_64 Change-Id: Idbb5d2c01839d4bca5cfd4ee9b26788bd15d3905 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-06-06HC Tests: reenable NSH plugin (CSIT-994)Marek Gradzki6-26/+16
Reverts https://gerrit.fd.io/r/#/c/12572/ Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-06-05CSIT-1115: Add dpdk mrr testsTibor Frank4-0/+875
Change-Id: Ib9d060f7e0d476b79debc750409da5277478e5b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-05Trending: fixTibor Frank2-2/+2
Change-Id: Ia039b1bc15d52ab8e3bddfd2d09ea5cf4190c67c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-05Trending: FixTibor Frank1-1/+1
Change-Id: Ib9f8d20cb500bb6f485a5fa6211ce1fb00b260a9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-04CSIT-1110: Print NameError to reduce confusionVratko Polak3-9/+9
See https://gerrit.fd.io/r/12724 for an example mistake which also can cause NameError. Change-Id: I65c74744c027800a95014f3be48d0f522a10ce2b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-04CSIT-1112: Add link bonding tests to the TrendingTibor Frank5-32/+196
Change-Id: I3130904423b0e5b24e20d0c74d1b238d2de16f46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-04Add DPDK MRR weekly into bootstrapPeter Mikus1-0/+8
Change-Id: Ia8c62035afe4178f1967cc1683afed7476186f7c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-01VPP link bonding - lacp modeJan Gelety15-32/+3029
CSIT-1072 CSIT-1083 CSIT-1084 Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-06-01HC Tests: disable failing ACL ODL tests (HC2VPP-337)Marek Gradzki1-0/+18
Change-Id: I1fa3e3876bcc0b4f5e9908cb4f6920d49eb6dd45 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-31CSIT-1055: Pkg download script to use package system not curlPeter Mikus2-95/+154
- Rework VPP package download script Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-31HC Tests: use ip-prefix in NAT mapping entries (HC2VPP-325)Marek Gradzki1-8/+8
Adapts HC tests to https://gerrit.fd.io/r/#/c/12810/ Change-Id: I6783b2db061c4cde0942dbb8583e7af8687c54d3 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-31Add s17-t33-tg1 into ansible/pxePeter Mikus3-6/+11
Change-Id: I1e44a17391b19aa09042d02e6f072a7ee3738bb8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-31DPDK link bonding: xor modeJan Gelety14-14/+3011
CSIT-1073 CSIT-1074 CSIT-1077 Change-Id: I248e079021c30988210fd792b32d5afdca71aadb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-30CSIT-1068 Update testbed-setup for new server onboardingPeter Mikus3-33/+113
Change-Id: I5e1588b432ebd5655a5451f8f19903f28d1fee2a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-30CSIT-1070 Update Ansible structurePeter Mikus83-334/+1047
Change-Id: I9adab174f0c15f4c05a93f61b17714fa6542ea5d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-29Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~252-g229c1aa~b4334_amd64 - use new vpp ref build - centos7: 18.07-rc0~252_g229c1aa~b4285.x86_64 Change-Id: I596520740ed93e31617ee382108bcba269771423 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-29CSIT-1089: Add SRv6 MRR tests to trendingTibor Frank5-13/+165
Change-Id: Id7cf1fd41f10922bce35be97153661cdd41d071b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-29CSIT-1106: Unify the anomaly detection (plots, dashboard)Tibor Frank4-150/+130
Change-Id: I27aaa5482224d1ff518aceb879cd889f2fc8d0f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-25CSIT-1104: Trending: Speed-up plots generationTibor Frank15-787/+401
Change-Id: Ia3916523d4fc9e05ec864af2a858a03dea46c73c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-25HC Tests: mark VRF assignment tests as failing (HC2VPP-331)Marek Gradzki2-0/+22
Failures might be related to: https://gerrit.fd.io/r/#/c/12643/ Change-Id: I0c60d51e27508f937a4b2d6c6b5e6f0703f793ab Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-25HC Tests: mark unnumbered interface tests as failing (HC2VPP-330)Marek Gradzki2-0/+16
Failures might be related to: https://gerrit.fd.io/r/#/c/12632/ and/or: https://gerrit.fd.io/r/#/c/12646/ Change-Id: I529582ef95b6cf752a3f0e98cd0326d4a01d15a8 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>