aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2018-06-29CSIT-1124: Support multi-sample testsTibor Frank5-262/+231
+ Store parsed MRR results as AvgStdevMetadata + Modify tables and plots to use AvgStdevMetadata Change-Id: I29bb1e492a664544e63a180055f66bb0eecfb957 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-29SetupFramework to detect failures, part IIPeter Mikus1-10/+4
- This patch is enforcing evaluation and aligning all __init__.robot files to use the same logic. Change-Id: I9e2bf5e904bb6d22f4e6a153c951c3b3c233e2fb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-28Jumpavg: Post 0.1.3 release editsVratko Polak1-1/+1
+ PyPI/jumpavg version bumped to 0.1.4. + presentation requirements bumped to 0.1.3. + Added stub for change log in readme. Change-Id: I21a606ed7d9aa2b9cc761ed20f94bda41963a1a8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-28Add New Skylake topology filesPeter Mikus1-0/+37
Change-Id: I6109729ee303806f69bba365c93b4de67b9a8c32 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-28FIX: SetupFramework to detect failuresPeter Mikus1-65/+57
- Fix behavior of setup framework to properly detect and raise exception in case of any issue occurs during framework setup on any node - General code cleanup Change-Id: Id4cf36e221817600164b25d5551582838b0f0d5e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-26Small update to PXE installation READMEPeter Mikus1-0/+4
Change-Id: I1766e3cd81cfe4ed049ed3e7034fff1e367396d4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-25Update PXE info about new Skylake machinesPeter Mikus4-35/+52
Change-Id: Ide828efb0e539ae7bf9c5cfd128f35d8117f3643 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-22CSIT-1043: Execute pci rescan only if neededjuraj.linkes2-51/+27
Pci rescan is a rather invasive process, which is why it should be executed only if needed. This patch moves the pci rescan after pci device driver discovery, rescanning the devices for further attemps at driver discovery. Change-Id: I29c939b44c3f67371416a99c711e057f711ba9b4 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2018-06-21HC2VPP-331: Fix Honeycomb fails to assign VRF to interfaceMichal Cmarada4-0/+208
- add configuration for FIB table management to test suite - fix routing test suite HC2VPP-331 bugs - fix intip4-intip6 test suite HC2VPP-331 bugs Change-Id: I0b1e9ed787d9fb68e76a6d61c1eea2519a36a6c4 Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-06-21CSIT-1136: Trending: Redirect "new" to the index.htmlTibor Frank19-200/+0
- remove the code which generated redirection Change-Id: Ia12ea1129724d92a6ac6e88782e562c23722ae48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-21CSIT-1136: Trending: Redirect "new" to the index.htmlTibor Frank19-0/+200
Change-Id: I2480a59fb34af70d78bc7404cd380c4b4d3ea483 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20FIX: PAL - list of failed testsTibor Frank1-11/+6
Change-Id: I03341283270e53df6bcb08b32f1787f61ebb601c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20CSIT-1110: Replace old trending with the new oneVratko Polak28-14729/+117
+ Remove /new/ folders in presentation and docs. Change-Id: I870002ba8509189196e778aa1292b93e83a3ec17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-20Revert "CSIT-986: Use MLRsearch from pip"Peter Mikus8-3/+809
This reverts commit 0c2c57d9965ab1db0d5404ad103871ac250339cb. Reason for revert: unless you will fix this broken patch we have to revert this as it breaks several thing in the csit core ci/cd. 1) all tb are pypi offline this means no new pypi is automatically dowloaded. Everytime you change your version you have to update every tb. As this is not automated this will never work and put extreme overhead 2) this code is not pylint checked and not verified by any existing job breaking any kind of verificition mechanics in csit 3)there is no automation in terms of creating pypi (no job) this creates chicken egg problem that you cannot verify change unless new version is installed Next time please think or consult with more seniored csit core developer Unless above will be fixed i will revert on monday as now it breaks all jobs. I will set hard verification to framework setup (exception) so this will prevent next time merge. Possible solution: 1)Move the directory back to resources and reference from csit directly not via pypi, leave the setup crap in dir and let users to create package on their own Change-Id: Id530a9f19f668e45f73ffc9e7371bb453b59fd1b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-19CSIT-1133: Cosmetic improvements in trending plotsTibor Frank2-17/+18
- Remove "outlier" from the colorbar - Remove anomalies from the legend Change-Id: Idd3255d912c48c80347a773a6b19307e90a53926 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-986: Use MLRsearch from pipVratko Polak8-809/+3
+ Delete resources/libraries/python/search/. + Add MLRsearch==0.1.1 to requirements.txt. + Bump PyPI/MLRsearch version to 0.1.2. Change-Id: I1f86d75ac8eb90ee3946dbac8c56280f39302f4d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-18CSIT-1126: Detection and reporting of failed MRR testsTibor Frank8-223/+603
Change-Id: Iafdd12a573b58ab3ba9c69699cd97c5a4e598601 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-986: Implement proposed MDR improvementsVratko Polak7-131/+137
+ Use first intermediate with goal in initial phase. + Measure above MRR if that got zero loss. + Always prioritizes NDR in internal search. + Rename classes. + Copy code for standalone PyPI publishing. - Original files will be deleted after publish. Change-Id: I5169d602d1e5e35a1894645cd52e70d791871608 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-18CSIT-1110: Update code after jumpavg 0.1.2 releaseTibor Frank2-2/+2
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I29284a258b24f9991379719313f30cce0349c2bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15Update Ansible with new Skylake machinesPeter Mikus21-61/+131
Change-Id: Ia5d0b680deaf7da60696bf2d0260cf7fbea78322 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-15Revert "CSIT-1110: Update code after jumpavg 0.1.2 release"Tibor Frank2-2/+2
This reverts commit f7c46f067a8fb594d2460aaadbe1ca9282b657a8. Change-Id: I409335daac8f9e02bea4e12f2141ab9ceb338964 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15CSIT-1110: Update code after jumpavg 0.1.2 releaseVratko Polak2-2/+2
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I0146efcc7c0b7eefc068464739afa605eda2b2d8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Use jumpavg library from pipVratko Polak21-1054/+2
+ Move the jumpavg library code to separate directory. - Bump to 0.1.2 has to be done later. Change-Id: I9722ede48f00e99eeb68ca3f91e0bdeee2937973 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Add files for PyPI migrationVratko Polak7-1/+302
Change-Id: I3414d4391f339ee67066491382b59239a81db241 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Prepare for migrating the new detectionVratko Polak13-28/+90
+ Do not declare BitCountingClassifier.classify() as class method. + Make BitCountingGroupList subclass of list. + Inherit from abstract classes whenever possible. + Drop unneeded imports. + Add module docstrings and class docstrings anywhere. + Add TODOs hinting at possible improvements. Change-Id: Iccfff5c0e7be0607d6cfa74314083fcfe5a4d7d9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13CSIT-942: RCA - Option 1: Analysing Archived VPP ResultsTibor Frank4-70/+260
- CSIT-953: LLD Change-Id: I0baefd8495f6ae8dc6f95f1cf29f5ccb8053d58d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-13CSIT-1110: Fix dashboard anomaly count rangeVratko Polak2-7/+10
+ Dashboard tables should now report anomalies from last week only. + Changed handling of Nan to report regression. Change-Id: I624b0bc84a93702a31fc79fd670bd645b963f1f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13link for start-testcase-DMMsharath1-0/+5
Change-Id: I2687f6408483cd88a2c820d6da03df511e087ba4 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-06-12CSIT-1110 PAL: Fix warnings by moving new docsVratko Polak1-1/+1
Change-Id: Ie6483e9245872bc6991ed1f3c7aab60131e1eeb1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-12CSIT-1110 PAL: Use group averages for term changesVratko Polak1-41/+23
+ Apply only to trending dashboard tables. + Remove outlier column. - Dashboard description not updated yet. Change-Id: I30e5267c4621564cd4d3ae8bd969d2ef72531d81 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Cherry-pick edits into new detectionVratko Polak5-401/+651
+ Edit methodology documentation. Change-Id: I441e17862aba4a8572c7c532ed8995790111b4d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Integrate anomaly detection into PALVratko Polak38-0/+14667
+ Keep the original detection, + add the new one as subdirectory (both in source and in rendered tree). - The new detection is not rebased over "Add dpdk mrr tests to trending". New detection features: + Do not remove (nor detect) outliers. + Trend line shows the constant average within a group. + Anomaly circles are placed at the changed average. + Small bias against too similar averages. + Should be ready for moving the detection library out to pip. Change-Id: I7ab1a92b79eeeed53ba65a071b1305e927816a89 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-08CSIT-1116: Add dpdk mrr tests to trendingTibor Frank4-354/+623
- Add static content - Add models to specification - Add plots - Add dpdk tests to dashboard - Add dpdk to csv and pretty ASCII tables - Get DPDK version from output.xml Change-Id: I2d9a911d882c205f82432125b601b125807f0ca0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-08CSIT-1081 Container VPP configuration refactorPeter Mikus7-37/+228
Adopt code for various topology configurations. Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-07CSIT-1122: Add link bonding tests for x710 to the TrendingTibor Frank1-0/+50
Change-Id: I199195bd771fcf9d363a91037cf98254b2d0b923 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-07CSIT-1121: Add "Get DPDK version" KW to DPDK testsTibor Frank2-3/+1
Change-Id: I6152b3b7d4895a376914166d03ee9ca15ea9eb32 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-06HC Tests: reenable NSH plugin (CSIT-994)Marek Gradzki2-18/+14
Reverts https://gerrit.fd.io/r/#/c/12572/ Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-06-05Trending: fixTibor Frank2-2/+2
Change-Id: Ia039b1bc15d52ab8e3bddfd2d09ea5cf4190c67c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-05Trending: FixTibor Frank1-1/+1
Change-Id: Ib9f8d20cb500bb6f485a5fa6211ce1fb00b260a9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-04CSIT-1110: Print NameError to reduce confusionVratko Polak3-9/+9
See https://gerrit.fd.io/r/12724 for an example mistake which also can cause NameError. Change-Id: I65c74744c027800a95014f3be48d0f522a10ce2b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-04CSIT-1112: Add link bonding tests to the TrendingTibor Frank2-31/+83
Change-Id: I3130904423b0e5b24e20d0c74d1b238d2de16f46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-01VPP link bonding - lacp modeJan Gelety6-32/+247
CSIT-1072 CSIT-1083 CSIT-1084 Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-31CSIT-1055: Pkg download script to use package system not curlPeter Mikus2-95/+154
- Rework VPP package download script Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-31HC Tests: use ip-prefix in NAT mapping entries (HC2VPP-325)Marek Gradzki1-8/+8
Adapts HC tests to https://gerrit.fd.io/r/#/c/12810/ Change-Id: I6783b2db061c4cde0942dbb8583e7af8687c54d3 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-31Add s17-t33-tg1 into ansible/pxePeter Mikus3-6/+11
Change-Id: I1e44a17391b19aa09042d02e6f072a7ee3738bb8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-31DPDK link bonding: xor modeJan Gelety5-14/+235
CSIT-1073 CSIT-1074 CSIT-1077 Change-Id: I248e079021c30988210fd792b32d5afdca71aadb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-30CSIT-1068 Update testbed-setup for new server onboardingPeter Mikus3-33/+113
Change-Id: I5e1588b432ebd5655a5451f8f19903f28d1fee2a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-30CSIT-1070 Update Ansible structurePeter Mikus83-334/+1047
Change-Id: I9adab174f0c15f4c05a93f61b17714fa6542ea5d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-29CSIT-1089: Add SRv6 MRR tests to trendingTibor Frank2-0/+53
Change-Id: Id7cf1fd41f10922bce35be97153661cdd41d071b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-29CSIT-1106: Unify the anomaly detection (plots, dashboard)Tibor Frank4-150/+130
Change-Id: I27aaa5482224d1ff518aceb879cd889f2fc8d0f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>