aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-06-29SetupFramework to detect failures, part IIPeter Mikus5-12/+13
- This patch is enforcing evaluation and aligning all __init__.robot files to use the same logic. Change-Id: I9e2bf5e904bb6d22f4e6a153c951c3b3c233e2fb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-28Jumpavg: Post 0.1.3 release editsVratko Polak3-2/+11
+ PyPI/jumpavg version bumped to 0.1.4. + presentation requirements bumped to 0.1.3. + Added stub for change log in readme. Change-Id: I21a606ed7d9aa2b9cc761ed20f94bda41963a1a8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-28Fix jumpavg: No negative variance from roundingVratko Polak1-16/+19
The algorithm for computing stdev has been changed to a more stable one, based on Welford's algorithm. Change-Id: I51e02d9c5c26cda0d4e998381d5011aa793e6483 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-28Add New Skylake topology filesPeter Mikus13-9/+908
Change-Id: I6109729ee303806f69bba365c93b4de67b9a8c32 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-28FIX: SetupFramework to detect failuresPeter Mikus1-65/+57
- Fix behavior of setup framework to properly detect and raise exception in case of any issue occurs during framework setup on any node - General code cleanup Change-Id: Id4cf36e221817600164b25d5551582838b0f0d5e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-26Small update to PXE installation READMEPeter Mikus1-0/+4
Change-Id: I1766e3cd81cfe4ed049ed3e7034fff1e367396d4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-25Update PXE info about new Skylake machinesPeter Mikus4-35/+52
Change-Id: Ide828efb0e539ae7bf9c5cfd128f35d8117f3643 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-25Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~394-ge0d2bd6~b4508 - use new vpp ref build - centos7: 18.07-rc0~394_ge0d2bd6~b4435 Change-Id: I3b1a749cf4192321af9ec1e9d297b938092d4135 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-06-25FIX: use correct path to vpp build packages in weekly bootstrapJan Gelety1-2/+2
Change-Id: I5a92499cc7f1e475614126fcb6044d48615673ab Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-06-22CSIT-1043: Execute pci rescan only if neededjuraj.linkes2-51/+27
Pci rescan is a rather invasive process, which is why it should be executed only if needed. This patch moves the pci rescan after pci device driver discovery, rescanning the devices for further attemps at driver discovery. Change-Id: I29c939b44c3f67371416a99c711e057f711ba9b4 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2018-06-21Fix TC02 test case in mgmt-cfg-int-subint-apihc-apivat-funcMichal Cmarada1-0/+2
Add wait for interface to be up, because it takes some time while the interface state changes. Change-Id: I895dea1017ac0ffd099e80d9edca0f1d127657dd Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-06-21HC2VPP-331: Fix Honeycomb fails to assign VRF to interfaceMichal Cmarada6-31/+241
- add configuration for FIB table management to test suite - fix routing test suite HC2VPP-331 bugs - fix intip4-intip6 test suite HC2VPP-331 bugs Change-Id: I0b1e9ed787d9fb68e76a6d61c1eea2519a36a6c4 Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-06-21CSIT-1136: Trending: Redirect "new" to the index.htmlTibor Frank19-200/+0
- remove the code which generated redirection Change-Id: Ia12ea1129724d92a6ac6e88782e562c23722ae48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-21CSIT-1136: Trending: Redirect "new" to the index.htmlTibor Frank19-0/+200
Change-Id: I2480a59fb34af70d78bc7404cd380c4b4d3ea483 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20FIX: PAL - list of failed testsTibor Frank4-36/+26
Change-Id: I03341283270e53df6bcb08b32f1787f61ebb601c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20CSIT-1110: Replace old trending with the new oneVratko Polak46-17621/+212
+ Remove /new/ folders in presentation and docs. Change-Id: I870002ba8509189196e778aa1292b93e83a3ec17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-20Revert "CSIT-986: Use MLRsearch from pip"Peter Mikus10-5/+810
This reverts commit 0c2c57d9965ab1db0d5404ad103871ac250339cb. Reason for revert: unless you will fix this broken patch we have to revert this as it breaks several thing in the csit core ci/cd. 1) all tb are pypi offline this means no new pypi is automatically dowloaded. Everytime you change your version you have to update every tb. As this is not automated this will never work and put extreme overhead 2) this code is not pylint checked and not verified by any existing job breaking any kind of verificition mechanics in csit 3)there is no automation in terms of creating pypi (no job) this creates chicken egg problem that you cannot verify change unless new version is installed Next time please think or consult with more seniored csit core developer Unless above will be fixed i will revert on monday as now it breaks all jobs. I will set hard verification to framework setup (exception) so this will prevent next time merge. Possible solution: 1)Move the directory back to resources and reference from csit directly not via pypi, leave the setup crap in dir and let users to create package on their own Change-Id: Id530a9f19f668e45f73ffc9e7371bb453b59fd1b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-20Update of VPP_STABLE_VER and DPDK_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~358-ga5ee900~b4457 - use new vpp ref build - centos7: 18.07-rc0~358_ga5ee900~b4395 - use new dpdk version: 18.02.1-vpp2 Change-Id: Idc72e3a01dbb1b479a4a9b6404c4b01d5a7c4627 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-06-20CSIT-1110: Improve new detection methodology docVratko Polak2-37/+82
Change-Id: I068fd4e9418f232ee1e1f13994e9c5c431478ec8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-19Use pkg download script in bootstrap filesPeter Mikus7-207/+122
Download specific version of VPP/DKMS via download script. Change-Id: I6585790224d746a9edea7fa6624e810f389218e6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-19CSIT-1133: Cosmetic improvements in trending plotsTibor Frank2-17/+18
- Remove "outlier" from the colorbar - Remove anomalies from the legend Change-Id: Idd3255d912c48c80347a773a6b19307e90a53926 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-986: Use MLRsearch from pipVratko Polak10-810/+5
+ Delete resources/libraries/python/search/. + Add MLRsearch==0.1.1 to requirements.txt. + Bump PyPI/MLRsearch version to 0.1.2. Change-Id: I1f86d75ac8eb90ee3946dbac8c56280f39302f4d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-18CSIT-1126: Detection and reporting of failed MRR testsTibor Frank10-245/+669
Change-Id: Iafdd12a573b58ab3ba9c69699cd97c5a4e598601 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-986: Implement proposed MDR improvementsVratko Polak22-139/+1357
+ Use first intermediate with goal in initial phase. + Measure above MRR if that got zero loss. + Always prioritizes NDR in internal search. + Rename classes. + Copy code for standalone PyPI publishing. - Original files will be deleted after publish. Change-Id: I5169d602d1e5e35a1894645cd52e70d791871608 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-18CSIT-1110: Update code after jumpavg 0.1.2 releaseTibor Frank4-3/+8
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I29284a258b24f9991379719313f30cce0349c2bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15Update Ansible with new Skylake machinesPeter Mikus21-61/+131
Change-Id: Ia5d0b680deaf7da60696bf2d0260cf7fbea78322 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-15CSIT-1085 eth-l2xcbase-eth-1memif-1dcrPeter Mikus5-0/+1166
Test case definitions Change-Id: I03736ef003d3839859dc450745323362b21aa75e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-15Revert "CSIT-1110: Update code after jumpavg 0.1.2 release"Tibor Frank4-8/+3
This reverts commit f7c46f067a8fb594d2460aaadbe1ca9282b657a8. Change-Id: I409335daac8f9e02bea4e12f2141ab9ceb338964 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15CSIT-1110: Update code after jumpavg 0.1.2 releaseVratko Polak4-3/+8
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I0146efcc7c0b7eefc068464739afa605eda2b2d8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Use jumpavg library from pipVratko Polak23-19/+124
+ Move the jumpavg library code to separate directory. - Bump to 0.1.2 has to be done later. Change-Id: I9722ede48f00e99eeb68ca3f91e0bdeee2937973 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Add files for PyPI migrationVratko Polak7-1/+302
Change-Id: I3414d4391f339ee67066491382b59239a81db241 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Prepare for migrating the new detectionVratko Polak13-28/+90
+ Do not declare BitCountingClassifier.classify() as class method. + Make BitCountingGroupList subclass of list. + Inherit from abstract classes whenever possible. + Drop unneeded imports. + Add module docstrings and class docstrings anywhere. + Add TODOs hinting at possible improvements. Change-Id: Iccfff5c0e7be0607d6cfa74314083fcfe5a4d7d9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-14CSIT-PERF: New trigger designPeter Mikus4-90/+260
- CSIT-1128 - This patch is implementing processing of TAGS specified as part of commit message Change-Id: Iad0923d22fae369dfe923a917e1c0d47d5cbf656 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-13FIX: TAG processingPeter Mikus1-1/+1
Change-Id: I08815de519532e8a20873f8b172d3f42ccfa33fb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-13FIX: TAG processingPeter Mikus3-14/+20
- Improve TAG post processing Change-Id: I5a36f5874ea747cbcae2562fc58c9f5abe9bac02 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-13CSIT-942: RCA - Option 1: Analysing Archived VPP ResultsTibor Frank4-70/+260
- CSIT-953: LLD Change-Id: I0baefd8495f6ae8dc6f95f1cf29f5ccb8053d58d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-13CSIT-1110: Fix dashboard anomaly count rangeVratko Polak2-7/+10
+ Dashboard tables should now report anomalies from last week only. + Changed handling of Nan to report regression. Change-Id: I624b0bc84a93702a31fc79fd670bd645b963f1f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13link for start-testcase-DMMsharath1-0/+5
Change-Id: I2687f6408483cd88a2c820d6da03df511e087ba4 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-06-12CSIT-1110 PAL: Fix warnings by moving new docsVratko Polak17-1/+1
Change-Id: Ie6483e9245872bc6991ed1f3c7aab60131e1eeb1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-12CSIT-1110 PAL: Use group averages for term changesVratko Polak1-41/+23
+ Apply only to trending dashboard tables. + Remove outlier column. - Dashboard description not updated yet. Change-Id: I30e5267c4621564cd4d3ae8bd969d2ef72531d81 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-12Mask out LBOND_DPDK tags from per patch verificationPeter Mikus1-2/+7
Change-Id: I47a5261e9a9b590a408bda093a9310dc38c85873 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-11CSIT-1110: Cherry-pick edits into new detectionVratko Polak21-401/+3381
+ Edit methodology documentation. Change-Id: I441e17862aba4a8572c7c532ed8995790111b4d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Integrate anomaly detection into PALVratko Polak38-0/+14667
+ Keep the original detection, + add the new one as subdirectory (both in source and in rendered tree). - The new detection is not rebased over "Add dpdk mrr tests to trending". New detection features: + Do not remove (nor detect) outliers. + Trend line shows the constant average within a group. + Anomaly circles are placed at the changed average. + Small bias against too similar averages. + Should be ready for moving the detection library out to pip. Change-Id: I7ab1a92b79eeeed53ba65a071b1305e927816a89 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11Trending: Add link to testbed HW specification.Tibor Frank1-0/+6
Change-Id: Ib000f2146bf0612b88c605413108b22fa4a99210 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-08CSIT-1116: Add dpdk mrr tests to trendingTibor Frank7-356/+959
- Add static content - Add models to specification - Add plots - Add dpdk tests to dashboard - Add dpdk to csv and pretty ASCII tables - Get DPDK version from output.xml Change-Id: I2d9a911d882c205f82432125b601b125807f0ca0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-08CSIT-1114 Add DPDK download to bootstrapPeter Mikus6-20/+35
- Add downloading artifacts to bootstrap to be able to use latest dpdk version Change-Id: I5f07e8207780b81ad85b6053db99639c47448409 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-08CSIT-1081 Container VPP configuration refactorPeter Mikus24-37/+245
Adopt code for various topology configurations. Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-08Add DPDK IMIX tests to trendingTibor Frank1-1/+4
Change-Id: Ibacb08a72b939346c90489282b10ebc001446f4b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-07CSIT-1122: Add link bonding tests for x710 to the TrendingTibor Frank2-0/+159
Change-Id: I199195bd771fcf9d363a91037cf98254b2d0b923 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-07CSIT-1121: Add "Get DPDK version" KW to DPDK testsTibor Frank3-5/+3
Change-Id: I6152b3b7d4895a376914166d03ee9ca15ea9eb32 Signed-off-by: Tibor Frank <tifrank@cisco.com>