aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-07-13Refactor perf test casesPeter Mikus312-29633/+6697
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Add stats segment heapsize to default configPeter Mikus2-0/+10
- Scale tests (ip4, ip6) are failing due to low amount of stats segment heapsize. Change-Id: Id9b3e84d5a5c63014c17041c08c00ef6188afa5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Update skylake tesbed inventoryPeter Mikus12-37/+265
- Add missing topology files - Add missing topologies to bootstrap - Small fixes in ansible Change-Id: I3b9ad60a0adfae9e93e5e700279f7ade81174471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12CSIT-1168 Create bootstrap for 2-node topologyPeter Mikus2-116/+149
Update existing bootstrap to recognize 2node/3node topologies Change-Id: I2f81f9d69d824f7eea608413eac35a1598fad8c6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12FIX: PAL: input data processingTibor Frank1-0/+3
Change-Id: I295ca0a991dea8104e9794d7013be908f5461ea2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-12Update Ligato to latest dev branchPeter Mikus2-37/+21
- Due to heavy modifications on vpp-agent docker images we need to change build mechanics. Change-Id: I26fb82ed1b2538335f7dc3dbb7f46ed2bb846583 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12CSIT-1186: Consume MLRsearch in agreed upon wayVratko Polak16-809/+4
+ Rename search to MLRsearch in resources/libraries/python/. + Make PyPI/MLRsearch/MLRsearch a symlink to the renamed directory. + TrafficGenerator.py to import from the renamed directory/module. - No change to MLRsearch code. - Version stays at 0.1.1 to point to the latest released code. Change-Id: I4a38b0b7f8f083fbb1a93b25522560144b4ef556 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak137-182/+253
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-11CSIT-1183: Process the new and the old TC namesTibor Frank2-2/+28
Change-Id: I7fcecd7e23494e8fb0e70e7af00408eed16733e4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-11Add .gitattributes to make endlines automaticVratko Polak1-0/+16
Change-Id: I9d58a5b0623c1b9d218e805fa619b324765f97a5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-10CSIT-1189: Add suite setup to source code documentationTibor Frank2-12/+33
Change-Id: I0cc435ecacaeb5f9e8fd5c67f495166a1abd2e91 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10PAL: Treat the new and the old TC namesTibor Frank1-0/+6
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: If5999de81b4e062d38ce44871f0c4d4fa794b55c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10Remove THIS tag and use unix endlinesVratko Polak45-4414/+4414
The THIS tag has sneaked in 10Ge2P1X520-Eth-L2Xcbase-Eth-1Memif-1Dcr-Mrr but usually it is only to be used in draft testing. Not sure about the way non-unix endlines crept in. Is not git supposed to perform endline conversions on text files? Or are .robot, .rst, .yaml and .vat not recognized as text? Change-Id: Ia78cf942c05c3029c340a8639782786f37e57469 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-10CSIT-1142 2-node topology - keywords DPDKPeter Mikus9-204/+172
Change-Id: Ia2676a7b846bd574aa86703fce6b0e3218f98776 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-09FIX: use correct match_n_vectors value in IPx iACL TC03Jan Gelety2-2/+2
Change-Id: I2e454a2410ffda2673745e6415666a0f96291491 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-07-09FIX: Implement changes required by Plot.ly 3.0.0Tibor Frank3-17/+6
- Scatter.xaxix.autotick - Scatter.yaxis.range[] Change-Id: I171e0c4a796f713985b69fae23bfb768590274b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-09CSIT-1142 Change thread perf test TAGsPeter Mikus342-8084/+7994
Due to automatization of SMT detection this change is suppose to remove static thread/core tags in favor of dynamic one. Leaving the static tags for number of physical cores to be able to select TCs. Change-Id: I7f99f605821f363e45c333f46d1dea786693521b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-09CSIT-1142 2-node topology - keywordsPeter Mikus311-983/+956
- Clean up of 2-node setup KWs Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-09Update of VPP_STABLE_VER and DPDK_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~471-g65784c1~b4600 - use new vpp ref build - centos7: 18.07-rc0~471_g65784c1~b4520 - use new dpdk version: 18.05-vpp1 Change-Id: Ica5f07d07b2e4893fb2ba67573a2aec5d23e1b2d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-07-06Add Skylake optimization to ansiblePeter Mikus2-2/+41
- Add kernel params - Add TurboBoost managing Change-Id: I9d9561290f8f6780ff41f3a418a1f335d935d843 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-03VTS VXLAN vhost-user with single DUT, TG sends VXLANPeter Ginchev4-0/+557
Change-Id: I63539af2cdbdbd02a67068e48d0fdf2743da3b1e Signed-off-by: Peter Ginchev <pginchev@cisco.com>
2018-07-03CSIT-1046 Make uio driver configurable from topofilesPeter Mikus4-20/+35
Currently we are configuring uio_driver from global variable. This may not be suitable for various topologies where we need different driver per TB. This patch is suppose to put uio_driver into topology files. Change-Id: I56af0697e8b2359ccb126151217976408720c1ba Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-02Update of VPP_STABLE_VER and DPDK_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~449_gef8ead5~b4498 - use new vpp ref build - centos7: 18.07-rc0~449-gef8ead5~b4575 - use new dpdk version: 18.02.2-vpp1 Change-Id: I6b708288dbad895fcfa454b8fda62446074b32a4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-07-02Compatibility fixes with Ubuntu 18.04Peter Mikus4-11/+29
Currently we are using ip:port socket to for VPP to listen for incoming connections. There is only one place in code this socket is used for detection if VPP is responding after restart. This patch is supposed to change ip:port to sock:file which is default preffered way in VPP. This way we can start using vppctl. netcat on the other side with ip:port remains hanged in console for infinite time not returning back. There is also need to check whether uio_module is loaded and eventually load it. As uio_pci_generic is not working there, we will fallback to main igb_uio (uio_pci_generic being only lightweight subset of igb_uio). This patch also add additional verbose output to console during setup to better understand if failure happens during copy/extract/setup. Change-Id: I0b8a3b76dce3316496a3ad928f58718b6e73057d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-29HC Tests: use vpp-fib-management module in dhcp tests (HC2VPP-348)Marek Gradzki2-7/+7
Addaps HC DHCP tests to https://gerrit.fd.io/r/#/c/13299/ Change-Id: I874da5ee76fcfdb5039c1b3ad33aec4af80396d0 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-06-29Add vfio-pci support on all TBPeter Mikus1-1/+5
- Add auto load of vfio-pci - Add iommu support Change-Id: I13611fab9db2813eeab7f90c8f961594349e561e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-29CSIT-1124: Support multi-sample testsTibor Frank16-262/+628
+ Store parsed MRR results as AvgStdevMetadata + Modify tables and plots to use AvgStdevMetadata Change-Id: I29bb1e492a664544e63a180055f66bb0eecfb957 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-29SetupFramework to detect failures, part IIPeter Mikus5-12/+13
- This patch is enforcing evaluation and aligning all __init__.robot files to use the same logic. Change-Id: I9e2bf5e904bb6d22f4e6a153c951c3b3c233e2fb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-28Jumpavg: Post 0.1.3 release editsVratko Polak3-2/+11
+ PyPI/jumpavg version bumped to 0.1.4. + presentation requirements bumped to 0.1.3. + Added stub for change log in readme. Change-Id: I21a606ed7d9aa2b9cc761ed20f94bda41963a1a8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-28Fix jumpavg: No negative variance from roundingVratko Polak1-16/+19
The algorithm for computing stdev has been changed to a more stable one, based on Welford's algorithm. Change-Id: I51e02d9c5c26cda0d4e998381d5011aa793e6483 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-28Add New Skylake topology filesPeter Mikus13-9/+908
Change-Id: I6109729ee303806f69bba365c93b4de67b9a8c32 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-28FIX: SetupFramework to detect failuresPeter Mikus1-65/+57
- Fix behavior of setup framework to properly detect and raise exception in case of any issue occurs during framework setup on any node - General code cleanup Change-Id: Id4cf36e221817600164b25d5551582838b0f0d5e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-26Small update to PXE installation READMEPeter Mikus1-0/+4
Change-Id: I1766e3cd81cfe4ed049ed3e7034fff1e367396d4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-25Update PXE info about new Skylake machinesPeter Mikus4-35/+52
Change-Id: Ide828efb0e539ae7bf9c5cfd128f35d8117f3643 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-25Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~394-ge0d2bd6~b4508 - use new vpp ref build - centos7: 18.07-rc0~394_ge0d2bd6~b4435 Change-Id: I3b1a749cf4192321af9ec1e9d297b938092d4135 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-06-25FIX: use correct path to vpp build packages in weekly bootstrapJan Gelety1-2/+2
Change-Id: I5a92499cc7f1e475614126fcb6044d48615673ab Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-06-22CSIT-1043: Execute pci rescan only if neededjuraj.linkes2-51/+27
Pci rescan is a rather invasive process, which is why it should be executed only if needed. This patch moves the pci rescan after pci device driver discovery, rescanning the devices for further attemps at driver discovery. Change-Id: I29c939b44c3f67371416a99c711e057f711ba9b4 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2018-06-21Fix TC02 test case in mgmt-cfg-int-subint-apihc-apivat-funcMichal Cmarada1-0/+2
Add wait for interface to be up, because it takes some time while the interface state changes. Change-Id: I895dea1017ac0ffd099e80d9edca0f1d127657dd Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-06-21HC2VPP-331: Fix Honeycomb fails to assign VRF to interfaceMichal Cmarada6-31/+241
- add configuration for FIB table management to test suite - fix routing test suite HC2VPP-331 bugs - fix intip4-intip6 test suite HC2VPP-331 bugs Change-Id: I0b1e9ed787d9fb68e76a6d61c1eea2519a36a6c4 Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-06-21CSIT-1136: Trending: Redirect "new" to the index.htmlTibor Frank19-200/+0
- remove the code which generated redirection Change-Id: Ia12ea1129724d92a6ac6e88782e562c23722ae48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-21CSIT-1136: Trending: Redirect "new" to the index.htmlTibor Frank19-0/+200
Change-Id: I2480a59fb34af70d78bc7404cd380c4b4d3ea483 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20FIX: PAL - list of failed testsTibor Frank4-36/+26
Change-Id: I03341283270e53df6bcb08b32f1787f61ebb601c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20CSIT-1110: Replace old trending with the new oneVratko Polak46-17621/+212
+ Remove /new/ folders in presentation and docs. Change-Id: I870002ba8509189196e778aa1292b93e83a3ec17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-20Revert "CSIT-986: Use MLRsearch from pip"Peter Mikus10-5/+810
This reverts commit 0c2c57d9965ab1db0d5404ad103871ac250339cb. Reason for revert: unless you will fix this broken patch we have to revert this as it breaks several thing in the csit core ci/cd. 1) all tb are pypi offline this means no new pypi is automatically dowloaded. Everytime you change your version you have to update every tb. As this is not automated this will never work and put extreme overhead 2) this code is not pylint checked and not verified by any existing job breaking any kind of verificition mechanics in csit 3)there is no automation in terms of creating pypi (no job) this creates chicken egg problem that you cannot verify change unless new version is installed Next time please think or consult with more seniored csit core developer Unless above will be fixed i will revert on monday as now it breaks all jobs. I will set hard verification to framework setup (exception) so this will prevent next time merge. Possible solution: 1)Move the directory back to resources and reference from csit directly not via pypi, leave the setup crap in dir and let users to create package on their own Change-Id: Id530a9f19f668e45f73ffc9e7371bb453b59fd1b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-20Update of VPP_STABLE_VER and DPDK_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~358-ga5ee900~b4457 - use new vpp ref build - centos7: 18.07-rc0~358_ga5ee900~b4395 - use new dpdk version: 18.02.1-vpp2 Change-Id: Idc72e3a01dbb1b479a4a9b6404c4b01d5a7c4627 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-06-20CSIT-1110: Improve new detection methodology docVratko Polak2-37/+82
Change-Id: I068fd4e9418f232ee1e1f13994e9c5c431478ec8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-19Use pkg download script in bootstrap filesPeter Mikus7-207/+122
Download specific version of VPP/DKMS via download script. Change-Id: I6585790224d746a9edea7fa6624e810f389218e6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-19CSIT-1133: Cosmetic improvements in trending plotsTibor Frank2-17/+18
- Remove "outlier" from the colorbar - Remove anomalies from the legend Change-Id: Idd3255d912c48c80347a773a6b19307e90a53926 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-986: Use MLRsearch from pipVratko Polak10-810/+5
+ Delete resources/libraries/python/search/. + Add MLRsearch==0.1.1 to requirements.txt. + Bump PyPI/MLRsearch version to 0.1.2. Change-Id: I1f86d75ac8eb90ee3946dbac8c56280f39302f4d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-18CSIT-1126: Detection and reporting of failed MRR testsTibor Frank10-245/+669
Change-Id: Iafdd12a573b58ab3ba9c69699cd97c5a4e598601 Signed-off-by: Tibor Frank <tifrank@cisco.com>