aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2023-08-18fix(core): AVF init problemoper-230814pmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I67eac5f0e68e9e84041816a8a6e6b8df3fdff664 (cherry picked from commit e9c8b39d0b6c8b7e72f26ace8233df078811b3a1)
2023-08-17feat(swasync): switch to polling modeVratko Polak4-21/+419
Performance of adaptive mode is bad (different bug), keep continuity of ipsec swasync tests (when VPP allows). As 23.06-release does not have the new API message, the new CSIT code needs to be more careful around CRC checking. + Add new crc collection with the new API call used. + Also keep the old collection so older VPP does not fail. + Document how papi executor works with VPP without a message. + Prevent CRC checker from raising bodus errors with old VPP. Change-Id: I9ff933a8a9558289d22d55526905d63e7894378c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 38c04b2566c3ecf2109611628783dd1c8a1be99a)
2023-08-17Add ability to parse more kinds of test resultsVratko Polak3-26/+209
Previously, only BMRR results were recongnized. Now also lower bounds for PDR (optionally NDR) and soak are recongnized. This code expects all tests are of the same type, e.g. when both MRR and NDRPDR tests are run, only MRR result will get parsed. If test or parsing fails, generate fake data based on overall pass or fail, so at least passrate of unknown tests can be compared in theory. Currently affects only per-patch job (vpp-csit-verify-perf-*), but is useful mainly for the upcoming bisect job. + Do not force MRR test type in vpp-csit jobs. - Some test results are still not recognized (e.g. hoststack). + Do not exit per-patch job early on robot failure. + Only changes that introduce a failure (not present in parent) get -1. + The same is true also for introducing unrecognized test results. - The fake values from passrate can be misleading. + Add default nic tag only if NIC tag is missing. + In all jobs, not only in vpp-csit ones. + Do not add NIC tags for device jobs. - No job supports NDR parsing yet. + Can be enabled in future from ci-management side. Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 0634490c0557d94856f6061c323cf6a2592f294b)
2023-08-15GSO: Add export of results to json files.Tibor Frank4-3/+12
Change-Id: Iac742f0571b11e06662af6bf1b680d0b4e196ddd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3b63dc1e6fa72fd47d9f3d07115f28ffa4a2bd7a)
2023-08-14fix(topo): IP addresspmikus1-2/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Icf43f76e80387e7d54164ed531ec844c7dfd87bb (cherry picked from commit c3f6c20aa939ccdb0f3673ea715886ad3d1d2333)
2023-08-11feat(core): QAT initialization refactorpmikus9-119/+166
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Idc91da55ab0b5c6b8eb53e8b4ce4da18a1ae891c
2023-08-11feat(dash): Add uWSGI statspmikus2-0/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I904391601996f344d921f818c2c700f2bc30a6c6
2023-08-11feat(terraform): Update Dash platformpmikus6-12/+12
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I1ed0abbd3527f928ec865166be085d413f9f4bad
2023-08-09C-Dash: Update requirements fileTibor Frank21-192/+311
+ add pyarrow exception processing + set 'dtype_backend="pyarrow"' for "wr.s3.read_parquet" method + add pyarrow schemas + improve console output Change-Id: Iae7f1dda3de4804af7089b80b9001f05d3364b39 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-08-07fix(core): Disable core dbg analysispmikus1-4/+5
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia85c4a48155c1e760120a61b39bacbb9de1ab673
2023-08-07Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Iaf6f39d49c3414eaf00aba6e482f0635c0c58e52 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-08-04fix(ansible): QAT v1.x installoper-230807pmikus4-16/+98
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I2e2047f3d02a1c4f90298cb15f2574e5ea6a7ad4
2023-08-04fix(core): QAT VF bindpmikus2-12/+16
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iafae1a1f538b928d3bb80bf9610a0bf7de646f8a
2023-07-31C-Dash: fix link in statsTibor Frank1-2/+2
Change-Id: I187f6a053998276ac552724ef857c8530ed23650 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-31Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I1169dbd336e48b2aa7141b94d3583b609686f423 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-27fix(ansible): QAT install flowoper-230731pmikus1-2/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4670366b704f0cd999d8a3ba08712b72148078a0
2023-07-27fix(core): QAT initializationpmikus6-86/+118
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I28af64b7d39a97bbb84f9d987a3f5d3a2d02701b
2023-07-27fix(ansible): QAT installationpmikus2-2/+6
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I48084f28070126561de630332e7b6f38f6e595ac
2023-07-27feat(core): Core allocationpmikus9-122/+146
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I782b87190dbee6e0a12c97f616b80539cd6614bd
2023-07-26job-spes: Remove gtpuhw tests from mlxTibor Frank5-37/+1
Change-Id: I7ff782992ac6d5a9d585932df8986f3b457fc7e1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-25job-spec: Remove rdma tests from 2n-spr coverageTibor Frank16-712/+0
Change-Id: I3a96edf248dc6b0896cf68bdffbf9d40e73c8f61 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-24Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I3cd54230a5f72773da301e40d5d0c46d9e8be9e0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-20feat(terraform): Add 3n-c6in, use intel TG for ARMoper-230724pmikus14-256/+1246
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Icac039f959b0dda007bc06152602e6fb42e5f7a1
2023-07-17feat(crc): print warnings in crc checker scriptVratko Polak2-2/+18
Robot already prints warnings when running tests, but not many people are looking at robot console output. This makes the warnings visible also in VPP API CRC job console log. Change-Id: I9044a2970f46e132ec80ae0faa2e0adacc889447 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-17Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I59afb80fba10a1399e03a07b0ee77fe6fb985d44 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-14feat(crc): bump messages for cycle after 2306Vratko Polak9-29/+144
The supported VPP code is 380c62d7040bf285d449f1d05692141c40089470 which is the latest commit before stable/2306 diverged from master. + Separate messages into blocks with paths to .api sources. + Prepare memif for use_dma (currently always false). + Use srv6 test teardown action in srv6 device tests. - Do not use sr_policy_add_v2 from 37258 yet. - Leave a TODO to do it eventually, for now inputs are too different. - Do not use index based policer calls from 37873. - The policer_add_del is not deprecated yet and inputs are different. Change-Id: I350138f09542ec12ce4bec140203175940ccf9d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-14fix(packer): Namingpmikus1-22/+22
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I7c9ee9887b86ec1a0ef2dfa6d2f6fbce39fd2a04
2023-07-14fix(packer): Namingpmikus8-48/+56
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8127beeb6664aa51ef5cb313d658ab2e5638b581
2023-07-14feat(aws): Add new flavorspmikus40-74/+1878
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie63b3d6c7ff376d808587e7c96f386946c939a81
2023-07-14fix(jumpavg): penalize stdev also for size=2Vratko Polak3-5/+10
This fix is mainly needed for bisection using PDR values. The impact on trending is smaller but still beneficial, as this fix should reduce the amount of false anomalies for two-band and other unstable tests. + Update metadata for 0.4.1 release into PyPI. Change-Id: Iabab4df50f4c4ad034362820904a237c507fa710 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-13C-Dash: Update link to release notesTibor Frank1-1/+1
Change-Id: I6ebefd220b1d1d2f9ff5343106340594adc7af68 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-13feat(packer): Cleanuppmikus167-12/+21
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I947f0e349584c3688e207a910e0debfc87562af6
2023-07-13C-Docs: Optimize url linksTibor Frank9-12/+51
Change-Id: I95ae31a84a12c5f5762197e257f30667debc6c0c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-11C-Dash: Release notesTibor Frank1-4/+4
Change-Id: I7d38443f4001604745c36d91441ee9ec8404d3e4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-11C-Docs: Release reportTibor Frank3-167/+132
Change-Id: I257e9ef513f163c48cd9dcb2d183bfada0c54fbb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-11Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I8f4f30e2cbe343e7dd18eeb5d321a326062abd30 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-10C-Dash: enable 2306 coverage dataTibor Frank1-40/+40
Change-Id: I2c3590d22cddc56295751aa886187c35f3838688 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-10report: add content and links to csit-2306 release infoMaciek Konstantynowicz1-10/+47
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Change-Id: I0c1239a8d8f93288accfc46cdaa0290a09975677
2023-07-07fix(core): Remove output_info.xml processingoper-230710pmikus7-64/+42
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I1528d7760228d50a4d89c0e413ad86aa882088ed
2023-07-03docs(links): Remove statically generated linkspmikus6-36/+12
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I76109b44da46ab2c5e9492d4fe5e000f1d811751
2023-06-30fix(infra): Ansible bitspmikus5-16/+14
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ic7527b9e0adf3397542b02d809e2eb40e51d28cc
2023-06-30C-Docs: Release notesTibor Frank1-1/+46
Change-Id: I4acf6f29b09aa1f07f2688b5836282580224723a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-06-30feat(docs): update release notes before rls2306Vratko Polak3-14/+85
Some descriptions will be updated later according to the items below: - Some issues (mostly RCAs) need more investigation. - Some issues may have been fixed, waiting for VPP coverage results. - Some issues may have become fixable on CSIT side. E.g. NAT tput tests can use higher ramp-up rate, as the decommissioned 2n-skx testbeds are no longer a bottleneck. Change-Id: I3a98fb308908eeee71cababb5a197413cd232e13 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-06-28C-Docs: CSIT-2306 Release ReportTibor Frank1-5/+10
Change-Id: I9aa608705ad972c8e5ecf234e0ccff18a2d07838 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-06-28C-Docs: Add CSIT-2306 Release Report anouncement.Tibor Frank1-0/+46
Change-Id: I8af12b3bd9177400b099fee939b1c7d2774ab739 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-06-26Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I68ce9247ac520c24b2846626297d109547e4b7bf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-06-23C-Docs: move "Branching Strategy" from wikioper-rls2306-230626oper-230626Tibor Frank2-0/+110
Change-Id: Ie63ee26791050e2312f89a665c3530a1cfa2c58e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-06-23C-Dash: Add hyperlinks to job/buildsTibor Frank5-44/+97
- performance trending - test job statistics - per release performance Change-Id: I2b0479120906b79d45b1887be1e8bb72d9845585 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-06-22feat(infra): Add QAT installpmikus16-2/+124
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ifc461460b2f0f8c7ca17ab32fbf7df52cb356c29
2023-06-22fix(topologies): fix typo in tb215Vratko Polak1-1/+1
Link11 is still there for trex testing. Fixes: d832e05b77a7194042c5429e44442553f37ab529 Change-Id: If500422bbd98bb0a21e92c38efd033d7c6a02ca0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>