aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2024-04-22Add hoststack with DMA test suitesxinfengx5-18/+335
Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066 Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-04-22fix(ip6scale): Document correct prefix lengthVratko Polak14-18/+18
We are testing /128 in ip6 scale tests for a long time, but we did not update the suite documentation when we switched. This does that. Note that ip6 bas (and feature) tests are still using /64. Change-Id: I5e108497b3f516195fce0e480ca3ec18d204bd84 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: If4175b67b34c96a097cbc7f250535159eef816be Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-19feat(jobspec): Unify soak jobspecsVratko Polak5-115/+106
Added 9 common tests (only one for non-default NIC+driver), 4 specific to nodeness (ASTF for 2-node, IPsec for 3-node). + First round, we can add more tests when duration is stable. - Left TODOs for possible improvements. Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-18feat(tests): IPv6 fixespmikus7-45/+43
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f
2024-04-18feat(job_specs): Add soak testpmikus12-46/+195
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e
2024-04-18Revert "fix(ip6): Use updated profile names in 2n suites"Peter Mikus3-6/+6
This reverts commit b3c5215bba37bd6555231da8c40ae90d9fc570c9. Reason for revert: Makes no sense Change-Id: Iabe098114a0e98a89e815daf706745917d8504a6 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-17fix(ipsec): Prepare IPsecUtil for upcoming changesVratko Polak1-44/+36
+ Separate sad into two cycles. + Do not update flags in each iteration. + Update inner dicts. Change-Id: Ic81dfc6e614cc78ff321fba748d48a30678cc88a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-17style(ipsec): Do not import ipsec.robot to suitesVratko Polak131-308/+177
It is already available via default.robot import. Change-Id: I52c8f5d62f641edfbbc4b750e40274a75b169a22 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-17feat(tox): add copyright year fixer scriptVratko Polak5-13/+71
It uses rather simple sed commands, but seems to work well enough. + Improve readme. + Shortened comments about why 3 lines. Change-Id: I50b395dfeb586f671f7c4c82f22369de90b351ec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-17fix(ip6): Use updated profile names in 2n suitesVratko Polak3-6/+6
Change-Id: If5cc42bac1c49d1f1d960e0812ab352564bc29d2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-16style(IPsecUtil): Apply black formattingVratko Polak1-465/+714
Change-Id: I7cc2bc69c6849360abff0bd18b2ae3b93e2303c4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-15feat(api): Use newest API messages after rls2402Vratko Polak5-53/+437
+ gtpu_add_del_tunnel_v2 + Add comments on used values and unused fields. + ipsec_sad_entry_add_v2 + Explicitly pass current default values. + ipsec_sa_v5_dump + policer_add + The old is_add argument removed, it was never false. + sr_policy_add_v2 + Add comments about currently unused fields. + Support also older VP builds with wrong reply. + rdma_create_v4 + Add comments about unused fields. Change-Id: I3d5bc345c4cf099661626770c4d86bc230643cca Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-15Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: If792605aebeeedc722bc677b693be75858ac61e0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-11feat(tests): IPv6 scalepmikus35-35/+2504
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I720b7c96a6ac9f328aff57437e51254364604911
2024-04-10feat(job-spec): Unify memif 1518B tests for 2n-sprVratko Polak4-0/+34
+ Add 4c 1518B tests to all memif 2n-spr coverage suites. + Add 1518B cases to iterative, so recently added DMA can be compared. Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-10fix(report): Update RCAVratko Polak1-1/+1
Probably last update this cycle. Few remamining failures were seen, but they are probably too rare to reproduce. Change-Id: Ia0e1dd20ed23412584624dc313c9de09d2081429 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-09fix(perpatch): Sort comparison output by test nameVratko Polak2-3/+7
Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-08Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I9e7cd93d7b07ba86e11eb9b75a9a11a6f3b4c617 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-04Fix(perpatch): improve compare script outputVratko Polak1-9/+8
+ Make tests more searchable by "Test name" prefix. + Shorten the output code (fewer duplication and continues). Change-Id: I0adfac146a689466345a30646e41fe948ea264ae Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-03job-spec: Add memif DMA 1518B testsTibor Frank4-0/+26
Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-02Revert "fix(topologies): Disable tb31 so jobs use tb32"Peter Mikus1-0/+0
This reverts commit 2734517899b6c109da520e6aef0866c8b78ec708. Reason for revert: not a proper solution, just hides an issue Change-Id: I51cb6875748c29e5bae5894c0cbabf1caf231817 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2024-04-02Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I31939169c1dee80d496fa9d5bcfa3ef3b071eb1a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-27fix(topologies): Disable tb31 so jobs use tb32Vratko Polak1-0/+0
As tb31 is the first reserved for 3n-icxd jobs, most runs are currently failing due to CSIT-1951 (TwentyFiveGigabitEthernet89/0/2 does not do up). Change-Id: I045e10daf114e02d3b46fc0e5a0cf9d080605092 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-27fix(report): Update RCA for this weekVratko Polak1-5/+7
Change-Id: I4c3dfc60361d1109c92f64b4fe360f7063cdf9b9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-26fix(perpatch): Do not repeat test nameVratko Polak1-2/+1
When searching for a specific test, it is confusing to see the name twice, first time close to previous test classification. Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-25fix(terraform): vpp-device filespmikus8-311/+219
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12
2024-03-25Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I32b3ae5beeeb42a6d4ccbe38d92b95c7803c2e01 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-25Revert "fix(core): Disable core dbg analysis"Vratko Polak1-7/+6
This reverts commit ffca8b8655c772fc6273702cae2151e7ac7a846d. + Add 10 second sleep, could help if core is big. Change-Id: Id2b3199737f8c50cee713e8626dce1bfa72ea4e1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-22C-Dash: Add detailed views to comparison tablesTibor Frank6-36/+286
Change-Id: I0936f736497299f8b9fc1254012b2a0b20c41bfb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-21feat(tests): Remove unsupported suitesVratko Polak8-1364/+0
The new suites were added in [1] and the VPP functionality was removed in [2]. [1] https://gerrit.fd.io/r/c/csit/+/28508 [2] https://gerrit.fd.io/r/c/vpp/+/31443 Change-Id: Id3fa984bf9f61a1dd831d637695ac6844c86ffc8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-20fix(report): Two more issues found so farVratko Polak1-1/+4
Change-Id: Ie3b8bf1a0068f0c085806526c97d964b8488b777 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-20job-spec: Add DMA testsTibor Frank4-0/+62
Change-Id: I6530519eaab2d09a187dddd803815888606ff17d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-18Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: If6157519e738f47b2d284bb02592bb25380cc17a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus25-87/+317
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-03-13feat(report): Add currently known issuesVratko Polak2-5/+42
Analysis is not finished yet, some updates may arrive next week. Change-Id: I7a51e279fbb2807ee4064affda8ad445bbd01b02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-12C-Dash: Add tooltipsTibor Frank8-101/+201
Change-Id: I00cf78e2e777fa96754f7b06aab02a8bf8682da5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-11C-Dash: add "download row data" feature to comparison tablesTibor Frank2-28/+87
Change-Id: Iaf5a57402e954453c237fb1e082da6c620cff59f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-11C-Docs: Add a procedure to "Search tests".Tibor Frank2-1/+12
Change-Id: I2b00894c6690cc1ae69d202f90fd9624c271832b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-11Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I70dcb89767587e225bf2585349211953e6ac8713 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-07C-Dash: Add possiblity to remove outliers from comparison dataTibor Frank3-26/+100
- extreme outliers only for now Change-Id: I2be7c291dd207d5a557947415a960fa6d0067c64 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-06C-Docs: Update release informationTibor Frank2-4/+82
Change-Id: I77dbc422f502d0c342177598d30b3bcca7ea5e06 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-05feat(ietf): MLRsearch draft-06Vratko Polak3-1462/+1638
Change-Id: Ia9e22ba1eca74a32ae7141b1bd111bdb9baaddf3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-04feat(device): cx6 update of 1n-alt device jobspecJuraj Linkeš2-70/+126
Update the jobspec according to the current Arm policy: 1. Run most of the tests on cx6, crypto coverage being the most important, 2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver, 3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf) drivers. The above is the policy used in performance testing where time is a major constraint. The same is true for functional testing to some extent, so it makes sense to apply the same logic for choosing the tests. There are 10 tests which are failing on cx6 without an identified reason. They are disabled until we find the root cause and address it. In the meantime, the tests are enabled for x710 with the DPDK driver: ethip4-l2xcbase-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2tap ethip4-l2bdbasemaclrn ethip4-l2bdbasemaclrn-iacl1sf ethip4-l2bdbasemaclrn-iacl1sl ethip4-l2bdbasemaclrn-oacl1sf ethip4-l2bdbasemaclrn-oacl1sl ethip4-l2patch ethip4-l2xcbase When the cx6 issue has been resolved, these should be enabled for cx6 and disabled for x710, with the exception of ethip4-l2bdbasemaclrn, which should be running on both. Change-Id: Id48f450063e405b1faca57431676f91d62e829b9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2024-03-04Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Ib84e4f147583c25c3fccff27a493dc07b37f7d9d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-28C-Dash: Add search in testsoper-240304Tibor Frank44-557/+1909
Change-Id: Ia250c4b4e299d48bc68cf01e65fe37a281047060 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-28job-spec: add more ip4scale tests to 2n-spr and 3na-sprTibor Frank4-0/+40
Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-26Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I9d6047a698c485e664f67bb4ea8847f683d0f688 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-19Update VPP_STABLE_VER filesoper-240226Tibor Frank1-1/+1
Change-Id: I84c7886a6181d24460665cd82ced2f83ced6f415 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-16feat(device): 1n-alt ansible improvementoper-240219Juraj Linkeš2-11/+21
We're seeing extra IGMP traffic which interferes with tests which must be disabled. This is done by disabling the setting by default on all interfaces. The default setting is also adopted for other traffic-related configuration: Default sets the configuration when the interface is created. For hardware interfaces, that is at boot time. For VF interfaces, when we create them with the csit-initialize-vfs.sh script and for virtual interfaces when they're created. On the other hand, the all configuration option doesn't set the configuration. It uses the current configuration value along with the passed configuration value to produce a new value, which could be expressed as: f(old_value, value_from_all) -> new_value Where f is a function specific to each configuration option. Using all thus requires us to know the function and the old value which is less reliable than just using default everywhere. Also fix the 1n-alt VF init script. Change-Id: I3da15abfb5a1e76769076edd95d20e2168b6f71f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>