aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2024-04-10feat(job-spec): Unify memif 1518B tests for 2n-sproper-240408Vratko Polak4-0/+34
+ Add 4c 1518B tests to all memif 2n-spr coverage suites. + Add 1518B cases to iterative, so recently added DMA can be compared. Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 00531ec6ec978e4beb18db17973bb0d81b9b5934)
2024-04-09fix(perpatch): Sort comparison output by test nameVratko Polak2-3/+7
Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit c4b7705089d6c2d01f743c2e93087a6a44025e6a)
2024-04-04Fix(perpatch): improve compare script outputVratko Polak1-9/+8
+ Make tests more searchable by "Test name" prefix. + Shorten the output code (fewer duplication and continues). Change-Id: I0adfac146a689466345a30646e41fe948ea264ae Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-03job-spec: Add memif DMA 1518B testsTibor Frank4-0/+26
Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-26fix(perpatch): Do not repeat test nameVratko Polak1-2/+1
When searching for a specific test, it is confusing to see the name twice, first time close to previous test classification. Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-25fix(terraform): vpp-device filespmikus2-102/+112
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12
2024-03-25Revert "fix(core): Disable core dbg analysis"Vratko Polak1-7/+6
This reverts commit ffca8b8655c772fc6273702cae2151e7ac7a846d. + Add 10 second sleep, could help if core is big. Change-Id: Id2b3199737f8c50cee713e8626dce1bfa72ea4e1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-20job-spec: Add DMA testsTibor Frank4-0/+62
Change-Id: I6530519eaab2d09a187dddd803815888606ff17d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus6-49/+49
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-03-04feat(device): cx6 update of 1n-alt device jobspecJuraj Linkeš2-70/+126
Update the jobspec according to the current Arm policy: 1. Run most of the tests on cx6, crypto coverage being the most important, 2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver, 3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf) drivers. The above is the policy used in performance testing where time is a major constraint. The same is true for functional testing to some extent, so it makes sense to apply the same logic for choosing the tests. There are 10 tests which are failing on cx6 without an identified reason. They are disabled until we find the root cause and address it. In the meantime, the tests are enabled for x710 with the DPDK driver: ethip4-l2xcbase-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2tap ethip4-l2bdbasemaclrn ethip4-l2bdbasemaclrn-iacl1sf ethip4-l2bdbasemaclrn-iacl1sl ethip4-l2bdbasemaclrn-oacl1sf ethip4-l2bdbasemaclrn-oacl1sl ethip4-l2patch ethip4-l2xcbase When the cx6 issue has been resolved, these should be enabled for cx6 and disabled for x710, with the exception of ethip4-l2bdbasemaclrn, which should be running on both. Change-Id: Id48f450063e405b1faca57431676f91d62e829b9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2024-02-28job-spec: add more ip4scale tests to 2n-spr and 3na-sprTibor Frank4-0/+40
Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-15fix(core): daily jobs should not do prefixingpmikus1-5/+7
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I131cc9957b288f4e02e9d02394a1681dbb539d83
2024-02-15fix(bootstrap): typopmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ib2a1ceb9145ef5495c76954ac70cedc5af6fa297
2024-02-14fix(core): Lower amount of TREX cores for externalpmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ic27f46876a93cc01d5f14bbefe0dccd84ab41027
2024-02-13feat(bootstrap): Add ability to load external NODE_FLAVORpmikus2-1/+32
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ia6e07111af543280b2365840bced02f94cf91e75
2024-02-13feat(core): QAT RXQ allocationpmikus1-4/+8
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I78501f08b29a202c0e1129b79af6a63299e8ee36
2024-02-07fix(bootstrap): skip suites for virtual NICVratko Polak1-2/+2
As the skipping logic looks at available topologies, fix skipping by adding virtual to vagrant.yaml Change-Id: I5e7bf1dc2f4f4787917f1f989a974255cf2591a9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-02-06Add memif with DMA test suitesxinfengx7-4/+322
Change-Id: I8c27b5956c0c26bb2de48321675e285ed961412f Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-01-31feat(job_specs): 2n-c7gnpmikus11-42/+196
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Idca0738320b56196e98aeec3050312111a90609a
2024-01-31fix(autogen): Do not set nic_code from nic_nameVratko Polak1-8/+1
This should fix some suites wrongly using nic_pfs=6. Change-Id: Ifb7bd24b9a2d1764634eea4a43b4509f16e03da2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24fix(PLRsearch): handle unsent packets as lossVratko Polak1-5/+20
Change-Id: Icaa88523ede0b1fad6e6cb667a8f307ea5f4a12d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24fix(PLRsearch): fix some pylint violationsVratko Polak3-6/+6
- Complexity and logging would require a larger change. Change-Id: I69f8e47b1806c880cd626bc5a8f5ae6290246093 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24style(PLRsearch): format according to blackVratko Polak4-99/+157
Change-Id: I26e0ce172740f7f440469578294f8c13fec5850b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-23docs(infra): 1n-altpmikus2-12/+12
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I1770a3f49e19d337d4ed6760fb062ba4d445574d
2024-01-23feat(device): Add 1n-alt vpp devicepmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I3d2bb0408f15fd14989d1179d7f08710a3d86e67
2024-01-22fix(jumpavg): Tolerate zero sized runsVratko Polak1-1/+3
Change-Id: I7c2426fe47ca9ee44338423597be90a71aaa3653 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-22feat(bisect): Tolerate zero testsVratko Polak1-8/+10
Needed when the anomaly causes failure in the global suite setup. Also needs a jumpavg fix, in the subsequent change. Change-Id: Ifa8f8fcfc0b25416afa064e606a59b79aa279b61 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-22feat(papi): Tolerate behavior after 39871Vratko Polak1-14/+31
Even when VPP switches back to (or adds support for) the old behavior, this enables bisect to work for all VPP commits in 2402 cycle. Change-Id: Ic2b71bee1db723d9d13229d9f4288d1699d246c6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-18feat(crc): Bump messages after 23.10 releaseoper-240122Vratko Polak3-390/+13
+ Post-release rdma_create_v4 will be added next cycle. Change-Id: Ief129b5be4a2c5d27f4674491c96c548573ecfb1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-17feat(device): Driver compatibilitypmikus1-2/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I55421ca38df412950f4b2487e5db901a1850ed12
2024-01-15feat(ansible): DPDK compatibility matrixpmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I746471b59e1fb00a00007b6e9f2ba02d873ae3e2
2023-12-13feat(bisect): introduce scripts for VPP bisectingVratko Polak6-57/+508
+ Parsing common with per-patch job is moved to a library. Ticket: CSIT-1618 Change-Id: I185bea084a29e6a37ef94e9da42b192a6a81fc17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-12-13feat(bootstrap): refactor functions before bisectVratko Polak6-91/+108
Ticket: CSIT-1618 Change-Id: I0c17f1e8f09a3944032d44efa8ecd36fef2056a2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-12-13fix(Interfaces): do not use JsonParserVratko Polak3-73/+2
In past, there perhaps were Robot keywords needing JsonParser. But now the single remaining call site can call json.loads directly. + Delete now unused resources/libraries/python/parsers/. Change-Id: I9c5d94d6b320f917f1f621abb83556ebccadc3ec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-12-12feat(terraform): Remove ansible dependencypmikus1-9/+9
- terraform ansible is not supported on aarch Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I3d1a592b4ed97fe635813dccbf78dc42d14e0fa9
2023-12-11feat(job_specs): Add 200ge6p3cx7veat testspmikus100-4723/+4732
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ia713b9a0b962820b014bad3582bc095ec802380c
2023-12-07fix(CpuUtils): correct robot variable namesVratko Polak1-4/+4
Fixes: 76fcd8422842d0756338502213de561eaa93e670 Change-Id: Ie642aeed5c55d479e0e4b87be965b4b5f70d6612 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-11-23fix(infra): QAT initpmikus1-8/+10
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I862f9ca12e9149eab2d0701368cdc65f294629cc
2023-11-22fix(core): common.sh typospmikus1-2/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: If25495e0eec60ac84dfaaafec3080f02a17fc740
2023-11-22fix(core): common.sh typospmikus1-2/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I87d0d297c79b1f0c0aa46ff7304586ab1898fed1
2023-11-22feat(infra): 2n-c7gn, 3n-c7gnpmikus2-16/+50
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5a94ae7caf1c3ee08efa7bd5db19c3b2c356705a
2023-11-21fix(core): Suite generatorpmikus2-185/+201
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ie47a2d736f90000741204bec144cbf2e4052bb2c
2023-11-16workaround(job_specs): Temporarily disable af_xdppmikus8-166/+166
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I5276dbe7da224a677f7cfb07ef5b48326dd3e46f
2023-11-15fix(common.sh): 3n_icxd is not 3n_icxVratko Polak1-64/+57
+ Fix globs for selecting topology yaml files. + Remove skx. + Sort alphabetically. Change-Id: Iefb8a53875792219815824dfc1125c99e55f86b6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-11-15fix(core): Test code parsingpmikus1-61/+61
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5b59243aa9236183595d71198763187ed14d68a0
2023-11-10feat(vpp_device): Main core allocation randomizationpmikus1-5/+8
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I0c261b08dc9b88b853922520598ddb29d222e86c
2023-11-08feat(infra): 3n-icxdpmikus1-0/+15
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I766fe7c0837ad2694645230e5fcc1d59bbf59898
2023-11-08fix crypto device init functionsxinfeng zhao1-0/+16
Change-Id: I96616f6895c9a0c9fb7dc876b2e8b83eff379f16 Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
2023-11-08feat(csit): 3n-icxdpmikus20-0/+1154
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f0eee8b94f65550eae68edeacf343ff982dd85a
2023-11-03feat(tests): 6p3nic ip4 testsoper-231106pmikus5-36/+85
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I69ee305b25b9e05d2305cb82aba71ef6418780ab