aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2024-03-04feat(device): cx6 update of 1n-alt device jobspecJuraj Linkeš2-70/+126
Update the jobspec according to the current Arm policy: 1. Run most of the tests on cx6, crypto coverage being the most important, 2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver, 3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf) drivers. The above is the policy used in performance testing where time is a major constraint. The same is true for functional testing to some extent, so it makes sense to apply the same logic for choosing the tests. There are 10 tests which are failing on cx6 without an identified reason. They are disabled until we find the root cause and address it. In the meantime, the tests are enabled for x710 with the DPDK driver: ethip4-l2xcbase-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2tap ethip4-l2bdbasemaclrn ethip4-l2bdbasemaclrn-iacl1sf ethip4-l2bdbasemaclrn-iacl1sl ethip4-l2bdbasemaclrn-oacl1sf ethip4-l2bdbasemaclrn-oacl1sl ethip4-l2patch ethip4-l2xcbase When the cx6 issue has been resolved, these should be enabled for cx6 and disabled for x710, with the exception of ethip4-l2bdbasemaclrn, which should be running on both. Change-Id: Id48f450063e405b1faca57431676f91d62e829b9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2024-02-28job-spec: add more ip4scale tests to 2n-spr and 3na-sprTibor Frank4-0/+40
Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-15fix(core): daily jobs should not do prefixingpmikus1-5/+7
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I131cc9957b288f4e02e9d02394a1681dbb539d83
2024-02-15fix(bootstrap): typopmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ib2a1ceb9145ef5495c76954ac70cedc5af6fa297
2024-02-14fix(core): Lower amount of TREX cores for externalpmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ic27f46876a93cc01d5f14bbefe0dccd84ab41027
2024-02-13feat(bootstrap): Add ability to load external NODE_FLAVORpmikus2-1/+32
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ia6e07111af543280b2365840bced02f94cf91e75
2024-02-13feat(core): QAT RXQ allocationpmikus1-4/+8
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I78501f08b29a202c0e1129b79af6a63299e8ee36
2024-02-07fix(bootstrap): skip suites for virtual NICVratko Polak1-2/+2
As the skipping logic looks at available topologies, fix skipping by adding virtual to vagrant.yaml Change-Id: I5e7bf1dc2f4f4787917f1f989a974255cf2591a9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-02-06Add memif with DMA test suitesxinfengx7-4/+322
Change-Id: I8c27b5956c0c26bb2de48321675e285ed961412f Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-01-31feat(job_specs): 2n-c7gnpmikus11-42/+196
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Idca0738320b56196e98aeec3050312111a90609a
2024-01-31fix(autogen): Do not set nic_code from nic_nameVratko Polak1-8/+1
This should fix some suites wrongly using nic_pfs=6. Change-Id: Ifb7bd24b9a2d1764634eea4a43b4509f16e03da2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24fix(PLRsearch): handle unsent packets as lossVratko Polak1-5/+20
Change-Id: Icaa88523ede0b1fad6e6cb667a8f307ea5f4a12d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24fix(PLRsearch): fix some pylint violationsVratko Polak3-6/+6
- Complexity and logging would require a larger change. Change-Id: I69f8e47b1806c880cd626bc5a8f5ae6290246093 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24style(PLRsearch): format according to blackVratko Polak4-99/+157
Change-Id: I26e0ce172740f7f440469578294f8c13fec5850b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-23docs(infra): 1n-altpmikus2-12/+12
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I1770a3f49e19d337d4ed6760fb062ba4d445574d
2024-01-23feat(device): Add 1n-alt vpp devicepmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I3d2bb0408f15fd14989d1179d7f08710a3d86e67
2024-01-22fix(jumpavg): Tolerate zero sized runsVratko Polak1-1/+3
Change-Id: I7c2426fe47ca9ee44338423597be90a71aaa3653 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-22feat(bisect): Tolerate zero testsVratko Polak1-8/+10
Needed when the anomaly causes failure in the global suite setup. Also needs a jumpavg fix, in the subsequent change. Change-Id: Ifa8f8fcfc0b25416afa064e606a59b79aa279b61 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-22feat(papi): Tolerate behavior after 39871Vratko Polak1-14/+31
Even when VPP switches back to (or adds support for) the old behavior, this enables bisect to work for all VPP commits in 2402 cycle. Change-Id: Ic2b71bee1db723d9d13229d9f4288d1699d246c6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-18feat(crc): Bump messages after 23.10 releaseoper-240122Vratko Polak3-390/+13
+ Post-release rdma_create_v4 will be added next cycle. Change-Id: Ief129b5be4a2c5d27f4674491c96c548573ecfb1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-17feat(device): Driver compatibilitypmikus1-2/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I55421ca38df412950f4b2487e5db901a1850ed12
2024-01-15feat(ansible): DPDK compatibility matrixpmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I746471b59e1fb00a00007b6e9f2ba02d873ae3e2
2023-12-13feat(bisect): introduce scripts for VPP bisectingVratko Polak6-57/+508
+ Parsing common with per-patch job is moved to a library. Ticket: CSIT-1618 Change-Id: I185bea084a29e6a37ef94e9da42b192a6a81fc17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-12-13feat(bootstrap): refactor functions before bisectVratko Polak6-91/+108
Ticket: CSIT-1618 Change-Id: I0c17f1e8f09a3944032d44efa8ecd36fef2056a2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-12-13fix(Interfaces): do not use JsonParserVratko Polak3-73/+2
In past, there perhaps were Robot keywords needing JsonParser. But now the single remaining call site can call json.loads directly. + Delete now unused resources/libraries/python/parsers/. Change-Id: I9c5d94d6b320f917f1f621abb83556ebccadc3ec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-12-12feat(terraform): Remove ansible dependencypmikus1-9/+9
- terraform ansible is not supported on aarch Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I3d1a592b4ed97fe635813dccbf78dc42d14e0fa9
2023-12-11feat(job_specs): Add 200ge6p3cx7veat testspmikus100-4723/+4732
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ia713b9a0b962820b014bad3582bc095ec802380c
2023-12-07fix(CpuUtils): correct robot variable namesVratko Polak1-4/+4
Fixes: 76fcd8422842d0756338502213de561eaa93e670 Change-Id: Ie642aeed5c55d479e0e4b87be965b4b5f70d6612 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-11-23fix(infra): QAT initpmikus1-8/+10
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I862f9ca12e9149eab2d0701368cdc65f294629cc
2023-11-22fix(core): common.sh typospmikus1-2/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: If25495e0eec60ac84dfaaafec3080f02a17fc740
2023-11-22fix(core): common.sh typospmikus1-2/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I87d0d297c79b1f0c0aa46ff7304586ab1898fed1
2023-11-22feat(infra): 2n-c7gn, 3n-c7gnpmikus2-16/+50
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5a94ae7caf1c3ee08efa7bd5db19c3b2c356705a
2023-11-21fix(core): Suite generatorpmikus2-185/+201
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ie47a2d736f90000741204bec144cbf2e4052bb2c
2023-11-16workaround(job_specs): Temporarily disable af_xdppmikus8-166/+166
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I5276dbe7da224a677f7cfb07ef5b48326dd3e46f
2023-11-15fix(common.sh): 3n_icxd is not 3n_icxVratko Polak1-64/+57
+ Fix globs for selecting topology yaml files. + Remove skx. + Sort alphabetically. Change-Id: Iefb8a53875792219815824dfc1125c99e55f86b6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-11-15fix(core): Test code parsingpmikus1-61/+61
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5b59243aa9236183595d71198763187ed14d68a0
2023-11-10feat(vpp_device): Main core allocation randomizationpmikus1-5/+8
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I0c261b08dc9b88b853922520598ddb29d222e86c
2023-11-08feat(infra): 3n-icxdpmikus1-0/+15
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I766fe7c0837ad2694645230e5fcc1d59bbf59898
2023-11-08fix crypto device init functionsxinfeng zhao1-0/+16
Change-Id: I96616f6895c9a0c9fb7dc876b2e8b83eff379f16 Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
2023-11-08feat(csit): 3n-icxdpmikus20-0/+1154
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f0eee8b94f65550eae68edeacf343ff982dd85a
2023-11-03feat(tests): 6p3nic ip4 testsoper-231106pmikus5-36/+85
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I69ee305b25b9e05d2305cb82aba71ef6418780ab
2023-11-02fix(job_specs): 1n-vboxpmikus1-51/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I0c333fe9954aaac7253064c33c9281e9246963f6
2023-11-02fix(core): Remove unwanted codepmikus1-28/+22
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ib03e469da3e93944ae7fb612e7a71df36f711cdd
2023-10-30code and doc updates for vagrant VM dev/test environ setupNaveen Joy5-25/+246
Change-Id: I0e4e4758b3abbfc2fe2e18200b85477293de218b Signed-off-by: Naveen Joy <najoy@cisco.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2023-10-25feat(core): Multilink TRex Sync mode IIpmikus1-57/+71
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Idf4df372520d4a72c0738a89290d16710485f140
2023-10-25feat(MLRsearch): use goal result as in draft05Vratko Polak8-40/+89
No effect on NDRPDR results, just different result packaging between the MLRsearch library and the rest of CSIT. - PyPI metadata still to be updated in a separate Change. Change-Id: I547134da189d1d7761594e92f36cc7c1c232ee32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-19fix(model): bump schema version for new MLRVratko Polak2-9/+9
Change-Id: I35230692241a5f54420ece3340530f6c608828bb Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-19feat(MLRseach): Update to v8 conditional throughputVratko Polak6-31/+78
Hopefully, with CSIT config values, PDR lower than NDR will not happen. + Bump duration_sum default to an odd number, so users are not surprised by not seeing standard median behavior. For CSIT this should not matter, overheads hide ties and number of trials (at least for STL) should stay the same. Change-Id: Id7130f978c31e71227499612424007c473bcfac2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-18fix(specs): 1n-spr remove VM tests, add flow vfio-pcipmikus1-16/+16
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I2b243aa33f41d267f83727f7747a9a28ffdd1c07
2023-10-18fix(specs): 1n-spr disable flow testspmikus1-11/+11
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ibddb430707510e2b3e803c892a7feeea6ab82ccd