aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-01-10fix(core): Constants.pyPeter Mikus1-3/+3
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia5a097797b54c2e71acdcc8d72706e5540536252
2022-01-10Doc: Tweak trend analysis documentVratko Polak2-39/+75
Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-10Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I1b4b92a69a31c3a934acb6e305631eeb9152ef31 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-07fix(uti): Fixing broken code part IIIpmikus1-8/+7
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I06e19def003575993bc3d97c0dc7fbedd3e5ff7a
2022-01-07Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Ic468388973a84b00bf3f62de88bf65c1f37d780f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-27Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I7a91fd0d8bbfcfffa2a4ae9c6873826b56299e22 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-23Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I2ff994b6eb9a2b87d4ea99f861a5b47b15a5d642 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-22fix(uti): Fixing broken code part IIpmikus2-34/+41
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I983b3036a388656bbad91aba71cf14b503f875bd
2021-12-22feat(telemetry): show hardwarepmikus4-58/+105
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I0c0bf055e5963ac794f66cce9d5d45bb628facee
2021-12-22fix(uti): Fixing broken code part Ipmikus3-4/+3
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624
2021-12-22add 2-node ipsec hwasync casesxinfeng zhao13-1/+1838
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I1590d438216e4c886aae03f83364837153623dbc
2021-12-21ansible: match vpp device config to perf configJuraj Linkeš3-11/+2
We're not using unsafe noiommu on perf testbeds and we should mirror that config in vpp device. As a side note, on arm vpp device, enabling unsafe noiommu leads to corrupted packets, so it must be disabled at least on arm vpp device. Also update arm vpp device kernel parameters to match perf testbeds. Change-Id: Id3d3e8fcf71583cc04887b4180cd20561856d902 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-12-21feat(infra): DPDK 21.11pmikus2-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib52fab112d458decfecf39c77085bcd85f811eba
2021-12-21feat(infra): Add new compatibility matrixpmikus3-2/+15
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I64deff93308771c2b3fc2e07fa8f2614b5e4ac9a
2021-12-21ansible: add kernel pinning to vpp deviceJuraj Linkeš3-0/+24
Change-Id: Ife26766e5f92ab95b537b39c25202fec6be27db3 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-12-17trending: hotfix failing trending emailsViliam Luc2-7/+24
Legend was showing for each job_name. When trying to fix it we broke the cpta with I/O operation. This fixes legend positioning and I/O operation error. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I809daa3eabe6a728e5e183630fc7c6615dfef8bf
2021-12-15feat(dpdk): bump dpdk versionpmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia3601c7d990bfe491e2b927b1208742e506f7c43
2021-12-15fix(dpdk): allowpmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ic7f24767b60eef5ddb7cdf5f933d82930c625f5c
2021-12-15UTI: Export resultsVratko Polak52-59/+2764
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15Tox: Add checker for CSIT model versionVratko Polak5-1/+137
+ Implementation stub so checker can check already. + Also add documentation stub for the implemented model. + Checker checks also for bumps in documentation version. - Not comparing implementation and documentation version yet. Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15INFO: Remove Jan from committersVratko Polak1-5/+0
He is no longer active on the project. Change-Id: Ic7621fb3dc4148ba41760f227e39bc52256b7463 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15trending: legend positioningViliam Luc1-2/+2
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: If655d953eb8317f0cba6b3cb35bec232031df7dc
2021-12-15docs: small update structure fixViliam Luc9-22/+19
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Ib0a853f7bd8cdbb0dee747e4f601bc4e54d006e9
2021-12-14trending: fix broken trendingViliam Luc1-6/+20
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1ecbfa48f3765884720f0490b9b9da1f69bd2b1a
2021-12-14docs(lab): Intel Icelakepmikus2-119/+577
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98
2021-12-13trending: regression and progression add info to emailViliam Luc2-15/+55
adding trend in Mpps, runs for trend in #, trend change in % + dashboard - removed Short-Term change and added # of runs for trend Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Ib02d2a2224fc52b79832560241b0530aa2eaaf77
2021-12-13doc: fixing documentation structureViliam Luc680-13647/+17033
When building documentation using sphinx we see ~1200 similar warnings [0] [0] - https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-verify-tox-master-ubuntu2004-x86_64/3289/doc_verify.log.gz These warning are harmless and can be fixed later Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1ac1099d38935971d47491dde905715345d3935c
2021-12-13Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I460247c30a19adb41e6c9ccd5f8c9c914791d219 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-13Report: Hide empty latency graph(s) for 3n-icxTibor Frank2-15/+16
Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add Latency graphs for 3n-icxTibor Frank12-93/+430
Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add 3n-icx - fixesTibor Frank3-83/+84
Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-09Report: Add 3n-icxTibor Frank29-777/+1329
Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-06PLRsearch: Update docscringsVratko Polak1-3/+11
Previous code changes updated code comments, but not docstring. Change-Id: I5be3fd07620cc97c9088efceb72c2f68ab103915 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-06Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I31046025e88ee0e7a13b8d7dd4d40574687a1bd8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-03Trending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphsTibor Frank2-15/+8
Change-Id: Iec877a74701409c87f941b540494e1f313b32911 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-02feat(AWS): Remove obsolete codepmikus3-323/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I97bba8f2092bc0554702a3acac10594426bd79c3
2021-12-02lab WIP: add new 3n-alt Arm testbedJuraj Linkeš3-18/+131
Change-Id: I798cf16af363d1035c816873a2ef6ec59824a17e Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-12-01feat(Performance): Add 2M/1G hugepagespmikus8-55/+48
+ Add ability to switch between hugepages. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I84d8eae28ed414a32e5ba82e6c9ed10d7f0ef9cb
2021-11-30Trending: Fix ethip4ipsecNspe tests for 2n-tx2Tibor Frank1-2/+2
Change-Id: I1cba1060d2d773d1209feb884ab46bbb7b1ada56 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-29Remove executable flag from suite filesVratko Polak4-0/+0
If ./{filename} does not execute, {filename} should not be flagged as executable. No .robot file is executable. Change-Id: I7add9d223ad0e587bc041a4cca6bac222a89e078 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-29Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Ia7a75e03c7e5a1c8009ea04e2f515e495b516de0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-29Trending: Add ethip4ipsecNspe tests for 2n-tx2Tibor Frank3-8/+73
Change-Id: I59315e7ab10b6773cc17c72bae7e73774755efb5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-25Pal: Process oper data only from coverage buildsTibor Frank1-6/+16
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I9340f4a34d95320e833c209fdec4bff7649522f0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-25PAPI: Include more details in PAPI fail messageVratko Polak1-3/+4
This helps to distinguish different symptoms for PAL failure alerting. Change-Id: Idd8e8f4b427641fa055516bdf17715f6b967ca72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-24NAT44det: Decrease ramp-up rate at big scalesVratko Polak2-4/+4
Some testbeds occasionally miss one session with the previous value. + Increase ramp-up duration proportionally. Change-Id: I5300127d7e8fbc670c37ae392ab514b077b3c9b1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-23Report: Small fixes in static contentTibor Frank10-36/+37
Change-Id: I291e83e4f8e4d9798b2868425b7a1fb6b63d8639 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-22Report: Add 2n-icx dataTibor Frank9-121/+113
Change-Id: Iaa369a5243b9c77760549f6dae3dd16d8139509a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-22Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I9cc4424bb4d0dfa3949321349267d190c939f4e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-22Report: Hide 2n-icx empty graphsTibor Frank9-112/+121
Change-Id: I258891f482d87d930d5df8f2dc93b0507f798b8f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-20Report: Remove 2n-icx build nr 3Tibor Frank1-3/+3
- seems to be corrupted Change-Id: I7f7cb780c0a94601a2c2808d4ef384cb24c3fd99 Signed-off-by: Tibor Frank <tifrank@cisco.com>