aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2022-01-25fix(core): Remove unused stuffPeter Mikus2-200/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0cfc9d9fbb1a82a308231a5d2c0b12cb632c469b
2022-01-25trending: fix re-pro showing wrong dataViliam Luc1-18/+17
vpp-2n-zn2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-zn2/484, vpp version: 22.06-rc0~0-g017a67665~b2179 4t2c-avf-eth-l2bdbasemaclrn-mrr 10ge2p1x710 64B 29.6 1 -0.2 2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.14 1 -58.08 4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.98 1 -57.73 4t4c-ethip4-ip4base-mrr 10ge2p1x553 64B 2.97 1 -79.05 1t1c-eth-l2patch-mrr 10ge2p1x553 64B 2.98 1 -75.94 2t2c-eth-l2bdbasemaclrn-mrr 10ge2p1x553 64B 8.27 1 -11.0 2t1c-af-xdp-ethip4-ip4scale2m-mrr 25ge2p1xxv710 64B 6.21 1 -53.14 vpp-2n-tx2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-tx2/265, vpp version: 22.02-rc0~508-g88a9c0e02~b851 4t2c-avf-eth-l2bdbasemaclrn-mrr 10ge2p1x710 64B 29.6 1 -0.2 2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.14 1 -58.08 4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.98 1 -57.73 4t4c-ethip4-ip4base-mrr 10ge2p1x553 64B 2.97 1 -79.05 1t1c-eth-l2patch-mrr 10ge2p1x553 64B 2.98 1 -75.94 2t2c-eth-l2bdbasemaclrn-mrr 10ge2p1x553 64B 8.27 1 -11.0 2t1c-af-xdp-ethip4-ip4scale2m-mrr 25ge2p1xxv710 64B 6.21 1 -53.14 The same data for different TB. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Iefce9a7196bae6fde45ee1935184efab4735e6e0
2022-01-25Report: Add Comparison tablesTibor Frank2-6/+434
- DPDK: 2n-tx2, 3n-tsh - VPP: 2n-aws, 3n-aws Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-24Trending: Add awsTibor Frank1-8/+48
Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-24feat(core): Add ICXPeter Mikus1-4/+31
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505
2022-01-24Report: Configure Report 2202Tibor Frank4-1871/+1529
Change-Id: I9be8b74716b09b2395fbab95eb37877867abbc22 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-19trending: fix empty regressions and progressionsViliam Luc1-5/+5
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1405c5d1dbf9e137afbc5fd5d9f83ea572613ea9
2022-01-19fix(vpp_device): pci address existence conditionJuraj Linkeš1-3/+5
The function get_pci_addr could check a different PCI_ADDR in case the netdev device directory doesn't exit. Move the check so that it always uses the proper PCI_ADDR and add a failure case when the netdev device directory doesn't exist. Change-Id: Ibadfea3fba34509cd3ea8f906ac5962c0f01dd17 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2022-01-19Trending: Add NAT44Det tests for 2n-zn2Tibor Frank1-81/+0
Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-18trending: new view in regressions and progressionsViliam Luc3-54/+145
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I8524319a215ff551cf67c30d0b08ddae69883f61
2022-01-17fix(perpatch): Correct the autogen archive nameVratko Polak1-3/+3
Change-Id: I82bc5cd69de82a2d6b6689cf3380f667ea905886 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-17trending: shorten error messagesViliam Luc1-1/+33
Sometimes error messages are longer than 1000 chars. This change looks for [;, :, '] in messages between 128 and 256 character. If it finds any of these the error message will be cut from beggining to this character. If there's no character from the list in error message and message is longer than 128 chars. It will be cut from beggining to 129 character of error message Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I283f8ee8d81422235d897370dbc9508fafda6a7f
2022-01-17Report: Add 2n-tx2 ipsec testsTibor Frank1-0/+186
- throughput - speedup - todo: latency Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17Revert "Report: Temporarily change report specs"Tibor Frank2-0/+13926
This reverts commit cd1f9904e173ecb34836b33cb551ab9b9d378e18. Reason for revert: Not needed Change-Id: Id0739d4fba2d2abadd8ee9954c724a54b39cd8a8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17fix(uti): Fixing broken code part VPeter Mikus3-7/+7
- UTI export breaks local execution - disabling useless tox rules Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2f610b08f06f437e4482f291fa7b47cbb7b92984
2022-01-17Report: Temporarily change report specsTibor Frank2-13926/+0
Change-Id: Ic8724a9676c2b2c37ee4f2de4c056b770a10d5af Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17Revert "Temporarily change report specs"Tibor Frank2-0/+13930
This reverts commit cc04963a4ad9bfd8dce0e31fd41226fa35e5e5d6. Reason for revert: Some data-sets missing. Change-Id: Id2363c2a71c0e87ad3d3e206a09d7af3984a1f36 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17Temporarily change report specsTibor Frank2-13930/+0
- to generate tables with oper data Change-Id: I06878713cd085d72eb3b9fef0c1aae1102dfb363 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17fix(IPsec): fix policy testsJuraj Linkeš2-16/+47
Replace the hardcoded SPD inbound/outbound ranges with values derived from test inputs. Add the necessary routes now that the tunnel endpoints are not in the same subnet. Also add ip neighbor entry on DUT2 for the same reason. Also replace ipsec sa dump with show ipsec all in teardown of tests where both SAs and SPDs are configured to improve troubleshooting. Change-Id: I7d89a99fcf457a701c87bf6ac07364b62802677d Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2022-01-17PAL: Fix sh-runTibor Frank2-25/+12
- do not post-process telemetry data Change-Id: I800a99d8e92016d1fa675b18e2b2d30db4a15077 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-14JumpAvg: Fix string formatVratko Polak1-2/+2
Change-Id: Id3975dfcca0040b799f31dcd14789d8c90993b14 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-12fix(uti): Fixing broken code part IVPeter Mikus1-2/+2
Part of fixing chain Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ie423ccf5a51751e605d906dd1214f5174bb364ac
2022-01-11feat(uti): Dash demoPeter Mikus21-0/+1486
- displays the table with trending data downloaded from trending pages Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic0d48290105ccd846c7de9ee4d8acb78e0b72f00
2022-01-10fix(core): Constants.pyPeter Mikus1-3/+3
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia5a097797b54c2e71acdcc8d72706e5540536252
2022-01-07fix(uti): Fixing broken code part IIIpmikus1-8/+7
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I06e19def003575993bc3d97c0dc7fbedd3e5ff7a
2021-12-22fix(uti): Fixing broken code part IIpmikus2-34/+41
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I983b3036a388656bbad91aba71cf14b503f875bd
2021-12-22feat(telemetry): show hardwarepmikus4-58/+105
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I0c0bf055e5963ac794f66cce9d5d45bb628facee
2021-12-22add 2-node ipsec hwasync casesxinfeng zhao1-1/+0
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I1590d438216e4c886aae03f83364837153623dbc
2021-12-21feat(infra): DPDK 21.11pmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib52fab112d458decfecf39c77085bcd85f811eba
2021-12-17trending: hotfix failing trending emailsViliam Luc2-7/+24
Legend was showing for each job_name. When trying to fix it we broke the cpta with I/O operation. This fixes legend positioning and I/O operation error. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I809daa3eabe6a728e5e183630fc7c6615dfef8bf
2021-12-15fix(dpdk): allowpmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ic7f24767b60eef5ddb7cdf5f933d82930c625f5c
2021-12-15UTI: Export resultsVratko Polak22-42/+1374
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15Tox: Add checker for CSIT model versionVratko Polak3-0/+84
+ Implementation stub so checker can check already. + Also add documentation stub for the implemented model. + Checker checks also for bumps in documentation version. - Not comparing implementation and documentation version yet. Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15trending: legend positioningViliam Luc1-2/+2
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: If655d953eb8317f0cba6b3cb35bec232031df7dc
2021-12-14trending: fix broken trendingViliam Luc1-6/+20
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1ecbfa48f3765884720f0490b9b9da1f69bd2b1a
2021-12-13trending: regression and progression add info to emailViliam Luc2-15/+55
adding trend in Mpps, runs for trend in #, trend change in % + dashboard - removed Short-Term change and added # of runs for trend Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Ib02d2a2224fc52b79832560241b0530aa2eaaf77
2021-12-13doc: fixing documentation structureViliam Luc2-16/+20
When building documentation using sphinx we see ~1200 similar warnings [0] [0] - https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-verify-tox-master-ubuntu2004-x86_64/3289/doc_verify.log.gz These warning are harmless and can be fixed later Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1ac1099d38935971d47491dde905715345d3935c
2021-12-13Report: Hide empty latency graph(s) for 3n-icxTibor Frank1-1/+1
Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add 3n-icx - fixesTibor Frank1-1/+1
Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-09Report: Add 3n-icxTibor Frank2-277/+562
Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-06PLRsearch: Update docscringsVratko Polak1-3/+11
Previous code changes updated code comments, but not docstring. Change-Id: I5be3fd07620cc97c9088efceb72c2f68ab103915 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-03Trending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphsTibor Frank1-3/+3
Change-Id: Iec877a74701409c87f941b540494e1f313b32911 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-02feat(AWS): Remove obsolete codepmikus3-323/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I97bba8f2092bc0554702a3acac10594426bd79c3
2021-12-01feat(Performance): Add 2M/1G hugepagespmikus8-55/+48
+ Add ability to switch between hugepages. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I84d8eae28ed414a32e5ba82e6c9ed10d7f0ef9cb
2021-11-29Trending: Add ethip4ipsecNspe tests for 2n-tx2Tibor Frank2-0/+15
Change-Id: I59315e7ab10b6773cc17c72bae7e73774755efb5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-25Pal: Process oper data only from coverage buildsTibor Frank1-6/+16
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I9340f4a34d95320e833c209fdec4bff7649522f0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-25PAPI: Include more details in PAPI fail messageVratko Polak1-3/+4
This helps to distinguish different symptoms for PAL failure alerting. Change-Id: Idd8e8f4b427641fa055516bdf17715f6b967ca72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-22Report: Add 2n-icx dataTibor Frank3-106/+107
Change-Id: Iaa369a5243b9c77760549f6dae3dd16d8139509a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-22Report: Hide 2n-icx empty graphsTibor Frank3-106/+105
Change-Id: I258891f482d87d930d5df8f2dc93b0507f798b8f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-20Report: Remove 2n-icx build nr 3Tibor Frank1-3/+3
- seems to be corrupted Change-Id: I7f7cb780c0a94601a2c2808d4ef384cb24c3fd99 Signed-off-by: Tibor Frank <tifrank@cisco.com>