aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2022-03-12chore(report): remove CSIT-1806 from release notesVratko Polak1-6/+3
It got fixed and no longer affects report results. Change-Id: Ifc0fba05d3470767921aedf98b194f895856973a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-03-11Report: Add dataTibor Frank1-0/+1
Change-Id: Ia4deab78f6e37207597df77709aae7dc01c53245 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-10chore(ietf): Partially update MLRsearch contentVratko Polak1-82/+759
- Multiple comments and TODOs. - Still contains old sections with duplicated content. - Many commented-out sections waiting for delete. - Several nits reported by IETF nitpicking tool. Anyway, the time is up, so to time fixing it all. Change-Id: I0c56f63bc9ae8173b6f566e862490123091ead79 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-03-10Report: Add rls dataTibor Frank1-0/+9
Change-Id: I54198ec9c0d0d71f9e6e3652e8ae53ff09bbd79e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-09report: final minor updatesViliam Luc1-7/+7
Change-Id: I33b3eed12ddf50f4d9c5beed858df722b432ceaf Signed-off-by: Viliam Luc <vluc@cisco.com>
2022-03-09Report: Add rls dataTibor Frank1-1/+3
Change-Id: If6cc2ce71592c98ea645e15d1a382f37de110c33 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-08report: 2 new issues added to release notesViliam Luc1-0/+6
Change-Id: I46f4797dd244382e6cef611d99096a198c1f9131 Signed-off-by: Viliam Luc <vluc@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2022-03-08report: edit failed test list in known issues in vpp rls notesMaciek Konstantynowicz1-5/+5
Change-Id: Ice668fa21f0f634cbd749365c9e6f0ffc440346c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2022-03-08Report: Small fixes in LatencyTibor Frank3-138/+43
Change-Id: I8c280b231babf00438f97afae2bdbbe731c012fe Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-08docs(report): Update release notes sections.Peter Mikus1-19/+16
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic85ac52301a057e9efdc04478a2fe8a56c38d69d
2022-03-08report: update vpp performance rls notesMaciek Konstantynowicz2-19/+81
Change-Id: Ia933d6719c41100524fd1e64990b38e03604c5ec Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2022-03-07IETF: MLRsearch draft updateVratko Polak2-20/+39
Change-Id: Ia899422b2bbd25e8ad81e9da2fa6c6b08deb4481 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-03-07Report: Static content: Speedup and the restTibor Frank6-166/+162
Change-Id: I00fdec38ab6e8a1bc61f2852bac3e49a90ca30af Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-07Report: Static content: TputTibor Frank5-154/+157
- VPP - DPDK - TRex Change-Id: I0f0c45fe0727a2819f2c092585184e79942f2eaa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-07Report: Static content: LatencyTibor Frank13-1140/+84
- VPP - DPDK - TRex Change-Id: I2a65829d7c6421b7a824cd169b3f273dc9c141c2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-02report: updated phy testbed diagrams 2n-icx 3n-icxMaciek Konstantynowicz2-4628/+4678
Change-Id: Ica6de877b954ed09026d16610a3c8ee44fca8627 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2022-02-28Report: Add nics to titles for comparisonsTibor Frank2-75/+28
Change-Id: I2d3773add4bc57e944a8c174a4bc774a13956fa9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-18Trending: FixesTibor Frank4-4/+12
Change-Id: I2bb089720fda87f28c17c64bc664ae79343360fb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-17doc updatetomas.smado3-58/+86
Change-Id: I6f1663006813f13b34aa0c88eed25c77ac7d8a73 Signed-off-by: tomas.smado <tomas.smado@pantheon.tech>
2022-02-17Report: Add dataTibor Frank1-2/+2
Change-Id: I1c9f58a27f1e881cca3e639d084547dfac88af91 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-11job-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skxTibor Frank6-284/+6
Reason: - ndrpdr job execution time >> 24hrs Remove: - ip4 and ip6 scale200k tests for dpdk and rdma - ip4 and ip6 scale2m tests for dpdk and rdma - af_xdp tests from NICs other than xxv710 Change-Id: I32fce8f436ae5ebbac8da9a9c670bdcb60abb3d8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-10Report: Add 2n-icx GSOTibor Frank2-0/+97
Change-Id: I171980a4ec67b85c3d0f2a680ebff29a2e6afcf2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-10Report: Add icx soak, reconf, nfvTibor Frank7-0/+953
Change-Id: I96e59e75c0bb877e0aa68c2d9eccd73959358350 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-07Report: Small fixesTibor Frank80-184/+347
Change-Id: Ib2cb94c747168b773409c18e3e366ebf3400ab99 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-07Trending: Add icx latency trending graphsTibor Frank22-0/+343
Change-Id: I75dc5fa2e0f8d92651ec22293875c8b3568a2159 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-07Trending: Add icx nfvTibor Frank8-0/+180
Change-Id: I77b3bf9d77224221cafac1c8825e9f8c397c8e41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-07Report: Add icx latenciesTibor Frank32-1811/+1554
Change-Id: Idcab4424a1439f22e4708abc1c88fbd1125ca439 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-04Trending: Add icx weeklyTibor Frank42-4/+1347
- Tables - data - dashboard - failed tests - last failed tests - weekly comparison tables - graphs - stats - dpdk_mrr - vpp_ndrpdr - DPDK MRR - VPP NDRPDR Change-Id: I371ba97992a0fcc1906d96c5020c9e2b13c396ce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-03Report: Add dpdk icx static contentTibor Frank8-24/+59
Change-Id: I79f1d70a3395551cfff872bd1d66ee900b9129b8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-02Report: Add ICXTibor Frank80-1041/+2021
- Stats - DPDK - comparisom tables - detailed results - graphs - tput - speedup - VPP - detailed results - graphs - tput - speedup Change-Id: Ic0b10247ee376262ee61487bdd4b4b461dcf5308 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-31Trending: Add 3n-icxTibor Frank19-18/+806
Change-Id: Id836184c0eca10b5b1d353e1783764ff5119ffea Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-31feat(docs): Static content updatePeter Mikus12-235/+240
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1cdd628be1d358fcca4bf05c9357c195ee3a8288
2022-01-31Trending: Remove HSWTibor Frank31-907/+0
Change-Id: I80ddeb6174c180e90c7e4b63378f08e430e452ce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-31Trending: Add 2n-icxTibor Frank26-0/+880
Change-Id: I2d71c557f6b3c4d93466c096c9d5c0fabc36f486 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-28Doc: Add discussion about common anomaly patternsVratko Polak1-5/+136
Change-Id: Ic70c653cb660663abe48c2a0ae3e496a4e8c85f3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-25Report: Add Comparison tablesTibor Frank6-48/+140
- DPDK: 2n-tx2, 3n-tsh - VPP: 2n-aws, 3n-aws Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-24Trending: Add awsTibor Frank4-0/+169
Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-24feat(core): Add ICXPeter Mikus77-966/+5721
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505
2022-01-21feat(ansible): Add ICXPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iecf76c75edccaccb7d4dcecbc5d47c3c036768e9
2022-01-21feat(doc): Add ICXPeter Mikus3-10/+1304
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I46b2198d94f21b25061f0bd9bed42ca15bc00aa0
2022-01-20feat(ansible): Compatibility matrix bumpPeter Mikus3-12/+12
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9628089bae7d9690f75807beb4321eadf84f9c79
2022-01-19Trending: Add NAT44Det tests for 2n-zn2Tibor Frank18-32/+80
Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-18Doc: Update anomaly methodology documentationVratko Polak1-20/+32
+ Define currently used compliance metrics (e.g. no short term change), + Clarify that (and why) column names in Dashboard and Alerting are somewhat different from the ones in the methodology document. Change-Id: Ie091b1981d7578245ca3e700820fab9ac93bbd17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-18Trending: Unify anomaly related column namesVratko Polak1-6/+9
The most recent update merged was related to alerting, so this Change uses the new column names defined there also in Dashboard tables and legend. Change-Id: I548bc4b42af8237c4251433f3a46e98427898ea8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-17Report: Add 2n-tx2 ipsec testsTibor Frank4-0/+574
- throughput - speedup - todo: latency Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-10Doc: Tweak trend analysis documentVratko Polak2-39/+75
Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-22fix(uti): Fixing broken code part Ipmikus3-4/+3
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624
2021-12-15UTI: Export resultsVratko Polak5-4/+1292
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15Tox: Add checker for CSIT model versionVratko Polak1-0/+48
+ Implementation stub so checker can check already. + Also add documentation stub for the implemented model. + Checker checks also for bumps in documentation version. - Not comparing implementation and documentation version yet. Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-14docs(lab): Intel Icelakepmikus2-119/+577
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98