aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2022-02-07Trending: Add icx nfvTibor Frank8-0/+180
Change-Id: I77b3bf9d77224221cafac1c8825e9f8c397c8e41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-07Report: Add icx latenciesTibor Frank32-1811/+1554
Change-Id: Idcab4424a1439f22e4708abc1c88fbd1125ca439 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-04Trending: Add icx weeklyTibor Frank42-4/+1347
- Tables - data - dashboard - failed tests - last failed tests - weekly comparison tables - graphs - stats - dpdk_mrr - vpp_ndrpdr - DPDK MRR - VPP NDRPDR Change-Id: I371ba97992a0fcc1906d96c5020c9e2b13c396ce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-03Report: Add dpdk icx static contentTibor Frank8-24/+59
Change-Id: I79f1d70a3395551cfff872bd1d66ee900b9129b8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-02-02Report: Add ICXTibor Frank80-1041/+2021
- Stats - DPDK - comparisom tables - detailed results - graphs - tput - speedup - VPP - detailed results - graphs - tput - speedup Change-Id: Ic0b10247ee376262ee61487bdd4b4b461dcf5308 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-31Trending: Add 3n-icxTibor Frank19-18/+806
Change-Id: Id836184c0eca10b5b1d353e1783764ff5119ffea Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-31feat(docs): Static content updatePeter Mikus12-235/+240
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1cdd628be1d358fcca4bf05c9357c195ee3a8288
2022-01-31Trending: Remove HSWTibor Frank31-907/+0
Change-Id: I80ddeb6174c180e90c7e4b63378f08e430e452ce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-31Trending: Add 2n-icxTibor Frank26-0/+880
Change-Id: I2d71c557f6b3c4d93466c096c9d5c0fabc36f486 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-28Doc: Add discussion about common anomaly patternsVratko Polak1-5/+136
Change-Id: Ic70c653cb660663abe48c2a0ae3e496a4e8c85f3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-25Report: Add Comparison tablesTibor Frank6-48/+140
- DPDK: 2n-tx2, 3n-tsh - VPP: 2n-aws, 3n-aws Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-24Trending: Add awsTibor Frank4-0/+169
Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-24feat(core): Add ICXPeter Mikus77-966/+5721
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505
2022-01-21feat(ansible): Add ICXPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iecf76c75edccaccb7d4dcecbc5d47c3c036768e9
2022-01-21feat(doc): Add ICXPeter Mikus3-10/+1304
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I46b2198d94f21b25061f0bd9bed42ca15bc00aa0
2022-01-20feat(ansible): Compatibility matrix bumpPeter Mikus3-12/+12
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9628089bae7d9690f75807beb4321eadf84f9c79
2022-01-19Trending: Add NAT44Det tests for 2n-zn2Tibor Frank18-32/+80
Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-18Doc: Update anomaly methodology documentationVratko Polak1-20/+32
+ Define currently used compliance metrics (e.g. no short term change), + Clarify that (and why) column names in Dashboard and Alerting are somewhat different from the ones in the methodology document. Change-Id: Ie091b1981d7578245ca3e700820fab9ac93bbd17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-18Trending: Unify anomaly related column namesVratko Polak1-6/+9
The most recent update merged was related to alerting, so this Change uses the new column names defined there also in Dashboard tables and legend. Change-Id: I548bc4b42af8237c4251433f3a46e98427898ea8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-17Report: Add 2n-tx2 ipsec testsTibor Frank4-0/+574
- throughput - speedup - todo: latency Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-10Doc: Tweak trend analysis documentVratko Polak2-39/+75
Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-22fix(uti): Fixing broken code part Ipmikus3-4/+3
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624
2021-12-15UTI: Export resultsVratko Polak5-4/+1292
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15Tox: Add checker for CSIT model versionVratko Polak1-0/+48
+ Implementation stub so checker can check already. + Also add documentation stub for the implemented model. + Checker checks also for bumps in documentation version. - Not comparing implementation and documentation version yet. Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-14docs(lab): Intel Icelakepmikus2-119/+577
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98
2021-12-13Report: Hide empty latency graph(s) for 3n-icxTibor Frank1-14/+15
Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add Latency graphs for 3n-icxTibor Frank12-93/+430
Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add 3n-icx - fixesTibor Frank2-82/+83
Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-09Report: Add 3n-icxTibor Frank27-500/+767
Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-03Trending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphsTibor Frank1-12/+5
Change-Id: Iec877a74701409c87f941b540494e1f313b32911 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-02lab WIP: add new 3n-alt Arm testbedJuraj Linkeš3-18/+131
Change-Id: I798cf16af363d1035c816873a2ef6ec59824a17e Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-30Trending: Fix ethip4ipsecNspe tests for 2n-tx2Tibor Frank1-2/+2
Change-Id: I1cba1060d2d773d1209feb884ab46bbb7b1ada56 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-29Trending: Add ethip4ipsecNspe tests for 2n-tx2Tibor Frank1-8/+58
Change-Id: I59315e7ab10b6773cc17c72bae7e73774755efb5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-23Report: Small fixes in static contentTibor Frank10-36/+37
Change-Id: I291e83e4f8e4d9798b2868425b7a1fb6b63d8639 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-22Report: Add 2n-icx dataTibor Frank6-15/+6
Change-Id: Iaa369a5243b9c77760549f6dae3dd16d8139509a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-22Report: Hide 2n-icx empty graphsTibor Frank6-6/+16
Change-Id: I258891f482d87d930d5df8f2dc93b0507f798b8f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-19PAL: Add boxpoints to all box graphsTibor Frank7-17/+12
Change-Id: Ic316149bab15c6fe1efccb53df0afa1cc78b3672 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-19job_specs: update 2n-tx2 daily and reportJuraj Linkeš18-106/+50
Add newly added spd outbound tests with and without flowcache. These new test may result in too many mlr tests, so remove the least needed tests, which are 2m and 1m scale tests. This also unifies which scale tests we run between af_xdp and dpdk tests. Also cleanup all 2n-tx2 job specs. Change-Id: I99bedefcef86f4b921f359f1ebf6c42ebdd8c20f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-18Report: Improve docs related to TRexVratko Polak4-9/+15
Change-Id: I0ed346ff30c61d28b5a2232ef2f9d32d26c1ae2c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-15Report: Add dataTibor Frank1-3/+4
Change-Id: Ie384ab9db8f3ba909ec0b6eaf39a04c5c7f3157a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-12Report: Add dataTibor Frank5-32/+32
Change-Id: I2ee6005d499c4d93cca72cffd3373ced16d7c994 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-11Report: Add DPDK speedup graphsTibor Frank15-5/+849
Change-Id: I0c763ae0371515955037f0aaa867251b5aaec604 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-11"fix(job_specs): Remove flow based tests"Peter Mikus1-23/+23
Reason for revert: Fixed Change-Id: Idbafdb953964967276f4f5748c78398a33635e2b Signed-off-by: pmikus <pmikus@cisco.com>
2021-11-11Report: Add 4t2c graphs for awsTibor Frank5-0/+356
Change-Id: I4fd625bc5139ebcb8430a4228986eafe39672532 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-10Report: Add stats tables, aws testsTibor Frank1-0/+39
Change-Id: I212b0e6e70008e15ced0167ab34e613cc0a1aea4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-10Report: Update known issuesVratko Polak1-26/+47
+ Remove MLRsearch comment, it happened a release before. + Separated known issues to fixed, old and new. + RCA section present, but empty yet. Change-Id: Ic713319017d6c2eb7ba2750de7c27de5237ee2c7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-10Report: Fixes in dynamic contentTibor Frank23-846/+748
Change-Id: If90ba8c66427061341888dcfc946450efe66010b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-10report: update to vpp performance release notesMaciek Konstantynowicz1-44/+17
Change-Id: I170d14555b21e91d0ce1f11ea3f2911e8b01341c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-11-09Report: Add 2n-icx, part 2Tibor Frank63-248/+3274
- packet throughput - speedup - latency Change-Id: If871dcc1888e7a49ac2fd2ba8e3632a87fa035bc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-09report: edits in aws methodology sectionMaciek Konstantynowicz4-119/+150
Edits include: - add description of used testbed topologies. - cleaned up references. - other editing nits. Change-Id: I43069541f3da8e844529a00a127fb1a360197647 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>