aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-01-25Report: Add dataTibor Frank1-4/+131
Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-25Hdrh latency graphs: Do not skip the last valueVratko Polak1-5/+7
Linear x axis does not need any skipping. For logarithmic axis, descrease from 100% to avoid infinity. Currently using a fixed PERCENTILE_MAX value. Added a comment on when to change that value. Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-22Report: add geneve to perf release notesJan Gelety3-0/+79
Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-22Report: Add dataTibor Frank4-15/+471
Change-Id: I1d5031780b1bef169509058233e02624d7afecb7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11Report: vpp-device release notesJan Gelety2-3/+18
Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-21Tests: Temporarily disable IPv6 VM test that is randomly failingpmikus1-2/+2
- To be debugged Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I62ea2427d716f10dbf6af179edfaa41e73952db0
2021-01-21Reconf: Fix bidir/unidir mismatchVratko Polak53-170/+119
Results if NDR search is in TPS (so unidir) since https://gerrit.fd.io/r/c/csit/+/28208 The bug was causing all reconf tests report zero loss, as they used half of NDR load during reconfiguration. + Small improvements to descriptions of other traffic keywords. Change-Id: Ib9af5861cc09e698eb762feb3f0a019571d17962 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-21Trending: Fix bugs in 2n-tx2Tibor Frank1-1/+1
Change-Id: I5522e2cb37b9e319bfde009297525179da2e50f7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-21Report: Add dataTibor Frank1-0/+22
Change-Id: I09a695d9c747d4bb6826d27283ab0aa172fc0d30 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-21Trending: Add 2n-tx2Tibor Frank13-1/+758
Change-Id: Id2d0248128eee6a5b0969c7f27aae946ed47bbaa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-20acl: add L2BD dev testsMartin Balaz5-0/+491
Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech> Change-Id: I70127d8dd2241b70511f31842eb8a9e3cbafdc4b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-20job_specs: add geneve testsJan Gelety9-20/+407
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-20Tox: Improve tox.iniVratko Polak1-15/+26
Just stylistic improvements, no functional change. + Use "ignore_outcome = true" instead of "|| true". + Document and apply recommended ordering within testenv definition. + Fix some typos. Change-Id: I004f12fbdf6dbeb555daa7cd111938b7eeef20b3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-20Add suites with randomized ip6 profilesVratko Polak18-28/+868
+ Replace pair of traffic profiles (2n and 3n) with single nodeless one. + Compared to incremental suites, randomized ones add IP6_RND tag. Change-Id: I2f0dfc9e04bbcd0f88e95b92edf2da2c73faaab6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-20Report: Add dataTibor Frank3-1013/+41
Change-Id: Ie7450076891e1041b5635f8ea714f94909b6d407 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-19Report: Add ip6 latency graphsTibor Frank1-4/+2
Change-Id: Ic53214b0a0360bdb6d62d100fc7b9c8e15fb8397 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-19Report: Add data, 2n-tx2 latency graphsTibor Frank6-469/+1190
Change-Id: Idd9396c0f260355e3b7b90839bd4b1f64d8b0644 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-19Job specs: Add some ipsec reconf to iterativeVratko Polak1-0/+76
We now have more time for 3n-hsw testbeds. Added only scales of 4, 1000 and 60000 tunnels. Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-19Report: Add dataTibor Frank1-416/+416
Change-Id: I1b7314affd08d12b67212affb2ef89f64d1347ee Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18Master: Update VPP_STABLE_VER_ filesTibor Frank2-2/+2
Change-Id: I8766254c5cb67afe913facec0477e5ba7550fba0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18Random flows: Use seeds again and increase limit.Vratko Polak3-45/+54
TRex does mix seeds when distributing over workers, but it is multiplicative [0], so zero is the only bad value. Limit restricts the cycle length of PRNG (by resetting [1] the seed). We want the cycle as long as possible. [0] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L1616 [1] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L313-L314 Change-Id: I33a29496f0853ef60d592c988f81a9d1109b5878 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-18Report: Remove slider for Latency graphsTibor Frank1-2/+0
Change-Id: I86b9af8e2ebbf27cd8d93c9a04901dce874fa9d6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18Report: Fix specificationTibor Frank1-2/+6
Change-Id: Ida7035fd130f566215f222d9cd7e98beb583af94 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18job-specs: Fix hoststackTibor Frank1-8/+8
Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18Report: Add data, add 2n-tx2Tibor Frank16-1146/+2528
Change-Id: Ic2f8e03c16c432479139648cad7982a962193bc4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18PAL: Improve latency graphsVratko Polak1-6/+31
Previously, they used sloped lines connecting reported points. But HdrHistogram reports only the upper bound of percentile. Example: If all samples are 10us, HdrHistogram reports a single value at 100%. This change attempts to show the whole intervals (0%-100% for the example) as a series (vertically connected) of horizontal lines. Hover also shows percentiles as intervals. Change-Id: Id7bbff7b1c29d7f62472041340fde88903363cfa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-15Report: add 2n-tx2 static contentJuraj Linkeš34-10/+316
Change-Id: I476ac52d64999f6d3ca3ee726f018f36693ac921 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-14perf: GENEVE tunnel test, l3 modeJan Gelety17-17/+2360
Jira: CSIT-1768 Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-14Report: Add dataTibor Frank2-9/+14
Change-Id: I3ac0e892ef3f2b0a23b42465565d28f5d5027dae Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13Add 3n ip4-rnd testsVratko Polak9-13/+430
+ Rename traffic profiles to avoid mentioning number of nodes. + Improve 2n rnd suite documentation slightly. Change-Id: I82d6fb6a99133163a58d56f2acf8a7b9568ee77c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-13job_specs: fix 2n-tx2 ip6 iacldst job specsJuraj Linkeš2-6/+6
Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-13Report: Fix plotsTibor Frank1-1/+2
Change-Id: I70a7929400d7fba144a3669fc9d8aff003695f55 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13job_specs: update 2n-tx2 coverage specsJuraj Linkeš16-344/+509
Start out with l2, l3, classifier and acl tests. Change-Id: I0cd781f1858d5461b793f782f8bc6fcde5263b69 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-13Docs: TOI - How to create branchesTibor Frank1-0/+191
Change-Id: I7588d7ac7a0200df5b660ffbc31f7c2496496d06 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13Report: Add dataTibor Frank2-29/+192
Change-Id: Ia6f46cd9dbf83e6376f635b3e250708bdfba80be Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13License: Update block replacerVratko Polak2-1/+24
... so it replaces also long (older) form of GPL license. This way replacing to apache and back ensures GPL has (newer) short form. Change-Id: I34efd83a91e54b2b2bbb3c4429d1b82397a1e8f8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-13Report: Add dataTibor Frank1-54/+35
Change-Id: I23dd384edd107facdc8e54275c1acded5a9935fd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-12License: Wrap GPL block to 80 charactersVratko Polak185-368/+553
The original license block was adapted from https://wiki.fd.io/view/TSC/Proposed_Header_Python_Test_Scripts resulting in a line longer than 80 chars, but those are reported (although not blocked) by tox verify job. As the text from wiki was not used in verbatim (it uses c-style comment block), minor formatting change like this should not be a big deal. + Bump copyright year. Change-Id: I55e3a0232639b448b1a6d7b1f3af84d903a8d0a5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-12Report: Add dataTibor Frank1-0/+16
Change-Id: I70153753ccc69597dc2c69133b3828cd76174468 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-12Report: Add dataTibor Frank1-22/+36
Change-Id: I648732e98941b562c31a9db735332bd215d65870 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-12Master: Update of VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I87fc785ad934066a6dfa21334f38b16587261c61 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11tests: add 2n1l l2 acl tests, update 2n-tx2 specsJuraj Linkeš57-201/+1070
Modify initialize L2BD ACL keywords to be usable for both 2-node and 3-node topologies and update testsuites accordingly. Add the missing macip T-rex profile. Add classifier tests to 2n-tx2 job specs. Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-11Infra: Increase shm-sizepmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib9dfb8623757fd23fd8b49b5e04ed86e202ada66
2021-01-11Report: Fix plot layoutTibor Frank1-1/+1
Change-Id: Ia2c448a6b9bed2095710c04fde606649385e408e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11Report: Add dataTibor Frank2-13/+521
Change-Id: Ic584b2340bbaebf5699213358292159518546334 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11Report: Add Latency graphs with logaritmic x-axisTibor Frank2-15/+527
Change-Id: Ic41b8761aed4256cb3f8ab9d14831e9d2be1598c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11jumpavg: fix setup.pyPaul Vinciguerra1-1/+1
Fix typo introduced in https://gerrit.fd.io/r/c/csit/+/23465 Signed-off-by: Paul Vinciguerra <pvinci@vinciconsulting.com> Change-Id: Ie581fd612e7849500e061ac6f56f56b6eb322553
2021-01-11Report: ConfigurationTibor Frank49-49/+49
Change-Id: Ia1d95d610ede86127797eecd89eb68091d15d54c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11Report: Configure reportTibor Frank64-10150/+1953
Change-Id: I1c64758f937c34a8f3956a5aa6512bb16a9dfe62 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-07ansible: remove unused old ARM nomad hostsDave Wallace3-64/+1
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ie2a653fa46119b5971c58478e306920376a8f874