aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-01-28job-specs: Add rnd testsTibor Frank22-1149/+783
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3354bdb7f7c183322c886ab1c89c8f3bbf42366b)
2021-01-27Report: Add dataTibor Frank2-4/+26
Change-Id: Ie90bdf03bb4190e199bfdcb440125caea7bfdef8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d6615bce0d5ac4cb88bbeec584fa7094a6db2c06)
2021-01-27Report: Fix reconfig graphsTibor Frank2-30/+6
Change-Id: Id8d4930937e502bd8b4b54145437a9e7f668ace5 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3f8cd3759d371a5ac2df46cfb981cc3a599574ea)
2021-01-27Report: Improve reconf graphsTibor Frank2-5/+9
Change-Id: Ic935c946123c4dcc9daa608c523767b9aca36ef3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7d7ec5e661abec4dda2546843addf1a71580e97e)
2021-01-26Trending: Add GENEVE testsTibor Frank6-0/+245
Change-Id: I5e20f6351dd3854eef075e1bf954dab5aee61698 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5e996684dd0c95089256631c696e4fb9e72e21a2)
2021-01-26Report: Add GENEVE testsTibor Frank9-1/+635
Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1e3c01e0e458d62ed228e8d6a916c24992304252)
2021-01-25rls2101: Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I4db975fab589594f7551217b64adfe13cf628f65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-25Report: Add dataTibor Frank1-4/+131
Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 88bbb1908b4aa58163374c983b4b8e85e78460d5)
2021-01-25Hdrh latency graphs: Do not skip the last valueVratko Polak1-5/+7
Linear x axis does not need any skipping. For logarithmic axis, descrease from 100% to avoid infinity. Currently using a fixed PERCENTILE_MAX value. Added a comment on when to change that value. Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit d4f12e6931c7fdf84043d8fb2f71e2f38965f26b)
2021-01-22Report: add geneve to perf release notesJan Gelety3-0/+79
Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 67d3b2a44d49dd2c4a1b2f722849f57432787137)
2021-01-22Report: Add dataTibor Frank4-15/+471
Change-Id: I1d5031780b1bef169509058233e02624d7afecb7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0c489b1767a031837f320c1fb5e45947ac82ea4d)
2021-01-22Report: vpp-device release notesJan Gelety2-3/+18
Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 7b9b65a3af83267a4e6a36fc98996aaa05060a87)
2021-01-21Reconf: Fix bidir/unidir mismatchVratko Polak53-170/+119
Results if NDR search is in TPS (so unidir) since https://gerrit.fd.io/r/c/csit/+/28208 The bug was causing all reconf tests report zero loss, as they used half of NDR load during reconfiguration. + Small improvements to descriptions of other traffic keywords. Change-Id: Ib9af5861cc09e698eb762feb3f0a019571d17962 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 293a88b56179094f655178b838b84844a672390d)
2021-01-21Trending: Fix bugs in 2n-tx2Tibor Frank1-1/+1
Change-Id: I5522e2cb37b9e319bfde009297525179da2e50f7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7f7f2fd7363637d0da626a28bb8a0b357d314a9d)
2021-01-21Report: Add dataTibor Frank1-0/+22
Change-Id: I09a695d9c747d4bb6826d27283ab0aa172fc0d30 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9e08f1dfb125d092a48f92c764f52ae97f8a9995)
2021-01-21Trending: Add 2n-tx2Tibor Frank13-1/+758
Change-Id: Id2d0248128eee6a5b0969c7f27aae946ed47bbaa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3fc6ce9f08f0a1c1293dfc032fdddfe5e3f7eb16)
2021-01-20acl: add L2BD dev testsMartin Balaz5-0/+491
Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech> Change-Id: I70127d8dd2241b70511f31842eb8a9e3cbafdc4b Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 0f3baca2366f969de6b5d3b889c1b05f72995ec2)
2021-01-20job_specs: add geneve testsJan Gelety9-20/+407
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 3d0d137bf45e1cd3c7aa06480f5ea08175a6df01)
2021-01-20Tox: Improve tox.iniVratko Polak1-15/+26
Just stylistic improvements, no functional change. + Use "ignore_outcome = true" instead of "|| true". + Document and apply recommended ordering within testenv definition. + Fix some typos. Change-Id: I004f12fbdf6dbeb555daa7cd111938b7eeef20b3 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 52a39f861bb645831130ef109a14e629be9bde7a)
2021-01-20Report: Add dataTibor Frank3-1013/+41
Change-Id: Ie7450076891e1041b5635f8ea714f94909b6d407 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 216c68cc8b010642c4de21673b7d8e18006767e2)
2021-01-19Report: Add ip6 latency graphsTibor Frank1-4/+2
Change-Id: Ic53214b0a0360bdb6d62d100fc7b9c8e15fb8397 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5e0fe5a28969dfc9fe36415a065122a668d5a273)
2021-01-19Report: Add data, 2n-tx2 latency graphsTibor Frank6-469/+1190
Change-Id: Idd9396c0f260355e3b7b90839bd4b1f64d8b0644 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4bc1e70ad02b198a7b9ea32b72da3ae98978e8c5)
2021-01-19Job specs: Add some ipsec reconf to iterativeVratko Polak1-0/+76
We now have more time for 3n-hsw testbeds. Added only scales of 4, 1000 and 60000 tunnels. Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit be5833232791a24921e7e9695e53efcbd7ff248e)
2021-01-19Report: Add dataTibor Frank1-416/+416
Change-Id: I1b7314affd08d12b67212affb2ef89f64d1347ee Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f5863d6213bf0066b9647a7dde10d56bd7260f80)
2021-01-18Random flows: Use seeds again and increase limit.Vratko Polak3-45/+54
TRex does mix seeds when distributing over workers, but it is multiplicative [0], so zero is the only bad value. Limit restricts the cycle length of PRNG (by resetting [1] the seed). We want the cycle as long as possible. [0] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L1616 [1] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L313-L314 Change-Id: I33a29496f0853ef60d592c988f81a9d1109b5878 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit eedb7dff222d2590ac2cb5a5e67dc7d90317f05c)
2021-01-182101: Update VPP_STABLE_VER_ filesTibor Frank2-2/+2
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ica196e6a309e4dc2fdfb51b7faed72a627311991
2021-01-18Report: Remove slider for Latency graphsTibor Frank1-2/+0
Change-Id: I86b9af8e2ebbf27cd8d93c9a04901dce874fa9d6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 69264aed8d43f3c4a8342dd7584f80336108c879)
2021-01-18Report: Fix specificationTibor Frank1-2/+6
Change-Id: Ida7035fd130f566215f222d9cd7e98beb583af94 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4d04d11497eb87f94d6ac4982e4b17ae0f48d811)
2021-01-18job-specs: Fix hoststackTibor Frank1-8/+8
Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e4d7b3b4d4185e97443830e7e9fb0f570031a376)
2021-01-18Report: Add data, add 2n-tx2Tibor Frank16-1146/+2528
Change-Id: Ic2f8e03c16c432479139648cad7982a962193bc4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit caef25a1412689fc0906e024e9b26c547ecfc5bd)
2021-01-18Report: add 2n-tx2 static contentJuraj Linkeš34-10/+316
Change-Id: I476ac52d64999f6d3ca3ee726f018f36693ac921 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit 7f0abbb8f56342fc09b09beb47661f4d55b7eb62)
2021-01-18PAL: Improve latency graphsVratko Polak1-6/+31
Previously, they used sloped lines connecting reported points. But HdrHistogram reports only the upper bound of percentile. Example: If all samples are 10us, HdrHistogram reports a single value at 100%. This change attempts to show the whole intervals (0%-100% for the example) as a series (vertically connected) of horizontal lines. Hover also shows percentiles as intervals. Change-Id: Id7bbff7b1c29d7f62472041340fde88903363cfa Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 826d80373dbd20bc1feac2403e9cade9e5633336)
2021-01-14Add 3n ip4-rnd testsVratko Polak9-13/+430
+ Rename traffic profiles to avoid mentioning number of nodes. + Improve 2n rnd suite documentation slightly. This is a manual cherry-pick of https://gerrit.fd.io/r/c/csit/+/27679 Change-Id: I82d6fb6a99133163a58d56f2acf8a7b9568ee77c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-14License: Update block replacerVratko Polak2-1/+24
... so it replaces also long (older) form of GPL license. This way replacing to apache and back ensures GPL has (newer) short form. Change-Id: I34efd83a91e54b2b2bbb3c4429d1b82397a1e8f8 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 193fc1732fdacf424d36bbb979037ba261457cb4)
2021-01-14License: Wrap GPL block to 80 charactersVratko Polak185-367/+552
The original license block was adapted from https://wiki.fd.io/view/TSC/Proposed_Header_Python_Test_Scripts resulting in a line longer than 80 chars, but those are reported (although not blocked) by tox verify job. As the text from wiki was not used in verbatim (it uses c-style comment block), minor formatting change like this should not be a big deal. + Bump copyright year. Change-Id: I55e3a0232639b448b1a6d7b1f3af84d903a8d0a5 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 624e580159dc056035d7e962582e86a000f8c3d6)
2021-01-09perf: GENEVE tunnel test, l3 modeJan Gelety17-18/+2361
Jira: CSIT-1768 Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 6962831a1f1905e50a3d663c0cf3ce8c2873ecc9) Change-Id: I6496ae773b176b2abfedab843110d6f870c62888 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-142101: Update the stable ver files to rc2Tibor Frank2-2/+2
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ibec19f45e307af8b6c92d76ed0da126650973c3b
2021-01-14Report: Add dataTibor Frank2-9/+14
Change-Id: I3ac0e892ef3f2b0a23b42465565d28f5d5027dae Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ef5c30213bb28824a55f4ebbcade6410ee8d2461)
2021-01-13job_specs: fix 2n-tx2 ip6 iacldst job specsJuraj Linkeš2-6/+6
Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit 55eb33d7469ec635755d0942c74ff798f9f3d498)
2021-01-13Report: Fix plotsTibor Frank1-1/+2
Change-Id: I70a7929400d7fba144a3669fc9d8aff003695f55 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 81958d4bc5ec4803be0726d94564680e2a0f9a5c)
2021-01-13job_specs: update 2n-tx2 coverage specsJuraj Linkeš15-5/+955
Start out with l2, l3, classifier and acl tests. Change-Id: I8fc390c77e410e4f4832b4412114253dd34a5fbb Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-13Report: Add dataTibor Frank2-29/+192
Change-Id: Ia6f46cd9dbf83e6376f635b3e250708bdfba80be Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 98a94315dae63bd19c7bc16ce50b3219386aa34c)
2021-01-13Report: Add dataTibor Frank1-54/+35
Change-Id: I23dd384edd107facdc8e54275c1acded5a9935fd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7a26d43c4f71869695ba19ce58f9afac9a1d176d)
2021-01-12Report: Add dataTibor Frank1-0/+16
Change-Id: I70153753ccc69597dc2c69133b3828cd76174468 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1899cf849e938512df8bac9ea7cb6479732dda42)
2021-01-12Add 2n-tx2 job specsTibor Frank2-0/+50
Change-Id: I992c1466b2226337a043b46e1bdba82de2dc2368 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-12Report: Add dataTibor Frank1-22/+36
Change-Id: I648732e98941b562c31a9db735332bd215d65870 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1b141f8090e9b067dce9d182a81aa530213d4a66)
2021-01-11tests: add 2n1l l2 acl tests, update 2n-tx2 specsJuraj Linkeš57-103/+1334
Modify initialize L2BD ACL keywords to be usable for both 2-node and 3-node topologies and update testsuites accordingly. Add the missing macip T-rex profile. Add classifier tests to 2n-tx2 job specs. Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit 9d510d595f73d26e3f7c6646fa6530e8f252f790)
2021-01-11Infra: Increase shm-sizepmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib9dfb8623757fd23fd8b49b5e04ed86e202ada66 (cherry picked from commit 2f4b14bc83437afcc242190a121ba47a6d10bd09)
2021-01-11Report: Fix plot layoutTibor Frank1-1/+1
Change-Id: Ia2c448a6b9bed2095710c04fde606649385e408e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fa0e6315e4db3d96b281fb7467a9416150c0bc9f)
2021-01-11Report: Add dataTibor Frank2-13/+521
Change-Id: Ic584b2340bbaebf5699213358292159518546334 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e7c71f5e3de89d0e9f0b6d5d0ee099e1ee97c2db)