aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-02-01Add suites with randomized ip6 profilesVratko Polak18-28/+868
+ Replace pair of traffic profiles (2n and 3n) with single nodeless one. + Compared to incremental suites, randomized ones add IP6_RND tag. Change-Id: I2f0dfc9e04bbcd0f88e95b92edf2da2c73faaab6 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ad98ea70cf435d104b6a4f0090575e137660da77)
2021-02-01Report: Synchronize report spec with masterTibor Frank1-20/+0
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Iaaa64ad82319a8176bf25693815136851925d38b
2021-02-01Report: Add 2101.release dataTibor Frank1-471/+513
Change-Id: Ic4587cb7f6fb5f2ee3d70169ad03d02d1721bd62 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1a82cf21d8ec419543fd46bbce3d64528fbb6bb4)
2021-01-29Fix: Slack API keypmikus1-75/+2
- Clearly we must implement key storage vault to avoid storing key in .tfstate Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Iea2db10e4cd59c29a0c74ee92cbddc7d261bd6a7 (cherry picked from commit 101d3251d3f30f894a9143f8c1062761f3ed8337) (cherry picked from commit 6b4b75acf819a8a7c68d0f57365bbd6e0b4d3933)
2021-01-29Fix: Slack key workaroundpmikus6-581/+40
- Todo: Deploy hashi vault. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib02f00039bd4cbb4725ea3fec56184b7928208ad (cherry picked from commit 993696b15c5f5b63c5d206fd9cc9b32c4af4e2dd) (cherry picked from commit 3715b48d91e15d0f961963acb641abce67a101d1)
2021-01-29Infra: Monitoring capabilitypmikus24-3/+26661
+ Monitoring SOA + Nomad alertmanager job + Nomad prometheus job + Nomad grafana job Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I0b32e9c87276ba1a2d4a5322816f3473c737eae2 (cherry picked from commit a44eef233de959c5679602dc6cd1ed866d6abc14) (cherry picked from commit 2856c0a0c19319de146a93c27e106351faf1926c) (cherry picked from commit 6717a3bc8b5fb81c1a19964fd367878230331457)
2021-01-28Infra: Remove Consul TLS on clients (Nomad conflict)pmikus1-3/+3
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7c825150a19dd783a255fcc5cbd31b91c6b0b2cf (cherry picked from commit 474163bc78aa418595b227c81056987b1114104d) (cherry picked from commit dae934efdf9c773b90cc4a9595d217dd55035561) (cherry picked from commit ba5dcdbecd4c009c832c2a186a58566a5ef4dc81)
2021-01-28Infra: Remove unwanted terraform outputpmikus1-18/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Id6ed065d05c20b6305abfecb8e79bacb86c5b85a (cherry picked from commit 6cc6235c7a693d7d4c22bb8a067924372bad6faf) (cherry picked from commit 95a7a55f4b7f77a1af8ddd8a8088896b7c8bcae5)
2021-01-28Infra: Terraform vpp_device modulepmikus3-0/+219
+ Convert to module + Fix memory limit Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I95285faabbf7bad7fcb7f3b0c9b4e79641c6b95c (cherry picked from commit 2afd8f4fe26ae1f1d183ecac8f9daa85f68bc634) (cherry picked from commit 7c90b6a0f1d0e14f64364d0213e473d447980d05) (cherry picked from commit 7a760c915e1d905f6cc0b2ef99ad293e3e5e290d)
2021-01-28Infra: Adjust vpp_device x86 memory layoutpmikus2-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I43b3b891b270903419b7fcf132813563306b6e10 (cherry picked from commit f6882e6231ef0a39d137862d1fb5b75f8eddd9c4) (cherry picked from commit d04cbd87772bf94648f130ce356ad53406760485) (cherry picked from commit 66946b2e17f15f09f03f2c1e646aa8fc844d614b)
2021-01-28Infra: Align Nomad settings across clusterpmikus13-5/+18
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Id362e47ecee9fd4eac8332978d81f33656880d66 (cherry picked from commit d69b5158e2c4ef0bae7acb1f99c103607a4d7b2a) (cherry picked from commit 45cb36933587e92ceb901725134d0eaeece82104) (cherry picked from commit db5da5b55359cf824ca1a06371622d9094d9cebc)
2021-01-28rls2101: Update VPP_STABLE_VER files to release versionTibor Frank3-3/+3
Change-Id: I1b4ceae9027f2d439c29058f4a19f0a28a698c0d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-28job-specs: Add rnd testsTibor Frank22-1149/+783
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3354bdb7f7c183322c886ab1c89c8f3bbf42366b)
2021-01-27Report: Add dataTibor Frank2-4/+26
Change-Id: Ie90bdf03bb4190e199bfdcb440125caea7bfdef8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d6615bce0d5ac4cb88bbeec584fa7094a6db2c06)
2021-01-27Report: Fix reconfig graphsTibor Frank2-30/+6
Change-Id: Id8d4930937e502bd8b4b54145437a9e7f668ace5 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3f8cd3759d371a5ac2df46cfb981cc3a599574ea)
2021-01-27Report: Improve reconf graphsTibor Frank2-5/+9
Change-Id: Ic935c946123c4dcc9daa608c523767b9aca36ef3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7d7ec5e661abec4dda2546843addf1a71580e97e)
2021-01-26Trending: Add GENEVE testsTibor Frank6-0/+245
Change-Id: I5e20f6351dd3854eef075e1bf954dab5aee61698 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5e996684dd0c95089256631c696e4fb9e72e21a2)
2021-01-26Report: Add GENEVE testsTibor Frank9-1/+635
Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1e3c01e0e458d62ed228e8d6a916c24992304252)
2021-01-25rls2101: Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I4db975fab589594f7551217b64adfe13cf628f65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-25Report: Add dataTibor Frank1-4/+131
Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 88bbb1908b4aa58163374c983b4b8e85e78460d5)
2021-01-25Hdrh latency graphs: Do not skip the last valueVratko Polak1-5/+7
Linear x axis does not need any skipping. For logarithmic axis, descrease from 100% to avoid infinity. Currently using a fixed PERCENTILE_MAX value. Added a comment on when to change that value. Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit d4f12e6931c7fdf84043d8fb2f71e2f38965f26b)
2021-01-22Report: add geneve to perf release notesJan Gelety3-0/+79
Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 67d3b2a44d49dd2c4a1b2f722849f57432787137)
2021-01-22Report: Add dataTibor Frank4-15/+471
Change-Id: I1d5031780b1bef169509058233e02624d7afecb7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0c489b1767a031837f320c1fb5e45947ac82ea4d)
2021-01-22Report: vpp-device release notesJan Gelety2-3/+18
Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 7b9b65a3af83267a4e6a36fc98996aaa05060a87)
2021-01-21Reconf: Fix bidir/unidir mismatchVratko Polak53-170/+119
Results if NDR search is in TPS (so unidir) since https://gerrit.fd.io/r/c/csit/+/28208 The bug was causing all reconf tests report zero loss, as they used half of NDR load during reconfiguration. + Small improvements to descriptions of other traffic keywords. Change-Id: Ib9af5861cc09e698eb762feb3f0a019571d17962 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 293a88b56179094f655178b838b84844a672390d)
2021-01-21Trending: Fix bugs in 2n-tx2Tibor Frank1-1/+1
Change-Id: I5522e2cb37b9e319bfde009297525179da2e50f7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7f7f2fd7363637d0da626a28bb8a0b357d314a9d)
2021-01-21Report: Add dataTibor Frank1-0/+22
Change-Id: I09a695d9c747d4bb6826d27283ab0aa172fc0d30 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9e08f1dfb125d092a48f92c764f52ae97f8a9995)
2021-01-21Trending: Add 2n-tx2Tibor Frank13-1/+758
Change-Id: Id2d0248128eee6a5b0969c7f27aae946ed47bbaa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3fc6ce9f08f0a1c1293dfc032fdddfe5e3f7eb16)
2021-01-20acl: add L2BD dev testsMartin Balaz5-0/+491
Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech> Change-Id: I70127d8dd2241b70511f31842eb8a9e3cbafdc4b Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 0f3baca2366f969de6b5d3b889c1b05f72995ec2)
2021-01-20job_specs: add geneve testsJan Gelety9-20/+407
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 3d0d137bf45e1cd3c7aa06480f5ea08175a6df01)
2021-01-20Tox: Improve tox.iniVratko Polak1-15/+26
Just stylistic improvements, no functional change. + Use "ignore_outcome = true" instead of "|| true". + Document and apply recommended ordering within testenv definition. + Fix some typos. Change-Id: I004f12fbdf6dbeb555daa7cd111938b7eeef20b3 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 52a39f861bb645831130ef109a14e629be9bde7a)
2021-01-20Report: Add dataTibor Frank3-1013/+41
Change-Id: Ie7450076891e1041b5635f8ea714f94909b6d407 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 216c68cc8b010642c4de21673b7d8e18006767e2)
2021-01-19Report: Add ip6 latency graphsTibor Frank1-4/+2
Change-Id: Ic53214b0a0360bdb6d62d100fc7b9c8e15fb8397 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5e0fe5a28969dfc9fe36415a065122a668d5a273)
2021-01-19Report: Add data, 2n-tx2 latency graphsTibor Frank6-469/+1190
Change-Id: Idd9396c0f260355e3b7b90839bd4b1f64d8b0644 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4bc1e70ad02b198a7b9ea32b72da3ae98978e8c5)
2021-01-19Job specs: Add some ipsec reconf to iterativeVratko Polak1-0/+76
We now have more time for 3n-hsw testbeds. Added only scales of 4, 1000 and 60000 tunnels. Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit be5833232791a24921e7e9695e53efcbd7ff248e)
2021-01-19Report: Add dataTibor Frank1-416/+416
Change-Id: I1b7314affd08d12b67212affb2ef89f64d1347ee Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f5863d6213bf0066b9647a7dde10d56bd7260f80)
2021-01-18Random flows: Use seeds again and increase limit.Vratko Polak3-45/+54
TRex does mix seeds when distributing over workers, but it is multiplicative [0], so zero is the only bad value. Limit restricts the cycle length of PRNG (by resetting [1] the seed). We want the cycle as long as possible. [0] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L1616 [1] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L313-L314 Change-Id: I33a29496f0853ef60d592c988f81a9d1109b5878 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit eedb7dff222d2590ac2cb5a5e67dc7d90317f05c)
2021-01-182101: Update VPP_STABLE_VER_ filesTibor Frank2-2/+2
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ica196e6a309e4dc2fdfb51b7faed72a627311991
2021-01-18Report: Remove slider for Latency graphsTibor Frank1-2/+0
Change-Id: I86b9af8e2ebbf27cd8d93c9a04901dce874fa9d6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 69264aed8d43f3c4a8342dd7584f80336108c879)
2021-01-18Report: Fix specificationTibor Frank1-2/+6
Change-Id: Ida7035fd130f566215f222d9cd7e98beb583af94 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4d04d11497eb87f94d6ac4982e4b17ae0f48d811)
2021-01-18job-specs: Fix hoststackTibor Frank1-8/+8
Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e4d7b3b4d4185e97443830e7e9fb0f570031a376)
2021-01-18Report: Add data, add 2n-tx2Tibor Frank16-1146/+2528
Change-Id: Ic2f8e03c16c432479139648cad7982a962193bc4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit caef25a1412689fc0906e024e9b26c547ecfc5bd)
2021-01-18Report: add 2n-tx2 static contentJuraj Linkeš34-10/+316
Change-Id: I476ac52d64999f6d3ca3ee726f018f36693ac921 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit 7f0abbb8f56342fc09b09beb47661f4d55b7eb62)
2021-01-18PAL: Improve latency graphsVratko Polak1-6/+31
Previously, they used sloped lines connecting reported points. But HdrHistogram reports only the upper bound of percentile. Example: If all samples are 10us, HdrHistogram reports a single value at 100%. This change attempts to show the whole intervals (0%-100% for the example) as a series (vertically connected) of horizontal lines. Hover also shows percentiles as intervals. Change-Id: Id7bbff7b1c29d7f62472041340fde88903363cfa Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 826d80373dbd20bc1feac2403e9cade9e5633336)
2021-01-14Add 3n ip4-rnd testsVratko Polak9-13/+430
+ Rename traffic profiles to avoid mentioning number of nodes. + Improve 2n rnd suite documentation slightly. This is a manual cherry-pick of https://gerrit.fd.io/r/c/csit/+/27679 Change-Id: I82d6fb6a99133163a58d56f2acf8a7b9568ee77c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-14License: Update block replacerVratko Polak2-1/+24
... so it replaces also long (older) form of GPL license. This way replacing to apache and back ensures GPL has (newer) short form. Change-Id: I34efd83a91e54b2b2bbb3c4429d1b82397a1e8f8 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 193fc1732fdacf424d36bbb979037ba261457cb4)
2021-01-14License: Wrap GPL block to 80 charactersVratko Polak185-367/+552
The original license block was adapted from https://wiki.fd.io/view/TSC/Proposed_Header_Python_Test_Scripts resulting in a line longer than 80 chars, but those are reported (although not blocked) by tox verify job. As the text from wiki was not used in verbatim (it uses c-style comment block), minor formatting change like this should not be a big deal. + Bump copyright year. Change-Id: I55e3a0232639b448b1a6d7b1f3af84d903a8d0a5 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 624e580159dc056035d7e962582e86a000f8c3d6)
2021-01-09perf: GENEVE tunnel test, l3 modeJan Gelety17-18/+2361
Jira: CSIT-1768 Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 6962831a1f1905e50a3d663c0cf3ce8c2873ecc9) Change-Id: I6496ae773b176b2abfedab843110d6f870c62888 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-142101: Update the stable ver files to rc2Tibor Frank2-2/+2
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ibec19f45e307af8b6c92d76ed0da126650973c3b
2021-01-14Report: Add dataTibor Frank2-9/+14
Change-Id: I3ac0e892ef3f2b0a23b42465565d28f5d5027dae Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ef5c30213bb28824a55f4ebbcade6410ee8d2461)