aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-02-10Methodology: Add NAT44ed tput testsVratko Polak1-14/+12
Change-Id: I22a38ca98cb0aa4bac9a03d3943e807c26ce4474 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 24012f71b90d48dbaab941a8815427bbf54ba5c1)
2021-02-10Report: Small fixesTibor Frank5-60/+64
Change-Id: I30c51b2fb71322df042d76394dfa223615f2d206 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 72f18772740b0dde1ed6e44d740f8456ce0546e9)
2021-02-10Report: Update release note sectionpmikus2-30/+17
- Infra update - Cleanup Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib8fe70fdbbaeabfbb9f2e96fc8a9ab87a8e63f35 (cherry picked from commit 60b531215d36e2402b1b6c768bd4fd4d4b210fd0)
2021-02-10Report: Add dataTibor Frank1-6/+40
Change-Id: Id7f398a3d4080d3780ac9684ae2e925d7eb59c86 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d56509e3e8e1109e75362fe7c2bf1f4fa805efed)
2021-02-09Report: Hide nat44 tput testsTibor Frank3-350/+352
Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cf2a4f97f261a8ab27578232e9f419968e8a1fb1)
2021-02-09Report: Add latency graphs for NAT44 tput testsTibor Frank3-17/+429
Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d517fd2f0363ef4b0d857f8a4437fb0a39d7d144)
2021-02-09Report: Add NAT44 tput testsTibor Frank15-12/+1008
Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ddaf1688aa8dbb6f9a6e463faaf62c752c53a394)
2021-02-08FIX: Nic selectionpmikus1-2/+2
- Buggy unnoticed for quite some time Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa (cherry picked from commit 127eb76dfeca04e123b0d7cc229c4a71ee3f2f9a)
2021-02-08Latency graphs: Do not hardcode x rangeVratko Polak1-2/+4
+ Compute it from PERCENTILE_MAX. + Use slightly higher PERCENTILE_MAX to avoid rounding errors. + Add a comment why slightly higher value is needed. Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 7c0d519483e2c5e5a0c9997ed01408200b64370b)
2021-02-08Traffic generator: Force ramp-up in next testVratko Polak1-2/+2
The behavior was already documented, just not implemented properly. Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 28ed095b73c4a01ed73c93b3b80da22a4bcca907)
2021-02-08job-spec: fix report_coverage/2n-tx2/l2-04.mdTibor Frank1-13/+13
- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by eth-l2bdbasemaclrn-macip-iacl50sl-10kflows Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2925ed78ef21456cf6f8dfbe4afed6ea0307ed20)
2021-02-08report: add 2n-tx2 phy testbed diagram and update descriptionMaciek Konstantynowicz2-4/+1088
Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit b6cac504fa90b85b94317238082885759ca28348)
2021-02-08Report: Add dataTibor Frank1-16/+207
Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e61e873dd9252b6824cbc3c37bafccf85813a7a1)
2021-02-05Report: Add dataTibor Frank1-8/+30
Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 15c18ac54d1794da1a9a4a1c12e10a46426e8a65)
2021-02-05Report: Various fixesTibor Frank11-267/+171
Change-Id: Ib3fcf5b9a839ce397970761c717310da9c8a63b7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5cbe9912f188bcad4956b212dfed12af5dccf065)
2021-02-05NAT44ed: Add pure throuhput bidir testsVratko Polak15-71/+1722
+ With ramp-up, without reset, with session verification. + Uses the same profile as pps tests. + Ramp up duration is not specified, as duration is computed. + Timeout tracking with automated ramp-up. + Correct computation of next duration. + Checking both early and late sessions. + No loss measurement also acts as a ramp-up. + Return ReceiveRateMeasurement from send_traffic_on_tg_internal, as that is needed for detecting whether trial is ok as ramp up. - Udp needs quite low ramp-up rate after recent regression. - Max scale has higher rate (so failing) to avoid session timeouts. + Bump copyright year. Change-Id: I50c928659cd5b985b490a2e5fb69c5cd790600b0 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit b26fe6de7965f6621b54a80a938f82afe95aa585)
2021-02-05Report: Set range of x-axis for latency graphs, add dataTibor Frank2-6/+5
Change-Id: Ibfa1d6d0fb851b8c2d55c0cc749307efb36a5a03 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0c02e000ae58474120246c484cf5458a76510288)
2021-02-05Trending: RND testsTibor Frank1-3/+8
Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 340c20a3f3908d832ad093349e1ccb14060e8035)
2021-02-05Report: Add dataTibor Frank1-4/+79
Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f60c0957d9d66a19a05c06e27839401f7ec97829)
2021-02-04Report: Set the range of x-axis fro Latency graphsTibor Frank1-4/+5
Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 879b31f02fb4df52016d7465e21377121dfbb515)
2021-02-04Report: Add 2n-clx rnd latency graphsTibor Frank1-10/+10
Change-Id: I7c8c6d2129cc67a7a9f635f0b6ebea53ffa6e158 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit eecc9da92caae82e9e9a608c41fd0b192780fe4c)
2021-02-04Report: Add dataTibor Frank1-3/+8
Change-Id: I9a09d6077f0c3acbd42b79220aec69dcd9490359 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2e769b838081d49868ea793f8c38318f5a1a6cef)
2021-02-04Report: Add dataTibor Frank1-4/+75
Change-Id: I5243c2b2a9669df4bc57f4d606b4bf0df3d9580c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 29ce700b9cf1a6b275f13fc3975991289b062e53)
2021-02-04Report: Latency graphsTibor Frank2-9/+9
Change-Id: I5ca267827a549f7378c289e7db1d3bb89f5482eb Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit df3b53935c5db2e53cf8e72ca2ef5be995071e69)
2021-02-03Trending: Add IPv4 and IPv6 rnd testsTibor Frank11-7/+719
Change-Id: Ie90b88466575c33c2c45e8fb9c2b0c42dc795aa6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 38b98cea69a149ac5b1be23f0dbad79e7e1cb01c)
2021-02-03Report: Add RND Latency graphs, add dataTibor Frank6-0/+424
Change-Id: I9882b19a87e0d7437471ac5e5f7986d69fe2ce34 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b5073afc4a941ea33ce874e016fe86384ae7a60d)
2021-02-02Report: Fix specTibor Frank1-0/+1
Change-Id: I2c7e98c05543e878a6a220fe8d4ffbb15eaa1997 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9387a7bd3187faa7c1e75daa084bda5564c74d94)
2021-02-02Report: Add RND testsTibor Frank17-22/+1138
Change-Id: I43289d4dde371984698b0d1a16e8dd65fc33f84e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 50a4e5e45f5e6e18f2dac6aee69adb85ef4d12c4)
2021-02-02Trending: Fix nat44 tests in NDRPDR trendingTibor Frank1-2/+6
Change-Id: Iab49c4e55d4cb3ad1e1c5399a406de6e9e8fbed1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 45423631acb4ddc58f20fffa096b46724de75ee8)
2021-02-02Report: Add dataTibor Frank1-10/+86
Change-Id: I97bdba256d5886c0ffdd42d4427038bd3b443043 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b4cc5ae04a3cefa5e4a3b6819003c223299b61b2)
2021-02-01Add suites with randomized ip6 profilesVratko Polak18-28/+868
+ Replace pair of traffic profiles (2n and 3n) with single nodeless one. + Compared to incremental suites, randomized ones add IP6_RND tag. Change-Id: I2f0dfc9e04bbcd0f88e95b92edf2da2c73faaab6 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ad98ea70cf435d104b6a4f0090575e137660da77)
2021-02-01Report: Synchronize report spec with masterTibor Frank1-20/+0
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Iaaa64ad82319a8176bf25693815136851925d38b
2021-02-01Report: Add 2101.release dataTibor Frank1-471/+513
Change-Id: Ic4587cb7f6fb5f2ee3d70169ad03d02d1721bd62 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1a82cf21d8ec419543fd46bbce3d64528fbb6bb4)
2021-01-29Fix: Slack API keypmikus1-75/+2
- Clearly we must implement key storage vault to avoid storing key in .tfstate Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Iea2db10e4cd59c29a0c74ee92cbddc7d261bd6a7 (cherry picked from commit 101d3251d3f30f894a9143f8c1062761f3ed8337) (cherry picked from commit 6b4b75acf819a8a7c68d0f57365bbd6e0b4d3933)
2021-01-29Fix: Slack key workaroundpmikus6-581/+40
- Todo: Deploy hashi vault. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib02f00039bd4cbb4725ea3fec56184b7928208ad (cherry picked from commit 993696b15c5f5b63c5d206fd9cc9b32c4af4e2dd) (cherry picked from commit 3715b48d91e15d0f961963acb641abce67a101d1)
2021-01-29Infra: Monitoring capabilitypmikus24-3/+26661
+ Monitoring SOA + Nomad alertmanager job + Nomad prometheus job + Nomad grafana job Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I0b32e9c87276ba1a2d4a5322816f3473c737eae2 (cherry picked from commit a44eef233de959c5679602dc6cd1ed866d6abc14) (cherry picked from commit 2856c0a0c19319de146a93c27e106351faf1926c) (cherry picked from commit 6717a3bc8b5fb81c1a19964fd367878230331457)
2021-01-28Infra: Remove Consul TLS on clients (Nomad conflict)pmikus1-3/+3
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7c825150a19dd783a255fcc5cbd31b91c6b0b2cf (cherry picked from commit 474163bc78aa418595b227c81056987b1114104d) (cherry picked from commit dae934efdf9c773b90cc4a9595d217dd55035561) (cherry picked from commit ba5dcdbecd4c009c832c2a186a58566a5ef4dc81)
2021-01-28Infra: Remove unwanted terraform outputpmikus1-18/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Id6ed065d05c20b6305abfecb8e79bacb86c5b85a (cherry picked from commit 6cc6235c7a693d7d4c22bb8a067924372bad6faf) (cherry picked from commit 95a7a55f4b7f77a1af8ddd8a8088896b7c8bcae5)
2021-01-28Infra: Terraform vpp_device modulepmikus3-0/+219
+ Convert to module + Fix memory limit Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I95285faabbf7bad7fcb7f3b0c9b4e79641c6b95c (cherry picked from commit 2afd8f4fe26ae1f1d183ecac8f9daa85f68bc634) (cherry picked from commit 7c90b6a0f1d0e14f64364d0213e473d447980d05) (cherry picked from commit 7a760c915e1d905f6cc0b2ef99ad293e3e5e290d)
2021-01-28Infra: Adjust vpp_device x86 memory layoutpmikus2-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I43b3b891b270903419b7fcf132813563306b6e10 (cherry picked from commit f6882e6231ef0a39d137862d1fb5b75f8eddd9c4) (cherry picked from commit d04cbd87772bf94648f130ce356ad53406760485) (cherry picked from commit 66946b2e17f15f09f03f2c1e646aa8fc844d614b)
2021-01-28Infra: Align Nomad settings across clusterpmikus13-5/+18
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Id362e47ecee9fd4eac8332978d81f33656880d66 (cherry picked from commit d69b5158e2c4ef0bae7acb1f99c103607a4d7b2a) (cherry picked from commit 45cb36933587e92ceb901725134d0eaeece82104) (cherry picked from commit db5da5b55359cf824ca1a06371622d9094d9cebc)
2021-01-28rls2101: Update VPP_STABLE_VER files to release versionTibor Frank3-3/+3
Change-Id: I1b4ceae9027f2d439c29058f4a19f0a28a698c0d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-28job-specs: Add rnd testsTibor Frank22-1149/+783
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3354bdb7f7c183322c886ab1c89c8f3bbf42366b)
2021-01-27Report: Add dataTibor Frank2-4/+26
Change-Id: Ie90bdf03bb4190e199bfdcb440125caea7bfdef8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d6615bce0d5ac4cb88bbeec584fa7094a6db2c06)
2021-01-27Report: Fix reconfig graphsTibor Frank2-30/+6
Change-Id: Id8d4930937e502bd8b4b54145437a9e7f668ace5 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3f8cd3759d371a5ac2df46cfb981cc3a599574ea)
2021-01-27Report: Improve reconf graphsTibor Frank2-5/+9
Change-Id: Ic935c946123c4dcc9daa608c523767b9aca36ef3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7d7ec5e661abec4dda2546843addf1a71580e97e)
2021-01-26Trending: Add GENEVE testsTibor Frank6-0/+245
Change-Id: I5e20f6351dd3854eef075e1bf954dab5aee61698 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5e996684dd0c95089256631c696e4fb9e72e21a2)
2021-01-26Report: Add GENEVE testsTibor Frank9-1/+635
Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1e3c01e0e458d62ed228e8d6a916c24992304252)
2021-01-25rls2101: Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I4db975fab589594f7551217b64adfe13cf628f65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-25Report: Add dataTibor Frank1-4/+131
Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 88bbb1908b4aa58163374c983b4b8e85e78460d5)