aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-03-04Report: Hide 2c and 4c GSO testsTibor Frank3-78/+81
Change-Id: Ifab207f12b056a8c77911ed69590337cea4355af Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bab7d6c6056d48df1c1edee30d690ce316aff2cb)
2021-03-04Report: GSO release notespmikus1-1/+7
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I369afd2c90d68078443436402a6224fa42ca646d (cherry picked from commit 2a5ecb6c130109828210eb7135a8fa4d6a0f2c80)
2021-03-03Methodology: GSOpmikus2-0/+137
- Report methodology Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I1726af15ab003ff6ee4411ca1ceace986d3ee42b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 1d7a226c6d9b237cdb034e40ededbfcc1094f363)
2021-03-03Job specs: add 2n-tx2 crypto mrr-daily testsJuraj Linkeš2-3/+93
Iteratively increase coverage, but only of mrr-daily tests. Because of time constraints (i.e. we won't have enough time to run all of the tests), only add mrr-daily tests and not ndrpdr iterative/cov tests. For iter tests, add the tests commented out which documents which tests we're omitting from iter runs compared to mrr-daily. Change-Id: I35625a1f67004473305cb752a98a962dcb825e16 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit 4d7ad95e106c152e90a93b01628324527e5e6497)
2021-03-03job-specs: Fix ipsec schedulerTibor Frank6-56/+56
Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a152271165987a8a74789c961782260a95f9777b)
2021-03-03Fix: Async scheduler tests are not hwVratko Polak12-12/+12
Suite name part is correct: swasync. This fixes the tag, from IPSECHW to IPSECSW. Change-Id: I13a5201dade7edf180d315416c82c15d69c1bfce Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit c2dda6e57c09bf364ee54ae5c81e22fb34c6e0d4)
2021-03-03Add test suites for crypto sw scheduler engineYulong Pei26-5/+3145
This patch is to add test suites for vpp plugin crypto_sw_scheduler, IPsec sync mode is to do crypto and packet forward work in same worker cores, crypto_sw_scheduler can schedule crypto work to other async crypto cores to improve whole crypto processing capability. This test suites configure fixed 1 rx queues per port, then measure IPsec performance with 1, 2, 3 crypto cores. This patchset include 1, 2, 4, 8 ipsec tunnels test cases. +Vratko help to change to count total physical cores instead of previous only count crypto cores in test cases. Change-Id: I0e67182e3d13273890a23703d838101900e25126 Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit f0e964d35af36f0923c6ae0421e74d94022cadba)
2021-02-25Report: Configure rls2101.09Tibor Frank3-3/+3
Change-Id: Ib61e7643c2072d9f0e8cdec3bb7e0328bd25d60a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 466ebbe92072c3b525a199b6f6601e8ece82e0d4)
2021-02-25Trending: Fix file names fro nat44 tput graphsTibor Frank8-36/+36
Change-Id: I7e722b268595e8b1de370b3dde9d2b00c566f143 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 572184f5dce9c564ee6fe132e0a22eff7ee75e02)
2021-02-24job-spec: Add test suites for crypto sw scheduler engineTibor Frank9-26/+874
Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0561d043063bec469833a85b09c0875c14cf4d4a)
2021-02-24Trending: Add nat44-tput testsTibor Frank17-1/+687
Change-Id: I0e670cfa4e0125856944656536f0d64d04bdbb6d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0e86d278980b7ebde05047d356bbdd37c13f70d6)
2021-02-24Report: Set .08 revision, fix GSO graphsTibor Frank6-26/+118
Change-Id: I5948dbaf69d183caddbefd16f2198b54a24ff904 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5f0782b8bd0db96a6496d55f44d157146b08de12)
2021-02-22Report: Add gso testsTibor Frank9-5/+603
Change-Id: Ic21d43a104bdafe93600d8f5fd60d403d13285aa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b9aa1c7701f6f261acc4849fb07929c64e3ae692)
2021-02-19FIX: Use x710 for gso testspmikus6-78/+78
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32 (cherry picked from commit 3a2c37ffa4755d89247684935fd27d8868fbfe4b)
2021-02-19FIX: Naming convention compliancepmikus11-89/+89
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046 (cherry picked from commit 1f6797ed6b662130f55d7629453c5010ed94162a)
2021-02-19Performance: Add GSO tests to report executionpmikus10-4/+223
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb (cherry picked from commit f09a4dffb4b0643a71f3f85960657a02a419ff3b)
2021-02-19Framework: GSO testpmikus6-5/+74
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad (cherry picked from commit ecfe59f83a49e0dda9cead06b81339e4ea545053)
2021-02-17PAPI: Python 3.8 compatibilitypmikus1-5/+7
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4 (cherry picked from commit 96c5f5ef45cf039691404a4451b1c6d9260d6ea0)
2021-02-17Report: Add dataTibor Frank1-0/+8
Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bb982ded24c87f3cbc2f84e41d85e426cd9092a4)
2021-02-16report: fixed typo AMD 2n-tx2 to ArmMaciek Konstantynowicz2-2/+2
Change-Id: I8b5af0a2a8b7af287e0258f0465687f3574c1ead Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 6e9cac0ad9f995c865a0f570a64ca19ce4030ab4)
2021-02-16RCA: Link to NAT44ed performance regression bugVratko Polak1-2/+2
Change-Id: Iec30c261225d99acec5a12bcda9ffe1809eed251 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 059ccad48e2ba56ef1922e54df01d6ba0cd5daa2)
2021-02-16Report: Add dataTibor Frank1-0/+4
Change-Id: If25bfb368aebc6ac84062086f81f67a62b30c912 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2ba4a54e5af01393d6ca8a73d64644bcbb07f9a1)
2021-02-16Report: Add comp tables for 2n-clx with mellanox NICTibor Frank11-63/+1005
Change-Id: I64f1821877f749cfb44b886b4760faba577a2014 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6b7f5d26098ba3a76b16169865eaee273274e96a)
2021-02-16Report: Add framework speedup to notesVratko Polak2-0/+8
Change-Id: If01c977a48bb64c53608f6b937a715fc11000446 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 05c22cea868503479b92236f2be6debe98e96c95)
2021-02-15Release notes: Tput tests and jumbo ipsecVratko Polak1-27/+9
+ Also randomized profiles. Change-Id: I8eefedca65129d8ebbd6f08b68e5884c930b1dc4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-15Report: Add 2n-clx cx556a Latency graphsTibor Frank14-6/+1032
Change-Id: I026ebb96874c55059e230d6e4db2424c341c04c6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7a3ffd6d385159609fe9ee8b8c575aa4fa4d891a)
2021-02-12Report: Fix spec for Latency by percentile: 2n-clx MLXTibor Frank1-2/+2
Change-Id: Ic782ef76d35b3349a04f57578c070b2f49e4ca7f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7d3f4273f0be2eec74eb1a2bed6d1f06ee5f3459)
2021-02-12Report: re-group RND testsTibor Frank19-2097/+191
Change-Id: If45709086b850b6cccc44645ab195fd77296e5e3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1c32c469514179f2a77ad2049c5e6ebf1c30bea8)
2021-02-12Methodology: Added packet flow orderingVratko Polak3-38/+92
Change-Id: If0f0397c2ace9112490e017ec8d18cfbf1dffbc5 Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 26328f390e81f7bcfd536fb7faabaa224d82f857)
2021-02-12Report: Add dataTibor Frank1-12/+37
Change-Id: Ia5c7e127c0063c4c1c8d265936361a68c4646f04 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 42a4834d143fe480d70aaed3c1ebb9eb9681d53e)
2021-02-11Job specs: Add -tput tests to iterativeTibor Frank4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit df0c31ceb15da3542f15941e1569e471d0f22007)
2021-02-11Report: Add 2n-clx Mellanox tests and graphsTibor Frank13-21/+239
Change-Id: Ib947d47b31138ac816acefee03429d454511dd05 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 87cd7f3983eade6f27a848b23409c95e4a35b631)
2021-02-10Report: vpp device i40e known issueJuraj Linkeš1-5/+7
Add the i40e PF/VF race condition known issue to the known issues list. Change-Id: I1eb4dcea118036dec3f3715f0d08d124f2a9ad1c Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit a0775ecebbef2caa05ae2ad1e0b666f178acfc02)
2021-02-10Report: Add dataTibor Frank1-2/+2
Change-Id: I6803f9694c0260817d93258b4cb99cdd47dea9ef Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1aebe29b8da1fc1ce77cbdda8da410b18fef74c0)
2021-02-10Methodology: Add NAT44ed tput testsVratko Polak1-14/+12
Change-Id: I22a38ca98cb0aa4bac9a03d3943e807c26ce4474 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 24012f71b90d48dbaab941a8815427bbf54ba5c1)
2021-02-10Report: Small fixesTibor Frank5-60/+64
Change-Id: I30c51b2fb71322df042d76394dfa223615f2d206 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 72f18772740b0dde1ed6e44d740f8456ce0546e9)
2021-02-10Report: Update release note sectionpmikus2-30/+17
- Infra update - Cleanup Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib8fe70fdbbaeabfbb9f2e96fc8a9ab87a8e63f35 (cherry picked from commit 60b531215d36e2402b1b6c768bd4fd4d4b210fd0)
2021-02-10Report: Add dataTibor Frank1-6/+40
Change-Id: Id7f398a3d4080d3780ac9684ae2e925d7eb59c86 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d56509e3e8e1109e75362fe7c2bf1f4fa805efed)
2021-02-09Report: Hide nat44 tput testsTibor Frank3-350/+352
Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cf2a4f97f261a8ab27578232e9f419968e8a1fb1)
2021-02-09Report: Add latency graphs for NAT44 tput testsTibor Frank3-17/+429
Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d517fd2f0363ef4b0d857f8a4437fb0a39d7d144)
2021-02-09Report: Add NAT44 tput testsTibor Frank15-12/+1008
Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ddaf1688aa8dbb6f9a6e463faaf62c752c53a394)
2021-02-08FIX: Nic selectionpmikus1-2/+2
- Buggy unnoticed for quite some time Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa (cherry picked from commit 127eb76dfeca04e123b0d7cc229c4a71ee3f2f9a)
2021-02-08Latency graphs: Do not hardcode x rangeVratko Polak1-2/+4
+ Compute it from PERCENTILE_MAX. + Use slightly higher PERCENTILE_MAX to avoid rounding errors. + Add a comment why slightly higher value is needed. Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 7c0d519483e2c5e5a0c9997ed01408200b64370b)
2021-02-08Traffic generator: Force ramp-up in next testVratko Polak1-2/+2
The behavior was already documented, just not implemented properly. Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 28ed095b73c4a01ed73c93b3b80da22a4bcca907)
2021-02-08job-spec: fix report_coverage/2n-tx2/l2-04.mdTibor Frank1-13/+13
- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by eth-l2bdbasemaclrn-macip-iacl50sl-10kflows Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2925ed78ef21456cf6f8dfbe4afed6ea0307ed20)
2021-02-08report: add 2n-tx2 phy testbed diagram and update descriptionMaciek Konstantynowicz2-4/+1088
Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit b6cac504fa90b85b94317238082885759ca28348)
2021-02-08Report: Add dataTibor Frank1-16/+207
Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e61e873dd9252b6824cbc3c37bafccf85813a7a1)
2021-02-05Report: Add dataTibor Frank1-8/+30
Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 15c18ac54d1794da1a9a4a1c12e10a46426e8a65)
2021-02-05Report: Various fixesTibor Frank11-267/+171
Change-Id: Ib3fcf5b9a839ce397970761c717310da9c8a63b7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5cbe9912f188bcad4956b212dfed12af5dccf065)
2021-02-05NAT44ed: Add pure throuhput bidir testsVratko Polak15-71/+1722
+ With ramp-up, without reset, with session verification. + Uses the same profile as pps tests. + Ramp up duration is not specified, as duration is computed. + Timeout tracking with automated ramp-up. + Correct computation of next duration. + Checking both early and late sessions. + No loss measurement also acts as a ramp-up. + Return ReceiveRateMeasurement from send_traffic_on_tg_internal, as that is needed for detecting whether trial is ok as ramp up. - Udp needs quite low ramp-up rate after recent regression. - Max scale has higher rate (so failing) to avoid session timeouts. + Bump copyright year. Change-Id: I50c928659cd5b985b490a2e5fb69c5cd790600b0 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit b26fe6de7965f6621b54a80a938f82afe95aa585)