aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-02-18Framework: SciPy upgradepmikus2-2/+2
+ 1.5.4 to solve python3.8 dependency. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I682bedc18b56d1fed3974f792a4d79656cbe97cb
2021-02-18Framework: Qemu 4.2 compatibility fixpmikus1-1/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8692b53c02773dbe5a5e02f959dfed8599cb8a4d
2021-02-17PAPI: Python 3.8 compatibilitypmikus1-5/+7
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4
2021-02-17Infra: Ansible docker images cleanuppmikus10-74/+188
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8d67b8ad5db5c0a7c9b3fa892e1e66dab2f666d0
2021-02-17Report: Add dataTibor Frank1-0/+8
Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-16report: fixed typo AMD 2n-tx2 to ArmMaciek Konstantynowicz2-2/+2
Change-Id: I8b5af0a2a8b7af287e0258f0465687f3574c1ead Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-02-16Infra: Ansible 2.10Peter Mikus11-5/+54
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6b058ff30628c7e066372fec2141a8bcc18c3997
2021-02-16RCA: Link to NAT44ed performance regression bugVratko Polak1-2/+2
Change-Id: Iec30c261225d99acec5a12bcda9ffe1809eed251 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-16Report: Add dataTibor Frank1-0/+4
Change-Id: If25bfb368aebc6ac84062086f81f67a62b30c912 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-16Report: Add comp tables for 2n-clx with mellanox NICTibor Frank11-63/+1005
Change-Id: I64f1821877f749cfb44b886b4760faba577a2014 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-15Report: Add framework speedup to notesVratko Polak2-0/+8
Change-Id: If01c977a48bb64c53608f6b937a715fc11000446 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-15Release notes: Tput tests and jumbo ipsecVratko Polak1-27/+9
+ Also randomized profiles. Change-Id: I8eefedca65129d8ebbd6f08b68e5884c930b1dc4 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 1b6c4949b794b0efd091f101ff450a04944c21ba)
2021-02-15Report: Add 2n-clx cx556a Latency graphsTibor Frank14-6/+1032
Change-Id: I026ebb96874c55059e230d6e4db2424c341c04c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-15Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I7baa8931325b16363b7d95c1bc17d82f75a109d6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-12Report: Fix spec for Latency by percentile: 2n-clx MLXTibor Frank1-2/+2
Change-Id: Ic782ef76d35b3349a04f57578c070b2f49e4ca7f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-12Report: re-group RND testsTibor Frank19-2097/+191
Change-Id: If45709086b850b6cccc44645ab195fd77296e5e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-12Methodology: Added packet flow orderingVratko Polak3-38/+92
Change-Id: If0f0397c2ace9112490e017ec8d18cfbf1dffbc5 Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-02-12Report: Add dataTibor Frank1-12/+37
Change-Id: Ia5c7e127c0063c4c1c8d265936361a68c4646f04 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-11Job specs: Add -tput tests to iterativeTibor Frank4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-11Report: Add 2n-clx Mellanox tests and graphsTibor Frank13-21/+239
Change-Id: Ib947d47b31138ac816acefee03429d454511dd05 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-10Report: vpp device i40e known issueJuraj Linkeš1-5/+7
Add the i40e PF/VF race condition known issue to the known issues list. Change-Id: I1eb4dcea118036dec3f3715f0d08d124f2a9ad1c Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-02-10Report: Add dataTibor Frank1-2/+2
Change-Id: I6803f9694c0260817d93258b4cb99cdd47dea9ef Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-10Methodology: Add NAT44ed tput testsVratko Polak1-14/+12
Change-Id: I22a38ca98cb0aa4bac9a03d3943e807c26ce4474 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-10Report: Small fixesTibor Frank5-60/+64
Change-Id: I30c51b2fb71322df042d76394dfa223615f2d206 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-10FIX: Hide slack urlpmikus3-34/+30
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If965c0d4ff52d96c407cf83b642119c321cc25fc
2021-02-10Infra: JenkinsJobHealthExporterpmikus14-217/+323
- Integration of Jenkins Job checker Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I822039cb64a3a352b49314ddab7c6099af3fe644
2021-02-10Report: Update release note sectionpmikus2-30/+17
- Infra update - Cleanup Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib8fe70fdbbaeabfbb9f2e96fc8a9ab87a8e63f35
2021-02-10Report: Add dataTibor Frank1-6/+40
Change-Id: Id7f398a3d4080d3780ac9684ae2e925d7eb59c86 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-09Report: Hide nat44 tput testsTibor Frank3-350/+352
Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-09Report: Add latency graphs for NAT44 tput testsTibor Frank3-17/+429
Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-09Report: Add NAT44 tput testsTibor Frank15-12/+1008
Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-08report: Update packet latency methodologyMaciek Konstantynowicz3-18/+30
Change-Id: I0378e96c6f64a1dd035d56465710b82f64dc4d32 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-02-08FIX: Nic selectionpmikus1-2/+2
- Buggy unnoticed for quite some time Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa
2021-02-08Latency graphs: Do not hardcode x rangeVratko Polak1-2/+4
+ Compute it from PERCENTILE_MAX. + Use slightly higher PERCENTILE_MAX to avoid rounding errors. + Add a comment why slightly higher value is needed. Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-08job-spec: fix report_coverage/2n-tx2/l2-04.mdTibor Frank1-13/+13
- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by eth-l2bdbasemaclrn-macip-iacl50sl-10kflows Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-08Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I3fbe46788e8b3b5701134e842b4db4583d842214 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-08report: add 2n-tx2 phy testbed diagram and update descriptionMaciek Konstantynowicz2-4/+1088
Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-02-08Traffic generator: Force ramp-up in next testVratko Polak1-2/+2
The behavior was already documented, just not implemented properly. Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-08Report: Add dataTibor Frank1-16/+207
Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Report: Add dataTibor Frank1-8/+30
Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Revert "Job specs: Add -tput tests to iterative"Tibor Frank4-168/+8
This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5. Reason for revert: Faulty tests, those which are running take too much time Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Job specs: Add -tput tests to iterativeVratko Polak4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-05Report: Various fixesTibor Frank11-267/+171
Change-Id: Ib3fcf5b9a839ce397970761c717310da9c8a63b7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05NAT44ed: Add pure throuhput bidir testsVratko Polak15-71/+1722
+ With ramp-up, without reset, with session verification. + Uses the same profile as pps tests. + Ramp up duration is not specified, as duration is computed. + Timeout tracking with automated ramp-up. + Correct computation of next duration. + Checking both early and late sessions. + No loss measurement also acts as a ramp-up. + Return ReceiveRateMeasurement from send_traffic_on_tg_internal, as that is needed for detecting whether trial is ok as ramp up. - Udp needs quite low ramp-up rate after recent regression. - Max scale has higher rate (so failing) to avoid session timeouts. + Bump copyright year. Change-Id: I50c928659cd5b985b490a2e5fb69c5cd790600b0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-05Report: Set range of x-axis for latency graphs, add dataTibor Frank2-6/+5
Change-Id: Ibfa1d6d0fb851b8c2d55c0cc749307efb36a5a03 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Trending: RND testsTibor Frank1-3/+8
Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Report: Add dataTibor Frank1-4/+79
Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-04Infra: Move probes under ansible instead of terraformpmikus29-1110/+417
+ More stable probe handling. + Naming cleanup due to errors. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I3bb1237af20636919f869f2eee53597202d00792
2021-02-04Report: Set the range of x-axis fro Latency graphsTibor Frank1-4/+5
Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-04Report: Add 2n-clx rnd latency graphsTibor Frank1-10/+10
Change-Id: I7c8c6d2129cc67a7a9f635f0b6ebea53ffa6e158 Signed-off-by: Tibor Frank <tifrank@cisco.com>