aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2022-11-29fix(report): use the usual ASTF order also for DNVrls2210oper-rls2210-221205Vratko Polak1-4/+4
Change-Id: Iba13c94debf36b4ba5ff7b30ba4fece8d744640f Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 96103a8ae46892dae052d93120eb25c9b1073861)
2022-11-22Report: Configure 2210.47Tibor Frank2-2/+2
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Id2504802568129951743e231cc1ac26df4e801cf (cherry picked from commit a8c21a01b5b95e3375479290f7de1ca49a7eb95c)
2022-11-22Report: FixesTibor Frank1-4/+4
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I31e71d7281547e968482588cf583e4d752707428 (cherry picked from commit 77b2674ffb8bd2854b6118950026b7f23741b8c0)
2022-11-16Report: Add rls data, NAT44 ED TCP tput for 2n-dnvTibor Frank2-6/+72
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I5271663ae073d38520581f732afcbeb2f7006651 (cherry picked from commit 8b2c88965335c951db5a4d1eaec65372a82c43c8)
2022-11-15Report: Add release dataTibor Frank1-0/+25
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Iec46eb9ae7da4179a863ab28e8ff98626a491808 (cherry picked from commit bce16197538239f1cab685627b9afa9b2468158a)
2022-11-14Report: Add release dataTibor Frank2-514/+520
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Id0060056d5fff5bd6f36dec90e649734ad64b946 (cherry picked from commit f7c8270ad45abe617b40f12f33676e8e387c17d5)
2022-11-11Report: Add 3n-icx wireguard latency, add rls dataTibor Frank3-348/+360
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ic4237034cf0753602be8fcc12a98afeacbee8f1c (cherry picked from commit 47104ebac9be62bc437e28549c498348d3f9dd42)
2022-11-10Report: Add wireguard testsTibor Frank3-2/+182
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I07748424c20b64e62f215223fdbb8408e5cf7be5 (cherry picked from commit 2655abfdccb0ac1c7335eec07400fbf5cbcc15bc)
2022-11-09Report: Disable archiving the xml filesTibor Frank1-1/+1
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Id7fedf6ea02790b6d7615e219af5f05f22f2176e (cherry picked from commit 71b67a5f318ff6b66d07fdb12c9bb9864da31e17)
2022-11-09Report: Final clean-upTibor Frank3-28/+60
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I396b394aed58da29e6873e36c1cdcb323b3cf474 (cherry picked from commit c4275b598e6c333ecbbd45ad3742ab6cc6ba24b8)
2022-11-08Report: Fix typo in elements.yamlTibor Frank1-1/+1
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ice91b91b4bfe91854c5a41292696da006f360858 (cherry picked from commit c8522a6e5f133dd516958fff6d326b097d1c845d)
2022-11-08Report: Add rls dataTibor Frank2-5/+8
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I7d22528d1845bcc65570bd5f8de4de1cb1b2ce7d (cherry picked from commit a4458ecdab86886bf938da038e859ec9858d8a97)
2022-11-08Report: Add release data, trex coverageTibor Frank4-18/+66
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I40fd7691548a1d6fcdf906ba5c899241dbb7c001 (cherry picked from commit 4bb5b6a0426c67cdf02f7fe58722a37c6a2f6a9e)
2022-11-08Report: Add 3n-alt comparison tablesTibor Frank2-2/+352
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I80dafb4843af2d817f5c294ffca269817f55dcdb (cherry picked from commit 3abe52278e7060cd46676491bce84f6cc6abc7db)
2022-11-07Report: Add release dataTibor Frank2-10/+94
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ifd7332c3c2d6e0722d17f51fe15a9aab1f41b721 (cherry picked from commit ed6a8ae8d363512c6c9d5a271521ca5a4b48a6c9)
2022-11-04Report: Add release dataTibor Frank1-1/+14
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I07e254d26a6ea81342ab7c0987ed3591dd0815c2 (cherry picked from commit 8a6c65494e70508d5a5db6d9a16fcec61e552a41)
2022-11-03Report: Add release dataTibor Frank1-3/+21
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Idcfdb8406b5d0f76898be8488d30be95331aae0f (cherry picked from commit 7c8fe74da144f6142d92e3d814828a18d1b049f3)
2022-11-02Report: Add release dataTibor Frank2-167/+237
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Icdca915b9dda8fdc3d4728ac8080713f638ffe06 (cherry picked from commit b57756ad88d1d3134ac60388d2ca23e251f736c5)
2022-11-02Report: Add Trex testsTibor Frank2-119/+155
- 1n-aws - 2n-icx Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I31003746e8eed5718a760be1f1ad6e574c3f754e (cherry picked from commit 32ec0b8cce48883be3f5e6e91b0797c1ab52351b)
2022-10-27Report: Add rc2 dataTibor Frank1-1/+19
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I21c18c11a73d022cca754ad98dde9fa4ff17bcda (cherry picked from commit 244eba927ac29d8f53a6483f1df89d49c8fb631c)
2022-10-27fix(report): list more decimals in soak comparisonsVratko Polak1-4/+4
Recent results frequently show just one digit. Change-Id: Ieefb7d06789af6934cb76d7abd959df50ab6fa3c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit e10da8fe238ad069e6793f263d92521a65e928f8)
2022-10-26Report: Add rc2 dataTibor Frank1-2/+4
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I1781af56126d56a6bbcaef0fb77532aa9c3e8290 (cherry picked from commit 82419f7f8a1b08c7451340b413e54486bd4c0b9b)
2022-10-25Report: Add rc2 dataTibor Frank1-3/+5
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I5ce47d75f2267d79aa692fb4f97a1c9fb3268a97 (cherry picked from commit 642e800b6f4e8fc899d2105d7380ab71a9b64513)
2022-10-24Report: Add rc2 dataTibor Frank1-37/+37
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ic0d538a0ff597b48ab5b5efebd38aec043d0b2c4 (cherry picked from commit 1db7d8339f7d52c860f57e1ce30f51ebdb7071ae)
2022-10-21Report: Add rc2 dataTibor Frank1-9/+6
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ie4acbb212edcb6074b03851a8062d23c3736688c (cherry picked from commit 01a0c0d7d5ccb5d67db8684d29b59d414ef38785)
2022-10-20Report: Add rc2 dataTibor Frank1-5/+8
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Icf84d87591ea00b27c5b1d6d3c37c8c81a086628 (cherry picked from commit 8002cfbc97bb0af9bc84cb2353350d9af4e5afc2)
2022-10-19Report: Add rc2 dataTibor Frank1-23/+25
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I21038ab84cc5657fb4eb0e8f08e010fc6951ab83 (cherry picked from commit 1992923050127445b5f08fbc1a7fdc00d4417915)
2022-10-18Report: Add Hoststack tests for 3n-icxTibor Frank2-0/+82
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I0f6546950d9cc015ee5ca633c86ad988ae75fe8f (cherry picked from commit 07ebd0caf0ed5cb14c70c30fc0cd4469abb49e7c)
2022-10-18Report: Add 3n-snr dpdk testsTibor Frank3-82/+123
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I6b1f9d50bbaa8f0a632e96cba510d6b53900892a (cherry picked from commit 4b246a2bf50fd42ec3343dc317e7828d8b0d82da)
2022-10-17Report: Add 3n-snr coverage data setTibor Frank1-3/+5
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Id489031b763bc659b5030c1b8c479200ec50b561 (cherry picked from commit 3c84a95372474fd32202e1b3d1fd8b0eb821b0b6)
2022-10-17Report: fix elements.yamlTibor Frank1-0/+5
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I1b9db428b956140e27b89c083d9d0a8eb5577cd4 (cherry picked from commit 4651d2229deff770c438ef21f2ce32046a67d748)
2022-10-17Report: Add 3n-snrTibor Frank3-14/+444
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I9e72bae01997b145f058002e75dd2ace37c80b08 (cherry picked from commit be7cc1c166ee756981b9159e3deccecd74df453b)
2022-10-17Report: Add rc2 dataTibor Frank3-272/+94
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I426bb6c0a89d2e2e9728f8a0a499fa1c5c5d8ad5 (cherry picked from commit 3cdbc6f2183e4c5bc27dd47cb701cc1871896f14)
2022-10-13feat(trex): Bump T-Rex to v3.00pmikus2-2/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I9aa88fb094b03888fc30d84edc1deaa406075db4
2022-10-07fix(report): reorder and add ip4base ASTFVratko Polak1-76/+88
Each na44ed test using ASTF should be paired with its ip4base variant and graph looks better when the ip4base variant is first in the pair. Change-Id: I6f7ec18d8548e43730bd68414fbfd9950e245630 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit a8dfaf8fb174651832a9285b78460846cc1840b1)
2022-10-05fix(report): tweak order of soak tests in graphsVratko Polak1-2/+2
Avf and dpdk versions of the same suite look better together. Change-Id: I233b61ef2ea653e48591388cc419ff5b5ca0d42f Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 51082bb20827f38a814d9b98f171244d619ad0c8)
2022-10-04Report: Add rc1 soak testsTibor Frank1-4/+4
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I5ceb45ccf8efab64bd9609e66d53f6b5273a818d (cherry picked from commit 2f87683cf1e9feaac810a632aba78a9689d9224b)
2022-10-03fix(docs): Static contentpmikus1-1/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I29c2c108cec7badbe302095d5797d39c0d34ad58 (cherry picked from commit 14fe52e81c59a5a3558f4f587e56b75e388191dc)
2022-10-03fix(soak): reduce scale coeffVratko Polak1-1/+1
After some experiments using simulator (based on real measurment data), coeff value of 5 gives nice balance between exploration and precision. Change-Id: I6c416ed5bf3796b2e952ae4d17ab6e6bce5e1b5f Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 186e30a749b404210c49081d2b6d1edfc58ffe90)
2022-10-03fix(soak): scale also rarityVratko Polak1-2/+2
Without this, far-off samples are considered too important leading to wrong integration. This should fix the symptom of secondary stats being too different. Change-Id: I66496ac25da95eae1f83154f32eb56f941cb20ce Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit d772d5346cf1c4802bda63e4faf008222b6c0cf0)
2022-10-03Add 10k tunnels IPSec policy mode test suitesYulong Pei2-0/+32
Also add 10k tunnels IPSec policy mode test with spd fast path enabled. spd fast path is to reduce policy adding time, refer to patchset [1] & [2] for details. [1] https://gerrit.fd.io/r/c/vpp/+/36095 [2] https://gerrit.fd.io/r/c/vpp/+/36097 Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: yulong pei <yulong.pei@intel.com> Change-Id: I211b38a60d273c46e68a5b5f712090037977c6e6 (cherry picked from commit d65da6a72887238eae5dd3b7eb4e53055ef516c3)
2022-10-03feat(soak): add warmup and statsVratko Polak1-0/+24
Specifically on 2n-icx, soak tests are suffering from the first search trial (at half of max rate) reporting unsent packets, thus polluting the results, see CSIT-1867. This adds a plain trial (no stats, result ignored), fixing the issue. To keep the structure similar to NDRPDR tests, stats trial is done after the search, at the discovered critical rate. Ticket: CSIT-1867 Change-Id: I12ff6f58c4eb174594e667bfa86ba1585164b8ef Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 141f1d7e939ebe7ca73d4d27c554cdfd8fc3f86d)
2022-09-30Add VPP wireguard async mode test suiteYulong Pei4-4/+17
Add VPP wireguard async mode test suite to use QAT device for crypto. Also change keyword ipsechw to cryptohw in suite_setup.robot since currently crypto device is not only used by IPSec. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: Ibdadb3b09c04b7181415ffd4a248abddc6289075 (cherry picked from commit 7df86999bfaee9e5a0fa0c8ee6f5bc897343de9a)
2022-09-30Add wireguard multiple tunnels test suitesYulong Pei2-37/+59
Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I7abd546e67fdbe481b204bb6a1ec7e9c654dcdae (cherry picked from commit 73354f8561599422a955a7ba5283968910d633f5)
2022-09-30Report: Set cores for dpdk testsTibor Frank1-24/+24
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I1c0884c3250586e4540f096d1857f5f5bae1a300 (cherry picked from commit 88fd39d9e8fa45f973fc9cadfca1728dc8f6e336)
2022-09-30Report: Hide VSAPTibor Frank2-216/+216
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: If2ee46787b67a9318b0b10078fdfdef15bf1e3af (cherry picked from commit 41b3573793b35c0647af980d60a7e290a736a00d)
2022-09-30Report: Fix elements.yamlTibor Frank1-1/+1
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ic5070846c979b86225a53193c3fff6b9ec9b4e31 (cherry picked from commit fbc49bd833f8b07785d30fd5d889f40b84ea42bf)
2022-09-30Report: Add rc1 dataTibor Frank1-128/+122
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I17784165060e1b66e71a6bf557500228478e10b6 (cherry picked from commit ee8cdad033a8ffada066a27a412e12ba00ee61e5)
2022-09-29Report: Remove re-test from comp tables.Tibor Frank2-748/+1084
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ic78d569b0f9906ace2cc52a53ffc86dd7e494464 (cherry picked from commit 39af3a182b0a6e3bba2264add47d37b3c2889092)
2022-09-26fix(qemu): VM testspmikus1-0/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8374ac119dca0640188e6ad874769e5a6aafbff4 (cherry picked from commit 3f16ce1bbca46437c648d75f6a15d23dae0b8fc1)