aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-11-18Report: Add dataTibor Frank2-4/+4
Change-Id: I1dcddef704898cfa4ff9a84934fd11b8cf7b139a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1493f602debb12f1ba152b74c16d1a379a53e50f)
2021-11-16PAL: Add box points to all box graphsTibor Frank3-17/+28
- enabled only for aws throughput and soak Change-Id: I3c4266e35d98d8319ef1e5c365734338195a40d9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 92a8cc02adf1b8c152685c46a9f0d9413b518115)
2021-11-15Report: Add boxpoints to aws tput graphsTibor Frank2-13/+24
Change-Id: Idaeba305747863178a5eebc1d42f389a14d6084e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 84ec89bbb5e870ab72ddbab024eb6e87b909905d)
2021-11-15Report: Add dataTibor Frank4-7/+10
Change-Id: Ie384ab9db8f3ba909ec0b6eaf39a04c5c7f3157a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 40ece2a4354f2dcc4af2928ab45762ccc22625e7)
2021-11-12Report: Show min/avg/max latency for aws - fixesTibor Frank2-13/+11
Change-Id: I119fa64da4b178cb6a8abe63fb16e0bc7f18fd70 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7d84c1e92f454ceb2159fcc17dd4338028d41f4d)
2021-11-12Report: Show min/avg/max latency for awsTibor Frank2-10/+19
Change-Id: I4acbe6b20054881f95bf4bab03958ad2dab60629 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7b3cf8085cb05c8a327cecf6fd4cfb83430ee5e3)
2021-11-12PAL: Round report comparisons to 1 digit moreVratko Polak1-4/+4
Change-Id: Ifc2fdd04270628053646a6b3d8b15bc730325eb6 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit e21ca2707937c91f66af9c3309a426aa61be7502)
2021-11-12Report: Add dataTibor Frank7-50/+54
Change-Id: I2ee6005d499c4d93cca72cffd3373ced16d7c994 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 014efcd0b57f88e70eb4229d241f7e189656c115)
2021-11-11Report: Add dataTibor Frank1-1/+4
Change-Id: Ifea5d3b84dbc0df4d8365ed1c1b4dfdd4c49f140 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c966e5a64ff3bb428f4ccd5ce7accfa924b1025e)
2021-11-11Report: Add DPDK speedup graphsTibor Frank16-5/+969
Change-Id: I0c763ae0371515955037f0aaa867251b5aaec604 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2b6a9cd2d0171013619d11c64c86ecdbb84e1d32)
2021-11-11"fix(job_specs): Remove flow based tests"Peter Mikus1-23/+23
Reason for revert: Fixed Change-Id: Idbafdb953964967276f4f5748c78398a33635e2b Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 5c2e3308a3640b8de05249270ecd40173846e48c)
2021-11-11Report: Add 4t2c graphs for awsTibor Frank7-10/+366
Change-Id: I4fd625bc5139ebcb8430a4228986eafe39672532 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit de547dba45bf1154d2bdb23319383a83cafc1abd)
2021-11-10Report: Add stats tables, aws testsTibor Frank3-213/+273
Change-Id: I212b0e6e70008e15ced0167ab34e613cc0a1aea4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5390d5cedf42ecc0d589d79a0a9d1b346ebb5c11)
2021-11-10Report: Update known issuesVratko Polak1-26/+47
+ Remove MLRsearch comment, it happened a release before. + Separated known issues to fixed, old and new. + RCA section present, but empty yet. Change-Id: Ic713319017d6c2eb7ba2750de7c27de5237ee2c7 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit f0f6265a54cc65e27daf04329df209c303518f04)
2021-11-10PAL: Fix heatmap graphTibor Frank1-2/+1
Change-Id: I4992c8f4ae63aa25794cdab98532722c45263e8e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 80e8f662317324156f9997e788f7ed2ae46401f8)
2021-11-10Report: Fixes in dynamic contentTibor Frank25-851/+775
Change-Id: If90ba8c66427061341888dcfc946450efe66010b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 89eb19f67d91a4aa535fb95ece3f26381dddfc28)
2021-11-10report: update to vpp performance release notesMaciek Konstantynowicz1-44/+17
Change-Id: I170d14555b21e91d0ce1f11ea3f2911e8b01341c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 7e22de2de8ef461b56d2b76f99601aa63814173b)
2021-11-10Report: Add dataTibor Frank1-0/+8
Change-Id: Ib00909a62739e488ad809463c08cec14b4b96e91 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c5f202b8fa105fa8701fae26d04b808c7529e33a)
2021-11-09Report: Add dataTibor Frank2-4/+8
Change-Id: I21eedf3ecabe0672daaaf87819960cd986420fa0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c566bbd1d659ed022fea08f7bd38326661779c8c)
2021-11-09Report: 2n-icx: disable elements without dataTibor Frank1-272/+272
Change-Id: Id908e094129e6becd70a63667ebe61a6433db07e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b4bea99de7dce5f3fbfbdffdc29958f4d6dc5618)
2021-11-09Report: Add 2n-icx, part 2Tibor Frank64-706/+3821
- packet throughput - speedup - latency Change-Id: If871dcc1888e7a49ac2fd2ba8e3632a87fa035bc Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 814cbec925be525dc328374fee458d9207d3d5e3)
2021-11-09report: edits in aws methodology sectionMaciek Konstantynowicz4-119/+150
Edits include: - add description of used testbed topologies. - cleaned up references. - other editing nits. Change-Id: I43069541f3da8e844529a00a127fb1a360197647 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 531215332c4b4374a5cd7e1317de506f59a7683a)
2021-11-09Report: Hide aws latencyTibor Frank3-4/+4
- it is not measured Change-Id: I1c3d2f629d8ed07a208c37a20642b0e6b336242e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0ab2529c2725c1475845666d4d6ea53882d1eed1)
2021-11-09Report: Add dataTibor Frank1-0/+12
Change-Id: Iec138a93b18f02046d7c13b7243463048ff695ee Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c3fdcd39f617a8dffdd1be77ec9113759beeb008)
2021-11-08Report: Add aws latencyTibor Frank6-7/+71
Change-Id: I0780ddabce015cf1809ea178bf53ab9fc6e18f2d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 49aad5d3e989a49ed33b8a583306041a3c4802e6)
2021-11-08Report: Add 2n-icx, part 1Tibor Frank3-281/+279
Change-Id: Idf1e56231afa14648d7c3db661eb9a04ef7a5c85 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5efcddefdcdb47bb1d71a13a18188e539007cc3f)
2021-11-08Report: Remove tests removed by 34207Tibor Frank64-4639/+328
Change-Id: Ibe960b8dd4340c2c5b8a01fc490cab906dc330fd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4fd081896e3b2e344772184fbd00ae4a189ea875)
2021-11-08vpp_device: bind to vfio-pci before running testsJuraj Linkeš3-19/+111
In rare cases, binding the whole /dev/vfio folder will result in unusable VFs: notice dpdk EAL: Cannot open /dev/vfio/151: Device or resource busy [0], section 4.3.1. provides some clues as to what's going on and how to avoid the failure. Mounting /dev/vfio reset the file descriptors of all devices under /dev/vfio. Vfio-pci creates a device when an interface is bound to it. The rare failure then occurs when /dev/vfio is mounted while a process is using the file descriptors result in that process using invalid file descriptors (or file descriptors belonging to a different VF). Fix the issue by binding i40e and ice VFs to vfio-pci before containers are created and make sure that the VFs are not unbound later in testing. Only bind DUT VFs since the TG uses the kernel driver. [0]: https://connect.redhat.com/sites/default/files/2021-03/Cloud Native Network Function Requirements.pdf Ticket: CSIT-1794 Change-Id: I83db91b29d16669fb034b141ad247f6f796fdf64 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-08Report: Add dataTibor Frank3-14/+52
Change-Id: I76a36cb19d6c121b1d668d1ff8f71085baa2ed2e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 03e0de0418452c9904dafe74d86e36cf3c2a7289)
2021-11-05Report: Small edits in static content.Tibor Frank2-3/+9
Change-Id: I621e9818cb929c9558c38d41cb4804a19ed2a468 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9dd388775bc42b334223b3a98909e9ee0e663dc7)
2021-11-05Report: Add dataTibor Frank1-12/+31
Change-Id: Ia1709ebd3543ac4ee5fa63cefa6b18411c3c58f6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5a33af45b4618f62ebc8ae131e550481beee2d21)
2021-11-04Report: update tablesTibor Frank2-128/+134
- statistics - latency comparison Change-Id: I84069c26e07ced08bad92e19e6cdb0953cd24d3b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4bc35be955ed767b4c50bf5676e9919fb4110833)
2021-11-04Report: Add dataTibor Frank2-14/+27
Change-Id: I9fce2c74eb564a80b7b7002538376ec6aefaeac2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 902cea84c1688e998867f50f02f3e058e27467a0)
2021-11-03fix(Docs): Report section updatespmikus7-32/+23
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Icd04b75d320f067bd66402d5bb499070ee2768f3 (cherry picked from commit e6b2505e14723eaca82204f1f6ef25af4f3e77e7)
2021-11-03Report: Add rls dataTibor Frank6-350/+390
Change-Id: I7868b419fa47c6130826948bbdfbb288abb8d1e4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c4ef85bfbdcf2c73919d8d23a409f02edacf9973)
2021-11-03job_specs: add ipsec 40 tunnel sw tests for 3n-skx testbedsMaciek Konstantynowicz2-2/+44
Change-Id: I4bb79bf34f64b1096be9e81586d718dbe283b3cd Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 8cbfb75d12b87fee16955e0937ea8127e5e1f996)
2021-11-03Re-adressing ipsec int tests to fit deployment in AWSMaros Mullner91-385/+385
Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech> Change-Id: I83b00d56a50d98c36547621cb2f41cb3b2f35741 (cherry picked from commit 41bf12b9700f5fe8d7d1ccdd042705f33b19b064)
2021-11-03perf: remove depracted ipsec scale reconf test suitesMaciek Konstantynowicz30-5075/+0
Remaining ipsec reconf test suites for 40 tunnels include: - int-aes128cbc-hmac512sha - int-aes256gcm Change-Id: I9c5f549368595bb0cbd0d7e9918b7695184d31c4 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 4b567a7fe17895812e1d4ac8327f08b8a1653bbb)
2021-11-03fix(Tests): Hoststack driverspmikus4-8/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If98f575503a59106fe8b94d5c683881412ea4f1c (cherry picked from commit f83793575f4d9ac462a70eb505b55463dab849df)
2021-11-02crypto: remove deprecated ipsec scale perf test suitesMaciek Konstantynowicz146-23984/+0
Remove following test suites: - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: Ib4915213f6c440c70f9b17cbaac834245e51bd85 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 282240ecada68e8a6811996057cfdae222fe1be2)
2021-11-02fix(autogen): VSAP testcase namingpmikus1-0/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ic6d440ffdf7e27c9e6ce65605178163652758f77 (cherry picked from commit 79f23ad3f92341040762a9b0018557e03b306200)
2021-10-28fix(Autogen): VSAP driver combinationspmikus2-41/+47
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ieac8cd32009bebbd1a3324a81becfbf3abb814ab (cherry picked from commit 585b9d8bbf21b0c5a2d2c28809688563007760db)
2021-10-28Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: Ie6eb285f2047c646953dfd20b87654ddf5d54ee7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-27job_specs: remove nat44ed udp and tcp scale 16m session testsMaciek Konstantynowicz4-116/+20
Tests removed from 2n-clx and 2n-skx testbeds for mrr_daily and mlr_weekly performance jobs. Tests are failing due to slower session setup rate and very long ramp up time, too long to be accommodated by CSIT resources. Change-Id: Idac6920d971256553c7c843056c410bf9393b4a3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit a67bec3e62cb239daa3a3991837b5495623fef77)
2021-10-27fix(docs): AWS job specspmikus6-13/+58
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I34b1475f0cabe8a6d9f260c77d5a3b10f7ead61c (cherry picked from commit 029bd28947704ab76983f48afec5646621a2b0fe)
2021-10-27Report: Add dataTibor Frank7-21/+13
Change-Id: I51e809322d652e1f410c5674883bdd86e730af41 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d4bcfe35de5e9d1f99f8f56d958dc00d615e1a3f)
2021-10-27feat(Docs): Add AWS methodologypmikus6-53/+290
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I766c1b8ce85e174946503a3d65f8239d8fec1bcd (cherry picked from commit 6899ba7eda3cbc707c1391affa6c8c2e57f1ba61)
2021-10-27docs: TRex static documentationViliam Luc9-36/+169
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I41233f7044574505f32f7425fd897bb3176ac839 (cherry picked from commit 23fa2a8925d65759bb14177b997b22f8a418e9ef)
2021-10-27fix(Infra): Move TB24 back into poolpmikus1-0/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I75e18f898369b8426f465649d7ea2f5996b73881 (cherry picked from commit a3e84f61ed43d570f75eeb36c9cc207a85ee82a2)
2021-10-26feat(Docs): DPDK release notespmikus1-5/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I3ffdf90227ab95a34a31c4e118350782f6bd1dea (cherry picked from commit 752abf48ea1c4b9c06b0bd11fec1cd5aafb5547c)