aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/python
AgeCommit message (Collapse)AuthorFilesLines
2023-06-07feat(jumpavg): support small values via unit paramVratko Polak7-46/+88
Previously, Jumpavg was known to give wrong results when the data contains values of order one or smaller. This change introduces a new "unit" parameter, which changes how the information content is calculated. For example if the data values are mutiplies of 0.01, the unit parameter should be set to 0.01 to compensate. For callers not knowing their correct unit value, another parameter is introduced, called "sbps" (meaning Significant Bits Per Sample). A binary integer number with this many ones is how much units should the maximal sample be. This way jumpavg computes the corresponding "unit" value to use. If neither "unit" nor "sbps" are given, the "sbps" value of 12 is applied. + Rename files to conform to snake_style naming. + Fix normalization for the "opposite triangle" distribution. + Simplify logic, all groups now start as "normal", not "unknown". + Minor style improvements as suggested by pylint. + From user perspective, this change should be backward compatible. - The normalization fix is a behavior change, but it is a bugfix and the new behavior should be better. Change-Id: I5a5ca11757f087fff13faf1d0b8e34a741400258 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-06-02fix(dpdk): CX7 supportoper-230605pmikus1-2/+6
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ib98b25bd3c98b5e6dbcb1bfe8478bd41bf37d71c
2023-06-01fix(core): Comparison hashpmikus1-1/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I84b46e6a792d72cb56a9a42d40db8cc13866b836
2023-05-26feat(core): T-Rex 3.03pmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I58607f50e2889092e40ff831ed4f1515444e29f8
2023-05-25fix(core): Trex typopmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4924054b414dc450df14a02a29081549c8620787
2023-05-25fix(core): dual_socket supportpmikus1-3/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I881dda8b2fec32b8f489ec97df6592937f6193fa
2023-05-25fix(TrafficGenerator): correct tg_topology reverseVratko Polak1-1/+1
Change-Id: Ibef272705ea889d58bb9c5b69a8566f6e38de1d1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-05-24feat(reassembly): add few suites for ip reassemblyVratko Polak2-3/+10
In tunneling scenarios, VPP needs to reassembly packet fragments before decapsulation. Conveniently, VPP also fragments the packets after encapsulation (at least for some encapsulation protocols) if they do not fit into MTU. So this change adds few suites, adapted from existing 3-node ones which additionally lower MTU on DUT1-DUT2 link. The intended packet size is 1518B. 64B packets will fit, and most of IMIX packets will also fit without fragmentation. VPP refuses to reassembly 9000B packets as they have too many fragments. + Add a keyword so suites need only one additional line of code. + Add new test tag REASSEMBLY for the added suites. + Tell autogen the one soak test case for reaseembly should be 1518B. - It is possible to increase fragment limit for 9000B, not done yet. - Ipsec policy suites are added but they should not be used. - VPP does fragmentation twice (before and after encapsulation). - VPP does not perform reassembly (only last fragment is decrypted). - TRex does not realize the packet from VPP is only a fragment. - The result is false pass with unfairly good performance. + Suites still included, to simplify verifying VPP fixes for the above. Change-Id: If33c60d767fea161d9e4ffabb8ded3d81c8f39ed Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-05-24refactor(trex): Startup configurationpmikus3-111/+312
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I16defefa5edd01638bc382be4f5e8cbca4fe9453
2023-05-23fix(docs): Minor tweakspmikus1-1/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I1537f3383d44ace8e705e5c744713d0863ca67d0
2023-05-22feat(interface): apply MTU for dpdk plugin ifacesVratko Polak1-14/+10
When changing MTU on a running VPP, the interface has to be down. - Other plugins (rdma, avf, af_xdp) need vastly different logic, so support for them will be added later. + Mlx5-core does not need to set MTU on Linux interface. + MTU setting now does not happen at final setting path up, it happens in driver initialization layer instead E.g. AVF tests will not attempt to change MTU. + MTU edit removed from some non-hardware interfaces (including memif) e.g. bond interfaces. MTU on parent hw interface seems to be enough. + The non-jumbo MTU value used is 1800, so 1518B tests with additional encapsulation can still work. + When VPP MTU setting fails, the failure is now propagated. Previously, the failure was just logged and ignored, but now there is no reason to hide it. Ticket: CSIT-1797 Change-Id: I3b853f1faf90001d544cbbb87b2affbb882ffba0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-05-16fix(core): AVF unbindpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ifa3964f290d75ebae094d1d46ce27b5d133c2158
2023-05-15fix(core): Container entropypmikus1-5/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I45760143ae0ccb0cc0edf0931ad47f5cf48ec968
2023-05-12fix(qemu): increase vm boot timeJuraj Linkeš1-2/+2
On 3n-tsh testbed, the vm sometimes times out when booting. Increasing the timeout is harmless since it doesn't affect perfomance. JIRA: CSIT-1877 Change-Id: I45eebdfba2fcd7c9a0be083ebb3515d37724e965 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-05-10feat(infra): Remove system.d dependencypmikus3-63/+90
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Icb7b6124dcba7bb57c18ceb91120284f6fe02c2e
2023-05-05fix(core): Docker detectionpmikus1-7/+11
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I976f96410b06b4f4d7500b03b1f5dd54486bbf42
2023-05-05fix(core): Unbind only when neededpmikus1-3/+11
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I7b7b8744fac6669a696253acb94e7a5d713fdb5b
2023-05-05fix(core): Add vpp log pathpmikus1-0/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I76e47610a0caa8af8e48a295ce08e799280404be
2023-05-05fix(core): Move log files to defaultpmikus1-5/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie88729cbd3916372cdbf5769974654edf066d5d7
2023-05-05feat(core): Remove some dead codepmikus1-29/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: If90e443a2d60459c6cbc6a85ba619e72242318a5
2023-05-05fix(core): Code stylingpmikus1-16/+20
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I76907c214cfae76c3d101ebd14813fd3a77504f8
2023-05-05fix(core): vppctl pathpmikus1-2/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia6778b0c49906a686427b9c1ca7f5658e8993e63
2023-04-20Add 100k tunnels ipsec policy mode with fastpath enabled test suiteYulong Pei2-25/+57
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I3708253adf4c7421ff48eee6aefb735b39726359
2023-04-19fix(core): wrong to unbind driver if pci device in unbinded driver stateYulong Pei1-2/+4
Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I7515bf952f8b6dbae180726da6a8bd4821c7af26
2023-04-18fix(api): bump messages to 23.02 usageVratko Polak3-7/+9
New features are generally not used in CSIT, but some edits in code are needed to continue using defaults. 3 messages have newer versions: * bridge_domain_add_del_v2 * ipsec_spd_entry_add_del_v2 * lb_add_del_vip_v2 Change-Id: Ibcc089ccbf933c019b5e7188c06ef229e68d39a8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-04-03Enable IPsec policy fast path inboundYulong Pei1-0/+18
This will greatly improve the performance of IPsec policy cases Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ib42b5650791be7fcc8649873eaf12616aeba5aec
2023-04-03remove dpdk_nic_bind.py dependencyYulong Pei2-27/+22
dpdk_nic_bind.py from <trex>/scripts/ is out of date, often bumped into errors when using it to bind nic port, e.g. /usr/bin/python3 dpdk_nic_bind.py --bind=vfio-pci 0000:ca:00.0 /opt/trex-core-3.00/scripts/dpdk_nic_bind.py:40: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives   from distutils.util import strtobool Error: bind failed for 0000:ca:00.0 - Cannot bind to driver vfio-pci so remove dpdk_nic_bind.py dependency in csit. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I5a3f641cd77d339aa7a213f410ce2efe7c322b8a Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2023-03-28feat(core): Add 2n-spr topologypmikus1-0/+6
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I3f7efcbfc82f683e7afc986d00fa71ae7413d93d
2023-03-13feat(model): Move schema to resourcespmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I905921cc93436c0e0f1c22dfbdc2af62f4b04ac0
2023-02-24Fix: detaches the attached XDP/BPF program before af_xdp test runYulong Pei1-0/+15
When call create af_xdp interface api, it will load default xdp program (xsk_def_prog.o) on the NIC interface, the program will be unloaded when call delete af_xdp interface api, but current csit config did not call delete api for af_xdp test cases, that will cause af_xdp test case fails to run on Intel E810 NIC when the interface already have xdp program attached, so this patch is to fix this issue by to detach any attached XDP/BPF program on the interface before af_xdp test case run. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I1a557b4c4a7e88c5715cec771a001df29ac4ae6f Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2023-02-20feat(telemetry): Data compresspmikus2-1/+8
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I652844e722e24cb49f09a3f30aabe3103e271079
2023-02-13Fix issue in csit hoststack testYulong Pei1-27/+10
1. ABTool.py, fix error in parsing the return result of ab 2. DUTSetup.py, add sleep to wait for the program to start Signed-off-by: Peng Lu <pengx.lu@intel.com> Signed-off-by: Xinfeng Zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I1cffa28d8492bcc27ae188f1e084b80afad60502
2023-02-02fix(perf/hoststack/quic): enable plugin_crypto_openssl.soDave Wallace1-2/+2
- convert hoststack tests to use app-api-socket instead of vpp-api-socket Change-Id: Ibcd87f3624e33168ed3afcb30267262efc927e7c Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2023-02-01fix(model): Merge vsap into hoststackpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I2b1aa0240e611f3f7d2b516583a6ea3e36091821
2023-01-24Tune host stack performance testsFilip Tehlar2-10/+81
* remove evt_qs_memfd_seg and evt_qs_seg_size as they are obsolete * use app socket api instead of vpp's api * apply rx and tx descriptors constraints * increase event queue size for nginx tests Signed-off-by: Filip Tehlar <ftehlar@cisco.com> Change-Id: Ie7ac12b8f587e0b1962884127e8eb68a4e588aee Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2023-01-19Add 40k tunnels ipsec policy mode with fastpath enabled test suiteYulong Pei1-4/+8
In order to compare performance number with existed routing based ipip interface mode 40k tunnels ipsec test. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I94816a8c18f08b539114d6ca9d4e1218a2b6ea5f
2023-01-18fix(core): Handle hoststack exceptionspmikus1-3/+6
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I28295ee6e64ab9674449a98e8d036b39d3d538bf
2023-01-17feat(model): Simplify logicpmikus4-28/+16
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I461899d72e92e5c5db9f64261206ec0e6704e0c8
2023-01-16feat(papi): wipe remains of VATVratko Polak5-643/+10
- Some older documentation files are not updated yet. Change-Id: If1717e12308f0e2e76c10024e6eebe68ddeddc9f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-01-16feat(papi): switch TestConfig from vat to async PAPIVratko Polak1-114/+1
Change-Id: I5b3ee68c8155e62ca6c68e84132d78af0615ee4d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-01-16feat(papi): switch ipsec from vat to async papiVratko Polak2-347/+84
+ Move papi_exec resource out of for loops. Change-Id: I39d75ad2552986f82f7e2c8e3aae2fbc07f042e0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-01-16feat(papi): switch ip from vat to async papiVratko Polak1-47/+0
Change-Id: I3ecad09d2659124a6c07d642a453845ed1779258 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-01-16feat(papi): add async mode, use it in scale callsVratko Polak7-174/+418
+ Introduce two explicit handling modes to save memory in scale test. + Connect in async mode for both handling modes (to avoid reconnects). + Support both pre- and post-37758 VPP PAPI async behavior. + Use control-ping in dumps to emulate sync mode. + Do not use it for single reply to avoid VPP-2033. + Fix call sites to get their replies with correct handling mode. + Drain enqueued replies to avoid subsequent errors. + Retry if read returns None too early. + Update docstrings. - Complexity issues reported by pylint postponed, needs larger refactor. - Explicit replace of VAT is done in subsequent changes. Ticket: CSIT-1547 CSIT-1671 Change-Id: I3c63fa5c578975cc4dd7fce0babe3ab04ec15ed3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-01-16style(papi): reformat code before real changesVratko Polak1-111/+144
Used black (with line length overridden to 80). Also manually removed u from inside f strigs. Change-Id: I5be354e744a697ac68f781b08159de6d1fbdc07e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-01-12feat(core): Add mlx5_core driver testspmikus1-2/+6
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I23f2ab678e6666a1423620fa373261d822030bc8
2023-01-11feat(model): Hoststack typepmikus3-63/+122
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia7eefc28645c78ad346d294099ef6258faa9814f
2022-12-15feat(core): DNV decommissionpmikus1-7/+0
- Static content will be removed separately Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I0992e941e1c24552837eaf7e8d3f6564b3cb21c8
2022-12-12fix(core): Telemetry oloadpmikus1-8/+8
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I1c13afd8cb377c76d65f7099b9652b96613ad087
2022-12-09feat(model): Reconf typepmikus2-5/+40
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ibfab25ee82eaa207987f4070cf2386ea9d0781cd
2022-12-06feat(telemetry): Add telemetry exportpmikus2-91/+56
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ibb8a59fd4e08bc736494c7ab18e689a55f7a98dc