aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/python
AgeCommit message (Collapse)AuthorFilesLines
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak2-74/+165
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ff820e3d53434889aacde2373314c3be8d00f765)
2019-08-23Improve PLRsearch yet againVratko Polak5-50/+166
Logic improvements for rls1908 and post-pylint fixes: + Reduce search time to 30 minutes. + Use average instead alternating loads. + Rework log/exp avg/stdev from two estimates. + Introduce and use pessimistic variance of dual trackers. + Introduce safe_exp to use when None does not skip code. + Use dot relative imports (instead of disabling pylint). + Complete docstrings for simpler functions. + Append docstrings to named tuples. + Somewhat unify docstrings related to the same arguments. + Slightly improve intentation. + State named tuples as rtype where used. + Add returns and rtype to __repr__ where missing. + Return what docstring say (or update them). + Explicit copying for vector and matrix values. Change-Id: I884c68b4839c5df5e8bef95e463666599603a0ff Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit fbbc47359e3f7b59bbd5a84d85c673374933a50a)
2019-08-23Framework: Refactor complex functions in PLRSearchMiroslav Los2-49/+68
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech> Change-Id: Ie2f19a2e3b37e8d85656ab31ece59b89c76bea25 (cherry picked from commit 281b230ba982f9f6ad589fb6e44f121a6a46531f)
2019-08-21Autogen: Create NICs for TCP suites.Vratko Polak4-257/+281
+ Put Regenerator internal functions ourside class. + Duplicate into _default_ and _tcp_ functions. + Rework Testcase to be a single class with two factories. + Improve suite and testcase naming. Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ae7dc0011f376861ba9259b7cb5166777520799c)
2019-08-19Write DPDK version to logTibor Frank1-1/+1
Change-Id: Ia9ec0d420c8db9e71234f74e4013c21d039931b2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f893de60bb36c3e241a992cb389697997a1cd0f2)
2019-08-14FIX: Remove eth_avf and portX_vifY interfaces from topo in TC/TS tear downJan Gelety2-4/+33
Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-15Add testbed info to output_info.xmlTibor Frank1-2/+3
Change-Id: I2ff45926a754647c1be6263cf8e5e0c7cbfedfef Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 16226fd221af3345c02de6d685c90ee6bf7cf9f9)
2019-08-15VAT-to-PAPI: Fix HTTP/TCP testsDave Wallace2-27/+37
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit 6da7266754c28754c04cf37d1974e39766a261f6)
2019-08-13PAL: Get DPDK VersionTibor Frank1-8/+12
- Needed for trending Change-Id: I3d576e39d6e3b91821050fbd4a8a95380275797b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9e1bb28404a23f6d4c62fb945a3ee6dba42f1c47)
2019-08-13Add testbed info to output_info.xmlTibor Frank1-1/+3
- Needed for trending Change-Id: I59fc115ce62d1ad839e7c8a39c74af0497b9012d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5dea7e63a012cdbf4fba60e4fdcb5c6acce2fca4)
2019-08-09FIX: macip_acl_rule needs binary mac dataJan Gelety1-2/+2
Change-Id: I0d26b2b31f0ce7497c91b4ae965f9cc45a66ef0c Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 5b28bc8c52a5f7ef72f03d03806f61ba45ecc623)
2019-08-07FIX: PylintPeter Mikus5-80/+71
- my bad Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8c1f57f6b648b99338f3f6a6ff9ec943082e9bc4
2019-08-07FIX: IPsecUtil - create IP object separately in ever iterationJan Gelety1-33/+24
- if we are trying to update ip field of already existing IP object in more iterations of e.g. ip_route_add_del the PapiExecutor uses value from last iteration for all iterations so it ends up in creation of ip route only for one IP not for all required IPs Change-Id: I5ffa622e2a06d0c5c71720d2cf743a4c2104ab79 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-07FIX: Remove PAPI_MAX_API_BULKJan Gelety3-11/+0
- it's not needed anymore as PapiSocketExecutor is used Change-Id: Ia9fad1d18991821d14e9261d27f7f26fca03c14a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-07CSIT-1473: Migrate Tap library from VAT to PAPIJan Gelety2-250/+170
Change-Id: Ibf4a4839c2e8b799b03eebd9dffae891d8f00dd4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-06Add: Dot1Q + L2BD + GBPPeter Mikus4-7/+372
Change-Id: I0050f715011ecfa92b3ee88b301809a56abb7946 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-08-06Change show hardware detail to show hardware verbosejuraj.linkes1-4/+4
After https://gerrit.fd.io/r/#/c/vpp/+/21071/, show hardware verbose doesn't output slowly processed module info which is not needed for debugging purposes. Change-Id: I2f91a0ce1bfc082b46f2fe43df968750bcd1cf3a Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-06VPPD: Dot1QPeter Mikus1-0/+28
Change-Id: I0d3c925ea4a6896a0df98db6ddaf4238e6291bf1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-08-06PapiHistory: Use repr strings for argument valuesVratko Polak1-1/+3
Composite arguments frequently do not have valid __str__ method so the values were not visible. Change-Id: If302934cb227f212580bb2f5c277a755ace51bcf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-05Fix CRCs, bump stable VPP versionVratko Polak1-183/+50
+ Migrate the data to a separate yaml file. + Improve some argument names. + Unify handling of unicode (to always utf-8 encode to str). Change-Id: Id0622b24202be796c1cd33ad52c3b8dca81cff50 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-02FIX: Disable API checker during runtimePeter Mikus1-3/+0
Change-Id: Id530710aaedc30472d8bcd33d24b7fbcaa7c011b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-08-01Disable CRC checking at runtimeVratko Polak1-2/+3
Temporarily, will be re-enabled once VPP and CSIT are in sync again. Change-Id: I0d3bb5b70ea04155972093102a26a81f86119c37 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-31Add VPP API CRC checkingVratko Polak2-1/+457
+ Include both checking at runtime and standalone static quick check. + Runtime checking does not look for missing messages, as messages belonging to disabled plugins are not visible. + Standalone check script has nice loud output. Change-Id: I1dfc3846d1bcdad0b09017d4ce8edd5028e17e0c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-29Fix logic error in AVF compatibility checkVratko Polak1-3/+4
Change-Id: I7f1b47725648c8c26e21f42c305395ad620beea6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-26Add: AVF into trace groupPeter Mikus1-1/+2
Change-Id: I3399d5fb2754eb67734e8f76a5743283fe9c074c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-26Change: AVF can run also on i40evfPeter Mikus1-2/+2
Change-Id: I375b7c9f8fe81428cb16fea35128bddec089da1b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-26FIX: IPsec UtilPeter Mikus1-25/+4
Because: >>> for i in xrange(4): ... if i > 0 and i % 250 / 3 == 0: ... i ... 1 2 Change-Id: Ia4eba227ea1e4c6222f32ac598f254428d95adc9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-25VAT-to-PAPI: LISPSetupAndrej Marcinek1-135/+268
Removed CRUD parts from tests Change-Id: Iaca36e62be5144ea3f2831457113959b65489db8 Signed-off-by: Andrej Marcinek <andrej.marcinek@pantheon.tech>
2019-07-24NF_density dot1qip4udpvxlanPeter Mikus2-6/+34
+ NF_density compatible + Baseline VM tests compatible + Scalability NxM - 3n variant is missing in VXLAN and DOT1Q due to requests to have it asymmetrical - TODO Change-Id: Ia817d7be00622b594b451bc07756240d1a379e04 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-24Fix arm sut docker image namejuraj.linkes1-1/+1
Change-Id: I548b176baeec39362b9c0a4e02a664d1e95574a3 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-23Add scale ipsec tunnel tests 40K, 60KPeter Mikus2-10/+17
Change-Id: Iecfd7e69a72c8d5893a703fa93439cde0a3edf5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-23FIX: Vhost optimizationPeter Mikus2-7/+4
- Testpmd 9000B - Disable fsck - Remove redundant init mounts Change-Id: Ia063520d0a206e9eee831a5cc692e32baf5a92c8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-233n-tsh timeout, testbed tags and ansible updatejuraj.linkes1-1/+1
* disable AVF tests which don't work with x520 * increase VPPApiClient timeout to 14s, as x520 show hardware is slower on Taishan * re-enable vhost and memif tests * remove tx2 mrr daily tag list; no tx2 is used for perf testing * remove taishan workaround * add scipy arm prerequisites and scipy workaround * rework inventories/lf_inventory/hosts; move cpu_microarchitecture to host files Change-Id: I5f10bd07b8146ac3b8be8c54fbb4d924a9373813 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-23Add support for aarch64 container imagesjuraj.linkes2-3/+13
Change-Id: I84f13d7139a6e5f7004426018c2d27425c5fa97e Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-19CSIT-1471: Migrate Dhcp library from VAT to PAPIJan Gelety1-4/+9
Change-Id: Ibc9b9b736532cce31994537e632daa4d4e62459c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-19VAT API to PAPI CONVERSIONpremkumarv1-13/+39
Change-Id: I9c87cdfb99780f398da5cd90351b303caa89bda9 Signed-off-by: premkumarv <preym17@gmail.com>
2019-07-19CSIT-1469: Migrate SRv6 library from VAT to PAPIJan Gelety1-158/+293
Change-Id: Ibbec3d1bbda2af9fcab3230fd1747406a89f0cc5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-19Remove un-interested VIRL tests and related resourcesJan Gelety3-393/+1
Change-Id: I712f5dc238fdf480c7c35250148c12d03ed96d74 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-18Papi socket: except more errors to insert err_msgVratko Polak1-10/+14
Change-Id: Ided91ee2b47dafb6aad83091126294d79f67aeac Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-18VAT-to-PAPI: LISPUtilAndrej Marcinek1-46/+161
Change-Id: I57328dbc33eaf62935a1a14e23f57ebab21c24f5 Signed-off-by: Andrej Marcinek <andrej.marcinek@pantheon.tech>
2019-07-11CSIT-1469: Migrate IPsecUtil library from VAT to PAPIJan Gelety3-349/+794
Change-Id: Iac790bf5755a70697e4c4eff32242b04f8e7f789 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak24-388/+688
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-17Refactor VPP Device VM vhost testsjuraj.linkes3-36/+58
* replace the current VM image with kernel img * rework keyword usage to make it consistent with performance tests * remove resources/libraries/robot/shared/qemu.robot as it's not used anywhere anymore Change-Id: Ia5bc19e9e6ed9af031e4d9b5c0c89431fb49fd33 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-12PapiExecutor always verifiesVratko Polak19-763/+455
Do not support returning unverified replies anymore. Basically, ".get_replies().verify_replies()" is now just ".get_replies()". This allows fairly large simplifications both at call sites and in PapiExecutor.py + Rename get_dumps to get_details. + Introduce get_reply and get_sw_if_index. + Rename variables holding get_*() value, + e.g. get_stats() value is stored to variable named "stats". + Rename "item" of subsequent loop to hint the type instead. + Rename "details" function argument to "verbose". + Process reply details in place, instead of building new list. - Except hybrid blocks which can return both list or single item. - Except human readable text building blocks. + Rename most similar names to sw_if_index. - Except "vpp_sw_index" and some function names. + Use single run_cli_cmd from PapiExecutor. + Do not chain methods over multiple lines. + Small space gain is not worth readability loss. + Include minor code and docstrings improvement. + Add some TODOs. Change-Id: Ib2110a3d2101a74d5837baab3a58dc46aafc6ce3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-11CSIT-1477: add 1n_tx2 VPP Devicejuraj.linkes2-1/+5
- add 1n_tx2 testbed - update VF reservation to meet 1n_tx2 testbed needs - update ansible with 1n_tx2 Change-Id: Ia075a913d4859f537fd0e6bff731ea88aff01dd9 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-10Fix few pylint violationsVratko Polak3-10/+8
+ Stop attempting to check test/ as module inits are not there. Change-Id: Ia4e498061be3e3118b07e98c9c2f761f2454653e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-10Tolerate failures when setting MTUVratko Polak1-3/+8
Because some NICs are known to not allow jumbo frames. Change-Id: I45fe636e3a880c6640922468c170f50e85dd2ba2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-10FIX: use correct slicing of classify mask/match stringJan Gelety1-28/+75
Change-Id: I11cc8ddc6925b44a596aa03d71318efd76232d6d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-09Add scale ipsec tunnel tests 20KPeter Mikus1-15/+28
Change-Id: Ib52e1735b6b82ea9fea44c06c379f117068e94c1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-09CSIT-1539 Aligning FUNC/PERF keywords - Phase IIIPeter Mikus2-0/+3
Change-Id: Ibd3e99390bf004173d3d126946b95ffe9ba8f196 Signed-off-by: Peter Mikus <pmikus@cisco.com>