aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/python
AgeCommit message (Collapse)AuthorFilesLines
2018-08-24add the expected prompt for ubuntu root userYulong Pei2-3/+3
if ssh use root account to login ubuntu os, its prompt is ":~# ", so add it to let csit test can run with root account. Change-Id: I21f5380245324c8e48099433e3d374188e9001d9 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-08-22CSIT-1222: Do two doublings in external MLRsearchVratko Polak6-20/+70
Make number of doublings configurable, keep Python default at 1, set Robot default to 2. Also make docstring types unique (pylint was complaining about classes and modules having the same name). Increase MLRsearch version to 0.2.0. Change-Id: Ib846032e79ff52994503c0cfef2f86655502c275 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-20Refactor VHOST codePeter Mikus4-296/+410
CSIT-1164 Create VM vhost tests for 2-node topology CSIT-1173 Implement VM vhost KWs for 2-node topology - Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue, ring size, qemu version detection) - Cleanup VHOST KWs perf (Unify running QEMU on N-node topology) - Add ability to configure Queues, Hyperthreading, automatically compute number of CPU for VM/Testpmd and RXQ for Testpmd workload. - Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node - Create IPv4 2-node KW Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-10CSIT-1156 Create container memif tests for 2-node topologyPeter Mikus1-1/+4
CSIT-1155 Implement container memif KWs for 2-node topology Change-Id: I4fc7bcab499a0b8a8594114d3f331b0d9610bf9d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-10CSIT-1193 De-duplicate bootstrap scripts into onePeter Mikus2-4/+7
- DPDK and VPP bootstrap merged into one (ligato will follow). - Added more error detections - Added topo-cleanup.py to cleanup TB before and after test. - Remove installation of VPP Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-31FIX: Revert l3fwd patchingPeter Mikus1-1/+0
For now this solution does not work on Haswells, need to find permanent fix. Change-Id: Id5323a078db3a8f14c009d6f66ee393c89d851ef Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 5f634b8c486f7a404c9cd33b60cc92a6907e7c64)
2018-07-27FIX: Interface up handlingPeter Mikus2-7/+15
- Increase timeout when trying to check interface (this is useful if there are multiple interfaces and dump command take more than TIMEOUT/NR_IF which is happening quite often). - Reverse the order of applying MTU and interface UP to try to prevent API overload during interface initialization phase. Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 584345da4f7330f7517e5defd894b4995c2b57b0)
2018-07-26CSIT-1065 High failure rate with K8s/Ligato orchestrationPeter Mikus1-12/+24
- Update Ligato Bootstrap for latest changes - Update Ligato Test cases for latest vpp-agent changes - Convert TC to new format - Add Hyperthreading support Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-25Add MTU handling into perf testsPeter Mikus2-8/+57
- Add ability to configure MTU on interfaces. Put the MTU into configuration keywors for all perf testcases. Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-24CSIT-1097: Migrate L2 to NDRPDR and edit MRRVratko Polak2-11/+13
Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24initial CSIT-DMM test scriptssharath reddy4-0/+341
Change-Id: I77a965751010b85d21335932baa5345a095dc4f3 Signed-off-by: sharath reddy <sharathkumarboyanapally@gmail.com> Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-07-24CSIT-1097: Migrate Vts suite to NDRPDRVratko Polak2-4/+10
Change-Id: Iaac913bb4b15d743a2e9d565e25d31c089cee3e8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Migrate ip4 to NDRPDR and edit MRRVratko Polak1-4/+10
Change-Id: I9e3b2973c14f818247658a2ae34456c9fc2bae4e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-19FIX: Increase timeout for VAT for longer API calls.Peter Mikus1-1/+1
Change-Id: Idab5e8d62a42513ddef97025625962b510c3a625 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-18CSIT-1097: Ip6 NDRPDR and edited MRR suitesVratko Polak1-1/+8
Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1201 Create L2patch perf testsPeter Mikus1-0/+30
- XL710, XXV710, X710 - 2n, 3n - all pkt.size groups - ndrpdr, mrr Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add srv6 NDRPDR suitesVratko Polak6-1/+246
Delete the corresponding ndrpdrdisc suites. MRR suites are also edited, to make them less different from NDRPDR suites. Now, there is a script to re-generate testcases of selected suites. For that, resources/libraries/python/autogen is created, with Regenerator holding the most of script logic. The script looks at files matching a glob expression, reuses a "prolog", but overwites test cases with the default template and hardcoded set of testcase arguments. Also, handling of overhead size has been simplified, using new keyword Get Max Rate And Jumbo And Handle Multi Seg. Default value for search timeout is increased to 12 minutes to make timeout failures less frequent. Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-17Refactor DPDK testcases to new structurePeter Mikus2-6/+36
+ RXQ refactor Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-16Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710Peter Mikus1-0/+9
- CSIT-1161 Add 2-node L2XC tests - CSIT-1160 Add 2-node L2BD tests - CSIT-1157 Add 2-node IP4 tests - CSIT-1153 Add 2-node IP6 KW - CSIT-1158 Add 2-node IP6 tests Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Add stats segment heapsize to default configPeter Mikus1-0/+9
- Scale tests (ip4, ip6) are failing due to low amount of stats segment heapsize. Change-Id: Id9b3e84d5a5c63014c17041c08c00ef6188afa5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12CSIT-1186: Consume MLRsearch in agreed upon wayVratko Polak8-3/+3
+ Rename search to MLRsearch in resources/libraries/python/. + Make PyPI/MLRsearch/MLRsearch a symlink to the renamed directory. + TrafficGenerator.py to import from the renamed directory/module. - No change to MLRsearch code. - Version stays at 0.1.1 to point to the latest released code. Change-Id: I4a38b0b7f8f083fbb1a93b25522560144b4ef556 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-09CSIT-1142 2-node topology - keywordsPeter Mikus1-1/+1
- Clean up of 2-node setup KWs Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-03CSIT-1046 Make uio driver configurable from topofilesPeter Mikus2-16/+33
Currently we are configuring uio_driver from global variable. This may not be suitable for various topologies where we need different driver per TB. This patch is suppose to put uio_driver into topology files. Change-Id: I56af0697e8b2359ccb126151217976408720c1ba Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-02Compatibility fixes with Ubuntu 18.04Peter Mikus3-10/+26
Currently we are using ip:port socket to for VPP to listen for incoming connections. There is only one place in code this socket is used for detection if VPP is responding after restart. This patch is supposed to change ip:port to sock:file which is default preffered way in VPP. This way we can start using vppctl. netcat on the other side with ip:port remains hanged in console for infinite time not returning back. There is also need to check whether uio_module is loaded and eventually load it. As uio_pci_generic is not working there, we will fallback to main igb_uio (uio_pci_generic being only lightweight subset of igb_uio). This patch also add additional verbose output to console during setup to better understand if failure happens during copy/extract/setup. Change-Id: I0b8a3b76dce3316496a3ad928f58718b6e73057d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-29HC Tests: use vpp-fib-management module in dhcp tests (HC2VPP-348)Marek Gradzki1-1/+1
Addaps HC DHCP tests to https://gerrit.fd.io/r/#/c/13299/ Change-Id: I874da5ee76fcfdb5039c1b3ad33aec4af80396d0 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-06-29SetupFramework to detect failures, part IIPeter Mikus1-10/+4
- This patch is enforcing evaluation and aligning all __init__.robot files to use the same logic. Change-Id: I9e2bf5e904bb6d22f4e6a153c951c3b3c233e2fb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-28FIX: SetupFramework to detect failuresPeter Mikus1-65/+57
- Fix behavior of setup framework to properly detect and raise exception in case of any issue occurs during framework setup on any node - General code cleanup Change-Id: Id4cf36e221817600164b25d5551582838b0f0d5e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-22CSIT-1043: Execute pci rescan only if neededjuraj.linkes2-51/+27
Pci rescan is a rather invasive process, which is why it should be executed only if needed. This patch moves the pci rescan after pci device driver discovery, rescanning the devices for further attemps at driver discovery. Change-Id: I29c939b44c3f67371416a99c711e057f711ba9b4 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2018-06-21HC2VPP-331: Fix Honeycomb fails to assign VRF to interfaceMichal Cmarada1-0/+139
- add configuration for FIB table management to test suite - fix routing test suite HC2VPP-331 bugs - fix intip4-intip6 test suite HC2VPP-331 bugs Change-Id: I0b1e9ed787d9fb68e76a6d61c1eea2519a36a6c4 Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-06-20Revert "CSIT-986: Use MLRsearch from pip"Peter Mikus8-3/+809
This reverts commit 0c2c57d9965ab1db0d5404ad103871ac250339cb. Reason for revert: unless you will fix this broken patch we have to revert this as it breaks several thing in the csit core ci/cd. 1) all tb are pypi offline this means no new pypi is automatically dowloaded. Everytime you change your version you have to update every tb. As this is not automated this will never work and put extreme overhead 2) this code is not pylint checked and not verified by any existing job breaking any kind of verificition mechanics in csit 3)there is no automation in terms of creating pypi (no job) this creates chicken egg problem that you cannot verify change unless new version is installed Next time please think or consult with more seniored csit core developer Unless above will be fixed i will revert on monday as now it breaks all jobs. I will set hard verification to framework setup (exception) so this will prevent next time merge. Possible solution: 1)Move the directory back to resources and reference from csit directly not via pypi, leave the setup crap in dir and let users to create package on their own Change-Id: Id530a9f19f668e45f73ffc9e7371bb453b59fd1b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-18CSIT-986: Use MLRsearch from pipVratko Polak8-809/+3
+ Delete resources/libraries/python/search/. + Add MLRsearch==0.1.1 to requirements.txt. + Bump PyPI/MLRsearch version to 0.1.2. Change-Id: I1f86d75ac8eb90ee3946dbac8c56280f39302f4d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-18CSIT-986: Implement proposed MDR improvementsVratko Polak7-131/+137
+ Use first intermediate with goal in initial phase. + Measure above MRR if that got zero loss. + Always prioritizes NDR in internal search. + Rename classes. + Copy code for standalone PyPI publishing. - Original files will be deleted after publish. Change-Id: I5169d602d1e5e35a1894645cd52e70d791871608 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-08CSIT-1081 Container VPP configuration refactorPeter Mikus2-30/+102
Adopt code for various topology configurations. Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-07CSIT-1121: Add "Get DPDK version" KW to DPDK testsTibor Frank1-2/+1
Change-Id: I6152b3b7d4895a376914166d03ee9ca15ea9eb32 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-01VPP link bonding - lacp modeJan Gelety1-5/+96
CSIT-1072 CSIT-1083 CSIT-1084 Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-31DPDK link bonding: xor modeJan Gelety4-12/+118
CSIT-1073 CSIT-1074 CSIT-1077 Change-Id: I248e079021c30988210fd792b32d5afdca71aadb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-18CSIT-986: MDR rst documentationVratko Polak1-0/+1
+ Introduction. + Phases description. + Comparison tables. + Graphs. Change-Id: Iec5143770677c733070fb0444a1a7d898f1eb04e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-16HC Tests: adapt NAT tests to ietf-nat@2018-02-23.yang (CSIT-1086)Marek Gradzki1-4/+4
Requires: https://gerrit.fd.io/r/#/c/12516/ Change-Id: Ie0a3452f51fb89914a6a0c53aa4136279a3dfb47 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-16CSIT-992: Fix intermediate phases MDR parameterVratko Polak2-8/+15
Also add TODOs and improve comments. Change-Id: I50bd652c83c272c3f7662dd487ab617be2b7de08 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-16HC tests: archive ODL logs (CSIT-1031)Marek Gradzki1-0/+39
Change-Id: I444a5d6cd32cb9ee68575dfdb5a208de2c4eb72a Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-14CSIT-1036 Expose option to install DKMS in containerPeter Mikus1-9/+3
Expose DKMS installation as suite variable. This will allow to use DPDK driver for future tests. Change-Id: I38fd014c8cf6f4bf42881af2196cadc679fe53e0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-12CSIT-1079 Add multiple mount dirs into containerPeter Mikus1-49/+58
Pass the list of mount dirs into container LXC/Docker Change-Id: Ie80062563955273791ab63e156bf0b369e5be649 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-11CSIT-1076 Improve SSH connection handlingPeter Mikus1-25/+36
Properly detect dropped connection via predicate is_active() to prevent using dropped connection. Change-Id: I9105622f28d2f7949675b8cee1dd4384a12f72a9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-10CSIT-992: Give MDR parameters official namesVratko Polak4-103/+115
Change-Id: I1da9a64fb06e015f2b2a0aacb46a53d70349b4b6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-10Cleanup DPDK framework setupPeter Mikus2-236/+38
Moving installation of DPDK into KW instead of framework setup. This will unify the framework setup and allow future optimizations. Change-Id: I360ba95a2858e73e4bbb12020567d5d174ab69ca Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-10HC2VPP-253 - Update routing csit jobsMichal Cmarada1-16/+9
this fixes test failures caused by HC2VPP routing models bump (https://gerrit.fd.io/r/#/c/10954) - updates tests for bgp routing - updates tests for routing - updates SLAAC test because of changes in rt-advertisements Change-Id: Iacc37b42e6523f440d77241c18ca8e61d1d01f23 Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-05-10CSIT-1071 Add traffic evaluation criteria to MRRPeter Mikus1-2/+13
- Fail the testcase if there is no traffic pass. Change-Id: I162187073aafa286793ce488fda9fd065bb55213 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-09FIX: SSH connect issuePeter Mikus2-28/+19
error: [Errno 9] Bad file descriptor Change-Id: I4c5278d41e979f6af43054e3b5890fb154555494 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-04CSIT-992: Add libraries for optimized searchVratko Polak8-20/+917
+ Place the libraries into resources/libraries/python/search/. + Except OptimizedTrexSearch in TrafficGenerator.py + Change traffic generator to support floats for duration and warmup. + Remove explicit type conversions where not needed. + Add robot keywords to performance_utils.robot + for calling the optimized search. + for reporting the resulting values. + for checking the minimal performance has been reached. + for running five second "Traffic should pass with no loss" after the search. - Add methodology documentation in subsequent Change. - Add simulator for testing algorithm correctness in a subsequent Change. - Add tests using the libraries in subsequent Change. Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04Fix various pylint 1.5.4 warningsVratko Polak15-45/+43
+ DUTSetup.py:424 Else clause on loop without a break statement + InterfaceUtil.py:400 Else clause on loop without a break statement + QemuUtils.py:564 Wrong continued indentation + SetupDPDKTest.py: Locally enabling broad-except + VatExecutor.py: Catching too general exception Exception + ssh.py:95 No exception type(s) specified. + HTTPRequest.py: Tolerate HTTPCodes.OK + multiple: Drop ":returns: None" from docstrings. There are still several warnings present: - R0902(too-many-instance-attributes) - R0912(too-many-branches) - R0913(too-many-arguments) - R0914(too-many-locals) - R0915(too-many-statements) - R0401(cyclic-import) And there are multiple blocks of similar lines, mainly across various Setup*Test.py files: - R0801(duplicate-code) Change-Id: I582575cb52b85d69d268e6374852f6e74bb71052 Signed-off-by: Vratko Polak <vrpolak@cisco.com>