aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak8-149/+416
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ff820e3d53434889aacde2373314c3be8d00f765)
2019-08-23Improve PLRsearch yet againVratko Polak6-51/+167
Logic improvements for rls1908 and post-pylint fixes: + Reduce search time to 30 minutes. + Use average instead alternating loads. + Rework log/exp avg/stdev from two estimates. + Introduce and use pessimistic variance of dual trackers. + Introduce safe_exp to use when None does not skip code. + Use dot relative imports (instead of disabling pylint). + Complete docstrings for simpler functions. + Append docstrings to named tuples. + Somewhat unify docstrings related to the same arguments. + Slightly improve intentation. + State named tuples as rtype where used. + Add returns and rtype to __repr__ where missing. + Return what docstring say (or update them). + Explicit copying for vector and matrix values. Change-Id: I884c68b4839c5df5e8bef95e463666599603a0ff Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit fbbc47359e3f7b59bbd5a84d85c673374933a50a)
2019-08-23Framework: Refactor complex functions in PLRSearchMiroslav Los2-49/+68
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech> Change-Id: Ie2f19a2e3b37e8d85656ab31ece59b89c76bea25 (cherry picked from commit 281b230ba982f9f6ad589fb6e44f121a6a46531f)
2019-08-23Report: Specify groups of tests for graphsTibor Frank1-0/+432
Groups of tests for graphs: - Packet Throughput - Packet Latency - Speedup Multi-Core Change-Id: Ib37c1231abb63c234fb1e98d059bb3338133da0c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 719a84662ad1482f09224543c07053d27d7b94ea)
2019-08-21Autogen: Create NICs for TCP suites.Vratko Polak4-257/+281
+ Put Regenerator internal functions ourside class. + Duplicate into _default_ and _tcp_ functions. + Rework Testcase to be a single class with two factories. + Improve suite and testcase naming. Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ae7dc0011f376861ba9259b7cb5166777520799c)
2019-08-21Add: avf-dot1q testcasesPeter Mikus3-4/+126
+ Few fixes in doc + Align testcases Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5575db8255a74fd46f37d5cc2637b9b4448bcd7f (cherry picked from commit a0a1bdba6245c685898bab5007de28452bbd2d27)
2019-08-21Fix Initialize layer dot1q on nodeVratko Polak1-8/+4
By using Get Variable Value keyword. Change-Id: I3a9650b6f802d60422ffa6b6b00d444ebb050d89 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit b6cd8aba14026ee89178714171d2890a2796ca31)
2019-08-20Align NF_denisty testsPeter Mikus1-14/+27
+ Apply layer approach for interfaces Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6c1898b9833f9f42b8912f1b521e30093360d7ea (cherry picked from commit 329e0acee1cf31c6524883e15560993af76f0fad)
2019-08-19PAL: Select tests by name, functionsTibor Frank3-0/+751
- throughput - latency - speedup Change-Id: Ia8b33815f5bbb7b0fb50b23e7655068928733832 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 144ebec26ff0a32000283eddfac393e497e01164)
2019-08-19Report: Add dataTibor Frank1-28/+130
- DPDK Change-Id: Ibc45c49e34b2b0abe0f0a9f3304ee478c174c01e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 42c64b70e6cdc0ba1466ca0919d5d0377f4c227d)
2019-08-19PAL: Get DPDK version from output_info.xmlTibor Frank1-2/+2
Change-Id: I922c8143df39025cc0a78047f3cef7b9f5673b4b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 039a71a97592cfb864dff8fc56ec04b33f8f92bb)
2019-08-19FIX: Missing ACL libraryPeter Mikus1-0/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1497a9b031603d09d69a29ed7167686848d4b7c5 (cherry picked from commit 00b3327cf9df8ac078bde5f936bd2ac9fe666f03)
2019-08-19Write DPDK version to logTibor Frank1-1/+1
Change-Id: Ia9ec0d420c8db9e71234f74e4013c21d039931b2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f893de60bb36c3e241a992cb389697997a1cd0f2)
2019-08-16PAL: Process show runtime output 3Tibor Frank1-2/+4
- format the table Change-Id: I871251a8329e5d52c527c93afe35d875bddaed0c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 859a3f724c077f9db9a2f40f76b6dad27f199003)
2019-08-16PAL: Process show runtime output 2Tibor Frank1-3/+2
- format the tables Change-Id: I31f786d53b79fa14c5d2dc21ff65d0465fde1d4f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7da9d215fc0867e19160d38b0096e58c78381bf8)
2019-08-15PAL: Process show runtime outputTibor Frank1-5/+42
Change-Id: If7eac41cd33837eea7291f87129e2c176fbe6aea Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3e58c2f916288c5ed22ce11f01fa56a4d19689d2)
2019-08-14FIX: Remove eth_avf and portX_vifY interfaces from topo in TC/TS tear downJan Gelety3-4/+39
Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-15Add testbed info to output_info.xmlTibor Frank1-2/+3
Change-Id: I2ff45926a754647c1be6263cf8e5e0c7cbfedfef Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 16226fd221af3345c02de6d685c90ee6bf7cf9f9)
2019-08-15VAT-to-PAPI: Fix HTTP/TCP testsDave Wallace12-67/+74
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit 6da7266754c28754c04cf37d1974e39766a261f6)
2019-08-14Move: WRK installation into ansiblePeter Mikus9-84/+71
- Remove ability to install from framework. - Control via ansible with other dependencies. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5fd0ca18b4f76c30b6c28b4dcd15e538e01cb315 (cherry picked from commit 37a9451377f7239365b5af778b8072d1585a2d2a)
2019-08-14FIX: Container VPP pid detectionPeter Mikus1-0/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I47163aa9ee0114f13ab17badde773560243ce319 (cherry picked from commit be39339d5bf121d718623885d05848e50d466347)
2019-08-14Report: Add dataTibor Frank1-4/+12
- Dry runs - fix table 'VPP Soak vs NDR 2n-skx' Change-Id: I1fb101ab1b7cc40de49e8bb564818a730d3853a4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b0592824b3b8394f25577481533c406145136dcf)
2019-08-14Report: Add dataTibor Frank1-319/+99
- Dry runs Change-Id: Ib6e50853b5b4638dc0f4bc93a98b3818f5079658 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 72614c322675f63958ca668404f081d738660e42)
2019-08-14FIX: Vhost teardownPeter Mikus1-1/+3
If test failed before vnf_manager is created then teardown does fail as well due to missing variable. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0b23648bce78738cf4c377979d7a06fb488d990d (cherry picked from commit 8f41f1d040453d963440d8cc99fb2b957521120b)
2019-08-14PAL: Archiving of input dataTibor Frank1-8/+24
Change-Id: I0902613047d7543378a4b7d46811fc67776c6ad9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9e476b274acf41b5ac358bc4dba3a0f1e16f04b2)
2019-08-13Report: Download first from logs.fd.ioTibor Frank4-161/+150
Change-Id: I308d7a7f72e0ea2e23b96be7db1ba35920bae519 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cd2a57aba61553f36c638dc6e8d949e1739fb6bf)
2019-08-13PAL: Get DPDK VersionTibor Frank2-13/+16
- Needed for trending Change-Id: I3d576e39d6e3b91821050fbd4a8a95380275797b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9e1bb28404a23f6d4c62fb945a3ee6dba42f1c47)
2019-08-13PAL: Get TG IP address from output_info.xmlTibor Frank1-7/+5
Change-Id: I566c0e436fbe50e5e72da35be6a2afc81e8a33b6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b763901692e207a8f07386bb3bcba254cdeaa790)
2019-08-13Add testbed info to output_info.xmlTibor Frank1-1/+3
- Needed for trending Change-Id: I59fc115ce62d1ad839e7c8a39c74af0497b9012d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5dea7e63a012cdbf4fba60e4fdcb5c6acce2fca4)
2019-08-13Clean: Various librariesPeter Mikus16-901/+717
- Remove translate TC as they have no perf opposite - Remove unused keywords - Merge similar keywords / rename - Move keywords from perf library to categories Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6433006136e2497ad8fb17193aa20c578d836999 (cherry picked from commit 9c75b7bf5af74aa13cfa3aeeaf726cd965850fce)
2019-08-12FIX: if MAC address must be updated after AVF interface creationJan Gelety1-0/+6
Change-Id: I9fc26a7d1bf8d9eed620173a73febe3d874a1351 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 3e664d4a46aecf847659df2fe3d2572697b582a7)
2019-08-07FIX: Various typos in nf_density + missing KWPeter Mikus1-0/+14
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I73878542672ab2dcfa1db046fbca4b7d931e744c
2019-08-12Report: dataTibor Frank1-1/+1
Change-Id: Id51e073d23d7bb54864eb5fd1c3c320077e6abb8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f187d0b4f9cfa3b980a94b1f56e828b183367c15)
2019-08-12Report: DataTibor Frank1-274/+219
Change-Id: Ibd1a5dc6e451d992eb85b223973734c876e37fe7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f7037acce33b11dbbbb87ad079750525e6b95eb4)
2019-08-12Clean: L2 bridge domainPeter Mikus9-1037/+838
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3721900b91a9c8e9db8766bdcb9771b6bcf95bca
2019-08-09FIX: macip_acl_rule needs binary mac dataJan Gelety1-2/+2
Change-Id: I0d26b2b31f0ce7497c91b4ae965f9cc45a66ef0c Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 5b28bc8c52a5f7ef72f03d03806f61ba45ecc623)
2019-08-09Clean: L2_xconnect keywordsPeter Mikus3-286/+286
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic15a15c426db04defc15840883a772a0eb8e4885 (cherry picked from commit 181e882d5c939cc6620545e5fde411e46fd59559)
2019-08-09Trending: Fix ipsecTibor Frank1-0/+4
Change-Id: I0f35098047bc1137cbf2a1ae39107698b1e9bf79 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Report: ConfigurationTibor Frank2-12/+12
Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d6c832b02ac7d3073dd8651b089a72ec8240b183)
2019-08-09Trending: Set 90 days periodTibor Frank1-10/+191
Change-Id: I56403c30142876501602fe06c0ad2665fa73cb7b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: TSH ipsec testsTibor Frank2-12/+38
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Clean: L2_patchPeter Mikus2-16/+10
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ib3620689acb3641b2ec9a49e2ce552bab3f00eef (cherry picked from commit 016fb5988a63c3086b0b5b9f5ad7155c6ebef291)
2019-08-09Clean: Interface KeywordsPeter Mikus4-504/+97
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ideddcea56120cf770aec78ca24813baf7d05ba11 (cherry picked from commit 484cb0bddf8ad75129ac20b955a72f36f4241ad2)
2019-08-08Trending: Add dnv mrr testsTibor Frank1-2/+483
Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-07Clean: IPv6 keywordsPeter Mikus2-220/+206
+ Move all base ipv6 related KW to library + Remove useless KW to save space in output.xml + Remove cross dependency in ip6.robot Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8c5f72e9852c1017356ab6034c4d271cf7b53265
2019-08-07Clean: IPv4 keywordsPeter Mikus4-567/+539
+ Move all base ipv4 related KW to library + Remove useless KW to save space in output.xml + Remove cross dependency in ip4.robot Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: If1e3a6370d36caf4ce7411fb956a0b7d0f939b6b
2019-08-07FIX: PylintPeter Mikus6-83/+74
- my bad Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8c1f57f6b648b99338f3f6a6ff9ec943082e9bc4
2019-08-07FIX: IPsecUtil - create IP object separately in ever iterationJan Gelety1-33/+24
- if we are trying to update ip field of already existing IP object in more iterations of e.g. ip_route_add_del the PapiExecutor uses value from last iteration for all iterations so it ends up in creation of ip route only for one IP not for all required IPs Change-Id: I5ffa622e2a06d0c5c71720d2cf743a4c2104ab79 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-07FIX: Remove PAPI_MAX_API_BULKJan Gelety3-11/+0
- it's not needed anymore as PapiSocketExecutor is used Change-Id: Ia9fad1d18991821d14e9261d27f7f26fca03c14a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-07CSIT-1473: Migrate Tap library from VAT to PAPIJan Gelety3-250/+174
Change-Id: Ibf4a4839c2e8b799b03eebd9dffae891d8f00dd4 Signed-off-by: Jan Gelety <jgelety@cisco.com>