Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Ticket: CSIT-1551
+ Config copied from other suites.
+ Layer keywords prepared for additional chains.
+ Renamed "create" argument to "vlan_per_chain".
+ TrafficGenerator result extraction improvements.
+ Also unified TG type and subtype checking.
+ Throughput estimated as PDR for zero PLR.
+ Actual Qemu start is skipped.
+ Parse xstats instead of stats in trex stop scipt.
- Because stats are unconditionally cleared on each script connect.
+ Remember start values to get better ReceiveMeasurementResult at stop.
+ Expose loss count and time as appropriate test message.
+ Autogen support.
+ Multiple chain amounts and core densities.
- Only 1 additional chain.
+ Proper TAGs. Documented.
+ Clarified min framesize tags are for TG-DUT.
+ Added a TODO concerning overhead values.
+ Added 118B tag.
+ Robot performance keywords improvements.
+ Added missing return value documentation.
+ Frame size as required test variable, not an explicit argument.
+ MLRsearch keyword to store result (not into test message).
- TODO: De-duplicate: main keyword to measure, minor to set test message.
- But implementation uses the fact default arguments are different.
+ Keywords for starting and stopping background traffic.
- No checks whether start-stop pair is complete.
+ Multiple minor indentation and logging improvements.
- Missing / TODOs:
- Support also vlan_per_chain=True?
- Support dot1q without vxlan?
- Support also deletion?
- How to package config steps so -reconf can be generated from -ndrpdr?
Change-Id: If0270697f9ffa837c34ef802917220a53f156703
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Logic improvements for rls1908 and post-pylint fixes:
+ Reduce search time to 30 minutes.
+ Use average instead alternating loads.
+ Rework log/exp avg/stdev from two estimates.
+ Introduce and use pessimistic variance of dual trackers.
+ Introduce safe_exp to use when None does not skip code.
+ Use dot relative imports (instead of disabling pylint).
+ Complete docstrings for simpler functions.
+ Append docstrings to named tuples.
+ Somewhat unify docstrings related to the same arguments.
+ Slightly improve intentation.
+ State named tuples as rtype where used.
+ Add returns and rtype to __repr__ where missing.
+ Return what docstring say (or update them).
+ Explicit copying for vector and matrix values.
Change-Id: I884c68b4839c5df5e8bef95e463666599603a0ff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Add testcases and tag expressions for perf occurrences.
+ Add TNL_1 tag for single tunnel IPsec suites.
- Some CRCs were missing before, but form a pair with a listed CRC.
- Probably the other half of the pair is not used.
- Will be fixed in subsequent Change.
Change-Id: I5754210755c13c41226b71045813714a65a1cdf3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Groups of tests for graphs:
- Packet Throughput
- Packet Latency
- Speedup Multi-Core
Change-Id: Ib37c1231abb63c234fb1e98d059bb3338133da0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I7682d802f405070e34f72bc4a80cbe6a63b03619
|
|
+ Few fixes in doc
+ Align testcases
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5575db8255a74fd46f37d5cc2637b9b4448bcd7f
|
|
By using Get Variable Value keyword.
Change-Id: I3a9650b6f802d60422ffa6b6b00d444ebb050d89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
After API change.
CSIT: https://gerrit.fd.io/r/c/csit/+/21245
VPP: https://gerrit.fd.io/r/c/vpp/+/18361
+ Add ip_probe_neighbor_reply CRC, not sure how that got missing.
Change-Id: I790875dab771981af3b9eceac5425d4d2f374984
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
CSIT code alignment with API changes in VPP introduced
by patch https://gerrit.fd.io/r/c/vpp/+/18361
Change-Id: Ib0357bba79f55d297ef1086fbf3b760caca16cdb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Apply layer approach for interfaces
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6c1898b9833f9f42b8912f1b521e30093360d7ea
|
|
If current VPP is broken, we want to fail early.
If there is API change, we are more interested in current results,
even if parent is likely to fail.
Change-Id: I552485bbb9fe0053bae39de7939f94a5971bb63b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Put Regenerator internal functions ourside class.
+ Duplicate into _default_ and _tcp_ functions.
+ Rework Testcase to be a single class with two factories.
+ Improve suite and testcase naming.
Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- throughput
- latency
- speedup
Change-Id: Ia8b33815f5bbb7b0fb50b23e7655068928733832
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- DPDK
Change-Id: Ibc45c49e34b2b0abe0f0a9f3304ee478c174c01e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I922c8143df39025cc0a78047f3cef7b9f5673b4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I86bc69f8b2f38b58cb3eb030bec7d0ce5c79d040
|
|
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: Ie2f19a2e3b37e8d85656ab31ece59b89c76bea25
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1497a9b031603d09d69a29ed7167686848d4b7c5
|
|
Change-Id: Ia9ec0d420c8db9e71234f74e4013c21d039931b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Last attempt [0] is doing more harm then good. If testbed is down
but recovered quickly enough (reboot, temporary ssh connectivity
issue, ...) it never gets back into pool making other testbeds
overloaded and queued.
This patch is suppose to partially revert previous behavior until
proper patch will follow.
[0] https://gerrit.fd.io/r/c/csit/+/21148
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8203946d10d3e7dd51e97519d679246b5dae59e3
|
|
- that prevents installation
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4fe4694ab7479481481aacc2eb550058bd7618e6
|
|
- format the table
Change-Id: I871251a8329e5d52c527c93afe35d875bddaed0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- format the tables
Change-Id: I31f786d53b79fa14c5d2dc21ff65d0465fde1d4f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- CSIT-1194
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I0f4c234fb5f5f6543a5d525301f17f5a111e1053
|
|
Change-Id: If7eac41cd33837eea7291f87129e2c176fbe6aea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifa4de8e60742f5c4cf4c2f377692313e23f9983b
|
|
Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: I2ff45926a754647c1be6263cf8e5e0c7cbfedfef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
+ Fixed Qemu
- Broad Exception should be addressed
- Policer is about to be refactored
- Drop search to be refactored
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I97eb992497ff6334057bf82a0f413387706e17fd
|
|
+ Still workaround for VPP bug not creating dir at startup
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8b87ac70e5f85d538a25058dcb5453f89e21498f
|
|
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
- force a python2 environment in tox for pylint
- let pylint load some compiled modules for member checking
- allow locally enabled pylint rules
- ignore bad enum names
- ignore complexity for code to be refactored by other tickets
- broad excepts are acceptable sometimes
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: If4c3a1b85e8609f074e1de8ce91fc9c4fedbeb38
|
|
- Remove ability to install from framework.
- Control via ansible with other dependencies.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5fd0ca18b4f76c30b6c28b4dcd15e538e01cb315
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47163aa9ee0114f13ab17badde773560243ce319
|
|
- Dry runs
- fix table 'VPP Soak vs NDR 2n-skx'
Change-Id: I1fb101ab1b7cc40de49e8bb564818a730d3853a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- Dry runs
Change-Id: Ib6e50853b5b4638dc0f4bc93a98b3818f5079658
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Needed to verify CSIT expects the correct CRCs.
This reverts commit d541b2b7d99651b53bd21ff75cd5fdacf8472a98.
This reverts commit 2dd27f5a638b5231c0f074ca61e6b67fed9d1faf.
+ Some pylint related improvements since then.
+ Less and better documented caching to class fields.
+ Global kill switch in Constants.
Change-Id: Id459800744cd93c578eab9c2e84cb9528235b064
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
If test failed before vnf_manager is created then teardown
does fail as well due to missing variable.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0b23648bce78738cf4c377979d7a06fb488d990d
|
|
https://lists.fd.io/g/csit-dev/message/2867
Change-Id: I8934218f2ccac9a458cec37e71e403db7d49281c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I0902613047d7543378a4b7d46811fc67776c6ad9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I308d7a7f72e0ea2e23b96be7db1ba35920bae519
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- Needed for trending
Change-Id: I3d576e39d6e3b91821050fbd4a8a95380275797b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I26ec27b00e5cd48143a2389f2ff41ed876a7a013
|
|
Change-Id: I566c0e436fbe50e5e72da35be6a2afc81e8a33b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- Needed for trending
Change-Id: I59fc115ce62d1ad839e7c8a39c74af0497b9012d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- Remove translate TC as they have no perf opposite
- Remove unused keywords
- Merge similar keywords / rename
- Move keywords from perf library to categories
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6433006136e2497ad8fb17193aa20c578d836999
|
|
Change-Id: I9fc26a7d1bf8d9eed620173a73febe3d874a1351
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: Id51e073d23d7bb54864eb5fd1c3c320077e6abb8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|