Age | Commit message (Collapse) | Author | Files | Lines |
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6ed065d05c20b6305abfecb8e79bacb86c5b85a
(cherry picked from commit 6cc6235c7a693d7d4c22bb8a067924372bad6faf)
(cherry picked from commit 95a7a55f4b7f77a1af8ddd8a8088896b7c8bcae5)
(cherry picked from commit d5b591c2a917690e658bf20bb8088cf3af2c357f)
|
|
+ Convert to module
+ Fix memory limit
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I95285faabbf7bad7fcb7f3b0c9b4e79641c6b95c
(cherry picked from commit 2afd8f4fe26ae1f1d183ecac8f9daa85f68bc634)
(cherry picked from commit 7c90b6a0f1d0e14f64364d0213e473d447980d05)
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I43b3b891b270903419b7fcf132813563306b6e10
(cherry picked from commit f6882e6231ef0a39d137862d1fb5b75f8eddd9c4)
(cherry picked from commit d04cbd87772bf94648f130ce356ad53406760485)
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id362e47ecee9fd4eac8332978d81f33656880d66
(cherry picked from commit d69b5158e2c4ef0bae7acb1f99c103607a4d7b2a)
(cherry picked from commit 45cb36933587e92ceb901725134d0eaeece82104)
|
|
Change-Id: I3d100ec3150f9c90e2754f1d058d07880942f828
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ib6f14e60b74d5534d7d605ee6420a807778ba1a4
|
|
Change-Id: Iebd62fd6b0c798f7b4dd1f3b093c156e533b3900
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit a5b3a8b91d8e6c9baa4361d70b96769a98bfc454)
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6f05e3980d42f7482d846ffe845b1e26b73e3897
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia0243926a595be2c2f05d710ae3162658c08cfed
|
|
- use new vpp ref build - ubuntu 18.04:
20.09.0-60~gd1598d427
- use new vpp ref build - centos8:
20.09.0-60~gd1598d427~b80
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I0964485771a02802eae2cad3247d2f774675cd99
|
|
Add testbed file and make code changes in common.sh.
Change-Id: I493bb92db3c66358afa81ec81bcd99b296f49c03
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 7aa013cf087993ca4546fd7988e177d43cfedfaf)
|
|
- use new vpp ref build - ubuntu 18.04:
20.09.0-59~g1e44cf53b
- use new vpp ref build - centos7:
20.09.0-59~g1e44cf5~b79
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I16b545a5d7bbc48059aa14fb6abc7a7f54ec05d8
|
|
The TG is now shared, update port and user accordingly.
Change-Id: I8be4f41887498ae42935b7ab22a7f22dc21e6b50
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 1d6448f6c2eea55ec82694b30d6d5081ff631482)
|
|
- use new vpp ref build - ubuntu 18.04:
20.09.0-58~g3b82d3e39
- use new vpp ref build - centos8:
20.09.0-58~g3b82d3e39~b78
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I75df7ab449501bad05193736562484847c41859a
|
|
- use new vpp ref build - ubuntu 18.04:
20.09.0-56~g7847f172a
- use new vpp ref build - centos8:
20.09.0-56~g7847f172a~b45
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I969cae12b3a6312683c8a5df90df3509188e7b1a
|
|
Attempt to unbind a driver from a device only if it is bound to a
driver.
Remove the dynamic addition of an existing device ID to a driver. From
the docs [0]:
Writing a device ID to this file will attempt to
dynamically add a new device ID to a PCI device driver.
Since we assume the VFs are bound to the kernel driver when VPP Device
topology creation is done, it implies that the kernel driver supports
the device ID of those VFs, removing the need to add the support.
[0]: https://www.kernel.org/doc/Documentation/ABI/testing/sysfs-bus-pci
Change-Id: I20f3ca071a5a84a06ff358ba514532248a8f9ad0
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 71d7150a65a7c006bf46b2c1001dbaa00b5681fb)
|
|
This is a follow-up to https://gerrit.fd.io/r/c/csit/+/20394
https://gerrit.fd.io/r/20119
has changed the way archival works,
everything should now go to logs.fd.io
(instead of appearing on run page in jenkins.fd.io).
The glob pattern for archiving is quite eager,
doing recursive search. That is good, as it can find
also misplaced useful outputs.
But it also means our usage of copy_archives function
creates two copies of archived directtories,
usually archives/ and archives/archive/.
This change renames copy_archives to move_archives,
with few workarounds to support multiple calls.
I also renamed ARCHIVE_DIR value from $CSIT_DIR/archive
to $CSIT_DIR/archives to make "move" operation look natural.
Finally, download_builds function is being removed,
as after recent improvements to VPP compilation speed
nobody seems to be using it.
Change-Id: I19a429e1dfdfaab7fcf32a9609963b1aebd33c6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 523c6e6e24101206ff1318ca17c310dff8b3c9d2)
|
|
+ Move "|| true" to a place that really aviods errors.
+ Attemp to parse decoded string if trigger is not found in plain one.
Change-Id: If3587229ec588f9ad41acb3050add1142032d2d8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 4582f0f408616cdff8e606ac3abfe154f8f0514b)
|
|
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I81ad4f769362637cdc4dce986a705211847b1221
|
|
- use new vpp ref build - ubuntu 18.04:
20.09.0-54~ge7a1006e8
- use new vpp ref build - centos7:
20.09.0-54~ge7a1006~b74
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: If644bddd3f09607bcfce9e07d4dd0ff53ed3e857
|
|
+ Expand details on NAT stateless tests added.
+ Clarify situation with jumbo ipsec.
Change-Id: Id6fb7fa48b5fadca7798ec1da7e1baf44d0827aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 57476e27b7220d37ca951cdf6b8e12fc0fbc8288)
|
|
+ DUT state chapter was not reachable.
+ Small reorder to put edits together and sooner.
Change-Id: I2735c522e92e277298e299176b4cdc9be4044c26
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 0e835cca6f7dbb1b8c3c0a0356ae7546aa5258bf)
|
|
Change-Id: I65cf505edd346fc5da240be08310064b3755e458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4d6dcbbbb9103f15fb55d525f14964c2323c2a03)
|
|
Change-Id: I5dc427693f78e4c712ab5cae587d7849dc2fec16
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Missing profile specifics and transaction counters.
Change-Id: I6f7378e5fe9d639599c38545b0503354a8a65198
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I4bdb61cf665579c6b49d79c6fb281b4c0fb5ec89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I43423dea499bce3a298dbbba752c2aee2a322836
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- use new vpp ref build - ubuntu 18.04:
20.09.0-27~ga6a5031e7
- use new vpp ref build - centos7:
20.09.0-27~ga6a5031~b47
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Icaf8b25fb1865ae80a3d91ca03090242545115aa
|
|
- Better to get it fully aligned then cherry-pick spaghetti.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If223ef3f0247413d53225eb57f8903a7675632e3
|
|
Change-Id: I8b154156120821adb24273db2a232fa82200c0fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 780612e1eaa2414808fb2cd6c88f7d428a8e3eed)
(cherry picked from commit d818ea2fcc9f644a1a3483007a4648266c16b7dc)
|
|
The previous code counted full TCP connections,
which need one more packet, leading to worse results.
Change-Id: Ifcf78356b6ed54819ea0bf5aa069d7d9cb951183
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b71112bc323b55e39d8a9992a46530e1eb7f6f58)
(cherry picked from commit 5f97857299cc027fe36ddebfe234c514ec94b0f7)
|
|
- use new vpp ref build - ubuntu 18.04:
20.09.0-12~g8cfcbaa72
- use new vpp ref build - centos7:
20.09.0-12~g8cfcbaa~b32
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I58388f18139a118e2d9c8dc75a35f1900be95be5
|
|
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I0dc6fcb7950ccb5fda4e74b29f03e28e5c748903
|
|
Change-Id: Ibed3ad934bc4fd03013404e18b5a0d6917499bf8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 579bccb6aa18c97f3c1a1636658eb41235a18b7a)
Change-Id: Ib002f8d3715301401e103a80f33de8cea7cc71a5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Manual cherry-pick from master [1],
reverting impact of [2] and [3].
[1] https://gerrit.fd.io/r/c/csit/+/28208/176
[2] https://gerrit.fd.io/r/c/csit/+/29077
[3] https://gerrit.fd.io/r/c/csit/+/29529
The heap multipliers are left in suites,
as that simplifies cherry-picking between branches.
Original [0] commit message:
Support existing test types with ASTF
+ Add UDP_CPS, TCP_CPS, UDP_PPS and TCP_PPS suites.
+ Update existing cps traffic profiles.
+ Add missing traffic profiles.
+ UDP:
+ Single burst of 32 packets was confirmed as safe enough for TRex.
+ Maybe 64 could work, but not enough testing for that.
+ Multiple bursts have lead to reduced TRex performance,
as overlaping bursts (from different client instances)
tend to fill up the buffers.
+ TCP:
+ Data size set to 11111 bytes, completely arbitrarily.
+ Results look reasonable, so I have kept that.
- MSS not set at all
- No tested support for frame size other than 64B.
- Frame size does not even factor into TCP profiles.
+ So other frame sizes are skipped in autogen.
+ Update tags in related suites.
- HOSTS_{n} and SRC_USER_{n} should be unified.
- Questionable clarification on difference between IP4BASE and SCALE.
+ Add NAT state resetters to tests that need them.
+ Resetter is called (if set) before each measurement.
+ If ramp-up is detected, resetter is not set.
+ Rename "mult" argument to "multiplier".
+ Abstracted from packets to transactions.
+ Transaction corresponds to profile.
+ TRex multiplier argument sets target rate in transactions per second.
+ The familiar STL traffic:
+ Bidirectional is considered to be 2 packets per transaction.
+ Unidirectional is considered to be 1 packet per transaction.
+ The newer ASTF traffic:
+ 4 subtypes, each has different number of packets per transaction.
+ For max rate computation:
+ Packets in the more numerous direction are considered.
+ Rely on TRex reported traffic duration for ASTF:
+ Use the server side value.
- Client side value is higher by an overhead.
- TRex is not sending traffic during that time.
+ Remove delays from traffic profiles.
- Those delays would increase the reprted traffic time.
+ Support for scale lmited trials.
+ Only for ASTF profiles, each ASTF profile has limited scale.
+ Scale defined in suite variables.
+ For TRex to send all transactions provided duration value is ignored.
+ The appropriate value is computed in TrafficGenerator.
+ An ad-hoc time constant is added to match the TRex client side time overhead.
+ The profile driver receives the computed duration.
+ Measurement for PLRsearch add a sleep if the computed duration is smaller.
+ Alternative argument for search algos if scale is limited.
+ Both need higher timeout to accomodate big scales.
+ MLRsearch can afford fewer phases.
+ Added a parameter to optionally shorten the duration.
+ Use short duration for runtime stats trial and failure stats trial.
+ Use very large keepalive values in udp profiles to avoid ka packets.
+ No polling in ASTF profile driver.
- Polling could eliminate the time overhead value.
+ But polling proved to introduce some loss, affecting the results.
+ Handle duration stretching in ASTF by stopping traffic.
+ The stop has several steps so that:
+ The traffic is really stopped entirely.
+ Late packets do not count (maybe as errors).
+ Stats are preserved to read for results (and cleared afterwards).
+ Several quantities added to ReceiveRateMeasurement:
+ Original target duration is preserved (algos need that).
+ Input estimate (tps) for early search iterations.
+ Output estimate (maybe pps) for MRR output.
+ Strict result (unsent counts as loss) for NDR.
+ Use L2 counters (opackets, ipackets) where possible.
- TRex has trouble processing packets for the L7 ones at high loads.
+ Remove warmup from profile drivers and keywords.
+ Suites should call "Send ramp-up traffic" explicitly if needed.
+ Added parsing for few more counters.
+ Both to use in formulas or just for debug purposes.
- Only 64B cases in autogen, framesize support to be added later.
+ Latency streams during search can be enabled via PERF_USE_LATENCY env var.
+ MLRsearch improvments:
+ Rename argument names to min_rate and max_rate.
+ Use relative receive rate in initial phase.
+ PLRsearch improvements:
+ Careful computation when output (pps) does not match input (tps).
+ Use geometric distribution (instead of Poisson).
+ Helps agains math errors.
+ This should improve estimate stability.
- But in practice big losses still lead to significant jumps.
+ Traffic generator improvements:
+ send_traffic_on_tg now calls the full set_rate_provider_defaults.
+ _send_traffic_on_tg_internal for the logic without provider defaults.
+ As the internal function is re-used by measure() without affecting defaults.
+ Move _parse_traffic_results just before get_measurement_result.
+ As the latter uses fields set bu the former, it is now easier to read.
+ Multiple sources for approximate duration.
+ Tried from more precise to more available.
+ Includes logic for _pps tests (added in later change).
+ Move explicit type conversions to earlier occurences.
+ Profile driver output field uses semicolons to simplify parsing.
+ Performance Robot lib file split to several smaller ones.
+ performance_actions.robot:
+ Hosts Additional Statistics Action For * keywords.
+ performance_display.robot:
+ Hosts keyword for displaying and verifying results.
+ Change test message to use the correct unit (pps or cps).
+ performance_limits.robot renamed to performance_vars.robot
+ Added many keywords, mostly for accessing test variables.
+ Moved variables for Policer into a new keyword there.
+ Some keywords need sophisticated logic.
- Other are basically Get Variable Value.
+ But in future more logic can be added, without editing callers.
+ Documentation for the new keywords acts as a documentation for test variables.
+ performance_utils.robot has the rest.
+ Eliminated arguments if the value is in test variable.
+ Small improvements to documentation.
- Still not enough cleanup with respect to arguments and test variables.
+ Keywords are sorted alphabetically now in each one.
+ Suites:
+ Unified variables table:
+ No colons in comments.
+ ${n_hosts}, ${n_ports} and use them instead hardcoded numbers.
+ Add -cps to existing cps suite names.
+ Remove "trial data overwrite".
+ Compute max rate as in STL suites.
+ Each NAT suite has ip4base suite to compare results to.
- Those act as indirect TRex calibration.
- VPP does not lose packets in those.
+ Latency in ASTF suites is disabled hard.
- As we do not support latency in ASTF profiles yet.
+ Unidirectional tests governed by suite variable, not an argument.
+ Write long argument lists vertically.
+ Prefer to use argument names.
+ In Python, also the last argument is followed by comma.
+ It makes renaming and reordering easier.
+ Similarly applies to prints with long lists of values.
+ A TODO to update api crc file comments.
Change-Id: I84729355edbec051298a9de1162107f88ff5737d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
- the specs:
- docs/job_specs/report_iterative/2n-clx/vpp-mlr-00.md
- docs/job_specs/report_iterative/2n-clx/vpp-mrr-00.md
- docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md
- docs/job_specs/report_iterative/2n-skx/vpp-mrr-00.md
take too long. We should consider to remove some tests.
- the coverage specs were split to three parts
Change-Id: I39e2032c76266e159a781d1225cff1a5119d4c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e31998ea56c55879fbaae8e58b0dad0bc6549dae)
Change-Id: I938ee568d3e694ba693d3ef88918a98de24a7722
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: I9b6c2185e43ed0b33dbeafb3d2757656f9e49bc3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b9aabb97bb10297ce004f731b7b61b9dc9c83ee6)
Change-Id: I0c58a35be63415a46ede8f340107a034fcb4f90d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: I7b15c69c923d47e83c2dc586cdc03ed4ebaeec74
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7bcbdcb30d2eea8fe7e1fb60696e39abef897920)
Change-Id: I60ddc6a47a7cc07e9d68bd70d9f9d99b4678f913
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
- use vpp builds from vpp stable/2009 branch
- use new vpp ref build - ubuntu 18.04:
20.09-rc2~29-g072def473
- use new vpp ref build - centos7:
20.09-rc2~29_g072def4~b18
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Ic53e380cdee7d4104ab378790a3b4a6dace299b0
|
|
Change-Id: If03e4adf3672413016058fae85219ae5c7e922db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8c840bcaf34a1ed3e43c78208aa3ab053c07719c)
|
|
Change-Id: I7f7e50610e71af7f2b0dc1eed267a421ffd8aef0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1b25441a3d82a12d01334bd82795bd35a4f7c2e3)
|
|
Change-Id: I657325a2c18a1003c8825037291f1c37962e2c67
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4fc1bd38a0b2260f83de2b2cf531041a9f95c62a)
|
|
Change-Id: I28cd6e2bfdf6617f7590907fc114681823a2979f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d2c7a89f3f22fb759902b66cb32f58499c6ea520)
|
|
Change-Id: I17c582de8fa24ffd55b163cfeb727f2951ec647f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f94785edae14c6b2e9bef270a633717975c35a6d)
|
|
Change-Id: I82099d75e02369a6b8e3093563f8e8ec62c96c19
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 36be7887e86fae7014c9cec12b46b8bf84159b82)
|
|
Change-Id: I16ce4e2146fa44eace76fb495cc6d007005c215f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 61dbfbcc31de9f20738fc85e2ac87badfd3ed1db)
|
|
Change-Id: I41209e4a285edb9d6ac5428ea091b36179f3e1ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9901a12854ca81faaf7699416ecfc296d842f489)
|
|
Replace the hacky grep of /etc/resolv.conf with default docker gateway
IP.
Change-Id: Iec3a4658826f2ba871acb14d511e9c79a1273290
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Change-Id: Ib5dd43bfa823352f2aa623e54bf8de4306675eb6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c348da370bfcedf8f1471ec6c4c43174ed84f8d0)
|
|
Change-Id: I3ba5ea19efd6d8f878aa67bff9bcd237a7a366ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ad451354e020e7cdb39122b60f7a165e1f53cb8a)
|