Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: I1c64758f937c34a8f3956a5aa6512bb16a9dfe62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fc3f7fa58880d2327c3364bbcf8338d2256fb8f0)
|
|
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ifb97088a26f3c2ab2ecee28ed43e6e957a844c64
(cherry picked from commit 9446b9bf9c15999feec3c8a48fec428bca094500)
|
|
Change-Id: I9099cce7c4da15a1b3a9aafd37825b284c5ed7fe
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
|
|
Change-Id: I298c3bdec3f9254a2644401a9ffb7ff09c4ecbd2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
+ Add a link to NAT44 methodology.
+ Mention TCP tests are not using 64B packets.
Change-Id: Ief6334e84abdf4d099dfbc455cfc7c9b2179ccfe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Extra storage capacity
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifbdc26581776e9885b0eb9929d8ac1f731282426
|
|
Jira: CSIT-1769
Change-Id: I98510cd8e627d7347f77d0032b7bac28f2e36c61
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: Ic7d559d30c2c7d314ba029dfe7c1db99e25e20f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
This reverts commit a9f54ca5080aeef17686f300a6807bf9b46b7c90.
Reason for revert: DO NOT MERGE BROKEN TESTS!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-device-master-ubuntu1804-1n-skx/9918/archives/log.html.gz
Change-Id: I2ce2970a43e5dd7487eeb54d1ccbb149e06cf8fa
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
Jira: CSIT-1769
Change-Id: I0ab906966f760b809b8431530c010a8f0835d62c
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: I1eb0475d30048d6b42458d1fb696d7fac93ac948
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ia8e71df86d561c1d9bc388fa6b70ef850c94e66e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia055011626212472f65d18a5c1a10440973ecd48
|
|
Change-Id: Ia19cfa32430c7f12e0093d0b540d23876ca9da8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Idf754d624443ceef1db5ea5e1d4ab2a9f1c5649b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ifec550ae69c6454d0adbc08d3e49435c3cca380f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- packet throughput
- speed-up
Change-Id: I5d49ae2da54170e48c51db47e035d2121471be0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
+ Expand details on NAT stateless tests added.
+ Clarify situation with jumbo ipsec.
Change-Id: Id6fb7fa48b5fadca7798ec1da7e1baf44d0827aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Fix "Not enough availablehuge pages: 1483!".
Also update 3n-tsh docs.
Change-Id: I1d37a66af1e2363f77fdbd87d238e8ff5535b011
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Update after switching one 1n-tx2 and the idle ThunderX2 servers between
racks. Update the idle ThunderX2 specs to a new perf testbed, 2n-tx2.
Add Server-Type-B12 which is a modified Server-Type-B2 with one extra
NIC (needed for 2n-tx2).
Change-Id: I51af358f1feb476652eddfe82b5af1d0d70ac259
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Change-Id: Ib7c4bc51bea43dafa2bd788c709c800caeb75988
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ifaba0d689a279ae650ae30531b21533cc6927262
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I49e2c50829af8f538155b6262ec2872a68560858
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
+ DUT state chapter was not reachable.
+ Small reorder to put edits together and sooner.
Change-Id: I2735c522e92e277298e299176b4cdc9be4044c26
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
If some details are still needed, re-add them to
docs/report/introduction/methodology_nat44.rst
Change-Id: I8796dcafff83407eda28719148b9527d2963e6f8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I5dc427693f78e4c712ab5cae587d7849dc2fec16
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Missing profile specifics and transaction counters.
Change-Id: I6f7378e5fe9d639599c38545b0503354a8a65198
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I4bdb61cf665579c6b49d79c6fb281b4c0fb5ec89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I43423dea499bce3a298dbbba752c2aee2a322836
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I2601a786f58b1d89cc9a90cb16ff20e6331abbfe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- reorder NAT44 graphs
Change-Id: Ied762a85fb1ee69c7d12971e3e15822571a18451
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I19308ed936246be5b4e61c6e219591d16095cb56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I6de49b81bd4b75d40c792b044dc46024279d6651
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I783f0f055462daa1e8047c6905a17495b8473135
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I2c247c5362396bcb4c8b42b1b46a2601091ca968
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I7886285de8edbf66e03e1b22d85c2e7a4c4d7224
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I277f462521273947d374e79a687e7f616ad1f13b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
|
|
- enable all NAT44 tests for report iterative
Change-Id: Ifc820c3d0b657637bb4569f59ddaecd9aefb8d1d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I6de094fc0cb2acdfb6eeb22e6d85a65d2e9f1478
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ibed3ad934bc4fd03013404e18b5a0d6917499bf8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I800273d04c3f956e58be727cbf5befa61377fa2b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ifca9e4f5783eea37df30ddfedc80c988f2163ad8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I463bf61d41484738ba5c614b473bcb5457e6abe1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I3920f881286565029f35bcfa700f36c6701db457
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
+ Add UDP_CPS, TCP_CPS, UDP_PPS and TCP_PPS suites.
+ Update existing cps traffic profiles.
+ Add missing traffic profiles.
+ UDP:
+ Single burst of 32 packets was confirmed as safe enough for TRex.
+ Maybe 64 could work, but not enough testing for that.
+ Multiple bursts have lead to reduced TRex performance,
as overlaping bursts (from different client instances)
tend to fill up the buffers.
+ TCP:
+ Data size set to 11111 bytes, completely arbitrarily.
+ Results look reasonable, so I have kept that.
- MSS not set at all
- No tested support for frame size other than 64B.
- Frame size does not even factor into TCP profiles.
+ So other frame sizes are skipped in autogen.
+ Update tags in related suites.
- HOSTS_{n} and SRC_USER_{n} should be unified.
- Questionable clarification on difference between IP4BASE and SCALE.
+ Add NAT state resetters to tests that need them.
+ Resetter is called (if set) before each measurement.
+ If ramp-up is detected, resetter is not set.
+ Rename "mult" argument to "multiplier".
+ Abstracted from packets to transactions.
+ Transaction corresponds to profile.
+ TRex multiplier argument sets target rate in transactions per second.
+ The familiar STL traffic:
+ Bidirectional is considered to be 2 packets per transaction.
+ Unidirectional is considered to be 1 packet per transaction.
+ The newer ASTF traffic:
+ 4 subtypes, each has different number of packets per transaction.
+ For max rate computation:
+ Packets in the more numerous direction are considered.
+ Rely on TRex reported traffic duration for ASTF:
+ Use the server side value.
- Client side value is higher by an overhead.
- TRex is not sending traffic during that time.
+ Remove delays from traffic profiles.
- Those delays would increase the reprted traffic time.
+ Support for scale lmited trials.
+ Only for ASTF profiles, each ASTF profile has limited scale.
+ Scale defined in suite variables.
+ For TRex to send all transactions provided duration value is ignored.
+ The appropriate value is computed in TrafficGenerator.
+ An ad-hoc time constant is added to match the TRex client side time overhead.
+ The profile driver receives the computed duration.
+ Measurement for PLRsearch add a sleep if the computed duration is smaller.
+ Alternative argument for search algos if scale is limited.
+ Both need higher timeout to accomodate big scales.
+ MLRsearch can afford fewer phases.
+ Added a parameter to optionally shorten the duration.
+ Use short duration for runtime stats trial and failure stats trial.
+ Use very large keepalive values in udp profiles to avoid ka packets.
+ No polling in ASTF profile driver.
- Polling could eliminate the time overhead value.
+ But polling proved to introduce some loss, affecting the results.
+ Handle duration stretching in ASTF by stopping traffic.
+ The stop has several steps so that:
+ The traffic is really stopped entirely.
+ Late packets do not count (maybe as errors).
+ Stats are preserved to read for results (and cleared afterwards).
+ Several quantities added to ReceiveRateMeasurement:
+ Original target duration is preserved (algos need that).
+ Input estimate (tps) for early search iterations.
+ Output estimate (maybe pps) for MRR output.
+ Strict result (unsent counts as loss) for NDR.
+ Use L2 counters (opackets, ipackets) where possible.
- TRex has trouble processing packets for the L7 ones at high loads.
+ Remove warmup from profile drivers and keywords.
+ Suites should call "Send ramp-up traffic" explicitly if needed.
+ Added parsing for few more counters.
+ Both to use in formulas or just for debug purposes.
- Only 64B cases in autogen, framesize support to be added later.
+ Latency streams during search can be enabled via PERF_USE_LATENCY env var.
+ MLRsearch improvments:
+ Rename argument names to min_rate and max_rate.
+ Use relative receive rate in initial phase.
+ PLRsearch improvements:
+ Careful computation when output (pps) does not match input (tps).
+ Use geometric distribution (instead of Poisson).
+ Helps agains math errors.
+ This should improve estimate stability.
- But in practice big losses still lead to significant jumps.
+ Traffic generator improvements:
+ send_traffic_on_tg now calls the full set_rate_provider_defaults.
+ _send_traffic_on_tg_internal for the logic without provider defaults.
+ As the internal function is re-used by measure() without affecting defaults.
+ Move _parse_traffic_results just before get_measurement_result.
+ As the latter uses fields set bu the former, it is now easier to read.
+ Multiple sources for approximate duration.
+ Tried from more precise to more available.
+ Includes logic for _pps tests (added in later change).
+ Move explicit type conversions to earlier occurences.
+ Profile driver output field uses semicolons to simplify parsing.
+ Performance Robot lib file split to several smaller ones.
+ performance_actions.robot:
+ Hosts Additional Statistics Action For * keywords.
+ performance_display.robot:
+ Hosts keyword for displaying and verifying results.
+ Change test message to use the correct unit (pps or cps).
+ performance_limits.robot renamed to performance_vars.robot
+ Added many keywords, mostly for accessing test variables.
+ Moved variables for Policer into a new keyword there.
+ Some keywords need sophisticated logic.
- Other are basically Get Variable Value.
+ But in future more logic can be added, without editing callers.
+ Documentation for the new keywords acts as a documentation for test variables.
+ performance_utils.robot has the rest.
+ Eliminated arguments if the value is in test variable.
+ Small improvements to documentation.
- Still not enough cleanup with respect to arguments and test variables.
+ Keywords are sorted alphabetically now in each one.
+ Suites:
+ Unified variables table:
+ No colons in comments.
+ ${n_hosts}, ${n_ports} and use them instead hardcoded numbers.
+ Add -cps to existing cps suite names.
+ Remove "trial data overwrite".
+ Compute max rate as in STL suites.
+ Each NAT suite has ip4base suite to compare results to.
- Those act as indirect TRex calibration.
- VPP does not lose packets in those.
+ Latency in ASTF suites is disabled hard.
- As we do not support latency in ASTF profiles yet.
+ Unidirectional tests governed by suite variable, not an argument.
+ Write long argument lists vertically.
+ Prefer to use argument names.
+ In Python, also the last argument is followed by comma.
+ It makes renaming and reordering easier.
+ Similarly applies to prints with long lists of values.
+ A TODO to update api crc file comments.
Change-Id: I84729355edbec051298a9de1162107f88ff5737d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- the specs:
- docs/job_specs/report_iterative/2n-clx/vpp-mlr-00.md
- docs/job_specs/report_iterative/2n-clx/vpp-mrr-00.md
- docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md
- docs/job_specs/report_iterative/2n-skx/vpp-mrr-00.md
take too long. We should consider to remove some tests.
- the coverage specs were split to three parts
Change-Id: I39e2032c76266e159a781d1225cff1a5119d4c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I409b060f64ae7c6787448ae519fd76d8384e9ffb
Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
|
|
Change-Id: I8918f09411254b64abb65a165a0e284f735b306e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I2394b42e177758a8f3ce4aeeb912b264cf3b457c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I7f7e50610e71af7f2b0dc1eed267a421ffd8aef0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|