Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: If5cc42bac1c49d1f1d960e0812ab352564bc29d2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I720b7c96a6ac9f328aff57437e51254364604911
|
|
The new suites were added in [1]
and the VPP functionality was removed in [2].
[1] https://gerrit.fd.io/r/c/csit/+/28508
[2] https://gerrit.fd.io/r/c/vpp/+/31443
Change-Id: Id3fa984bf9f61a1dd831d637695ac6844c86ffc8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
|
|
Change-Id: I8c27b5956c0c26bb2de48321675e285ed961412f
Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I69ee305b25b9e05d2305cb82aba71ef6418780ab
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ib93dc1552945fe91ab5346b9b759d56c7468debf
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I8d168979ab9722e0056e97edb228f29cbfa245e3
|
|
Also add IPsec 10000tnlhwasync int mode and 4tnlhwasync policy mode
test suites, in order to compare sw crypto and QAT crypto and IPsec
int mode and policy mode performance.
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I0aed06a0c75c1a545720649d3561a0aa5a861db2
|
|
Previously, the Set up LDP or VCL Nginx on DUT node keyword
was wrongly documenting its "dut" argument as type string,
while using the value as a node dict instead.
As most of the code already used direct dut1 variables,
this patch eliminates the dut argument altogether
and puts DUT1 into the keyword name.
Change-Id: Ie29afc175b98c1b1cb554438da9178738662d108
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Add ipsec reassembly test cases to bring in line with 3n-icx.
Add ipsec policy test cases with flow cache enabled for both inbound and
outbound traffic.
Remove GTPU hardware tests as the NIC doesn't support GTPU offload RX.
Change-Id: I7b18914f983d5974b390f995ec638a64b9bbccbb
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Change-Id: I6ec27d787b59d4bc13b8c04f4217302cc3021581
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I676696928fd1758c9dddf4f2580b9e924fe71b53
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia13e920ef11d364893a51957778e60084f4ac0f9
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I5cd45dd59f13e1ca942f44341b5f37e257c2b51e
|
|
In tunneling scenarios, VPP needs to reassembly packet fragments
before decapsulation. Conveniently, VPP also fragments the packets
after encapsulation (at least for some encapsulation protocols)
if they do not fit into MTU.
So this change adds few suites, adapted from existing 3-node ones
which additionally lower MTU on DUT1-DUT2 link.
The intended packet size is 1518B. 64B packets will fit,
and most of IMIX packets will also fit without fragmentation.
VPP refuses to reassembly 9000B packets as they have too many fragments.
+ Add a keyword so suites need only one additional line of code.
+ Add new test tag REASSEMBLY for the added suites.
+ Tell autogen the one soak test case for reaseembly should be 1518B.
- It is possible to increase fragment limit for 9000B, not done yet.
- Ipsec policy suites are added but they should not be used.
- VPP does fragmentation twice (before and after encapsulation).
- VPP does not perform reassembly (only last fragment is decrypted).
- TRex does not realize the packet from VPP is only a fragment.
- The result is false pass with unfairly good performance.
+ Suites still included, to simplify verifying VPP fixes for the above.
Change-Id: If33c60d767fea161d9e4ffabb8ded3d81c8f39ed
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Icb7b6124dcba7bb57c18ceb91120284f6fe02c2e
|
|
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I3708253adf4c7421ff48eee6aefb735b39726359
|
|
This will greatly improve the performance of IPsec policy cases
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: Ib42b5650791be7fcc8649873eaf12616aeba5aec
|
|
Previously, only vhost suites got the plugin.
Fixes: 5e663cf4cfa7c3ce187dc4f223fa94dfb41f484b
Change-Id: I020410581583c6226936aa9480913c751b5e8852
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
VPP routing with one million fib rules also is a key indicator for
performance benchmark
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I19b52f6b96bdc5ed1e76305d258825fb17bd3af9
|
|
- convert hoststack tests to use app-api-socket instead
of vpp-api-socket
Change-Id: Ibcd87f3624e33168ed3afcb30267262efc927e7c
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
* remove evt_qs_memfd_seg and evt_qs_seg_size as they are obsolete
* use app socket api instead of vpp's api
* apply rx and tx descriptors constraints
* increase event queue size for nginx tests
Signed-off-by: Filip Tehlar <ftehlar@cisco.com>
Change-Id: Ie7ac12b8f587e0b1962884127e8eb68a4e588aee
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
In order to compare performance number with existed routing based ipip
interface mode 40k tunnels ipsec test.
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I94816a8c18f08b539114d6ca9d4e1218a2b6ea5f
|
|
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I9ff7abda9961d92c98ab08c77e79406644c115fc
|
|
- removed old 1_15_0
- removed old 1_14_2
+ updated job_specs
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ie75cde28f485b809fe08f808f4fa7d31d52c3929
|
|
vxlan is going to a plugin.
https://gerrit.fd.io/r/c/vpp/+/37511
Need to add vxlan_plugin.so to all vxlan test cases
Signed-off-by: Steven Luong <sluong@cisco.com>
Change-Id: Ie7f9c6c61eac4b85aeca769d467ddd0f7d5118f0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
vhost is going to a plugin.
https://gerrit.fd.io/r/c/vpp/+/37488
Need to add vhost_plugin.so to all vhost test cases
Signed-off-by: Steven Luong <sluong@cisco.com>
Change-Id: I5c79795c1ba5ffcdc9d10697faffbc0b49b22abb
|
|
Also add 10k tunnels IPSec policy mode test with spd fast path enabled.
spd fast path is to reduce policy adding time, refer to patchset [1] & [2]
for details.
[1] https://gerrit.fd.io/r/c/vpp/+/36095
[2] https://gerrit.fd.io/r/c/vpp/+/36097
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: yulong pei <yulong.pei@intel.com>
Change-Id: I211b38a60d273c46e68a5b5f712090037977c6e6
|
|
Add VPP wireguard async mode test suite to use QAT device for crypto.
Also change keyword ipsechw to cryptohw in suite_setup.robot since currently
crypto device is not only used by IPSec.
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: Ibdadb3b09c04b7181415ffd4a248abddc6289075
|
|
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I7abd546e67fdbe481b204bb6a1ec7e9c654dcdae
|
|
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I17ced17a309cc0ac21c5fc94e570c89a456339e2
|
|
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I9e499df973fd9990ab02fe7008d12e78b2ab089f
|
|
The test scenario is about two private networks which communication was
protected by ipsec.
The test suites are to show performance impovement about ipsec esp flow
lookup that offloaded by NIC flow director and rss.
Verified on 3n-clx and Intel E810 NIC environment, with 64B ipsec packet
flow, performance improved ~31% with 1C2T, ~110% with 2C4T, ~250% with 4C8T.
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I30aec8c5115e5a6fbef88c11d1bef2624029d1b9
|
|
+ Delete nat44 pps suites.
+ Rename ip4base suites, testcases, suite tags (also tg) to -tput.
+ Also robot tags like UDP_PPS and TCP_PPS.
- Keep traffic types and traffic profile names with pps.
+ They can be renamed in a different change if needed.
+ Update job specs.
- Do not update methodology yet (avoid conflict with another Change).
Ticket: CSIT-1829
Change-Id: Ic0dac441f6e8253edce88e057ab7fad1d3814c24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Previous change did not consider TCP_PPS and TCP_CPS robot tags
are used by two different suite types (hoststack or ASTF).
This fixes the unintended impact on hoststack.
+ Add HOSTSTACK tag to VSAP suites.
- They could also get VSAP tag, but not needed for this Change.
Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a
Change-Id: Ic583b5ae336c9b74794706fefc232f221a243c87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Fixes: 75ef277536c43096e7646430568d97d2cc489238
Change-Id: I94575bee0aa77907cc900b58b186c3612fb18d85
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
Change-Id: I71e257e5f16a887a40ff83d782a9ebdee9d05c34
Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
|
|
- This is actually bug not a feature.
- AB to be added later
- Tested on TREX and iPerf3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib6f2d13e3b9401a9fb5759e42a8a310ee11b9d41
|
|
The implementation of GTPU offload rx is to use ip4_gtpu flow MARK action
of NIC and vpp flow REDIRECT_TO_NODE and BUFFER_ADVANCE fuction to direct
received gtpu flow to gtpu4-flow-input graph node, skipped ethernet-input,
ip4-input, ip4-lookup, ip4-local, ip4-udp-lookup normal graph node
processing.
Verified on 3n-clx and Intel E810 NIC environment, single core with 64B packet,
performance improve ~33% that compare with pure software way.
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I2af4589448bdb1729e4ce206a8cf3a1239c61af8
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
|
|
- No support for IMIX.
+ Fix a bad bug in padding (most ASTF profiles had wrong frame sizes).
+ Fix a big typo in TCP PPS profiles (s->c was not data, just RST).
+ Control transaction size via ASTF_N_DATA_FRAMES env variable.
- Default value 5 leads to transactions smaller than before.
+ It ensures transaction is one burst (per direction) even for jumbo.
+ Edit autogen to set supported frame sizes based on suite id.
+ Both TCP and UDP use the same values:
+ 64B for CPS (exact for UDP, nominal for TCP).
+ 100B, 1518B and 9000B for TPUT and PPS.
- TCP TPUT achievable minimum is 70B.
+ Used 100B to leave room for possible IPv6 ASTF tests.
+ Separate function for code reused by vpp and trex tests.
- I do not really like the new "copy and edit" approach added here.
+ But it is a quick edit, better autogen refactor is low priority.
+ Consider both established and transitory sessions as valid.
- Mostly for compatibility with 2202 behavior and to avoid ramp-ups.
- Assuming both session states have similar enough VPP CPU overhead.
+ Added a TODO to investigate and maybe reconsider later.
+ Update the state timeout value to 240s.
+ That is the default for TCP (for transitory state).
- UDP could keep using 300s.
+ But I prefer UDP and TCP to behave as similarly as possible.
+ Use TRex tunables to get the exact frame size (for data packets).
- It is not clear why the recipe for MSS has to be this complicated.
+ Move code away from profile init, as frame size is not known there.
+ Change internal profile API, so values related to MSS are passed.
+ Lower ramp-up rate for TCP TPUT tests.
+ Because without lower rate, jumbo fails on packet loss in ramp-up.
+ UDP TPUT ramp-up rate also lowered (just to keep suites more similar).
+ Distinguish one-direction and aggregated average frame size.
+ Update keyword documentation where the distiction matters.
+ One-direction is needed for turning bandwidth limit to TPS limit.
+ Aggregated is needed for correct NDRPDR bandwidth result value.
- TCP TPUT will always be few percent below bidirectional maximum.
+ That is unavoidable, as one direction sends more control packets.
+ Add runtime consistency checks so future refactors are safer.
+ Fail if padding requested would be negative.
+ Fail if suite claims unexpected values for packets per transaction.
+ Edit the 4 types of ASTF profiles to keep them similar to each other.
+ Move UDP TPUT limit value from a field back to direct argument.
+ Stop pretending first UDP packet is not data.
+ Apply small improvements where convenient.
+ Replace "aggregate" with "aggregated" where possible.
+ To lower probability of any future typos in variable names.
+ Avoid calling Set Numeric Frame Sizes twice.
+ Code formatting, keyword documentation, code comments, ...
+ Add TODOs for less important code quality improvements.
- Postpone updating of methodology pages to a subsequent change.
Change-Id: I4b381e5210e69669f972326202fdcc5a2c9c923b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Previous edit was restoring the correct formatting for bold text
in suite documentation by a mass replace of single asterisk
to double asterisk.
But in geneve suites, one usage of single asterisk
was numeric multiplication, which was errorneously replaces
with double asterisk (power operation).
This restores the multiplication.
Fixes: e82ebbd96e2ba73276e2f1b6d7f9c2d8a9442c3f
Change-Id: I537ebe59dd8c04768a90a5b61a348c57e3dfd149
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
The previous values were too high for 9000b bandwidth.
In order to avoid any packet loss,
the new values are low enough even for x710 (10 Gbps).
The ramp-up rate is also considerably lowered
for lower scales, to keep the rate constant.
Ramp-up duration slightly increased above the minimum needed
to avoid time overheads, duration stretching and rounding errors.
Ticket: CSIT-1811
Change-Id: Iefa8d4d9344e3876014dc5415a4acfedc5abf429
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I901ef0afce782bf69b7169e0dd08ce06b6f074b0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Replace the hardcoded SPD inbound/outbound ranges with values derived
from test inputs.
Add the necessary routes now that the tunnel endpoints are not in the
same subnet. Also add ip neighbor entry on DUT2 for the same reason.
Also replace ipsec sa dump with show ipsec all in teardown of tests
where both SAs and SPDs are configured to improve troubleshooting.
Change-Id: I7d89a99fcf457a701c87bf6ac07364b62802677d
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I1590d438216e4c886aae03f83364837153623dbc
|
|
+ Model version 1.0.0.
- Only some result types are exported.
+ MRR, NDRPDR and SOAK.
- Other result types to be added later.
+ In contrast, all test types are detected.
+ Convert custom classes to JSON-serializable equivalents.
+ Sort dict keys before converting to JSON.
+ Override the order for some known keys.
+ Export sets as sorted arrays.
+ Convert to info content from serialized raw content.
+ Also export outputs for suite setups and teardowns.
+ Info files for setup/teardown exist only temporarily.
+ The data is merged into suite.info.json file.
+ This simplifies presentation of total suite duration.
+ Define model via JSON schema:
- Just test case, suite setup/teardown/suite to be added later.
- Just info, raw to be added later.
+ Proper descriptions.
+ Json is generated from yaml.
+ This is a convenience for maintainers.
+ The officially used schema is the .json one.
+ TODOs written into a separate .txt file.
+ Validate exported instance against the schema.
+ Include format checking.
+ Update CSIT requirements for validation dependencies.
+ This needs python-dateutil==2.8.2, only a patch bump.
+ Compute bandwidth also for soak tests.
+ This unifies with NDRPDR to simplify schema definition.
- PAL may need an update for parsing soak test message.
+ Include SSH log items, raw output only.
+ Generate all outputs in a single filesystem tree.
+ Move raw outputs into test_output_raw.tar.xz.
+ Rename existing tar with suites to generated_robot_files.tar.xz.
Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib0a853f7bd8cdbb0dee747e4f601bc4e54d006e9
|
|
When building documentation using sphinx we see ~1200 similar warnings [0]
[0] - https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-verify-tox-master-ubuntu2004-x86_64/3289/doc_verify.log.gz
These warning are harmless and can be fixed later
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1ac1099d38935971d47491dde905715345d3935c
|
|
Some testbeds occasionally miss one session with the previous value.
+ Increase ramp-up duration proportionally.
Change-Id: I5300127d7e8fbc670c37ae392ab514b077b3c9b1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|