diff options
author | 2022-04-25 10:22:05 +0200 | |
---|---|---|
committer | 2022-05-03 15:23:47 +0000 | |
commit | 1daa6fdc0bae284dee1b61f34534e59b60b7526a (patch) | |
tree | 6314e011a8f029c4332586d5fd05b51d1a69a89c /tests/vpp/perf/ip4/2n1l-10ge2p1x710-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr.robot | |
parent | cd417be7f836eb9346fad4f87bd4f75dc1d9a429 (diff) |
feat(astf): Support framesizes for ASTF
- No support for IMIX.
+ Fix a bad bug in padding (most ASTF profiles had wrong frame sizes).
+ Fix a big typo in TCP PPS profiles (s->c was not data, just RST).
+ Control transaction size via ASTF_N_DATA_FRAMES env variable.
- Default value 5 leads to transactions smaller than before.
+ It ensures transaction is one burst (per direction) even for jumbo.
+ Edit autogen to set supported frame sizes based on suite id.
+ Both TCP and UDP use the same values:
+ 64B for CPS (exact for UDP, nominal for TCP).
+ 100B, 1518B and 9000B for TPUT and PPS.
- TCP TPUT achievable minimum is 70B.
+ Used 100B to leave room for possible IPv6 ASTF tests.
+ Separate function for code reused by vpp and trex tests.
- I do not really like the new "copy and edit" approach added here.
+ But it is a quick edit, better autogen refactor is low priority.
+ Consider both established and transitory sessions as valid.
- Mostly for compatibility with 2202 behavior and to avoid ramp-ups.
- Assuming both session states have similar enough VPP CPU overhead.
+ Added a TODO to investigate and maybe reconsider later.
+ Update the state timeout value to 240s.
+ That is the default for TCP (for transitory state).
- UDP could keep using 300s.
+ But I prefer UDP and TCP to behave as similarly as possible.
+ Use TRex tunables to get the exact frame size (for data packets).
- It is not clear why the recipe for MSS has to be this complicated.
+ Move code away from profile init, as frame size is not known there.
+ Change internal profile API, so values related to MSS are passed.
+ Lower ramp-up rate for TCP TPUT tests.
+ Because without lower rate, jumbo fails on packet loss in ramp-up.
+ UDP TPUT ramp-up rate also lowered (just to keep suites more similar).
+ Distinguish one-direction and aggregated average frame size.
+ Update keyword documentation where the distiction matters.
+ One-direction is needed for turning bandwidth limit to TPS limit.
+ Aggregated is needed for correct NDRPDR bandwidth result value.
- TCP TPUT will always be few percent below bidirectional maximum.
+ That is unavoidable, as one direction sends more control packets.
+ Add runtime consistency checks so future refactors are safer.
+ Fail if padding requested would be negative.
+ Fail if suite claims unexpected values for packets per transaction.
+ Edit the 4 types of ASTF profiles to keep them similar to each other.
+ Move UDP TPUT limit value from a field back to direct argument.
+ Stop pretending first UDP packet is not data.
+ Apply small improvements where convenient.
+ Replace "aggregate" with "aggregated" where possible.
+ To lower probability of any future typos in variable names.
+ Avoid calling Set Numeric Frame Sizes twice.
+ Code formatting, keyword documentation, code comments, ...
+ Add TODOs for less important code quality improvements.
- Postpone updating of methodology pages to a subsequent change.
Change-Id: I4b381e5210e69669f972326202fdcc5a2c9c923b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Diffstat (limited to 'tests/vpp/perf/ip4/2n1l-10ge2p1x710-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr.robot')
-rw-r--r-- | tests/vpp/perf/ip4/2n1l-10ge2p1x710-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr.robot | 48 |
1 files changed, 36 insertions, 12 deletions
diff --git a/tests/vpp/perf/ip4/2n1l-10ge2p1x710-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr.robot b/tests/vpp/perf/ip4/2n1l-10ge2p1x710-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr.robot index b1dbdfa0ae..d2b08f7e10 100644 --- a/tests/vpp/perf/ip4/2n1l-10ge2p1x710-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr.robot +++ b/tests/vpp/perf/ip4/2n1l-10ge2p1x710-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr.robot @@ -1,4 +1,4 @@ -# Copyright (c) 2021 Cisco and/or its affiliates. +# Copyright (c) 2022 Cisco and/or its affiliates. # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at: @@ -86,12 +86,12 @@ | ${n_ports}= | ${63} | ${n_sessions}= | ${${n_hosts} * ${n_ports}} | ${transaction_scale}= | ${n_sessions} -| ${packets_per_transaction_and_direction}= | ${33} +| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES} # Main heap size multiplicator | ${heap_size_mult}= | ${7} # Ramp-up settings # This scale needs more than 55 ktps, which is more than current NDR results. -| ${ramp_up_rate}= | ${56000} +| ${ramp_up_rate}= | ${30000} # Traffic profile | ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps | ${transaction_type}= | udp_pps @@ -136,14 +136,38 @@ | | And Verify NAT44 UDP sessions number on DUT1 node *** Test Cases *** -| 64B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr -| | [Tags] | 64B | 1C -| | frame_size=${64} | phy_cores=${1} +| 100B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr +| | [Tags] | 100B | 1C +| | frame_size=${100} | phy_cores=${1} -| 64B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr -| | [Tags] | 64B | 2C -| | frame_size=${64} | phy_cores=${2} +| 100B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr +| | [Tags] | 100B | 2C +| | frame_size=${100} | phy_cores=${2} -| 64B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr -| | [Tags] | 64B | 4C -| | frame_size=${64} | phy_cores=${4} +| 100B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr +| | [Tags] | 100B | 4C +| | frame_size=${100} | phy_cores=${4} + +| 1518B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr +| | [Tags] | 1518B | 1C +| | frame_size=${1518} | phy_cores=${1} + +| 1518B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr +| | [Tags] | 1518B | 2C +| | frame_size=${1518} | phy_cores=${2} + +| 1518B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr +| | [Tags] | 1518B | 4C +| | frame_size=${1518} | phy_cores=${4} + +| 9000B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr +| | [Tags] | 9000B | 1C +| | frame_size=${9000} | phy_cores=${1} + +| 9000B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr +| | [Tags] | 9000B | 2C +| | frame_size=${9000} | phy_cores=${2} + +| 9000B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr +| | [Tags] | 9000B | 4C +| | frame_size=${9000} | phy_cores=${4} |