aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-05-31Framework: exclude env and .git when copyingJuraj Linkeš1-3/+4
The tarball is unnecessarily big, remove superflous directories. Change-Id: I55f6fae64973cfac34a1dc18cbdc688cd416e8b9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2022-05-31Report: Add rc1 dataTibor Frank2-74/+81
Change-Id: I4f83a043c65ac1c968020024d139123a836fb33b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-30PAL: Remove nexus from data sourcesTibor Frank2-99/+3
Change-Id: Iec40f3cb1ca543dc42017ccfb2a663aee1204531 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-30Report: Add rc1 dataTibor Frank1-289/+302
Change-Id: If71ad64c0778793afd9b8d8aff8a55c035b7dbfe Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-30feat(infra): Update AWS AMIsPeter Mikus3-5/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1fd9351b2c3448809bdef282c23eedd1ca3364a7
2022-05-30trending: tput 100b tests update + static contentViliam Luc13-22/+550
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Iba05311055b901ca3f5c2714bf0ea1c87525af50
2022-05-30feat(docs): Add e810 for 2n-clxPeter Mikus18-86/+216
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I607ccd5d4b28dca576e40b79285bb2b31a65d76c
2022-05-30Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Ia8d310749ef074f3eaaf1251b9b5106a978ea42d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-26trending: fix missing csit-trex-perf-ndrpdr in trending emailsViliam Luc1-1/+1
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I62af32fd69af35491f3ed97ffc6ff31fb3f19720
2022-05-26feat(docs): Add e810 for 2n-clxPeter Mikus10-37/+393
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I59f9df885907c7ce316e95a65fe98e9637820d01
2022-05-26fix(core): TG exportPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I60313cd62a878bb713832f14121a938a81c954ed
2022-05-26feat(infra): remove 2n-skxPeter Mikus3-66/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id263f260ecb7a7a11b8c7eb64b415418da36c5c8
2022-05-26feat(infra): remove 2n-skxPeter Mikus1-155/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Idabdef957f6191c6a05bc82fb8f86d3015b67fc7
2022-05-25Report: Configure report rls2206Tibor Frank9-2390/+2873
Change-Id: If5cb8bfd0af11c9a9d35bac8de7a9c8f8c59092b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-25feat(etl): optimizationPeter Mikus2-2/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2f313d5967e1ac745b817c4074487ccf56940b0a
2022-05-25feat(etl): report 2206Peter Mikus1-143/+147
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I159860b7da1bd03f5cdf6a35c59221c079c863b1
2022-05-25feat(etl): report 2206Peter Mikus9-4/+88
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I61fc4187ecd9948c2a8091229c5670f9c73e82ae
2022-05-24fix(uti): Add TG type exportPeter Mikus26-145/+229
- This is actually bug not a feature. - AB to be added later - Tested on TREX and iPerf3 Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ib6f2d13e3b9401a9fb5759e42a8a310ee11b9d41
2022-05-24feat(uti): Use only 1 workerPeter Mikus2-3/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I84d20520abd58f698dac936ee06163e1b5b20e04
2022-05-23fix(dash): improve date formatting in hoverVratko Polak2-4/+4
Bring it closer to RFC 3339 while keeping spaces. The fully compatible format (2022-03-29T08:45:02Z) may look too exotic for average human. Dates other than in hover (e.g. in Time Period selection) are not affected by this Change. Change-Id: Ic5033d1b0db8505b0919e6a1392e28004c718f21 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-23Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I7fa27b403f8e12d8c36728d462762dacd05de852 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-20report,trending: updated tput test to 100BViliam Luc2-92/+68
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I4af6076dc0f02b952a04a3d3a5729b82f8a1e354
2022-05-20feat(uti): Infra updatesPeter Mikus4-11/+18
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I82f84b81f4a016c8bd503e60caacf34f24d407d5
2022-05-19feat(uti): Deploy tuningPeter Mikus2-0/+12
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6f83e88a34997183fa2e7ac5bfe52b9bce50c906
2022-05-19feat(uti): Add iterative dataTibor Frank14-488/+1969
Change-Id: Iaa7253b377f019235289f6bbf48eafd850a2dfc8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-19fix(jobspec): use 100b for tput and pps testsVratko Polak20-288/+288
For TCP tests, 1518b is closer to what the real traffic would be, but as usual we want smaller sizes to stress VPP before filling line. CPS tests remain at 64b. Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a Change-Id: Id16056b63006bb569a600fa1d9e318fd2853a5c8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-18fix(trex): use reset instead of clear_profileVratko Polak2-4/+3
Now sure why clear_profile gets stuck with v2.97 (unless block=False), but calling reset() works, and will be less risky next time we bump TRex version. - Only ASTF for now. Change-Id: Ib6906fb8ce269e888bf0e0438d3309931d5e9981 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-18Add gtpu flow offload test suiteYulong Pei9-47/+243
The implementation of GTPU offload rx is to use ip4_gtpu flow MARK action of NIC and vpp flow REDIRECT_TO_NODE and BUFFER_ADVANCE fuction to direct received gtpu flow to gtpu4-flow-input graph node, skipped ethernet-input, ip4-input, ip4-lookup, ip4-local, ip4-udp-lookup normal graph node processing. Verified on 3n-clx and Intel E810 NIC environment, single core with 64B packet, performance improve ~33% that compare with pure software way. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I2af4589448bdb1729e4ce206a8cf3a1239c61af8 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2022-05-17feat(perf): T-Rex core usage 2n-zn2Peter Mikus1-2/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ife55633c620a3c762f4d939013a7f6fafb640aa6
2022-05-17fix(uti): Terraform settingsPeter Mikus3-2/+79
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ica539512f3129391551938541d00d9e9d1560af3
2022-05-17feat(uti): Values in hover as integers (no decimals)Tibor Frank1-5/+5
Change-Id: I3b4246a77daeb41ec23e6de341fafdfad5ed657b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-17feat(uti): Add list of failed tests to statsTibor Frank4-11/+68
Change-Id: Ie0bedafc7be3235fe696af4f356e95f64773e783 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-17infra(ansible): Jammy placeholderPeter Mikus15-62/+55
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I693841cadf33d23e417374b949771ba7c3dbccd2
2022-05-16feat(perf): T-Rex core usagePeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id0e7d31dc1368140c2c829fb2fcab009fbbed26d
2022-05-16Core: T-rex 2.97pmikus11-23/+17
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Id4d84aa7268080843b099fd7ab9851234612968b
2022-05-16feat(uti): set styles for url dialogTibor Frank3-29/+58
Change-Id: I27e741436be82499c84371018a4f03f2330cbab4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-16Ansible: T-rex 2.97pmikus1-0/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7d5e00c45648dd4ae9e03ce1c7d0f2d2c53db476
2022-05-16Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I3a549ec0a0d8d060fdc9e5642c589454eaae93cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-12feat(uti): Trending - add encoded and zipped urlTibor Frank2-33/+118
Change-Id: I0148999ed5fe3f7e51078545b88e2bb2d2481884 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-11feat(uti): Statistics - base64 encoded urlTibor Frank2-23/+114
Change-Id: Iab6d5c62ab35778127bb328a032a63cd7c21d0bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-10feat(infra): Mellanox compatibility MatrixPeter Mikus12-44/+78
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iec87340aed64dd72e5289bd13af27c177f92c466
2022-05-10feat(uti): Statistics - add urlTibor Frank1-37/+105
Change-Id: Ied1ec832379dad4965ad2299834d2eaa7d1a4c88 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09feat(uti): data to csvTibor Frank2-15/+29
Change-Id: Iebc24dae2b76408f07c145b2638c346193cf8e1e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09feat(uti): tooltipsTibor Frank6-62/+196
Change-Id: I615affce80f1e6af9ea0a5d581b84e17ee88e458 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I5e48e9d9759b456c8e4b67815045e8376632df65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-05feat(uti): Generate structure of tests from data for trendingTibor Frank5-2045/+273
Change-Id: I14a59da85112473fde342b2f687bd87256a7d416 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-03feat(astf): Support framesizes for ASTFVratko Polak63-1114/+2022
- No support for IMIX. + Fix a bad bug in padding (most ASTF profiles had wrong frame sizes). + Fix a big typo in TCP PPS profiles (s->c was not data, just RST). + Control transaction size via ASTF_N_DATA_FRAMES env variable. - Default value 5 leads to transactions smaller than before. + It ensures transaction is one burst (per direction) even for jumbo. + Edit autogen to set supported frame sizes based on suite id. + Both TCP and UDP use the same values: + 64B for CPS (exact for UDP, nominal for TCP). + 100B, 1518B and 9000B for TPUT and PPS. - TCP TPUT achievable minimum is 70B. + Used 100B to leave room for possible IPv6 ASTF tests. + Separate function for code reused by vpp and trex tests. - I do not really like the new "copy and edit" approach added here. + But it is a quick edit, better autogen refactor is low priority. + Consider both established and transitory sessions as valid. - Mostly for compatibility with 2202 behavior and to avoid ramp-ups. - Assuming both session states have similar enough VPP CPU overhead. + Added a TODO to investigate and maybe reconsider later. + Update the state timeout value to 240s. + That is the default for TCP (for transitory state). - UDP could keep using 300s. + But I prefer UDP and TCP to behave as similarly as possible. + Use TRex tunables to get the exact frame size (for data packets). - It is not clear why the recipe for MSS has to be this complicated. + Move code away from profile init, as frame size is not known there. + Change internal profile API, so values related to MSS are passed. + Lower ramp-up rate for TCP TPUT tests. + Because without lower rate, jumbo fails on packet loss in ramp-up. + UDP TPUT ramp-up rate also lowered (just to keep suites more similar). + Distinguish one-direction and aggregated average frame size. + Update keyword documentation where the distiction matters. + One-direction is needed for turning bandwidth limit to TPS limit. + Aggregated is needed for correct NDRPDR bandwidth result value. - TCP TPUT will always be few percent below bidirectional maximum. + That is unavoidable, as one direction sends more control packets. + Add runtime consistency checks so future refactors are safer. + Fail if padding requested would be negative. + Fail if suite claims unexpected values for packets per transaction. + Edit the 4 types of ASTF profiles to keep them similar to each other. + Move UDP TPUT limit value from a field back to direct argument. + Stop pretending first UDP packet is not data. + Apply small improvements where convenient. + Replace "aggregate" with "aggregated" where possible. + To lower probability of any future typos in variable names. + Avoid calling Set Numeric Frame Sizes twice. + Code formatting, keyword documentation, code comments, ... + Add TODOs for less important code quality improvements. - Postpone updating of methodology pages to a subsequent change. Change-Id: I4b381e5210e69669f972326202fdcc5a2c9c923b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-03feat(uti): Add structured menu for statsTibor Frank3-28/+287
Change-Id: I907606b1b994e991975f887611750d23fd7f1634 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-02Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I5207153be2b3231633ee3c16ac78a099bd60893f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-02trending: fix failing trending jobViliam Luc3-19/+1
3n-aws job was recently removed which caused trending jobs to fail. For historical reason we keep 3n-aws in trending until 180 days period pass. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I7b59fc4b6f1b46bf910bc540cf37dd042df9c64a