aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-06-01Report: Remove 3n-awsTibor Frank74-468/+417
Change-Id: I6e065cf25536197c2e414fde017390d54fb3b15c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 466bf87200ec963f4d7f809454876212c9273b0a)
2022-06-01Report: Add rc1 dataTibor Frank2-75/+81
Change-Id: I79678b56fcdc5c8ff8736a87a7437ee145a40459 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 700100edcef04a78f3f8a9f99ced2d170d01875f)
2022-06-01fix(core): TG exportPeter Mikus1-0/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I80f9f32f10d46eccf1157949a184ec4467d071cd (cherry picked from commit ed9140f77876c00b6caff6b9d76c516a493be921)
2022-05-31Report: Add rc1 dataTibor Frank2-74/+81
Change-Id: I4f83a043c65ac1c968020024d139123a836fb33b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7afe43cad35079b93c223a2553e0e8746ddbc4c7)
2022-05-30PAL: Remove nexus from data sourcesTibor Frank2-99/+3
Change-Id: Iec40f3cb1ca543dc42017ccfb2a663aee1204531 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 83baf715f77d68e2d90ef279d34a85c8f51d0883)
2022-05-30Report: Add rc1 dataTibor Frank1-289/+302
Change-Id: If71ad64c0778793afd9b8d8aff8a55c035b7dbfe Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5a7175b6a9fc0a6cd31441a203cd711796e56108)
2022-05-30feat(infra): Update AWS AMIsPeter Mikus3-5/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1fd9351b2c3448809bdef282c23eedd1ca3364a7 (cherry picked from commit 63f02ab0e082f49b5fbc47f1e6f42c63fdb3b54f)
2022-05-30trending: tput 100b tests update + static contentViliam Luc13-22/+550
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Iba05311055b901ca3f5c2714bf0ea1c87525af50 (cherry picked from commit 36a4b3bd44f4da3740b69011dadc43e212864c11)
2022-05-30feat(docs): Add e810 for 2n-clxPeter Mikus18-86/+216
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I607ccd5d4b28dca576e40b79285bb2b31a65d76c (cherry picked from commit 66b77bbd243e65346b593577fe7d2d0d85614626)
2022-05-26feat(docs): Add e810 for 2n-clxPeter Mikus10-37/+393
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I59f9df885907c7ce316e95a65fe98e9637820d01 (cherry picked from commit 28f1f3e4735386efae45630c8347b35089a3897c)
2022-05-26fix(core): TG exportPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I60313cd62a878bb713832f14121a938a81c954ed (cherry picked from commit 14b538d836f6a3562cf8df506bc09a53ec0ca950)
2022-05-26feat(infra): remove 2n-skxPeter Mikus1-155/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Idabdef957f6191c6a05bc82fb8f86d3015b67fc7 (cherry picked from commit 67f7039576834e2feefb0fad223cb5c9c8ad852d)
2022-05-26Update VPP_STABLE_VER filesTibor Frank3-3/+3
Change-Id: I851ee5f597927fe39b4eac4aa745c4f5f7ca58b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-25Report: Configure report rls2206Tibor Frank9-2390/+2873
Change-Id: If5cb8bfd0af11c9a9d35bac8de7a9c8f8c59092b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-25feat(etl): optimizationPeter Mikus2-2/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2f313d5967e1ac745b817c4074487ccf56940b0a
2022-05-25feat(etl): report 2206Peter Mikus1-143/+147
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I159860b7da1bd03f5cdf6a35c59221c079c863b1
2022-05-25feat(etl): report 2206Peter Mikus9-4/+88
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I61fc4187ecd9948c2a8091229c5670f9c73e82ae
2022-05-24fix(uti): Add TG type exportPeter Mikus26-145/+229
- This is actually bug not a feature. - AB to be added later - Tested on TREX and iPerf3 Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ib6f2d13e3b9401a9fb5759e42a8a310ee11b9d41
2022-05-24feat(uti): Use only 1 workerPeter Mikus2-3/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I84d20520abd58f698dac936ee06163e1b5b20e04
2022-05-23fix(dash): improve date formatting in hoverVratko Polak2-4/+4
Bring it closer to RFC 3339 while keeping spaces. The fully compatible format (2022-03-29T08:45:02Z) may look too exotic for average human. Dates other than in hover (e.g. in Time Period selection) are not affected by this Change. Change-Id: Ic5033d1b0db8505b0919e6a1392e28004c718f21 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-23Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I7fa27b403f8e12d8c36728d462762dacd05de852 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-20report,trending: updated tput test to 100BViliam Luc2-92/+68
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I4af6076dc0f02b952a04a3d3a5729b82f8a1e354
2022-05-20feat(uti): Infra updatesPeter Mikus4-11/+18
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I82f84b81f4a016c8bd503e60caacf34f24d407d5
2022-05-19feat(uti): Deploy tuningPeter Mikus2-0/+12
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6f83e88a34997183fa2e7ac5bfe52b9bce50c906
2022-05-19feat(uti): Add iterative dataTibor Frank14-488/+1969
Change-Id: Iaa7253b377f019235289f6bbf48eafd850a2dfc8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-19fix(jobspec): use 100b for tput and pps testsVratko Polak20-288/+288
For TCP tests, 1518b is closer to what the real traffic would be, but as usual we want smaller sizes to stress VPP before filling line. CPS tests remain at 64b. Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a Change-Id: Id16056b63006bb569a600fa1d9e318fd2853a5c8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-18fix(trex): use reset instead of clear_profileVratko Polak2-4/+3
Now sure why clear_profile gets stuck with v2.97 (unless block=False), but calling reset() works, and will be less risky next time we bump TRex version. - Only ASTF for now. Change-Id: Ib6906fb8ce269e888bf0e0438d3309931d5e9981 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-18Add gtpu flow offload test suiteYulong Pei9-47/+243
The implementation of GTPU offload rx is to use ip4_gtpu flow MARK action of NIC and vpp flow REDIRECT_TO_NODE and BUFFER_ADVANCE fuction to direct received gtpu flow to gtpu4-flow-input graph node, skipped ethernet-input, ip4-input, ip4-lookup, ip4-local, ip4-udp-lookup normal graph node processing. Verified on 3n-clx and Intel E810 NIC environment, single core with 64B packet, performance improve ~33% that compare with pure software way. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I2af4589448bdb1729e4ce206a8cf3a1239c61af8 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2022-05-17feat(perf): T-Rex core usage 2n-zn2Peter Mikus1-2/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ife55633c620a3c762f4d939013a7f6fafb640aa6
2022-05-17fix(uti): Terraform settingsPeter Mikus3-2/+79
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ica539512f3129391551938541d00d9e9d1560af3
2022-05-17feat(uti): Values in hover as integers (no decimals)Tibor Frank1-5/+5
Change-Id: I3b4246a77daeb41ec23e6de341fafdfad5ed657b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-17feat(uti): Add list of failed tests to statsTibor Frank4-11/+68
Change-Id: Ie0bedafc7be3235fe696af4f356e95f64773e783 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-17infra(ansible): Jammy placeholderPeter Mikus15-62/+55
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I693841cadf33d23e417374b949771ba7c3dbccd2
2022-05-16feat(perf): T-Rex core usagePeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id0e7d31dc1368140c2c829fb2fcab009fbbed26d
2022-05-16Core: T-rex 2.97pmikus11-23/+17
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Id4d84aa7268080843b099fd7ab9851234612968b
2022-05-16feat(uti): set styles for url dialogTibor Frank3-29/+58
Change-Id: I27e741436be82499c84371018a4f03f2330cbab4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-16Ansible: T-rex 2.97pmikus1-0/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7d5e00c45648dd4ae9e03ce1c7d0f2d2c53db476
2022-05-16Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I3a549ec0a0d8d060fdc9e5642c589454eaae93cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-12feat(uti): Trending - add encoded and zipped urlTibor Frank2-33/+118
Change-Id: I0148999ed5fe3f7e51078545b88e2bb2d2481884 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-11feat(uti): Statistics - base64 encoded urlTibor Frank2-23/+114
Change-Id: Iab6d5c62ab35778127bb328a032a63cd7c21d0bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-10feat(infra): Mellanox compatibility MatrixPeter Mikus12-44/+78
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iec87340aed64dd72e5289bd13af27c177f92c466
2022-05-10feat(uti): Statistics - add urlTibor Frank1-37/+105
Change-Id: Ied1ec832379dad4965ad2299834d2eaa7d1a4c88 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09feat(uti): data to csvTibor Frank2-15/+29
Change-Id: Iebc24dae2b76408f07c145b2638c346193cf8e1e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09feat(uti): tooltipsTibor Frank6-62/+196
Change-Id: I615affce80f1e6af9ea0a5d581b84e17ee88e458 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I5e48e9d9759b456c8e4b67815045e8376632df65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-05feat(uti): Generate structure of tests from data for trendingTibor Frank5-2045/+273
Change-Id: I14a59da85112473fde342b2f687bd87256a7d416 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-03feat(astf): Support framesizes for ASTFVratko Polak63-1114/+2022
- No support for IMIX. + Fix a bad bug in padding (most ASTF profiles had wrong frame sizes). + Fix a big typo in TCP PPS profiles (s->c was not data, just RST). + Control transaction size via ASTF_N_DATA_FRAMES env variable. - Default value 5 leads to transactions smaller than before. + It ensures transaction is one burst (per direction) even for jumbo. + Edit autogen to set supported frame sizes based on suite id. + Both TCP and UDP use the same values: + 64B for CPS (exact for UDP, nominal for TCP). + 100B, 1518B and 9000B for TPUT and PPS. - TCP TPUT achievable minimum is 70B. + Used 100B to leave room for possible IPv6 ASTF tests. + Separate function for code reused by vpp and trex tests. - I do not really like the new "copy and edit" approach added here. + But it is a quick edit, better autogen refactor is low priority. + Consider both established and transitory sessions as valid. - Mostly for compatibility with 2202 behavior and to avoid ramp-ups. - Assuming both session states have similar enough VPP CPU overhead. + Added a TODO to investigate and maybe reconsider later. + Update the state timeout value to 240s. + That is the default for TCP (for transitory state). - UDP could keep using 300s. + But I prefer UDP and TCP to behave as similarly as possible. + Use TRex tunables to get the exact frame size (for data packets). - It is not clear why the recipe for MSS has to be this complicated. + Move code away from profile init, as frame size is not known there. + Change internal profile API, so values related to MSS are passed. + Lower ramp-up rate for TCP TPUT tests. + Because without lower rate, jumbo fails on packet loss in ramp-up. + UDP TPUT ramp-up rate also lowered (just to keep suites more similar). + Distinguish one-direction and aggregated average frame size. + Update keyword documentation where the distiction matters. + One-direction is needed for turning bandwidth limit to TPS limit. + Aggregated is needed for correct NDRPDR bandwidth result value. - TCP TPUT will always be few percent below bidirectional maximum. + That is unavoidable, as one direction sends more control packets. + Add runtime consistency checks so future refactors are safer. + Fail if padding requested would be negative. + Fail if suite claims unexpected values for packets per transaction. + Edit the 4 types of ASTF profiles to keep them similar to each other. + Move UDP TPUT limit value from a field back to direct argument. + Stop pretending first UDP packet is not data. + Apply small improvements where convenient. + Replace "aggregate" with "aggregated" where possible. + To lower probability of any future typos in variable names. + Avoid calling Set Numeric Frame Sizes twice. + Code formatting, keyword documentation, code comments, ... + Add TODOs for less important code quality improvements. - Postpone updating of methodology pages to a subsequent change. Change-Id: I4b381e5210e69669f972326202fdcc5a2c9c923b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-03feat(uti): Add structured menu for statsTibor Frank3-28/+287
Change-Id: I907606b1b994e991975f887611750d23fd7f1634 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-02Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I5207153be2b3231633ee3c16ac78a099bd60893f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-02trending: fix failing trending jobViliam Luc3-19/+1
3n-aws job was recently removed which caused trending jobs to fail. For historical reason we keep 3n-aws in trending until 180 days period pass. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I7b59fc4b6f1b46bf910bc540cf37dd042df9c64a