aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-05-19feat(uti): Add iterative dataTibor Frank14-488/+1969
Change-Id: Iaa7253b377f019235289f6bbf48eafd850a2dfc8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-19fix(jobspec): use 100b for tput and pps testsVratko Polak20-288/+288
For TCP tests, 1518b is closer to what the real traffic would be, but as usual we want smaller sizes to stress VPP before filling line. CPS tests remain at 64b. Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a Change-Id: Id16056b63006bb569a600fa1d9e318fd2853a5c8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-18fix(trex): use reset instead of clear_profileVratko Polak2-4/+3
Now sure why clear_profile gets stuck with v2.97 (unless block=False), but calling reset() works, and will be less risky next time we bump TRex version. - Only ASTF for now. Change-Id: Ib6906fb8ce269e888bf0e0438d3309931d5e9981 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-18Add gtpu flow offload test suiteYulong Pei9-47/+243
The implementation of GTPU offload rx is to use ip4_gtpu flow MARK action of NIC and vpp flow REDIRECT_TO_NODE and BUFFER_ADVANCE fuction to direct received gtpu flow to gtpu4-flow-input graph node, skipped ethernet-input, ip4-input, ip4-lookup, ip4-local, ip4-udp-lookup normal graph node processing. Verified on 3n-clx and Intel E810 NIC environment, single core with 64B packet, performance improve ~33% that compare with pure software way. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I2af4589448bdb1729e4ce206a8cf3a1239c61af8 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2022-05-17feat(perf): T-Rex core usage 2n-zn2Peter Mikus1-2/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ife55633c620a3c762f4d939013a7f6fafb640aa6
2022-05-17fix(uti): Terraform settingsPeter Mikus3-2/+79
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ica539512f3129391551938541d00d9e9d1560af3
2022-05-17feat(uti): Values in hover as integers (no decimals)Tibor Frank1-5/+5
Change-Id: I3b4246a77daeb41ec23e6de341fafdfad5ed657b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-17feat(uti): Add list of failed tests to statsTibor Frank4-11/+68
Change-Id: Ie0bedafc7be3235fe696af4f356e95f64773e783 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-17infra(ansible): Jammy placeholderPeter Mikus15-62/+55
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I693841cadf33d23e417374b949771ba7c3dbccd2
2022-05-16feat(perf): T-Rex core usagePeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id0e7d31dc1368140c2c829fb2fcab009fbbed26d
2022-05-16Core: T-rex 2.97pmikus11-23/+17
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Id4d84aa7268080843b099fd7ab9851234612968b
2022-05-16feat(uti): set styles for url dialogTibor Frank3-29/+58
Change-Id: I27e741436be82499c84371018a4f03f2330cbab4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-16Ansible: T-rex 2.97pmikus1-0/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7d5e00c45648dd4ae9e03ce1c7d0f2d2c53db476
2022-05-16Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I3a549ec0a0d8d060fdc9e5642c589454eaae93cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-12feat(uti): Trending - add encoded and zipped urlTibor Frank2-33/+118
Change-Id: I0148999ed5fe3f7e51078545b88e2bb2d2481884 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-11feat(uti): Statistics - base64 encoded urlTibor Frank2-23/+114
Change-Id: Iab6d5c62ab35778127bb328a032a63cd7c21d0bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-10feat(infra): Mellanox compatibility MatrixPeter Mikus12-44/+78
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iec87340aed64dd72e5289bd13af27c177f92c466
2022-05-10feat(uti): Statistics - add urlTibor Frank1-37/+105
Change-Id: Ied1ec832379dad4965ad2299834d2eaa7d1a4c88 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09feat(uti): data to csvTibor Frank2-15/+29
Change-Id: Iebc24dae2b76408f07c145b2638c346193cf8e1e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09feat(uti): tooltipsTibor Frank6-62/+196
Change-Id: I615affce80f1e6af9ea0a5d581b84e17ee88e458 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I5e48e9d9759b456c8e4b67815045e8376632df65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-05feat(uti): Generate structure of tests from data for trendingTibor Frank5-2045/+273
Change-Id: I14a59da85112473fde342b2f687bd87256a7d416 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-03feat(astf): Support framesizes for ASTFVratko Polak63-1114/+2022
- No support for IMIX. + Fix a bad bug in padding (most ASTF profiles had wrong frame sizes). + Fix a big typo in TCP PPS profiles (s->c was not data, just RST). + Control transaction size via ASTF_N_DATA_FRAMES env variable. - Default value 5 leads to transactions smaller than before. + It ensures transaction is one burst (per direction) even for jumbo. + Edit autogen to set supported frame sizes based on suite id. + Both TCP and UDP use the same values: + 64B for CPS (exact for UDP, nominal for TCP). + 100B, 1518B and 9000B for TPUT and PPS. - TCP TPUT achievable minimum is 70B. + Used 100B to leave room for possible IPv6 ASTF tests. + Separate function for code reused by vpp and trex tests. - I do not really like the new "copy and edit" approach added here. + But it is a quick edit, better autogen refactor is low priority. + Consider both established and transitory sessions as valid. - Mostly for compatibility with 2202 behavior and to avoid ramp-ups. - Assuming both session states have similar enough VPP CPU overhead. + Added a TODO to investigate and maybe reconsider later. + Update the state timeout value to 240s. + That is the default for TCP (for transitory state). - UDP could keep using 300s. + But I prefer UDP and TCP to behave as similarly as possible. + Use TRex tunables to get the exact frame size (for data packets). - It is not clear why the recipe for MSS has to be this complicated. + Move code away from profile init, as frame size is not known there. + Change internal profile API, so values related to MSS are passed. + Lower ramp-up rate for TCP TPUT tests. + Because without lower rate, jumbo fails on packet loss in ramp-up. + UDP TPUT ramp-up rate also lowered (just to keep suites more similar). + Distinguish one-direction and aggregated average frame size. + Update keyword documentation where the distiction matters. + One-direction is needed for turning bandwidth limit to TPS limit. + Aggregated is needed for correct NDRPDR bandwidth result value. - TCP TPUT will always be few percent below bidirectional maximum. + That is unavoidable, as one direction sends more control packets. + Add runtime consistency checks so future refactors are safer. + Fail if padding requested would be negative. + Fail if suite claims unexpected values for packets per transaction. + Edit the 4 types of ASTF profiles to keep them similar to each other. + Move UDP TPUT limit value from a field back to direct argument. + Stop pretending first UDP packet is not data. + Apply small improvements where convenient. + Replace "aggregate" with "aggregated" where possible. + To lower probability of any future typos in variable names. + Avoid calling Set Numeric Frame Sizes twice. + Code formatting, keyword documentation, code comments, ... + Add TODOs for less important code quality improvements. - Postpone updating of methodology pages to a subsequent change. Change-Id: I4b381e5210e69669f972326202fdcc5a2c9c923b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-03feat(uti): Add structured menu for statsTibor Frank3-28/+287
Change-Id: I907606b1b994e991975f887611750d23fd7f1634 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-02Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I5207153be2b3231633ee3c16ac78a099bd60893f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-02trending: fix failing trending jobViliam Luc3-19/+1
3n-aws job was recently removed which caused trending jobs to fail. For historical reason we keep 3n-aws in trending until 180 days period pass. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I7b59fc4b6f1b46bf910bc540cf37dd042df9c64a
2022-04-27feat(infra): Terraform updatesPeter Mikus5-147/+158
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3d7ecad9125e3ff55c0b4e1da5cda5a1ff22d690
2022-04-27feat(uti): Add constant TIME_PERIODTibor Frank5-20/+73
It defines the time period from now back to the past from which data is raed to dataframes. Change-Id: Ic6feeb8e7958d69aa2e39922b48e9898e09b45dd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-27feat(uti): Add offcanvas to statsTibor Frank2-27/+108
Change-Id: I5d807944b0158e51998bfc709a87d9d6c826112c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-27feat(uti): Form layoutPeter Mikus1-7/+11
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1c00a9b3ffa69b1a0be1d51bb72d13516293afd2
2022-04-27feat(uti): Add init files to dirsTibor Frank4-0/+48
Change-Id: Ic643da296861350b4d86eaec0245c8312f3c1a35 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-26feat(infra): Onboard Mellanox III.Peter Mikus32-95/+72
+ DPDK matrix Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I473265ae1ebf08e1518a6b6e2998abdc750167d1
2022-04-26feat(uti): Add statisticsTibor Frank11-15/+669
Change-Id: I14046fd1050f130d201bbe81a72e48ad4fd10057 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-26fix(tgtest): filter by TG NIC modelVratko Polak1-3/+9
The previous path computation code was only correct for tests with DUT (and TG). There, we only want to filter by DUT NICs, but not TG NICs (e.g. to allow testing E810 DUT with MLX TG). But for tests without DUT (still with TG), we do indeed want to filter by NICs on TG, so this patch does that. Change-Id: Ia482c6327af7bca26353ad6e503ae224d90cb3a4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-04-25feat(infra): Onboard Mellanox II.Peter Mikus3-45/+77
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ifd90f6b77f49e2a6907262d6f1e3da19ef275ac6
2022-04-25feat(infra): AWS Beanstalk adjustmentsPeter Mikus3-5/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iad492c1a848052de4e5a7cb50dd3312d25234e2e
2022-04-25Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: If6d3461a2712a6854e3d80d8ac04329f2debd029 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-22feat(uti): swap buttonsTibor Frank1-6/+6
Change-Id: I0c0069a37783658099fb11d7fa15f45b6d0dc3cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-21feat(infra): Onboard Mellanox I.Peter Mikus1-13/+23
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I47781b9d0cf6c08d12ac36774b9093c3934d9ee6
2022-04-21feat(uti): Form layoutPeter Mikus1-28/+34
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ibea233e89ef87b684adba65ad3a4a13524d32809
2022-04-21feat(uti): optimize offcanvasTibor Frank1-27/+24
Change-Id: I323e6743ed3f77b552b0556806ad8d7a4ba5675c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-21feat(uti): Remove button "Display"Tibor Frank2-11/+10
- not needed Change-Id: Ic2bc74af1574e766c007f310f626c2e9ba61bbc1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-20feat(uti): Form layoutPeter Mikus1-5/+20
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id065f8ecd0571567f1f679bdd70c46794fc71a94
2022-04-20feat(uti): list of selected testsTibor Frank1-21/+31
Change-Id: I7ddfb7afd62f4a30c4f5c0ebc1df86d32354b2cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-20feat(uti): plotting area with default viewTibor Frank1-33/+77
Change-Id: I150d6b79f869734385204a2236fe8608474a213d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-20feat(uti): Add copyable text also to anomaliesTibor Frank1-2/+12
Change-Id: I4d850985bafc00594c61e5cf1c2ece2be6a90b1f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-20feat(uti): hrdh latency graphTibor Frank3-16/+19
Change-Id: Ib08b31b6dda79c66f4d204145a1b2ed78e9636b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-19feat(uti): Form layoutPeter Mikus1-103/+154
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Icc0fd99492c75ce41104c70cc5df279949c8265e
2022-04-19feat(uti): re-work the callbacksTibor Frank1-215/+338
Change-Id: I5394b562be7991ab268521362270e0771a6528af Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-19telemetry: convert openmetrics to readable outputViliam Luc1-1/+42
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I4b12f8e49a473ff54ca30d9ed3f02798136c6971