aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2022-06-14fix(pylint): Some quick pylintsPeter Mikus4-20/+18
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iba133914882485191ad962e36fae70b6fda0af98
2022-06-14trending: fix 3n-alt missing in dashboardViliam Luc2-4/+4
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I356998c521d47f085a78bf2577574ea0d489e02d
2022-06-13feat(uti): remove not neccessary dataTibor Frank4-93/+96
Change-Id: I10f00fce9623ec1dfe34925087e2669ae411e036 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-13feat(dpdk): Bump the version within VMPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ie358593f9977d04aca9e50a14e0d14158e1b0cf1
2022-06-10fix(hoststack): distinguish two tcp tag typesVratko Polak1-4/+8
Previous change did not consider TCP_PPS and TCP_CPS robot tags are used by two different suite types (hoststack or ASTF). This fixes the unintended impact on hoststack. + Add HOSTSTACK tag to VSAP suites. - They could also get VSAP tag, but not needed for this Change. Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a Change-Id: Ic583b5ae336c9b74794706fefc232f221a243c87 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-10fix(core): T-Rex initializationPeter Mikus1-11/+30
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I53226ff6a345ac99c1e2e110712b2ff6197efe95
2022-06-10feat(uti): statistical graphsTibor Frank4-22/+30
Change-Id: Ic05d56dae08e9745582e02e59e8b76145050ca73 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-09feat(uti): Add statistical graphsTibor Frank6-118/+345
Change-Id: Ia2831cfbcb9e2333c5b49af5c6b0577867d99902 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-09Report: Add retest dataTibor Frank1-1/+2
Change-Id: Ic42a15b44e0395c194cdeddef6d91635fd0f9b10 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-09Add Test Suite for VPP WireGuardCui,Cheng3-1/+341
Signed-off-by: Cui,Cheng <cheng.cui@intel.com> Change-Id: I71e257e5f16a887a40ff83d782a9ebdee9d05c34 Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
2022-06-08Report: Add dpdk and re-test dataTibor Frank1-0/+6
Change-Id: Ia078a30f467c9a0eac45a58b83dd82975b815b5a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-07Report: Add rc1, re-test, dpdk dataTibor Frank1-1/+4
Change-Id: I1ae47ee5d0ae21dd17bd6e99d81ab5e8f223f70b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-06Report: Add rc1, dpdk, re-test dataTibor Frank1-5/+21
Change-Id: Icb8c2acccd27a7d2ec0da2b524a743f795f7ab36 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-03Report: Add rc1 dataTibor Frank1-0/+5
Change-Id: I569e49967bdebb02828cd166f7a9164afbbe9205 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-02Report: Add rc1 dataTibor Frank2-2/+6
Change-Id: I06c976cb91d5125d18fc9b2d313c2373f61d88b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-01Report: fix: 3n-altTibor Frank1-5/+4
Change-Id: Idf3d8a393b928cf6f939355d2f6a5af93d18f440 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-01Report: Add 3n-alt rc1 dataTibor Frank1-0/+37
Change-Id: I176dd4a109056b01c2b1b3b11e274b57258b7a02 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-01Report: Add 3n-altTibor Frank2-32/+615
Change-Id: I2a811d5a2e618dc339a3e40c3b8c374a5051649c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-01Report: Remove 3n-awsTibor Frank2-353/+353
Change-Id: I6e065cf25536197c2e414fde017390d54fb3b15c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-01Report: Add rc1 dataTibor Frank2-75/+81
Change-Id: I79678b56fcdc5c8ff8736a87a7437ee145a40459 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-01fix(core): TG exportPeter Mikus1-0/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I80f9f32f10d46eccf1157949a184ec4467d071cd
2022-05-31Framework: exclude env and .git when copyingJuraj Linkeš1-3/+4
The tarball is unnecessarily big, remove superflous directories. Change-Id: I55f6fae64973cfac34a1dc18cbdc688cd416e8b9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2022-05-31Report: Add rc1 dataTibor Frank2-74/+81
Change-Id: I4f83a043c65ac1c968020024d139123a836fb33b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-30PAL: Remove nexus from data sourcesTibor Frank2-99/+3
Change-Id: Iec40f3cb1ca543dc42017ccfb2a663aee1204531 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-30Report: Add rc1 dataTibor Frank1-289/+302
Change-Id: If71ad64c0778793afd9b8d8aff8a55c035b7dbfe Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-30trending: tput 100b tests update + static contentViliam Luc1-22/+94
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Iba05311055b901ca3f5c2714bf0ea1c87525af50
2022-05-26trending: fix missing csit-trex-perf-ndrpdr in trending emailsViliam Luc1-1/+1
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I62af32fd69af35491f3ed97ffc6ff31fb3f19720
2022-05-26fix(core): TG exportPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I60313cd62a878bb713832f14121a938a81c954ed
2022-05-25Report: Configure report rls2206Tibor Frank4-2377/+2706
Change-Id: If5cb8bfd0af11c9a9d35bac8de7a9c8f8c59092b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-24fix(uti): Add TG type exportPeter Mikus8-32/+164
- This is actually bug not a feature. - AB to be added later - Tested on TREX and iPerf3 Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ib6f2d13e3b9401a9fb5759e42a8a310ee11b9d41
2022-05-24feat(uti): Use only 1 workerPeter Mikus2-3/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I84d20520abd58f698dac936ee06163e1b5b20e04
2022-05-23fix(dash): improve date formatting in hoverVratko Polak2-4/+4
Bring it closer to RFC 3339 while keeping spaces. The fully compatible format (2022-03-29T08:45:02Z) may look too exotic for average human. Dates other than in hover (e.g. in Time Period selection) are not affected by this Change. Change-Id: Ic5033d1b0db8505b0919e6a1392e28004c718f21 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-20report,trending: updated tput test to 100BViliam Luc2-92/+68
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I4af6076dc0f02b952a04a3d3a5729b82f8a1e354
2022-05-20feat(uti): Infra updatesPeter Mikus1-1/+8
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I82f84b81f4a016c8bd503e60caacf34f24d407d5
2022-05-19feat(uti): Deploy tuningPeter Mikus2-0/+12
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6f83e88a34997183fa2e7ac5bfe52b9bce50c906
2022-05-19feat(uti): Add iterative dataTibor Frank14-488/+1969
Change-Id: Iaa7253b377f019235289f6bbf48eafd850a2dfc8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-18Add gtpu flow offload test suiteYulong Pei4-3/+49
The implementation of GTPU offload rx is to use ip4_gtpu flow MARK action of NIC and vpp flow REDIRECT_TO_NODE and BUFFER_ADVANCE fuction to direct received gtpu flow to gtpu4-flow-input graph node, skipped ethernet-input, ip4-input, ip4-lookup, ip4-local, ip4-udp-lookup normal graph node processing. Verified on 3n-clx and Intel E810 NIC environment, single core with 64B packet, performance improve ~33% that compare with pure software way. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I2af4589448bdb1729e4ce206a8cf3a1239c61af8 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2022-05-17feat(perf): T-Rex core usage 2n-zn2Peter Mikus1-2/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ife55633c620a3c762f4d939013a7f6fafb640aa6
2022-05-17feat(uti): Values in hover as integers (no decimals)Tibor Frank1-5/+5
Change-Id: I3b4246a77daeb41ec23e6de341fafdfad5ed657b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-17feat(uti): Add list of failed tests to statsTibor Frank4-11/+68
Change-Id: Ie0bedafc7be3235fe696af4f356e95f64773e783 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-16feat(perf): T-Rex core usagePeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id0e7d31dc1368140c2c829fb2fcab009fbbed26d
2022-05-16Core: T-rex 2.97pmikus3-10/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Id4d84aa7268080843b099fd7ab9851234612968b
2022-05-16feat(uti): set styles for url dialogTibor Frank3-29/+58
Change-Id: I27e741436be82499c84371018a4f03f2330cbab4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-12feat(uti): Trending - add encoded and zipped urlTibor Frank2-33/+118
Change-Id: I0148999ed5fe3f7e51078545b88e2bb2d2481884 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-11feat(uti): Statistics - base64 encoded urlTibor Frank2-23/+114
Change-Id: Iab6d5c62ab35778127bb328a032a63cd7c21d0bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-10feat(uti): Statistics - add urlTibor Frank1-37/+105
Change-Id: Ied1ec832379dad4965ad2299834d2eaa7d1a4c88 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09feat(uti): data to csvTibor Frank2-15/+29
Change-Id: Iebc24dae2b76408f07c145b2638c346193cf8e1e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-09feat(uti): tooltipsTibor Frank6-62/+196
Change-Id: I615affce80f1e6af9ea0a5d581b84e17ee88e458 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-05feat(uti): Generate structure of tests from data for trendingTibor Frank5-2045/+273
Change-Id: I14a59da85112473fde342b2f687bd87256a7d416 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-03feat(astf): Support framesizes for ASTFVratko Polak7-116/+266
- No support for IMIX. + Fix a bad bug in padding (most ASTF profiles had wrong frame sizes). + Fix a big typo in TCP PPS profiles (s->c was not data, just RST). + Control transaction size via ASTF_N_DATA_FRAMES env variable. - Default value 5 leads to transactions smaller than before. + It ensures transaction is one burst (per direction) even for jumbo. + Edit autogen to set supported frame sizes based on suite id. + Both TCP and UDP use the same values: + 64B for CPS (exact for UDP, nominal for TCP). + 100B, 1518B and 9000B for TPUT and PPS. - TCP TPUT achievable minimum is 70B. + Used 100B to leave room for possible IPv6 ASTF tests. + Separate function for code reused by vpp and trex tests. - I do not really like the new "copy and edit" approach added here. + But it is a quick edit, better autogen refactor is low priority. + Consider both established and transitory sessions as valid. - Mostly for compatibility with 2202 behavior and to avoid ramp-ups. - Assuming both session states have similar enough VPP CPU overhead. + Added a TODO to investigate and maybe reconsider later. + Update the state timeout value to 240s. + That is the default for TCP (for transitory state). - UDP could keep using 300s. + But I prefer UDP and TCP to behave as similarly as possible. + Use TRex tunables to get the exact frame size (for data packets). - It is not clear why the recipe for MSS has to be this complicated. + Move code away from profile init, as frame size is not known there. + Change internal profile API, so values related to MSS are passed. + Lower ramp-up rate for TCP TPUT tests. + Because without lower rate, jumbo fails on packet loss in ramp-up. + UDP TPUT ramp-up rate also lowered (just to keep suites more similar). + Distinguish one-direction and aggregated average frame size. + Update keyword documentation where the distiction matters. + One-direction is needed for turning bandwidth limit to TPS limit. + Aggregated is needed for correct NDRPDR bandwidth result value. - TCP TPUT will always be few percent below bidirectional maximum. + That is unavoidable, as one direction sends more control packets. + Add runtime consistency checks so future refactors are safer. + Fail if padding requested would be negative. + Fail if suite claims unexpected values for packets per transaction. + Edit the 4 types of ASTF profiles to keep them similar to each other. + Move UDP TPUT limit value from a field back to direct argument. + Stop pretending first UDP packet is not data. + Apply small improvements where convenient. + Replace "aggregate" with "aggregated" where possible. + To lower probability of any future typos in variable names. + Avoid calling Set Numeric Frame Sizes twice. + Code formatting, keyword documentation, code comments, ... + Add TODOs for less important code quality improvements. - Postpone updating of methodology pages to a subsequent change. Change-Id: I4b381e5210e69669f972326202fdcc5a2c9c923b Signed-off-by: Vratko Polak <vrpolak@cisco.com>