aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2022-05-05feat(uti): Generate structure of tests from data for trendingTibor Frank5-2045/+273
Change-Id: I14a59da85112473fde342b2f687bd87256a7d416 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-03feat(astf): Support framesizes for ASTFVratko Polak7-116/+266
- No support for IMIX. + Fix a bad bug in padding (most ASTF profiles had wrong frame sizes). + Fix a big typo in TCP PPS profiles (s->c was not data, just RST). + Control transaction size via ASTF_N_DATA_FRAMES env variable. - Default value 5 leads to transactions smaller than before. + It ensures transaction is one burst (per direction) even for jumbo. + Edit autogen to set supported frame sizes based on suite id. + Both TCP and UDP use the same values: + 64B for CPS (exact for UDP, nominal for TCP). + 100B, 1518B and 9000B for TPUT and PPS. - TCP TPUT achievable minimum is 70B. + Used 100B to leave room for possible IPv6 ASTF tests. + Separate function for code reused by vpp and trex tests. - I do not really like the new "copy and edit" approach added here. + But it is a quick edit, better autogen refactor is low priority. + Consider both established and transitory sessions as valid. - Mostly for compatibility with 2202 behavior and to avoid ramp-ups. - Assuming both session states have similar enough VPP CPU overhead. + Added a TODO to investigate and maybe reconsider later. + Update the state timeout value to 240s. + That is the default for TCP (for transitory state). - UDP could keep using 300s. + But I prefer UDP and TCP to behave as similarly as possible. + Use TRex tunables to get the exact frame size (for data packets). - It is not clear why the recipe for MSS has to be this complicated. + Move code away from profile init, as frame size is not known there. + Change internal profile API, so values related to MSS are passed. + Lower ramp-up rate for TCP TPUT tests. + Because without lower rate, jumbo fails on packet loss in ramp-up. + UDP TPUT ramp-up rate also lowered (just to keep suites more similar). + Distinguish one-direction and aggregated average frame size. + Update keyword documentation where the distiction matters. + One-direction is needed for turning bandwidth limit to TPS limit. + Aggregated is needed for correct NDRPDR bandwidth result value. - TCP TPUT will always be few percent below bidirectional maximum. + That is unavoidable, as one direction sends more control packets. + Add runtime consistency checks so future refactors are safer. + Fail if padding requested would be negative. + Fail if suite claims unexpected values for packets per transaction. + Edit the 4 types of ASTF profiles to keep them similar to each other. + Move UDP TPUT limit value from a field back to direct argument. + Stop pretending first UDP packet is not data. + Apply small improvements where convenient. + Replace "aggregate" with "aggregated" where possible. + To lower probability of any future typos in variable names. + Avoid calling Set Numeric Frame Sizes twice. + Code formatting, keyword documentation, code comments, ... + Add TODOs for less important code quality improvements. - Postpone updating of methodology pages to a subsequent change. Change-Id: I4b381e5210e69669f972326202fdcc5a2c9c923b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-03feat(uti): Add structured menu for statsTibor Frank3-28/+287
Change-Id: I907606b1b994e991975f887611750d23fd7f1634 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-05-02trending: fix failing trending jobViliam Luc3-19/+1
3n-aws job was recently removed which caused trending jobs to fail. For historical reason we keep 3n-aws in trending until 180 days period pass. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I7b59fc4b6f1b46bf910bc540cf37dd042df9c64a
2022-04-27feat(uti): Add constant TIME_PERIODTibor Frank5-20/+73
It defines the time period from now back to the past from which data is raed to dataframes. Change-Id: Ic6feeb8e7958d69aa2e39922b48e9898e09b45dd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-27feat(uti): Add offcanvas to statsTibor Frank2-27/+108
Change-Id: I5d807944b0158e51998bfc709a87d9d6c826112c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-27feat(uti): Form layoutPeter Mikus1-7/+11
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1c00a9b3ffa69b1a0be1d51bb72d13516293afd2
2022-04-27feat(uti): Add init files to dirsTibor Frank4-0/+48
Change-Id: Ic643da296861350b4d86eaec0245c8312f3c1a35 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-26feat(uti): Add statisticsTibor Frank11-15/+669
Change-Id: I14046fd1050f130d201bbe81a72e48ad4fd10057 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-26fix(tgtest): filter by TG NIC modelVratko Polak1-3/+9
The previous path computation code was only correct for tests with DUT (and TG). There, we only want to filter by DUT NICs, but not TG NICs (e.g. to allow testing E810 DUT with MLX TG). But for tests without DUT (still with TG), we do indeed want to filter by NICs on TG, so this patch does that. Change-Id: Ia482c6327af7bca26353ad6e503ae224d90cb3a4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-04-22feat(uti): swap buttonsTibor Frank1-6/+6
Change-Id: I0c0069a37783658099fb11d7fa15f45b6d0dc3cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-21feat(uti): Form layoutPeter Mikus1-28/+34
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ibea233e89ef87b684adba65ad3a4a13524d32809
2022-04-21feat(uti): optimize offcanvasTibor Frank1-27/+24
Change-Id: I323e6743ed3f77b552b0556806ad8d7a4ba5675c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-21feat(uti): Remove button "Display"Tibor Frank2-11/+10
- not needed Change-Id: Ic2bc74af1574e766c007f310f626c2e9ba61bbc1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-20feat(uti): Form layoutPeter Mikus1-5/+20
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id065f8ecd0571567f1f679bdd70c46794fc71a94
2022-04-20feat(uti): list of selected testsTibor Frank1-21/+31
Change-Id: I7ddfb7afd62f4a30c4f5c0ebc1df86d32354b2cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-20feat(uti): plotting area with default viewTibor Frank1-33/+77
Change-Id: I150d6b79f869734385204a2236fe8608474a213d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-20feat(uti): Add copyable text also to anomaliesTibor Frank1-2/+12
Change-Id: I4d850985bafc00594c61e5cf1c2ece2be6a90b1f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-20feat(uti): hrdh latency graphTibor Frank3-16/+19
Change-Id: Ib08b31b6dda79c66f4d204145a1b2ed78e9636b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-19feat(uti): Form layoutPeter Mikus1-103/+154
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Icc0fd99492c75ce41104c70cc5df279949c8265e
2022-04-19feat(uti): re-work the callbacksTibor Frank1-215/+338
Change-Id: I5394b562be7991ab268521362270e0771a6528af Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-19telemetry: convert openmetrics to readable outputViliam Luc1-1/+42
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I4b12f8e49a473ff54ca30d9ed3f02798136c6971
2022-04-19feat(uti): Cover theme syncPeter Mikus4-21/+26
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8ffe4311a67790066fd82a5ac6c3661e95533693
2022-04-19feat(uti): Add c&p to offcanvasTibor Frank1-2/+12
Change-Id: I235f78d1e7fab94114958dee8aba004bee6b6b03 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-14feat(uti): Add offcanvasTibor Frank1-155/+108
Change-Id: Ibb83c43162db9c90f816faa2572187a69bb8a0b3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-14feat(uti): Refactor plotting areaTibor Frank1-34/+76
Change-Id: Ib3fce8f8f011b50919c1abebed21c7e962913650 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-14feat(uti): Refactor grid layoutPeter Mikus3-337/+326
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I992ac4f2a4ecfa779c9fbf393a2f4dfa8cea704f
2022-04-13feat(uti): Refactor stylingPeter Mikus19-486/+80
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I7880e58b2b97b1c365da7755784d3f93e85568cc
2022-04-13Trending: Add 3n-alt - fixesTibor Frank2-11/+11
Change-Id: I017bcc3ef9e9ceb4e8110c8d58a5f4ef1e46db15 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-12Trending: Add 3n-altTibor Frank3-0/+256
Change-Id: I2614c5688697f4b58c523cc8abe2aa34c11730a1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-12UTI: UX StylingTibor Frank4-160/+165
Change-Id: I54e3992f81db04c7c978b2157dafd067de917664 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-11feat(telemetry): T-Rex runtimePeter Mikus1-1/+36
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2829b5931e5a63a33f524e1d14ffb20c27f4ce5a
2022-04-08UTI: Improvements in detailed hover metadata informationTibor Frank2-169/+240
Change-Id: I65c1a4a229869166c256aa320a54a74669519959 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-07Revert "feat(core): Add dpdk log level"Peter Mikus3-6/+6
This reverts commit 22bfd741614145d86751df2d61ff77af9db63627. Reason for revert: OMFG this patch is causing 90% perf degradation on AWS Change-Id: Id081f61ae849678b6b877fbf03309c4b1b0c6df6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2022-04-07UTI: Display HDRH Latency for chosen sampleTibor Frank5-64/+243
Change-Id: Ia0cf83c3aa789ce5a0a9e0c1b8d86144226827a7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-05VppConfigGenerator: disable vpp cli pagerDave Wallace2-2/+8
- Robot framework logs contain 'show pci' output from VPP that is truncated due to the VPP cli pager. Add UNIX cli-no-pager configuration to the default startup config to fix this issue. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I80f2cd045063245098f22eb638a9796c5031fecf
2022-04-04feat(core): update 3n-altJuraj Linkeš1-2/+10
Update ansible, topologies, bash scripts and job specs. Change-Id: I834b991f281e0b29b4af9dc37fe8028460298d83 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2022-04-04UTI: Display Latency graphTibor Frank4-103/+311
- Display Latency graph below the ndrpdr throughput graph for the same test set Change-Id: I5c6475ccc1a849dbe299f78939b40ef6f6076634 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-04-04telemetry: error message handling part2Viliam Luc4-10/+25
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I4d8de4e6ccff25c0c1dcf66c192c56710939bf7d
2022-04-01UTI: PoC - Make detailed hover information copyableTibor Frank3-3/+25
Change-Id: Ib313d6289412b921caa528c3984a640c3e4862eb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-31telemetry: fix Linux bundlesViliam Luc2-3/+4
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I71c795c211652f353d3afd81908d04969dd3e067
2022-03-31telemetry: error message handlingViliam Luc8-35/+125
Change-Id: I3bc07072337d45ff24acfbb75cced3b0b052b6f5 Signed-off-by: Viliam Luc <vluc@cisco.com>
2022-03-30feat(terraform): 1n_aws_c5nPeter Mikus1-16/+26
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I12d2d58de01693b18628cd73b5d8c36467506f32
2022-03-30refactor(terraform): 2n_aws_c5nPeter Mikus2-5/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5f68fd84a9ea034c5d8ff175807033aa0b60d5a2
2022-03-30UTI: PoC - Add trendingTibor Frank3-34/+219
Change-Id: I77f201a662076aef7e0d6dffcd5f6c835ee10e99 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-29UTI: PoC - Read data from parquetsTibor Frank9-190/+2426
Change-Id: Ie53954b2b8695ed9e5415ea604a8f3b229552489 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-23UTI: PoC - Dash application for TrendingTibor Frank5-159/+492
- functional UI without styling - uses csv files as a source of data for graphs Change-Id: I0b7b67cdf928aec6a668b3e151e84ecfd600f959 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-03-21feat(core): Add dpdk log levelPeter Mikus3-6/+6
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8af9bae81ec83a3195ae83febd978882ebc2474d
2022-03-17feat(dash): Terraform AWS Beanstalk splitPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6a9f54be0f734cd267c7ea5aa7f9933e04a8e139
2022-03-17Report: Fix typoTibor Frank1-1/+1
Change-Id: I3e414068f8e7f619ffec9bda490d682874fe649f Signed-off-by: Tibor Frank <tifrank@cisco.com>