aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-08-15feat(jumpavg): speed up, use Python 3.8 featuresVratko Polak7-264/+221
+ The main speedup comes from abandoning copy.deepcopy(), doing shallow list copies (at most) and introcuding copy_fast(). + Turn into dataclasses whenever possible, use type hints. + Simplify the partition search code, + It is now clearer the time complexity is O(N*(N+n)), where N is number of samples, and n is the average size of the last group of the current record glist. + Used black for formatting, so no u"" anymore. + Update metadata for 0.3.0 release. Change-Id: I302203b4d42aeb22be1128e2fe72353a44eae5d0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-08-15Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I6a1ff4e7b21b7bfca6cdb0ced433858c6a8aa56d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-15PAL: Do not process oper data for iter and trendTibor Frank1-4/+6
to save the RAM. Change-Id: I6ac7b162ee6789635a6cba3d58d45a9c65a7024b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-12fix(hoststack): add a missing endVratko Polak1-0/+1
Change-Id: I07de784de4bfd1e1fa4230567331e55a72d1a7de Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-08-12PAL: fix in ExecutionCheckerTibor Frank1-4/+4
Change-Id: Ie269fe1a0bc338f2a84240665984a56fd07ce805 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-12PAL: Re-work the ExecutionChecker classTibor Frank1-737/+430
- needed due to moving to the latest version of Robot Framework Change-Id: Ie2fc3d57630ddb79a9d96e5a4b118f4932745670 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-11Trending: weekly comparison - workaroundTibor Frank1-5/+8
- Temporary solution: use build number if vpp version is not available Change-Id: I256ac987cb234f27bfdd052cb44f5d8968c1cffa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-10PAL: suite visitor 2Tibor Frank1-1/+0
Change-Id: Ic95836e8108d4efd845313db8da7f76f3b8492d1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-10PAL: suite visitorTibor Frank1-2/+10
Change-Id: Icab58df411935bad46b5e4ca84288d1631cfe2e8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-10PAL: fix typoTibor Frank1-1/+1
Change-Id: I0287f1d7afa535bc028446de39a9441e05b392a3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-10PAL: visit_setup_kwTibor Frank1-5/+3
Change-Id: I8367c07f590c2e4533173284f009da6d26692e5d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-10PAL: vpp_versionTibor Frank3-22/+22
Change-Id: Id01389d5bac005b0812182551053f354511e24d1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-10feat(pip): set jinja2==3.0.3Tibor Frank1-1/+1
- jinja2>=3.1.0 causes ImportError: cannot import name 'environmentfilter' from 'jinja2' Change-Id: If293d932775474a1eacc019210fb58ee7601c99f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-09PAL: Add debug output to table_weekly_comparisonTibor Frank1-1/+13
Change-Id: Ibb117e49e2ff5d3381a9d081c3f6eed6721abe51 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-09PAL: robot.model.totalstatistics.TotalStatisticsTibor Frank1-3/+3
Change-Id: If59ae966d3fa8b1944391088b0efc7bddae3c6db Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-09PAL: Update to RF 5.0 and pandas.SeriesTibor Frank1-18/+15
Change-Id: I2d4bfc6be02e66b6242ad688d092516bca0eb739 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-09PAL: Update to RobotFramework 5.0Tibor Frank1-5/+5
Change-Id: I03340f47b5f4d5aa2bb6d33589b0d13e4671a75d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-08Revert "job-spec: Add VSAP and Hoststack to weekly and coverage"Peter Mikus4-54/+18
This reverts commit dc200e7f96297b3bccecb88b4e951b142617734b. Reason for revert: This is breaking results due to test_type variable set to vsap without supporting model and results itself. It makes the output not usable for trending. Change-Id: I1c4fee87e9bcaed6fc010ebbf570f65208519fad Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2022-08-08feat(pip): UpgradePeter Mikus5-112/+101
Due to some integration changes with upcoming Ubuntu 22.04 (and mainly python) bump, upgrading the full pip package list to latest version. Keyword 'BuiltIn.Run Keyword Unless' is deprecated - will be part of subsequent change Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ie3bdc424c7c0efb4fe4f1fa7c73137b916c17116
2022-08-08fix(etl): Adjust resourcesPeter Mikus4-153/+153
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3f4dcd24285bd162c2d9ab159a4928671b27feb4
2022-08-08Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Iba43ce72b1d6850a554c4c0d8bdeb0ee0955b81a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-05feat(uti): Add some more debug toolsPeter Mikus3-0/+105
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1dfe1782334c8415fe5dbcdba24781947076639d
2022-08-04fix(doc): IP addressesPeter Mikus3-26/+26
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ibfc7fe47ff091b9b734f72857313455c922b6888
2022-08-04feat(infra): Migrate ARM nomad to JammyPeter Mikus11-36/+36
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I600d5ecc725f8e82219feed2abcdeaa43e78a30b
2022-08-03UTI: Add Download for iterative data.Tibor Frank7-52/+222
Change-Id: I79bcfc2449310d4d186146ce79b2143a33ed2d1f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-03fix(terraform): IP addressesPeter Mikus6-64/+25
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iac8d82bf741b2f8a2fb366f024e3f1b92cfd8662
2022-08-03feat(infra): Remove decommissioned serversPeter Mikus28-1155/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I641af1bb944592ad454eb9f54cffe9f3d0b872bb
2022-08-03feat(ansible): Migrate Ubuntu Jammy IV.Peter Mikus13-102/+103
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia48ee3f9bbcdfd7b85968362b1fb7f816dcd97be
2022-08-03feat(pxe): Migrate Ubuntu Jammy I.Peter Mikus122-476/+1052
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8f79882fce6375a55d67167781fc6b4212934e06
2022-08-02job-spec: Add VSAP and Hoststack to weekly and coverageTibor Frank4-18/+54
- VSAP: run on 2n-clx - Hoststack: run on 3n-icx Change-Id: I9fb54353b0cb61192769eb46e5e8e6849f6f8887 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-02Report: Set NIC limmits according to constant.pyTibor Frank1-14/+14
Change-Id: I5d8d1bff4a1244a8819a4eb5c9756ea6c6749345 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-02Trending: Prepare static content for the new UTITibor Frank8-450/+30
- Chapter "jenkins jobs": deleted, the neccesary information is in "Performance Tests". - Chapter "perpatch_performance_tests": deleted, should be somewhere else. - Chapter "testbed_hw_configuration": no information was there for years. - Chapter "performance_tests": deleted. - Other chapters: Edited, updated, simplyfied. Change-Id: I04dffffea1200a9bf792458022ce868021c94745 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-01Report: Add 2n-tx2 LXC/DRC Container Memif graphsTibor Frank9-2/+268
- Packet Throughput - Speedup Multi-Core - Packet Latency Change-Id: Ia98a44a5fad8676832d8c5beb687e1fd68e30d41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-08-01ansible: add Arm dev ssh keys to tx2 VPP DeviceJuraj Linkeš2-0/+4
Add keys of: Jieqiang Wang <Jieqiang.Wang@arm.com> Tianyu Li <Tianyu.Li@arm.com> Only add the keys to ThunderX2 VPP Device servers for debugging purposes. Change-Id: I4dcffa598134d0e9e287a8506f8275909a91c020 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2022-08-01Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I7f37c27dfa2c621349ba3d47af3703523a65a6fb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-27UTI: Code clean-upTibor Frank6-43/+313
Change-Id: Ia88f3ce646664eeb4f2bb96e25fe1c2e433d7423 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-27Report: NAT44 udp tput graphsTibor Frank7-339/+0
Change-Id: Ia5108792ec32d8c2ff68bba953c77be536aba379 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-27fix: start testpmd and l3fwd in 3 cyclesViliam Luc10-188/+201
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I935ee5cf5bd7e760ef29fdc338f981e4e7cc333f
2022-07-27Report: NAT44 graphsTibor Frank2-23/+40
Change-Id: Ia0dc9483cd615398193cbc9be059b8ce29e53eb5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-26UTI: code clean-upTibor Frank7-279/+413
Change-Id: I492370e20ad0e7431aaf86af618ed874104c4ad5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-26fix(report): update the text part of release notesVratko Polak3-35/+6
Change-Id: I7c5b95b3b547f4d9a9359b0c688d621c3709b6f1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-07-26Report: Add NAT44 testsTibor Frank19-111/+479
Change-Id: I757331b2c1fafe80f1e0e7cf10db5690912823f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-25feat(jobspec): improve tput selectionVratko Polak8-120/+96
+ Revert bad edit on 2n-dnv, add 1518b back. + Add 1c ip4base tput everywhere nat44ed tput is tested. + Both tcp and udp. + Use only 1c tests for ip4base tput. + Use the same selection in mrr as in mlr. - 2n-tx2 and 2n-zn2 still have no ASTF tests. - ASTF tests still only tested on xxv710, no 100ge tests yet. Change-Id: I0bfc1fa372c5020f1a6f2f4564c4b44f578ac328 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-07-25Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I046ab0834f228d393ae282b8a6cf402a37b470e2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-22UTI: Add URL support to "News"Tibor Frank2-4/+57
Change-Id: Ic3d878e02d1237a4e1e05aba7bd0747ef6c66515 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-21UTI: Move common functions to utils.Tibor Frank7-300/+244
Change-Id: Ic390359afcea7855a964f8f9793f6d17a5b9b616 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-21UTI: Move constatns to a separate fileTibor Frank19-530/+493
Change-Id: If3796b71d02bcf5a92612585dfa8867e5039f037 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-20fix(jobspec): switch tcp tput back to 100bVratko Polak15-180/+180
Change-Id: Id16649044ac0385d55766197fb921c38009c0da8 Ticket: CSIT-1830 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-07-20fix(astf): avoid issues in pps tputVratko Polak6-45/+76
When more than 1 data packet is sent in the same chunk, TRex is sometimes not fully deterministic in its usage of delayed ACKs. This changes the "application protocol" to sent 5 chunks (1 data packet each), c2s and s2c interleaved, so each subsequent chunk acts as an ACK. The overall packet count remains the same, and even though this interleaved way may be more demanding on TRex CPU, preliminary results show NAT performance is still well below ip4base performance. As a side effect, the interleaved way seems to work also for 100B data frames, so we are avoiding two issues at once. Ticket: CSIT-1846 Ticket: CSIT-1830 Change-Id: Ia4dcfa7c89f2c08fc32bd6118e2e009316b33c25 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-07-20UTI: Add regressions and progressionsTibor Frank6-74/+239
Change-Id: Ic5febe8fc1bd5ccd9699e73003783484240cbd07 Signed-off-by: Tibor Frank <tifrank@cisco.com>