aboutsummaryrefslogtreecommitdiffstats
path: root/bootstrap-verify-perf.sh
AgeCommit message (Collapse)AuthorFilesLines
2018-08-30CSIT-1135: Scripts for VPP per-patch testingVratko Polak1-396/+4
+ Scripts do not rely on (other) bootstraps. + Perf verify bootstrap is also the new style sript now. + Scripts are divided to functions for better re-use. + Functions are sourced from small number of large "library" files. - Still using jumpavg from pipy. - Perpatch has specific simplified parsing (instead of the PAL one). - Bash style document is in a separate Change. Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-24Adjust TEST_TAGs for timed jobsPeter Mikus1-7/+3
+ remove obsolete bootstraps Change-Id: Iee1fe404106f2fa0c438ff30526e756f037ce676 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-21FIX: Boostrap-perf array assignmentPeter Mikus1-3/+3
Change-Id: I4d7c27dd182ae8e7b68b5f6342c163ac3615cad2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-17Add NIC exclusion for all jobs in perf bootstrapPeter Mikus1-37/+37
This patch is suppose to move the processing logic for all job types, including timed trigger perf jobs. This should eliminate MRR job to run NIC tests not in topology file. Change-Id: I9add5073266bd37fd3ef2c6efe7244b41e85f2a9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-10CSIT-1193 De-duplicate bootstrap scripts into onePeter Mikus1-121/+283
- DPDK and VPP bootstrap merged into one (ligato will follow). - Added more error detections - Added topo-cleanup.py to cleanup TB before and after test. - Remove installation of VPP Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-25Fail bootstrap immediately if no topology foundVratko Polak1-0/+4
Zero topologies might be found if testbeds of some type are all unavailable, or when purposedly restricted Change is verified with a wrong trigger incantation. The previous behavior enters an infinite cycle instead. Change-Id: I9764a79ed4df57c6c99746438431bf1162b7f7ea Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24WORKAROUND: Remove broken SKX-TB out of poolPeter Mikus1-2/+0
Currently T22 and T23 are faulty Tracked in [FD.io Helpdesk #58059] Change-Id: Ib8d474400a7e109a87573e33ca73946208bbb5de Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17Refactor DPDK testcases to new structurePeter Mikus1-2/+2
+ RXQ refactor Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Update skylake tesbed inventoryPeter Mikus1-3/+6
- Add missing topology files - Add missing topologies to bootstrap - Small fixes in ansible Change-Id: I3b9ad60a0adfae9e93e5e700279f7ade81174471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12CSIT-1168 Create bootstrap for 2-node topologyPeter Mikus1-66/+84
Update existing bootstrap to recognize 2node/3node topologies Change-Id: I2f81f9d69d824f7eea608413eac35a1598fad8c6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-09CSIT-1142 Change thread perf test TAGsPeter Mikus1-121/+26
Due to automatization of SMT detection this change is suppose to remove static thread/core tags in favor of dynamic one. Leaving the static tags for number of physical cores to be able to select TCs. Change-Id: I7f99f605821f363e45c333f46d1dea786693521b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-28Add New Skylake topology filesPeter Mikus1-3/+3
Change-Id: I6109729ee303806f69bba365c93b4de67b9a8c32 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-19Use pkg download script in bootstrap filesPeter Mikus1-26/+13
Download specific version of VPP/DKMS via download script. Change-Id: I6585790224d746a9edea7fa6624e810f389218e6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-14CSIT-PERF: New trigger designPeter Mikus1-0/+32
- CSIT-1128 - This patch is implementing processing of TAGS specified as part of commit message Change-Id: Iad0923d22fae369dfe923a917e1c0d47d5cbf656 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-13FIX: TAG processingPeter Mikus1-1/+1
Change-Id: I08815de519532e8a20873f8b172d3f42ccfa33fb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-13FIX: TAG processingPeter Mikus1-12/+18
- Improve TAG post processing Change-Id: I5a36f5874ea747cbcae2562fc58c9f5abe9bac02 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-12Mask out LBOND_DPDK tags from per patch verificationPeter Mikus1-2/+7
Change-Id: I47a5261e9a9b590a408bda093a9310dc38c85873 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-23CSIT-1087: Add SRv6 MRR testsTibor Frank1-0/+8
Change-Id: Ia90a9bff6791518ba08fa81e6167e96aea7714d5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-23Add dot1q into L2-perf triggersPeter Mikus1-10/+11
Change-Id: Idf91005bc1331705c9f5ac9a2b2af59a4fb5a062 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-05Optimize performance bootstrapsPeter Mikus1-172/+77
- reduce redundant code Change-Id: Ic5f9f29b18983f116b43bb151c5692ae54f42270 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-04CSIT-992: Add two suites using optimized searchVratko Polak1-0/+1
+ Add 10ge2p1x520-ethip4-ip4base-ndrpdr.robot + Add 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-ndrpdr.robot + Make sure both IMIX and 9000B test cases are there. + Document NDRPDR test tag. + Execute some of NDRPDR tests daily. Change-Id: I66427d49cb6b8304fde4e8d91606de33b624186a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-02Report: dataTibor Frank1-1/+0
Change-Id: If58c7bebaedc772fb7b8d7376f2118bad848b2cc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27FIX: Add api-segment conf to TCP testsTibor Frank1-0/+1
Change-Id: Idf778d8427c8dabf716090cdaeba189e8cccfb98 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-11Cleanup perf bootstrapPeter Mikus1-28/+45
- Remove the DPDK_TEST variable and replace it by internal global variable - Unify all perf boostrap for merge in future. - Cleanup ligato perf bootstrap. Change-Id: Id47d6614c8dd18a701493e00056ef17d2e37fc5c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-05Revert "FIX: Change plugin default behavior for Container tests"Peter Mikus1-2/+3
This reverts commit c754789176b1a3ca00a129d3d207aa5a6bad7c27. Change-Id: Ic1bbe8fac0d98f41aa8b1b57da0c7a147111340b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-05FIX: Change plugin default behavior for Container testsPeter Mikus1-3/+2
Looks like disabling all plugins in container leaving only memif_plugin.so results into issue that could lead into lost of SSH connectivity to TB or in better case to not handling any traffic. This fix is supose to return previous behavior for Container instance of VPP. Change-Id: Ie8b3ce2e35a40c8f3498e490abb6967cd4dd912a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-29Add IPSEC MRR tests to VPP verify jobsPeter Mikus1-0/+4
- Add IPSEC MRR tests to VPP verify jobs on IPSEC trigger Change-Id: I39f79fab266e86fbc8d15859b1aaa26e15f26cbd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-29Add IMIX for Vhost and Memif into MRR trendingPeter Mikus1-0/+6
- Add IMIX for Vhost and Memif into MRR trending Change-Id: Ifab55b14a97f742e801ddc6f15388f3a134db799 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-28Perf bootstrap cleanupPeter Mikus1-60/+27
- Add archiving of all artifacts to logs.fd.io - Remove obsolete test tags - Sync all bootstrap and prepare for future merge-into-single bootstrap. Change-Id: I023df6964bb049df3ccffdffa31a93b667e1587a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-22Add 78B tests to MRR trending dailyTibor Frank1-0/+3
Change-Id: I73b9c505dcd28361978a075bc81db3112e308b9c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-21MRR Daily: Run only 64B testsTibor Frank1-1/+3
Change-Id: I61bb0c785fcc1407b80ce8019df69e64a3e4eb9e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-14Robot logs archiving for trending jobsPeter Mikus1-4/+15
- Add output.xml auto-archiving to logs.fd.io. - Cleanup from obsolete code. Change-Id: Iafa9ef802264d2ad36ca0f556cb14d2b3ca0f179 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-08CSIT-989 Fix: Reflect latest memif API changesPeter Mikus1-0/+2
Change-Id: I0c9cb073a42a8b4b7e573023e784ab9e72d0ad55 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23Raw results chk keywords and initial TCPeter Mikus1-26/+10
- Implementation of Display raw results - Implementation of Traffic should pass with maximum rate - Code optimizations - L2BD, L2XC, IP4, IP6 TC Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-16Modify IPsec test triggerPeter Mikus1-4/+4
Change-Id: Ide575762b5e7682e3558f2138dc9ae07adf559c1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-10CSIT-866: wrk onboarding in CSITTibor Frank1-1/+0
- CSIT-867: Low Level Description - CSIT-868: wrk traffic profile - parsing - CSIT-869: wrk implementation into CSIT Change-Id: I65e1037f5ae05b3a5b2020e4a6c54462766ae1b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-01-05VatHistory: Add ability to trace file executionsPeter Mikus1-0/+1
Change-Id: I9f6de8d2b86ddbbdf1524dcc12d8ed5a33b3266e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-11-28CSIT-865: Add manual trigger for HW cryptodev (IPSECHW) perf testsJan Gelety1-0/+17
This manual trigger will allow to run 1T1C (1 core, 1 thread) and 2T2C (2 core, 2 thread) PDRDISC HW cryptodev tests per VPP/CSIT patch when required. Change-Id: I767203a1641f3446c3e45d7365fa5f9fff928f06 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-19Add IPSEC tests to DAILY Jenkins jobTibor Frank1-0/+1
Change-Id: Ie4558b53a0c0a19b9fa24e951bcf0fcb320076b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-09-25Add memif to TEST_TAG casesJan Gelety1-0/+17
- implement possibility to manually triger memif perf tests in case of csit as well as vpp patch Change-Id: I6bec350a496ba138bcb8ffb8da01c81672187bac Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-02CSIT-742: Add manual trigger for ACL perf testsJan Gelety1-0/+9
Impelmenting needed change in bootstrap-verify-perf.sh file to provide manual trigger that will allow to run 1T1C (1 core, 1 thread) and 2T2C (2 core, 2 threads) ACL tests per VPP patch when required. Change-Id: I3d9cc403ca8ea90da23aca524c4b4ddbf26eb217 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-06CSIT-661: re-add vring256 tuned CFS for vpp workers and guest-testpmdJan Gelety1-1/+1
1. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and tuned CFS setting 2. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and default CFS setting Change-Id: I25aae6839d3e621316d35f5c9525389a6faabd56 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-03Remove DPDK package download from vpp-csit* jobsPeter Mikus1-6/+0
Remove downloading if DPDK package from Nexus if the job is vpp-csit*. Change-Id: I37aada67c4334433618e122676fd1f50591b6742 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-30vpp-verify-perf-vhost runs pdrdisc testsTibor Frank1-1/+1
- Temporary solution: run pdrdisc tests instead of pdrchk for vpp-verify-perf-vhost trigger Change-Id: I0a18397964db8bd2e0c5614eaee44c1208ba0abc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-29CSIT-687: Directory structure reorganizationTibor Frank1-28/+28
Change-Id: I772c9e214be2461adf58124998d272e7d795220f Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-06-23CSIT-614: Create PDRCHK testsTibor Frank1-6/+6
- CSIT-639: 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhost-1vm-pdrchk - CSIT-640: 10ge2p1x520-dot1q-l2xcbase-eth-2vhost-1vm-pdrchk - CSIT-641: 10ge2p1x520-ethip4-ip4base-eth-2vhost-1vm-pdrchk - CSIT-642: 10ge2p1x520-eth-l2xcbase-eth-2vhost-1vm-pdrchk Change-Id: Id676c69abe34e455ca298f7225fd065fc6cc8218 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-02CSIT-572: Add script for data collection for reportTibor Frank1-1/+9
- Add script which picks required data from RF output.xml and saves it in JSON format. - Run this script automatically when the output.xml is generated. - Archive the output. Change-Id: I89589369975e14fc8d8e4afa88abfa34260c09cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-24Download the latest VPP build for *NIGHTLY and *DAILY jobsTibor Frank1-1/+3
Change-Id: I15755c9fc5f95497c84a20d83c3dabddf53c2225 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-24CSIT-554: Performance jobs reorganisation, part 4Tibor Frank1-0/+48
Add: - vpp-csit-verify-hw-perf Change-Id: Ia6b4773256b78ce26c0ef29e70964966f3b901ca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-24CSIT-557: Performance jobs reorganisation, part 3Tibor Frank1-0/+48
Add: - csit-vpp-perf-verify Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061 Signed-off-by: Tibor Frank <tifrank@cisco.com>