summaryrefslogtreecommitdiffstats
path: root/jjb/global-macros.yaml
AgeCommit message (Collapse)AuthorFilesLines
2024-04-03Feat!: Upgrade Jenkins-job-builder to 6xAnil Belur1-9/+9
Jenkins Job Builder 6.0.0 is released and breaks backward compatibility with 5.1.0. The breaking changes with previous 5.1.0 release: - Jobs are now expanded the same way as job templates. - Macros without parameters are now expanded the same way as macros with parameters. - Tags !include-raw: and !include-raw-escape: should now be used the same way in jobs and macros without parameters as they are used in job templates and macros with parameters. Note: This breaks backward compatibility with older version of JJB therefore care must be taken when upgrading the ci-man repositories. Ref: https://storyboard.openstack.org/#!/story/2010963 https://storyboard.openstack.org/#!/story/2010588 https://jira.linuxfoundation.org/browse/RELENG-5182 Change-Id: Iea1f78ae0806d75566c93b4ba4cb37cfb260ffdf Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
2024-03-22Revert "Feat!: Upgrade Jenkins-job-builder to 6x"Dave Wallace1-9/+9
This reverts commit cbe4988f0e9e9668919c0dd5cdd03d1e925ce93f. Reason for revert: the change in jjb/global_macros.yaml replacing !include-raw with !include-raw-escape mangles the python code in the here_doc that gets written to /w/workspace/publish_library.py, thus all jobs fail during post job upload of log files to AWS s3 storage. Change-Id: I8346ed9db9810f595614c28c114cc08170fdeb1a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2024-03-21Feat!: Upgrade Jenkins-job-builder to 6xAnil Belur1-9/+9
Jenkins Job Builder 6.0.0 is released and breaks backward compatibility with 5.1.0. The breaking changes with previous 5.1.0 release: - Jobs are now expanded the same way as job templates. - Macros without parameters are now expanded the same way as macros with parameters. - Tags !include-raw: and !include-raw-escape: should now be used the same way in jobs and macros without parameters as they are used in job templates and macros with parameters. Note: This breaks backward compatibility with older version of JJB therefore care must be taken when upgrading the ci-man repositories. Ref: https://storyboard.openstack.org/#!/story/2010963 https://storyboard.openstack.org/#!/story/2010588 Issue: LF-JIRA RELENG-5182 Change-Id: Ib9acd0b9e7c264ac3531af858431e738397833b5 Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
2023-07-06Replace vpp-gcc job with vpp-cov job per-patchDave Wallace1-0/+41
- the original gcc job was intended to ensure that gcc builds worked to generate test coverage reports. The vpp-cov-verify job produces test coverage reports per patch and stores them in the S3 7-day docs retention bucket. Change-Id: I28c7c323ea8d673cdee66b85189e20029e63336d Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2023-05-26Re-enable voting for vpp-csit device jobsVratko Polak1-1/+1
With both 38877 and 38899 merged, CSIT should be stable again. This reverts commit 10dfa1443d49f3932416fbfc6ae80fe6e300080d. This reverts commit cf55023ecfbde00ddcba7b540a2220b0c6e84a9c. Some improvements in those could be kept, but this change just restores the previous lines. Change-Id: Ibb6185eea81037c3edfe790a56063c45f350e178 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-05-24Pin CSIT_REF to non-breaking csit gerrit refspec for vpp-csit* jobsDave Wallace1-1/+1
- To avoid breakage caused by https://gerrit.fd.io/r/c/csit/+/38875 - For now, leave vpp-device jobs non-voting Change-Id: I120f4472fba51f98120cb2489150b2f751363267 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2023-02-13feat(csit): Add terraform jobsPeter Mikus1-0/+21
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I65839bd6399aaf07be7352f52068fbfcb493e82e
2022-11-28Enable upload of vpp & hicn verify docs to s3 7day retention bucketDave Wallace1-2/+43
- Use the same bucket path as logs so that the docs can be viewed by s/s3-logs/s3-docs-7day/ in the URL after selecting the logs URL from the jenkins job page. - Also, fix error output of get_gerrit_refspec bash function. Change-Id: I73e8b7a1f310dbfb031afe9d164b114021c2cfe3 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-10-11Add vpp-dpdk-rdma-version-mismatch periodic job.Dave Wallace1-0/+31
Change-Id: Idc9df053430fc793737441590e7609d5f3c9fe68 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-09-20Run VPP 'make test' on Ubuntu 22.04 for master.Dave Wallace1-0/+8
- clean up build parameters Change-Id: I1c620f89eb59916620ae9e36dacf9368fb38e476 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-08-17fix(hicn.yaml): specify architecture in functest triggerMauro Sardara1-1/+1
This prevents the functional tests for x86_64 to start when the build job for aarch64 completes. Since the success message triggering the functional test was the same for x86_64 and aarch64, there was no way to distinguish what build jobs completed first. Also: Archive *.deb artifacts to be reused in functest jobs, thus avoiding to compile the code twice. Change-Id: Ibef007eabd57ff417aff1a55e949c11e2e2d9d6a Signed-off-by: Mauro Sardara <msardara@cisco.com>
2022-08-11feat(hicn.yaml): add functional tests jobsMauro Sardara1-0/+16
The approach to trigger the functional test job is the same adopted for triggering the build after the checkstyle. A comment "build_successful" will be added in gerrit by the build job, and this comment will in turn trigger the functional test job. Change-Id: I140160dfdd6fe80fdbe64848b9dc2c7a2b75cac4 Signed-off-by: Mauro Sardara <msardara@cisco.com>
2022-07-08feat(logs): Remove unused logs backupPeter Mikus1-16/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I54391b1301dd231f60132627e89922a06d73e58d
2021-12-02Nexus retirement CI job clean upDave Wallace1-16/+0
- Remove nexus configuration parameters from CI jobs for active FD.io projects - Convert HICN docs jobs to use S3 storage Change-Id: Ida00b6448926567e0245b4988597113bfea0bd84 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-09-23Docs deploy via Terraformpmikus1-1/+1
+ This fixes also problem with content-type detection. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I5fb89668a1792c4497fce1367279657c415d8a32
2021-09-14Docs: Cleanuppmikus1-28/+12
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9209a4c739feb9aae713d0f3654d3cf6fa04c92d
2021-09-02CSIT: send email notification if job is successfulTibor Frank1-4/+4
Change-Id: Ifcae6bb0bf66e426d601d3129b784450ae8ac7bf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-08-31Fix build discarder config for all fd.io projectsDave Wallace1-7/+0
- Existing build discard configuration is no longer generating build discarder config in jjb. Use lf-infra-properties macro instead. Change-Id: I2e6aabefd4a5a74877c4ba02c1f06f3f120bea69 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-08-31Merge "CSIT: Email publisher"Dave Wallace1-0/+67
2021-08-27Description setter: Search for S3 linkVratko Polak1-1/+1
We disabled Nexus and we never plan to go back. Change-Id: I279e0ddb2697a3a28316cb6700fdde13cde841bc Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-26CSIT: Email publisherpmikus1-0/+67
+ Fix email send when job fails + Resuse publishers as macro Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ic6c5a5f97ff38243d0dc5d6a4665d21009acb026
2021-08-17Global: Docs generation in s3pmikus1-1/+48
+ Rework report/docs/trending jobs in CSIT to utilize AWS S3 cloudfront Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ica2757ba8dc31792631c8d6b53b332ebf688b15e
2021-08-06Revert "Global: Disable Nexus for fdio-infra-ship-logs in production"Peter Mikus1-1/+1
This reverts commit 94ccf388b6317892bdd5db5c7b8a2baedaf904c4. Reason for revert: CORS setting of S3 is corrupted. Until LF ticket is resolved reverting. Change-Id: I59e6196f8e3317f249aa4258435705cc8965a80c Signed-off-by: pmikus <pmikus@cisco.com>
2021-08-05Global: Disable Nexus for fdio-infra-ship-logs in productionpmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I98521297778c2c141c393d429c15039eae16d84f
2021-08-05Global: Rework archive artifactspmikus1-2/+14
This patch removes archive-artifacts-parameter macro and ARCHVIVE_ARTIFACTS env var from csit and vpp project. All project specific artifacts to be uploaded with the log files SHOULD BE copied to $WORKSPACE/archives. The next step once this is merged will be to remove NEXUS entirely via JCasC. + Remove archive-artifacts from all csit/vpp yaml files. + Add fdio-infra-ship-backup-logs macro + Remove unused jjb/include-raw-deploy-archives.sh + CSIT: - copy job artifacts to $WORKSPACE/archives + HC2VPP - remove CSIT + TLDK: - remove CSIT Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Iada020cf269714c34f9ce32d764d991827e3b003
2021-05-19Revert "Retry VPP jobs if git clone fails."Andrew Yourtchenko1-9/+0
This reverts commit 1fb419681d9738d890e90e9ac7cd8e36cafc5d4d. Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com> Change-Id: I7993e11ab39d2f6b05c11484c68bbed0fe431b72
2021-05-04Merge "Remove deprecated fdio-infra-shiplogs macro"Vratko Polak1-37/+0
2021-05-03Retry VPP jobs if git clone fails.Dave Wallace1-0/+9
- Use naginator regular-expression to only retry builds when logs contain git clone failure message. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Icb18b7c287b0ccb9d47c7c4af216b3204a720291
2021-04-23Remove deprecated fdio-infra-shiplogs macroDave Wallace1-37/+0
- Update node labels, replacing deprecated 'snergster' labels with equivalent 'fdiotools' node labels Change-Id: I1ff7d42b2c4f4f592567378b7f1fe359ff7e2a0f Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-23Separate VPP stacktrace generation from artifact archivingDave Wallace1-8/+0
- Separate removal of socket files in workspace archive directory from archiving of artifacts - Clean up deprecated workspace-archive-artifacts-parameter macro Change-Id: I11c7fe55d3412fb7261da9f0cfb809a152ae1d51 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-08Use fdio-infra-publish for nomad executor based jobsDave Wallace1-1/+1
- Separate post build executor info dump into its own script file. - Remove backup_upload_archives.sh from fdio-infra-shiplogs which is now only used for openstack executors. - Add setup_executor_env.sh to run first for all jobs which run on nomad/dockerhub images. Change-Id: I564201b8c578e6541152e6af74537d1d007ba1a7 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-16Change 'make test' os on VPP/master to ubuntu-20.04Dave Wallace1-0/+8
- remove beta job templates which should have been done in a previous gerrit change. Change-Id: Id27bc54b86fa0affaaae40e97149ed49d760bdc3 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-01-18CSIT: Make tox job gating (as VPP checkstyle)Vratko Polak1-9/+6
+ Add code comments explaining how CSIT device tests can be started. Change-Id: Icc5bd800f8fdc4616366a32559304977fba9fb04 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-08upload the logs to backup storage location as wellAndrew Yourtchenko1-1/+3
Change-Id: Ib3e9c9ae1fd053c06840f7bc5124aae48fe58e76 Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
2020-12-15Use 'lftools deploy archives' for log uploadDave Wallace1-0/+72
- This is a pre-requisite for using amazon S3 for log storage. - Requires docker images built by updated docker scripts to include packages required by 'lftools' or other project specific docker images to be upgraded with same packages. This change only updates jobs which are using fdiotools docker images. - Add FD.io specific global macros to avoid inflating docker images with packages required by unneeded global-jjb scripts. - Sort VPP job parameters alphabetically - Dump installed python3 packages in setup_executor_env.sh Change-Id: Ifddd8f2b70b10acf834ffc837b27ef5453213a86 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-07-20Merge "vsap build"Dave Wallace1-0/+8
2020-07-17vsap buildxiaolongx.jiang1-0/+8
Signed-off-by: xiaolongx.jiang <xiaolongx.jiang@intel.com> Change-Id: Ibb780f3c9e319a2aa49db5f846539db6c86e0848
2020-06-01Add MAKE_PARALLEL_JOBS parameterJuraj Linkeš1-0/+8
VPP uses the MAKE_PARALLEL_JOBS variable to limit the number of cpus used for build. Make that varialbe configurable as job paramter instead of setting it in script for easier job management. Change-Id: Iaaafdb216c3af9244827b270c540a70b5844021f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-03-12Use the same perf triger for vpp and csitVratko Polak1-7/+7
+ Rename arguments. + Make skip-vote and trigger word configurable in the macro. + Keep the old skip-vote and trigger word values. + Improve vpp-csit job description highlighting the difference. Change-Id: Ie9ca68d422f8514bc8b0cd79f36a83181911feb9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-03-12Order macros alphabeticallyVratko Polak1-244/+255
+ Rename csit-vpp and vpp-csit macros to similar naming convention. Change-Id: I042db66cf52e19f08a60854e8672146a0d6a0fc0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-09Move VPP and CSIT macros to globalVratko Polak1-0/+177
+ Add copyright notice. Change-Id: Ib5de5738a031ce94bbaf145a7cd1e58e882470f4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-28Apply BMRR parameters to each MRR jobVratko Polak1-0/+16
+ Define global macros to make values configurable on demand. + Define minimal values to be used as global default. + The vpp-csit and csit-vpp jobs need different values. + Ndrpdr jobs do not use the values. Change-Id: I868da5fdf16cfb627c48b44a028ed2f6a708ce77 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-11Mark jobs that should not tolerate CRC mismatchVratko Polak1-1/+1
CRC checking is only needed in a small subset of jobs that are required for maintaining CRCs. Other jobs are more useful if they skip CRC checking, in order to uncover real incompatibility (or confirm compatibility). Change-Id: I08113b3bec5e38650a6e7331a9513feb17908e48 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-05Disable CRC checking for some vpp-csit jobsVratko Polak1-0/+8
+ Except the API CRC job, of course. + See comments for reasons. Change-Id: Ida87cac3cf4a85fdf25d8d579ad48a484eb1d2b8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-11-05Fix linting in global-macrosVanessa Rene Valderrama1-322/+318
This change is to fix linting errors in global-macros Change-Id: I387c49b90e3d2750e6e41e27fb18d16ad97a90ae Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
2018-10-26Revert post-build-script to old fd.io oneThanh Ha1-2/+11
Change-Id: I3ea65cb0da467021b39bdce755ea8d25d9d7bbcc Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
2018-10-18Fix publisher macro causing JJB 2.5.0 errorsVanessa Rene Valderrama1-13/+10
Fixing postbuildscripts publisher to resolve JJB 2.5.0 errors Change-Id: Iab07fe7a419b2084591b4f386340accf9ec47064 Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
2018-09-28Update ci-management submodules recursivelyEric Ball1-0/+14
To enable compatibility with global-jjb, the scm needs to update submodules recursively. Adding the param to the old scm would require changing every reference to that object, so a new scm was created. Change-Id: Ib514d06891f50a24bb2f38449b5b094db602f7e6 Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2018-09-06CSIT-1264: Job for per-patch VPP perf testingVratko Polak1-0/+25
Most logic is in CSIT repository. + Hardcode topology type of vpp-csit-verify-perf-{stream}- job. + Introduce gerrit related parameters to enable Sandbox testing. + Add the parameters to vpp-csit and csit-vpp perf verify jobs. Change-Id: I8643b4ba352122c51289db923f0d0ebe597d08e4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-11CSIT-1117: Update jenkins job infrastructure for 2-node/3-node testingTibor Frank1-0/+15
+ 'csit-vpp-perf-{stream}-{topo}-{arch}' - {stream} [branch_id] - {topo} [2n|3n] - {arch} [skx|hsw|arm] Change-Id: I5f01a1035cec4dbc663fa06c67e2a4d4ae692d28 Signed-off-by: Tibor Frank <tifrank@cisco.com>