summaryrefslogtreecommitdiffstats
path: root/jjb/scripts
AgeCommit message (Collapse)AuthorFilesLines
2023-02-13feat(csit): Add terraform jobsPeter Mikus2-0/+42
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I65839bd6399aaf07be7352f52068fbfcb493e82e
2023-01-20Allow multiple OS's for make test and vppapigenDave Wallace2-4/+6
- And change VPP verify/merge jobs to run 'make test' on both ubuntu-22.04 and ubuntu-20.04 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I7a9b488c063d3229e82ba29ecd4806e632dc0537
2022-11-30Merge "Enable upload of vpp & hicn verify docs to s3 7day retention bucket"Peter Mikus3-23/+36
2022-11-28Enable upload of vpp & hicn verify docs to s3 7day retention bucketDave Wallace3-23/+36
- Use the same bucket path as logs so that the docs can be viewed by s/s3-logs/s3-docs-7day/ in the URL after selecting the logs URL from the jenkins job page. - Also, fix error output of get_gerrit_refspec bash function. Change-Id: I73e8b7a1f310dbfb031afe9d164b114021c2cfe3 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-11-10Compress & archive failed tests in vpp-debug-verify jobsDave Wallace1-2/+3
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I9b99bc8ab2e1698f9539c19d772795091f51434e
2022-11-03Merge "Restore vpp-csit-*tx2 jobs in production"Peter Mikus1-6/+0
2022-10-20Update post build client hostname output for docker executors.Dave Wallace1-1/+12
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I19477c066db314a501d8fa127c5c4dddd45922f2
2022-10-19Fix Nomad hostname output in docker job console logs.Dave Wallace1-1/+11
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: If88be92314290bd2b2d0b1bbb21167b6286b8155
2022-10-19Revert "Set FDIONOMAD container hostname with job and node info."Dave Wallace1-0/+1
This reverts commit 672f06dd9d8a2b0b4c536e70d71c40bb85d720f4. Reason for revert: JCasC is not happy with this. Change-Id: I906053a454cbaaaf2a4cbf6f87bb258e25e8b034 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-10-19Set FDIONOMAD container hostname with job and node info.Dave Wallace1-1/+0
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ida46ca8a0bbbb66919445cce399679b13e27e85f
2022-10-18Merge "Fix: Robot Framework logging"Eric Ball1-0/+4
2022-10-17Fix: Robot Framework loggingEric Ball1-0/+4
The builder should be ubuntu, and the logging script has been modified to include robot logs if found. Change-Id: I4fedf0b8b36dfb56cc43546ab3d1f4fc7c63562c Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2022-10-17Restore vpp-csit-*tx2 jobs in productionDave Wallace1-6/+0
- Revert 1c6290e (gerrit 34848) "Skip vpp-csit-*tx2 jobs in production" Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I3d2ada11f41a8759fc682d4eb668e00adacfa7fe
2022-10-13chore: remove output of script sha1sum from jjb scriptsDave Wallace4-12/+0
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I20e1b0d6bc73a01d33835a53421e72cbe988efc0
2022-10-11Add vpp-dpdk-rdma-version-mismatch periodic job.Dave Wallace1-0/+36
Change-Id: Idc9df053430fc793737441590e7609d5f3c9fe68 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-09-20Run VPP 'make test' on Ubuntu 22.04 for master.Dave Wallace3-23/+53
- clean up build parameters Change-Id: I1c620f89eb59916620ae9e36dacf9368fb38e476 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-08-30Merge "Add hicn job to build against vpp latest."Peter Mikus1-0/+7
2022-08-12Merge "feat(hicn.yaml): add functional tests jobs"Dave Wallace1-0/+9
2022-08-12Add hicn job to build against vpp latest.Dave Wallace1-0/+7
Change-Id: I0210401c810720b3927d7fe9f7b92aba3f0d260d Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Signed-off-by: Mauro Sardara <msardara@cisco.com>
2022-08-11post 22.06 vpp job clean upDave Wallace5-77/+6
- Remove ubuntu-18.04 jobs - Remove vpp 21.10 jobs - Address TODO clean up now that 21.06 & 21.10 are no longer supported - Remove unused jjb/hc2vpp (archived project) Change-Id: I9da69fa175ebb647476916e9921f4149045408b4 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-08-11feat(hicn.yaml): add functional tests jobsMauro Sardara1-0/+9
The approach to trigger the functional test job is the same adopted for triggering the build after the checkstyle. A comment "build_successful" will be added in gerrit by the build job, and this comment will in turn trigger the functional test job. Change-Id: I140160dfdd6fe80fdbe64848b9dc2c7a2b75cac4 Signed-off-by: Mauro Sardara <msardara@cisco.com>
2022-08-10feat(hicn.yaml): add project and job-template for sonar scanner.Mauro Sardara1-0/+8
Signed-off-by: Mauro Sardara <msardara@cisco.com> Change-Id: I86c9baa94b6df0e2ec722e47e660d1d70fb71d39 Signed-off-by: Mauro Sardara <msardara@cisco.com>
2022-07-08feat(logs): Remove unused logs backupPeter Mikus1-39/+0
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I54391b1301dd231f60132627e89922a06d73e58d
2022-06-17Add docs-spell to vpp checkstyle jobDave Wallace2-2/+25
- also replace individual package install confirm/force environment variables with UNATTENDED=yes. Change-Id: I22a503848d7ae916bdbff1977586a0fa17498cca Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-05-31vpp: add spellcheck to docs jobs.Dave Wallace1-2/+2
Change-Id: I0ab1c58a01f9b1a9b2c661f700b3862294900a44 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-04-20fix(hicn/docs.sh): create SITE_DIR if it does not exist before moving html ↵Mauro Sardara1-1/+3
folder Signed-off-by: Mauro Sardara <msardara@cisco.com> Change-Id: I1cd578f1895f911e4b56d57c564759a6759de052
2022-03-31doc(hicn): do not build doxygenMauro Sardara4-4/+6
Also: - print info about current script Signed-off-by: Mauro Sardara <msardara@cisco.com> Change-Id: I89d05a8f1ac956015a3b55b892a1a63988e76816 Signed-off-by: Mauro Sardara <msardara@cisco.com>
2022-01-19Allow the optimization of preinstalling vpp-ext-deps to failAndrew Yourtchenko1-1/+12
e62c4bc9708a906d2dcd504cdcca5964b232d3b3 added stricter error handling, thus creating a failure case if a packagecloud repo has been newly created and is empty. Relax the error handling, and add the comment about the motivation. Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com> Change-Id: I8bfe6d69ab1a59622c60080e796f301b6b6f4ead
2022-01-06Skip vpp-csit-*tx2 jobs in productionDave Wallace1-0/+6
- jobs currently either failing or timing out after 90 minutes in production. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I52131a255e55af8e5974136751ad6629fb4ccf59
2021-12-02Nexus retirement CI job clean upDave Wallace9-74/+98
- Remove nexus configuration parameters from CI jobs for active FD.io projects - Convert HICN docs jobs to use S3 storage Change-Id: Ida00b6448926567e0245b4988597113bfea0bd84 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-11-16Merge "vpp: run 'make test-dep' for all OS variants."Peter Mikus1-41/+38
2021-11-06vpp: run 'make test-dep' for all OS variants.Dave Wallace1-41/+38
- Ensure that there are no repeats of python dependency breakages on OS variants which do not run 'make test' in the CI. This is required for docker executor builder as well as doc/test dep issues [0]. [0] https://gerrit.fd.io/r/c/vpp/+/34381 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ife4e33b4a048fe87574165cfd6f573a1ec6dadc8
2021-10-29Fix upload of vpp-ext-deps cached in executorDave Wallace4-121/+114
- Refactor installation of vpp-ext-deps Change-Id: Ifd22ceb0481c9b2f2c6be223dae64e775d59fa12 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-10-27Remove deprecated releases/os jobs for VPP 21.10Dave Wallace1-11/+0
- Deprecated release: VPP stable/2009, stable/2101 - Deprecated OS: centos-7, debian-9 Change-Id: If3ca0f249210946321f6e867a933b05f19f58865 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-10-26Convert VPP docs upload destination from nexus to amazon S3.Dave Wallace4-177/+36
- Don't build doxygen docs which is deprecated in master and fails to upload in 21.xx releases - Only build 'make test-docs' in 21.xx releases which is deprecated in master (VPP 22.02) Change-Id: I54c46b32f95705ee0868a961f18fed8b0d4bba81 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-10-01Use $GIT_URL in scripts to avoid https CA cert failure.Dave Wallace5-9/+14
- git clone using https fails due to expired CA certificate, but project repo git clone works using git transfer protocol. Use $GIT_URL for clone command in scripts which use the git transfer protocol to the git mirror (same as git clone of project repo's) instead of https to the public gerrit ip address. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I15ef9e79e7e32d1561f6c452d192048f04c55caa
2021-09-24Merge "Docs deploy via Terraform"Dave Wallace2-11/+106
2021-09-23Docs deploy via Terraformpmikus2-11/+106
+ This fixes also problem with content-type detection. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I5fb89668a1792c4497fce1367279657c415d8a32
2021-09-23S3: Content type detectionpmikus1-29/+44
+ Rework content type detection as current way leads into inconsistent detection and corrupted CloudFront handling + MimeType is base on wild guess of file extension and does not work for our use cases. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If8a3e052a5512dca1767bccf10107c9867ba7366
2021-09-20FIX: Do not fail to copy directorypmikus1-5/+8
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I3cff2ca3feef7fc1083584249cdb2866e13ea836
2021-09-16Merge "FIX: Improve ContentEncoding handling"Dave Wallace1-10/+10
2021-09-16FIX: Improve ContentEncoding handlingpmikus1-10/+10
+ Each bucket has different settings that is accepted. This patch helps to make all buckets and jobs works as expected for their settings. + Tested on sandbox on all kind of jobs (tox,docs,trending) Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibf7e81f06c9bd9b3f17194231cbd4f7e83596305
2021-09-16CSIT: cleanup unused scriptspmikus5-181/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I121b8fdf94ebbaa65ed999c9f907581ca7690210
2021-09-14Docs: Cleanuppmikus3-72/+119
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9209a4c739feb9aae713d0f3654d3cf6fa04c92d
2021-08-25Delete jjb/scripts/csit/cpta.shVratko Polak1-89/+0
It is not used since https://gerrit.fd.io/r/c/ci-management/+/33118 Change-Id: I62b167eff32fd27158e2dd7ae6deec2c25d8db47 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-20FIX: CSIT trending pathpmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If7f9889fce320c2d53c7ff1c25d1a505e5f80eaf
2021-08-17Global: Docs generation in s3pmikus6-156/+142
+ Rework report/docs/trending jobs in CSIT to utilize AWS S3 cloudfront Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ica2757ba8dc31792631c8d6b53b332ebf688b15e
2021-08-06Fix workarounds for archive pathsVratko Polak3-3/+38
https://gerrit.fd.io/r/c/ci-management/+/33060 has introduced workarounds for jobs which create Robot outputs outside /archives/. It got merged without verifying the workarounds work correctly. + The workaround for device job does not seem to be needed. + Perform the copy also when robot failed. Fixes: 37a55a05cd6ac7ca15bbb99f5ddc9ca61874d5f8 Change-Id: I5e08545bd290fa917e85a375865a130c3f2ff996 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-05Global: Rework archive artifactspmikus8-263/+296
This patch removes archive-artifacts-parameter macro and ARCHVIVE_ARTIFACTS env var from csit and vpp project. All project specific artifacts to be uploaded with the log files SHOULD BE copied to $WORKSPACE/archives. The next step once this is merged will be to remove NEXUS entirely via JCasC. + Remove archive-artifacts from all csit/vpp yaml files. + Add fdio-infra-ship-backup-logs macro + Remove unused jjb/include-raw-deploy-archives.sh + CSIT: - copy job artifacts to $WORKSPACE/archives + HC2VPP - remove CSIT + TLDK: - remove CSIT Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Iada020cf269714c34f9ce32d764d991827e3b003
2021-06-15Change 'Downloading' to 'Retrieving' in backup_upload_archives.shDave Wallace1-2/+2
- To prevent false positives when searching console logs for jobs which are downloading content over the internet. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I0d9d1e3138380453eabab6a0fe2844311304491f