summaryrefslogtreecommitdiffstats
path: root/jjb/scripts
AgeCommit message (Collapse)AuthorFilesLines
2022-08-30Merge "Add hicn job to build against vpp latest."Peter Mikus1-0/+7
2022-08-12Merge "feat(hicn.yaml): add functional tests jobs"Dave Wallace1-0/+9
2022-08-12Add hicn job to build against vpp latest.Dave Wallace1-0/+7
Change-Id: I0210401c810720b3927d7fe9f7b92aba3f0d260d Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Signed-off-by: Mauro Sardara <msardara@cisco.com>
2022-08-11post 22.06 vpp job clean upDave Wallace5-77/+6
- Remove ubuntu-18.04 jobs - Remove vpp 21.10 jobs - Address TODO clean up now that 21.06 & 21.10 are no longer supported - Remove unused jjb/hc2vpp (archived project) Change-Id: I9da69fa175ebb647476916e9921f4149045408b4 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-08-11feat(hicn.yaml): add functional tests jobsMauro Sardara1-0/+9
The approach to trigger the functional test job is the same adopted for triggering the build after the checkstyle. A comment "build_successful" will be added in gerrit by the build job, and this comment will in turn trigger the functional test job. Change-Id: I140160dfdd6fe80fdbe64848b9dc2c7a2b75cac4 Signed-off-by: Mauro Sardara <msardara@cisco.com>
2022-08-10feat(hicn.yaml): add project and job-template for sonar scanner.Mauro Sardara1-0/+8
Signed-off-by: Mauro Sardara <msardara@cisco.com> Change-Id: I86c9baa94b6df0e2ec722e47e660d1d70fb71d39 Signed-off-by: Mauro Sardara <msardara@cisco.com>
2022-07-08feat(logs): Remove unused logs backupPeter Mikus1-39/+0
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I54391b1301dd231f60132627e89922a06d73e58d
2022-06-17Add docs-spell to vpp checkstyle jobDave Wallace2-2/+25
- also replace individual package install confirm/force environment variables with UNATTENDED=yes. Change-Id: I22a503848d7ae916bdbff1977586a0fa17498cca Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-05-31vpp: add spellcheck to docs jobs.Dave Wallace1-2/+2
Change-Id: I0ab1c58a01f9b1a9b2c661f700b3862294900a44 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-04-20fix(hicn/docs.sh): create SITE_DIR if it does not exist before moving html ↵Mauro Sardara1-1/+3
folder Signed-off-by: Mauro Sardara <msardara@cisco.com> Change-Id: I1cd578f1895f911e4b56d57c564759a6759de052
2022-03-31doc(hicn): do not build doxygenMauro Sardara4-4/+6
Also: - print info about current script Signed-off-by: Mauro Sardara <msardara@cisco.com> Change-Id: I89d05a8f1ac956015a3b55b892a1a63988e76816 Signed-off-by: Mauro Sardara <msardara@cisco.com>
2022-01-19Allow the optimization of preinstalling vpp-ext-deps to failAndrew Yourtchenko1-1/+12
e62c4bc9708a906d2dcd504cdcca5964b232d3b3 added stricter error handling, thus creating a failure case if a packagecloud repo has been newly created and is empty. Relax the error handling, and add the comment about the motivation. Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com> Change-Id: I8bfe6d69ab1a59622c60080e796f301b6b6f4ead
2022-01-06Skip vpp-csit-*tx2 jobs in productionDave Wallace1-0/+6
- jobs currently either failing or timing out after 90 minutes in production. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I52131a255e55af8e5974136751ad6629fb4ccf59
2021-12-02Nexus retirement CI job clean upDave Wallace9-74/+98
- Remove nexus configuration parameters from CI jobs for active FD.io projects - Convert HICN docs jobs to use S3 storage Change-Id: Ida00b6448926567e0245b4988597113bfea0bd84 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-11-16Merge "vpp: run 'make test-dep' for all OS variants."Peter Mikus1-41/+38
2021-11-06vpp: run 'make test-dep' for all OS variants.Dave Wallace1-41/+38
- Ensure that there are no repeats of python dependency breakages on OS variants which do not run 'make test' in the CI. This is required for docker executor builder as well as doc/test dep issues [0]. [0] https://gerrit.fd.io/r/c/vpp/+/34381 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ife4e33b4a048fe87574165cfd6f573a1ec6dadc8
2021-10-29Fix upload of vpp-ext-deps cached in executorDave Wallace4-121/+114
- Refactor installation of vpp-ext-deps Change-Id: Ifd22ceb0481c9b2f2c6be223dae64e775d59fa12 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-10-27Remove deprecated releases/os jobs for VPP 21.10Dave Wallace1-11/+0
- Deprecated release: VPP stable/2009, stable/2101 - Deprecated OS: centos-7, debian-9 Change-Id: If3ca0f249210946321f6e867a933b05f19f58865 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-10-26Convert VPP docs upload destination from nexus to amazon S3.Dave Wallace4-177/+36
- Don't build doxygen docs which is deprecated in master and fails to upload in 21.xx releases - Only build 'make test-docs' in 21.xx releases which is deprecated in master (VPP 22.02) Change-Id: I54c46b32f95705ee0868a961f18fed8b0d4bba81 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-10-01Use $GIT_URL in scripts to avoid https CA cert failure.Dave Wallace5-9/+14
- git clone using https fails due to expired CA certificate, but project repo git clone works using git transfer protocol. Use $GIT_URL for clone command in scripts which use the git transfer protocol to the git mirror (same as git clone of project repo's) instead of https to the public gerrit ip address. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I15ef9e79e7e32d1561f6c452d192048f04c55caa
2021-09-24Merge "Docs deploy via Terraform"Dave Wallace2-11/+106
2021-09-23Docs deploy via Terraformpmikus2-11/+106
+ This fixes also problem with content-type detection. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I5fb89668a1792c4497fce1367279657c415d8a32
2021-09-23S3: Content type detectionpmikus1-29/+44
+ Rework content type detection as current way leads into inconsistent detection and corrupted CloudFront handling + MimeType is base on wild guess of file extension and does not work for our use cases. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If8a3e052a5512dca1767bccf10107c9867ba7366
2021-09-20FIX: Do not fail to copy directorypmikus1-5/+8
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I3cff2ca3feef7fc1083584249cdb2866e13ea836
2021-09-16Merge "FIX: Improve ContentEncoding handling"Dave Wallace1-10/+10
2021-09-16FIX: Improve ContentEncoding handlingpmikus1-10/+10
+ Each bucket has different settings that is accepted. This patch helps to make all buckets and jobs works as expected for their settings. + Tested on sandbox on all kind of jobs (tox,docs,trending) Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibf7e81f06c9bd9b3f17194231cbd4f7e83596305
2021-09-16CSIT: cleanup unused scriptspmikus5-181/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I121b8fdf94ebbaa65ed999c9f907581ca7690210
2021-09-14Docs: Cleanuppmikus3-72/+119
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9209a4c739feb9aae713d0f3654d3cf6fa04c92d
2021-08-25Delete jjb/scripts/csit/cpta.shVratko Polak1-89/+0
It is not used since https://gerrit.fd.io/r/c/ci-management/+/33118 Change-Id: I62b167eff32fd27158e2dd7ae6deec2c25d8db47 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-20FIX: CSIT trending pathpmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If7f9889fce320c2d53c7ff1c25d1a505e5f80eaf
2021-08-17Global: Docs generation in s3pmikus6-156/+142
+ Rework report/docs/trending jobs in CSIT to utilize AWS S3 cloudfront Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ica2757ba8dc31792631c8d6b53b332ebf688b15e
2021-08-06Fix workarounds for archive pathsVratko Polak3-3/+38
https://gerrit.fd.io/r/c/ci-management/+/33060 has introduced workarounds for jobs which create Robot outputs outside /archives/. It got merged without verifying the workarounds work correctly. + The workaround for device job does not seem to be needed. + Perform the copy also when robot failed. Fixes: 37a55a05cd6ac7ca15bbb99f5ddc9ca61874d5f8 Change-Id: I5e08545bd290fa917e85a375865a130c3f2ff996 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-05Global: Rework archive artifactspmikus8-263/+296
This patch removes archive-artifacts-parameter macro and ARCHVIVE_ARTIFACTS env var from csit and vpp project. All project specific artifacts to be uploaded with the log files SHOULD BE copied to $WORKSPACE/archives. The next step once this is merged will be to remove NEXUS entirely via JCasC. + Remove archive-artifacts from all csit/vpp yaml files. + Add fdio-infra-ship-backup-logs macro + Remove unused jjb/include-raw-deploy-archives.sh + CSIT: - copy job artifacts to $WORKSPACE/archives + HC2VPP - remove CSIT + TLDK: - remove CSIT Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Iada020cf269714c34f9ce32d764d991827e3b003
2021-06-15Change 'Downloading' to 'Retrieving' in backup_upload_archives.shDave Wallace1-2/+2
- To prevent false positives when searching console logs for jobs which are downloading content over the internet. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I0d9d1e3138380453eabab6a0fe2844311304491f
2021-06-03Merge "JJB: Include perf analysis per job"Dave Wallace3-1/+41
2021-06-03JJB: Include perf analysis per jobpmikus3-1/+41
+ Useful for performance analysis before run. This should help to analyze machine load before starting payload by comparing conditions from running jobs. - Requirements: sysstat (apt install sysstat) - Remove extraneous python import from backup_upload_archives.sh - Fix sar issue on centos-7 - Fix debian9 lftools install / upgrade issue Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I6b61f99b9b2cde2bac3dacdefaa926e9afbb157e
2021-06-02api-checkstyle: do not send the notification about the successful API checksAndrew Yourtchenko1-4/+0
the api-checkstyle was initially done with notification for both successful and failed api-checkstyle runs, just as a matter of precaution. It's time to keep the notification only for the fail case, thus fulfilling the point of notifications. Change-Id: I41a12e7a30bc852c9280fc08a6eae426438f7d92 Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
2021-05-13Fix make test docs upload & clean up docs jobsDave Wallace1-1/+6
- make test DOCS_DIR in vpp/master changed location, fix upload for master and subsequent release branches. - Don't archive docs build output to avoid stress on nexus - Sphinx docs are generated and pushed to github by hand for publishing. Therefore remove sphinx docs jobs and include building of sphinx docs in the vpp-docs-verify-* jobs. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I3b2badbf3e2b242ad6b4efcc7d6d281c8b26136b
2021-05-08Backup console logs to consul.Dave Wallace2-10/+27
- Add additional executor info to console output for consul log storage. Change-Id: Ifc9174ff69f26aa31f92e3680606f7a2303b5924 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-27Merge "Separate VPP stacktrace generation from artifact archiving"Vratko Polak1-21/+17
2021-04-23Separate VPP stacktrace generation from artifact archivingDave Wallace1-21/+17
- Separate removal of socket files in workspace archive directory from archiving of artifacts - Clean up deprecated workspace-archive-artifacts-parameter macro Change-Id: I11c7fe55d3412fb7261da9f0cfb809a152ae1d51 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-21Refactor ccache config to use per-os ccache dirs.Dave Wallace1-17/+11
- Simplify ccache state output to console log by using ccache stats command. - Bump max size of ccache dir to 10G (centos8 is approximately 5.7G) - Clean up extraneous ccache dir after docker build is complete. Change-Id: Ia2b55b7cd47212fce91b4567d0cca69d2ce892ed Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-16Fix backup archive directory structure.Dave Wallace1-18/+7
Change-Id: I9fd1194bdb68239df2a6e2c4432ec1849ca12aac Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-08Use fdio-infra-publish for nomad executor based jobsDave Wallace2-22/+47
- Separate post build executor info dump into its own script file. - Remove backup_upload_archives.sh from fdio-infra-shiplogs which is now only used for openstack executors. - Add setup_executor_env.sh to run first for all jobs which run on nomad/dockerhub images. Change-Id: I564201b8c578e6541152e6af74537d1d007ba1a7 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-06disable ASAN in the debug buildsAndrew Yourtchenko1-1/+3
The move to unix sockets has broken ASAN fairly thoroughly, so disable it Change-Id: Icf3822c5927309f8574865008173a66019a3ed55 Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
2021-03-26Merge "Include container id in console log."Vanessa Rene Valderrama2-4/+19
2021-03-26Include container id in console log.Dave Wallace2-4/+19
- Output executor runtime attributes in post_build_deploy_archives.sh for the case when a job fails prior to setup_executor_env.sh Change-Id: Icb54c039db21a621d44808221a3100c509583090 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-03-25Enable CCACHE in builder images / labelsDave Wallace1-0/+22
- Remove aarch64 labels which do not have any executor docker images. Change-Id: I1f46929b1c8393aa7a25bad215a95b85f2e00bd9 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-03-24Remove temporary DNS fix.Dave Wallace2-7/+2
- Use search domain in /etc/resolv.conf as hostname. Change-Id: Iaf156a2096a1b60f6222fa2d7f99101d72e2572c Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-03-23Force DNS nameserver in CI jobs to use local consul server.Dave Wallace1-0/+3
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I76b7f4668ad0bfb11e9045de2d7f8e150132083a