summaryrefslogtreecommitdiffstats
path: root/docker/scripts
AgeCommit message (Collapse)AuthorFilesLines
2022-11-02Post VPP 22.10 Release job clean upDave Wallace3-8/+5
- Remove VPP stable/2202 jobs - Remove debian10 docker executor images Change-Id: I2a83cc3db0aadf987ae726f77a453cfbb778f077 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-10-11Add stable/2210 to docker builderDave Wallace1-4/+4
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ia6a24f21ed256af7d56150ab93317cce98b641b6
2022-09-07Support ubuntu-22.04 docker exector image building & vpp jobsDave Wallace3-7/+9
Change-Id: I71b654cd072288e4ede70285a0740a7f18caa299 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-08-11post 22.06 vpp job clean upDave Wallace3-13/+12
- Remove ubuntu-18.04 jobs - Remove vpp 21.10 jobs - Address TODO clean up now that 21.06 & 21.10 are no longer supported - Remove unused jjb/hc2vpp (archived project) Change-Id: I9da69fa175ebb647476916e9921f4149045408b4 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-06-17Add docs-spell to vpp checkstyle jobDave Wallace2-6/+3
- also replace individual package install confirm/force environment variables with UNATTENDED=yes. Change-Id: I22a503848d7ae916bdbff1977586a0fa17498cca Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2022-05-25vpp: add stable/2206 CI jobsDave Wallace1-4/+4
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com> Change-Id: I279978c3b0eb4c5e3079c8c5645837fc8a25029e
2022-03-15docker builder: add debian-11 executor image.Dave Wallace3-6/+4
= Add vpp-*-master-debian11-x86_64 jobs Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I1bb12d72e28ef8a9872558fb4f6def6b520981ae
2022-03-14Remove vpp stable/2106 jenkins jobs.Dave Wallace1-3/+3
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ic9623be20a720c82fe8fb828bebc4171d36104a7
2022-02-08docker builder: Remove code for deprecated OS (centos-8, debian-9)Dave Wallace9-958/+13
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I04d9102e38657f1cffa62e491f7da4ffcd2acf15
2022-01-19Add stable/2202 branch to docker executor generation scripts.Dave Wallace1-2/+2
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: If491eabfbc43ee6f6b26c887aced8bc66a355269
2021-12-01Remove VPP master branch from ubuntu-18.04 executor.Dave Wallace1-1/+1
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I92aea8725dcd00f90c61025673792048e06934ca
2021-11-06Remove stable/2101 branches from docker executor builderDave Wallace3-7/+11
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I280d1ddb9c7e2ee35c2009b0cf019302fd76aa4a
2021-10-03Update docker image builder to support stable/2110Dave Wallace7-47/+5
- Remove stable/2009 from docker image builder - Remove centos-7 & debian-9 which is only required on stable/2009 Change-Id: I4ae47ca7dc8e833b003fb62dfd9036dca644e946 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-08-23Add terraform to docker CI executor images.Dave Wallace2-4/+12
- Also restrict docs-venv to ubuntu / x86_64 images Change-Id: I6eea04bce8819f4fd9bc34c5551a07a2a79d6655 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-08-04Fix debian-9 docker image builderDave Wallace1-4/+2
- Docker installation no longer works on debian-9 so don't install it when building debian-9 executor images. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I7896799bdc6cd1d683966b1f0951405d4967891b
2021-07-09Fix docker image builder vpp-ext-deps package copy to /root/Downloads.Dave Wallace1-13/+24
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ifdc95193bbf6fe4866b5abfeea33a425fa8c2e9f
2021-06-03Add stable/2106 branch to docker image buildsDave Wallace1-4/+4
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: If22e9e2dd8ab5ed2008ce1baeb78721bf9035681
2021-06-03JJB: Include perf analysis per jobpmikus4-0/+8
+ Useful for performance analysis before run. This should help to analyze machine load before starting payload by comparing conditions from running jobs. - Requirements: sysstat (apt install sysstat) - Remove extraneous python import from backup_upload_archives.sh - Fix sar issue on centos-7 - Fix debian9 lftools install / upgrade issue Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I6b61f99b9b2cde2bac3dacdefaa926e9afbb157e
2021-04-23Merge "Refactor ccache config to use per-os ccache dirs."Vratko Polak3-3/+6
2021-04-21Fix docker image update scriptDave Wallace1-1/+4
- Handle case where the original image has been deleted from dockerhub. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ifcb34f39b36f2974d45a48754b72d33e9cfc4b06
2021-04-21Refactor ccache config to use per-os ccache dirs.Dave Wallace3-3/+6
- Simplify ccache state output to console log by using ccache stats command. - Bump max size of ccache dir to 10G (centos8 is approximately 5.7G) - Clean up extraneous ccache dir after docker build is complete. Change-Id: Ia2b55b7cd47212fce91b4567d0cca69d2ce892ed Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-13builder: if new ansible dir doesn't exist, use old one.Dave Wallace1-0/+3
Change-Id: I539fc3981b46a285bf6934d2dd13c8c660fc0e8a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-09Fix broken docker install for debian-9 executor.Dave Wallace1-2/+12
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I4766dfec19de63ba6ae7dbd86ed70f696a10f117
2021-04-08Scripts: Change CSIT ansible pathpmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I09ad51af52e9246ab4491ffd7ed03ab5c8a09268
2021-03-25Enable CCACHE in builder images / labelsDave Wallace3-6/+3
- Remove aarch64 labels which do not have any executor docker images. Change-Id: I1f46929b1c8393aa7a25bad215a95b85f2e00bd9 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-03-20Use Ubuntu-20.04 for vpp-csit-* job executor imagesDave Wallace14-723/+1061
- refactor vpp-csit job names to conform to the vpp job nomenclature - add ubuntu-20.04 for CSIT image builder install requirements - fix executor class verification - add option to build_executor_docker_image.sh to dump Dockerfile without building image(s) - refactor Dockerfile generation to support executor classes - add support for csit_shim and csit_dut docker image generation from csit ansible repo - refactor docker installation - refactor locale support - remove old static csit Dockerfiles - remove unused jenkins labels - use csit-builder-{os}-prod-{executor_arch} label for vpp csit device test - run tox in csit_pip_cache() to include pylint requirements in python cache to avoid downloading from pypi during job execution. Change-Id: I5f4ffc587c6b8c43cb874dfd8c615ce56d3b97a4 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-18Fix installation of lftools python packages in docker images.Dave Wallace5-32/+34
- fix build script to remove $DOCKER_BUILD_DIR before copying ci-management repo into it. - remove unnecessary jenkins account configuration. Change-Id: I6267b13efad1426194ea87f63c7284bed4b988a1 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-12Move ubuntu2004-aarch64 jobs into productionDave Wallace1-2/+7
- move ubuntu2004-aarch64 merge/verify jobs from beta into production on master as required for https://gerrit.fd.io/r/c/vpp/+/30734 - remove beta job definitions - refactor os job add/remove from separate project definitions to exclude list in vpp-<arch> project definitions - handle errors when parsing yaml files in dbld_csit_find_ansible_packages.py Change-Id: Ife651a6b85c6c3872255f15bd87ede499ee78b22 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-09Add the core file decoding+cleanup for the verify jobsAndrew Yourtchenko1-1/+2
- Add better failure reporting and dry run handling for build scripts. Change-Id: Ia19bae15ff4880b07094f4f665e5e00030eda27c Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-04Promote vpp-*-centos8-aarch64 jobs to productionDave Wallace1-2/+3
- Update lftools install in the docker image builder to use the same options as global-jjb lf-activate-venv to pre-populate python cache, otherwise it takes 15+ minutes for lf-activate-venv to complete. Change-Id: I8c1124faadfbf65228c31418ed02b5967e7fa82c Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-03Add packages to docker image builderDave Wallace4-2/+13
- sshpass for CSIT - gdb for VPP core decode - Add comment to end of builder script to detect completion in build log. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I6ddbc066f07514dbd76f02104bc04c3bc70da163
2021-02-02Deprecate VPP stable/2005Dave Wallace1-2/+2
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ifba4ab4270d8eddf9713fa817f00b179247fd09f
2021-01-28Merge "Import jjb test bash functions from vpp repo."Vratko Polak1-17/+0
2021-01-27Import jjb test bash functions from vpp repo.Dave Wallace1-17/+0
- Also move get_gerrit_refspec() from docker/scripts/lib_common.sh into sandbox_test_functions.sh Change-Id: I8f4a1648da678361c7ab364724f488571c91f0b7 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-01-14Update VPP branches for docker image builder.Dave Wallace1-7/+14
- Remove stable/2001 which has been deprecated - Add stable/2101 - Remove debian-9 from master Change-Id: I9b88d01bc38284aba5390c4583f1ac6a0e23cba8 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-01-05Remove VPP 19.08 jobsDave Wallace2-10/+4
- Also remove stable/1908 from the docker image build scripts. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I44fc73898b936ec75721801956e76412da262e49
2020-12-18docker: update distro packagesJuraj Linkeš3-8/+9
Remove puppet, since it's not used. Add the missing yum/dnf libxslt dev package needed for Aarch64 CentOS-8 docker image build. Change-Id: I8669e5d7aba6a5ad113bb0f3f9ea737ce6ae6829 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-12-15Use 'lftools deploy archives' for log uploadDave Wallace6-13/+24
- This is a pre-requisite for using amazon S3 for log storage. - Requires docker images built by updated docker scripts to include packages required by 'lftools' or other project specific docker images to be upgraded with same packages. This change only updates jobs which are using fdiotools docker images. - Add FD.io specific global macros to avoid inflating docker images with packages required by unneeded global-jjb scripts. - Sort VPP job parameters alphabetically - Dump installed python3 packages in setup_executor_env.sh Change-Id: Ifddd8f2b70b10acf834ffc837b27ef5453213a86 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-11-23docker images: add aarch64 centos supportJuraj Linkeš2-4/+4
Add the changes that were missing for a successful build. Change-Id: I0def3dcf2642110384674977ecf901c65fde4d78 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-11-05Merge "Promote centos-8 verify/merge jobs to production."Vratko Polak1-0/+1
2020-11-04Add debian-10 tag info to docker generation README file.Dave Wallace1-0/+61
- Add note about tagging and pushing initial images to a new Docker Hub repository. Change-Id: I762a6795d5bbee1715bf6e868a550bf94b35a5db Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-11-03Promote centos-8 verify/merge jobs to production.Dave Wallace1-0/+1
- Executor docker image fdiotools/builder-centos8:prod-x86_64 image verified on sandbox with latest master and stable/2009 patches Change-Id: Ibe619a0082130a60273cbfda2c008ae452194f7a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-10-28Automate generation of docker builder images.Dave Wallace15-0/+2835
- Add bash scripts to generate builder image Dockerfile that invokes the scripts to iterate over project branches installing OS packages and python modules. Change-Id: I9b3b355b593e2f982f287023c662cc4a4f35a734 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>