summaryrefslogtreecommitdiffstats
path: root/docker
AgeCommit message (Collapse)AuthorFilesLines
2021-04-23Merge "Refactor ccache config to use per-os ccache dirs."Vratko Polak3-3/+6
2021-04-21Fix docker image update scriptDave Wallace1-1/+4
- Handle case where the original image has been deleted from dockerhub. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ifcb34f39b36f2974d45a48754b72d33e9cfc4b06
2021-04-21Refactor ccache config to use per-os ccache dirs.Dave Wallace3-3/+6
- Simplify ccache state output to console log by using ccache stats command. - Bump max size of ccache dir to 10G (centos8 is approximately 5.7G) - Clean up extraneous ccache dir after docker build is complete. Change-Id: Ia2b55b7cd47212fce91b4567d0cca69d2ce892ed Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-13builder: if new ansible dir doesn't exist, use old one.Dave Wallace1-0/+3
Change-Id: I539fc3981b46a285bf6934d2dd13c8c660fc0e8a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-09Fix broken docker install for debian-9 executor.Dave Wallace1-2/+12
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I4766dfec19de63ba6ae7dbd86ed70f696a10f117
2021-04-08Scripts: Change CSIT ansible pathpmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I09ad51af52e9246ab4491ffd7ed03ab5c8a09268
2021-03-25Enable CCACHE in builder images / labelsDave Wallace3-6/+3
- Remove aarch64 labels which do not have any executor docker images. Change-Id: I1f46929b1c8393aa7a25bad215a95b85f2e00bd9 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-03-20Use Ubuntu-20.04 for vpp-csit-* job executor imagesDave Wallace21-1097/+1061
- refactor vpp-csit job names to conform to the vpp job nomenclature - add ubuntu-20.04 for CSIT image builder install requirements - fix executor class verification - add option to build_executor_docker_image.sh to dump Dockerfile without building image(s) - refactor Dockerfile generation to support executor classes - add support for csit_shim and csit_dut docker image generation from csit ansible repo - refactor docker installation - refactor locale support - remove old static csit Dockerfiles - remove unused jenkins labels - use csit-builder-{os}-prod-{executor_arch} label for vpp csit device test - run tox in csit_pip_cache() to include pylint requirements in python cache to avoid downloading from pypi during job execution. Change-Id: I5f4ffc587c6b8c43cb874dfd8c615ce56d3b97a4 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-18Fix installation of lftools python packages in docker images.Dave Wallace5-32/+34
- fix build script to remove $DOCKER_BUILD_DIR before copying ci-management repo into it. - remove unnecessary jenkins account configuration. Change-Id: I6267b13efad1426194ea87f63c7284bed4b988a1 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-12Move ubuntu2004-aarch64 jobs into productionDave Wallace1-2/+7
- move ubuntu2004-aarch64 merge/verify jobs from beta into production on master as required for https://gerrit.fd.io/r/c/vpp/+/30734 - remove beta job definitions - refactor os job add/remove from separate project definitions to exclude list in vpp-<arch> project definitions - handle errors when parsing yaml files in dbld_csit_find_ansible_packages.py Change-Id: Ife651a6b85c6c3872255f15bd87ede499ee78b22 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-09Add the core file decoding+cleanup for the verify jobsAndrew Yourtchenko1-1/+2
- Add better failure reporting and dry run handling for build scripts. Change-Id: Ia19bae15ff4880b07094f4f665e5e00030eda27c Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-04Promote vpp-*-centos8-aarch64 jobs to productionDave Wallace1-2/+3
- Update lftools install in the docker image builder to use the same options as global-jjb lf-activate-venv to pre-populate python cache, otherwise it takes 15+ minutes for lf-activate-venv to complete. Change-Id: I8c1124faadfbf65228c31418ed02b5967e7fa82c Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-02-03Add packages to docker image builderDave Wallace4-2/+13
- sshpass for CSIT - gdb for VPP core decode - Add comment to end of builder script to detect completion in build log. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I6ddbc066f07514dbd76f02104bc04c3bc70da163
2021-02-02Deprecate VPP stable/2005Dave Wallace1-2/+2
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ifba4ab4270d8eddf9713fa817f00b179247fd09f
2021-01-28Merge "Import jjb test bash functions from vpp repo."Vratko Polak1-17/+0
2021-01-27Import jjb test bash functions from vpp repo.Dave Wallace1-17/+0
- Also move get_gerrit_refspec() from docker/scripts/lib_common.sh into sandbox_test_functions.sh Change-Id: I8f4a1648da678361c7ab364724f488571c91f0b7 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-01-14Update VPP branches for docker image builder.Dave Wallace1-7/+14
- Remove stable/2001 which has been deprecated - Add stable/2101 - Remove debian-9 from master Change-Id: I9b88d01bc38284aba5390c4583f1ac6a0e23cba8 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-01-05Remove VPP 19.08 jobsDave Wallace2-10/+4
- Also remove stable/1908 from the docker image build scripts. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I44fc73898b936ec75721801956e76412da262e49
2020-12-18docker: update distro packagesJuraj Linkeš3-8/+9
Remove puppet, since it's not used. Add the missing yum/dnf libxslt dev package needed for Aarch64 CentOS-8 docker image build. Change-Id: I8669e5d7aba6a5ad113bb0f3f9ea737ce6ae6829 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-12-15Use 'lftools deploy archives' for log uploadDave Wallace6-13/+24
- This is a pre-requisite for using amazon S3 for log storage. - Requires docker images built by updated docker scripts to include packages required by 'lftools' or other project specific docker images to be upgraded with same packages. This change only updates jobs which are using fdiotools docker images. - Add FD.io specific global macros to avoid inflating docker images with packages required by unneeded global-jjb scripts. - Sort VPP job parameters alphabetically - Dump installed python3 packages in setup_executor_env.sh Change-Id: Ifddd8f2b70b10acf834ffc837b27ef5453213a86 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-11-23docker images: add aarch64 centos supportJuraj Linkeš2-4/+4
Add the changes that were missing for a successful build. Change-Id: I0def3dcf2642110384674977ecf901c65fde4d78 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-11-05Merge "Promote centos-8 verify/merge jobs to production."Vratko Polak1-0/+1
2020-11-04Add debian-10 tag info to docker generation README file.Dave Wallace1-0/+61
- Add note about tagging and pushing initial images to a new Docker Hub repository. Change-Id: I762a6795d5bbee1715bf6e868a550bf94b35a5db Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-11-03Promote centos-8 verify/merge jobs to production.Dave Wallace1-0/+1
- Executor docker image fdiotools/builder-centos8:prod-x86_64 image verified on sandbox with latest master and stable/2009 patches Change-Id: Ibe619a0082130a60273cbfda2c008ae452194f7a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-10-28Automate generation of docker builder images.Dave Wallace15-0/+2835
- Add bash scripts to generate builder image Dockerfile that invokes the scripts to iterate over project branches installing OS packages and python modules. Change-Id: I9b3b355b593e2f982f287023c662cc4a4f35a734 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-10-13Clean up vpp jenkins scripts & docker dirDave Wallace59-3458/+2
- Remove docker/vpp Dockerfile definitions and colateral files for image now being build by https://gerrit.fd.io/r/c/ci-management/+/28022 - Remove opensuse support which has been elided from the vpp build in https://gerrit.fd.io/r/c/vpp/+/28999 - Remove unused scripts. - Output script name marker for all jjb scripts following LFIT practices. - Remove old/unused output from scripts. - Add logic to use vpp-ext-deps download cache in the executor images to speed up build jobs. - Add copyright notifcations to modified files without an existing copyright. - Make all vpp/docs jobs use '-{stream}-{os}-{executor}' suffix in their names. - Consolidate executor logging into setup_executor_env.sh and call it first for all jobs. Change-Id: I4ffb67ed476659f0127ca8c84f20a305d06149bf Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-05-28Update Nomad docker image files for VPP & CSITDave Wallace59-18/+1511
- The docker image files were originally created by Ed Kern for the Nomad container proof of concept build infrastructure for the VPP project. The original source files and commit history can be found in the respective repositories at https://github.com/snergfdio Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Iff0a8fc76e8a1d2b56dfea6daff688b237338568
2020-04-27Import VPP docker files from githubDave Wallace9-0/+2572
- These Dockerfiles were originally created by Ed Kern for the Nomad container proof of concept build infrastructure for the VPP project. The original source files and commit history can be found in the respective repositories at https://github.com/snergfdio Change-Id: I6c32cb013cbfad33c41d99992e5f97e0264b625a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>