summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-04-22Merge "Fix docker image update script"Vratko Polak1-1/+4
2021-04-21Fix docker image update scriptDave Wallace1-1/+4
- Handle case where the original image has been deleted from dockerhub. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ifcb34f39b36f2974d45a48754b72d33e9cfc4b06
2021-04-21Refactor ccache config to use per-os ccache dirs.Dave Wallace31-47/+44
- Simplify ccache state output to console log by using ccache stats command. - Bump max size of ccache dir to 10G (centos8 is approximately 5.7G) - Clean up extraneous ccache dir after docker build is complete. Change-Id: Ia2b55b7cd47212fce91b4567d0cca69d2ce892ed Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-20Merge "Modify OpenStack builders"Vanessa Rene Valderrama3-3/+3
2021-04-20Merge "Add new dev branch to the CI framework"Vratko Polak1-0/+2
2021-04-16Modify OpenStack buildersVanessa Rene Valderrama3-3/+3
Modifying OpenStack builders to use V3 flavors Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org> Change-Id: I1601921bba92f9ad9519dda992846ccca586d657
2021-04-16Fix backup archive directory structure.Dave Wallace1-18/+7
Change-Id: I9fd1194bdb68239df2a6e2c4432ec1849ca12aac Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-15Merge "builder: if new ansible dir doesn't exist, use old one."Vanessa Rene Valderrama1-0/+3
2021-04-14Upgrade global-jjb to v0.62.0Vanessa Rene Valderrama1-0/+0
Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org> Change-Id: I2b5f181f32ce399d6b6091ab051562fe6e714fb6
2021-04-14Testing JCasCVanessa Rene Valderrama1-1/+1
Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org> Change-Id: I857f42130e50c73bce2844a15c0e351d717a21fd
2021-04-14Add new dev branch to the CI frameworkKonstantin Ananyev1-0/+2
Signed-off-by: Konstantin Ananyev <konstantin.ananyev@intel.com> Change-Id: Icb676be654efa89792b7917c77d90c4d8092712a
2021-04-13builder: if new ansible dir doesn't exist, use old one.Dave Wallace1-0/+3
Change-Id: I539fc3981b46a285bf6934d2dd13c8c660fc0e8a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-13Merge "CSIT: restrict CSIT VPP Device to 32 cores"Dave Wallace1-0/+8
2021-04-12Merge "Use fdio-infra-publish for nomad executor based jobs"Vanessa Rene Valderrama13-88/+107
2021-04-09Fix broken docker install for debian-9 executor.Dave Wallace1-2/+12
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I4766dfec19de63ba6ae7dbd86ed70f696a10f117
2021-04-09CSIT: restrict CSIT VPP Device to 32 coresJuraj Linkeš1-0/+8
We're seeing frequent "Host high CPU load" alerts. The jobs are not restricted in any way, which could lead to resource starvation or misdirection of resources between jobs. Mirror the VPP jobs configuration - restrict to 32 cores. Change-Id: I6b36602df0546fedf9603dda395325199130513e Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-04-08Use fdio-infra-publish for nomad executor based jobsDave Wallace13-88/+107
- Separate post build executor info dump into its own script file. - Remove backup_upload_archives.sh from fdio-infra-shiplogs which is now only used for openstack executors. - Add setup_executor_env.sh to run first for all jobs which run on nomad/dockerhub images. Change-Id: I564201b8c578e6541152e6af74537d1d007ba1a7 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-08Scripts: Change CSIT ansible pathpmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I09ad51af52e9246ab4491ffd7ed03ab5c8a09268
2021-04-06disable ASAN in the debug buildsAndrew Yourtchenko1-1/+3
The move to unix sockets has broken ASAN fairly thoroughly, so disable it Change-Id: Icf3822c5927309f8574865008173a66019a3ed55 Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
2021-04-01Merge "Fix hicn-docs job to use correct label."Vratko Polak1-5/+10
2021-03-31Fix hicn-docs job to use correct label.Dave Wallace1-5/+10
- Also add gerrit-parameter & branch-refspec for testing in jenkins sandbox (same pattern as vpp.yaml). Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ia48c7e484db78f35dffe93e78c418736c686b356
2021-03-30Modify OpenStack templatesVanessa Rene Valderrama4-4/+4
Switching the OpenStack templates used by CI mgmt jobs back to V2 flavors due to problems with the V3 flavors in production. Modifying the INFO.yaml job to use a template with a V3 flavor to continue troubleshooting the issue in production because this issue can't be reproduced on the sandbox. Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org> Change-Id: Ibc8e744e3201538122965a70ab0f23ca3fe66371
2021-03-29Modify executor flavorsVanessa Rene Valderrama4-7/+3
Modifying the executors to use the new V3 flavors which will improve performance and are more cost efficient. Tested in production using the centos7-v3-4c-4g template which can now be removed. Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org> Change-Id: I92c25c86b368546cf0ef8db05c2ed832a99b82c1
2021-03-29Add additional V3 templateVanessa Rene Valderrama1-0/+4
Adding a centos7-v3-4c-4g to test V3 flavors. When testing is scucessful, the centos7-builder-4c-4g will be modified to use the V3 builder and this additional template will be removed. Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org> Change-Id: Ic1e02b7c5c550a7c15c8f7f06844c510c43eb77b
2021-03-26Merge "Include container id in console log."Vanessa Rene Valderrama2-4/+19
2021-03-26Include container id in console log.Dave Wallace2-4/+19
- Output executor runtime attributes in post_build_deploy_archives.sh for the case when a job fails prior to setup_executor_env.sh Change-Id: Icb54c039db21a621d44808221a3100c509583090 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-03-26Merge "bump CPU and memory in ubuntu2004 nomad jobs from 16000 to 20000"Dave Wallace1-2/+2
2021-03-26bump CPU and memory in ubuntu2004 nomad jobs from 16000 to 20000Andrew Yourtchenko1-2/+2
Some jobs fail due to OOMKILLER, the theory is that the python 3.8.5 takes more memory than 3.7.3, which runs on debian10 where no such failures are seen. Change-Id: Ie263055b0292f4afab3a907a107479a3f8fb962b Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
2021-03-25Enable CCACHE in builder images / labelsDave Wallace40-51/+52
- Remove aarch64 labels which do not have any executor docker images. Change-Id: I1f46929b1c8393aa7a25bad215a95b85f2e00bd9 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-03-24Remove temporary DNS fix.Dave Wallace2-7/+2
- Use search domain in /etc/resolv.conf as hostname. Change-Id: Iaf156a2096a1b60f6222fa2d7f99101d72e2572c Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-03-24Merge "Force DNS nameserver in CI jobs to use local consul server."Vratko Polak1-0/+3
2021-03-23Force DNS nameserver in CI jobs to use local consul server.Dave Wallace1-0/+3
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I76b7f4668ad0bfb11e9045de2d7f8e150132083a
2021-03-23Update node configuration of hicn-docs.yaml.Mauro Sardara1-72/+73
Signed-off-by: Mauro Sardara <msardara@cisco.com> Change-Id: I3c355a03a6609204a7637294ef133a9eda6eca50 Signed-off-by: Mauro Sardara <msardara@cisco.com>
2021-03-22Merge "Use Ubuntu-20.04 for vpp-csit-* job executor images"Vratko Polak29-1206/+1148
2021-03-20Use Ubuntu-20.04 for vpp-csit-* job executor imagesDave Wallace29-1206/+1148
- refactor vpp-csit job names to conform to the vpp job nomenclature - add ubuntu-20.04 for CSIT image builder install requirements - fix executor class verification - add option to build_executor_docker_image.sh to dump Dockerfile without building image(s) - refactor Dockerfile generation to support executor classes - add support for csit_shim and csit_dut docker image generation from csit ansible repo - refactor docker installation - refactor locale support - remove old static csit Dockerfiles - remove unused jenkins labels - use csit-builder-{os}-prod-{executor_arch} label for vpp csit device test - run tox in csit_pip_cache() to include pylint requirements in python cache to avoid downloading from pypi during job execution. Change-Id: I5f4ffc587c6b8c43cb874dfd8c615ce56d3b97a4 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-03-19CSIT: Convert jobs to ubuntu2004 part Vpmikus1-30/+30
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibf5202e13a008ebc7480dfcfc1e0705d0552705b
2021-03-18Merge "Modify ci-management flavor"Andrew Grimberg4-4/+4
2021-03-18Modify ci-management flavorVanessa Rene Valderrama4-4/+4
Modifying the ci-mgmt flavor to use v2 while we figure out what the issue is with the v3 flavors. Noticed the merge job is using the wrong builder so I switched it to the 4c-4g builder. Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org> Change-Id: I23c5e9ab21711d8545fdbcd12baeb1cfc55a3662
2021-03-18CSIT: Convert jobs to ubuntu2004 part.IVpmikus1-110/+15
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I36256126ebc75398d20abd366889eb31ed7a9643
2021-03-18CSIT: Prepare Ubuntu2004 vpp device templatespmikus11-101/+27
+ Nomad templates Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I4f1a0d2e7b44ab13ec6822116fee27053532c7ee
2021-03-16Merge "Update sandbox bash functions"Vanessa Rene Valderrama1-4/+24
2021-03-15Merge "CSIT: Convert jobs to ubuntu2004 part.II"Dave Wallace1-98/+229
2021-03-15CSIT: Convert jobs to ubuntu2004 part.IIpmikus1-98/+229
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7417c6c14eaa7a9dfd09b972ede4c70aa4ff93f0
2021-03-12Modify executor flavorsVanessa Rene Valderrama16-16/+16
Modifying the executors to use the new V3 flavors which will improve performance and are more cost efficient. Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org> Change-Id: I74bdda1e2be2a42e0927e8bd4243dd2b495e3cef
2021-03-12Upgrade common-packer to v0.7.6Vanessa Rene Valderrama1-0/+0
Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org> Change-Id: I8c358ae6a244db7c22adbb99d269f9c5748cb74f
2021-03-12Merge "CSIT: Convert jobs to ubuntu2004 part.IV"Dave Wallace1-10/+9
2021-03-12Merge "CSIT: Convert jobs to ubuntu2004 part.III"Dave Wallace1-4/+5
2021-03-11Merge "Upgrade common-packer to v0.7.5"Vanessa Rene Valderrama1-0/+0
2021-03-11CSIT: Convert jobs to ubuntu2004 part.IVpmikus1-10/+9
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I69e2393dafe129fa9effd6ce10f6b1ac34616860
2021-03-10Update sandbox bash functionsDave Wallace1-4/+24
- Add '-n' option to jjsb-test() and jjsb-update() to limit output to the most useful information of each function -- job names and number of jobs respectively. Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I47722c2238ad5bbdc9e289885303fe68239503f9