Age | Commit message (Collapse) | Author | Files | Lines |
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9209a4c739feb9aae713d0f3654d3cf6fa04c92d
|
|
It is not used since https://gerrit.fd.io/r/c/ci-management/+/33118
Change-Id: I62b167eff32fd27158e2dd7ae6deec2c25d8db47
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If7f9889fce320c2d53c7ff1c25d1a505e5f80eaf
|
|
+ Rework report/docs/trending jobs in CSIT
to utilize AWS S3 cloudfront
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ica2757ba8dc31792631c8d6b53b332ebf688b15e
|
|
https://gerrit.fd.io/r/c/ci-management/+/33060
has introduced workarounds for jobs
which create Robot outputs outside /archives/.
It got merged without verifying the workarounds work correctly.
+ The workaround for device job does not seem to be needed.
+ Perform the copy also when robot failed.
Fixes: 37a55a05cd6ac7ca15bbb99f5ddc9ca61874d5f8
Change-Id: I5e08545bd290fa917e85a375865a130c3f2ff996
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
This patch removes archive-artifacts-parameter macro
and ARCHVIVE_ARTIFACTS env var from csit and vpp project.
All project specific artifacts to be uploaded with the
log files SHOULD BE copied to $WORKSPACE/archives.
The next step once this is merged will be to remove NEXUS
entirely via JCasC.
+ Remove archive-artifacts from all csit/vpp yaml files.
+ Add fdio-infra-ship-backup-logs macro
+ Remove unused jjb/include-raw-deploy-archives.sh
+ CSIT:
- copy job artifacts to $WORKSPACE/archives
+ HC2VPP
- remove CSIT
+ TLDK:
- remove CSIT
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Iada020cf269714c34f9ce32d764d991827e3b003
|
|
- To prevent false positives when searching console logs for
jobs which are downloading content over the internet.
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I0d9d1e3138380453eabab6a0fe2844311304491f
|
|
|
|
+ Useful for performance analysis before run.
This should help to analyze machine load before starting
payload by comparing conditions from running jobs.
- Requirements: sysstat (apt install sysstat)
- Remove extraneous python import from
backup_upload_archives.sh
- Fix sar issue on centos-7
- Fix debian9 lftools install / upgrade issue
Signed-off-by: pmikus <pmikus@cisco.com>
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I6b61f99b9b2cde2bac3dacdefaa926e9afbb157e
|
|
the api-checkstyle was initially done with notification for both successful
and failed api-checkstyle runs, just as a matter of precaution.
It's time to keep the notification only for the fail case, thus
fulfilling the point of notifications.
Change-Id: I41a12e7a30bc852c9280fc08a6eae426438f7d92
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
|
|
- make test DOCS_DIR in vpp/master changed location,
fix upload for master and subsequent release
branches.
- Don't archive docs build output to avoid
stress on nexus
- Sphinx docs are generated and pushed
to github by hand for publishing. Therefore
remove sphinx docs jobs and include building
of sphinx docs in the vpp-docs-verify-* jobs.
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I3b2badbf3e2b242ad6b4efcc7d6d281c8b26136b
|
|
- Add additional executor info to console output
for consul log storage.
Change-Id: Ifc9174ff69f26aa31f92e3680606f7a2303b5924
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
|
|
- Separate removal of socket files in workspace archive directory
from archiving of artifacts
- Clean up deprecated workspace-archive-artifacts-parameter macro
Change-Id: I11c7fe55d3412fb7261da9f0cfb809a152ae1d51
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
- Simplify ccache state output to console log by
using ccache stats command.
- Bump max size of ccache dir to 10G (centos8 is
approximately 5.7G)
- Clean up extraneous ccache dir after docker build
is complete.
Change-Id: Ia2b55b7cd47212fce91b4567d0cca69d2ce892ed
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Change-Id: I9fd1194bdb68239df2a6e2c4432ec1849ca12aac
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
- Separate post build executor info dump into its
own script file.
- Remove backup_upload_archives.sh from
fdio-infra-shiplogs which is now only used for
openstack executors.
- Add setup_executor_env.sh to run first for all
jobs which run on nomad/dockerhub images.
Change-Id: I564201b8c578e6541152e6af74537d1d007ba1a7
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
The move to unix sockets has broken ASAN fairly thoroughly, so disable it
Change-Id: Icf3822c5927309f8574865008173a66019a3ed55
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
|
|
|
|
- Output executor runtime attributes in
post_build_deploy_archives.sh for the case
when a job fails prior to setup_executor_env.sh
Change-Id: Icb54c039db21a621d44808221a3100c509583090
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
- Remove aarch64 labels which do not have any executor docker images.
Change-Id: I1f46929b1c8393aa7a25bad215a95b85f2e00bd9
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
- Use search domain in /etc/resolv.conf as hostname.
Change-Id: Iaf156a2096a1b60f6222fa2d7f99101d72e2572c
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I76b7f4668ad0bfb11e9045de2d7f8e150132083a
|
|
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I2f7b549a903d3cd572a4711901ce1d138e922aa5
|
|
|
|
API checkstyle is unhappy if the repo is not clean.
An example:
https://jenkins.fd.io/job/vpp-checkstyle-verify-master-ubuntu2004-x86_64/598/console
Output the changes to make diagnostics easier.
Change-Id: I3fe1dfd0adde47e2140151687a6ab31885fc851c
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
|
|
|
|
This patch enables the multi-worker make test
on the branches that support it, as a voting job directly,
to capture the working tests and avoid the new non-working
multiworker testcases.
Change-Id: Ibeedd8f8aa2851c022b045d37505bb75bf460de8
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
|
|
Problem: The VPP CI merge and verify jobs use the "make verify", which has
special handling depending on the OS. So, to make meaningful changes
like running the test suite on more platforms, one would need
to make the changes in two places, which is error-prone and slow.
Solution: move the logic on which OS to run the "make test" into
the ci-management scripts, and stop using "make verify"
Change-Id: Icc7daa9364198f455ed8ca5bae5e5da5f15baf48
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
|
|
- Add better failure reporting and dry run handling
for build scripts.
Change-Id: Ia19bae15ff4880b07094f4f665e5e00030eda27c
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
if they are already compressed
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
Change-Id: Ie0ce0a303f3d681b8aae697c1b358534e68b2c28
|
|
- Since merge jobs are serialized after the patches have
been merged into git, all merge jobs which do not have
the same Gerrit ID as git HEAD are redundant. Skip
them to save useless cycles and to reduce the size of
the build queues when multiple patches are merged in a
short amount of time.
- This also fixes the issue with packagecloud packages
containing different contents then the associated
Gerrit ID when built & pushed in this state.
Change-Id: I822492bd1d523576373bb268258c181a9c5edb42
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Change-Id: Ib3e9c9ae1fd053c06840f7bc5124aae48fe58e76
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
|
|
Change-Id: I45efc7227d4efd37e26cae50495306834ac17d0d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
installing vpp-ext-deps"
|
|
vpp-ext-deps
If a new empty packagecloud.io/fdio/XXYY empty repository is being added during the stable/XXYY
branch creation process, the jobs will fail unless a dummy artifact is added to this repository.
Since we only use this repository to install the right version of vpp-ext-deps, delete
the references after that portion is complete.
Change-Id: Ia5dfa5bf0193c0af8671d561d27f9f02c4e641f4
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
|
|
- This is a pre-requisite for using amazon S3
for log storage.
- Requires docker images built by updated
docker scripts to include packages required
by 'lftools' or other project specific
docker images to be upgraded with same
packages. This change only updates jobs
which are using fdiotools docker images.
- Add FD.io specific global macros to avoid
inflating docker images with packages
required by unneeded global-jjb scripts.
- Sort VPP job parameters alphabetically
- Dump installed python3 packages in
setup_executor_env.sh
Change-Id: Ifddd8f2b70b10acf834ffc837b27ef5453213a86
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Address sanitizer catches a wide range of failures
like buffer overruns, etc. So makes sense to run it
during the debug test run.
However, it is a bit picky to the compiler -
currently it only works well only on GCC 8+,
so this patch accounts for that by moving
the job to 20.04 executor which has gcc-9 by default.
Thanks to Benoit for the help getting it working.
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
Change-Id: If086907d1f20e99503aa0e811fd2ae95c168d731
|
|
+ Add job parameters for Sandbox testing.
Change-Id: I3f8c088bd49b1926393a6fa9d3327dd6c7533656
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Fix regression in previous change to packagecloud_push.sh
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: Idfb47bd49bc59467ba3f28499edcdd41a00d04ce
|
|
- When a new vpp-ext-deps version is created, the
packagecloud_push.sh script will declare a failure
for merge jobs if the package already has been
pushed by another job running in parallel.
Since vpp-ext-deps will be automatically rebuilt
by the VPP build, there is no reason to fail the
merge job if the packagecloud push fails for the
vpp-ext-deps package.
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I96edc6948b7f8b654cc66154412e5eb00927266a
|
|
- In setup_vpp_dpdk_dev_env.sh if the required
vpp-ext-deps package version is available in
/root/Downloads, then install the local package
instead of downloading and installing it from
packagecloud.io.
Change-Id: Iffb8394288524732a2fd2795eec6324d85b17ef5
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
- The version of apt-cache on debian-10 does not produce
the same output as the versions in Ubuntu distros.
Refactor extraction of vpp-ext-deps package name from
apt-cache output.
Change-Id: I92c297d91f6acf332be6a54bc1eaac83a4d3d7da
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
- Fix set -e bug on snergster executors for vpp stable/*
branches introduced by
https://gerrit.fd.io/r/c/ci-management/+/29209
Change-Id: Icb261cf0a198f9c76feca689e4013a5dd0247f8b
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
- Remove docker/vpp Dockerfile definitions and
colateral files for image now being build by
https://gerrit.fd.io/r/c/ci-management/+/28022
- Remove opensuse support which has been elided
from the vpp build in
https://gerrit.fd.io/r/c/vpp/+/28999
- Remove unused scripts.
- Output script name marker for all jjb scripts
following LFIT practices.
- Remove old/unused output from scripts.
- Add logic to use vpp-ext-deps download cache
in the executor images to speed up build jobs.
- Add copyright notifcations to modified files
without an existing copyright.
- Make all vpp/docs jobs use '-{stream}-{os}-{executor}'
suffix in their names.
- Consolidate executor logging into
setup_executor_env.sh and call it first for all jobs.
Change-Id: I4ffb67ed476659f0127ca8c84f20a305d06149bf
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I99905d7a00b11d81715789af64774b375bd404d7
|
|
- Switch to using fdiotools docker repos using
associated jenkins labels.
- Align vpp job names with docker repos and tags.
- Normalize project attributes (including order)
across vpp project definitions.
- Add branch-head-refspec attribute for testing.
- Refactor projects to allow finer granularity
definition of {stream}-{os}-{executor-arch}
based jobs.
- Add 2009 stream to vpp-csit-verify-api-crc.
- Add vpp-verify-gcc job for gcov testing.
New list of VPP jobs:
$ jjsb-test vpp-* 2>&1 | grep -e'Number of jobs' -e'Job name' | sed -e 's/INFO:jenkins_jobs.builder://g'
Number of jobs generated: 126
Job name: vpp-beta-merge-master-centos8-aarch64
Job name: vpp-beta-merge-master-centos8-x86_64
Job name: vpp-beta-merge-master-debian9-x86_64
Job name: vpp-beta-merge-master-debian10-x86_64
Job name: vpp-beta-verify-master-centos8-aarch64
Job name: vpp-beta-verify-master-centos8-x86_64
Job name: vpp-beta-verify-master-debian9-x86_64
Job name: vpp-beta-verify-master-debian10-x86_64
Job name: vpp-checkstyle-verify-1908-x86_64
Job name: vpp-checkstyle-verify-2001-x86_64
Job name: vpp-checkstyle-verify-2005-x86_64
Job name: vpp-checkstyle-verify-2009-x86_64
Job name: vpp-checkstyle-verify-master-x86_64
Job name: vpp-csit-verify-api-crc-1908
Job name: vpp-csit-verify-api-crc-2009
Job name: vpp-csit-verify-api-crc-master
Job name: vpp-csit-verify-device-1908-1n-skx
Job name: vpp-csit-verify-device-1908-1n-tx2
Job name: vpp-csit-verify-device-2001-1n-skx
Job name: vpp-csit-verify-device-2001-1n-tx2
Job name: vpp-csit-verify-device-2005-1n-skx
Job name: vpp-csit-verify-device-2005-1n-tx2
Job name: vpp-csit-verify-device-2009-1n-skx
Job name: vpp-csit-verify-device-2009-1n-tx2
Job name: vpp-csit-verify-device-master-1n-skx
Job name: vpp-csit-verify-device-master-1n-tx2
Job name: vpp-csit-verify-perf-1908-2n-clx
Job name: vpp-csit-verify-perf-1908-2n-dnv
Job name: vpp-csit-verify-perf-1908-2n-skx
Job name: vpp-csit-verify-perf-1908-3n-dnv
Job name: vpp-csit-verify-perf-1908-3n-hsw
Job name: vpp-csit-verify-perf-1908-3n-skx
Job name: vpp-csit-verify-perf-1908-3n-tsh
Job name: vpp-csit-verify-perf-2001-2n-clx
Job name: vpp-csit-verify-perf-2001-2n-dnv
Job name: vpp-csit-verify-perf-2001-2n-skx
Job name: vpp-csit-verify-perf-2001-3n-dnv
Job name: vpp-csit-verify-perf-2001-3n-hsw
Job name: vpp-csit-verify-perf-2001-3n-skx
Job name: vpp-csit-verify-perf-2001-3n-tsh
Job name: vpp-csit-verify-perf-2005-2n-clx
Job name: vpp-csit-verify-perf-2005-2n-dnv
Job name: vpp-csit-verify-perf-2005-2n-skx
Job name: vpp-csit-verify-perf-2005-3n-dnv
Job name: vpp-csit-verify-perf-2005-3n-hsw
Job name: vpp-csit-verify-perf-2005-3n-skx
Job name: vpp-csit-verify-perf-2005-3n-tsh
Job name: vpp-csit-verify-perf-2009-2n-clx
Job name: vpp-csit-verify-perf-2009-2n-dnv
Job name: vpp-csit-verify-perf-2009-2n-skx
Job name: vpp-csit-verify-perf-2009-3n-dnv
Job name: vpp-csit-verify-perf-2009-3n-hsw
Job name: vpp-csit-verify-perf-2009-3n-skx
Job name: vpp-csit-verify-perf-2009-3n-tsh
Job name: vpp-csit-verify-perf-master-2n-clx
Job name: vpp-csit-verify-perf-master-2n-dnv
Job name: vpp-csit-verify-perf-master-2n-skx
Job name: vpp-csit-verify-perf-master-3n-dnv
Job name: vpp-csit-verify-perf-master-3n-hsw
Job name: vpp-csit-verify-perf-master-3n-skx
Job name: vpp-csit-verify-perf-master-3n-tsh
Job name: vpp-debug-verify-2009-ubuntu1804-x86_64
Job name: vpp-debug-verify-master-ubuntu1804-x86_64
Job name: vpp-docs-merge-1908
Job name: vpp-docs-merge-2001
Job name: vpp-docs-merge-2005
Job name: vpp-docs-merge-2009
Job name: vpp-docs-merge-master
Job name: vpp-docs-verify-1908
Job name: vpp-docs-verify-2001
Job name: vpp-docs-verify-2005
Job name: vpp-docs-verify-2009
Job name: vpp-docs-verify-master
Job name: vpp-gcc-verify-2009-ubuntu2004-x86_64
Job name: vpp-gcc-verify-master-ubuntu2004-x86_64
Job name: vpp-info-yaml-verify
Job name: vpp-make-test-docs-merge-1908
Job name: vpp-make-test-docs-merge-2001
Job name: vpp-make-test-docs-merge-2005
Job name: vpp-make-test-docs-merge-2009
Job name: vpp-make-test-docs-merge-master
Job name: vpp-make-test-docs-verify-1908
Job name: vpp-make-test-docs-verify-2001
Job name: vpp-make-test-docs-verify-2005
Job name: vpp-make-test-docs-verify-2009
Job name: vpp-make-test-docs-verify-master
Job name: vpp-merge-1908-centos7-x86_64
Job name: vpp-merge-1908-ubuntu1804-aarch64
Job name: vpp-merge-1908-ubuntu1804-x86_64
Job name: vpp-merge-2001-centos7-x86_64
Job name: vpp-merge-2001-ubuntu1804-aarch64
Job name: vpp-merge-2001-ubuntu1804-x86_64
Job name: vpp-merge-2005-centos7-x86_64
Job name: vpp-merge-2005-ubuntu1804-aarch64
Job name: vpp-merge-2005-ubuntu1804-x86_64
Job name: vpp-merge-2009-centos7-x86_64
Job name: vpp-merge-2009-ubuntu1804-aarch64
Job name: vpp-merge-2009-ubuntu1804-x86_64
Job name: vpp-merge-2009-ubuntu2004-aarch64
Job name: vpp-merge-2009-ubuntu2004-x86_64
Job name: vpp-merge-master-centos7-x86_64
Job name: vpp-merge-master-ubuntu1804-aarch64
Job name: vpp-merge-master-ubuntu1804-x86_64
Job name: vpp-merge-master-ubuntu2004-aarch64
Job name: vpp-merge-master-ubuntu2004-x86_64
Job name: vpp-sphinx-docs-merge-master
Job name: vpp-sphinx-docs-verify-master
Job name: vpp-verify-1908-centos7-x86_64
Job name: vpp-verify-1908-ubuntu1804-aarch64
Job name: vpp-verify-1908-ubuntu1804-x86_64
Job name: vpp-verify-2001-centos7-x86_64
Job name: vpp-verify-2001-ubuntu1804-aarch64
Job name: vpp-verify-2001-ubuntu1804-x86_64
Job name: vpp-verify-2005-centos7-x86_64
Job name: vpp-verify-2005-ubuntu1804-aarch64
Job name: vpp-verify-2005-ubuntu1804-x86_64
Job name: vpp-verify-2009-centos7-x86_64
Job name: vpp-verify-2009-ubuntu1804-aarch64
Job name: vpp-verify-2009-ubuntu1804-x86_64
Job name: vpp-verify-2009-ubuntu2004-aarch64
Job name: vpp-verify-2009-ubuntu2004-x86_64
Job name: vpp-verify-master-centos7-x86_64
Job name: vpp-verify-master-ubuntu1804-aarch64
Job name: vpp-verify-master-ubuntu1804-x86_64
Job name: vpp-verify-master-ubuntu2004-aarch64
Job name: vpp-verify-master-ubuntu2004-x86_64
Change-Id: I46e786a2092043aa95baa12a24ea9531683f7d6f
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I7f5d1fec7a811908860816e8ba23c0a700dfadd5
|
|
CSIT differes in how MAKE_PARALLEL flags are logged to stdout before
build. Unify based on https://gerrit.fd.io/r/c/csit/+/27821.
Change-Id: I48bced4792e65da504e9a1815e598633315aecab
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
There are two sets of scripts doing basically the same thing,
one set for arm and one for x86. Use the same scripts for both
x86 and arm jobs, remove the unnecessary ones and update the scripts
so that they work on both architectures.
Change-Id: Ie9c29578d0f6af41e65c0f4723bc248e664cb8dd
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|