summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-07-19prefetch mavenC.J. Collier1-0/+12
* install maven at basebuild respin time * jenkins will be modified to point to pre-installed maven * this will eliminate many problems caused by an inability to fetch common files Change-Id: I93032bb08e8ce6ffc50cd89ce4c5f5d080e60726 Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-07-13Merge "CIMANAGE-12: csit-vpp-verify-master-semiweekly job uses wrong CSIT ↵Andrew Grimberg1-1/+1
branch"
2016-07-12Improve respin scriptsC.J. Collier5-103/+253
In order to create a new OpenStack basebuild Images, a multi-phase process must be executed. The first phase is to configure the system for use with dynamic language environments. Due to security precautions, We do not currently have the ability to automate the process of respinning a new Image. We have a goal of fully automating the process so that a new Image will be generated on every commit. Until the process is self-hosted, we must manually fetch credentials from the OpenStack provider's web UI in order to make use of the python openstack bindings and to complete the basebuild re-spin process using Vagrant. The more generic portions of the Image are imported once every two to three weeks from upstream distributors. This duration is computed thus: $(perl -I${CI_MGMT}/vagrant/lib -MRespin -e 'Respin::latest_src_age( "${NOW_TS}", "${SRC_TS}" )') | jq .week Once fetched, these qcow2 Images are pushed to OpenStack using glance and labelled as: "$(lsb_release -i) $(lsb_release -r) (YYYYMMDDTHHMMSS) - LF upload" The generated basebuild Images are pushed to OpenStack with glance labelled as: "$(lsb_release -i) $(lsb_release -r) - basebuild - YYYYMMDDTHHMMSS" ==== This patch makes it possible to perform the above multi-phase processes by executing a single script: bash scripts/respin-jcloud-images.sh This script sources a function library from the following file: vagrant/lib/respin-functions.sh Defined in this library are (among others): # Fetch latest image from upstream distributor download_deb_image( $dist, $version, $arch ) download_rh_image( $dist, $version, $arch ) # Fetch latest image from upstream distributor create_deb_image( $dist, $version, $arch ) create_rh_image( $dist, $version, $arch ) # Run Vagrant provisioning on upstream image respin_deb_image( $dist, $version, $arch ) respin_rh_image( $dist, $version, $arch ) The following script initializes vagrant and the following dynamic language environments: * python-virtualenv * pip * setuptools * python-{cinder,glance,keystone,neutron,nova,openstack}client * rbenv * Vagrant * vagrant-openstack-provider * nodejs * jq * local::lib * JSON::XS * DateTime * DateTime::Format::Duration * DateTime::Duration scripts/init-respin-env.sh The following module compares ISO 8601 dates (as included in Image labels) with the current time and prints to STDOUT the count of weeks, days, hours, minutes and seconds in JSON: vagrant/lib/Respin.pm Change-Id: I434cf2882e5e337ae4b55a4a7acb774a62b528b7 Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-07-08Fix merge job to not try to push artifacts (yet) for vpp-liteEd Warnicke1-13/+1
Change-Id: I752040595646c98a6d5e23f5e1fb4a7377ba16f1 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-07-08Added vpp-lite verify and merge jobs.Ed Warnicke2-0/+240
* Added a vpp-lite.yaml Change-Id: I9aa16968dac9067a92bc272f1cfa4315c0eec4ad Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-07-07CIMANAGE-12: csit-vpp-verify-master-semiweekly job uses wrong CSIT branchJan Gelety1-1/+1
- use proper regex in grep command to choose correct csit branch Change-Id: I683e31e19d2eec556180c810cc1509abe6bfe4f4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-07-06Turn on timestampe for CSIT jobsEd Warnicke1-0/+2
Change-Id: I43c381f68c29405d8c3b34bdee6f69c2b115ebf4 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-07-04Merge "Add Jenkins job to run Honeycomb tests"C.J. Collier2-0/+75
2016-07-04CIMANAGE-11: Correction of the date string format for CSIT branchesJan Gelety1-1/+1
- change date string from YYYY-MM-DD to shorter one: YYMMDD Change-Id: I7ed3728ff6392aef23d7c6094f7aead255fcb7bd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-07-04Add Jenkins job to run Honeycomb testsTibor Frank2-0/+75
JIRA: CSIT-185 Change-Id: Ib113f55e2ed6f3dbb42728abebcbd5107216fdb5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-07-01CIMANAGE-11: Change of CSIT branch namesJan Gelety2-6/+6
- change csit-verified-master-YYYY-MM-DD to oper-YYMMDD - change csit-verified-stable1606-YYYY-MM-DD to oper-rls1606-YYMMDD Change-Id: Idcf889e1703d54ff33855ceb528ced54035e036d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-29Move from rpm push in merge to rpm push in integrationEd Warnicke1-19/+1
It turns out that doing rpm push in both merge and integration job leads to collisions because they have two separate sequences of BUILD_NUMBERs and those BUILD_NUMBERS are used for the rpm release number. So... this patch makes the merge job *stop* pushing rpms, and should cause the integration job to trigger on both vpp *and* honeycomb merge job success. Change-Id: I12fe582ea8a1444096b86c214b3cd3c412bc7591 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-29CIMANAGE-10 Add plots into semiweekly jobpmikus1-0/+134
Change-Id: I7f77bfa138428e825a203a31b8dd27e83f84807b Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-27Add : to end of include-raw-escape commandsC.J. Collier2-5/+5
Missing it is deprecated syntax Change-Id: Ib8a03206154e28c2a11abeea4df3b0cd1d7aac3b Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-06-21Correct jjb and mvn parameters for honeycomb deploymentC.J. Collier2-6/+12
* remove deprecated MaxPermSize argument from mvn * add repo-name parameter to job template definition Change-Id: Ic202a8cbf56df52970c22996980206ce3849e1a3 Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-06-21Declare maven-project-parameter for honeycomb-integration-* jobThanh Ha1-0/+2
Change-Id: I7e792a561e8bf45f7b011b4dd85a69b96db4361d Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
2016-06-21Merge "Branching for csit-vpp-verify-semiweekly job"C.J. Collier3-31/+54
2016-06-21Re-endable centos7 buildEd Warnicke1-0/+2
Change-Id: Ia3a342e96349fc7c3cfd7448fce3e20e957bebff Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-20Disable centos7 jobsEd Warnicke1-2/+0
Change-Id: I33ab63dc4870054253d8310c5fbc381e786e05f5 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-20Use honeycomb-settings for push of rpms to centosEd Warnicke1-4/+6
Change-Id: I13e35fcaf764db0c81dc335c0adb7e31ce7f8f42 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-17Disable centos7 builds for nowEd Warnicke1-2/+0
Change-Id: Iebb012635d1eb2d428c6859d4cf6d7d962203995 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-17Further fixes for maven push of rpm for honeycombEd Warnicke1-0/+14
Change-Id: I3c2a3650f30bd5d2bd49df30e78c57c5eb6d2ca8 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-17Fix honeycomb merge and integration job to have the correct maven settingsEd Warnicke1-0/+6
Change-Id: I0d341f1cc96c3d8a35a127f7cd6f667126dac9d7 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-17Branching for csit-vpp-verify-semiweekly jobJan Gelety3-31/+54
- introduce per branch semiweekly jobs: master, stable/1606 - check remote verified branches and use the latest one of the desired branch Change-Id: I715ee9e9c4732033bf7fd6a1fd25cdabe2c62e1d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-17Also have the -integration job push rpms for honeycomb.Ed Warnicke1-0/+4
Change-Id: If0c4bfaf9aeb650b5fb13f4c1ac64bc4919b7c5f Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-17Revert "Create script to automate deployment"Ed Warnicke6-117/+85
https://gerrit.fd.io/r/#/c/1606/ This reverts commit afd303bc155a27d1ddccfc8add7d510c731decf5. Change-Id: Ie169e3cad3433953d6f21064ec90b33d6b2dc49a Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-17Merge "Create script to automate deployment"Thanh Ha6-85/+117
2016-06-17Merge "Re-enable centos7 homeycomb verify and merge builds"C.J. Collier1-0/+2
2016-06-17Merge "CSIT: Do not autogenerate csv persistance plot file names."C.J. Collier1-0/+12
2016-06-17Re-enable centos7 homeycomb verify and merge buildsEd Warnicke1-0/+2
Change-Id: Ibf5610b0607001178791bd9b56bcd0427e5ffee8 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-17Add -{os} to node selectorEd Warnicke1-3/+3
Change-Id: I10da36d45ff8ea3d4b5c3a17e68d5ee89d3132de Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-17Create script to automate deploymentC.J. Collier6-85/+117
* as per #24343 * re-factored to use common code from include-raw-vpp-maven-push and maven_push_functions.sh Change-Id: I197c114bcf61b0dd2ea81e2be0505793cf594e49 Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-06-16Temporarily remove centos7 build as there is some issue thereEd Warnicke1-2/+0
Change-Id: I1dd82bb2a8c5f7c19aa8905a24133e5805f31ae2 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-16Merge "Remove spurious and mistaken pegging of jdk: {jdk}"C.J. Collier1-2/+0
2016-06-16CSIT: Do not autogenerate csv persistance plot file names.Miroslav Miklus1-0/+12
History of plotss is lost when JJB generates new file names on every commit to ci-management. plot: csv-file-name (str) – Use for choosing the file name in which the data will be persisted. If none specified and random name is generated as done in the Jenkins Plot plugin. (default: random generated .csv filename, same behaviour as the Jenkins Plot plugin) Change-Id: I1fe55eb035c168f489437f4617c41f877b9a9bc1 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-16Merge "FIX: Get CSIT branch from build-root/scripts/csit-test-branch"C.J. Collier1-2/+2
2016-06-16Remove spurious and mistaken pegging of jdk: {jdk}Ed Warnicke1-2/+0
Change-Id: Ie1f34c60b256588281e70b835b7bbd797265db3a Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-16Setup honeycomb to build and push rpms on mergeEd Warnicke3-1/+120
This patch depends on the merging of https://gerrit.fd.io/r/#/c/1574/ which must merge before it. Please also note, while there is a first step to getting the package pushing scripts into a common sharable place, the vpp script for pushing has *intentionally* not been changed to use it yet because of the release later this week as a matter of risk management. Change-Id: Ifad185d35f582a62bb750ece3c022a24d2153b4e Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-16FIX: Get CSIT branch from build-root/scripts/csit-test-branchMiroslav Miklus1-2/+2
JIRA: CSIT-167 Change-Id: I1a1d2cfd696228ec8558ba0a81c31d4c9d2c09b1 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-15Simplify READMEC.J. Collier5-49/+224
* configurable options have been moved to environment variables * processes have been simplified * Added a script to bootstrap openstack vagrant environment * Added an example openstack dummy box Vagrantfile Change-Id: I5dd850e9456ad205fe3a655ca9e16a9bb14f32e2 Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-06-15Add refs/heads/ prefix for git publisherMiroslav Miklus1-1/+1
ERROR: Failed to push branch csit-verified-master-2016-06-15 to origin hudson.plugins.git.GitException: Command "git -c core.askpass=true push ssh://rotterdam-jobbuilder@gerrit.fd.io:29418/csit HEAD:csit-verified-master-2016-06-15" returned status code 1: stdout: stderr: error: unable to push to unqualified destination: csit-verified-master-2016-06-15 The destination refspec neither matches an existing ref on the remote nor begins with refs/, and we are unable to guess a prefix based on the source ref. Change-Id: I98a3b0bb77ce9e845f63f9e32d8e8bf1f63832a6 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-14CSIT jobs - branchingMiroslav Miklus3-22/+30
- introduce per branch jobs: master, stable/1606 - weekly job to create csit-stable branch - archive artifacts for last 10 jobs Change-Id: Ib3eb7320fad365017d82a5a594123f0c68076151 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-10Add more Plots into csit-vpp-verfiy-perf-allpmikus1-4/+104
- Add more Plots (1c,2c,4c) into csit-vpp-verfiy-perf-all Change-Id: Idcc0892a65e1b28e8c0d7216eba8301cd1f9844b Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-09Merge "Get CSIT branch from build-root/scripts/csit-test-branch"C.J. Collier2-1/+27
2016-06-09Merge "Add simple plot into csit/perf job"C.J. Collier1-1/+23
2016-06-08Add common setup for vpp plugin verifiesEd Warnicke2-0/+46
Change-Id: Iac8b1d5408a9187fd39276881e21501c247c2231 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-08Fix issue in cleanup scriptEd Warnicke1-1/+1
Change-Id: I06c1b51a423fac735767abf6c5f5ffdc602b0126 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-08Provide common cleanup script to be used across projectsEd Warnicke2-6/+56
Change-Id: Iebafbd25bee5cbf9c09fe0183b5d7e4c1eef8bb8 Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-08Fix for nsh_sfc jjbEd Warnicke1-3/+3
Change-Id: I871c8723dd443e4472e851b2ecda76f53cdd530d Signed-off-by: Ed Warnicke <eaw@cisco.com>
2016-06-07Initial nsh_sfc jjbEd Warnicke2-0/+185
Change-Id: If77fdd4778eb54b3cba683a94b3cb84d1203fd00 Signed-off-by: Ed Warnicke <eaw@cisco.com>