aboutsummaryrefslogtreecommitdiffstats
path: root/fdio.infra.ansible
AgeCommit message (Collapse)AuthorFilesLines
2021-12-15UTI: Export resultsVratko Polak2-2/+2
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-15fix(Ansible): iavf install conditionJuraj Linkeš1-4/+4
The existing condition is missing parentheses and doesn't work as expected. Change-Id: I3c45f5764b95bc8dcfbdd8ee6e2698bfb022dfb6 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-11fix(Ansible): Configure systemd as service managerpmikus21-0/+42
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I80ec9854b311af7a8da9363cf569598e1eb667f4
2021-10-05fix(Terraform): Bump AWS APIpmikus1-1/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I057bd9875a3981245b570e61ff3ba2f478def769
2021-10-04fix(Ansible): ca-certificatespmikus1-0/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I11089abeddf4287193008c28438dc6d8c97408b0
2021-09-30feat(Infra): Upgrade Intel NIC's firmware on SUTspmikus19-5/+40
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I02e808591fca9a79b65981f2884ff5ebadc3365d
2021-09-29feat(DPDK): Bump payload version to 21.08pmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ic249493a39faa8f429ae4fa1de644d74d874151b
2021-09-27feat(Ansible): Consul make variables configurablepmikus2-8/+12
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2dc9da9546d1a6ea7e3b9110843eb28f84f1bfc2
2021-09-27feat(Infra): Upgrade Intel NIC's firmware on TGspmikus11-0/+25
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I4090ed6ed2f65ef37053112e7682e3606cecfc9b
2021-09-24fix(Ansible): Kernel param checkpmikus1-1/+1
+ Temporary fix until i write more complex logic Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibbcf1a0212da568aa37a9fdc9198cc7a50df9c61
2021-09-24Ansible: Intel driver compatibility matrixpmikus9-77/+148
+ implements Intel Ethernet 700/800 series driver installation based on compatiblity matrix + includes iavf, i40, ice, ddp driver/profiles installation + patch abstracts multiple compatibility scenarios (dpdk, intel product materials, custom override) and could be applied per testbed + if no matrix choosen, default operating system drivers are used Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ifbdbf8c2ebc48d81941e66698708a2e0ff57b7de
2021-09-24feat(Ansible): 2M and 1G hugepagespmikus31-26/+82
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I55720cee8236c37e21881d1d8115d357d2a1f05f
2021-09-21fix Ansible: Adjust PCI addresspmikus1-2/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibbc0887f8a0878f1bf5263f24c078eb0e42365f6
2021-09-21Infra: Ansible Nomad, Consulpmikus4-45/+43
+ Fix idempotency + Fix APT download Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I03304c1c229c921806658b0169bd230154d8dde9
2021-08-30Infra: vpp_device NICspmikus1-1/+6
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I06d4012552eee918ae29e0bd789d3d316840ad4a
2021-08-27Infra: Cleanup Nomad configspmikus33-175/+287
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia5c9f0902551de1a63144e6f56dfa6db2895b0b2
2021-08-25lab: update Arm lab docsJuraj Linkeš1-4/+4
The one node and two node Arm testbeds were improperly named. They were configured with a new hostname in the past but the docs were not updated accordingly, so fix the docs. Create a new server type for Arm servers and servers related to Arm testbeds to improve doc organization. Change-Id: I205b1e2f958dd1113e1e9f207acffe4355b267bc Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-08-19vpp_device: Multiple NICs (infra)pmikus1-0/+17
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie8662b6a485374b5df68dec9c82065cf59f28c8f
2021-08-19Infra: ansible update arm perf testbedsJuraj Linkeš3-15/+15
Only isolate as many cores as needed for VPP testing so that the rest are available for other tasks, such as DPDK compilation. Configure perf iommu kernel cmdline which works on arm. Change-Id: I0bf356b34e6a611bd43707b4fd43b7701cd205de Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-08-18Infra: Ansible yaml lint cleanuppmikus125-393/+391
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If00b376bd78b7b603d7887c1e149e7dccdb6d217
2021-08-18Ansible: VPP Device configure unsafe noiommuJuraj Linkeš1-0/+9
VFs need /sys/module/vfio/parameters/enable_unsafe_noiommu_mode to be enabled on the host. Add this to Ansible. Change-Id: Iee1d0ccfdb4ea9b9d6981d39490fe7feb33bf70c Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-08-17ansible: update DPDK meson versionJuraj Linkeš1-1/+1
DPDK compilaiton is failing with: ERROR: Meson version is 0.47.1 but project requires >= 0.49.2. Change-Id: I692058819021ffaef9b85c0414041c5fcfa5fd96 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-08-11Infra: AWS self terminationpmikus1-1/+6
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9ecd85d1086f6be1bbaf6a6925da362cc4c1a9ad
2021-08-09Infra: Vaultpmikus9-0/+489
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia6e728f98d20144c3771405b32933a77fe15b19b
2021-08-06Ansible: remove 10.30.51.30 from server poolpmikus1-13/+7
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I1e0b374b4d57e8dd0c0399cb5b32b8308a9f2285
2021-08-04Infra: Update monitoring for new layoutpmikus17-60/+180
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I299515fc676a9995e006bbb197068160044dbd98
2021-08-04Infra: Decommission 3n-hsw - pxe/ansiblepmikus21-1279/+1101
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie3ddec5487192217d0921f892098384da73a1ef2
2021-07-28Infra: upgrade monitoring solutionpmikus7-101/+86
+ bump versions - remove cadvisor Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I3de95531f1b09f7254152254e92f225dde653e45
2021-07-26Ansible: fix multiple shell commandsJuraj Linkeš3-3/+15
Ansible passes "&&" as arguments to the command being called, which prevents us from using it for calling multiple commands in one ansible task. Fix by replacing this with "with_items". Change-Id: Ie07a1b1969bda9569cf82ef0741ec52260e2c736 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-07-23Ansible: iavf driver installJuraj Linkeš8-38/+53
* move iavf driver install from vpp_device to intel role * differentiate the names of tasks of various drivers to get better ansible logs * add .5 sleep when creating VFs with iavf to avoid improper init * fix install commands * add XL710QDA2 NIC to supported i40e NICs Change-Id: Id50e1552a322b9473e58222bfed3405d2d73c824 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-07-22Infra: Add mnaser ssh-keypmikus22-1/+22
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia4869d0fecb68dc828ad3732dbfe0279afeba648
2021-07-21Ansible: i40e driver installpmikus4-104/+143
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib0e1b37e3d920f8d9a9e88896b6898fe13e4acba
2021-07-08Infra: AWS Jenkins Integrationpmikus25-3/+28
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I5910ce0701f865403aa772c7ad5d8eb126c6ec2c
2021-06-11FIX: Ansible vpp_device typopmikus1-4/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I902439bd078886e30bf0990647796038c36ed598
2021-06-10Infra: vpp_device -> Ubuntu 20.04pmikus9-79/+129
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If24c385b93e1ba310ea258984c97494b4cab467c
2021-06-09FIX: spectre-meltdown calibrationpmikus1-15/+15
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie162c2021d54129b48a6b3a48027b31db11d7ec6
2021-05-25Infra: Add fdio-marvel-devpmikus2-9/+6
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ic851dea3b763006b57e1b9c017274d3279b6a1ba
2021-05-20perf: add TCP Nginx+LDPRELOAD suitesxizhanx1-0/+7
1. Suite steup add download nginx 2. Add nginx-1.14.2/1.15.0 ldp test suite 3. Add NginxUtils,NginxConfigGenerator method 4. Taskset the PID of nginx to the unused cores in VPP and these cores are under NIC's NUMA ID 5. cleanup add Kill Processes - nohup Signed-off-by: xizhanx <xix.zhang@intel.com> Change-Id: Idbf0e4ec3bf63e88281a8e3e34f52e00a6801c85 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-05-12Infra: Nomadpmikus3-1269/+765
+ Cleanup vault + Add native GC + add raid to skx Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I402cb96fb7d1dc0c7d026ae69bf29d84be171269
2021-05-11Infra: Backend infra upgradepmikus39-375/+1569
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If1e659339f0d25ebcaab4388745c62aa0852abb3
2021-05-05FIX: Vagrant ansible installpmikus1-0/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia81698d423f8545985bc1451080ae02cec91822b
2021-04-23FIX: Jenkins job health configpmikus1-3/+3
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I6acd32a210ab48c96f0dc96827a280794ebf79b0
2021-04-21Infra: Vagrant upgrade to focalpmikus7-0/+121
+ Upgradfe to focal + Move to better place + Integrate with ansible library Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibddea33efa2c3587251f9f03921282fb47ffee31
2021-04-19DPDK bumppmikus5-29/+73
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I6edd980cb72111a008ae7fa19e1a4df279febdb2
2021-04-15requirements: Update Sphinx to the latest versionsTibor Frank1-23/+24
Change-Id: I4efcbe62d696227ce33444da38d06573fbfcbba6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-04-13Infra: Ansible E810 ddp/driverpmikus4-0/+158
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I383ae63bdfb24a9e8a5cd629a711537607ebf4e9
2021-04-12Infra: AWS bootstrap integrationTomas Alexy2-2/+25
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I254c79201a198ee054851c934167a24e9e8803cb
2021-04-08Ansible git movepmikus206-0/+9033
+ Better accessibility + Compliant with fdio.infra._function_ - function [pxe|terraform|ansible|vagrant] + dill==0.3.3 also applied on TBs - ci-man to follow today - Docs to be updated in separate patch Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Iff9eaa29d63044188cc8160db2d9b44b7635782a