Age | Commit message (Collapse) | Author | Files | Lines |
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Idf8462f15a2dd76b42dcaea9df6a0fc15a45503f
(cherry picked from commit 8079ed2ff7e2fdd41474d286b98cd9be19481f7a)
(cherry picked from commit df03302555c697928d3529ce050f3629b4e055a0)
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I909942dbb920df7f0fe15c0c92cda92c3cd8d8ad
(cherry picked from commit 7829fea4a2c8936513fa95215b7d84997f814a69)
|
|
Change-Id: Ic6c5d35dc602638b06962fcad30d8517c9553552
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 1d8887789f98551aac51571b8c4c0c3a18612203)
|
|
1. Suite steup add download nginx
2. Add nginx-1.14.2/1.15.0 ldp test suite
3. Add NginxUtils,NginxConfigGenerator method
4. Taskset the PID of nginx to the unused cores in VPP and these cores are under NIC's NUMA ID
5. cleanup add Kill Processes - nohup
Signed-off-by: xizhanx <xix.zhang@intel.com>
Change-Id: Idbf0e4ec3bf63e88281a8e3e34f52e00a6801c85
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I41b5905bcaab303a74d9985283e469922e5fba94
|
|
Change-Id: I2bbdc28431b6271d1950ec0e74bf708cae841146
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
CSIT is becoming stricter in avoiding downloads during run,
as everything should be pre-cached in executor image.
This change makes it easier for human to detect downloads.
Change-Id: If7085f96ef1033f7f9405a86232a3d39a239d3e1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
A common mistage is to add a file into GPL directory,
with Apache license only.
This adds a tox checker to vote -1 on such changes,
gpl_license.log contains the list of affected files.
There are TODOs related to unlicensed files
or unconventional GPL licenses.
Change-Id: I267e4fb98afd199d5acc7d211068b28c97b31dc9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
In Gerrit 30041 that was not tested properly.
Change-Id: I42f57f1933b0e7d029030f4ec502f7268780827b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
This is a follow-up to https://gerrit.fd.io/r/c/csit/+/20394
https://gerrit.fd.io/r/20119
has changed the way archival works,
everything should now go to logs.fd.io
(instead of appearing on run page in jenkins.fd.io).
The glob pattern for archiving is quite eager,
doing recursive search. That is good, as it can find
also misplaced useful outputs.
But it also means our usage of copy_archives function
creates two copies of archived directtories,
usually archives/ and archives/archive/.
This change renames copy_archives to move_archives,
with few workarounds to support multiple calls.
I also renamed ARCHIVE_DIR value from $CSIT_DIR/archive
to $CSIT_DIR/archives to make "move" operation look natural.
Finally, download_builds function is being removed,
as after recent improvements to VPP compilation speed
nobody seems to be using it.
Change-Id: I19a429e1dfdfaab7fcf32a9609963b1aebd33c6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
The test names are unique without it and the information doesn't add
anything extra.
Change-Id: Idc7d6d1d21c8c05691e1757227a0a3787406d370
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Change-Id: I1159fb29d43f61628922cdbd51313f710aa72f4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibdfc0350a101c4815f25456176e25bb1d90fd881
|
|
+ Rework BASH scripts (more code to python).
+ Move BASH into libraries.
+ Allows RDMA usage.
+ Fix 9000B tests.
+ Rename confusing l2fwd -> testpmd.
+ Fix suite setup.
+ Fix PCI whitelist to not accidentally pickup wrong interface.
+ Fix deprecated DPDK cli arguments.
- MLX5 jumbo are disabled on NIC (i will increase separately).
https://jenkins.fd.io/job/csit-dpdk-perf-verify-master-2n-clx/6/console (l3fwd still broken)
- MLX5 IMIX seems to be some TRex issue with IMIX for mlx5 (i will handle separately)
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I31d1b67305fa247cb5e1f57e739d3ef30dc1a04b
|
|
Only added/edited files already containing copyright notice
are checked for the correct year (and only if in first 3 lines).
Change-Id: I22c057431847fda3a7dfd4577f8346fadfe4c4f6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
The function ansible_hosts got renamed to ansible_playbook
in https://gerrit.fd.io/r/c/csit/+/24511
Change-Id: Ife4e7b13f634fcdda95f80c18bc86cfded139b5d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia2ce482798204ad426f93f334c97e28eb51139fd
|
|
Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab
|
|
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Ticket: CSIT-1551
+ Config copied from other suites.
+ Layer keywords prepared for additional chains.
+ Renamed "create" argument to "vlan_per_chain".
+ TrafficGenerator result extraction improvements.
+ Also unified TG type and subtype checking.
+ Throughput estimated as PDR for zero PLR.
+ Actual Qemu start is skipped.
+ Parse xstats instead of stats in trex stop scipt.
- Because stats are unconditionally cleared on each script connect.
+ Remember start values to get better ReceiveMeasurementResult at stop.
+ Expose loss count and time as appropriate test message.
+ Autogen support.
+ Multiple chain amounts and core densities.
- Only 1 additional chain.
+ Proper TAGs. Documented.
+ Clarified min framesize tags are for TG-DUT.
+ Added a TODO concerning overhead values.
+ Added 118B tag.
+ Robot performance keywords improvements.
+ Added missing return value documentation.
+ Frame size as required test variable, not an explicit argument.
+ MLRsearch keyword to store result (not into test message).
- TODO: De-duplicate: main keyword to measure, minor to set test message.
- But implementation uses the fact default arguments are different.
+ Keywords for starting and stopping background traffic.
- No checks whether start-stop pair is complete.
+ Multiple minor indentation and logging improvements.
- Missing / TODOs:
- Support also vlan_per_chain=True?
- Support dot1q without vxlan?
- Support also deletion?
- How to package config steps so -reconf can be generated from -ndrpdr?
Change-Id: If0270697f9ffa837c34ef802917220a53f156703
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
If current VPP is broken, we want to fail early.
If there is API change, we are more interested in current results,
even if parent is likely to fail.
Change-Id: I552485bbb9fe0053bae39de7939f94a5971bb63b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifa4de8e60742f5c4cf4c2f377692313e23f9983b
|
|
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Change-Id: Ib4585729f7b84bbcf1db62db801a6b2f24337803
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Ida54722ee5c73a0b3e0a8e22692795daf5bb09f3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ Include both checking at runtime and standalone static quick check.
+ Runtime checking does not look for missing messages,
as messages belonging to disabled plugins are not visible.
+ Standalone check script has nice loud output.
Change-Id: I1dfc3846d1bcdad0b09017d4ce8edd5028e17e0c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I84f13d7139a6e5f7004426018c2d27425c5fa97e
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
|
|
Change-Id: I0644fbd0e136dee3a91fd9406155f971b3c726eb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I038d90fc481e5f74085d0fe6165b12769d98e8a1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
This reverts commit ccfe499e2a27f2caf234ecbb2ec948120810eab6.
Change-Id: I076bdaf255f6fa5cc6b0f25926850d62f450fd94
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
https://gerrit.fd.io/r/20119
has changed the way archival works,
everything should now go to logs.fd.io
(instead of appearing on run page in jenkins.fd.io).
The glob pattern for archiving is quite eager,
doing recursive search. That is good, as it can find
also misplaced useful outputs.
But it also means our usage of copy_archives function
creates two copies of archived directories,
usually archives/ and archives/archive/.
This change simply removes copy_archives,
relying on the new recursive search.
A solution with changing ARCHIVE_DIR and moving if needed
would be better, but looking at amout of jobs
and various func bootstraps, it is not worth the effort.
Change-Id: Iad2bc09455944307e59eecafa64d1db6dc8befe8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Stop attempting to check test/ as module inits are not there.
Change-Id: Ia4e498061be3e3118b07e98c9c2f761f2454653e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Caring about per-file notices is too distracting.
Change-Id: I3f07a9fd1d3a4350135dd3d14f4944647af39a0b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Only looks at files edited since HEAD~.
+ Only checks files of whitelisted extensions.
+ Distinguishes missing and outdated copyrights.
+ Any line with "Copyright" substring can work.
+ Many copyright lines are tolerated, if at least one has correct year.
+ Voting.
Change-Id: I2cda0459cb191eeec7aada69c508973568039d87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Only on not-failed-yet testbeds.
+ If any, else give up.
Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
CSIT-1505
Parse {os} parameter from job and use it to separate the correct
image for each distro and the correct stable package versions.
Use two vpp device image names, one for Ubuntu and one for Centos.
Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos
Source for Centos sut image:
https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos
Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
|
|
+ Fix the version of MMD tool to always latest
Change-Id: Iafd7f40d618b8e4995b5cc12fe06056719f58517
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
The idea is to run test generation and archivation
before testbed reservation, as during generation and archivation
the testbed can be used by another job.
The two steps are moved just before (physical or docker) reservation,
as they currently take considerable time,
so simpler steps are kept before to save time if they fail.
Coincidentally, it is also just after activate_virtualenv,
Python is needed for test generation.
Change-Id: I8b41b91dba8118e89301e3fcf89d5cd14ac054a2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
CSIT-1485
- Measurement results are inconsistent, creating false positives.
- To avoid false positives, sensitivity has to be lowered.
+ Measurements are no more interleaved.
+ Measurement result are no longer filtered.
+ The job now runs faster.
- Ip6base regressions smaller than 4% are tolerated.
+ Ip6base false positives can happen, but less than 10% of the time.
- Part of job parameters is set on ci-management level.
+ Voter script output is improved.
Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ All perf suites updated, as autogen change is backward incompatible.
+ Only x710 -ndrpdr suites remain in git repository.
+ Removed retry feature of run_tests.
+ Renamed topology_type and traffic_type to traffic_profile.
+ Renamed framesize to frame_size; nic_model to nic_name.
+ Reordered Variables table to start with nic_name and overhead.
+ Fixed wrong overhead value in some cbc-sha1 suites.
+ Fixed some suite tags.
++ Introduced tags to distinguish suites, such as IPSECINT.
+ Bound crypto hardware to NIC name.
+ Implemented NIC limit hiding.
+ Also search and teardown related arguments are now hidden.
+ Main measurement keywords updated to new arg handling.
+ Max rate related keywords moved to performance_limits.robot
+ Teardowns unified.
+ Generated tests are archived.
++ Generated directory is .gitignore-d.
+ Regenerator raises an exception on seeing non-compatible suite.
++ Relatively helpful message should be seen in exception.
+ Suite and template Documentation has generated parts.
+- With short NIC names only.
+ Autogen checker also upgraded.
+ Tag expressions replaced with long files to ensure analogous tests.
Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Still non-voting, but useful.
Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Remove obsolete bootstrap_setup.sh.
- Add calibration support into ansible.
- Inject Ansible run with calibration to every job.
Change-Id: Ib2d6cd0c04d3bce700b205bef34c3c88edb26e28
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
The plan is to change csit-validate-pylint-master job
to fail if (and only if) tox fails.
This will allow us to easily add checks,
with or without the voting power.
Each check produces log (ignored in .gitignore)
the voting job can archive.
+ Made autogen quiet by default, to avoid spam in autogen checker.
+ Unified the way direct csit subdirectories are git-ignored.
Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Incredible why is it so hard to write scripts not hardcoding
anything.
Change-Id: I48cf2cc3d25f9665a9ff7ca26756d3b70cdd2f9c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I5af6de4b96775a72855e1644ca4d8d9b4b2f9e25
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I153d378849ea76444915b7fc219237db1b7bca1a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|