Age | Commit message (Collapse) | Author | Files | Lines |
|
Update ansible, topologies, bash scripts and job specs.
Change-Id: I834b991f281e0b29b4af9dc37fe8028460298d83
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I12d2d58de01693b18628cd73b5d8c36467506f32
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5f68fd84a9ea034c5d8ff175807033aa0b60d5a2
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505
|
|
Part of fixing chain
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie423ccf5a51751e605d906dd1214f5174bb364ac
|
|
Part of fixing chain after early merge.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I06e19def003575993bc3d97c0dc7fbedd3e5ff7a
|
|
Part of fixing chain after early merge.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I983b3036a388656bbad91aba71cf14b503f875bd
|
|
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I1590d438216e4c886aae03f83364837153623dbc
|
|
+ Model version 1.0.0.
- Only some result types are exported.
+ MRR, NDRPDR and SOAK.
- Other result types to be added later.
+ In contrast, all test types are detected.
+ Convert custom classes to JSON-serializable equivalents.
+ Sort dict keys before converting to JSON.
+ Override the order for some known keys.
+ Export sets as sorted arrays.
+ Convert to info content from serialized raw content.
+ Also export outputs for suite setups and teardowns.
+ Info files for setup/teardown exist only temporarily.
+ The data is merged into suite.info.json file.
+ This simplifies presentation of total suite duration.
+ Define model via JSON schema:
- Just test case, suite setup/teardown/suite to be added later.
- Just info, raw to be added later.
+ Proper descriptions.
+ Json is generated from yaml.
+ This is a convenience for maintainers.
+ The officially used schema is the .json one.
+ TODOs written into a separate .txt file.
+ Validate exported instance against the schema.
+ Include format checking.
+ Update CSIT requirements for validation dependencies.
+ This needs python-dateutil==2.8.2, only a patch bump.
+ Compute bandwidth also for soak tests.
+ This unifies with NDRPDR to simplify schema definition.
- PAL may need an update for parsing soak test message.
+ Include SSH log items, raw output only.
+ Generate all outputs in a single filesystem tree.
+ Move raw outputs into test_output_raw.tar.xz.
+ Rename existing tar with suites to generated_robot_files.tar.xz.
Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I19c160e40e01bd7f69c08188f61d2bcbc3fd4bcb
(cherry picked from commit 8be983ad917cd47fa8da4256fa8ada14ecfcd425)
|
|
The comms DDP package needs to be installed to support all flow protocols
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I6ab1bd8beb9edb8c9889a0ed9a999080ca3cef3d
|
|
- job-spec for trex tests modified
Change-Id: Id04d76648f30baacfa027b182a838d2f681afcec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I82819c924012c966ba91fdf39ffba500ee0ce6b0
|
|
It uses different bootstrap than csit-vpp.
Just cherry-pick the edits from
https://gerrit.fd.io/r/c/csit/+/33513/15/resources/libraries/bash/entry/bootstrap_vpp_device.sh
+ Match just *device* when reading testplan.
+ Do not prepend MRR for vpp device jobs.
Change-Id: I13e171551ebc87af0ac3e3a1a1bcfae7cad8326c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I81958fbf6ef240d53a0fb8708ca882baf02f606c
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie8662b6a485374b5df68dec9c82065cf59f28c8f
|
|
When I make a typo in GERRIT_EVENT,
old code starts many ASTF tests.
Change-Id: Iac1c2cc620919d33b0e77bd28b145f3fd38d28ff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I9c81563c904b02c5ca6ede5dc3d0922851c11ae4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
+ hoststack
+ vsap (cps, rps)
+ add e810cq to common.sh
Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I5910ce0701f865403aa772c7ad5d8eb126c6ec2c
|
|
Not fixing .rst, .md, .yaml, conf.py, .vat, and so on.
Change-Id: Icc585d6dbebc8eb5c483b10326302571e94c614d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I41b5905bcaab303a74d9985283e469922e5fba94
|
|
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ic6dd4a14887d572487d7d4efcca8a437cf140ca9
|
|
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Idc672f6086ab9d4ad38b52947a52c667d0908d8f
|
|
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: I254c79201a198ee054851c934167a24e9e8803cb
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Icab8b87498e8487268857bb04c5ba7069d9297e3
|
|
Change-Id: I71d72699a7fa99749e2554fcb2252f8bd86bfdfa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Buggy unnoticed for quite some time
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d83ba048e0609d6b8623fab5c2960e48a37c023
|
|
Add testbed file and make code changes in common.sh.
Change-Id: I493bb92db3c66358afa81ec81bcd99b296f49c03
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ieff60a44d42d66acee8ba1680e7e285d6cd01bc9
|
|
+ Reduce time overhead when parsing --include vs --test
+ Input files will remain the same
+ 3n-hsw 150include ~24min, 150test ~5min
+ 2n-clx 489include ~61min, 489test ~9min
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7e5957c32385aecbc4551bd124da41afa5bc63c9
|
|
This is a follow-up to https://gerrit.fd.io/r/c/csit/+/20394
https://gerrit.fd.io/r/20119
has changed the way archival works,
everything should now go to logs.fd.io
(instead of appearing on run page in jenkins.fd.io).
The glob pattern for archiving is quite eager,
doing recursive search. That is good, as it can find
also misplaced useful outputs.
But it also means our usage of copy_archives function
creates two copies of archived directtories,
usually archives/ and archives/archive/.
This change renames copy_archives to move_archives,
with few workarounds to support multiple calls.
I also renamed ARCHIVE_DIR value from $CSIT_DIR/archive
to $CSIT_DIR/archives to make "move" operation look natural.
Finally, download_builds function is being removed,
as after recent improvements to VPP compilation speed
nobody seems to be using it.
Change-Id: I19a429e1dfdfaab7fcf32a9609963b1aebd33c6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Move "|| true" to a place that really aviods errors.
+ Attemp to parse decoded string if trigger is not found in plain one.
Change-Id: If3587229ec588f9ad41acb3050add1142032d2d8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
16 times faster setting at cost of 50% larger archive.
Before:
$ time ( cat tests.tar | xz -9e > tests.9e.tar.xz )
real 0m41.640s
user 0m41.009s
sys 0m0.602s
$ wc -c tests.9e.tar.xz
913432 tests.9e.tar.xz
After:
$ time ( cat tests.tar | xz -3 > tests.3.tar.xz )
real 0m2.422s
user 0m2.294s
sys 0m0.161s
$ wc -c tests.3.tar.xz
1556080 tests.3.tar.xz
Change-Id: Ia5c86183d4e19db3cbf95dd84cf86ee720ef4051
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Replace the hacky grep of /etc/resolv.conf with default docker gateway
IP.
Change-Id: Iec3a4658826f2ba871acb14d511e9c79a1273290
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I3954157e91aafd370c3ac0843708903d19b84936
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2ff6526b5209dabf70c6593f60162d9b8c147014
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8d6108af943d729fecbcfe4867ea820a69b4eb1e
|
|
To avoid runs such as:
https://jenkins.fd.io/job/vpp-csit-verify-perf-master-3n-hsw/340/
Change-Id: I1b30d5f440ddf8ff32b11265b2ac2176f4b9a665
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
for example, below will trigger VPP with default code path test in CSIT,
"csit-2n-clx-perftest mrrAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf"
and below will trigger VPP with avx512 code path test in CSIT,
"csit-2n-clx-perftest icl mrrAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf"
Change-Id: Id3abf932203ce00f34f8643c5bc4d5fc4d3e6efb
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
|
|
- Create the same directory structure for report-iterative as it is
for report-coverage.
- Move files from report-iterative directory to created sub-directories.
- Rename the moved files to keep the convention defined in
report-coverage.
- Update the corresponding functionality in
resources/libraries/bash/function/common.sh
The patches:
- https://gerrit.fd.io/r/c/csit/+/27486
- https://gerrit.fd.io/r/c/csit/+/27484
- https://gerrit.fd.io/r/c/csit/+/27485
must be updated.
Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- split job specs to directories
Change-Id: I9a71621216ab0bdf85d147ce03f473e7cbb0b266
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
- note: currently dpdk report-coverge test sets are equal to dpdk
report-iterative test sets
Change-Id: Ib9a718bfea4b24842742f49ee2eca022aa8a08e5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
- job will be used to collect vpp performance iterative data
for csit report
Change-Id: I4cff5caa0a97d08b11f3eb9b72963deaf1b04c73
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
+ Waiting for Docker image to be updated. Then next step
I will disable any update attempt.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I92d4e27be0537a95473cd723a45e6185b26ce599
|
|
Change-Id: I4ad87092bff1c072051ca1c7243d8dedb1c4576e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia2ce482798204ad426f93f334c97e28eb51139fd
|
|
Change-Id: I47e45f395976fd65a8da0e93bc33588cc213c79e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
New daily sets are prepared based on information in
https://gerrit.fd.io/r/c/csit/+/24073/1/docs/job_specs/perf_tests_job_specs.md
and previous test set definitions in
docs/job_specs/test_select_list_[2n|3n]_[clx|skx|hsw|tsh|dnv].md
files.
- mrr-daily-2n-clx: 510 TCs (incl. nfv_density), expected exec. time 8:50h
- mrr-daily-2n-skx: 525 TCs (incl. nfv_density), expected exec. time 7:55h
- mrr-daily-3n-skx: 393 TCs (incl. nfv_density), expected exec. time 11:00h
- mrr-daily-3n-hsw: 177 TCs (incl. nfv_density), expected exec. time 7:10h
- mrr-daily-3n-tsh: 204 TCs, expected exec. time 21:00h
- mrr-daily-2n-dnv: 84 TCs, expected exec. time 2:25h
- mrr-daily-3n-dnv: 144 TCs, expected exec. time 6:35h
+ add some missing test suites
+ add trex-sl-2n-ethip4udp-1000u15p.py T-Rex traffic profile
+ correction of TS and TC names and tags in directory
tests/vpp/perf/nfv_density/chain_ipsec
Change-Id: Icfc86e9af97ed8dd8ccd2a34355c99aad69a28c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|