aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias1-0/+17
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-11CSIT-574: IPSec Scale File Splitsjan.hradil1-0/+4
split file into two separate files based on number of tunnels values 1 or 1000 corrected name errors - scale -> base Change-Id: I7114c777f3cc3d7f4951a1f59e54f3a7bbe404ec Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-05-10CSIT-573: Split SNAT scale tests to multiple filesjan.hradil1-0/+20
split file with many test cases into mutliple files based on users and ports added SRC_USER tags removed empty lines at EOF Change-Id: I19c79cdf8d7de4147c98bc061559af1fde10ab8c Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-05-09csit report - fixed table format in vpp_performance_tests/csit_release_notes.rstMaciek Konstantynowicz1-1/+1
Change-Id: Ie9d4a9ba373c0e6131f0a2d3e49f20a315da3b9a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-03Update to csit rls1704 report - perf changes tables - based on increased ↵Maciek Konstantynowicz1-12/+12
number of test job executions. Change-Id: I659f7f3da2464081be540c80cb2d71c107455a5e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-03Updates to csit rls1704 report related to increased number of test job ↵Maciek Konstantynowicz21-395/+134
executions. Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-28csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.Maciek Konstantynowicz3-14/+20
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27csit rls1704 report: final update to csit_release_notes.rst, ↵Maciek Konstantynowicz15-53/+95
packet_*_graphs.rst files. Change-Id: I531706f87716a3db8c5417be6ce4933e02e2a622 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27Report-gen updatePeter Mikus3-28/+36
- fix header in IPsec sections - fix IP4 regexp to include SNAT - update source data for perf trending - fix rendering of Trex section Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-27csit rls1704 report: updates to csit_release_notes.rst files.Maciek Konstantynowicz2-84/+86
Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26update to csti rls1704 report: vpp_unittest_results.rstMaciek Konstantynowicz1-51/+291
Change-Id: I3af10e3caeaa4150b35a118899e233e33877c673 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT rls1704 report - small updatesJan Gelety4-19/+21
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Edits to csit rls1704 report: vpp_unit_tests sections.Maciek Konstantynowicz2-4/+8
Change-Id: I1eceb766f53c7bd25c791c16b8fbc027009df3f0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Edits to csit rls1704 report: csit_tag_description.rst.Maciek Konstantynowicz1-2/+5
Change-Id: Iee1b6fd98b73be1821068f08fa469222eb938a32 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26csit rls1704 report - updated csit_release_notes.rst and overview.rst files.Maciek Konstantynowicz6-33/+105
Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT rls1704 report - update of functional csit_release_notes.rstJan Gelety1-46/+44
Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26Update run_report.sh script for generating reportPeter Mikus10-31/+435
Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-25CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rstJan Gelety1-4/+8
Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update to vpp_functional_tests/csit_release_notes.rstJan Gelety1-17/+25
Change-Id: I400f49ab5399a83b925fbbe2b52e37fd97f464f0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25rls1704 report - updated sections:Maciek Konstantynowicz6-162/+192
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25CSIT rls1704 report - update to handcrafted sections:Maciek Konstantynowicz22-1294/+1429
- index.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/overview.rst - vpp_performance_tests/packet_throughput_graphs/... - testpmd_performance_tests/csit_release_notes.rst - vpp_functional_tests/csit_release_notes.rst - testpmd_performance_tests/packet_latency_graphs/... - testpmd_performance_tests/packet_throughput_graphs/... Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25CSIT doc gen: Add configurations and operational data.Jan Gelety5-0/+80
- vpp perf configurations and operational data - vpp func configurations Change-Id: I634682e55a2862b927546e2657aabb242c730be1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-251704 report - fix mistake in honeycomb sectionselias1-1/+1
Change-Id: I6517ea48a6df95cc855596843d736658471486ea Signed-off-by: selias <samelias@cisco.com>
2017-04-251704 Report - Honeycomb sectionselias3-28/+62
Change-Id: I8006cf8187f943b8d880c8193b6b1bde25ad343c Signed-off-by: selias <samelias@cisco.com>
2017-04-24Fix: Report vhost and testpmd plotsPeter Mikus4-227/+256
Change-Id: Iaf41d9132a52e1d4e199bba31abedba66143bfc7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-24Fix: Report generationPeter Mikus16-37/+255
- Add IPsec plots - Fix plots rendering Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-24CSIT-557: Performance jobs reorganisation, part 3Tibor Frank1-0/+20
Add: - csit-vpp-perf-verify Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-21Report generation script updatespmikus8-4717/+80
- Add new type of throughput plots - Update Sphinx, Sphinx-rtd-theme and Plotly packages - Add auto generation of detailed test results - Small fixes Change-Id: I706777160a7f166e0a335c64428d10cb546fa854 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-21tag_documentation.rst - added:Maciek Konstantynowicz1-0/+16
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B. Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-21CSIT rls1704 report - update to handcraftec sections:Maciek Konstantynowicz28-813/+224
- introduction /overview /general_notes /csit_test_naming - vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs - vpp_functional_tests /overview /csit_release_notes /documentation - testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-21tag_documentation.rst - added: Ethernet frame size tags for performance testsMaciek Konstantynowicz1-4/+22
Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-18CSIT-545: Performance tests for SNATTibor Frank1-0/+4
- High level definition (HLD) - Low level definition (LLD) - Add keywords to set SNAT - Add tests according to HLD, LLD Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-08csit rls1701 report nits and updates:Maciek Konstantynowicz14-28/+70
- Completed paragraph for each thput and latency graph in report describing: graphs title, x-axis, y-axis, legend. Change-Id: Ia45e2da2623b909123f6b3d4abe65e6caf72e058 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-02-06csit rls1701 report edits:Maciek Konstantynowicz75-905/+1341
- simplified section structure for clarity and readability, - updated overview sections, - moved not rls related content from rls_notes to overview sections, - removed section title suffixes: HW, VIRL. - completed vpp_unit_tests and vpp_unittest_results sections. - updated all documentation sections. - updated rls_notes sections for vpp performance and vpp functional. Change-Id: Id2c2abbf9d3531ec9f63ecd353f385a0b55ae1ba Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-02-03CSIT 1701 report files and script AD1pmikus23-2143/+2455
CSIT 1701 report files and script addendum 1 Edits to correct and align all Overview sub-sections. Updates in Performance CSIT Release Notes - added more NDR and PDR performance changes. Change-Id: I52b6ee89e9c536fb4ab9d30dc27cca8dbdd88a20 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-01CSIT 1701 report files and scriptpmikus57-0/+15430
Add RST source files and script to generate CSIT 1701 report Change-Id: I4345564547270ba10c64d6beebf2c2b5a83de459 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-27CSIT-508: Add perf tests for Cisco VIC-1227 L2BDMiroslav Miklus1-0/+8
- 10ge2p1vic1227-eth-l2bdbasemaclrn-ndrdisc Change-Id: Ib0e99f8160ca951b58b0244de88fa587e61bd941 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2017-01-13Tags for tests with IPSec.Tibor Frank1-0/+24
Change-Id: Ic06bd15de44303f99133fa0df83319b5568b64dd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-12CSIT-501: Perf tests re-taggingTibor Frank1-1/+17
- Implement tags introduced by https://gerrit.fd.io/r/#/c/3856/ Change-Id: I59313f43f338e2b4a1ad5caf9521b1a0da84d1d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-10CSIT-469 Rename performance suitespmikus1-76/+276
Rename performance suites and add more TAGS Change-Id: I6a5251bb6e380fe2a47a6ec1c1aeb4a9f70c5ce3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-07CSIT-256: L2enc - l2-eth-lispgpe-ip6 - L2BDZdeno Olsovsky1-4/+7
Change-Id: I5523235aa7b48be673c9940323424b2dc1172312 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-08-22CSIT-324 L2dp - Bridge domain - baseline vhost-userpmikus1-0/+3
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: Id0e508d50288d89b39bc5c321eeab0c908f3e2ba Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-18CSIT-200: Lisp performance testAndrej Kozemcak1-0/+14
Change-Id: I8a54b79ee03c2f5defc4eeba486086d793484668 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-28CSIT-169 IPv4 Scale - performancepmikus1-0/+12
- Add libraries for ipv4 scale setup - Add test cases for testing 10k/100k/1M fib entries - Add t-rex profiles for large scale testing Change-Id: If085e0d834e5ffe5538ba76756e8b9d0e8255cb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-29CSIT-181: Remove fds tests from vpp-csit-verify and csit-vpp-verify jobsJan Gelety1-1/+5
- add tag SKIP_PATCH to FDS related tests and exclude them from execution in case of vpp-csit-verify and csit-vpp-verify jobs Change-Id: I14237a78529b3d3c9b586041a24ceef303c1394b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-26Find PDR using binary searchPeter Mikus1-0/+9
- JIRA: CSIT-72 - modify libraries for PDR search evaluation - write robot framework keywords for PDR search - write Performance Test Cases using PDR Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-04-17Multicore VPP setup for performance testingpmikus1-0/+43
- add multithread TAGS documentation - add methods to VppConfigGenerator for RSS configuration - create KW for multithread setup - create sample test case using multithread vpp setup - add Documentation into TCs Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-15Update Qemu libraryMatus Fabian1-0/+49
Incorporated changes from nested VM on VIRL. Change-Id: I76ceeb2dde635c2cf0d3a53d29bf24fed72a5437 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-13Honeycomb setup and utilsTibor1-0/+22
- re-implement HTTPCodes as IntEnum rather then dictionary - add methods to manipulate data using honeycomb - get, set, delete - change the name of url file from vpp_version.url to oper_vpp_version.url - improve checking of startup and shutdown state of honeycomb - PEP8 fixes - add docstrings in all modules and classes - move logging to the lowest possible level - improve logging in exceptions - add method exec_command_sudo_log to resources.libraries.python.ssh module Change-Id: I54e0c6b45313e3a3c11bafa475488ae2b1e605c2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-04-08Add Vagrantfile for local testing.Stefan Kobza1-0/+16
Vagrantfile contains 3 VMs as of now, 2 DUTs 1 TG, with these notes: - login is csit/csit - by default provision script installs all deb packages from the dir where Vagrantfile is - developed for, and only tested on vbox (someone can pick up vmware) - All nodes have 1 shared mgmt network: 192.168.255.0/24 - hosts have these IP addresses in host-only network TG : 192.168.255.100 DUT1 : 192.168.255.101 DUT2 : 192.168.255.102 - script created to download MAC address information - PCI addresses are always the same for vbox (not sure about vmware) HOWTO (will create a wiki page once one is created for CSIT project): - copy Vagrantfile to separate dir on host - vagrant up --parallel sit-back-and-relax - from VM that has access to the same host-only network (192.168.255.0 above) - copy your ssh-key to csit@192.168.255.{101,102,250} using ssh-copy-id - cd ${csit_dir} - virtualenv & pip as in README - export PYTHONPATH=${csit_dir} - resources/tools/topology/update_topology.py -v -f -o topologies/available/vagrant_pci.yaml \ topologies/available/vagrant.yaml - pybot -L TRACE \ -v TOPOLOGY_PATH:topologies/available/vagrant_pci.yaml -s \ "ipv4" tests - see tests results Change-Id: Ic27626605a9c820bca977b38f4e8ca37d1504ff5 Signed-off-by: Stefan Kobza <skobza@cisco.com>