aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2017-05-03Update to csit rls1704 report - perf changes tables - based on increased ↵Maciek Konstantynowicz1-12/+12
number of test job executions. Change-Id: I659f7f3da2464081be540c80cb2d71c107455a5e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-03Updates to csit rls1704 report related to increased number of test job ↵Maciek Konstantynowicz21-395/+134
executions. Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-28csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.Maciek Konstantynowicz3-14/+20
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27csit rls1704 report: final update to csit_release_notes.rst, ↵Maciek Konstantynowicz15-53/+95
packet_*_graphs.rst files. Change-Id: I531706f87716a3db8c5417be6ce4933e02e2a622 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27Report-gen updatePeter Mikus3-28/+36
- fix header in IPsec sections - fix IP4 regexp to include SNAT - update source data for perf trending - fix rendering of Trex section Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-27csit rls1704 report: updates to csit_release_notes.rst files.Maciek Konstantynowicz2-84/+86
Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26update to csti rls1704 report: vpp_unittest_results.rstMaciek Konstantynowicz1-51/+291
Change-Id: I3af10e3caeaa4150b35a118899e233e33877c673 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT rls1704 report - small updatesJan Gelety4-19/+21
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Edits to csit rls1704 report: vpp_unit_tests sections.Maciek Konstantynowicz2-4/+8
Change-Id: I1eceb766f53c7bd25c791c16b8fbc027009df3f0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Edits to csit rls1704 report: csit_tag_description.rst.Maciek Konstantynowicz1-2/+5
Change-Id: Iee1b6fd98b73be1821068f08fa469222eb938a32 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26csit rls1704 report - updated csit_release_notes.rst and overview.rst files.Maciek Konstantynowicz6-33/+105
Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT rls1704 report - update of functional csit_release_notes.rstJan Gelety1-46/+44
Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26Update run_report.sh script for generating reportPeter Mikus10-31/+435
Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-25CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rstJan Gelety1-4/+8
Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update to vpp_functional_tests/csit_release_notes.rstJan Gelety1-17/+25
Change-Id: I400f49ab5399a83b925fbbe2b52e37fd97f464f0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25rls1704 report - updated sections:Maciek Konstantynowicz6-162/+192
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25CSIT rls1704 report - update to handcrafted sections:Maciek Konstantynowicz22-1294/+1429
- index.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/overview.rst - vpp_performance_tests/packet_throughput_graphs/... - testpmd_performance_tests/csit_release_notes.rst - vpp_functional_tests/csit_release_notes.rst - testpmd_performance_tests/packet_latency_graphs/... - testpmd_performance_tests/packet_throughput_graphs/... Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25CSIT doc gen: Add configurations and operational data.Jan Gelety5-0/+80
- vpp perf configurations and operational data - vpp func configurations Change-Id: I634682e55a2862b927546e2657aabb242c730be1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-251704 report - fix mistake in honeycomb sectionselias1-1/+1
Change-Id: I6517ea48a6df95cc855596843d736658471486ea Signed-off-by: selias <samelias@cisco.com>
2017-04-251704 Report - Honeycomb sectionselias3-28/+62
Change-Id: I8006cf8187f943b8d880c8193b6b1bde25ad343c Signed-off-by: selias <samelias@cisco.com>
2017-04-24Fix: Report vhost and testpmd plotsPeter Mikus4-227/+256
Change-Id: Iaf41d9132a52e1d4e199bba31abedba66143bfc7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-24Fix: Report generationPeter Mikus16-37/+255
- Add IPsec plots - Fix plots rendering Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-24CSIT-557: Performance jobs reorganisation, part 3Tibor Frank1-0/+20
Add: - csit-vpp-perf-verify Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-21Report generation script updatespmikus8-4717/+80
- Add new type of throughput plots - Update Sphinx, Sphinx-rtd-theme and Plotly packages - Add auto generation of detailed test results - Small fixes Change-Id: I706777160a7f166e0a335c64428d10cb546fa854 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-21tag_documentation.rst - added:Maciek Konstantynowicz1-0/+16
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B. Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-21CSIT rls1704 report - update to handcraftec sections:Maciek Konstantynowicz28-813/+224
- introduction /overview /general_notes /csit_test_naming - vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs - vpp_functional_tests /overview /csit_release_notes /documentation - testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-21tag_documentation.rst - added: Ethernet frame size tags for performance testsMaciek Konstantynowicz1-4/+22
Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-18CSIT-545: Performance tests for SNATTibor Frank1-0/+4
- High level definition (HLD) - Low level definition (LLD) - Add keywords to set SNAT - Add tests according to HLD, LLD Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-08csit rls1701 report nits and updates:Maciek Konstantynowicz14-28/+70
- Completed paragraph for each thput and latency graph in report describing: graphs title, x-axis, y-axis, legend. Change-Id: Ia45e2da2623b909123f6b3d4abe65e6caf72e058 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-02-06csit rls1701 report edits:Maciek Konstantynowicz75-905/+1341
- simplified section structure for clarity and readability, - updated overview sections, - moved not rls related content from rls_notes to overview sections, - removed section title suffixes: HW, VIRL. - completed vpp_unit_tests and vpp_unittest_results sections. - updated all documentation sections. - updated rls_notes sections for vpp performance and vpp functional. Change-Id: Id2c2abbf9d3531ec9f63ecd353f385a0b55ae1ba Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-02-03CSIT 1701 report files and script AD1pmikus23-2143/+2455
CSIT 1701 report files and script addendum 1 Edits to correct and align all Overview sub-sections. Updates in Performance CSIT Release Notes - added more NDR and PDR performance changes. Change-Id: I52b6ee89e9c536fb4ab9d30dc27cca8dbdd88a20 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-01CSIT 1701 report files and scriptpmikus57-0/+15430
Add RST source files and script to generate CSIT 1701 report Change-Id: I4345564547270ba10c64d6beebf2c2b5a83de459 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-27CSIT-508: Add perf tests for Cisco VIC-1227 L2BDMiroslav Miklus1-0/+8
- 10ge2p1vic1227-eth-l2bdbasemaclrn-ndrdisc Change-Id: Ib0e99f8160ca951b58b0244de88fa587e61bd941 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2017-01-13Tags for tests with IPSec.Tibor Frank1-0/+24
Change-Id: Ic06bd15de44303f99133fa0df83319b5568b64dd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-12CSIT-501: Perf tests re-taggingTibor Frank1-1/+17
- Implement tags introduced by https://gerrit.fd.io/r/#/c/3856/ Change-Id: I59313f43f338e2b4a1ad5caf9521b1a0da84d1d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-10CSIT-469 Rename performance suitespmikus1-76/+276
Rename performance suites and add more TAGS Change-Id: I6a5251bb6e380fe2a47a6ec1c1aeb4a9f70c5ce3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-07CSIT-256: L2enc - l2-eth-lispgpe-ip6 - L2BDZdeno Olsovsky1-4/+7
Change-Id: I5523235aa7b48be673c9940323424b2dc1172312 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-08-22CSIT-324 L2dp - Bridge domain - baseline vhost-userpmikus1-0/+3
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: Id0e508d50288d89b39bc5c321eeab0c908f3e2ba Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-18CSIT-200: Lisp performance testAndrej Kozemcak1-0/+14
Change-Id: I8a54b79ee03c2f5defc4eeba486086d793484668 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-28CSIT-169 IPv4 Scale - performancepmikus1-0/+12
- Add libraries for ipv4 scale setup - Add test cases for testing 10k/100k/1M fib entries - Add t-rex profiles for large scale testing Change-Id: If085e0d834e5ffe5538ba76756e8b9d0e8255cb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-29CSIT-181: Remove fds tests from vpp-csit-verify and csit-vpp-verify jobsJan Gelety1-1/+5
- add tag SKIP_PATCH to FDS related tests and exclude them from execution in case of vpp-csit-verify and csit-vpp-verify jobs Change-Id: I14237a78529b3d3c9b586041a24ceef303c1394b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-26Find PDR using binary searchPeter Mikus1-0/+9
- JIRA: CSIT-72 - modify libraries for PDR search evaluation - write robot framework keywords for PDR search - write Performance Test Cases using PDR Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-04-17Multicore VPP setup for performance testingpmikus1-0/+43
- add multithread TAGS documentation - add methods to VppConfigGenerator for RSS configuration - create KW for multithread setup - create sample test case using multithread vpp setup - add Documentation into TCs Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-15Update Qemu libraryMatus Fabian1-0/+49
Incorporated changes from nested VM on VIRL. Change-Id: I76ceeb2dde635c2cf0d3a53d29bf24fed72a5437 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-13Honeycomb setup and utilsTibor1-0/+22
- re-implement HTTPCodes as IntEnum rather then dictionary - add methods to manipulate data using honeycomb - get, set, delete - change the name of url file from vpp_version.url to oper_vpp_version.url - improve checking of startup and shutdown state of honeycomb - PEP8 fixes - add docstrings in all modules and classes - move logging to the lowest possible level - improve logging in exceptions - add method exec_command_sudo_log to resources.libraries.python.ssh module Change-Id: I54e0c6b45313e3a3c11bafa475488ae2b1e605c2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-04-08Add Vagrantfile for local testing.Stefan Kobza1-0/+16
Vagrantfile contains 3 VMs as of now, 2 DUTs 1 TG, with these notes: - login is csit/csit - by default provision script installs all deb packages from the dir where Vagrantfile is - developed for, and only tested on vbox (someone can pick up vmware) - All nodes have 1 shared mgmt network: 192.168.255.0/24 - hosts have these IP addresses in host-only network TG : 192.168.255.100 DUT1 : 192.168.255.101 DUT2 : 192.168.255.102 - script created to download MAC address information - PCI addresses are always the same for vbox (not sure about vmware) HOWTO (will create a wiki page once one is created for CSIT project): - copy Vagrantfile to separate dir on host - vagrant up --parallel sit-back-and-relax - from VM that has access to the same host-only network (192.168.255.0 above) - copy your ssh-key to csit@192.168.255.{101,102,250} using ssh-copy-id - cd ${csit_dir} - virtualenv & pip as in README - export PYTHONPATH=${csit_dir} - resources/tools/topology/update_topology.py -v -f -o topologies/available/vagrant_pci.yaml \ topologies/available/vagrant.yaml - pybot -L TRACE \ -v TOPOLOGY_PATH:topologies/available/vagrant_pci.yaml -s \ "ipv4" tests - see tests results Change-Id: Ic27626605a9c820bca977b38f4e8ca37d1504ff5 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-04-05Add new tag for VPP-VM testing enviromentMatus Fabian1-0/+3
Change-Id: I2bdca4d8451bec8215b2d8f637809f8781e2e9d2 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-02-19Add hw/vm tags, add single link tag.Stefan Kobza1-0/+10
Add HW_EVN and VM_ENV tags to specify limitations on where the given test could be run. For tests that should be run only on bare metal, author of the test should add tag HW_ENV to it. Add 3_NODE_SINGLE_LINK_TOPO tag, to specify requirement on topology, where only one link is required in between any two nodes in the topology. Change-Id: I38c9a9732cad608bb6a9e4a2c5f1997236cd48b9 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-02-11Update of latest tests.Stefan Kobza1-0/+14
Change-Id: Ifb04651ff4a3c1ba9aaa725eb9a309278ebc1140 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-02-08New version of RF tests.Stefan Kobza2-0/+32
Change-Id: I241a2b7a7706e65f71cfd4a62e2a40f053fc5d07 Signed-off-by: Stefan Kobza <skobza@cisco.com>