CSIT-725: Use csv files for performance improvments table

 - Use CSV files instead of static content in "performance improvments"
   chapter in report.
 - The content of csv files is created manualy now, it will be automatized.

Change-Id: Ied00f33612e0daf13cf81cf9b4c3827d04c5d5b0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fa19644365e53cdf2a02c3c93b1b93a5d3891210)

1 files changed, 17 insertions, 106 deletions

diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index ff992df896..0a5d25e6b6 100644
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -49,52 +49,20 @@ NDR Throughput
 

 Non-Drop Rate Throughput discovery tests:

 

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01 | VPP-17.04 | VPP-17.07 | 17.04 to 17.07  |

-|                   |                                                                 | [Mpps]    | [Mpps]    | [Mpps]    | [Mpps]    | Relative Change |

-+===================+=================================================================+===========+===========+===========+===========+=================+

-| L2XC-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-ndrdisc       | 0.5       | 2.8       | 3.4       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2BD-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc | 0.4       | 2.7       | 3.1       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 vhost        | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-ndrdisc     | 0.3       | 2.6       | 3.0       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 LISP         | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-ndrdisc             | 4.4       | 4.8       | 5.5       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6              | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-ndrdisc                    | 3.0       | 7.3       | 8.1       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6 COP          | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-ndrdisc     | 6.1       | 6.1       | 6.9       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6 iAcl         | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-ndrdisc        | 6.5       | 6.1       | 6.9       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6 FIB 2M       | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-ndrdisc                 | 5.3       | 4.2       | 4.6       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

+.. csv-table::

+    :align: center

+    :header-rows: 1

+    :file: ../../../docs/report/vpp_performance_tests/performance_improvements/ndr_throughput.csv

 

 PDR Throughput

 ~~~~~~~~~~~~~~

 

 Partial Drop Rate thoughput discovery tests with packet Loss Tolerance of 0.5%:

 

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01 | VPP-17.04 | VPP-17.07 | 17.04 to 17.07  |

-|                   |                                                                 | [Mpps]    | [Mpps]    | [Mpps]    | [Mpps]    | Relative Change |

-+===================+=================================================================+===========+===========+===========+===========+=================+

-| L2XC-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-pdrdisc       | 2.6       | 3.2       | 3.7       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2BD-vhost-VM     | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-pdrdisc | 2.1       | 2.9       | 3.3       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 vhost        | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-pdrdisc     | 2.0       | 2.7       | 3.0       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 LISP         | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-pdrdisc             | 4.6       | 4.8       | 5.5       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6              | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-pdrdisc                    | 7.7       | 7.3       | 8.1       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6 COP          | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-pdrdisc     | 6.1       | 6.1       | 6.9       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6 iAcl         | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-pdrdisc        | 6.5       | 6.1       | 6.9       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6 FIB 2M       | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-pdrdisc                 | 5.3       | 4.2       | 4.6       |           | ??%             |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

+.. csv-table::

+    :align: center

+    :header-rows: 1

+    :file: ../../../docs/report/vpp_performance_tests/performance_improvements/pdr_throughput.csv

 

 Measured improvements are in line with VPP code optimizations listed in

 `VPP-17.07 release notes

@@ -113,78 +81,21 @@ NDR Throughput
 

 Non-Drop Rate Throughput discovery tests:

 

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01 | VPP-17.04 | VPP-17.07 | 17.04 to 17.07  |

-|                   |                                                                 | [Mpps]    | [Mpps]    | [Mpps]    | [Mpps]    | Relative Change |

-+===================+=================================================================+===========+===========+===========+===========+=================+

-| L2XC              | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-ndrdisc                      | 9.4       | 12.7      | 13.1      |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2XC              | 10ge2p1xl710: 64B-1t1c-eth-l2xcbase-ndrdisc                     | 9.5       | 12.2      | 12.4      |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2XC dot1ad       | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-ndrdisc                   | 7.4       | 8.8       | 9.3       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2XC dot1q        | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-ndrdisc                    | 7.5       | 8.8       | 9.2       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2XC VxLAN        | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-ndrdisc              | 5.4       | 6.5       | 6.8       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2BD              | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-ndrdisc                | 7.8       | 10.4      | 10.8      |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4              | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ndrdisc                    | 8.7       | 9.7       | 10.6      |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 COP          | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-ndrdisc     | 7.1       | 8.3       | 9.0       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 iAcl         | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-ndrdisc        | 6.9       | 7.6       | 8.3       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 FIB 200k     | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-ndrdisc               | 8.5       | 9.0       | 9.7       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 FIB 20k      | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-ndrdisc                | 8.5       | 9.0       | 9.7       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 FIB 2M       | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-ndrdisc                 | 8.5       | 7.8       | 8.1       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 Policer      | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-ndrdisc    | 6.9       | 7.4       | 8.1       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6 FIB 200k     | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-ndrdisc               | 6.5       | 5.3       | 5.3       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6 FIB 20k      | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-ndrdisc                | 6.9       | 6.5       | 6.9       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

+.. csv-table::

+    :align: center

+    :header-rows: 1

+    :file: ../../../docs/report/vpp_performance_tests/performance_improvements/ndr_throughput_others.csv

 

 PDR Throughput

 ~~~~~~~~~~~~~~

 

 Partial Drop Rate thoughput discovery tests with packet Loss Tolerance of 0.5%:

 

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| VPP Functionality | Test Name                                                       | VPP-16.09 | VPP-17.01 | VPP-17.04 | VPP-17.07 | 17.04 to 17.07  |

-|                   |                                                                 | [Mpps]    | [Mpps]    | [Mpps]    | [Mpps]    | Relative Change |

-+===================+=================================================================+===========+===========+===========+===========+=================+

-| L2XC              | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-pdrdisc                      | 9.4       | 12.7      | 13.4      |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2XC dot1ad       | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-pdrdisc                   | 7.4       | 8.8       | 9.3       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2XC dot1q        | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-pdrdisc                    | 7.5       | 8.8       | 9.2       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2XC VxLAN        | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-pdrdisc              | 5.4       | 6.5       | 6.8       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| L2BD              | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-pdrdisc                | 7.8       | 10.6      | 10.8      |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4              | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-pdrdisc                    | 8.7       | 9.7       | 10.6      |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 COP          | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-pdrdisc     | 7.1       | 8.3       | 9.2       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 iAcl         | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-pdrdisc        | 7.1       | 7.6       | 8.3       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 FIB 200k     | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-pdrdisc               | 8.5       | 9.0       | 9.7       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 FIB 20k      | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-pdrdisc                | 8.5       | 9.0       | 9.7       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 FIB 2M       | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-pdrdisc                 | 8.3       | 8.1       | 8.1       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv4 Policer      | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-pdrdisc    | 7.1       | 7.4       | 8.1       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6 FIB 200k     | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-pdrdisc               | 6.9       | 5.3       | 5.3       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

-| IPv6 FIB 20k      | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-pdrdisc                | 6.9       | 6.5       | 6.9       |           | ?%              |

-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------+-----------------+

+.. csv-table::

+    :align: center

+    :header-rows: 1

+    :file: ../../../docs/report/vpp_performance_tests/performance_improvements/pdr_throughput_others.csv

+

 

 Known Issues

 ------------