Difference between revisions of "CSIT/VPP-ubuntu-compare-1404to1604"

From fd.io
Jump to: navigation, search
(Created page with "Summary of performance trending from FD.io testbeds after upgrading from Ubuntu14.04 Trusty to 16.04 Xenial:- A. Comparison based on: 1. Ubuntu 14.04 - vpp build 101, csit-vp...")
 
Line 1: Line 1:
 
Summary of performance trending from FD.io testbeds after upgrading from Ubuntu14.04 Trusty to 16.04 Xenial:-
 
Summary of performance trending from FD.io testbeds after upgrading from Ubuntu14.04 Trusty to 16.04 Xenial:-
  
A. Comparison based on:
+
* '''A. Comparison based on:'''
1. Ubuntu 14.04 - vpp build 101, csit-vpp-perf-master-long #1076
+
** 1. Ubuntu 14.04 - vpp build 101, csit-vpp-perf-master-long #1076
2. Ubuntu 16.04 - vpp build 136, csit-vpp-perf-master-long #1080(onwards)
+
** 2. Ubuntu 16.04 - vpp build 136, csit-vpp-perf-master-long #1080(onwards)
  
B. Increased - all values for 1worker, unless noted:
+
* '''B. Increased NDR throughput - all values for 1worker, unless noted:'''
1. l2bd x520 6%
+
** 1. l2bd x520 6%
2. IPv4 x520 3%
+
** 2. IPv4 x520 3%
3. L2XC x520 3..9% (untagged, dot1q, dot1ad)
+
** 3. L2XC x520 3..9% (untagged, dot1q, dot1ad)
4. L2XC xl710 3%
+
** 4. L2XC xl710 3%
5. L2XC xl710 81% 2workers
+
** 5. L2XC xl710 81% 2workers
  
C. Decreased - all values for 1worker:
+
* '''C. Decreased NDR throughput - all values for 1worker:'''
1. IPv6 x520 -5%
+
** 1. IPv6 x520 -5%
  
 
Source data log files for above calcs available here: csit wiki links
 
Source data log files for above calcs available here: csit wiki links
  
D. This is also reflected in NDR trending graphs in LF Jenkins:
+
* '''D. This is also reflected in NDR trending graphs in LF Jenkins:'''
1. Ubuntu1404, vpp1609 release without fib2.0 patches:
+
** 1. Ubuntu1404, vpp1609 release without fib2.0 patches:
    https://jenkins.fd.io/view/csit/job/csit-vpp-perf-1609-long/plot/RFC2544%3ANDR/
+
*** https://jenkins.fd.io/view/csit/job/csit-vpp-perf-1609-long/plot/RFC2544%3ANDR/
2. Ubuntu1604, vpp master with fib2.0 patches:
+
** 2. Ubuntu1604, vpp master with fib2.0 patches:
    https://jenkins.fd.io/view/csit/job/csit-vpp-perf-master-long/plot/RFC2544%3ANDR/
+
*** https://jenkins.fd.io/view/csit/job/csit-vpp-perf-master-long/plot/RFC2544%3ANDR/
 
but due to LF purged job history we only have vpp-1609 ("fib1.0") vs. vpp-master (fib2.0)
 
but due to LF purged job history we only have vpp-1609 ("fib1.0") vs. vpp-master (fib2.0)
 
trend graphs.
 
trend graphs.
  
E. Note that you can now see daily performance trending graphs for NDR and PDR for vpp master here:
+
* '''E. Note that you can now see daily performance trending graphs for NDR and PDR for vpp master here:'''
1. vpp master branch - RFC2544:NDR trending plot
+
** 1. vpp master branch - RFC2544:NDR trending plot
    https://jenkins.fd.io/view/csit/job/csit-vpp-verify-perf-master-nightly-all/plot/RFC2544%3ANDR/
+
*** https://jenkins.fd.io/view/csit/job/csit-vpp-verify-perf-master-nightly-all/plot/RFC2544%3ANDR/
2. vpp master branch - RFC2544:PDR trending plot
+
** 2. vpp master branch - RFC2544:PDR trending plot
    https://jenkins.fd.io/view/csit/job/csit-vpp-verify-perf-master-nightly-all/plot/RFC2544%3APDR/
+
*** https://jenkins.fd.io/view/csit/job/csit-vpp-verify-perf-master-nightly-all/plot/RFC2544%3APDR/
  
F. And few requests:
+
* '''F. And few requests:'''
1. Welcome all comments!  
+
** 1. Welcome all comments!  
2. Welcome any volunteers to help us catch any anomalies in perf trending.
+
** 2. Welcome any volunteers to help us catch any anomalies in perf trending.
3. Pls send any wishes for what you would like to see for performance tests and trending, to csit-dev@lists.fd.io.
+
** 3. Pls send any wishes for what you would like to see for performance tests and trending, to csit-dev@lists.fd.io.

Revision as of 14:08, 1 November 2016

Summary of performance trending from FD.io testbeds after upgrading from Ubuntu14.04 Trusty to 16.04 Xenial:-

  • A. Comparison based on:
    • 1. Ubuntu 14.04 - vpp build 101, csit-vpp-perf-master-long #1076
    • 2. Ubuntu 16.04 - vpp build 136, csit-vpp-perf-master-long #1080(onwards)
  • B. Increased NDR throughput - all values for 1worker, unless noted:
    • 1. l2bd x520 6%
    • 2. IPv4 x520 3%
    • 3. L2XC x520 3..9% (untagged, dot1q, dot1ad)
    • 4. L2XC xl710 3%
    • 5. L2XC xl710 81% 2workers
  • C. Decreased NDR throughput - all values for 1worker:
    • 1. IPv6 x520 -5%

Source data log files for above calcs available here: csit wiki links

but due to LF purged job history we only have vpp-1609 ("fib1.0") vs. vpp-master (fib2.0) trend graphs.

  • F. And few requests:
    • 1. Welcome all comments!
    • 2. Welcome any volunteers to help us catch any anomalies in perf trending.
    • 3. Pls send any wishes for what you would like to see for performance tests and trending, to csit-dev@lists.fd.io.