Difference between revisions of "CSIT/Honeycomb/HC performance"
(→Measured numbers with multiple netconf thread) |
(→Scenario) |
||
| Line 4: | Line 4: | ||
The goal of this test is to measure the performance of an external NETCONF client performing read operations on VPP operational data using Honeycomb's NETCONF northbound server. | The goal of this test is to measure the performance of an external NETCONF client performing read operations on VPP operational data using Honeycomb's NETCONF northbound server. | ||
=== Scenario === | === Scenario === | ||
| − | 1. | + | 1. VPP and Honeycomb are started on device |
2. external netconf client generates read requests over localhost to Honeycomb's netconf northbound server | 2. external netconf client generates read requests over localhost to Honeycomb's netconf northbound server | ||
| Line 11: | Line 11: | ||
4. performance is calculated in terms of requests processed per second | 4. performance is calculated in terms of requests processed per second | ||
| + | |||
=== Results === | === Results === | ||
==== Environment ==== | ==== Environment ==== | ||
Revision as of 13:36, 19 June 2017
Contents
[hide]Honeycomb Performance Testing
Performance tests for Honeycomb as a VPP agent.
NETCONF northbound performance test - read
The goal of this test is to measure the performance of an external NETCONF client performing read operations on VPP operational data using Honeycomb's NETCONF northbound server.
Scenario
1. VPP and Honeycomb are started on device
2. external netconf client generates read requests over localhost to Honeycomb's netconf northbound server
3. client measures time since sending out the first request until the last response is received
4. performance is calculated in terms of requests processed per second
Results
Environment
Host configuration:
- Cisco UCS C240-M4 (2x Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz, 18c, 512GB RAM)
- BIOS settings:
- Hyperthreading disabled.
- SpeedStep disabled.
- TurboBoost disabled.
- Power Technology: Performance.
- Ubuntu 16.04.1, kernel 4.4.0-42-generic
More details about the testbed on https://wiki.fd.io/view/CSIT/CSIT_LF_testbed
- VPP 17.07-RC0:
- default configuration
- Honeycomb 1.17.07:
- minimal optimization (increased JVM parameters - memory size, metaspace size)
- custom "show version" method, in order to minimize VPP processing
Measured numbers with single netconf thread
"netconf-netty-threads":1
| # of clients | Client type | TCP performance | Total reads |
|---|---|---|---|
| 1 | Synchronous | 4475 reads/s | 100K |
| 2 | Synchronous | 4923 reads/s | 100K |
| 4 | Synchronous | 5024 reads/s | 100K |
| 8 | Synchronous | 5099 reads/s | 100K |
| 16 | Synchronous | 5217 reads/s | 100K |
Measured numbers with multiple netconf threads
"netconf-netty-threads":16
| # of clients | Client type | TCP performance | Total reads |
|---|---|---|---|
| 1 | Synchronous | 4505 reads/s | 100K |
| 2 | Synchronous | 9345 reads/s | 100K |
| 4 | Synchronous | 18484 reads/s | 100K |
| 8 | Synchronous | 31210 reads/s | 100K |
| 16 | Synchronous | 42833 reads/s | 100K |
Data source: https://jenkins.fd.io/job/csit-hc2vpp-verify-perf/23/
How to reproduce
Work in progress
