CSIT/PerfTestPlan

From fd.io
< CSIT
Revision as of 18:21, 8 July 2016 by Pmikus (Talk | contribs)

Jump to: navigation, search

Performance testing - Jobs

CSIT Jenkins Jobs for Performance Tests

Performance testing - Testbeds

CSIT LF testbed for Performance Tests: all 3 LF physical testbeds are all live

Performance testing - Test Cases

CSIT test suite list for VPP v16.06

Test Suites

CSIT test suite list for VPP v16.09

[TO-DO]

Performance Test Cases - Plan and Status

For CSIT project to work and be useful, it is proposed that CSIT code and test cases development should be done in coordination with VPP Release Candidate content and release schedule. CSIT development work needs to be prioritized based on FD.io community needs and feedback, and csit-dev work distributed. To facilitate this, we compiled an initial list of proposed performance test cases that must, should, could be tested. Each csit-dev work item is prefixed with status and/or proposed priority relative to FD.io VPP release:

  • [Pn-Rm] – Proposed coverage of VPP functionality by FD.io CSIT functional and performance test cases.
    • Pn – CSIT development and integration priority; n=0,1,2, 0-for-MUST, 1-for-SHOULD, 2-for-COULD.
    • Rm – VPP major release, R1 stands for the first FD.io VPP release, R2 for the 2nd FD.io VPP release.
  • [DONE-Rm] - Done and working test cases, executed for VPP Rm code.
  • [TBD] - Development work scheduling priority to-be-defined.

Plan execution tracked on CSIT jira

CSIT-DEV plan for VPP v16.06

  1. Long throughput benchmarks - libraries
  2. Long throughput benchmarks - test cases
  3. Short throughput benchmarks - libraries
  4. Short throughput benchmarks - test cases
  5. 3-node physical testbed - libraries
  6. Multi-core multi-thread tests - libraries
  7. Security feature
  8. L2 encapsulations
  9. VPP vNet topology baselines - libraries
    • Host stack VPP baseline - Phy1-VPP-Phy2
  10. vNet VPP topologies - libraries
    • Phy1-VPP-Phy2
  11. Traffic generator drivers
  12. Other work items

CSIT-DEV plan for VPP v16.09

  1. Large-scale FIB tests - libraries
  2. Packet encapsulations - test cases
    • IP4 encapsulations
      • [P1-R2] ip4-gre-ip4
      • [P1-R2] ip4-ipsec-ip4
    • IP6 encapsulations
      • [P1-R2] ip4-o-ip6 softwire
        • [P1-R2] lightweight46 [rfc7596]
      • [P2-R2] map-e [rfc7597]
      • [P2-R2] map-t [rfc7599]
    • L2 encapsulations
      • [P1-R2] l2-vxlan-ipv4
      • [TBD] l2-eth-l2tpv3-ip4
      • [TBD] l2-eth-l2tpv3-ip6
      • [TBD] l2-eth-gre-ip4
      • [TBD] l2-eth-gre-ip6
    • [TBD] ip6-segment-routing
    • [P1-R2] ip6-ipsec-ip6
  3. Security feature
    • [TBD] IPv6 iACL
  4. VPP vNet topology baselines - libraries
    • Host stack baseline - Phy1-App-Phy2
    • Host stack VPP baseline - Phy1-VPP-Phy2
      • [TBD] Host VPP IPv4 baseline config, DPDK driver per NIC type
    • Guest stack baseline - Phy1-pcipt-AppVM-pcipt-Phy2
      • [TBD] Reference guest user-mode app, L3FWD-xconnect, DPDK driver per NIC type
    • Guest stack VPP baseline - Phy1-pcipt-VPPVM-pcipt-Phy2
      • [TBD] VPP IPv4 baseline config, DPDK driver per NIC type
    • [P0-R2] Host and guest stack baseline - Phy1-VPP-AppVM-VPP-Phy2 - Gerrit #1319 Jira CSIT-63
      • [TBD] VPP IPv4 baseline config, vhost-user to AppVM
  5. vNet VPP topologies - libraries
  6. Traffic generator drivers
    • IXIA IxNetwork driver
      • [P1-R2] driver design - Gerrit #1561 Jira CSIT-66
      • [P1-R2] driver implementation - Gerrit #1561 Jira CSIT-66
        • [TBD] test case setup, teardown
        • [TBD] traffic stream configuration
        • [TBD] statistics retrieval
      • latency measurements
        • [TBD] feasibility
        • [TBD] implementation
      • [TBD] integration with CSIT tests
    • Moongen driver
      • [TBD] verify requirements and available HW against latest MoonGen codebase
      • [TBD] CSIT integration
    • LWPG driver
      • [TBD] driver design
      • [TBD] driver implementation
        • [TBD] test case setup, teardown
        • [TBD] traffic stream configuration
        • [TBD] statistics retrieval
      • [TBD] latency measurements
        • [TBD] feasibility
        • [TBD] implementation
      • [TBD] integration with CSIT tests
  7. Other work items
Retrieved from "https://wiki.fd.io/index.php?title=CSIT/PerfTestPlan&oldid=2073"