Difference between revisions of "CSIT/csit1707 plan"

From fd.io
Jump to: navigation, search
(→‎Release Deliverables)
 
(2 intermediate revisions by one other user not shown)
Line 5: Line 5:
 
All CSIT release deliverables should be tracked in FDio CSIT Jira using one of the following Jira Epic categories:
 
All CSIT release deliverables should be tracked in FDio CSIT Jira using one of the following Jira Epic categories:
  
 +
# '''<span style="color: blue">1707-Report</span>''' [https://jira.fd.io/browse/CSIT-618 CSIT-618].
 
# '''<span style="color: blue">1707-Tests</span>''' [https://jira.fd.io/browse/CSIT-616 CSIT-616].
 
# '''<span style="color: blue">1707-Tests</span>''' [https://jira.fd.io/browse/CSIT-616 CSIT-616].
 
# '''<span style="color: blue">VIRL-GetWellPlan</span>''' [https://jira.fd.io/browse/CSIT-581 CSIT-581].
 
# '''<span style="color: blue">VIRL-GetWellPlan</span>''' [https://jira.fd.io/browse/CSIT-581 CSIT-581].
Line 19: Line 20:
 
|-
 
|-
 
| Stateful Security Groups
 
| Stateful Security Groups
−
| InTesting
+
| Done
 
| 1707-Tests perf
 
| 1707-Tests perf
 
| [https://jira.fd.io/browse/CSIT-622 CSIT-622] L2 switching with (Stateful) Security Groups required by OpenStack ML2 VPP use cases.
 
| [https://jira.fd.io/browse/CSIT-622 CSIT-622] L2 switching with (Stateful) Security Groups required by OpenStack ML2 VPP use cases.
 
|-
 
|-
 
| NSH_SFC
 
| NSH_SFC
−
| InTesting
+
| Done
 
| 1707-Tests func
 
| 1707-Tests func
 
| [https://jira.fd.io/browse/CSIT-676 CSIT-676] VPP as Service Function Forwarder SFF, SFC Classifier, NSH Proxy.
 
| [https://jira.fd.io/browse/CSIT-676 CSIT-676] VPP as Service Function Forwarder SFF, SFC Classifier, NSH Proxy.
 
|-
 
|-
 
| VM vhost use cases
 
| VM vhost use cases
−
| InTesting
+
| Done
 
| 1707-Tests perf
 
| 1707-Tests perf
 
| [https://jira.fd.io/browse/CSIT-659 CSIT-659] Add more vhost configurations, use cases and topologies: multi-thread multi-core, Qemu config variants, VXLAN.
 
| [https://jira.fd.io/browse/CSIT-659 CSIT-659] Add more vhost configurations, use cases and topologies: multi-thread multi-core, Qemu config variants, VXLAN.
 
|-
 
|-
 
| DPDK17.05 testpmd
 
| DPDK17.05 testpmd
−
| DONE
+
| Done
 
| 1707-Tests perf
 
| 1707-Tests perf
 
| Standalone DPDK tests for baseline NIC-to-NIC performance.
 
| Standalone DPDK tests for baseline NIC-to-NIC performance.
 
|-
 
|-
 
| LXC memif use cases
 
| LXC memif use cases
−
| InTesting
+
| Done
 
| 1707-Tests perf
 
| 1707-Tests perf
 
| [https://jira.fd.io/browse/CSIT-646 CSIT-646] Initial VPP in LXC memif use cases and topologies.
 
| [https://jira.fd.io/browse/CSIT-646 CSIT-646] Initial VPP in LXC memif use cases and topologies.
 
|-
 
|-
 
| VPP multi-thread profiling
 
| VPP multi-thread profiling
−
| DONE
+
| Done
 
| 1707-Tests perf
 
| 1707-Tests perf
 
| [https://jira.fd.io/browse/CSIT-421 CSIT-421] Updates to existing m-thread m-core tests to verify results repeatibility. Not introducing simultaneous multi-threading SMT (Intel hyper-threading HT).
 
| [https://jira.fd.io/browse/CSIT-421 CSIT-421] Updates to existing m-thread m-core tests to verify results repeatibility. Not introducing simultaneous multi-threading SMT (Intel hyper-threading HT).
Line 53: Line 54:
 
| [https://jira.fd.io/browse/CSIT-602 CSIT-602] Complete productization of Centos7 VPP tests for all VPP functional tests in FD.io CSIT VIRL infra.
 
| [https://jira.fd.io/browse/CSIT-602 CSIT-602] Complete productization of Centos7 VPP tests for all VPP functional tests in FD.io CSIT VIRL infra.
 
|-
 
|-
−
| SRv6
+
| NIC models coverage
−
| Next rls
+
| Done
 
| 1707-Tests perf
 
| 1707-Tests perf
−
| [https://jira.fd.io/browse/CSIT-684 CSIT-684] Initial VPP SRv6 performance tests.
+
| Extending perf tests coverage for x710, xl710, vic1385, vic1227.
 +
|-
 +
| CSIT Framework Optimization
 +
| Done
 +
| 1707-Optimizations
 +
| [https://jira.fd.io/browse/CSIT-575 CSIT-575] CSIT code optimizations. Description in [https://wiki.fd.io/view/CSIT/Design_Optimizations Design Optimizations] wiki.
 +
|-
 +
| HoneyComb func
 +
| Done
 +
| 1707-Honeycomb func
 +
| [https://jira.fd.io/browse/CSIT-658 CSIT-658] CSIT HoneyComb functional tests. Description in [https://wiki.fd.io/view/CSIT/Honeycomb/HC1707_plan] wiki.
 +
|-
 +
| HoneyComb perf
 +
| Done
 +
| 1707-Honeycomb perf
 +
| [https://jira.fd.io/browse/CSIT-658 CSIT-658] CSIT HoneyComb performance tests. Description in [https://lists.fd.io/pipermail/csit-dev/2017-May/001984.html] wiki.
 
|-
 
|-
 
| CryptoDev
 
| CryptoDev
−
| TBC
+
| Future
 
| 1707-Tests perf
 
| 1707-Tests perf
 
| Further VPP cryptodev use cases.
 
| Further VPP cryptodev use cases.
 +
|-
 +
| SRv6
 +
| Future
 +
| 1707-Tests perf
 +
| [https://jira.fd.io/browse/CSIT-684 CSIT-684] Initial VPP SRv6 performance tests.
 
|-
 
|-
 
| NAT44 multi-core
 
| NAT44 multi-core
−
| Next rls
+
| Future
 
| 1707-Tests perf
 
| 1707-Tests perf
 
| [https://jira.fd.io/browse/CSIT-672 CSIT-672] SNAT44 multi-thread multi-core performance tests.
 
| [https://jira.fd.io/browse/CSIT-672 CSIT-672] SNAT44 multi-thread multi-core performance tests.
−
|-
 
−
| NIC models coverage
 
−
| DONE
 
−
| 1707-Tests perf
 
−
| Extending perf tests coverage for x710, xl710, vic1385, vic1227.
 
 
|-
 
|-
 
| IPFIX
 
| IPFIX
−
| Next rls
+
| Future
 
| 1707-Tests perf
 
| 1707-Tests perf
 
| IPFIX netflow per flow statistics collection.
 
| IPFIX netflow per flow statistics collection.
 
|-
 
|-
 
| SPAN
 
| SPAN
−
| Next rls
+
| Future
 
| 1707-Tests perf
 
| 1707-Tests perf
 
| SPAN performance tests.
 
| SPAN performance tests.
 
|-
 
|-
−
| CSIT Framework Optimization
+
| rls1707 Report
−
| Done
+
| WIP
−
| 1707-Optimizations
+
| 1707-Report
−
| [https://jira.fd.io/browse/CSIT-575 CSIT-575] CSIT code optimizations. Description in [https://wiki.fd.io/view/CSIT/Design_Optimizations Design Optimizations] wiki.
+
| [https://jira.fd.io/browse/CSIT-618 CSIT-618] CSIT rls1707 report auto-generation including Jenkins test execution for test results generation and auto-rendering of all test results into report graphs and tables.  
−
|-
+
−
| HoneyComb func
+
−
| DONE
+
−
| 1707-Honeycomb func
+
−
| [https://jira.fd.io/browse/CSIT-658 CSIT-658] CSIT HoneyComb functional tests. Description in [https://wiki.fd.io/view/CSIT/Honeycomb/HC1707_plan] wiki.
+
−
|-
+
−
| HoneyComb perf
+
−
| DONE
+
−
| 1707-Honeycomb perf
+
−
| [https://jira.fd.io/browse/CSIT-658 CSIT-658] CSIT HoneyComb performance tests. Description in [https://lists.fd.io/pipermail/csit-dev/2017-May/001984.html] wiki.
+
 
|}
 
|}
  

Latest revision as of 08:55, 21 July 2017

Introduction

All CSIT release deliverables should be tracked in FDio CSIT Jira using one of the following Jira Epic categories:

  1. 1707-Report CSIT-618.
  2. 1707-Tests CSIT-616.
  3. VIRL-GetWellPlan CSIT-581.
  4. 1707-Optimizations CSIT-615.
  5. 1707-Honeycomb CSIT-658.

Release Deliverables

Name Status Category Description
Stateful Security Groups Done 1707-Tests perf CSIT-622 L2 switching with (Stateful) Security Groups required by OpenStack ML2 VPP use cases.
NSH_SFC Done 1707-Tests func CSIT-676 VPP as Service Function Forwarder SFF, SFC Classifier, NSH Proxy.
VM vhost use cases Done 1707-Tests perf CSIT-659 Add more vhost configurations, use cases and topologies: multi-thread multi-core, Qemu config variants, VXLAN.
DPDK17.05 testpmd Done 1707-Tests perf Standalone DPDK tests for baseline NIC-to-NIC performance.
LXC memif use cases Done 1707-Tests perf CSIT-646 Initial VPP in LXC memif use cases and topologies.
VPP multi-thread profiling Done 1707-Tests perf CSIT-421 Updates to existing m-thread m-core tests to verify results repeatibility. Not introducing simultaneous multi-threading SMT (Intel hyper-threading HT).
Centos7 VIRL tests WIP VIRL-GetWellPlan CSIT-602 Complete productization of Centos7 VPP tests for all VPP functional tests in FD.io CSIT VIRL infra.
NIC models coverage Done 1707-Tests perf Extending perf tests coverage for x710, xl710, vic1385, vic1227.
CSIT Framework Optimization Done 1707-Optimizations CSIT-575 CSIT code optimizations. Description in Design Optimizations wiki.
HoneyComb func Done 1707-Honeycomb func CSIT-658 CSIT HoneyComb functional tests. Description in [1] wiki.
HoneyComb perf Done 1707-Honeycomb perf CSIT-658 CSIT HoneyComb performance tests. Description in [2] wiki.
CryptoDev Future 1707-Tests perf Further VPP cryptodev use cases.
SRv6 Future 1707-Tests perf CSIT-684 Initial VPP SRv6 performance tests.
NAT44 multi-core Future 1707-Tests perf CSIT-672 SNAT44 multi-thread multi-core performance tests.
IPFIX Future 1707-Tests perf IPFIX netflow per flow statistics collection.
SPAN Future 1707-Tests perf SPAN performance tests.
rls1707 Report WIP 1707-Report CSIT-618 CSIT rls1707 report auto-generation including Jenkins test execution for test results generation and auto-rendering of all test results into report graphs and tables.

Release Milestones

rls1707 Milestone Date Deliverables
Code complete 2017-07-06 Test cases code frozen. Only bug fixes and low-risk changes accepted.
Branch pull 2017-07-06 Pull CSIT rls1707 throttle branch.
CSIT Release 2017-07-12 CSIT rls1707 test code complete. VPP1707 rls testing.
CSIT Report 2017-07-26 CSIT rls1707 report published

Expected Dependencies on Other Projects

  • dpdk-17.05 release
  • vpp-17.07 release
  • honeycomb
  • nsh_sfc
  • one
Retrieved from "https://wiki.fd.io/index.php?title=CSIT/csit1707_plan&oldid=5545"