Difference between revisions of "CSIT/csit1707 plan"

From fd.io
Jump to: navigation, search
(Created page with "Category:Release Plan == Introduction == == Release Deliverables == {|class="wikitable" ! Name ! Status ! Test Category ! Description |- | Stateful Security Groups | InR...")
 
(Release Deliverables)
 
(18 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 +
 
[[Category:Release Plan]]
 
[[Category:Release Plan]]
 
== Introduction ==
 
== Introduction ==
 +
 +
All CSIT release deliverables should be tracked in FDio CSIT Jira using one of the following Jira Epic categories:
 +
 +
# '''<span style="color: blue">1707-Report</span>''' [https://jira.fd.io/browse/CSIT-618 CSIT-618].
 +
# '''<span style="color: blue">1707-Tests</span>''' [https://jira.fd.io/browse/CSIT-616 CSIT-616].
 +
# '''<span style="color: blue">VIRL-GetWellPlan</span>''' [https://jira.fd.io/browse/CSIT-581 CSIT-581].
 +
# '''<span style="color: blue">1707-Optimizations</span>''' [https://jira.fd.io/browse/CSIT-615 CSIT-615].
 +
# '''<span style="color: blue">1707-Honeycomb</span>''' [https://jira.fd.io/browse/CSIT-658 CSIT-658].
  
 
== Release Deliverables ==
 
== Release Deliverables ==
Line 7: Line 16:
 
! Name
 
! Name
 
! Status
 
! Status
! Test Category
+
! Category
 
! Description
 
! Description
 
|-
 
|-
 
| Stateful Security Groups
 
| Stateful Security Groups
| InReview
+
| Done
| csit-perf
+
| 1707-Tests perf
| L2 switching with Stateful Security Groups.
+
| [https://jira.fd.io/browse/CSIT-622 CSIT-622] L2 switching with (Stateful) Security Groups required by OpenStack ML2 VPP use cases.
 
|-
 
|-
 
| NSH_SFC
 
| NSH_SFC
| InReview
+
| Done
| csit-perf
+
| 1707-Tests func
| VPP as Service Function Forwarder SFF, SFC Classifier, NSH Proxy.
+
| [https://jira.fd.io/browse/CSIT-676 CSIT-676] VPP as Service Function Forwarder SFF, SFC Classifier, NSH Proxy.
|-
+
| CryptoDev
+
| TBC
+
| csit-perf
+
| Further VPP cryptodev use cases.
+
|-
+
| NAT44
+
| TBC
+
| csit-perf
+
| SNAT44 multi-thread multi-core performance tests.
+
 
|-
 
|-
 
| VM vhost use cases
 
| VM vhost use cases
| TBC
+
| Done
| csit-perf
+
| 1707-Tests perf
| Add vhost use cases and topologies as captured on csit vhostuser use cases wiki: multi-thread multi-core, vxlan, multiple VMs.
+
| [https://jira.fd.io/browse/CSIT-659 CSIT-659] Add more vhost configurations, use cases and topologies: multi-thread multi-core, Qemu config variants, VXLAN.
 
|-
 
|-
 
| DPDK17.05 testpmd
 
| DPDK17.05 testpmd
| WIP
+
| Done
| csit-perf
+
| 1707-Tests perf
 
| Standalone DPDK tests for baseline NIC-to-NIC performance.
 
| Standalone DPDK tests for baseline NIC-to-NIC performance.
 +
|-
 +
| LXC memif use cases
 +
| Done
 +
| 1707-Tests perf
 +
| [https://jira.fd.io/browse/CSIT-646 CSIT-646] Initial VPP in LXC memif use cases and topologies.
 +
|-
 +
| VPP multi-thread profiling
 +
| Done
 +
| 1707-Tests perf
 +
| [https://jira.fd.io/browse/CSIT-421 CSIT-421] Updates to existing m-thread m-core tests to verify results repeatibility. Not introducing simultaneous multi-threading SMT (Intel hyper-threading HT).
 +
|-
 +
| Centos7 VIRL tests
 +
| WIP
 +
| VIRL-GetWellPlan
 +
| [https://jira.fd.io/browse/CSIT-602 CSIT-602] Complete productization of Centos7 VPP tests for all VPP functional tests in FD.io CSIT VIRL infra.
 
|-
 
|-
 
| NIC models coverage
 
| NIC models coverage
| TBC
+
| Done
| csit-perf
+
| 1707-Tests perf
 
| Extending perf tests coverage for x710, xl710, vic1385, vic1227.
 
| Extending perf tests coverage for x710, xl710, vic1385, vic1227.
 
|-
 
|-
| LXC memif use cases
+
| CSIT Framework Optimization
| TBC
+
| Done
| csit-perf
+
| 1707-Optimizations
| Initial VPP in LXC memif use cases and topologies.
+
| [https://jira.fd.io/browse/CSIT-575 CSIT-575] CSIT code optimizations. Description in [https://wiki.fd.io/view/CSIT/Design_Optimizations Design Optimizations] wiki.
 +
|-
 +
| HoneyComb func
 +
| Done
 +
| 1707-Honeycomb func
 +
| [https://jira.fd.io/browse/CSIT-658 CSIT-658] CSIT HoneyComb functional tests. Description in [https://wiki.fd.io/view/CSIT/Honeycomb/HC1707_plan] wiki.
 +
|-
 +
| HoneyComb perf
 +
| Done
 +
| 1707-Honeycomb perf
 +
| [https://jira.fd.io/browse/CSIT-658 CSIT-658] CSIT HoneyComb performance tests. Description in [https://lists.fd.io/pipermail/csit-dev/2017-May/001984.html] wiki.
 +
|-
 +
| CryptoDev
 +
| Future
 +
| 1707-Tests perf
 +
| Further VPP cryptodev use cases.
 +
|-
 +
| SRv6
 +
| Future
 +
| 1707-Tests perf
 +
| [https://jira.fd.io/browse/CSIT-684 CSIT-684] Initial VPP SRv6 performance tests.
 +
|-
 +
| NAT44 multi-core
 +
| Future
 +
| 1707-Tests perf
 +
| [https://jira.fd.io/browse/CSIT-672 CSIT-672] SNAT44 multi-thread multi-core performance tests.
 
|-
 
|-
 
| IPFIX
 
| IPFIX
| TBC
+
| Future
| csit-perf
+
| 1707-Tests perf
 
| IPFIX netflow per flow statistics collection.
 
| IPFIX netflow per flow statistics collection.
|-
 
| VPP multi-thread profiling
 
| WIP
 
| csit-perf
 
| Updates to existing m-thread m-core tests to verify results repeatibility. Introduce simultaneous multi-threading SMT (Intel hyper-threading HT).
 
 
|-
 
|-
 
| SPAN
 
| SPAN
| TBC
+
| Future
| csit-perf
+
| 1707-Tests perf
 
| SPAN performance tests.
 
| SPAN performance tests.
 +
|-
 +
| rls1707 Report
 +
| WIP
 +
| 1707-Report
 +
| [https://jira.fd.io/browse/CSIT-618 CSIT-618] CSIT rls1707 report auto-generation including Jenkins test execution for test results generation and auto-rendering of all test results into report graphs and tables.
 
|}
 
|}
  
Line 71: Line 110:
  
 
{| class="wikitable"
 
{| class="wikitable"
! Milestone
+
! rls1707 Milestone
 
! Date
 
! Date
 
! Deliverables
 
! Deliverables
 
|-
 
|-
| CSIT code freeze
+
| Code complete
| 2017-07-05
+
| 2017-07-06
| New TCs code frozen. Only low-risk changes accepted on main branch.
+
| Test cases code frozen. Only bug fixes and low-risk changes accepted.
 
|-
 
|-
| csit rls1707 pull
+
| Branch pull
| 2017-07-05
+
| 2017-07-06
| pull csit release throttle branch.
+
| Pull CSIT rls1707 throttle branch.
 
|-
 
|-
| CSIT bug fixes
+
| CSIT Release
 
| 2017-07-12
 
| 2017-07-12
| CSIT1707 code complete.
+
| CSIT rls1707 test code complete. VPP1707 rls testing.
 
|-
 
|-
| CSIT report
+
| CSIT Report
 
| 2017-07-26
 
| 2017-07-26
| CSIT report published
+
| CSIT rls1707 report published
 
|}
 
|}
  
Line 99: Line 138:
 
* honeycomb
 
* honeycomb
 
* nsh_sfc
 
* nsh_sfc
 +
* one

Latest revision as of 08:55, 21 July 2017

Introduction

All CSIT release deliverables should be tracked in FDio CSIT Jira using one of the following Jira Epic categories:

  1. 1707-Report CSIT-618.
  2. 1707-Tests CSIT-616.
  3. VIRL-GetWellPlan CSIT-581.
  4. 1707-Optimizations CSIT-615.
  5. 1707-Honeycomb CSIT-658.

Release Deliverables

Name Status Category Description
Stateful Security Groups Done 1707-Tests perf CSIT-622 L2 switching with (Stateful) Security Groups required by OpenStack ML2 VPP use cases.
NSH_SFC Done 1707-Tests func CSIT-676 VPP as Service Function Forwarder SFF, SFC Classifier, NSH Proxy.
VM vhost use cases Done 1707-Tests perf CSIT-659 Add more vhost configurations, use cases and topologies: multi-thread multi-core, Qemu config variants, VXLAN.
DPDK17.05 testpmd Done 1707-Tests perf Standalone DPDK tests for baseline NIC-to-NIC performance.
LXC memif use cases Done 1707-Tests perf CSIT-646 Initial VPP in LXC memif use cases and topologies.
VPP multi-thread profiling Done 1707-Tests perf CSIT-421 Updates to existing m-thread m-core tests to verify results repeatibility. Not introducing simultaneous multi-threading SMT (Intel hyper-threading HT).
Centos7 VIRL tests WIP VIRL-GetWellPlan CSIT-602 Complete productization of Centos7 VPP tests for all VPP functional tests in FD.io CSIT VIRL infra.
NIC models coverage Done 1707-Tests perf Extending perf tests coverage for x710, xl710, vic1385, vic1227.
CSIT Framework Optimization Done 1707-Optimizations CSIT-575 CSIT code optimizations. Description in Design Optimizations wiki.
HoneyComb func Done 1707-Honeycomb func CSIT-658 CSIT HoneyComb functional tests. Description in [1] wiki.
HoneyComb perf Done 1707-Honeycomb perf CSIT-658 CSIT HoneyComb performance tests. Description in [2] wiki.
CryptoDev Future 1707-Tests perf Further VPP cryptodev use cases.
SRv6 Future 1707-Tests perf CSIT-684 Initial VPP SRv6 performance tests.
NAT44 multi-core Future 1707-Tests perf CSIT-672 SNAT44 multi-thread multi-core performance tests.
IPFIX Future 1707-Tests perf IPFIX netflow per flow statistics collection.
SPAN Future 1707-Tests perf SPAN performance tests.
rls1707 Report WIP 1707-Report CSIT-618 CSIT rls1707 report auto-generation including Jenkins test execution for test results generation and auto-rendering of all test results into report graphs and tables.

Release Milestones

rls1707 Milestone Date Deliverables
Code complete 2017-07-06 Test cases code frozen. Only bug fixes and low-risk changes accepted.
Branch pull 2017-07-06 Pull CSIT rls1707 throttle branch.
CSIT Release 2017-07-12 CSIT rls1707 test code complete. VPP1707 rls testing.
CSIT Report 2017-07-26 CSIT rls1707 report published

Expected Dependencies on Other Projects

  • dpdk-17.05 release
  • vpp-17.07 release
  • honeycomb
  • nsh_sfc
  • one