Difference between revisions of "CSIT/csit2005 plan"
From fd.io
< CSIT
(→Release Deliverables) |
Mackonstan (Talk | contribs) |
||
| (2 intermediate revisions by 2 users not shown) | |||
| Line 27: | Line 27: | ||
|- | |- | ||
| CSIT Release | | CSIT Release | ||
| − | | 2020- | + | | 2020-05-27 (RC2+7) |
| CSIT release complete. VPP release testing starts. Date aligned with [https://wiki.fd.io/view/Projects/vpp/Release_Plans/Release_Plan_20.05#Release_Milestones VPP Formal Release]. | | CSIT release complete. VPP release testing starts. Date aligned with [https://wiki.fd.io/view/Projects/vpp/Release_Plans/Release_Plan_20.05#Release_Milestones VPP Formal Release]. | ||
|- | |- | ||
| Report Publish | | Report Publish | ||
| − | | 2020-06- | + | | 2020-06-10 (Rls+14) |
| CSIT report published for VPP release. | | CSIT report published for VPP release. | ||
|} | |} | ||
| Line 46: | Line 46: | ||
| Done | | Done | ||
| Device | | Device | ||
| − | | | + | | Added IPSEC interface and SRv6 vpp_device tests for better VPP API coverage, as those are executed per vpp patch and per csit patch. |
| + | |- | ||
| + | | CSIT in AWS | ||
| + | | Done | ||
| + | | Framework | ||
| + | | Enable ip4 and ipsec 3-Node tests in AWS on c5n instances. | ||
| + | |- | ||
| + | | CSIT in Azure | ||
| + | | WIP | ||
| + | | Framework | ||
| + | | Enable ip4 and ipsec 3-Node tests in Azure on xxx instances. | ||
| + | |- | ||
| + | | Perfmon | ||
| + | | Next Release | ||
| + | | Framework | ||
| + | | Per vpp node efficiency - today storing elog capturing thread barriers - for perfmon we are missing an API to catch two values for the run, we would need to check if this got resolved. | ||
| + | |- | ||
| + | | Per packet path telemetry | ||
| + | | Next Release | ||
| + | | Tools | ||
| + | | Start with a new telemetry approach - per packet path analysis, similarly how it's done in NFVbench, see how this could be applied to NFV density tests and actually all other tests. | ||
| + | |- | ||
| + | | Emails with regressions | ||
| + | | Done | ||
| + | | Presentation | ||
| + | | Trending regressions - add announce emails to csit-report. | ||
| + | |- | ||
| + | | More Arm testbeds for vpp_device | ||
| + | | WIP | ||
| + | | Device | ||
| + | | Testbeds - Arm - adding more ThunderX machines for vpp_device to run csit-vpp and vpp-csit device tests. | ||
| + | |- | ||
| + | | More vpp_device tests | ||
| + | | WIP | ||
| + | | Device | ||
| + | | Add more vpp_device tests for better VPP API coverage, as those are executed per vpp patch and per csit patch | ||
| + | |- | ||
| + | | Arm vpp_Device per VPP patch voting | ||
| + | | WIP | ||
| + | | CI process | ||
| + | | Productize per VPP patch (with voting?) vpp-csit device tests for Arm. | ||
| + | |- | ||
| + | | HostStack Tests | ||
| + | | Next Release | ||
| + | | Performance | ||
| + | | New Performance Tests - Iperf3+LDP with WRK, Nginx+VCL with WRK, Quic Transport | ||
| + | |- | ||
|} | |} | ||
Latest revision as of 15:10, 27 May 2020
Contents
Introduction
This page tracks release information for FD.io CSIT-2005. It is updated regularly by hand. Real-time information is available in FD.io CSIT code repository and auto-generated docs.
Release Milestones
| Milestone | Date | Deliverables |
|---|---|---|
| F0 | 2020-05-06 | Test case keywords code complete. Only low-risk changes accepted. |
| RC1 | 2020-05-13 (F0+7) | Code complete. Pull first release branch. Only bug fixes accepted in release branch. Date aligned with VPP RC1. Start dry-runs to identify CSIT gaps on less frequently run tests. |
| RC2 | 2020-05-20 (RC1+7) | Dry-run testing begins of VPP RC2, performance and functional. Date aligned with VPP RC2. |
| CSIT Release | 2020-05-27 (RC2+7) | CSIT release complete. VPP release testing starts. Date aligned with VPP Formal Release. |
| Report Publish | 2020-06-10 (Rls+14) | CSIT report published for VPP release. |
Release Deliverables
| Name | Status | Jira Category | Description |
|---|---|---|---|
| VPP-DEV API coverages | Done | Device | Added IPSEC interface and SRv6 vpp_device tests for better VPP API coverage, as those are executed per vpp patch and per csit patch. |
| CSIT in AWS | Done | Framework | Enable ip4 and ipsec 3-Node tests in AWS on c5n instances. |
| CSIT in Azure | WIP | Framework | Enable ip4 and ipsec 3-Node tests in Azure on xxx instances. |
| Perfmon | Next Release | Framework | Per vpp node efficiency - today storing elog capturing thread barriers - for perfmon we are missing an API to catch two values for the run, we would need to check if this got resolved. |
| Per packet path telemetry | Next Release | Tools | Start with a new telemetry approach - per packet path analysis, similarly how it's done in NFVbench, see how this could be applied to NFV density tests and actually all other tests. |
| Emails with regressions | Done | Presentation | Trending regressions - add announce emails to csit-report. |
| More Arm testbeds for vpp_device | WIP | Device | Testbeds - Arm - adding more ThunderX machines for vpp_device to run csit-vpp and vpp-csit device tests. |
| More vpp_device tests | WIP | Device | Add more vpp_device tests for better VPP API coverage, as those are executed per vpp patch and per csit patch |
| Arm vpp_Device per VPP patch voting | WIP | CI process | Productize per VPP patch (with voting?) vpp-csit device tests for Arm. |
| HostStack Tests | Next Release | Performance | New Performance Tests - Iperf3+LDP with WRK, Nginx+VCL with WRK, Quic Transport |
Jira Task Tracking
All CSIT release deliverables should be tracked in FDio CSIT Jira using one of the following Jira Epic categories:
Framework CI process Performance Device Methodology Telemetry Tools Presentation Honeycomb Aarch64
Multi-Release Work Areas
| Work Area | Description |
|---|
External Dependencies
- No known external dependencies.
