Difference between revisions of "CSIT/csit2005 plan"
From fd.io
< CSIT
Mackonstan (Talk | contribs) |
Dwallacelf (Talk | contribs) (→Release Deliverables) |
||
| Line 89: | Line 89: | ||
|- | |- | ||
| HostStack Tests | | HostStack Tests | ||
| − | | | + | | Next Release |
| Performance | | Performance | ||
| New Performance Tests - Iperf3+LDP with WRK, Nginx+VCL with WRK, Quic Transport | | New Performance Tests - Iperf3+LDP with WRK, Nginx+VCL with WRK, Quic Transport | ||
Revision as of 14:29, 20 May 2020
Contents
Introduction
This page tracks release information for FD.io CSIT-2005. It is updated regularly by hand. Real-time information is available in FD.io CSIT code repository and auto-generated docs.
Release Milestones
| Milestone | Date | Deliverables |
|---|---|---|
| F0 | 2020-05-06 | Test case keywords code complete. Only low-risk changes accepted. |
| RC1 | 2020-05-13 (F0+7) | Code complete. Pull first release branch. Only bug fixes accepted in release branch. Date aligned with VPP RC1. Start dry-runs to identify CSIT gaps on less frequently run tests. |
| RC2 | 2020-05-20 (RC1+7) | Dry-run testing begins of VPP RC2, performance and functional. Date aligned with VPP RC2. |
| CSIT Release | 2020-06-03 (RC2+7) | CSIT release complete. VPP release testing starts. Date aligned with VPP Formal Release. |
| Report Publish | 2020-06-17 (Rls+14) | CSIT report published for VPP release. |
Release Deliverables
| Name | Status | Jira Category | Description |
|---|---|---|---|
| VPP-DEV API coverages | Done | Device | Added IPSEC interface and SRv6 vpp_device tests for better VPP API coverage, as those are executed per vpp patch and per csit patch. |
| CSIT in AWS | Done | Framework | Enable ip4 and ipsec 3-Node tests in AWS on c5n instances. |
| CSIT in Azure | WIP | Framework | Enable ip4 and ipsec 3-Node tests in Azure on xxx instances. |
| Perfmon | Next Release | Framework | Per vpp node efficiency - today storing elog capturing thread barriers - for perfmon we are missing an API to catch two values for the run, we would need to check if this got resolved. |
| Per packet path telemetry | Next Release | Tools | Start with a new telemetry approach - per packet path analysis, similarly how it's done in NFVbench, see how this could be applied to NFV density tests and actually all other tests. |
| Emails with regressions | Done | Presentation | Trending regressions - add announce emails to csit-report. |
| More Arm testbeds for vpp_device | WIP | Device | Testbeds - Arm - adding more ThunderX machines for vpp_device to run csit-vpp and vpp-csit device tests. |
| More vpp_device tests | WIP | Device | Add more vpp_device tests for better VPP API coverage, as those are executed per vpp patch and per csit patch |
| Arm vpp_Device per VPP patch voting | WIP | CI process | Productize per VPP patch (with voting?) vpp-csit device tests for Arm. |
| HostStack Tests | Next Release | Performance | New Performance Tests - Iperf3+LDP with WRK, Nginx+VCL with WRK, Quic Transport |
Jira Task Tracking
All CSIT release deliverables should be tracked in FDio CSIT Jira using one of the following Jira Epic categories:
Framework CI process Performance Device Methodology Telemetry Tools Presentation Honeycomb Aarch64
Multi-Release Work Areas
| Work Area | Description |
|---|
External Dependencies
- No known external dependencies.
