Difference between revisions of "CSIT/csit2106 plan"
From fd.io
< CSIT
(First writeup, improves Milestones description (cherry-picking, testing previous VPP for comparison tables, API deprecation).) |
|||
| (15 intermediate revisions by 5 users not shown) | |||
| Line 15: | Line 15: | ||
|- | |- | ||
| F0 | | F0 | ||
| − | | | + | | 2021-05-19 |
| Test case keywords code complete. Only low-risk changes accepted. | | Test case keywords code complete. Only low-risk changes accepted. | ||
|- | |- | ||
| RC1 | | RC1 | ||
| − | | | + | | 2021-05-26 (F0+7) |
| Code complete. Pull first release branch. Only bug fixes, infra changes and framework optimizations are accepted in release branch. Date aligned with [https://wiki.fd.io/view/Projects/vpp/Release_Plans/Release_Plan_21.06#Release_Milestones VPP RC1]. Start dry-runs to identify CSIT gaps on less frequently run tests. | | Code complete. Pull first release branch. Only bug fixes, infra changes and framework optimizations are accepted in release branch. Date aligned with [https://wiki.fd.io/view/Projects/vpp/Release_Plans/Release_Plan_21.06#Release_Milestones VPP RC1]. Start dry-runs to identify CSIT gaps on less frequently run tests. | ||
|- | |- | ||
| RC2 | | RC2 | ||
| − | | | + | | 2021-06-16 (RC1+21) |
| Dry-run testing begins of VPP RC2, performance and functional. Date aligned with [https://wiki.fd.io/view/Projects/vpp/Release_Plans/Release_Plan_21.06#Release_Milestones VPP RC2]. | | Dry-run testing begins of VPP RC2, performance and functional. Date aligned with [https://wiki.fd.io/view/Projects/vpp/Release_Plans/Release_Plan_21.06#Release_Milestones VPP RC2]. | ||
|- | |- | ||
| CSIT Release | | CSIT Release | ||
| − | | | + | | 2021-06-30 (RC2+14) |
| CSIT release complete. VPP release testing starts. Date aligned with [https://wiki.fd.io/view/Projects/vpp/Release_Plans/Release_Plan_21.06#Release_Milestones VPP Formal Release]. Only critical changes (as they usually require re-starting release testing) or changes not affecting results (such as documentation improvements) are accepted in release branch. Release testing also includes testing previous VPP version with new CSIT code, needed for comparison tables. | | CSIT release complete. VPP release testing starts. Date aligned with [https://wiki.fd.io/view/Projects/vpp/Release_Plans/Release_Plan_21.06#Release_Milestones VPP Formal Release]. Only critical changes (as they usually require re-starting release testing) or changes not affecting results (such as documentation improvements) are accepted in release branch. Release testing also includes testing previous VPP version with new CSIT code, needed for comparison tables. | ||
|- | |- | ||
| Report Publish | | Report Publish | ||
| − | | 2021- | + | | 2021-07-14 (Rls+14) |
| − | | CSIT report published for VPP release. On master branch, start replacing (or dropping support for) APIs deprecated in the | + | | CSIT report published for VPP release. On master branch, start replacing (or dropping support for) APIs deprecated in the newly released VPP version (as we do not need to run the previous VPP version with newest CSIT code from now on). |
|- | |- | ||
|} | |} | ||
| Line 43: | Line 43: | ||
! Jira Category | ! Jira Category | ||
! Description | ! Description | ||
| + | |- | ||
| + | | Hoststack Perf | ||
| + | | Done | ||
| + | | New Test Suites | ||
| + | | Iperf3 UDP throughput tests | ||
| + | |- | ||
| + | | Hoststack Perf (VSAP) | ||
| + | | Done | ||
| + | | New Test Suites | ||
| + | | Nginx LDPreload RCS & CPS tests | ||
| + | |- | ||
| + | | Policy IPsec with more SPD rules | ||
| + | | In Review | ||
| + | | New Test Suites | ||
| + | | Extend the current policy tests with policy tests with more SPD rules - use only the nth rule with just IPv4 forwarding | ||
| + | |- | ||
| + | | IPv6 IPsec | ||
| + | | Moved to 2111 | ||
| + | | New Test Suites | ||
| + | | Extend IPsec testcases with IPv6 | ||
| + | |- | ||
| + | | Export test outputs in JSON | ||
| + | | In progress | ||
| + | | New functionality for existing tests | ||
| + | | XML processing is heavy, new processing using S3 queries need outputs in JSON files of a more stable layout. | ||
| + | |- | ||
| + | | Ubuntu 20.04 LTS migration | ||
| + | | Done | ||
| + | | Infra | ||
| + | | OS migration including IaaC improvements. | ||
| + | |- | ||
| + | | CSIT in AWS | ||
| + | | Done | ||
| + | | Framework | ||
| + | | Improve provisioning and framework compatibility with AWS environment. | ||
| + | |- | ||
| + | | AF_XDP driver testing | ||
| + | | Done | ||
| + | | New Test Suites | ||
| + | | Introducing AF_XDP performance tests. | ||
|- | |- | ||
|} | |} | ||
| Line 58: | Line 98: | ||
[https://jira.fd.io/browse/CSIT-1529 Tools] | [https://jira.fd.io/browse/CSIT-1529 Tools] | ||
[https://jira.fd.io/browse/CSIT-1527 Presentation] | [https://jira.fd.io/browse/CSIT-1527 Presentation] | ||
| − | |||
[https://jira.fd.io/browse/CSIT-1050 Aarch64] | [https://jira.fd.io/browse/CSIT-1050 Aarch64] | ||
Latest revision as of 07:00, 20 August 2021
Contents
Introduction
This page tracks release information for FD.io CSIT-2106. It is updated regularly by hand. Real-time information is available in FD.io CSIT code repository and auto-generated docs.
Release Milestones
| Milestone | Date | Deliverables |
|---|---|---|
| F0 | 2021-05-19 | Test case keywords code complete. Only low-risk changes accepted. |
| RC1 | 2021-05-26 (F0+7) | Code complete. Pull first release branch. Only bug fixes, infra changes and framework optimizations are accepted in release branch. Date aligned with VPP RC1. Start dry-runs to identify CSIT gaps on less frequently run tests. |
| RC2 | 2021-06-16 (RC1+21) | Dry-run testing begins of VPP RC2, performance and functional. Date aligned with VPP RC2. |
| CSIT Release | 2021-06-30 (RC2+14) | CSIT release complete. VPP release testing starts. Date aligned with VPP Formal Release. Only critical changes (as they usually require re-starting release testing) or changes not affecting results (such as documentation improvements) are accepted in release branch. Release testing also includes testing previous VPP version with new CSIT code, needed for comparison tables. |
| Report Publish | 2021-07-14 (Rls+14) | CSIT report published for VPP release. On master branch, start replacing (or dropping support for) APIs deprecated in the newly released VPP version (as we do not need to run the previous VPP version with newest CSIT code from now on). |
Release Deliverables
| Name | Status | Jira Category | Description |
|---|---|---|---|
| Hoststack Perf | Done | New Test Suites | Iperf3 UDP throughput tests |
| Hoststack Perf (VSAP) | Done | New Test Suites | Nginx LDPreload RCS & CPS tests |
| Policy IPsec with more SPD rules | In Review | New Test Suites | Extend the current policy tests with policy tests with more SPD rules - use only the nth rule with just IPv4 forwarding |
| IPv6 IPsec | Moved to 2111 | New Test Suites | Extend IPsec testcases with IPv6 |
| Export test outputs in JSON | In progress | New functionality for existing tests | XML processing is heavy, new processing using S3 queries need outputs in JSON files of a more stable layout. |
| Ubuntu 20.04 LTS migration | Done | Infra | OS migration including IaaC improvements. |
| CSIT in AWS | Done | Framework | Improve provisioning and framework compatibility with AWS environment. |
| AF_XDP driver testing | Done | New Test Suites | Introducing AF_XDP performance tests. |
Jira Task Tracking
All CSIT release deliverables should be tracked in FDio CSIT Jira using one of the following Jira Epic categories:
Framework CI process Performance Device Methodology Telemetry Tools Presentation Aarch64
Multi-Release Work Areas
| Work Area | Description |
|---|
External Dependencies
- No known external dependencies.
