Difference between revisions of "CSIT/csit2106 plan"

From fd.io
Jump to: navigation, search
(→‎Release Deliverables: Add JSON test outputs.)
Line 63: Line 63:
 
| New Test Suites
 
| New Test Suites
 
| Extend IPsec testcases with IPv6
 
| Extend IPsec testcases with IPv6
−
|-
 
−
| Autogen modularization
 
−
| Postponed to next release
 
−
| Refactor
 
−
| Simplify the way we can add new suite types, support generating multiple scales (tunnels) for ipsec tests.
 
 
|-
 
|-
 
| Export test outputs in JSON
 
| Export test outputs in JSON
Line 73: Line 68:
 
| New functionality for existing tests
 
| New functionality for existing tests
 
| XML processing is heavy, new processing using S3 queries need outputs in JSON files of a more stable layout.
 
| XML processing is heavy, new processing using S3 queries need outputs in JSON files of a more stable layout.
 +
|-
 +
| Ubuntu 20.04 LTS migration
 +
| Finalizing
 +
| Infra
 +
| OS migration including IaaC improvements.
 +
|-
 +
| CSIT in AWS
 +
| Done
 +
| Framework
 +
| Improve provisioning and framework compatibility with AWS environment.
 
|-|}
 
|-|}
  

Revision as of 10:23, 21 May 2021


Introduction

This page tracks release information for FD.io CSIT-2106. It is updated regularly by hand. Real-time information is available in FD.io CSIT code repository and auto-generated docs.

Release Milestones

Milestone Date Deliverables
F0 2021-05-19 Test case keywords code complete. Only low-risk changes accepted.
RC1 2021-05-26 (F0+7) Code complete. Pull first release branch. Only bug fixes, infra changes and framework optimizations are accepted in release branch. Date aligned with VPP RC1. Start dry-runs to identify CSIT gaps on less frequently run tests.
RC2 2021-06-16 (RC1+21) Dry-run testing begins of VPP RC2, performance and functional. Date aligned with VPP RC2.
CSIT Release 2021-06-30 (RC2+14) CSIT release complete. VPP release testing starts. Date aligned with VPP Formal Release. Only critical changes (as they usually require re-starting release testing) or changes not affecting results (such as documentation improvements) are accepted in release branch. Release testing also includes testing previous VPP version with new CSIT code, needed for comparison tables.
Report Publish 2021-07-14 (Rls+14) CSIT report published for VPP release. On master branch, start replacing (or dropping support for) APIs deprecated in the newly released VPP version (as we do not need to run the previous VPP version with newest CSIT code from now on).

Release Deliverables

Jira Task Tracking

All CSIT release deliverables should be tracked in FDio CSIT Jira using one of the following Jira Epic categories: 

Framework
CI process
Performance
Device
Methodology
Telemetry
Tools
Presentation
Aarch64

Multi-Release Work Areas

Name Status Jira Category Description
Hoststack Perf In Progress New Test Suites Iperf3 UDP throughput tests
Hoststack Perf (VSAP) In Progress New Test Suites Nginx LDPreload RCS & CPS tests
Policy IPsec with more SPD rules In Progress New Test Suites Extend the current policy tests with policy tests with more SPD rules - use only the nth rule with just IPv4 forwarding
IPv6 IPsec Waiting New Test Suites Extend IPsec testcases with IPv6
Export test outputs in JSON In progress New functionality for existing tests XML processing is heavy, new processing using S3 queries need outputs in JSON files of a more stable layout.
Ubuntu 20.04 LTS migration Finalizing Infra OS migration including IaaC improvements.
CSIT in AWS Done Framework Improve provisioning and framework compatibility with AWS environment.
Work Area Description

External Dependencies

  1. No known external dependencies.
Retrieved from "https://wiki.fd.io/index.php?title=CSIT/csit2106_plan&oldid=11262"