CSIT/csit2005 plan

From fd.io
Jump to: navigation, search


Introduction

This page tracks release information for FD.io CSIT-2005. It is updated regularly by hand. Real-time information is available in FD.io CSIT code repository and auto-generated docs.

Release Milestones

Milestone Date Deliverables
F0 2020-05-06 Test case keywords code complete. Only low-risk changes accepted.
RC1 2020-05-13 (F0+7) Code complete. Pull first release branch. Only bug fixes accepted in release branch. Date aligned with VPP RC1. Start dry-runs to identify CSIT gaps on less frequently run tests.
RC2 2020-05-20 (RC1+7) Dry-run testing begins of VPP RC2, performance and functional. Date aligned with VPP RC2.
CSIT Release 2020-05-27 (RC2+7) CSIT release complete. VPP release testing starts. Date aligned with VPP Formal Release.
Report Publish 2020-06-10 (Rls+14) CSIT report published for VPP release.

Release Deliverables

Name Status Jira Category Description
VPP-DEV API coverages Done Device Added IPSEC interface and SRv6 vpp_device tests for better VPP API coverage, as those are executed per vpp patch and per csit patch.
CSIT in AWS Done Framework Enable ip4 and ipsec 3-Node tests in AWS on c5n instances.
CSIT in Azure WIP Framework Enable ip4 and ipsec 3-Node tests in Azure on xxx instances.
Perfmon Next Release Framework Per vpp node efficiency - today storing elog capturing thread barriers - for perfmon we are missing an API to catch two values for the run, we would need to check if this got resolved.
Per packet path telemetry Next Release Tools Start with a new telemetry approach - per packet path analysis, similarly how it's done in NFVbench, see how this could be applied to NFV density tests and actually all other tests.
Emails with regressions Done Presentation Trending regressions - add announce emails to csit-report.
More Arm testbeds for vpp_device WIP Device Testbeds - Arm - adding more ThunderX machines for vpp_device to run csit-vpp and vpp-csit device tests.
More vpp_device tests WIP Device Add more vpp_device tests for better VPP API coverage, as those are executed per vpp patch and per csit patch
Arm vpp_Device per VPP patch voting WIP CI process Productize per VPP patch (with voting?) vpp-csit device tests for Arm.
HostStack Tests Next Release Performance New Performance Tests - Iperf3+LDP with WRK, Nginx+VCL with WRK, Quic Transport

Jira Task Tracking

All CSIT release deliverables should be tracked in FDio CSIT Jira using one of the following Jira Epic categories:

Framework
CI process
Performance
Device
Methodology
Telemetry
Tools
Presentation
Honeycomb
Aarch64

Multi-Release Work Areas

Work Area Description

External Dependencies

  1. No known external dependencies.