Difference between revisions of "CSIT/csit1804 plan"
From fd.io
< CSIT
(→Release Deliverables) |
Mackonstan (Talk | contribs) |
||
| (12 intermediate revisions by 4 users not shown) | |||
| Line 8: | Line 8: | ||
All CSIT release deliverables should be tracked in FDio CSIT Jira .using one of the following Jira Epic categories: | All CSIT release deliverables should be tracked in FDio CSIT Jira .using one of the following Jira Epic categories: | ||
| − | # .. | + | # [VIRL]https://jira.fd.io/browse/CSIT-929 |
| + | # [HoneyComb]https://jira.fd.io/browse/CSIT-930 | ||
| + | # [Test]https://jira.fd.io/browse/CSIT-931 | ||
| + | # [Optimizations]https://jira.fd.io/browse/CSIT-932 | ||
| + | # [Operations]https://jira.fd.io/browse/CSIT-933 | ||
| + | # [PAL]https://jira.fd.io/browse/CSIT-934 | ||
| + | # [DMM]https://jira.fd.io/browse/CSIT-1018 | ||
== Release Deliverables == | == Release Deliverables == | ||
| Line 19: | Line 25: | ||
|- | |- | ||
| SRv6 performance | | SRv6 performance | ||
| − | | | + | | Done |
| 1804-Test | | 1804-Test | ||
| − | | SRv6 performance - additional SRv6 performance tests focusing on service chainging. | + | | SRv6 performance - additional SRv6 performance tests focusing on service chainging [https://jira.fd.io/browse/CSIT-1009 CSIT-1009]: End.AS, End.AD and End.AM behaviours. |
|- | |- | ||
| K8s container extensions | | K8s container extensions | ||
| − | | | + | | rls1807 |
| 1804-Test | | 1804-Test | ||
| − | | Adding more Pod and Memif topologies - targeting node-full tests with multiple service chains. | + | | [https://jira.fd.io/browse/CSIT-1037 CSIT-1037] Adding more Pod and Memif topologies - targeting node-full tests with multiple service chains. |
|- | |- | ||
| VPP TCP/IP stack | | VPP TCP/IP stack | ||
| − | | | + | | OnHold |
| 1804-Test | | 1804-Test | ||
| − | | HTTP and TCP/IP performance tests using TRex for CPS and RPS benchmarks. | + | | Blocked by T-Rex, HTTP and TCP/IP performance tests using TRex for CPS and RPS benchmarks. |
|- | |- | ||
| Netgate CPE | | Netgate CPE | ||
| − | | | + | | rls1807 |
| 1804-Test | | 1804-Test | ||
| Specific tests to be defined. | | Specific tests to be defined. | ||
|- | |- | ||
| Clock cycles per VPP node into CSIT-PAL | | Clock cycles per VPP node into CSIT-PAL | ||
| − | | | + | | rls1807 |
| 1804-PAL | | 1804-PAL | ||
| Dependency on VPP API for "show run". Status tbc. | | Dependency on VPP API for "show run". Status tbc. | ||
|- | |- | ||
| New performance trending | | New performance trending | ||
| − | | | + | | Done |
| 1804-Test | | 1804-Test | ||
| − | | Performance trending jobs with new MRR and optimized NDR/PDR search tests | + | | [https://jira.fd.io/browse/CSIT-913 CSIT-913] Performance trending jobs with new MRR and optimized NDR/PDR search tests |
|- | |- | ||
| New vpp-csit perf jobs | | New vpp-csit perf jobs | ||
| − | | | + | | Done |
| 1804-Test | | 1804-Test | ||
| − | | New MRR-based vpp-csit perf jobs with execution per patch. | + | | [https://jira.fd.io/browse/CSIT-941 CSIT-941], [https://jira.fd.io/browse/CSIT-919 CSIT-919] New MRR-based vpp-csit perf jobs with execution per patch. |
|- | |- | ||
| Automated performance analysis with anomaly detection | | Automated performance analysis with anomaly detection | ||
| − | | | + | | Done |
| 1804-PAL | | 1804-PAL | ||
| − | | Performance analysis, regression and progression detection. | + | | [https://jira.fd.io/browse/CSIT-942 CSIT-942], [https://jira.fd.io/browse/CSIT-943 CSIT-943], [https://jira.fd.io/browse/CSIT-945 CSIT-945]Performance analysis, regression and progression detection. |
|- | |- | ||
| Centos7 VIRL tests | | Centos7 VIRL tests | ||
| − | | | + | | Done |
| − | | | + | | 1804-Test |
| [https://jira.fd.io/browse/CSIT-602 CSIT-602] Complete productization of Centos7 VPP tests for all VPP functional tests in FD.io CSIT VIRL infra. | | [https://jira.fd.io/browse/CSIT-602 CSIT-602] Complete productization of Centos7 VPP tests for all VPP functional tests in FD.io CSIT VIRL infra. | ||
| + | |- | ||
| + | | New DMM functional test scripts | ||
| + | | rls1807 | ||
| + | | 1804-Test | ||
| + | | [https://jira.fd.io/browse/CSIT-1018 CSIT-1018] Functional tests of DMM host stack adapter library. | ||
|} | |} | ||
| Line 86: | Line 97: | ||
|- | |- | ||
| CSIT Report | | CSIT Report | ||
| − | | 2018-05- | + | | 2018-05-04 |
| − | | CSIT rls1804 report published. | + | | CSIT rls1804 report to be published. Moved from 2018-05-02 due to longer performance test cycle and test data collection. |
|} | |} | ||
== Expected Dependencies on Other Projects == | == Expected Dependencies on Other Projects == | ||
Latest revision as of 16:34, 3 May 2018
Please be aware that this page is work-in-progress and more info is being added continuously.
Contents
Introduction
All CSIT release deliverables should be tracked in FDio CSIT Jira .using one of the following Jira Epic categories:
- [VIRL]https://jira.fd.io/browse/CSIT-929
- [HoneyComb]https://jira.fd.io/browse/CSIT-930
- [Test]https://jira.fd.io/browse/CSIT-931
- [Optimizations]https://jira.fd.io/browse/CSIT-932
- [Operations]https://jira.fd.io/browse/CSIT-933
- [PAL]https://jira.fd.io/browse/CSIT-934
- [DMM]https://jira.fd.io/browse/CSIT-1018
Release Deliverables
| Name | Status | Jira Category | Description |
|---|---|---|---|
| SRv6 performance | Done | 1804-Test | SRv6 performance - additional SRv6 performance tests focusing on service chainging CSIT-1009: End.AS, End.AD and End.AM behaviours. |
| K8s container extensions | rls1807 | 1804-Test | CSIT-1037 Adding more Pod and Memif topologies - targeting node-full tests with multiple service chains. |
| VPP TCP/IP stack | OnHold | 1804-Test | Blocked by T-Rex, HTTP and TCP/IP performance tests using TRex for CPS and RPS benchmarks. |
| Netgate CPE | rls1807 | 1804-Test | Specific tests to be defined. |
| Clock cycles per VPP node into CSIT-PAL | rls1807 | 1804-PAL | Dependency on VPP API for "show run". Status tbc. |
| New performance trending | Done | 1804-Test | CSIT-913 Performance trending jobs with new MRR and optimized NDR/PDR search tests |
| New vpp-csit perf jobs | Done | 1804-Test | CSIT-941, CSIT-919 New MRR-based vpp-csit perf jobs with execution per patch. |
| Automated performance analysis with anomaly detection | Done | 1804-PAL | CSIT-942, CSIT-943, CSIT-945Performance analysis, regression and progression detection. |
| Centos7 VIRL tests | Done | 1804-Test | CSIT-602 Complete productization of Centos7 VPP tests for all VPP functional tests in FD.io CSIT VIRL infra. |
| New DMM functional test scripts | rls1807 | 1804-Test | CSIT-1018 Functional tests of DMM host stack adapter library. |
Release Milestones
| rls1804 Milestone | Date | Deliverables |
|---|---|---|
| Code complete | 2018-04-11 | Test cases code frozen. Only bug fixes and low-risk changes accepted. Aligned with VPP RC2. |
| Branch pull | 2018-04-11 | Pull CSIT rls1804 throttle branch. Aligned with VPP RC2. Initial VPP RC2 performance tests. |
| CSIT Release | 2018-04-18 | CSIT rls1804 test code complete. VPP1801 rls testing. |
| CSIT Report | 2018-05-04 | CSIT rls1804 report to be published. Moved from 2018-05-02 due to longer performance test cycle and test data collection. |
