Difference between revisions of "CSIT/csit1807 plan"
From fd.io
< CSIT
(→Release Deliverables) |
Mackonstan (Talk | contribs) |
||
| Line 24: | Line 24: | ||
|- | |- | ||
| New Xeon Skx testbeds | | New Xeon Skx testbeds | ||
| − | | | + | | Done |
| 1807-Framework | | 1807-Framework | ||
| On-boarding of new SM Skylake testbed infra to increase FD.io CSIT test lab capacity. | | On-boarding of new SM Skylake testbed infra to increase FD.io CSIT test lab capacity. | ||
|- | |- | ||
| 2-Node tests | | 2-Node tests | ||
| − | | | + | | Done |
| 1807-Test | | 1807-Test | ||
| Introduction of 2-Node topologies with new SM Skylake testbeds, alter subset of existing tests to run on 2-Node topologies. | | Introduction of 2-Node topologies with new SM Skylake testbeds, alter subset of existing tests to run on 2-Node topologies. | ||
| Line 39: | Line 39: | ||
|- | |- | ||
| VPP_Path | | VPP_Path | ||
| − | | | + | | Part Done |
| 1807-Framework | | 1807-Framework | ||
| − | | Implementation of new VPP-make_test VPP integration tests for functional acceptance of VPP feature path(s) driven by use case(s). | + | | Implementation of new VPP-make_test VPP integration tests for functional acceptance of VPP feature path(s) driven by use case(s). All VIRL P0 tests migrated to VPP_Path using VPP make test. |
|- | |- | ||
| Performance trending PAL evolution | | Performance trending PAL evolution | ||
| − | | | + | | Done |
| 1807-PAL | | 1807-PAL | ||
| − | | Performance trending jobs with MRR tests. | + | | Performance trending jobs with MRR tests, improved presentation layer, added improved anomaly detection. |
|- | |- | ||
| Performance change detection | | Performance change detection | ||
| Done | | Done | ||
| 1807-PAL | | 1807-PAL | ||
| − | | Change detection tunings. | + | | Change detection tunings, better trending and anomaly detection algos. |
|- | |- | ||
| Per VPP patch performance tests | | Per VPP patch performance tests | ||
| Line 59: | Line 59: | ||
|- | |- | ||
| K8s container extensions | | K8s container extensions | ||
| − | | | + | | WIP |
| 1807-Test | | 1807-Test | ||
| [https://jira.fd.io/browse/CSIT-1037 CSIT-1037] Adding more Pod and Memif topologies - targeting node-full tests with multiple service chains. | | [https://jira.fd.io/browse/CSIT-1037 CSIT-1037] Adding more Pod and Memif topologies - targeting node-full tests with multiple service chains. | ||
Revision as of 13:48, 25 July 2018
Please be aware that this page is work-in-progress and more info is being added continuously.
Contents
[hide]Introduction
All CSIT release deliverables should be tracked in FDio CSIT Jira .using one of the following Jira Epic categories:
Release Deliverables
| Name | Status | Jira Category | Description |
|---|---|---|---|
| New Xeon Skx testbeds | Done | 1807-Framework | On-boarding of new SM Skylake testbed infra to increase FD.io CSIT test lab capacity. |
| 2-Node tests | Done | 1807-Test | Introduction of 2-Node topologies with new SM Skylake testbeds, alter subset of existing tests to run on 2-Node topologies. |
| VPP_Device | WIP | 1807-Framework | Design and initial CI/CD implementation of new container based VPP integration tests for functional acceptance of VPP device driver interactions, running on 1-Node testbeds. |
| VPP_Path | Part Done | 1807-Framework | Implementation of new VPP-make_test VPP integration tests for functional acceptance of VPP feature path(s) driven by use case(s). All VIRL P0 tests migrated to VPP_Path using VPP make test. |
| Performance trending PAL evolution | Done | 1807-PAL | Performance trending jobs with MRR tests, improved presentation layer, added improved anomaly detection. |
| Performance change detection | Done | 1807-PAL | Change detection tunings, better trending and anomaly detection algos. |
| Per VPP patch performance tests | WIP | 1807-Framework | Per VPP patch vs. parent performance tests and voting (-1/0/+1). |
| K8s container extensions | WIP | 1807-Test | CSIT-1037 Adding more Pod and Memif topologies - targeting node-full tests with multiple service chains. |
| VPP TCP/IP stack | Open | 1807-Test | Blocked by T-Rex, HTTP and TCP/IP performance tests using TRex for CPS and RPS benchmarks. |
| Atom Netgate CPE | Open | 1807-Test | Specific tests to be defined. |
| Clock cycles per VPP node into CSIT-PAL | Open | 1807-PAL | Dependency on VPP API for "show run". Status tbc. |
| New DMM functional test scripts | WIP | 1807-Test | CSIT-1018 Functional tests of DMM host stack adapter library. |
Release Milestones
| rls1807 Milestone | Date | Deliverables |
|---|---|---|
| Code complete | 2018-07-23 | Test cases code frozen. Only bug fixes and low-risk changes accepted. Aligned with VPP RC2. |
| Branch pull | 2018-07-23 | Pull CSIT rls1807 throttle branch. Aligned with VPP RC2. Initial VPP RC2 performance tests. |
| CSIT Release | 2018-07-30 | CSIT rls1807 test code complete. VPP 18.07 rls testing. |
| CSIT Report | 2018-08-06 | CSIT rls1807 report to be published. |
