Difference between revisions of "CSIT/csit1807 plan"

From fd.io
Jump to: navigation, search
(Created page with "Category:Release Plan '''<span style="color: red">Please be aware that this page is work-in-progress and more info is being added continuously.</span>''' == Introduction...")
 
 
(9 intermediate revisions by 2 users not shown)
Line 7: Line 7:
 
All CSIT release deliverables should be tracked in FDio CSIT Jira .using one of the following Jira Epic categories:
 
All CSIT release deliverables should be tracked in FDio CSIT Jira .using one of the following Jira Epic categories:
  
−
# [https://jira.fd.io/browse/CSIT-932 Infrastructure]
+
# [https://jira.fd.io/browse/CSIT-932 CSIT-CPL Framework]
 
# [https://jira.fd.io/browse/CSIT-933 Operations]
 
# [https://jira.fd.io/browse/CSIT-933 Operations]
 
# [https://jira.fd.io/browse/CSIT-931 Test]
 
# [https://jira.fd.io/browse/CSIT-931 Test]
Line 22: Line 22:
 
! Jira Category
 
! Jira Category
 
! Description
 
! Description
 +
|-
 +
| New Xeon Skx testbeds
 +
| Done
 +
| 1807-Framework
 +
| On-boarding of new SM Skylake testbed infra to increase FD.io CSIT test lab capacity.
 +
|-
 +
| 2-Node tests
 +
| Done
 +
| 1807-Test
 +
| Introduction of 2-Node topologies with new SM Skylake testbeds, alter subset of existing tests to run on 2-Node topologies.
 +
|-
 +
| VPP_Device
 +
| Next rls
 +
| 1807-Framework
 +
| Design and initial CI/CD implementation of new container based VPP integration tests for functional acceptance of VPP device driver interactions, running on 1-Node testbeds.
 +
|-
 +
| VPP_Path
 +
| Part Done
 +
| 1807-Framework
 +
| Implementation of new VPP-make_test VPP integration tests for functional acceptance of VPP feature path(s) driven by use case(s). All VIRL P0 tests migrated to VPP_Path using VPP make test.
 +
|-
 +
| Performance trending PAL evolution
 +
| Done
 +
| 1807-PAL
 +
| Performance trending jobs with MRR tests, improved presentation layer, added improved anomaly detection.
 +
|-
 +
| Performance change detection
 +
| Done
 +
| 1807-PAL
 +
| Change detection tunings, better trending and anomaly detection algos.
 +
|-
 +
| Per VPP patch performance tests
 +
| Next rls
 +
| 1807-Framework
 +
| Per VPP patch vs. parent performance tests and voting (-1/0/+1).
 
|-
 
|-
 
| K8s container extensions
 
| K8s container extensions
−
| Open
+
| Next rls
 
| 1807-Test
 
| 1807-Test
 
| [https://jira.fd.io/browse/CSIT-1037 CSIT-1037] Adding more Pod and Memif topologies - targeting node-full tests with multiple service chains.
 
| [https://jira.fd.io/browse/CSIT-1037 CSIT-1037] Adding more Pod and Memif topologies - targeting node-full tests with multiple service chains.
 
|-
 
|-
 
| VPP TCP/IP stack
 
| VPP TCP/IP stack
−
| Open
+
| Next rls
 
| 1807-Test
 
| 1807-Test
 
| Blocked by T-Rex, HTTP and TCP/IP performance tests using TRex for CPS and RPS benchmarks.
 
| Blocked by T-Rex, HTTP and TCP/IP performance tests using TRex for CPS and RPS benchmarks.
 
|-
 
|-
−
| ATOM Netgate CPE
+
| Atom Netgate CPE
−
| Open
+
| Next rls
 
| 1807-Test
 
| 1807-Test
 
| Specific tests to be defined.
 
| Specific tests to be defined.
 
|-
 
|-
 
| Clock cycles per VPP node into CSIT-PAL
 
| Clock cycles per VPP node into CSIT-PAL
−
| Open
+
| Next rls
 
| 1807-PAL
 
| 1807-PAL
 
| Dependency on VPP API for "show run". Status tbc.
 
| Dependency on VPP API for "show run". Status tbc.
−
|-
 
−
| Performance trending and analysis tunings
 
−
| Open
 
−
| 1807-Test
 
−
| [https://jira.fd.io/browse/CSIT-913 CSIT-913] Performance trending jobs with new MRR and optimized NDR/PDR search tests
 
 
|-
 
|-
 
| New DMM functional test scripts
 
| New DMM functional test scripts
−
| Open
+
| Done
 
| 1807-Test
 
| 1807-Test
 
| [https://jira.fd.io/browse/CSIT-1018 CSIT-1018] Functional tests of DMM host stack adapter library.
 
| [https://jira.fd.io/browse/CSIT-1018 CSIT-1018] Functional tests of DMM host stack adapter library.
Line 64: Line 94:
 
|-
 
|-
 
| Code complete
 
| Code complete
−
| 2018-07-xx
+
| 2018-07-23
 
| Test cases code frozen. Only bug fixes and low-risk changes accepted. Aligned with VPP RC2.
 
| Test cases code frozen. Only bug fixes and low-risk changes accepted. Aligned with VPP RC2.
 
|-
 
|-
 
| Branch pull
 
| Branch pull
−
| 2018-07-xx
+
| 2018-07-23
 
| Pull CSIT rls1807 throttle branch. Aligned with VPP RC2. Initial VPP RC2 performance tests.
 
| Pull CSIT rls1807 throttle branch. Aligned with VPP RC2. Initial VPP RC2 performance tests.
 
|-
 
|-
 
| CSIT Release
 
| CSIT Release
−
| 2018-07-xx
+
| 2018-07-30
−
| CSIT rls1807 test code complete. VPP1801 rls testing.
+
| CSIT rls1807 test code complete. VPP 18.07 rls testing.
 
|-
 
|-
 
| CSIT Report
 
| CSIT Report
−
| 2018-07-xx
+
| 2018-08-06
 
| CSIT rls1807 report to be published.
 
| CSIT rls1807 report to be published.
 
|}
 
|}
  
 
== Expected Dependencies on Other Projects ==
 
== Expected Dependencies on Other Projects ==

Latest revision as of 13:56, 22 August 2018


Please be aware that this page is work-in-progress and more info is being added continuously.

Introduction

All CSIT release deliverables should be tracked in FDio CSIT Jira .using one of the following Jira Epic categories:

  1. CSIT-CPL Framework
  2. Operations
  3. Test
  4. PAL
  5. VIRL
  6. HoneyComb
  7. DMM

Release Deliverables

Name Status Jira Category Description
New Xeon Skx testbeds Done 1807-Framework On-boarding of new SM Skylake testbed infra to increase FD.io CSIT test lab capacity.
2-Node tests Done 1807-Test Introduction of 2-Node topologies with new SM Skylake testbeds, alter subset of existing tests to run on 2-Node topologies.
VPP_Device Next rls 1807-Framework Design and initial CI/CD implementation of new container based VPP integration tests for functional acceptance of VPP device driver interactions, running on 1-Node testbeds.
VPP_Path Part Done 1807-Framework Implementation of new VPP-make_test VPP integration tests for functional acceptance of VPP feature path(s) driven by use case(s). All VIRL P0 tests migrated to VPP_Path using VPP make test.
Performance trending PAL evolution Done 1807-PAL Performance trending jobs with MRR tests, improved presentation layer, added improved anomaly detection.
Performance change detection Done 1807-PAL Change detection tunings, better trending and anomaly detection algos.
Per VPP patch performance tests Next rls 1807-Framework Per VPP patch vs. parent performance tests and voting (-1/0/+1).
K8s container extensions Next rls 1807-Test CSIT-1037 Adding more Pod and Memif topologies - targeting node-full tests with multiple service chains.
VPP TCP/IP stack Next rls 1807-Test Blocked by T-Rex, HTTP and TCP/IP performance tests using TRex for CPS and RPS benchmarks.
Atom Netgate CPE Next rls 1807-Test Specific tests to be defined.
Clock cycles per VPP node into CSIT-PAL Next rls 1807-PAL Dependency on VPP API for "show run". Status tbc.
New DMM functional test scripts Done 1807-Test CSIT-1018 Functional tests of DMM host stack adapter library.

Release Milestones

rls1807 Milestone Date Deliverables
Code complete 2018-07-23 Test cases code frozen. Only bug fixes and low-risk changes accepted. Aligned with VPP RC2.
Branch pull 2018-07-23 Pull CSIT rls1807 throttle branch. Aligned with VPP RC2. Initial VPP RC2 performance tests.
CSIT Release 2018-07-30 CSIT rls1807 test code complete. VPP 18.07 rls testing.
CSIT Report 2018-08-06 CSIT rls1807 report to be published.

Expected Dependencies on Other Projects

Retrieved from "https://wiki.fd.io/index.php?title=CSIT/csit1807_plan&oldid=8274"