Difference between revisions of "CSIT/csit1701 plan"

From fd.io
Jump to: navigation, search
 
Line 6: Line 6:
 
{|class="wikitable"
 
{|class="wikitable"
 
! Name
 
! Name
 +
! Status
 
! Test Category
 
! Test Category
 
! Description
 
! Description
 
|-
 
|-
| More NICs
+
| More NIC models
 +
| OK
 
| csit-perf
 
| csit-perf
| Adding x710, xl710, vic1385, vic1227.
+
| Added x710, xl710, vic1385, vic1227.
 
|-
 
|-
 
| vhost tests
 
| vhost tests
| csit-perf: Optimized qemu vhost environment, vhost test coverage per vhost use cases review
+
| OK
 +
| csit-perf
 +
| Optimized qemu vhost environment, vhost test coverage per vhost use cases review. Added more vhost use cases: vlan-l2bd-vhost, vxlan-l2bd-vhost.
 
|-
 
|-
 
| DPDK CryptoDev
 
| DPDK CryptoDev
 +
| TBC
 
| csit-func
 
| csit-func
| IPSec using DPDK CryptoDev - VIRL-based functional tests
+
| IPSec using DPDK CryptoDev - VIRL-based functional tests; tests are in CSIT, but need updates to VPP image; subject to addressing VPP image build dependencies on external crypto libraries that are in turn subject to export restrictions.
 
|-
 
|-
 
| DPDK CryptoDev
 
| DPDK CryptoDev
 +
| WIP
 
| csit-perf
 
| csit-perf
| IPSec using DPDK CryptoDev - both SW and HW (Intel QAT) performance tests
+
| IPSec using DPDK CryptoDev - performance tests with Intel QAT PCIe cards present in FD.io CPL testbed (used by CSIT), require vpp code change to enable cryptodev driver for these cards without relying on external libraries - this is work-in-progress by cryptodev vpp-dev team following the VPP project call on 17-Jan-2017. Performance tests in SW mode are subject to the resolution of VPP image build dependencies on external crypto libraries, similar as for csit-func VIRL tests. Most likely test results will be published in the addendum to csit1701 report.
 
|-
 
|-
 
| SNAT44
 
| SNAT44
| make-test
+
| OK
| New NAT44 code functional tests
+
| vpp-make-test
 +
| New NAT44 code functional tests using vpp make test infrastructure, run as part of vpp make verify jobs.
 
|-
 
|-
| SNAT44?
+
| SNAT44
 +
| WIP
 
| csit-perf
 
| csit-perf
| Single thread and multi-thread performance tests
+
| Single thread and multi-thread performance tests; the manual tests are completed, but automated CSIT version is not complete yet. Most likely test results will be published in the addendum to csit1701 report.
 
|-
 
|-
| DPDK16.11 standalone?
+
| DPDK16.11 testpmd
 +
| OK
 
| csit-perf
 
| csit-perf
| Standalone DPDK tests for baseline NIC-to-NIC performance
+
| Standalone DPDK tests for baseline NIC-to-NIC performance. x520 NIC tests are completed. Other NICs are WIP. Most likely complete NIC list test results will be published in the addendum to csit1701 report.
 
|-
 
|-
| TLDK?
+
| TLDK
 +
| TBC
 
| csit-perf
 
| csit-perf
| TLDK performance tests
+
| TLDK performance tests. csit1701 status is unknown at this stage.
 
|-
 
|-
 
| Doc generation
 
| Doc generation
 +
| OK
 
| csit-func, csit-perf, make-test
 
| csit-func, csit-perf, make-test
| spinx rtd docs generation for all test cases
+
| spinx rtd docs generation for all test cases - will be stored on nexus.fd.io, and reachable for reading on docs.fd.io.
 +
|-
 +
| SPAN
 +
| OK
 +
| vpp-make-test
 +
| SPAN functional tests using vpp make test infrastructure, run as part of vpp make verify jobs.
 
|-
 
|-
| SPAN?
+
| SPAN
 +
| TBC
 
| csit-func
 
| csit-func
| SPAN functional tests
+
| SPAN functional tests using csit VIRL test infrastructure; currently tests failing due to CSIT TC bugs.
 
|-
 
|-
| IPFIX?
+
| IPFIX
 +
| TBC
 
| csit-func
 
| csit-func
| IPFIX netflow functional tests
+
| IPFIX netflow functional tests; IPFIX IPv4 tests are passing; two IPFIX IPv6 tests are failing due to CSIT TC bugs.
 
|-
 
|-
 
| Centos tests
 
| Centos tests
 +
| TBC
 
| csit-func
 
| csit-func
| Functional VPP on Centos tests in VIRL testbeds environment
+
| Functional VPP on Centos tests in VIRL testbeds environment; status to be confirmed.
 
|}
 
|}
  

Latest revision as of 13:32, 18 January 2017

Introduction

Release Deliverables

Name Status Test Category Description
More NIC models OK csit-perf Added x710, xl710, vic1385, vic1227.
vhost tests OK csit-perf Optimized qemu vhost environment, vhost test coverage per vhost use cases review. Added more vhost use cases: vlan-l2bd-vhost, vxlan-l2bd-vhost.
DPDK CryptoDev TBC csit-func IPSec using DPDK CryptoDev - VIRL-based functional tests; tests are in CSIT, but need updates to VPP image; subject to addressing VPP image build dependencies on external crypto libraries that are in turn subject to export restrictions.
DPDK CryptoDev WIP csit-perf IPSec using DPDK CryptoDev - performance tests with Intel QAT PCIe cards present in FD.io CPL testbed (used by CSIT), require vpp code change to enable cryptodev driver for these cards without relying on external libraries - this is work-in-progress by cryptodev vpp-dev team following the VPP project call on 17-Jan-2017. Performance tests in SW mode are subject to the resolution of VPP image build dependencies on external crypto libraries, similar as for csit-func VIRL tests. Most likely test results will be published in the addendum to csit1701 report.
SNAT44 OK vpp-make-test New NAT44 code functional tests using vpp make test infrastructure, run as part of vpp make verify jobs.
SNAT44 WIP csit-perf Single thread and multi-thread performance tests; the manual tests are completed, but automated CSIT version is not complete yet. Most likely test results will be published in the addendum to csit1701 report.
DPDK16.11 testpmd OK csit-perf Standalone DPDK tests for baseline NIC-to-NIC performance. x520 NIC tests are completed. Other NICs are WIP. Most likely complete NIC list test results will be published in the addendum to csit1701 report.
TLDK TBC csit-perf TLDK performance tests. csit1701 status is unknown at this stage.
Doc generation OK csit-func, csit-perf, make-test spinx rtd docs generation for all test cases - will be stored on nexus.fd.io, and reachable for reading on docs.fd.io.
SPAN OK vpp-make-test SPAN functional tests using vpp make test infrastructure, run as part of vpp make verify jobs.
SPAN TBC csit-func SPAN functional tests using csit VIRL test infrastructure; currently tests failing due to CSIT TC bugs.
IPFIX TBC csit-func IPFIX netflow functional tests; IPFIX IPv4 tests are passing; two IPFIX IPv6 tests are failing due to CSIT TC bugs.
Centos tests TBC csit-func Functional VPP on Centos tests in VIRL testbeds environment; status to be confirmed.

Release Milestones

Milestone Date Deliverables
CSIT code freeze 2017-01-11 New TCs code frozen. Only low-risk changes accepted on main branch.
csit rls1701 pull 2017-01-11 pull csit release throttle branch.
CSIT bug fixes 2017-01-18 CSIT1701 code complete.
CSIT report 2017-01-25 CSIT report published

Expected Dependencies on Other Projects

  • dpdk-16.11 release
  • vpp-17.01 release