CSIT/csit1701 plan

Release Deliverables

Name	Status	Test Category	Description
More NIC models	OK	csit-perf	Added x710, xl710, vic1385, vic1227.
vhost tests	OK	csit-perf	Optimized qemu vhost environment, vhost test coverage per vhost use cases review. Added more vhost use cases: vlan-l2bd-vhost, vxlan-l2bd-vhost.
DPDK CryptoDev	TBC	csit-func	IPSec using DPDK CryptoDev - VIRL-based functional tests; tests are in CSIT, but need updates to VPP image; subject to addressing VPP image build dependencies on external crypto libraries that are in turn subject to export restrictions.
DPDK CryptoDev	WIP	csit-perf	IPSec using DPDK CryptoDev - performance tests with Intel QAT PCIe cards present in FD.io CPL testbed (used by CSIT), require vpp code change to enable cryptodev driver for these cards without relying on external libraries - this is work-in-progress by cryptodev vpp-dev team following the VPP project call on 17-Jan-2017. Performance tests in SW mode are subject to the resolution of VPP image build dependencies on external crypto libraries, similar as for csit-func VIRL tests. Most likely test results will be published in the addendum to csit1701 report.
SNAT44	OK	vpp-make-test	New NAT44 code functional tests using vpp make test infrastructure, run as part of vpp make verify jobs.
SNAT44	WIP	csit-perf	Single thread and multi-thread performance tests; the manual tests are completed, but automated CSIT version is not complete yet. Most likely test results will be published in the addendum to csit1701 report.
DPDK16.11 testpmd	OK	csit-perf	Standalone DPDK tests for baseline NIC-to-NIC performance. x520 NIC tests are completed. Other NICs are WIP. Most likely complete NIC list test results will be published in the addendum to csit1701 report.
TLDK	TBC	csit-perf	TLDK performance tests. csit1701 status is unknown at this stage.
Doc generation	OK	csit-func, csit-perf, make-test	spinx rtd docs generation for all test cases - will be stored on nexus.fd.io, and reachable for reading on docs.fd.io.
SPAN	OK	vpp-make-test	SPAN functional tests using vpp make test infrastructure, run as part of vpp make verify jobs.
SPAN	TBC	csit-func	SPAN functional tests using csit VIRL test infrastructure; currently tests failing due to CSIT TC bugs.
IPFIX	TBC	csit-func	IPFIX netflow functional tests; IPFIX IPv4 tests are passing; two IPFIX IPv6 tests are failing due to CSIT TC bugs.
Centos tests	TBC	csit-func	Functional VPP on Centos tests in VIRL testbeds environment; status to be confirmed.

Release Milestones

Milestone	Date	Deliverables
CSIT code freeze	2017-01-11	New TCs code frozen. Only low-risk changes accepted on main branch.
csit rls1701 pull	2017-01-11	pull csit release throttle branch.
CSIT bug fixes	2017-01-18	CSIT1701 code complete.
CSIT report	2017-01-25	CSIT report published

Expected Dependencies on Other Projects

• dpdk-16.11 release
• vpp-17.01 release