CSIT/FuncTestPlan
WORK IN PROGRESS
Contents
- 1 CSIT development plan - background
- 2 CSIT functional tests - dev plan
- 2.1 IPv4 data plane - ip4dp
- 2.2 IPv4 control plane - ip4cp
- 2.3 IPv4 encapsulations - ip4enc
- 2.4 IPv4 telemetry - ip4tel
- 2.5 IPv6 data plane - ip6dp
- 2.6 IPv6 control plane - ip6cp
- 2.7 IPv6 encapsulations - ip6enc
- 2.8 IPv6 telemetry - ip6tel
- 2.9 Ethernet L2 data plane - l2dp
- 2.10 Ethernet L2 control plane - l2cp
- 2.11 Ethernet L2 encapsulations - l2enc
- 2.12 Ethernet L2 telemetry - l2tel
- 2.13 MPLS data plane - mplsdp
- 2.14 NSH data plane - nshdp
- 2.15 OPNFV-FDS integration
CSIT development plan - background
CSIT test development priorities are aligned with VPP releases timeline, with relative dev work prioritization for each VPP release driven by perceived importance of test verification for VPP functionality and performance. Specific CSIT dev work priorities are driven by rough consensus within the project and contributors and committers availability and willingness to do work.
Following priority tagging scheme is used in this CSIT wiki and FD.io jira for CSIT:
- [$VppRlsNo-$RelPrio]
- VppRlsNo - aligned VPP release number - 16.09, 16.12, 17.03.
- RelPrio - CSIT release priority - P0 for Must Have, P1 for Should Have, P2 for Could Have
- CSIT dev work tagging examples:
- [1609-P0] - CSIT Must Have for vpp-v1609
- [1609-P1] - CSIT Should Have for vpp-v1609
- [1609-P2] - CSIT Could Have for vpp-v1609
CSIT dev work plan execution tracked on CSIT jira, with priority tags encoded as Jira labels for easy of tracking and reporting.
CSIT functional tests - dev plan
For the purpose of tracking CSIT dev work, CSIT functional test cases are grouped into the following VPP functional areas:
- IPv4 data plane
- IPv4 control plane
- IPv4 encapsulations
- IPv4 telemetry
- IPv6 data plane
- IPv6 control plane
- IPv6 encapsulations
- IPv6 telemetry
- Ethernet L2 data plane
- Ethernet L2 control plane
- Ethernet L2 encapsulations
- Ethernet L2 management plane
- Ethernet L2 telemetry
- MPLS data plane
- NSH data plane
- OPNFV-FDS integration
Following sections provide a top-level breakdown of CSIT dev work items covering functional test cases per area, and their proposed priorities. Items completed to date are prefixed with [DONE]; remaining items are prefixed with their respective priority per target release as described earlier. Indicative VPP functionality coverage is listed at the beginning of each section.
Identified VPP working code availability dependencies are marked by VPP Jira ticket [TODO VPP-xxx].
IPv4 data plane - ip4dp
JIRA status for ip4dp tasks:
- 1609-p0
- CSIT-183 Vpn baseline routed forwarding (VRF) Done
CSIT-188 security - source IPv4 Reverse Path Forwarding (RPF) Done
view in JIRA
- CSIT-183 Vpn baseline routed forwarding (VRF) Done
- 1609-p1
- 1609-p2
- CSIT-21 IPv4 DP - QOS ingress policing - 1r2c-(cb,ca), 2r3c-(cb,ca) policers - part I Done
CSIT-214 Extranet VPN routed forwarding (VRF) - baseline. Done
CSIT-228 IP4 Security - stateful firewall Done
view in JIRA
- CSIT-21 IPv4 DP - QOS ingress policing - 1r2c-(cb,ca), 2r3c-(cb,ca) policers - part I Done
- JIRA views: board, list
Original CSIT plan:
- [1609-P1] qos - ingress policing - 1r2c-(cb,ca), 2r3c-(cb,ca) policers, RFC2475, RFC2697, RFC2698. CSIT-21
- [1609-P1] routing multipath (ECMP, UECMP) - baseline. CSIT-227
- [1609-P1] [TODO VPP-xxx] carrier grade nat 44, CGN44, RFC6598, RFC6888. CSIT-22 - The feature is blocked at the moment (for more info please see Jira ticket).
- [1609-P2] extranet VPN routed forwarding (VRF) - baseline. CSIT-214
- [1609-P2] [TODO VPP-xxx] security - stateful firewall. CSIT-228
- [1606-DONE] IPv4 routing RFC791 - baseline.
- [1606-DONE] security - iacl with n-tuple classification, ip4, ip6, mac.
- [1606-DONE] security - cop white-/black-list ip4 src addr filtering.
- [1609-DONE] VPN routed forwarding (VRF) - baseline. CSIT-183
- [1609-DONE] security - source IPv4 Reverse Path Forwarding (RPF). CSIT-188
IPv4 control plane - ip4cp
JIRA status for ip4cp tasks:
- 1609-p0
- CSIT-27 IPv4 CP - IKEv2 Done
CSIT-24 [P1-R1] IPv4 - Proxy ARP Done
view in JIRA
- CSIT-27 IPv4 CP - IKEv2 Done
- 1609-p1
- CSIT-25 IPv4 CP - DHCPv4 proxy Done
CSIT-341 IPv4 CP - DHCPv4 proxy - refactor Done
view in JIRA
- CSIT-25 IPv4 CP - DHCPv4 proxy Done
- 1609-p2
- JIRA views: board, list
Original CSIT plan:
- [1609-P0] IKEv2. CSIT-27
- [1606-DONE] ARP.
- [1606-DONE] ICMPv4.
- [1606-DONE] DHCPv4 client.
- [1609-DONE] Proxy ARP. CSIT-24
- [1609-DONE] DHCPv4 proxy. CSIT-25
IPv4 encapsulations - ip4enc
JIRA status for ip4enc tasks:
- 1609-p0
- CSIT-28 IPv4 encaps - ip4-ipsec-ip4, part I Done
CSIT-231 ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp Done
CSIT-124 IPv4 encapsulations - IP4-GRE-IP4 part II Done
CSIT-229 ip4-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp Done
view in JIRA
- CSIT-28 IPv4 encaps - ip4-ipsec-ip4, part I Done
- 1609-p1
- CSIT-456 IPv4 - ip4-ipsec-lispgpe-ip6 - main fib, vrf, phy2lisp, virt2lisp Done
CSIT-392 ip4-lispgpe-ip4 - main fib, vrf; virt2lisp Done
CSIT-393 ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf); virt2lisp Done
CSIT-232 ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp Done
CSIT-230 ip4-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp Done
CSIT-459 IPv4 - ip6-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp Done
view in JIRA
- CSIT-456 IPv4 - ip4-ipsec-lispgpe-ip6 - main fib, vrf, phy2lisp, virt2lisp Done
- 1609-p2
- JIRA views: board, list
Original CSIT plan:
- [1609-P0] ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-231
- [1609-P1] ip4-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-230
- [1609-P1] ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-232
- [1606-DONE] ip4-gre-ip4 - baseline main fib.
- [1609-DONE] ip4-ipsec-ip4 - baseline main fib. CSIT-28
- [1609-DONE] ip4-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-229
IPv4 telemetry - ip4tel
JIRA status for ip4tel tasks:
Original CSIT plan:
- [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. CSIT-235
- [1609-P1] [Blocked-by VPP-186] Lawful intercept - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. CSIT-236
- [1609-DONE] IPv4 IPFIX - stats collection and export - baseline. CSIT-233
- [1609-DONE] IPv4 IPFIX - stats collection and export - functional scale. CSIT-234
IPv6 data plane - ip6dp
JIRA status for ip6dp tasks:
- 1609-p0
- 1609-p1
- CSIT-240 Routing multipath (ECMP) - baseline for IPv6 Done
CSIT-420 Routing multipath (UECMP) - baseline for IPv6 Done
view in JIRA
- CSIT-240 Routing multipath (ECMP) - baseline for IPv6 Done
- 1609-p2
- JIRA views: board, list
Original CSIT plan:
- [1609-P1] routing multipath (ECMP, UECMP) - baseline. CSIT-240
- [1609-P2] [TODO VPP-194] security - source IPv6 Reverse Path Forwarding (RPF). CSIT-208
- [1609-P2] [Blocked-by VPP-224] extranet VPN routed forwarding (VRF) - baseline. CSIT-238
- [1609-P2] [TODO VPP-xxx] security - stateful firewall.
- [1609-P2] qos - ingress policing - 1r2c-(cb,ca), 2r3c-(cb,ca) policers, RFC2475, RFC2697, RFC2698. CSIT-239
- [1606-DONE] routing [rfc2460] - baseline.
- [1606-DONE] security - iacl with n-tuple classification.
- [1606-DONE] security - cop white-/black-list ip4 src addr filtering.
- [1609-DONE] VPN routed forwarding (VRF) - baseline. CSIT-237
IPv6 control plane - ip6cp
JIRA status for ip6cp tasks:
- 1609-p0
- CSIT-241 IPv6 CP router advertisement Done
view in JIRA
- CSIT-241 IPv6 CP router advertisement Done
- 1609-p1
- CSIT-31 IPv6 CP - DHCPv6 proxy Done
view in JIRA
- CSIT-31 IPv6 CP - DHCPv6 proxy Done
- 1609-p2
- JIRA views: board, list
Original CSIT plan:
- [1609-P1] DHCPv6 proxy. CSIT-31
- [1609-P2] [TODO VPP-xxx] ip6-ioam, in-band OAM.
- [1609-P2] DHCPv6 client. CSIT-242
- [1606-DONE] neighbor discovery, RFC4861.
- [1606-DONE] ICMPv6.
- [1609-DONE] router advertisement - baseline tests. CSIT-241
IPv6 encapsulations - ip6enc
JIRA status for ip6enc tasks:
- 1609-p0
- CSIT-33 IPv6 encaps - ip6-ipsec-ip6, part I Done
CSIT-32 IPv6 encaps softwire - Lightweight IPv4 over IPv6 Done
CSIT-197 IPv6 encaps softwire - MAP-E Done
CSIT-353 IPv6 encaps softwire - MAP-T Done
view in JIRA
- CSIT-33 IPv6 encaps - ip6-ipsec-ip6, part I Done
- 1609-p1
- CSIT-245 IPv6 - ip4-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp Done
CSIT-249 IPv6 - ip4-ipsec-lispgpe-ip6 - main fib, phy2lisp, virt2lisp Done
CSIT-243 IPv6 - ip6-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp Done
CSIT-247 IPv6 - ip6-ipsec-lispgpe-ip6 - main fib, phy2lisp, virt2lisp Done
CSIT-365 IPv6 encaps softwire - MAP-E part II Done
CSIT-250 IPv6 - ip4-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp Done
CSIT-246 IPv6 - ip4-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp Done
CSIT-244 IPv6 - ip6-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp Done
CSIT-459 IPv4 - ip6-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp Done
view in JIRA
- CSIT-245 IPv6 - ip4-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp Done
- 1609-p2
- JIRA views: board, list
Original CSIT plan:
- [1609-P1] ip6-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-243
- [1609-P1] ip6-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-244
- [1609-P1] ip4-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-245
- [1609-P1] ip4-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-246
- [1609-P1] ip6-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-247
- [1609-P1] ip6-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-248
- [1609-P1] ip4-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-249
- [1609-P1] ip4-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-250
- [1609-P1] [TODO VPP-xxx] ip6-segment-routing.
- [1609-DONE] ip4-o-ip6 softwire - lightweight46. CSIT-32
- [1609-DONE] ip4-o-ip6 softwire - map-e. CSIT-197
- [1609-DONE] ip4-o-ip6 softwire - map-t. CSIT-353
- [1609-DONE] ip6-ipsec-ip6. CSIT-33
IPv6 telemetry - ip6tel
JIRA status for ip6tel tasks:
- 1609-p0
- 1609-p1
- 1609-p2
- JIRA views: board view, list view.
Original CSIT plan:
- [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. CSIT-253
- [1609-P1] [Blocked-by VPP-186] Lawful intercept - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. CSIT-254
- [1609-DONE] [Blocked-by VPP-204] IPv6 IPFIX - stats collection and export - baseline. CSIT-251
- [1609-DONE] [Blocked-by VPP-204] IPv6 IPFIX - stats collection and export - functional scale. CSIT-252
Ethernet L2 data plane - l2dp
JIRA status for l2dp tasks:
- 1609-p0
- CSIT-35 L2 DP - Bridge domain - part II Done
view in JIRA
- CSIT-35 L2 DP - Bridge domain - part II Done
- 1609-p1
- 1609-p2
- JIRA views: board, list.
Original CSIT plan:
- [1609-P1] Integrated Routing-Bridging (IRB) - baseline. CSIT-255
- [1606-DONE] L2 Cross-connec - baseline.
- [1606-DONE] L2 Cross-connect - with VLAN tag acrobatics 1-to-1, 1-to-2, 2-to-1, 2-to-2.
- [1606-DONE] Bridge domain - baseline.
- [1609-DONE] Bridge domain - with VLAN tag acrobatics 1-to-1, 1-to-2, 2-to-1, 2-to-2. CSIT-35
Ethernet L2 control plane - l2cp
JIRA status for l2cp tasks:
Original CSIT plan:
- [1609-P2] [TODO VPP-xxx] CDP/LLDP.
- [1606-DONE] MAC learning.
- [1606-DONE] MAC split-horizon.
Ethernet L2 encapsulations - l2enc
JIRA status for l2enc tasks:
- 1609-p0
- 1609-p1
- CSIT-257 L2enc - l2-eth-lispgpe-ip4 - L2BD Done
CSIT-256 L2enc - l2-eth-lispgpe-ip6 - L2BD Done
view in JIRA
- CSIT-257 L2enc - l2-eth-lispgpe-ip4 - L2BD Done
- 1609-p2
- CSIT-260 L2enc - l2-eth-l2tpv3-ip6 - L2BD, L2XC Done
CSIT-261 L2enc - l2-eth-gre-ip4 - L2BD Done
CSIT-262 L2enc - l2-eth-gre-ip6 - L2BD Done
CSIT-259 L2enc - l2-eth-l2tpv3-ip4 - L2BD, L2XC Done
view in JIRA
- CSIT-260 L2enc - l2-eth-l2tpv3-ip6 - L2BD, L2XC Done
- JIRA views: board, list.
Original CSIT plan:
- [1609-P1] l2-eth-lispgpe-ip6 - L2BD. CSIT-256
- [1609-P1] l2-eth-lispgpe-ip4 - L2BD. CSIT-257
- [1609-P1] l2eth-gre-ip4-ipsec-ip4-eth - L2BD. CSIT-258
- [1609-P2] l2-eth-l2tpv3-ip4 - L2BD, L2XC. CSIT-259
- [1609-P2] l2-eth-l2tpv3-ip6 - L2BD, L2XC. CSIT-260
- [1609-P2] l2-eth-gre-ip4 - L2BD. CSIT-261
- [1609-P2] l2-eth-gre-ip6 - L2BD. CSIT-262
- [1606-DONE] l2-vxlan-ipv4 - with bridge-domain.
- [1606-DONE] l2-vxlan-ipv4 - with L2 cross-connect.
Ethernet L2 telemetry - l2tel
JIRA status for l2tel tasks:
Original CSIT plan:
- [1609-P1] L2 FIB - stats collection and export - baseline. CSIT-263
- [1609-P2] L2 FIB - stats collection and export - functional scale. CSIT-264
- [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. CSIT-265
- [1609-P1] [Blocked-by VPP-186] Lawful intercept - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. CSIT-266
MPLS data plane - mplsdp
- JIRA views: [board], [list].
Original CSIT plan:
NSH data plane - nshdp
- JIRA views: [board], [list].
Original CSIT plan:
OPNFV-FDS integration
Original CSIT plan:
- [1606-DONE] FDS VM scenario with two L2 bridge domains – ICMPv4.
- [1606-DONE] FDS VM scenario with two L2 bridge domains with static L2FIB entries – ICMPv4.
- [1606-DONE] FDS VM scenario with two L2 bridge domains – ICMPv6.
- [1606-DONE] FDS VM scenario with two L2 bridge domains with static L2FIB entries – ICMPv6.
- [1606-DONE] FDS VM scenario with L2 cross-connect – ICMPv4.
- [1606-DONE] FDS VM scenario with L2 cross-connect – ICMPv6.
- [1606-DONE] FDS L2 test cases with tenant networks (VXLAN).
- [1606-DONE] FDS L2 test cases with provider physical networks (VLAN).