Difference between revisions of "CSIT/FuncTestPlan"

From fd.io
Jump to: navigation, search
(→‎IPv4 control plane)
 
(16 intermediate revisions by 3 users not shown)
Line 1: Line 1:
−
'''WORK IN PROGRESS - PLEASE TREAT IT AS SUCH'''
+
'''WORK IN PROGRESS'''
  
 
__TOC__
 
__TOC__
Line 44: Line 44:
 
Identified VPP working code availability dependencies are marked by VPP Jira ticket [TODO VPP-xxx].
 
Identified VPP working code availability dependencies are marked by VPP Jira ticket [TODO VPP-xxx].
  
−
==IPv4 data plane==
+
==IPv4 data plane - ip4dp==
  
−
JIRA [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=39&quickFilter=37&quickFilter=64 board view], [https://jira.fd.io/issues/?filter=10631 list view] - '''ip4dp''' label for CSIT work tracking.
+
JIRA status for '''ip4dp''' tasks:
  
−
Indicative coverage = 50%
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = ip4dp AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = ip4dp AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = ip4dp AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=39&quickFilter=37&quickFilter=64 board], [https://jira.fd.io/issues/?filter=10631 list]
 +
 
 +
Original CSIT plan:
  
 
# [1609-P1] qos - ingress policing - 1r2c-(cb,ca), 2r3c-(cb,ca) policers, RFC2475, RFC2697, RFC2698. [https://jira.fd.io/browse/CSIT-21 CSIT-21]
 
# [1609-P1] qos - ingress policing - 1r2c-(cb,ca), 2r3c-(cb,ca) policers, RFC2475, RFC2697, RFC2698. [https://jira.fd.io/browse/CSIT-21 CSIT-21]
Line 58: Line 66:
 
# [1606-DONE] security - iacl with n-tuple classification, ip4, ip6, mac.
 
# [1606-DONE] security - iacl with n-tuple classification, ip4, ip6, mac.
 
# [1606-DONE] security - cop white-/black-list ip4 src addr filtering.
 
# [1606-DONE] security - cop white-/black-list ip4 src addr filtering.
−
# [1609-DONE] VPN routed forwarding (VRF) - baseline. [https://jira.fd.io/browse/CSIT-183 CSIT-183]  
+
# [1609-DONE] VPN routed forwarding (VRF) - baseline. [https://jira.fd.io/browse/CSIT-183 CSIT-183]
 
# [1609-DONE] security - source IPv4 Reverse Path Forwarding (RPF). [https://jira.fd.io/browse/CSIT-188 CSIT-188]
 
# [1609-DONE] security - source IPv4 Reverse Path Forwarding (RPF). [https://jira.fd.io/browse/CSIT-188 CSIT-188]
  
−
==IPv4 control plane==
+
==IPv4 control plane - ip4cp==
  
−
JIRA [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=39&quickFilter=64&quickFilter=35 board view], [https://jira.fd.io/issues/?filter=10632 list view] - '''ip4cp''' label for CSIT work tracking.
+
JIRA status for '''ip4cp''' tasks:
  
−
Indicative coverage = 83%
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = ip4cp AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = ip4cp AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = ip4cp AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=39&quickFilter=64&quickFilter=35 board], [https://jira.fd.io/issues/?filter=10632 list]
  
 +
Original CSIT plan:
  
 
# [1609-P0] IKEv2. [https://jira.fd.io/browse/CSIT-27 CSIT-27]
 
# [1609-P0] IKEv2. [https://jira.fd.io/browse/CSIT-27 CSIT-27]
Line 75: Line 90:
 
# [1609-DONE] DHCPv4 proxy. [https://jira.fd.io/browse/CSIT-25 CSIT-25]
 
# [1609-DONE] DHCPv4 proxy. [https://jira.fd.io/browse/CSIT-25 CSIT-25]
  
−
==IPv4 encapsulations==
+
==IPv4 encapsulations - ip4enc==
  
−
JIRA [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=39&quickFilter=64&quickFilter=38 board view], [https://jira.fd.io/issues/?filter=10633 list view] - '''ip4enc''' label for CSIT work tracking.
+
JIRA status for '''ip4enc''' tasks:
  
−
Indicative coverage = 10%
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = ip4enc AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = ip4enc AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = ip4enc AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=39&quickFilter=64&quickFilter=38 board], [https://jira.fd.io/issues/?filter=10633 list]
 +
 
 +
Original CSIT plan:
  
−
# [1609-P0] ip4-ipsec-ip4 - baseline main fib. [https://jira.fd.io/browse/CSIT-28 CSIT-28]
 
−
# [1609-P0] ip4-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. [https://jira.fd.io/browse/CSIT-229 CSIT-229]
 
−
# [1609-P0] ip4-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. [https://jira.fd.io/browse/CSIT-230 CSIT-230]
 
 
# [1609-P0] ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. [https://jira.fd.io/browse/CSIT-231 CSIT-231]
 
# [1609-P0] ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. [https://jira.fd.io/browse/CSIT-231 CSIT-231]
−
# [1609-P0] ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. [https://jira.fd.io/browse/CSIT-232 CSIT-232]
+
# [1609-P1] ip4-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. [https://jira.fd.io/browse/CSIT-230 CSIT-230]
 +
# [1609-P1] ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. [https://jira.fd.io/browse/CSIT-232 CSIT-232]
 
# [1606-DONE] ip4-gre-ip4 - baseline main fib.
 
# [1606-DONE] ip4-gre-ip4 - baseline main fib.
 +
# [1609-DONE] ip4-ipsec-ip4 - baseline main fib. [https://jira.fd.io/browse/CSIT-28 CSIT-28]
 +
# [1609-DONE] ip4-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. [https://jira.fd.io/browse/CSIT-229 CSIT-229]
  
−
==IPv4 telemetry==
+
==IPv4 telemetry - ip4tel==
  
−
JIRA [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=39&quickFilter=64&quickFilter=42 board view], [https://jira.fd.io/issues/?filter=10634 list view] - '''ip4tel''' label for CSIT work tracking.
+
JIRA status for '''ip4tel''' tasks:
  
−
Indicative coverage = 0%
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = ip4tel AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = ip4tel AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = ip4tel AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=39&quickFilter=64&quickFilter=42 board], [https://jira.fd.io/issues/?filter=10634 list]
 +
 
 +
Original CSIT plan:
  
−
# [1609-P0] [Blocked-by VPP-204] IPv4 IPFIX - stats collection and export - baseline. [https://jira.fd.io/browse/CSIT-233 CSIT-233]
 
−
# [1609-P0] [Blocked-by VPP-204] IPv4 IPFIX - stats collection and export - functional scale. [https://jira.fd.io/browse/CSIT-234 CSIT-234]
 
 
# [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. [https://jira.fd.io/browse/CSIT-235 CSIT-235]
 
# [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. [https://jira.fd.io/browse/CSIT-235 CSIT-235]
 
# [1609-P1] [Blocked-by VPP-186] Lawful intercept  - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. [https://jira.fd.io/browse/CSIT-236 CSIT-236]
 
# [1609-P1] [Blocked-by VPP-186] Lawful intercept  - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. [https://jira.fd.io/browse/CSIT-236 CSIT-236]
 +
# [1609-DONE] IPv4 IPFIX - stats collection and export - baseline. [https://jira.fd.io/browse/CSIT-233 CSIT-233]
 +
# [1609-DONE] IPv4 IPFIX - stats collection and export - functional scale. [https://jira.fd.io/browse/CSIT-234 CSIT-234]
  
−
==IPv6 data plane==
+
==IPv6 data plane - ip6dp==
  
−
JIRA [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=40&quickFilter=37 board view], [https://jira.fd.io/issues/?filter=10635 list view] - '''ip6dp''' label for CSIT work tracking.
+
JIRA status for '''ip6dp''' tasks:
  
−
Indicative coverage = 67%
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = ip6dp AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = ip6dp AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = ip6dp AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=40&quickFilter=37 board], [https://jira.fd.io/issues/?filter=10635 list]
 +
 
 +
Original CSIT plan:
  
−
# [1609-P0] VPN routed forwarding (VRF) - baseline. [https://jira.fd.io/browse/CSIT-237 CSIT-237]
 
−
# [1609-P0] [Blocked-by VPP-224] extranet VPN routed forwarding (VRF) - baseline. [https://jira.fd.io/browse/CSIT-238 CSIT-238]
 
−
# [1609-P2] [TODO VPP-194] security - source IPv6 Reverse Path Forwarding (RPF). [https://jira.fd.io/browse/CSIT-208 CSIT-208]
 
−
# [1609-P0] qos - ingress policing - 1r2c-(cb,ca), 2r3c-(cb,ca) policers, RFC2475, RFC2697, RFC2698. [https://jira.fd.io/browse/CSIT-239 CSIT-239]
 
 
# [1609-P1] routing multipath (ECMP, UECMP) - baseline. [https://jira.fd.io/browse/CSIT-240 CSIT-240]
 
# [1609-P1] routing multipath (ECMP, UECMP) - baseline. [https://jira.fd.io/browse/CSIT-240 CSIT-240]
 +
# [1609-P2] [TODO VPP-194] security - source IPv6 Reverse Path Forwarding (RPF). [https://jira.fd.io/browse/CSIT-208 CSIT-208]
 +
# [1609-P2] [Blocked-by VPP-224] extranet VPN routed forwarding (VRF) - baseline. [https://jira.fd.io/browse/CSIT-238 CSIT-238]
 
# [1609-P2] [TODO VPP-xxx] security - stateful firewall.
 
# [1609-P2] [TODO VPP-xxx] security - stateful firewall.
 +
# [1609-P2] qos - ingress policing - 1r2c-(cb,ca), 2r3c-(cb,ca) policers, RFC2475, RFC2697, RFC2698. [https://jira.fd.io/browse/CSIT-239 CSIT-239]
 
# [1606-DONE] routing [rfc2460] - baseline.
 
# [1606-DONE] routing [rfc2460] - baseline.
 
# [1606-DONE] security - iacl with n-tuple classification.
 
# [1606-DONE] security - iacl with n-tuple classification.
 
# [1606-DONE] security - cop white-/black-list ip4 src addr filtering.
 
# [1606-DONE] security - cop white-/black-list ip4 src addr filtering.
 +
# [1609-DONE] VPN routed forwarding (VRF) - baseline. [https://jira.fd.io/browse/CSIT-237 CSIT-237]
  
−
==IPv6 control plane==
+
==IPv6 control plane - ip6cp==
  
−
[https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=40&quickFilter=35 JIRA board view], [https://jira.fd.io/issues/?filter=10636 JIRA list view] - '''ip6cp''' label for CSIT work tracking.
+
JIRA status for '''ip6cp''' tasks:
  
−
Indicative coverage = 40%
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = ip6cp AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = ip6cp AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = ip6cp AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=40&quickFilter=35 board], [https://jira.fd.io/issues/?filter=10636 list]
 +
 
 +
Original CSIT plan:
  
−
# [1609-DONE] router advertisement - baseline tests. [https://jira.fd.io/browse/CSIT-241 CSIT-241]
 
−
# [1609-P0] DHCPv6 client. [https://jira.fd.io/browse/CSIT-242 CSIT-242]
 
 
# [1609-P1] DHCPv6 proxy. [https://jira.fd.io/browse/CSIT-31 CSIT-31]
 
# [1609-P1] DHCPv6 proxy. [https://jira.fd.io/browse/CSIT-31 CSIT-31]
 
# [1609-P2] [TODO VPP-xxx] ip6-ioam, in-band OAM.
 
# [1609-P2] [TODO VPP-xxx] ip6-ioam, in-band OAM.
 +
# [1609-P2] DHCPv6 client. [https://jira.fd.io/browse/CSIT-242 CSIT-242]
 
# [1606-DONE] neighbor discovery, RFC4861.
 
# [1606-DONE] neighbor discovery, RFC4861.
 
# [1606-DONE] ICMPv6.
 
# [1606-DONE] ICMPv6.
 +
# [1609-DONE] router advertisement - baseline tests. [https://jira.fd.io/browse/CSIT-241 CSIT-241]
  
−
==IPv6 encapsulations==
+
==IPv6 encapsulations - ip6enc==
  
−
[https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=40&quickFilter=38 JIRA board view], [https://jira.fd.io/issues/?filter=10637 JIRA list view] - '''ip6enc''' label for CSIT work tracking.
+
JIRA status for '''ip6enc''' tasks:
  
−
Indicative coverage = 0%
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = ip6enc AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = ip6enc AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = ip6enc AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=40&quickFilter=38 board], [https://jira.fd.io/issues/?filter=10637 list]
 +
 
 +
Original CSIT plan:
  
−
# [1609-DONE] ip4-o-ip6 softwire - lightweight46. [https://jira.fd.io/browse/CSIT-32 CSIT-32]
 
−
# [1609-P0] ip4-o-ip6 softwire - map-e/map-t. [https://jira.fd.io/browse/CSIT-197 CSIT-197]
 
−
# [1609-P0] ip6-ipsec-ip6. [https://jira.fd.io/browse/CSIT-33 CSIT-33]
 
 
# [1609-P1] ip6-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. [https://jira.fd.io/browse/CSIT-243 CSIT-243]
 
# [1609-P1] ip6-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. [https://jira.fd.io/browse/CSIT-243 CSIT-243]
 
# [1609-P1] ip6-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. [https://jira.fd.io/browse/CSIT-244 CSIT-244]
 
# [1609-P1] ip6-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. [https://jira.fd.io/browse/CSIT-244 CSIT-244]
Line 146: Line 198:
 
# [1609-P1] ip4-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. [https://jira.fd.io/browse/CSIT-250 CSIT-250]
 
# [1609-P1] ip4-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. [https://jira.fd.io/browse/CSIT-250 CSIT-250]
 
# [1609-P1] [TODO VPP-xxx] ip6-segment-routing.
 
# [1609-P1] [TODO VPP-xxx] ip6-segment-routing.
 +
# [1609-DONE] ip4-o-ip6 softwire - lightweight46. [https://jira.fd.io/browse/CSIT-32 CSIT-32]
 +
# [1609-DONE] ip4-o-ip6 softwire - map-e. [https://jira.fd.io/browse/CSIT-197 CSIT-197]
 +
# [1609-DONE] ip4-o-ip6 softwire - map-t. [https://jira.fd.io/browse/CSIT-353 CSIT-353]
 +
# [1609-DONE] ip6-ipsec-ip6. [https://jira.fd.io/browse/CSIT-33 CSIT-33]
 +
 +
==IPv6 telemetry - ip6tel==
  
−
==IPv6 telemetry==
+
JIRA status for '''ip6tel''' tasks:
  
−
[https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=40&quickFilter=42 JIRA board view], [https://jira.fd.io/issues/?filter=10638 JIRA list view] - '''ip6tel''' label for CSIT work tracking.
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = ip6tel AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = ip6tel AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = ip6tel AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=40&quickFilter=42 board view], [https://jira.fd.io/issues/?filter=10638 list view].
  
−
Indicative coverage = 0%
+
Original CSIT plan:
  
−
# [1609-P0] [Blocked-by VPP-204] IPv6 IPFIX - stats collection and export - baseline. [https://jira.fd.io/browse/CSIT-251 CSIT-251]
 
−
# [1609-P0] [Blocked-by VPP-204] IPv6 IPFIX - stats collection and export - functional scale. [https://jira.fd.io/browse/CSIT-252 CSIT-252]
 
 
# [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. [https://jira.fd.io/browse/CSIT-253 CSIT-253]
 
# [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. [https://jira.fd.io/browse/CSIT-253 CSIT-253]
 
# [1609-P1] [Blocked-by VPP-186] Lawful intercept  - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. [https://jira.fd.io/browse/CSIT-254 CSIT-254]
 
# [1609-P1] [Blocked-by VPP-186] Lawful intercept  - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. [https://jira.fd.io/browse/CSIT-254 CSIT-254]
 +
# [1609-DONE] [Blocked-by VPP-204] IPv6 IPFIX - stats collection and export - baseline. [https://jira.fd.io/browse/CSIT-251 CSIT-251]
 +
# [1609-DONE] [Blocked-by VPP-204] IPv6 IPFIX - stats collection and export - functional scale. [https://jira.fd.io/browse/CSIT-252 CSIT-252]
  
−
==Ethernet L2 data plane==
+
==Ethernet L2 data plane - l2dp==
  
−
[https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=41&quickFilter=37 JIRA board view], [https://jira.fd.io/issues/?filter=10639 JIRA list view] - '''l2dp''' label for CSIT work tracking.
+
JIRA status for '''l2dp''' tasks:
  
−
Indicative coverage = 80%
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = l2dp AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = l2dp AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = l2dp AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=41&quickFilter=37 board], [https://jira.fd.io/issues/?filter=10639 list].
 +
 
 +
Original CSIT plan:
  
 
# [1609-P1] Integrated Routing-Bridging (IRB) - baseline. [https://jira.fd.io/browse/CSIT-255 CSIT-255]
 
# [1609-P1] Integrated Routing-Bridging (IRB) - baseline. [https://jira.fd.io/browse/CSIT-255 CSIT-255]
Line 170: Line 242:
 
# [1609-DONE] Bridge domain - with VLAN tag acrobatics 1-to-1, 1-to-2, 2-to-1, 2-to-2. [https://jira.fd.io/browse/CSIT-35 CSIT-35]
 
# [1609-DONE] Bridge domain - with VLAN tag acrobatics 1-to-1, 1-to-2, 2-to-1, 2-to-2. [https://jira.fd.io/browse/CSIT-35 CSIT-35]
  
−
==Ethernet L2 control plane==
+
==Ethernet L2 control plane - l2cp==
 +
 
 +
JIRA status for '''l2cp''' tasks:
  
−
[https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=41&quickFilter=35 JIRA board view], [https://jira.fd.io/issues/?filter=10640 JIRA list view] - '''l2cp''' label for CSIT work tracking.
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = l2cp AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = l2cp AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = l2cp AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=41&quickFilter=35 board], [https://jira.fd.io/issues/?filter=10640 list].
  
−
Indicative coverage = 66%
+
Original CSIT plan:
  
 
# [1609-P2] [TODO VPP-xxx] CDP/LLDP.
 
# [1609-P2] [TODO VPP-xxx] CDP/LLDP.
Line 180: Line 260:
 
# [1606-DONE] MAC split-horizon.
 
# [1606-DONE] MAC split-horizon.
  
−
==Ethernet L2 encapsulations==
+
==Ethernet L2 encapsulations - l2enc==
  
−
[https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=41&quickFilter=38 JIRA board view], [https://jira.fd.io/issues/?filter=10641 JIRA list view] - '''l2enc''' label for CSIT work tracking.
+
JIRA status for '''l2enc''' tasks:
  
−
Indicative coverage = 33%
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = l2enc AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = l2enc AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = l2enc AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=41&quickFilter=38 board], [https://jira.fd.io/issues/?filter=10641 list].
 +
 
 +
Original CSIT plan:
  
 
# [1609-P1] l2-eth-lispgpe-ip6 - L2BD. [https://jira.fd.io/browse/CSIT-256 CSIT-256]
 
# [1609-P1] l2-eth-lispgpe-ip6 - L2BD. [https://jira.fd.io/browse/CSIT-256 CSIT-256]
Line 196: Line 284:
 
# [1606-DONE] l2-vxlan-ipv4 - with L2 cross-connect.
 
# [1606-DONE] l2-vxlan-ipv4 - with L2 cross-connect.
  
−
==L2 telemetry==
+
==Ethernet L2 telemetry - l2tel==
 +
 
 +
JIRA status for '''l2tel''' tasks:
  
−
[https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=41&quickFilter=42 JIRA board view], [https://jira.fd.io/issues/?filter=10642 JIRA list view] - '''l2tel''' label for CSIT work tracking.
+
* '''1609-p0'''
 +
** <jira jql='project = CSIT AND labels = l2tel AND labels = func AND labels = 1609-p0 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p1'''
 +
** <jira jql='project = CSIT AND labels = l2tel AND labels = func AND labels = 1609-p1 ORDER BY status DESC, priority DESC'></jira>
 +
* '''1609-p2'''
 +
** <jira jql='project = CSIT AND labels = l2tel AND labels = func AND labels = 1609-p2 ORDER BY status DESC, priority DESC'></jira>
 +
* '''JIRA views''': [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8&quickFilter=64&quickFilter=41&quickFilter=42 board], [https://jira.fd.io/issues/?filter=10642 list].
  
−
Indicative coverage = 0%
+
Original CSIT plan:
  
 
# [1609-P1] L2 FIB - stats collection and export - baseline. [https://jira.fd.io/browse/CSIT-263 CSIT-263]
 
# [1609-P1] L2 FIB - stats collection and export - baseline. [https://jira.fd.io/browse/CSIT-263 CSIT-263]
 
# [1609-P2] L2 FIB - stats collection and export - functional scale. [https://jira.fd.io/browse/CSIT-264 CSIT-264]
 
# [1609-P2] L2 FIB - stats collection and export - functional scale. [https://jira.fd.io/browse/CSIT-264 CSIT-264]
−
# [1609-P0] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. [https://jira.fd.io/browse/CSIT-265 CSIT-265]
+
# [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. [https://jira.fd.io/browse/CSIT-265 CSIT-265]
 
# [1609-P1] [Blocked-by VPP-186] Lawful intercept  - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. [https://jira.fd.io/browse/CSIT-266 CSIT-266]
 
# [1609-P1] [Blocked-by VPP-186] Lawful intercept  - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. [https://jira.fd.io/browse/CSIT-266 CSIT-266]
  
−
==MPLS data plane==
+
==MPLS data plane - mplsdp==
  
−
[ JIRA board view], [ JIRA list view] - '''mplsdp''' label for CSIT work tracking.
+
* '''JIRA views''': [board], [list].
  
−
Indicative coverage = 0%
+
Original CSIT plan:
  
 
# [1609-P2] vpnv4-mpls-gre-ip4. [https://jira.fd.io/browse/CSIT-267 CSIT-267]
 
# [1609-P2] vpnv4-mpls-gre-ip4. [https://jira.fd.io/browse/CSIT-267 CSIT-267]
 
# [1609-P2] mpls-o-eth. [https://jira.fd.io/browse/CSIT-268 CSIT-268]
 
# [1609-P2] mpls-o-eth. [https://jira.fd.io/browse/CSIT-268 CSIT-268]
  
−
==NSH data plane==
+
==NSH data plane - nshdp==
  
−
[ JIRA board view], [ JIRA list view] - '''nshdp''' label for CSIT work tracking.
+
* '''JIRA views''': [board], [list].
  
−
Indicative coverage = 0%
+
Original CSIT plan:
  
 
# [1609-P1] ip4-nsh-gre-ip4. [https://jira.fd.io/browse/CSIT-269 CSIT-269]
 
# [1609-P1] ip4-nsh-gre-ip4. [https://jira.fd.io/browse/CSIT-269 CSIT-269]
Line 227: Line 323:
 
==OPNFV-FDS integration==
 
==OPNFV-FDS integration==
  
−
Indicative coverage = 100%
+
Original CSIT plan:
  
 
# [1606-DONE] FDS VM scenario with two L2 bridge domains – ICMPv4.
 
# [1606-DONE] FDS VM scenario with two L2 bridge domains – ICMPv4.

Latest revision as of 21:20, 12 September 2016

WORK IN PROGRESS

CSIT development plan - background

CSIT test development priorities are aligned with VPP releases timeline, with relative dev work prioritization for each VPP release driven by perceived importance of test verification for VPP functionality and performance. Specific CSIT dev work priorities are driven by rough consensus within the project and contributors and committers availability and willingness to do work.

Following priority tagging scheme is used in this CSIT wiki and FD.io jira for CSIT:

  • [$VppRlsNo-$RelPrio]
    • VppRlsNo - aligned VPP release number - 16.09, 16.12, 17.03.
    • RelPrio - CSIT release priority - P0 for Must Have, P1 for Should Have, P2 for Could Have
  • CSIT dev work tagging examples:
    • [1609-P0] - CSIT Must Have for vpp-v1609
    • [1609-P1] - CSIT Should Have for vpp-v1609
    • [1609-P2] - CSIT Could Have for vpp-v1609

CSIT dev work plan execution tracked on CSIT jira, with priority tags encoded as Jira labels for easy of tracking and reporting.

CSIT functional tests - dev plan

For the purpose of tracking CSIT dev work, CSIT functional test cases are grouped into the following VPP functional areas:

  1. IPv4 data plane
  2. IPv4 control plane
  3. IPv4 encapsulations
  4. IPv4 telemetry
  5. IPv6 data plane
  6. IPv6 control plane
  7. IPv6 encapsulations
  8. IPv6 telemetry
  9. Ethernet L2 data plane
  10. Ethernet L2 control plane
  11. Ethernet L2 encapsulations
  12. Ethernet L2 management plane
  13. Ethernet L2 telemetry
  14. MPLS data plane
  15. NSH data plane
  16. OPNFV-FDS integration

Following sections provide a top-level breakdown of CSIT dev work items covering functional test cases per area, and their proposed priorities. Items completed to date are prefixed with [DONE]; remaining items are prefixed with their respective priority per target release as described earlier. Indicative VPP functionality coverage is listed at the beginning of each section.

Identified VPP working code availability dependencies are marked by VPP Jira ticket [TODO VPP-xxx].

IPv4 data plane - ip4dp

JIRA status for ip4dp tasks:

Original CSIT plan:

  1. [1609-P1] qos - ingress policing - 1r2c-(cb,ca), 2r3c-(cb,ca) policers, RFC2475, RFC2697, RFC2698. CSIT-21
  2. [1609-P1] routing multipath (ECMP, UECMP) - baseline. CSIT-227
  3. [1609-P1] [TODO VPP-xxx] carrier grade nat 44, CGN44, RFC6598, RFC6888. CSIT-22 - The feature is blocked at the moment (for more info please see Jira ticket).
  4. [1609-P2] extranet VPN routed forwarding (VRF) - baseline. CSIT-214
  5. [1609-P2] [TODO VPP-xxx] security - stateful firewall. CSIT-228
  6. [1606-DONE] IPv4 routing RFC791 - baseline.
  7. [1606-DONE] security - iacl with n-tuple classification, ip4, ip6, mac.
  8. [1606-DONE] security - cop white-/black-list ip4 src addr filtering.
  9. [1609-DONE] VPN routed forwarding (VRF) - baseline. CSIT-183
  10. [1609-DONE] security - source IPv4 Reverse Path Forwarding (RPF). CSIT-188

IPv4 control plane - ip4cp

JIRA status for ip4cp tasks:

Original CSIT plan:

  1. [1609-P0] IKEv2. CSIT-27
  2. [1606-DONE] ARP.
  3. [1606-DONE] ICMPv4.
  4. [1606-DONE] DHCPv4 client.
  5. [1609-DONE] Proxy ARP. CSIT-24
  6. [1609-DONE] DHCPv4 proxy. CSIT-25

IPv4 encapsulations - ip4enc

JIRA status for ip4enc tasks:

Original CSIT plan:

  1. [1609-P0] ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-231
  2. [1609-P1] ip4-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-230
  3. [1609-P1] ip4-ipsec-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-232
  4. [1606-DONE] ip4-gre-ip4 - baseline main fib.
  5. [1609-DONE] ip4-ipsec-ip4 - baseline main fib. CSIT-28
  6. [1609-DONE] ip4-lispgpe-ip4 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-229

IPv4 telemetry - ip4tel

JIRA status for ip4tel tasks:

Original CSIT plan:

  1. [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. CSIT-235
  2. [1609-P1] [Blocked-by VPP-186] Lawful intercept - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. CSIT-236
  3. [1609-DONE] IPv4 IPFIX - stats collection and export - baseline. CSIT-233
  4. [1609-DONE] IPv4 IPFIX - stats collection and export - functional scale. CSIT-234

IPv6 data plane - ip6dp

JIRA status for ip6dp tasks:

Original CSIT plan:

  1. [1609-P1] routing multipath (ECMP, UECMP) - baseline. CSIT-240
  2. [1609-P2] [TODO VPP-194] security - source IPv6 Reverse Path Forwarding (RPF). CSIT-208
  3. [1609-P2] [Blocked-by VPP-224] extranet VPN routed forwarding (VRF) - baseline. CSIT-238
  4. [1609-P2] [TODO VPP-xxx] security - stateful firewall.
  5. [1609-P2] qos - ingress policing - 1r2c-(cb,ca), 2r3c-(cb,ca) policers, RFC2475, RFC2697, RFC2698. CSIT-239
  6. [1606-DONE] routing [rfc2460] - baseline.
  7. [1606-DONE] security - iacl with n-tuple classification.
  8. [1606-DONE] security - cop white-/black-list ip4 src addr filtering.
  9. [1609-DONE] VPN routed forwarding (VRF) - baseline. CSIT-237

IPv6 control plane - ip6cp

JIRA status for ip6cp tasks:

Original CSIT plan:

  1. [1609-P1] DHCPv6 proxy. CSIT-31
  2. [1609-P2] [TODO VPP-xxx] ip6-ioam, in-band OAM.
  3. [1609-P2] DHCPv6 client. CSIT-242
  4. [1606-DONE] neighbor discovery, RFC4861.
  5. [1606-DONE] ICMPv6.
  6. [1609-DONE] router advertisement - baseline tests. CSIT-241

IPv6 encapsulations - ip6enc

JIRA status for ip6enc tasks:

Original CSIT plan:

  1. [1609-P1] ip6-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-243
  2. [1609-P1] ip6-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-244
  3. [1609-P1] ip4-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-245
  4. [1609-P1] ip4-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-246
  5. [1609-P1] ip6-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-247
  6. [1609-P1] ip6-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-248
  7. [1609-P1] ip4-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), phy2lisp, virt2lisp. CSIT-249
  8. [1609-P1] ip4-ipsec-lispgpe-ip6 - main fib, vrf (gpe_vni-to-vrf), lisp2lisp. CSIT-250
  9. [1609-P1] [TODO VPP-xxx] ip6-segment-routing.
  10. [1609-DONE] ip4-o-ip6 softwire - lightweight46. CSIT-32
  11. [1609-DONE] ip4-o-ip6 softwire - map-e. CSIT-197
  12. [1609-DONE] ip4-o-ip6 softwire - map-t. CSIT-353
  13. [1609-DONE] ip6-ipsec-ip6. CSIT-33

IPv6 telemetry - ip6tel

JIRA status for ip6tel tasks:

Original CSIT plan:

  1. [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. CSIT-253
  2. [1609-P1] [Blocked-by VPP-186] Lawful intercept - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. CSIT-254
  3. [1609-DONE] [Blocked-by VPP-204] IPv6 IPFIX - stats collection and export - baseline. CSIT-251
  4. [1609-DONE] [Blocked-by VPP-204] IPv6 IPFIX - stats collection and export - functional scale. CSIT-252

Ethernet L2 data plane - l2dp

JIRA status for l2dp tasks:

Original CSIT plan:

  1. [1609-P1] Integrated Routing-Bridging (IRB) - baseline. CSIT-255
  2. [1606-DONE] L2 Cross-connec - baseline.
  3. [1606-DONE] L2 Cross-connect - with VLAN tag acrobatics 1-to-1, 1-to-2, 2-to-1, 2-to-2.
  4. [1606-DONE] Bridge domain - baseline.
  5. [1609-DONE] Bridge domain - with VLAN tag acrobatics 1-to-1, 1-to-2, 2-to-1, 2-to-2. CSIT-35

Ethernet L2 control plane - l2cp

JIRA status for l2cp tasks:

Original CSIT plan:

  1. [1609-P2] [TODO VPP-xxx] CDP/LLDP.
  2. [1606-DONE] MAC learning.
  3. [1606-DONE] MAC split-horizon.

Ethernet L2 encapsulations - l2enc

JIRA status for l2enc tasks:

Original CSIT plan:

  1. [1609-P1] l2-eth-lispgpe-ip6 - L2BD. CSIT-256
  2. [1609-P1] l2-eth-lispgpe-ip4 - L2BD. CSIT-257
  3. [1609-P1] l2eth-gre-ip4-ipsec-ip4-eth - L2BD. CSIT-258
  4. [1609-P2] l2-eth-l2tpv3-ip4 - L2BD, L2XC. CSIT-259
  5. [1609-P2] l2-eth-l2tpv3-ip6 - L2BD, L2XC. CSIT-260
  6. [1609-P2] l2-eth-gre-ip4 - L2BD. CSIT-261
  7. [1609-P2] l2-eth-gre-ip6 - L2BD. CSIT-262
  8. [1606-DONE] l2-vxlan-ipv4 - with bridge-domain.
  9. [1606-DONE] l2-vxlan-ipv4 - with L2 cross-connect.

Ethernet L2 telemetry - l2tel

JIRA status for l2tel tasks:

Original CSIT plan:

  1. [1609-P1] L2 FIB - stats collection and export - baseline. CSIT-263
  2. [1609-P2] L2 FIB - stats collection and export - functional scale. CSIT-264
  3. [1609-P1] [Blocked-by VPP-185] Switched port analyzer mirroring SPAN - (flow,port) mirroring to local port - baseline. CSIT-265
  4. [1609-P1] [Blocked-by VPP-186] Lawful intercept - (flow,port) mirroring to remote locatio via LI UDP tunnel - baseline. CSIT-266

MPLS data plane - mplsdp

  • JIRA views: [board], [list].

Original CSIT plan:

  1. [1609-P2] vpnv4-mpls-gre-ip4. CSIT-267
  2. [1609-P2] mpls-o-eth. CSIT-268

NSH data plane - nshdp

  • JIRA views: [board], [list].

Original CSIT plan:

  1. [1609-P1] ip4-nsh-gre-ip4. CSIT-269
  2. [1609-P1] ip4-nsh-vxlan-gpe-ip4. CSIT-270

OPNFV-FDS integration

Original CSIT plan:

  1. [1606-DONE] FDS VM scenario with two L2 bridge domains – ICMPv4.
  2. [1606-DONE] FDS VM scenario with two L2 bridge domains with static L2FIB entries – ICMPv4.
  3. [1606-DONE] FDS VM scenario with two L2 bridge domains – ICMPv6.
  4. [1606-DONE] FDS VM scenario with two L2 bridge domains with static L2FIB entries – ICMPv6.
  5. [1606-DONE] FDS VM scenario with L2 cross-connect – ICMPv4.
  6. [1606-DONE] FDS VM scenario with L2 cross-connect – ICMPv6.
  7. [1606-DONE] FDS L2 test cases with tenant networks (VXLAN).
  8. [1606-DONE] FDS L2 test cases with provider physical networks (VLAN).
Retrieved from "https://wiki.fd.io/index.php?title=CSIT/FuncTestPlan&oldid=2952"