CSIT/csit-perf-tc-naming-change

CSIT Performance TCs Naming

Current names

1. Bridge_Domain_Intel-X520-DA2.robot
2. Bridge_Domain_Intel-X710-DA2.robot
3. Bridge_Domain_Intel-XL710.robot
4. Long_Bridge_Domain_Vhost_Intel-X520-DA2.robot
5. Long_IPv4_Cop_Intel-X520-DA2.robot
6. Long_IPv4_Fib_200k_Intel-X520-DA2.robot
7. Long_IPv4_Fib_20k_Intel-X520-DA2.robot
8. Long_IPv4_Fib_2M_Intel-X520-DA2.robot
9. Long_IPv4_Intel-X520-DA2.robot
10. Long_IPv4_Intel-XL710.robot
11. Long_IPv4_Policer_Intel-X520-DA2.robot
12. Long_IPv4_Vhost_Intel-X520-DA2.robot
13. Long_IPv4_iAcl_Intel-X520-DA2.robot
14. Long_IPv6_Cop_Intel-X520-DA2.robot
15. Long_IPv6_Fib_200k_Intel-X520-DA2.robot
16. Long_IPv6_Fib_20k_Intel-X520-DA2.robot
17. Long_IPv6_Fib_2M_Intel-X520-DA2.robot
18. Long_IPv6_Intel-X520-DA2.robot
19. Long_IPv6_Intel-XL710.robot
20. Long_IPv6_iAcl_Intel-X520-DA2.robot
21. Long_Lisp_Intel-X520-DA2.robot
22. Long_Xconnect_Dot1ad_Intel-X520-DA2.robot
23. Long_Xconnect_Dot1q_Intel-X520-DA2.robot
24. Long_Xconnect_Intel-X520-DA2.robot
25. Long_Xconnect_Intel-XL710.robot
26. Long_Xconnect_Vhost_Intel-X520-DA2.robot
27. Long_Xconnect_Vxlan_Ipv4_Intel-X520-DA2.robot
28. Short_Bridge_Domain_Intel-X520-DA2.robot
29. Short_IPv4_Cop_Intel-X520-DA2.robot
30. Short_IPv4_Fib_200k_Intel-X520-DA2.robot
31. Short_IPv4_Fib_20k_Intel-X520-DA2.robot
32. Short_IPv4_Fib_2M_Intel-X520-DA2.robot
33. Short_IPv4_Intel-X520-DA2.robot
34. Short_IPv4_Policer_Intel-X520-DA2.robot
35. Short_IPv4_iAcl_Intel-X520-DA2.robot
36. Short_IPv6_Cop_Intel-X520-DA2.robot
37. Short_IPv6_Fib_200k_Intel-X520-DA2.robot
38. Short_IPv6_Fib_20k_Intel-X520-DA2.robot
39. Short_IPv6_Fib_2M_Intel-X520-DA2.robot
40. Short_IPv6_Intel-X520-DA2.robot
41. Short_IPv6_iAcl_Intel-X520-DA2.robot
42. Short_Lisp_Intel-X520-DA2.robot
43. Short_Xconnect_Dot1ad_Intel-X520-DA2.robot
44. Short_Xconnect_Dot1q_Intel-X520-DA2.robot
45. Short_Xconnect_Intel-X520-DA2.robot
46. Short_Xconnect_Vxlan_Ipv4_Intel-X520-DA2.robot

Change Proposal 1

Proposed names per patch #3856

1. short_x520_dot1ad-l2xc.robot
2. short_x520_dot1q-l2xc.robot
3. short_x520_eth-ip4-base.robot
4. short_x520_eth-ip4-cop-whitelist.robot
5. short_x520_eth-ip4-fib-200k.robot
6. short_x520_eth-ip4-fib-20k.robot
7. short_x520_eth-ip4-fib-2M.robot
8. short_x520_eth-ip4-iacl-dst.robot
9. short_x520_eth-ip4-lisp-ip4.robot
10. short_x520_eth-ip4-lisp-ip6.robot
11. short_x520_eth-ip4-policer-marker.robot
12. short_x520_eth-ip4-vxlan-l2xc.robot
13. short_x520_eth-ip6-base.robot
14. short_x520_eth-ip6-cop-whitelist.robot
15. short_x520_eth-ip6-fib-200k.robot
16. short_x520_eth-ip6-fib-20k.robot
17. short_x520_eth-ip6-fib-2M.robot
18. short_x520_eth-ip6-iacl-dst.robot
19. short_x520_eth-ip6-lisp-ip4.robot
20. short_x520_eth-ip6-lisp-ip6.robot
21. short_x520_eth-l2bd-base.robot
22. short_x520_eth-l2xc-base.robot
23. x520_dot1ad-l2xc.robot
24. x520_dot1q-l2xc.robot
25. x520_eth-ip4-base-vhost.robot
26. x520_eth-ip4-base.robot
27. x520_eth-ip4-cop-whitelist.robot
28. x520_eth-ip4-fib-200k.robot
29. x520_eth-ip4-fib-20k.robot
30. x520_eth-ip4-fib-2M.robot
31. x520_eth-ip4-iacl-dst.robot
32. x520_eth-ip4-lisp-ip4.robot
33. x520_eth-ip4-lisp-ip6.robot
34. x520_eth-ip4-policer-marker.robot
35. x520_eth-ip4-vxlan-l2xc.robot
36. x520_eth-ip6-base.robot
37. x520_eth-ip6-cop-whitelist.robot
38. x520_eth-ip6-fib-200k.robot
39. x520_eth-ip6-fib-20k.robot
40. x520_eth-ip6-fib-2M.robot
41. x520_eth-ip6-iacl-dst.robot
42. x520_eth-ip6-lisp-ip4.robot
43. x520_eth-ip6-lisp-ip6.robot
44. x520_eth-l2bd-base-vhost.robot
45. x520_eth-l2bd-base.robot
46. x520_eth-l2xc-base-vhost.robot
47. x520_eth-l2xc-base.robot
48. x710_eth-l2bd-base.robot
49. xl710_eth-ip4-base.robot
50. xl710_eth-ip6-base.robot
51. xl710_eth-l2bd-base.robot
52. xl710_eth-l2xc-base.robot

Change Proposal 2 - TC Naming Scheme

Test topologies and functions encoded using tree notation with physical ports and NIC on the left (underlay), followed by outer most frame header, then other stacked headers up to the header processed by vSwitch-VPP, then VPP forwarding function, then encap on vhost interface, number of vhost interfaces, number of VMs. Some examples and legend here:

1. 10ge2p1x520-ethip4-ip4base2.robot
2. 10ge2p1x520-ethip4-ip4base20k.robot
3. 10ge2p1x520-ethip4-ip4base200k.robot
4. 10ge2p1x520-ethip4-ip4base2m.robot

1. 10ge2p1x710-ethip4-ip4base2.robot
2. 10ge2p1vic1227-ethip4-ip4base2.robot
3. 40ge2p1xl710-ethip4-ip4base2.robot
4. 40ge2p1vic1385-ethip4-ip4base2.robot

1. 10ge2p1x520-eth-l2bdbase-eth-2vhost-1vm
2. 10ge2p1x520-dot1q-l2bdbase-eth-2vhost-1vm
3. 10ge2p1x520-ethip4-ip4base-eth-2vhost-1vm
4. 10ge2p1x520-eth-l2xcbase-eth-2vhost-1vm
5. 10ge2p1x520-dot1q-l2xcbase-eth-2vhost-1vm
6. 10ge2p1x520-ethip4vxlan-l2bdbase-eth-2vhost-1vm

Legend:

• <n>ge - n=10|40|100
• <n>p - number of physical Ethernet ports
• <n><nic_model> - number of NICs and NIC model
• eth|dot1q|dot1ad
  • eth - untagged Ethernet on the physical wire
  • dot1q - single VLAN tag on physical wire
  • dot1ad - double VLAN tag on physical wire
• ip4|ip6
  • ip4 - IPv4 header
  • ip6 - IPv6 header
• vxlan - VXLAN header
• l2bdbase, l2bdscale - VPP L2 bridge-domain, L2 MAC learning&switching
  • base - baseline test with one L2 MAC flow received per interface
  • scale - scale tests with many L2 MAC flows received per interface
  • distinct L@ MAC flow - distinct (src-mac,dst-mac) tuple in MAC headers
• l2xcbase, l2xcscale - VPP L2 point-to-point crossconnect
  • base - baseline test with one L2 MAC flow received per interface
  • scale - scale tests with many L2 MAC flows received per interface
  • distinct L2 MAC flow - distinct (src-mac,dst-mac) tuple in MAC headers
• ip4base, ip4scale - VPP IPv4 routed forwarding
  • base - baseline test with one IPv4 flow received per interface
  • scale - scale tests with many IPv4 flows received per interface
  • distinct IPv4 flow - distinct (src-ip4,dst-ip4) tuple in IPv4 headers
• Short tests:
  • use suffix "-ndrchk"

Change Proposal 2 - TC Names

1. 2p1nic-eth-l2bdbase-eth-2vhost-1vm-testpmd