Difference between revisions of "CSIT/CSIT LF testbed"

From fd.io
Jump to: navigation, search
(Created page with "== FD.IO CSIT testbed - Server HW Configuration == CSIT testbed contains following three HW configuration types of UCS x86 servers, across total of ten servers provided: 1....")
 
Line 23: Line 23:
 
             - PCIe Slot6: empty.
 
             - PCIe Slot6: empty.
 
         - MLOM slot: Cisco VIC 1227 2p10GE (x8 PCIe2.0 lanes).
 
         - MLOM slot: Cisco VIC 1227 2p10GE (x8 PCIe2.0 lanes).
−
  2. Type-2: Purpose - OpenVPP functional and performance conformance testing.
+
  2. Type-2: Purpose - VPP functional and performance conformance testing.
 
     - Quantity: 3 computers as TG hosts (Traffic Generators).
 
     - Quantity: 3 computers as TG hosts (Traffic Generators).
 
     - Physical connectivity:
 
     - Physical connectivity:
Line 60: Line 60:
 
         - MLOM slot: empty.
 
         - MLOM slot: empty.
  
−
== OpenVPP CI/CD Testbeds - Physical Connectivity ==
+
== FD.IO CSIT Testbeds - Physical Connectivity ==
  
 
Total of 10 UCSC-C240-M4SX servers is made available for FD.IO CSIT testbed.
 
Total of 10 UCSC-C240-M4SX servers is made available for FD.IO CSIT testbed.

Revision as of 14:58, 17 May 2016

FD.IO CSIT testbed - Server HW Configuration

CSIT testbed contains following three HW configuration types of UCS x86 servers, across total of ten servers provided: 

1. Type-1: Purpose - VPP functional and performance conformance testing.
   - Quantity: 6 computers as SUT hosts (Systems Under Test).
   - Physical connectivity:
       - CIMC and host management ports.
       - NIC ports connected in 3-node topologies.
   - Main HW configuration:
       - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
       - Processors: 2* E5-2667 3.20 GHz v3/135W 8C/20MB Cache/DDR4 2133MHz.
       - RAM Memory: 16* 32GB DDR4-2133MHz.
       - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
   - NICs configuration:
       - Right PCIe Riser Board (Riser 1) (x8, x8, x8 PCIe3.0 lanes)
           - PCIe Slot1: Cisco VIC 1385 2p40GE.
           - PCIe Slot2: Intel NIC x520 2p10GE.
           - PCIe Slot3: empty.
       - Left PCIe Riser Board (Riser 2) (x8, x16, x8 PCIe3.0 lanes)
           - PCIe Slot4: Intel NIC xl710 2p40GE.
           - PCIe Slot5: Intel NIC x710 2p10GE.
           - PCIe Slot6: empty.
       - MLOM slot: Cisco VIC 1227 2p10GE (x8 PCIe2.0 lanes).
2. Type-2: Purpose - VPP functional and performance conformance testing.
   - Quantity: 3 computers as TG hosts (Traffic Generators).
   - Physical connectivity:
       - CIMC and host management ports.
       - NIC ports connected in 3-node topologies.
   - Main HW configuration:
       - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
       - Processors: 2* E5-2667 3.20 GHz v3/135W 8C/20MB Cache/DDR4 2133MHz.
       - RAM Memory: 16* 32GB DDR4-2133MHz.
       - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
   - NICs configuration:
       - Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
           - PCIe Slot1: Intel NIC xl710 2p40GE.
           - PCIe Slot2: Intel NIC x710 2p10GE.
           - PCIe Slot3: Intel NIC x710 2p10GE.
       - Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
           - PCIe Slot4: Intel NIC xl710 2p40GE.
           - PCIe Slot5: Intel NIC x710 2p10GE.
           - PCIe Slot6: Intel NIC x710 2p10GE.
       - MLOM slot: empty.
3. Type-3: Purpose - VIRL functional conformance.
   - Quantity: 1 computer as VIRL host.
   - Physical connectivity:
       - CIMC and host management ports.
       - no NIC ports, standalone setup.
   - Main HW configuration:
       - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
       - Processors: 2* E5-2667 3.20 GHz v3/135W 8C/20MB Cache/DDR4 2133MHz.
       - RAM Memory: 16* 32GB DDR4-2133MHz.
       - Disks: 2* 480 GB 2.5inch 6G SATA SSD.
   - NICs configuration:
       - Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
           - no cards.
       - Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
           - no cards.
       - MLOM slot: empty.

FD.IO CSIT Testbeds - Physical Connectivity

Total of 10 UCSC-C240-M4SX servers is made available for FD.IO CSIT testbed. For management purposes, each server must have following two ports connected to the management network: 

1. 1GE CIMC port
   - CIMC - Cisco Integrated Management Controller.
   - Required for provides embedded server management with WebUI, CLI, SNMPv3, IPMIv2.0.
2. 1GE management port
   - hostOS management port.

Naming Convention

Following naming convention is used within this page to specify physical connectivity and wiring across defined CSIT testbeds: 

- testbedname: testbedN.
- hostname:
   - traffic-generator: tN-tgW.
   - system-under-testX: tN-sutX.
- portnames:
   - tN-tgW-cY/pZ.
   - tN-sutX-cY/pZ.
- where:
   - N - testbed number.
   - tgW - server acts as traffic-generator with W index.
   - sutX - server acts as system-under-test with X index.
   - Y - PCIe slot number denoting a NIC card number within the host.
       - Y=1,2,3 - slots in Riser 1, Right PCIe Riser Board, NUMA node 0.
       - Y=4,5,6 - slots in Riser 2, Left PCIe Riser Board, NUMA node 1.
       - Y=m - the MLOM slot.
   - Z - port number on the NIC card.

3-node Topology Testbeds for Functional and Performance Conformance

Nine servers are used to build three of 3-node topologies, with each topology using two servers of Type-1 (SUT function) and one server of Type-2 (TG function). Server NIC cards are placed and NIC ports are connected using the scheme defined in next sections.

CIMC and Management networks

Each server has a CIMC and a Management port, which are connected to two different VLANs. 

1. CIMC Vlan:
   - Subnet: 10.30.50.0/24
   - Gateway: 10.30.50.1
   - Broadcast: 10.30.50.255
   - DNS1: 199.204.44.24
   - DNS2: 199.204.47.54
2. Management Vlan:
   - Subnet: 10.30.51.0/24
   - Gateway: 10.30.51.1
   - Broadcast: 10.30.51.255
   - DNS1: 199.204.44.24
   - DNS2: 199.204.47.54

To access these hosts, an VPN connection is required.

Testbeds1,2,3 Server and Ports Naming and NIC Placement

Each server in 3-node Topology has its NIC cards placed, and NIC cards and ports indexed using defined naming convention: 

1. Server1 of Type-1:
   - testbedname: testbed1.
   - hostname: t1-sut1.
   - CIMC IP: 10.30.50.17
   - Host IP: 10.30.51.17
   - portnames:
       - t1-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
       - t1-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
       - t1-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
       - t1-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
       - t1-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t1-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t1-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t1-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t1-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
       - t1-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
2. Server2 of Type-1:
   - testbedname: testbed1.
   - hostname: t1-sut2.
   - CIMC IP: 10.30.50.18
   - Host IP: 10.30.51.18
   - portnames:
       - t1-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
       - t1-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
       - t1-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
       - t1-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
       - t1-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t1-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t1-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t1-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t1-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
       - t1-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
3. Server3 of Type-2:
   - testbedname: testbed1.
   - hostname: t1-tg1.
   - CIMC IP: 10.30.50.16
   - Host IP: 10.30.51.16
   - portnames:
       - t1-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t1-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t1-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t1-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t1-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t1-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t1-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t1-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t1-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t1-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t1-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t1-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
4. Server4 of Type-1:
   - testbedname: testbed2.
   - hostname: t2-sut1.
   - CIMC IP: 10.30.50.21
   - Host IP: 10.30.51.21
   - portnames:
       - t2-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
       - t2-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
       - t2-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
       - t2-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
       - t2-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t2-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t2-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t2-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t2-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
       - t2-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
5. Server5 of Type-1:
   - testbedname: testbed2.
   - hostname: t2-sut2.
   - CIMC IP: 10.30.50.22
   - Host IP: 10.30.51.22
   - portnames:
       - t2-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
       - t2-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
       - t2-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
       - t2-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
       - t2-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t2-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t2-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t2-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t2-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
       - t2-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
6. Server6 of Type-2:
   - testbedname: testbed2.
   - hostname: t2-tg1.
   - CIMC IP: 10.30.50.20
   - Host IP: 10.30.51.20
   - portnames:
       - t2-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t2-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t2-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t2-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t2-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t2-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t2-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t2-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t2-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t2-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t2-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t2-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
7. Server7 of Type-1:
   - testbedname: testbed3.
   - hostname: t3-sut1.
   - CIMC IP: 10.30.50.25
   - Host IP: 10.30.51.25
   - portnames:
       - t3-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
       - t3-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
       - t3-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
       - t3-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
       - t3-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t3-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t3-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t3-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t3-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
       - t3-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
8. Server8 of Type-1:
   - testbedname: testbed3.
   - hostname: t3-sut2.
   - CIMC IP: 10.30.50.26
   - Host IP: 10.30.51.26
   - portnames:
       - t3-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
       - t3-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
       - t3-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
       - t3-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
       - t3-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t3-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t3-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t3-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t3-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
       - t3-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
9. Server9 of Type-2:
   - testbedname: testbed3.
   - hostname: t3-tg1.
   - CIMC IP: 10.30.50.24
   - Host IP: 10.30.51.24
   - portnames:
       - t3-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t3-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t3-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t3-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t3-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t3-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t3-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
       - t3-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
       - t3-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t3-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
       - t3-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
       - t3-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.

Testbeds1,2,3 Server and Ports Physical Connectivity

Listed nine servers are connected into the three of 3-node testbeds, testbed1, testbed2 and testbed3, using defined naming convention as follows: 

1. testbed1:
   - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
       - t1-tg1-c1/p1 to t1-sut1-c1/p2.
       - t1-sut1-c1/p1 to t1-sut2-c1/p2.
       - t1-sut2-c1/p1 to t1-tg1-c1/p2.
   - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
       - t1-tg1-c2/p1 to t1-sut1-c2/p2.
       - t1-sut1-c2/p1 to t1-sut2-c2/p2.
       - t1-sut2-c2/p1 to t1-tg1-c2/p2.
   - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
       - t1-tg1-c4/p1 to t1-sut1-c4/p2.
       - t1-sut1-c4/p1 to t1-sut2-c4/p2.
       - t1-sut2-c4/p1 to t1-tg1-c4/p2.
   - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
       - t1-tg1-c5/p1 to t1-sut1-c5/p2.
       - t1-sut1-c5/p1 to t1-sut2-c5/p2.
       - t1-sut2-c5/p1 to t1-tg1-c5/p2.
   - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
       - t1-tg1-c2/p1 to t1-sut1-cm/p2.
       - t1-sut1-cm/p1 to t1-sut2-cm/p2.
       - t1-sut2-cm/p1 to t1-tg1-c2/p2.
   - TG loopback ports Intel NIC x710 2p10GE
       - t1-tg1-c6/p1 to t1-tg1-c6/p2.

2. testbed2:
   - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
       - t2-tg1-c1/p1 to t2-sut1-c1/p2.
       - t2-sut1-c1/p1 to t2-sut2-c1/p2.
       - t2-sut2-c1/p1 to t2-tg1-c1/p2.
   - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
       - t2-tg1-c2/p1 to t2-sut1-c2/p2.
       - t2-sut1-c2/p1 to t2-sut2-c2/p2.
       - t2-sut2-c2/p1 to t2-tg1-c2/p2.
   - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
       - t2-tg1-c4/p1 to t2-sut1-c4/p2.
       - t2-sut1-c4/p1 to t2-sut2-c4/p2.
       - t2-sut2-c4/p1 to t2-tg1-c4/p2.
   - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
       - t2-tg1-c5/p1 to t2-sut1-c5/p2.
       - t2-sut1-c5/p1 to t2-sut2-c5/p2.
       - t2-sut2-c5/p1 to t2-tg1-c5/p2.
   - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
       - t2-tg1-c2/p1 to t2-sut1-cm/p2.
       - t2-sut1-cm/p1 to t2-sut2-cm/p2.
       - t2-sut2-cm/p1 to t2-tg1-c2/p2.
   - TG loopback ports Intel NIC x710 2p10GE
       - t2-tg1-c6/p1 to t2-tg1-c6/p2.

3. testbed3:
   - ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
       - t3-tg1-c1/p1 to t3-sut1-c1/p2.
       - t3-sut1-c1/p1 to t3-sut2-c1/p2.
       - t3-sut2-c1/p1 to t3-tg1-c1/p2.
   - ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
       - t3-tg1-c2/p1 to t3-sut1-c2/p2.
       - t3-sut1-c2/p1 to t3-sut2-c2/p2.
       - t3-sut2-c2/p1 to t3-tg1-c2/p2.
   - ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
       - t3-tg1-c4/p1 to t3-sut1-c4/p2.
       - t3-sut1-c4/p1 to t3-sut2-c4/p2.
       - t3-sut2-c4/p1 to t3-tg1-c4/p2.
   - ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
       - t3-tg1-c5/p1 to t3-sut1-c5/p2.
       - t3-sut1-c5/p1 to t3-sut2-c5/p2.
       - t3-sut2-c5/p1 to t3-tg1-c5/p2.
   - ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
       - t3-tg1-c2/p1 to t3-sut1-cm/p2.
       - t3-sut1-cm/p1 to t3-sut2-cm/p2.
       - t3-sut2-cm/p1 to t3-tg1-c2/p2.
   - TG loopback ports Intel NIC x710 2p10GE
       - t3-tg1-c6/p1 to t3-tg1-c6/p2.
Retrieved from "https://wiki.fd.io/index.php?title=CSIT/CSIT_LF_testbed&oldid=1375"