CSIT/CSIT LF testbed
From fd.io
Contents
FD.IO CSIT testbed - Server HW Configuration
CSIT testbed contains following three HW configuration types of UCS x86 servers, across total of ten servers provided:
1. Type-1: Purpose - VPP functional and performance conformance testing.
- Quantity: 6 computers as SUT hosts (Systems Under Test).
- Physical connectivity:
- CIMC and host management ports.
- NIC ports connected in 3-node topologies.
- Main HW configuration:
- Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
- Processors: 2* E5-2699 2.3 GHz.
- RAM Memory: 16* 32GB DDR4-2133MHz.
- Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
- NICs configuration:
- Right PCIe Riser Board (Riser 1) (x8, x8, x8 PCIe3.0 lanes)
- PCIe Slot1: Cisco VIC 1385 2p40GE.
- PCIe Slot2: Intel NIC x520 2p10GE.
- PCIe Slot3: empty.
- Left PCIe Riser Board (Riser 2) (x8, x16, x8 PCIe3.0 lanes)
- PCIe Slot4: Intel NIC xl710 2p40GE.
- PCIe Slot5: Intel NIC x710 2p10GE.
- PCIe Slot6: empty.
- MLOM slot: Cisco VIC 1227 2p10GE (x8 PCIe2.0 lanes).
2. Type-2: Purpose - VPP functional and performance conformance testing.
- Quantity: 3 computers as TG hosts (Traffic Generators).
- Physical connectivity:
- CIMC and host management ports.
- NIC ports connected in 3-node topologies.
- Main HW configuration:
- Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
- Processors: 2* E5-2699 2.3 GHz.
- RAM Memory: 16* 32GB DDR4-2133MHz.
- Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD.
- NICs configuration:
- Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
- PCIe Slot1: Intel NIC xl710 2p40GE.
- PCIe Slot2: Intel NIC x710 2p10GE.
- PCIe Slot3: Intel NIC x710 2p10GE.
- Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
- PCIe Slot4: Intel NIC xl710 2p40GE.
- PCIe Slot5: Intel NIC x710 2p10GE.
- PCIe Slot6: Intel NIC x710 2p10GE.
- MLOM slot: empty.
3. Type-3: Purpose - VIRL functional conformance.
- Quantity: 1 computer as VIRL host.
- Physical connectivity:
- CIMC and host management ports.
- no NIC ports, standalone setup.
- Main HW configuration:
- Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots.
- Processors: 2* E5-2699 2.3 GHz.
- RAM Memory: 16* 32GB DDR4-2133MHz.
- Disks: 2* 480 GB 2.5inch 6G SATA SSD.
- NICs configuration:
- Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes)
- no cards.
- Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes)
- no cards.
- MLOM slot: empty.
FD.IO CSIT Testbeds - Physical Connectivity
Total of 10 UCSC-C240-M4SX servers is made available for FD.IO CSIT testbed. For management purposes, each server must have following two ports connected to the management network:
1. 1GE CIMC port - CIMC - Cisco Integrated Management Controller. - Required for provides embedded server management with WebUI, CLI, SNMPv3, IPMIv2.0. 2. 1GE management port - hostOS management port.
Naming Convention
Following naming convention is used within this page to specify physical connectivity and wiring across defined CSIT testbeds:
- testbedname: testbedN.
- hostname:
- traffic-generator: tN-tgW.
- system-under-testX: tN-sutX.
- portnames:
- tN-tgW-cY/pZ.
- tN-sutX-cY/pZ.
- where:
- N - testbed number.
- tgW - server acts as traffic-generator with W index.
- sutX - server acts as system-under-test with X index.
- Y - PCIe slot number denoting a NIC card number within the host.
- Y=1,2,3 - slots in Riser 1, Right PCIe Riser Board, NUMA node 0.
- Y=4,5,6 - slots in Riser 2, Left PCIe Riser Board, NUMA node 1.
- Y=m - the MLOM slot.
- Z - port number on the NIC card.
3-node Topology Testbeds for Functional and Performance Conformance
Nine servers are used to build three of 3-node topologies, with each topology using two servers of Type-1 (SUT function) and one server of Type-2 (TG function). Server NIC cards are placed and NIC ports are connected using the scheme defined in next sections.
CIMC and Management networks
Each server has a CIMC and a Management port, which are connected to two different VLANs.
1. CIMC Vlan: - Subnet: 10.30.50.0/24 - Gateway: 10.30.50.1 - Broadcast: 10.30.50.255 - DNS1: 199.204.44.24 - DNS2: 199.204.47.54 2. Management Vlan: - Subnet: 10.30.51.0/24 - Gateway: 10.30.51.1 - Broadcast: 10.30.51.255 - DNS1: 199.204.44.24 - DNS2: 199.204.47.54
To access these hosts, an VPN connection is required.
Testbeds1,2,3 Server and Ports Naming and NIC Placement
Each server in 3-node Topology has its NIC cards placed, and NIC cards and ports indexed using defined naming convention:
1. Server1 of Type-1:
- testbedname: testbed1.
- hostname: t1-sut1.
- CIMC IP: 10.30.50.17
- Host IP: 10.30.51.17
- portnames:
- t1-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
- t1-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
- t1-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
- t1-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
- t1-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t1-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t1-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t1-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t1-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
- t1-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
2. Server2 of Type-1:
- testbedname: testbed1.
- hostname: t1-sut2.
- CIMC IP: 10.30.50.18
- Host IP: 10.30.51.18
- portnames:
- t1-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
- t1-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
- t1-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
- t1-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
- t1-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t1-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t1-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t1-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t1-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
- t1-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
3. Server3 of Type-2:
- testbedname: testbed1.
- hostname: t1-tg1.
- CIMC IP: 10.30.50.16
- Host IP: 10.30.51.16
- portnames:
- t1-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t1-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t1-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t1-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t1-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t1-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t1-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t1-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t1-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t1-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t1-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t1-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
4. Server4 of Type-1:
- testbedname: testbed2.
- hostname: t2-sut1.
- CIMC IP: 10.30.50.21
- Host IP: 10.30.51.21
- portnames:
- t2-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
- t2-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
- t2-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
- t2-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
- t2-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t2-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t2-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t2-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t2-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
- t2-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
5. Server5 of Type-1:
- testbedname: testbed2.
- hostname: t2-sut2.
- CIMC IP: 10.30.50.22
- Host IP: 10.30.51.22
- portnames:
- t2-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
- t2-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
- t2-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
- t2-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
- t2-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t2-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t2-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t2-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t2-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
- t2-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
6. Server6 of Type-2:
- testbedname: testbed2.
- hostname: t2-tg1.
- CIMC IP: 10.30.50.20
- Host IP: 10.30.51.20
- portnames:
- t2-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t2-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t2-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t2-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t2-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t2-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t2-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t2-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t2-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t2-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t2-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t2-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
7. Server7 of Type-1:
- testbedname: testbed3.
- hostname: t3-sut1.
- CIMC IP: 10.30.50.25
- Host IP: 10.30.51.25
- portnames:
- t3-sut1-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
- t3-sut1-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
- t3-sut1-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
- t3-sut1-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
- t3-sut1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t3-sut1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t3-sut1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t3-sut1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t3-sut1-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
- t3-sut1-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
8. Server8 of Type-1:
- testbedname: testbed3.
- hostname: t3-sut2.
- CIMC IP: 10.30.50.26
- Host IP: 10.30.51.26
- portnames:
- t3-sut2-c1/p1 - 10GE port1 on Intel NIC x520 2p10GE.
- t3-sut2-c1/p2 - 10GE port2 on Intel NIC x520 2p10GE.
- t3-sut2-c2/p1 - 40GE port1 on Cisco VIC 1385 2p40GE.
- t3-sut2-c2/p2 - 40GE port2 on Cisco VIC 1385 2p40GE.
- t3-sut2-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t3-sut2-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t3-sut2-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t3-sut2-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t3-sut2-cm/p1 - 10GE port1 on Cisco VIC 1227 2p10GE.
- t3-sut2-cm/p2 - 10GE port2 on Cisco VIC 1227 2p10GE.
9. Server9 of Type-2:
- testbedname: testbed3.
- hostname: t3-tg1.
- CIMC IP: 10.30.50.24
- Host IP: 10.30.51.24
- portnames:
- t3-tg1-c1/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t3-tg1-c1/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t3-tg1-c2/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t3-tg1-c2/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t3-tg1-c3/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t3-tg1-c3/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t3-tg1-c4/p1 - 40GE port1 on Intel NIC xl710 2p40GE.
- t3-tg1-c4/p2 - 40GE port2 on Intel NIC xl710 2p40GE.
- t3-tg1-c5/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t3-tg1-c5/p2 - 10GE port2 on Intel NIC x710 2p10GE.
- t3-tg1-c6/p1 - 10GE port1 on Intel NIC x710 2p10GE.
- t3-tg1-c6/p2 - 10GE port2 on Intel NIC x710 2p10GE.
Testbeds1,2,3 Server and Ports Physical Connectivity
Listed nine servers are connected into the three of 3-node testbeds, testbed1, testbed2 and testbed3, using defined naming convention as follows:
1. testbed1:
- ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
- t1-tg1-c1/p1 to t1-sut1-c1/p2.
- t1-sut1-c1/p1 to t1-sut2-c1/p2.
- t1-sut2-c1/p1 to t1-tg1-c1/p2.
- ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
- t1-tg1-c2/p1 to t1-sut1-c2/p2.
- t1-sut1-c2/p1 to t1-sut2-c2/p2.
- t1-sut2-c2/p1 to t1-tg1-c2/p2.
- ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
- t1-tg1-c4/p1 to t1-sut1-c4/p2.
- t1-sut1-c4/p1 to t1-sut2-c4/p2.
- t1-sut2-c4/p1 to t1-tg1-c4/p2.
- ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
- t1-tg1-c5/p1 to t1-sut1-c5/p2.
- t1-sut1-c5/p1 to t1-sut2-c5/p2.
- t1-sut2-c5/p1 to t1-tg1-c5/p2.
- ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
- t1-tg1-c2/p1 to t1-sut1-cm/p2.
- t1-sut1-cm/p1 to t1-sut2-cm/p2.
- t1-sut2-cm/p1 to t1-tg1-c2/p2.
- TG loopback ports Intel NIC x710 2p10GE
- t1-tg1-c6/p1 to t1-tg1-c6/p2.
2. testbed2:
- ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
- t2-tg1-c1/p1 to t2-sut1-c1/p2.
- t2-sut1-c1/p1 to t2-sut2-c1/p2.
- t2-sut2-c1/p1 to t2-tg1-c1/p2.
- ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
- t2-tg1-c2/p1 to t2-sut1-c2/p2.
- t2-sut1-c2/p1 to t2-sut2-c2/p2.
- t2-sut2-c2/p1 to t2-tg1-c2/p2.
- ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
- t2-tg1-c4/p1 to t2-sut1-c4/p2.
- t2-sut1-c4/p1 to t2-sut2-c4/p2.
- t2-sut2-c4/p1 to t2-tg1-c4/p2.
- ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
- t2-tg1-c5/p1 to t2-sut1-c5/p2.
- t2-sut1-c5/p1 to t2-sut2-c5/p2.
- t2-sut2-c5/p1 to t2-tg1-c5/p2.
- ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
- t2-tg1-c2/p1 to t2-sut1-cm/p2.
- t2-sut1-cm/p1 to t2-sut2-cm/p2.
- t2-sut2-cm/p1 to t2-tg1-c2/p2.
- TG loopback ports Intel NIC x710 2p10GE
- t2-tg1-c6/p1 to t2-tg1-c6/p2.
3. testbed3:
- ring of 40GE ports on Cisco VIC 1385 2p40GE on SUTs
- t3-tg1-c1/p1 to t3-sut1-c1/p2.
- t3-sut1-c1/p1 to t3-sut2-c1/p2.
- t3-sut2-c1/p1 to t3-tg1-c1/p2.
- ring of 10GE ports on Intel NIC x520 2p10GE on SUTs
- t3-tg1-c2/p1 to t3-sut1-c2/p2.
- t3-sut1-c2/p1 to t3-sut2-c2/p2.
- t3-sut2-c2/p1 to t3-tg1-c2/p2.
- ring of 40GE ports on Intel NIC xl710 2p40GE on SUTs
- t3-tg1-c4/p1 to t3-sut1-c4/p2.
- t3-sut1-c4/p1 to t3-sut2-c4/p2.
- t3-sut2-c4/p1 to t3-tg1-c4/p2.
- ring of 10GE ports on Intel NIC x710 2p10GE on SUTs
- t3-tg1-c5/p1 to t3-sut1-c5/p2.
- t3-sut1-c5/p1 to t3-sut2-c5/p2.
- t3-sut2-c5/p1 to t3-tg1-c5/p2.
- ring of 10GE ports on Cisco VIC 1227 2p10GE on SUTs
- t3-tg1-c2/p1 to t3-sut1-cm/p2.
- t3-sut1-cm/p1 to t3-sut2-cm/p2.
- t3-sut2-cm/p1 to t3-tg1-c2/p2.
- TG loopback ports Intel NIC x710 2p10GE
- t3-tg1-c6/p1 to t3-tg1-c6/p2.
