TSC/fdio lab funding proposal

From fd.io
< TSC
Jump to: navigation, search

LFN FD.io Lab Funding Proposal v3

Purpose

This note constitutes an agreement governing the funding and donations of hardware equipment and software in FD.io labs hosted by LFN.

Need to be reviewed and approved by FD.io TSC and project participants' representatives.

The key words "MUST" , "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC 2119.

FD.io Lab Equipment Funding Sources

Following main funding sources have been identified:

  • LFN FD.io project budget.
  • FD.io project participants' donations, including:
    • AMD.
    • Arm.
    • Cisco.
    • Intel.
    • Mellanox.

Lab Equipment in Scope

Following hardware equipment and software are in scope for this note:

  • Servers for FD.io software builds.
  • Servers FD.io functional device testing.
  • Servers FD.io performance benchmarking.
  • All associated networking pluggables and cabling.

Funding Model Proposal

LFN FD.io funds SHOULD be used for acquiring common hardware that can not be funded by the project participants collaborating in LFN FD.io project.

Project participants commit to fund parts of and/or complete systems under test (SUT) that:

  1. Are of interest for FD.io project community, and
  2. Are manufactured and/or provided by them, and
  3. Are in their interest to be evaluated by FD.io project, and
  4. Are to benefit FD.io project community.

Project participants are also encouraged to fund common equipment including Traffic Generator (TG) servers, network pluggables and cabling.

In order to ensure the most cost effective (best possible) equipment acquisition model using LFN FD.io funds, project participants are encouraged to consider the following rules when donating equipment:

  1. SUT Equipment
    1. If project participant is manufacturing complete systems, complete server system SHOULD be donated by project participant.
    2. If project participant is manufacturing parts/sub-systems of a complete system, those parts SHOULD be donated by project participant.
    3. It is left at the discretion of the project participant to fund spares, network pluggables and cabling.
  2. TG Equipment
    1. Traffic Generator equipment is treated as common equipment.
    2. Project participant either funds common TG equipment or makes a meaningful contribution to the FD.io lab, be it equipment or otherwise.
    3. It is left at the discretion of the project participant to fund spares, network pluggables and cabling.
    4. Refer to FD.io CSIT TG server platform recommendations CSIT-TG.
  3. Software Build equipment
    1. If project participant is manufacturing complete systems, complete server system SHOULD be donated by project participant.
    2. If project participant is manufacturing parts/sub-systems of a complete system, those parts SHOULD be donated by project participant.
    3. It is left at the discretion of the project participant to fund spares, network pluggables and cabling.

LFN FD.io funds are used for:

  • Any required common equipment that has not been donated and is required to build fully functional testing and build environment.
  • Installation of equipment.
  • Recurring DC hosting costs, as well as costs associated with physical operation and maintenance of all LFN FD.io equipment.

FD.io lab extension with new equipment is subject to review and approval by the project participants and the community, including the impact on recurring DC hosting costs. LFN FD.io funding is subject to review and approval by LFN Finance Committee.

Current Lab Equipment

FD.io Software Builds

Currently FD.io SW builds are performed on a range of Intel/Xeon and Arm servers.

Intel Xeon servers are built using Xeon processors donated by Intel, with all other components funded by LFN FD.io budget.

Arm servers have been donated in full by Arm.

Any future lab extensions in this area should by governed by this funding note.

FD.io Functional Device Testing

Currently FD.io functional device testing is using following testbeds:

Arm

Testbed 1-Node-ThunderX2:

  • SUT server (cn9975)
    • Arm donated: complete ThunderX2 Arm server with multi-vendor NICs.
    • Intel donated: Intel 2p100GE E810 CVL NICs.
    • LFN FD.io funded: Network pluggables and cables.

Xeon

Testbeds 1-Node-Skylake, 1-Node-Cascadelake:

  • SUT servers (8180, 6252N)
    • Intel donated: Xeon processors and Intel NICs.
    • LFN FD.io funded: All non-processor common HW (chassis, motherboards, memory, disks).
    • LFN FD.io funded: Network pluggables and cables.

Any future lab extensions in this area should by governed by this funding note.

FD.io Performance Benchmarking

Currently FD.io performance testing is using following testbeds:

Atom

Testbeds 2-Node-Denverton, 3-Node-Denverton, 3-Node-Rangeley:

  • SUT servers (C3858, C2758)
    • Intel donated: complete Denverton servers with Intel NICs (with pluggables and cables).
    • Netgate donated: complete Rangeley servers with NICs.
    • LFN FD.io funded: network pluggables and cables for 3-Node-Rangeley testbed.
  • TG servers (8180)
    • Intel donated: Xeon processors, Intel NICs (with pluggables and cables) and all Intel SSD drives.
    • LFN FD.io funded: All non-processor common HW (chassis, motherboards, memory, disks).
    • LFN FD.io funded: network pluggables and cables for 3-Node-Rangeley testbed.

Arm

Testbeds 3-Node-Taishan, 2-Node-ThunderX2:

  • SUT servers (hip07-d05, cn9975)
    • Arm donated: complete Taishan and ThunderX2 Arm servers with multi-vendor NICs.
    • LFN FD.io funded: Network pluggables and cables.
  • TG servers (8180)
    • Intel donated: Xeon processors and Intel NICs.
    • LFN FD.io funded: All non-processor common HW (chassis, motherboards, memory, disks).
    • LFN FD.io funded: Network pluggables and cables.

AMD

Testbed 2-Node-Zen2:

  • SUT servers (EPYC 7532)
    • AMD donated: complete Zen2 servers with multi-vendor NICs.
    • AMD donated: Network pluggables and cables.
  • TG servers (EPYC 7532)
    • AMD donated: complete Zen2 servers with multi-vendor NICs.
    • AMD donated: Network pluggables and cables.

Xeon

Testbeds 2-Node-Cascadelake, 3-Node-Haswell, 2-Node-Skylake, 3-Node-Skylake:

  • SUT servers (6252N, E5-2699v3, 8180)
    • Cisco donated: complete UCS c240M3 servers with E5-2699v3 processors and multi-vendor NICs (with pluggables and cables).
    • Intel donated: Xeon 8180 and 6252N processors, Intel NICs (with pluggables and cables) and all Intel SSD drives.
    • LFN FD.io funded: Some non-processor common HW (chassis, motherboards, memory, spinning hard-disks).
    • LFN FD.io funded: Some network pluggables and cables.
    • Mellanox donated: mcx556a-edat ConnectX5-2p100GE Mellanox NICs in 2-Node-Cascadelake testbeds.
  • TG servers (8280, E5-2699v3, 8180)
    • Cisco donated complete 3-Node-Haswell setup: complete UCS c240M3 servers with E5-2699v3 processors and multi-vendor NICs (with pluggables and cables).
    • Intel donated: Xeon 8180 and 6252N processors, Intel NICs (with pluggables and cables)and all Intel SSD drives.
    • LFN FD.io funded: Some non-processor common HW (chassis, motherboards, memory, spinning hard-disks).
    • LFN FD.io funded: Some network pluggables and cables.
    • Mellanox donated: mcx556a-edat ConnectX5-2p100GE Mellanox NICs in 2-Node-Cascadelake testbeds.

References

[CSIT-TG], CSIT TG servers, https://wiki.fd.io/view/CSIT/csit_tg_servers