Revision as of 08:00, 22 May 2020

Nomad clusters are hosted on dedicated servers in the FD.io lab and used to manage Docker container based executors for FD.io project CI jobs.

Physical Lab Infrastructure

• FD.io CSIT git repository keeps an up-to-date FD.io lab specification.
• Server naming convention is specified here.

Nomad Operational Status

• TBD - add description or link to Nomad architecture / configuration
• TBD - Add links to Nomad monitoring status / data

Jenkins Nomad Plugin Configuration

Proposed Jenkins Nomad Plugin Label to Docker Image Mapping

Jenkins Nomad Plugin Labels can only be created via LF Service Desk requests. In order to test CI jobs in the Jenkins Sandbox, a different label must exist which points to a sandbox Dockerhub repository to avoid disrupting operational jobs during docker image testing. This is the proposed nomenclature for the mapping of Jenkins Nomad Plugin labels and the corresponding dockerhub repositories (production and sandbox variants).

All new docker images will first be pushed to the Dockerhub associated 'sandbox repo' and all CI jobs utilizing the Jenkins Nomad Plugin Label will be verified in the Jenkins Sandbox, by modifying the appropriate JJB YAML files to point to the sandbox repo. Once all CI jobs have been verified, then the image will be pushed to the operational dockerhub repository associated with the label.

NOTE: the 'sandbox labels' should NEVER be merged into the ci-management repository.

fdiotools-prod-{arch}-{os} fdiotools-sandbox-{arch}-{os}

QUESTION 1: Is there a need for project specific images?

QUESTION 2: Is there a need for different size labels (small, medium, large) with different resource allocations (eg. CPU, Memory, etc)?

Legacy Jenkins Label to Docker Image Mapping

These labels are currently defined (circa VPP 20.05) and will be removed once there are no references to them in the ci-management repo. Some of them are not being used today.

Nomad Operations Tasks

This is the current list of high priority Nomad tasks.

Nomad Planning Wish List

This is the list of long term Nomad tasks. Please move them to the Nomad Operations Tasks and provide owner/ET information when they are being actively worked on.

• Add Nomad nodes to LF DNS & make the names the same as the hostname
• Add VPP 'make test-debug w/ ASAN enabled' verify job
• Nomad server OS upgrades/normalization. Utilize ansible to create a uniform bare-metal OS environment across all Nomad servers.
• Convert Jenkins Nomad-plugin configuration spreadsheet to JJB managed YAML configuration files.
• Investigate Jenkins Nomad-plugin security issues.
• Convert Nomad/Jenkins/Gerrit monitoring/screen-scraping hacks into an operational monitoring system using exported gerrit & jenkins logs & nomad cli output.
• Add a mechanism to measure/track the memory consumed by the CI jobs inside Docker images

Completed Nomad Tasks