Nomad Operations and Planning

Revision as of 21:57, 15 May 2020 by Dwallacelf (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Nomad Operations and Planning

Nomad clusters are hosted on dedicated servers in the lab and used to manage Docker container based executors for project CI jobs.

Nomad Operational Status

  • TBD - add description or link to Nomad architecture / configuration
  • TBD - Add links to Nomad monitoring status / data

Nomad Operations Tasks

This is the current list of high priority Nomad tasks.

Task Description Owner  % Complete ETA
Add a sudoer/admin account to all Nomad Servers. Dave W. 90% May 18, 2020
Move Nomad Docker images from into fdiotools dockerhub account. Dave W. 10% May 18, 2020
Update Ubuntu1804 & Centos7 Nomad Docker images to include clang-9 toolchain packages required by VPP 'make install-deps'. Dave W. 10% May 20, 2020
Perform fresh installation of Ubuntu 18.04 Server on t4-virl1, t4-virl2, & t4-virl3 Peter M.
Restore Nomad configuration on t4-virl1, t4-virl2, & t4-virl3 and rejoin on VPP cluster. Dave W.
Fix server-type-c4-3 ( SDD with an HDD, reinstall Ubuntu 18.04 and restore to Nomad cluster.
Update VPP ci-management configurations to use global jjb macros (publisher & Vanessa V.

Nomad Planning Wish List

This is the long term list of Nomad tasks. Please move them to the Nomad Operations Tasks and provide owner/ET information when they are being actively worked on.

  • Add VPP 'make test-debug w/ ASAN enabled' verify job
  • Nomad server OS upgrades/normalization. Utilize ansible to create a uniform bare-metal OS environment across all Nomad servers.
  • Convert Jenkins Nomad-plugin configuration spreadsheet to JJB managed YAML configuration files.
  • Investigate Jenkins Nomad-plugin security issues.
  • Export Gerrit & Jenkins logs and other operational data to Nomad servers
  • Convert Nomad/Jenkins/Gerrit monitoring/screen-scraping hacks into an operational monitoring system using exported gerrit & jenkins logs & nomad cli output.
  • Add a mechanism to measure/track the memory consumed by the CI jobs inside Docker images

Completed Nomad Tasks

Task Description Owner  % Complete Finish Date
Move Nomad build executor Dockerfiles from* into the ci-management project. Dave W. 100% April 29, 2020