Difference between revisions of "CSIT/Jobs"
From fd.io
< CSIT
m (→CSIT Jenkins Periodic Jobs: Periodically verify VPP branch and CSIT branch) |
m (→CSIT Jenkins Periodic Jobs: Periodically verify VPP branch and CSIT branch) |
||
| Line 280: | Line 280: | ||
- 2T2C: two worker thread, two core | - 2T2C: two worker thread, two core | ||
- NDRCHK: Check of NDR throughput | - NDRCHK: Check of NDR throughput | ||
| + | |Once a day between 20:00 and 23:00 | ||
|csit branch 'oper-<$DATE>' | |csit branch 'oper-<$DATE>' | ||
|vpp branch 'master' from nexus.fd.io | |vpp branch 'master' from nexus.fd.io | ||
|WORKING | |WORKING | ||
|} | |} | ||
Revision as of 08:23, 19 May 2017
Contents
VPP Jenkins Verify Jobs: Verify a VPP patch using an operational CSIT branch
The following jenkins jobs verify VPP patches by running CSIT tests based on gerrit events for the VPP git repository or manual scheduling based on gerrit comment trigger keywords posted to a VPP patch in gerrit. The version of the CSIT tests which are executed is determined by a script that is checked into each VPP branch. See CSIT/Branching_Strategy for details.
| Jenkins Job | Description | Gerrit Comment Trigger | Event Triggers | VPP Code | Testbed | Status |
|---|---|---|---|---|---|---|
| vpp-csit-verify-virl-master | Verify VPP patches by running csit functional tests | recheck | gerrit patch commit, gerrit rebase, gerrit edit | vpp branch 'master' + gerrit patch | LF VIRL compute nodes | WORKING |
| vpp-csit-verify-hw-perf-master-short | Verify VPP patches by running csit short performance tests | verify-perf-short | none | vpp branch 'master' + gerrit patch | LF HW compute nodes | WORKING |
| vpp-csit-verify-hw-perf-master-long | Verify VPP patches by running csit long performance tests | verify-perf-long | none | vpp branch 'master' + gerrit patch | LF HW compute nodes | WORKING |
| vpp-csit-verify-hw-perf-master-all | Verify VPP patches by running all csit tests (func., short perf., long perf.) | verify-perf-all | none | vpp branch 'master' + gerrit patch | LF HW compute nodes | WORKING |
| vpp-csit-verify-virl-1606 | Verify VPP patches by running csit functional tests | recheck | gerrit patch commit, gerrit rebase, gerrit edit | vpp branch 'stable/1606' + gerrit patch | LF VIRL compute nodes | WORKING |
| vpp-csit-verify-hw-perf-1606-short | Verify VPP patches by running csit short performance tests | verify-perf-short | none | vpp branch 'stable/1606' + gerrit patch | LF HW compute nodes | WORKING |
| vpp-csit-verify-hw-perf-1606-long | Verify VPP patches by running csit long performance tests | verify-perf-long | none | vpp branch 'stable/1606' + gerrit patch | LF HW compute nodes | WORKING |
| vpp-csit-verify-hw-perf-1606-all | Verify VPP patches by running all csit tests (func., short perf., long perf.) | verify-perf-all | none | vpp branch 'stable/1606' + gerrit patch | LF HW compute nodes | WORKING |
| vpp-csit-verify-virl-1609 | Verify VPP patches by running csit functional tests | recheck | gerrit patch commit, gerrit rebase, gerrit edit | vpp branch 'stable/1609' + gerrit patch | LF VIRL compute nodes | WORKING |
| vpp-csit-verify-hw-perf-1609-short | Verify VPP patches by running csit short performance tests | verify-perf-short | none | vpp branch 'stable/1609' + gerrit patch | LF HW compute nodes | WORKING |
| vpp-csit-verify-hw-perf-1609-long | Verify VPP patches by running csit long performance tests | verify-perf-long | none | vpp branch 'stable/1609' + gerrit patch | LF HW compute nodes | WORKING |
| vpp-csit-verify-hw-perf-1609-all | Verify VPP patches by running all csit tests (func., short perf., long perf.) | verify-perf-all | none | vpp branch 'stable/1609' + gerrit patch | LF HW compute nodes | WORKING |
| vpp-csit-verify-hw-perf-1606 vpp-csit-verify-hw-perf-1609 vpp-csit-verify-hw-perf-1701 vpp-csit-verify-hw-perf-1704 vpp-csit-verify-hw-perf-master |
VPP performance verify - Verify VPP patches by running selected NDR check tests | vpp-verify-perf-l2 vpp-verify-perf-ip4 vpp-verify-perf-ip6 vpp-verify-perf-lisp vpp-verify-perf-vxlan vpp-verify-perf-vhost |
None | vpp branch 'stable/1606' + gerrit patch vpp branch 'stable/1609' + gerrit patch vpp branch 'stable/1701' + gerrit patch vpp branch 'stable/1704' + gerrit patch vpp branch 'stable/master' + gerrit patch |
LF HW compute nodes | vpp-verify-perf-l2 - NDR Values to be updated vpp-verify-perf-ip4 - NDR Values to be updated vpp-verify-perf-ip6 - NDR Values to be updated vpp-verify-perf-lisp - Working vpp-verify-perf-vxlan - NDR Values to be updated vpp-verify-perf-vhost - No NDRCHK tests |
CSIT Jenkins Verify Jobs: Verify a CSIT patch using a validated VPP image
The following jenkins jobs verify CSIT patches by running CSIT tests based on gerrit events for the CSIT git repository or manual scheduling based on gerrit comment trigger keywords posted to a CSIT patch in gerrit. The VPP images used to verify the CSIT patches is based on the latest VPP image that has been validated by the CSIT semi-weekly verify job.
| Jenkins Job | Description | Gerrit Comment Trigger | Event Triggers | CSIT Code | Testbed | Status |
|---|---|---|---|---|---|---|
| csit-vpp-functional-master-virl | Verify CSIT functional tests against a validated VPP 'master' image | recheck | gerrit patch commit, gerrit rebase, gerrit edit | csit branch 'master' + csit patch | LF VIRL compute nodes | WORKING |
| csit-vpp-perf-master-all | Verify CSIT code changes against VPP 'master' - all performance tests | verify-perf-all | none | csit branch 'master' + csit patch | LF HW compute nodes | WORKING |
| csit-vpp-perf-master-long | Verify CSIT code changes against VPP 'master' - long performance tests | verify-perf-long | none | csit branch 'master' + csit patch | LF HW compute nodes | WORKING |
| csit-vpp-functional-1606-virl | Verify CSIT functional tests against a validated VPP 'stable/1606' image | recheck | gerrit patch commit, gerrit rebase, gerrit edit | csit branch 'rls1606' + csit patch | LF VIRL compute nodes | WORKING |
| csit-vpp-perf-1606-all | Verify CSIT code against VPP 16.06 release 'stable/1606' - all performance tests | verify-perf-all | none | csit branch 'rls1606' + csit patch | LF HW compute nodes | WORKING |
| csit-vpp-perf-1606-long | Verify CSIT code against VPP 16.06 release 'stable/1606' - long performance tests | verify-perf-long | none | csit branch 'rls1606' + csit patch | LF HW compute nodes | WORKING |
| csit-vpp-functional-1609-virl | Verify CSIT functional tests against a validated VPP 'stable/1609' image | recheck | gerrit patch commit, gerrit rebase, gerrit edit | csit branch 'rls1609' + csit patch | LF VIRL compute nodes | WORKING |
| csit-vpp-perf-1609-all | Verify CSIT code against VPP 16.09 release 'stable/1609' - all performance tests | verify-perf-all | none | csit branch 'rls1609' + csit patch | LF HW compute nodes | WORKING |
| csit-vpp-perf-1609-long | Verify CSIT code against VPP 16.09 release 'stable/1609' - long performance tests | verify-perf-long | none | csit branch 'rls1609' + csit patch | LF HW compute nodes | WORKING |
| csit-vpp-perf-check-1606 csit-vpp-perf-check-1609 csit-vpp-perf-check-1701 csit-vpp-perf-check-1704 csit-vpp-perf-check-master |
Verify CSIT code against VPP - Run selected tests according to the used trigger
default tags: - 1T1C: one worker thread, one core - 2T2C: two worker thread, two core |
verify-perf-ndrdisc verify-perf-pdrdisc verify-perf-ndrchk |
None | csit branch 'rls1606' + csit patch csit branch 'rls1609' + csit patch csit branch 'rls1701' + csit patch csit branch 'rls1704' + csit patch csit branch 'master' + csit patch |
LF HW compute nodes | TO BE VERIFIED |
| csit-vpp-perf-verify-1606 csit-vpp-perf-verify-1609 csit-vpp-perf-verify-1701 csit-vpp-perf-verify-1704 csit-vpp-perf-verify-master |
perf verify - per csit gerrit patch
default tags: - 1T1C: one worker thread, one core - X520: x520 Niantic NIC - NDRDISC: discovery of NDR throughput |
verify-perf-l2 verify-perf-ip4 verify-perf-ip6 verify-perf-lisp verify-perf-vxlan verify-perf-vhost |
None | csit branch 'rls1606' + csit patch csit branch 'rls1609' + csit patch csit branch 'rls1701' + csit patch csit branch 'rls1704' + csit patch csit branch 'master' + csit patch |
LF HW compute nodes | TO BE VERIFIED |
CSIT Jenkins Periodic Jobs: Periodically verify VPP branch and CSIT branch
Because these jobs take many hours to run, they are only triggered periodically to prevent blocking per patch verification by tying up hardware resources. There are two types of Jenkins periodic jobs:
1. Jobs that verify VPP images using all CSIT tests.
2. Jobs that verify CSIT branch with verified stable VPP build.
| Jenkins Job | Description | Execution Period | CSIT Code | VPP Code | Status |
|---|---|---|---|---|---|
| csit-vpp-verify-master-semiweekly | Verify latest VPP image of 'master' from nexus.fd.io. If all tests pass, the "VPP_STABLE_VER" of 'master' image used to verify CSIT patches can be updated (by CSIT patch). | Twice a week (start at 4AM UTC every Tuesday and Saturday) | csit branch 'oper-<$DATE>' | vpp branch 'master' from nexus.fd.io | WORKING |
| sit-vpp-verify-perf-master-nightly-all | Run performance suite on latest VPP image of 'master' from nexus.fd.io. Publish performance trend: plot | Once a day (start at 8PM UTC) | csit branch 'oper-<$DATE>' | vpp branch 'master' from nexus.fd.io | WORKING |
| csit-vpp-verify-1609-semiweekly | Verify VPP image of 'stable/1609' from nexus.fd.io. If all tests pass, the "VPP_STABLE_VER" of 'stable/1609' image used to verify CSIT patches can be updated (by CSIT patch). | Twice a week (start at 4AM UTC every Tuesday and Saturday) | csit branch 'oper-rls1609-<$DATE>' | vpp branch 'stable/1609' from nexus.fd.io | WORKING |
| csit-vpp-verify-master-weekly | Verify CSIT 'master' HEAD image using "VPP_STABLE_VER" of 'master' branch. If all tests pass, create csit branch 'oper-<$DATE>' that can be used for VPP verify Jenkins jobs. | Once a week (start at 4AM UTC every Sunday) | csit branch 'master' HEAD | stable vpp branch 'master' image from nexus.fd.io | WORKING |
| csit-vpp-verify-1609-weekly | Verify CSIT 'master' HEAD image using "VPP_STABLE_VER" of 'stable/1609' branch. If all tests pass, create csit branch 'oper-rls1609-<$DATE>' that can be used for VPP verify Jenkins jobs. | As required | csit branch 'rls1609' HEAD | stable vpp branch 'stable/1609' image from nexus.fd.io | WORKING |
| csit-vpp-perf-trend-daily-master | Daily perf trending of vpp master build
default tags: - 1T1C: one worker thread, one core - 2T2C: two worker threads, two cores - X520: x520 Niantic NIC - NDRDISC: discovery of NDR throughput |
Once a day between 20:00 and 23:00 | csit branch 'oper-<$DATE>' | vpp branch 'master' from nexus.fd.io | WORKING |
| csit-vpp-perf-ndrchk-daily-master | Check vpp perf ndrchk daily
default tags: - 1T1C: one worker thread, one core - 2T2C: two worker thread, two core - NDRCHK: Check of NDR throughput |
Once a day between 20:00 and 23:00 | csit branch 'oper-<$DATE>' | vpp branch 'master' from nexus.fd.io | WORKING |
