Difference between revisions of "CSIT/Honeycomb/Status"
From fd.io
< CSIT
(updated status) |
|||
| Line 1: | Line 1: | ||
| − | (Up to date as of | + | (Up to date as of 4. November 2016). |
== Status of CSIT-Honeycomb tests == | == Status of CSIT-Honeycomb tests == | ||
| − | * '''Tests are currently not automated!''' The Jenkins job | + | * '''Tests are currently not automated!''' The Jenkins job is missing git integration, the [https://gerrit.fd.io/r/3620 relevant commit] is in review. |
| − | * Manual test runs are possible on Ubuntu 14.04 DUTs with an installed Honeycomb .deb package | + | * Manual test runs are possible on Ubuntu 14.04 and 16.04 DUTs with an installed Honeycomb .deb package |
| − | + | ||
| Line 14: | Line 13: | ||
(Results from local testing, since Jenkins job is not running yet.) | (Results from local testing, since Jenkins job is not running yet.) | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
* Bridge domain: | * Bridge domain: | ||
** Removing bridge domain leaves interfaces assigned to it | ** Removing bridge domain leaves interfaces assigned to it | ||
| Line 28: | Line 20: | ||
*** VPP removes entire table chain, causing desync between Honeycomb operational and config data | *** VPP removes entire table chain, causing desync between Honeycomb operational and config data | ||
*** [https://jira.fd.io/browse/VPP-206 VPP-206] | *** [https://jira.fd.io/browse/VPP-206 VPP-206] | ||
| + | |||
| + | Expected failures (tagged EXPECTED_FAILING): | ||
| + | * Interface management: | ||
| + | ** Cannot read operational data for IPv4/IPv6 neighbor | ||
| + | *** missing VPP API for reading neighbor list | ||
| + | *** [https://jira.fd.io/browse/HONEYCOMB-102 HONEYCOMB-102 ] [https://jira.fd.io/browse/VPP-333 VPP-333 ] | ||
| + | ** Cannot set IPv6 address | ||
| + | *** not implemented | ||
| + | *** [https://jira.fd.io/browse/HONEYCOMB-126 HONEYCOMB-126 ] [https://jira.fd.io/browse/VPP-82 VPP-82 ] | ||
Revision as of 09:17, 4 November 2016
(Up to date as of 4. November 2016).
Status of CSIT-Honeycomb tests
- Tests are currently not automated! The Jenkins job is missing git integration, the relevant commit is in review.
- Manual test runs are possible on Ubuntu 14.04 and 16.04 DUTs with an installed Honeycomb .deb package
Observed Test Failures
Note: Unlike CSIT-core, Honeycomb tests do not add Gerrit "verified" labels to changes (for now). They are only meant to provide information and track issue history with logs.
Lists cause of failure, explanation and Jira ticket where applicable:
(Results from local testing, since Jenkins job is not running yet.)
- Bridge domain:
- Removing bridge domain leaves interfaces assigned to it
- ACL:
- Cannot remove ACL table if multiple tables exist:
- VPP removes entire table chain, causing desync between Honeycomb operational and config data
- VPP-206
- Cannot remove ACL table if multiple tables exist:
Expected failures (tagged EXPECTED_FAILING):
- Interface management:
- Cannot read operational data for IPv4/IPv6 neighbor
- missing VPP API for reading neighbor list
- HONEYCOMB-102 VPP-333
- Cannot set IPv6 address
- not implemented
- HONEYCOMB-126 VPP-82
- Cannot read operational data for IPv4/IPv6 neighbor
