Difference between revisions of "CSIT/AArch64"
From fd.io
< CSIT
GabrielGanne (Talk | contribs) (→Functional test) |
GabrielGanne (Talk | contribs) (→Functional test) |
||
| Line 47: | Line 47: | ||
* 3-Nodes topology | * 3-Nodes topology | ||
* On VM only | * On VM only | ||
| + | * only show failing tests | ||
| + | |||
| + | ''No guarantee that the tests are failing because of arm.'' | ||
<pre> | <pre> | ||
| Line 54: | Line 57: | ||
Func.Crypto.Default.Eth2P-Ethip4Ipsectnl-Ip4Base-Func :: *IPv4 IPsec tunnel... | Func.Crypto.Default.Eth2P-Ethip4Ipsectnl-Ip4Base-Func :: *IPv4 IPsec tunnel... | ||
============================================================================== | ============================================================================== | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
------------------------------------------------------------------------------ | ------------------------------------------------------------------------------ | ||
TC13: VPP process ESP packet in Tunnel Mode with AES-CBC-128 encry... | FAIL | | TC13: VPP process ESP packet in Tunnel Mode with AES-CBC-128 encry... | FAIL | | ||
| Line 102: | Line 82: | ||
19 critical tests, 12 passed, 7 failed | 19 critical tests, 12 passed, 7 failed | ||
19 tests total, 12 passed, 7 failed | 19 tests total, 12 passed, 7 failed | ||
| + | ============================================================================== | ||
| + | Func.crypto.sw_default | ||
| + | ============================================================================== | ||
| + | 2 critical tests, 0 passed, 2 failed | ||
| + | 2 tests total, 0 passed, 2 failed | ||
| + | ============================================================================== | ||
| + | Func.Honeycomb | ||
| + | ============================================================================== | ||
| + | ... Honeycomb not set up ... | ||
| + | All tests fail. | ||
| + | ============================================================================== | ||
| + | Func.Interfaces.* | ||
| + | ============================================================================== | ||
| + | 6 critical test, 6 passed, 0 failed | ||
| + | 6 test total, 6 passed, 0 failed | ||
| + | ============================================================================== | ||
| + | |||
| + | ============================================================================== | ||
</pre> | </pre> | ||
Revision as of 13:24, 18 January 2018
Contents
CSIT TOI
Based on CSIT committers availability, current proposal is to hold two separate 1hr sessions:
TOI-1: Tue 23-Jan 07:00-08:00 PST / 15:00-16:00 UTC / 16:00-17:00 CET TOI-1: Fri 31-Jan 07:00-08:00 PST / 15:00-16:00 UTC / 16:00-17:00 CET
Recent Patches
| add new topology parameter: arch | Merged 2018-01-10 | https://gerrit.fd.io/r/#/c/9474/ |
| update nodes dependency | Merged 2018-01-02 | https://gerrit.fd.io/r/#/c/9584/ |
| update vagrant to use ubuntu 16.04 images | https://gerrit.fd.io/r/#/c/8295/ | |
| warn against virtualenv --system-site-packages | Merged 2017-12-20 | https://gerrit.fd.io/r/#/c/9428/ |
TEST for 2-nodes topology
(gg) based on my tests, in order to reproduce issues more easily across the team.
- set up 2 aarch64 VMs (TG + DUT)
- give them 3 interfaces
- one for management, the other two down for the test
- compile igb_uio (see known issue #1) and load it
- write topology file with `arch: aarch64`
- fill pci_address, and mac_address according to your setup
- create virtualenv following csit README
- virtualenv env
- source env/bin/activate
- pip install -r requirements.txt
- export PATH with vpp_api_test, and PYTHONPATH
cmdline to run functional tests only with debug logs. You need the "__init__.robot" present in the folder you give to pybot.
pybot --debugfile /tmp/debugfile --exitonerror -L TRACE -v TOPOLOGY_PATH:topologies/enabled/topology.yaml tests/vpp/func/
Functional test
Tests status:
- CSIT: 54ad6efd342695d0a7dad5380cc989a8d846f518
- 3-Nodes topology
- On VM only
- only show failing tests
No guarantee that the tests are failing because of arm.
============================================================================== Func.Crypto.Default ============================================================================== Func.Crypto.Default.Eth2P-Ethip4Ipsectnl-Ip4Base-Func :: *IPv4 IPsec tunnel... ============================================================================== ------------------------------------------------------------------------------ TC13: VPP process ESP packet in Tunnel Mode with AES-CBC-128 encry... | FAIL | Expected error 'ESP packet Rx timeout' but got 'Traffic script execution failed'. ------------------------------------------------------------------------------ TC14: VPP process ESP packet in Tunnel Mode with AES-CBC-128 encry... | FAIL | Expected error 'ESP packet Rx timeout' but got 'Traffic script execution failed'. ------------------------------------------------------------------------------ TC15: VPP process ESP packet in Tunnel Mode with AES-CBC-128 encry... | FAIL | Expected error 'ESP packet Rx timeout' but got 'Traffic script execution failed'. ------------------------------------------------------------------------------ TC16: VPP process ESP packet in Tunnel Mode with AES-CBC-128 encry... | FAIL | Traffic script execution failed ------------------------------------------------------------------------------ TC17: VPP process ESP packet in Tunnel Mode with AES-CBC-128 encry... | FAIL | Expected error 'ESP packet Rx timeout' but got 'Traffic script execution failed'. ------------------------------------------------------------------------------ TC18: VPP process ESP packet in Tunnel Mode with AES-CBC-128 encry... | FAIL | Expected error 'ESP packet Rx timeout' but got 'Traffic script execution failed'. ------------------------------------------------------------------------------ TC19: VPP process ESP packet in Tunnel Mode with AES-CBC-128 encry... | FAIL | Expected error 'ESP packet Rx timeout' but got 'Traffic script execution failed'. ------------------------------------------------------------------------------ Func.Crypto.Default.Eth2P-Ethip4Ipsectnl-Ip4Base-Func :: *IPv4 IPs... | FAIL | 19 critical tests, 12 passed, 7 failed 19 tests total, 12 passed, 7 failed ============================================================================== Func.crypto.sw_default ============================================================================== 2 critical tests, 0 passed, 2 failed 2 tests total, 0 passed, 2 failed ============================================================================== Func.Honeycomb ============================================================================== ... Honeycomb not set up ... All tests fail. ============================================================================== Func.Interfaces.* ============================================================================== 6 critical test, 6 passed, 0 failed 6 test total, 6 passed, 0 failed ============================================================================== ==============================================================================
TODO
- identify ARM64 hardware to replicate CSIT repo
- make Jira EPIC for CSIT func
- make Jira EPIC for CSIT performance
- disk-image-builder scripts
- write a bootstrap-* script for aarch64
- add VPP_REPO_URL* VPP_STABLE_VER* files ... (could be any public server for now)
known issues
- dpdk does not compiles igb_uio on aarch64 (it seems to require a kernel patch introduced in kernel 4.12: f719582435afe9c7985206e42d804ea6aa315d33). it has been re-enabled in dpdk v17.11 (f1810113590373b157ebba555d6b51f38c8ca10f)
