Difference between revisions of "CSIT/Meeting"
From fd.io
< CSIT
Mackonstan (Talk | contribs) |
|||
| Line 36: | Line 36: | ||
# Inputs from projects | # Inputs from projects | ||
#* FD.io: VPP, TSC, other. | #* FD.io: VPP, TSC, other. | ||
| − | #* FD.io: [https://wiki.fd.io/view/Project_Proposals/vppcfg **vppcfg** new project proposal] - readout to CSIT postponed | + | #* <del>FD.io: [https://wiki.fd.io/view/Project_Proposals/vppcfg **vppcfg** new project proposal] - readout to CSIT postponed</del> |
| − | # New or | + | # New or refactored tests |
#* E810 flow "offload" tests | #* E810 flow "offload" tests | ||
#** device: WIP updating tests with new dpdk offload flags, Fan. | #** device: WIP updating tests with new dpdk offload flags, Fan. | ||
#** perf: gtpu and ipsec policy tests, Fan. | #** perf: gtpu and ipsec policy tests, Fan. | ||
| − | #*** Trending and report for 3n-icx testbeds only | + | #*** Trending and report for 3n-icx testbeds only (currently broken due to using unsupported TRex + CVL NIC) |
| − | #* Scale tests | + | #* Scale tests API optimization |
#** Moving from VAT to Async PAPI | #** Moving from VAT to Async PAPI | ||
# VPP and CSIT hot items | # VPP and CSIT hot items | ||
| − | #* move to Ubuntu 22.04 | + | #* CSIT env move to Ubuntu 22.04 |
#** docker executor images | #** docker executor images | ||
#** perf testbeds | #** perf testbeds | ||
#** vpp_device testbeds | #** vpp_device testbeds | ||
| − | #** vpp-csit-verify-device jobs | + | #*** currently staying on Ubuntu 20.04 |
| − | + | #*** vpp-csit-verify-device jobs work only with vpp ubuntu 20.04 images | |
#* Intel FVL/CVL driver compatibility matrix - FW, DPDK, AVF | #* Intel FVL/CVL driver compatibility matrix - FW, DPDK, AVF | ||
| − | #** | + | #** Continuously tracked in [https://gerrit.fd.io/r/c/csit/+/36929/3/fdio.infra.ansible/roles/intel/defaults/main.yaml CSIT compatibility matrix] |
| − | #** Reviewed and approved by FD.io Intel team | + | #** Reviewed and approved by FD.io CSIT and Intel team |
| − | + | #* Spectre-BHB security vulnerability (on-hold) | |
| − | + | ||
| − | + | ||
| − | #* Spectre-BHB security vulnerability | + | |
#** [https://gerrit.fd.io/r/c/csit/+/35681 docs: Add references to Spectre-BHB security vulnerability] | #** [https://gerrit.fd.io/r/c/csit/+/35681 docs: Add references to Spectre-BHB security vulnerability] | ||
#** [https://github.com/speed47/spectre-meltdown-checker/pull/418 Waiting for updated spectre-meltdown script.] | #** [https://github.com/speed47/spectre-meltdown-checker/pull/418 Waiting for updated spectre-meltdown script.] | ||
| − | #* AMD performance results review - FD.io CSIT labs vs. AMD CSIT labs, Keesang et al | + | #* <del>AMD performance results review - FD.io CSIT labs vs. AMD CSIT labs, Keesang et al</del> |
#** [http://csit.fd.io/trending/#eNrdkssKwjAQRb-m3ZSBZGrblQsf_yExHR_Q1pBEqX69qRSmXYgiIthNQjh37kwu4_zJ0sZRNY-yZVQsIyyOZTiidJGE62IMYAO6akEKsSc0UrdZliuwZa2gQshnW5AayB_Cq9Vb5QhqazsLXHUW5dmP_JiYw5XJ8y5coCwprqiQiSc36DIchjU7q2pyxxuxMAzPXIckGEk9dvdXM6D9D4v1Q_FhbDjB2PALsd0a_MG2Penyv9v2IjacYGzvblu2jp1X1s9RIIJAQEyECLL-iKkpe5aDTEfsDg9kWyM Current state in CSIT lab.] | #** [http://csit.fd.io/trending/#eNrdkssKwjAQRb-m3ZSBZGrblQsf_yExHR_Q1pBEqX69qRSmXYgiIthNQjh37kwu4_zJ0sZRNY-yZVQsIyyOZTiidJGE62IMYAO6akEKsSc0UrdZliuwZa2gQshnW5AayB_Cq9Vb5QhqazsLXHUW5dmP_JiYw5XJ8y5coCwprqiQiSc36DIchjU7q2pyxxuxMAzPXIckGEk9dvdXM6D9D4v1Q_FhbDjB2PALsd0a_MG2Penyv9v2IjacYGzvblu2jp1X1s9RIIJAQEyECLL-iKkpe5aDTEfsDg9kWyM Current state in CSIT lab.] | ||
# Next Release [https://wiki.fd.io/view/CSIT/csit2210_plan CSIT-2210] | # Next Release [https://wiki.fd.io/view/CSIT/csit2210_plan CSIT-2210] | ||
Revision as of 13:58, 5 October 2022
Meeting Details
Weekly on Wednesday 15:00 Greenwich, London time.
FD.io Zoom Meeting room (passcode <remove spaces> '4 1 2 3 2 4')
If no DST in Europe and US: 07:00 PST, 10:00 EST, 15:00 UTC, 15:00 UK/GMT, 16:00 CET, 17:00 Israel Std Time, 20:30 India Std Time, 23:00 China Std Time.
If DST in Europe: 07:00 PDT, 10:00 EDT, 14:00 UTC, 15:00 UK/BST, 16:00 CEST, 17:00 Israel Summer Time, 19:30 India Std Time, 22:00 China Std Time.
If no DST in Europe and DST in US: 08:00 PDT, 11:00 EDT, 15:00 UTC, 15:00 UK/GMT, 16:00 CET, 17:00 Israel Std Time, 20:30 India Std Time, 23:00 China Std Time.
Topic: FD.io CSIT Project Meeting
Join from PC, Mac, Linux, iOS or Android: https://zoom.us/my/fastdata?pwd=Z3Z0UnJyUmRIMlU3eTJLcGF6VEptQT09
Or iPhone one-tap (US Toll): +14086380968,,5301185804# or +16465588656,,5301185804#
Or Telephone:
Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll)
+1 855 880 1246 (US Toll Free)
+1 877 369 0926 (US Toll Free)
Meeting ID: 530 118 5804
International numbers available: https://zoom.us/zoomconference?m=ppBOQMQTVxGYmbxNsVemC6KNo8eX2ptF
Issues connecting to the meeting? Contact: Maciek Konstantynowicz <mkonstan@cisco.com>.
- IRC
- #fdio-meeting room on libera
- More info: https://lists.fd.io/g/csit-dev/message/4345
- Web-based IRC client: https://web.libera.chat/
- #fdio-meeting room on libera
Agenda
The next CSIT meeting is scheduled for Wednesday 05-Oct 15:00-16:00 Greenwich, London time / 07:00-08:00 PST. Proposed topics:
- Agenda bashing.
- Inputs from projects
- FD.io: VPP, TSC, other.
-
FD.io: **vppcfg** new project proposal - readout to CSIT postponed
- New or refactored tests
- E810 flow "offload" tests
- device: WIP updating tests with new dpdk offload flags, Fan.
- perf: gtpu and ipsec policy tests, Fan.
- Trending and report for 3n-icx testbeds only (currently broken due to using unsupported TRex + CVL NIC)
- Scale tests API optimization
- Moving from VAT to Async PAPI
- E810 flow "offload" tests
- VPP and CSIT hot items
- CSIT env move to Ubuntu 22.04
- docker executor images
- perf testbeds
- vpp_device testbeds
- currently staying on Ubuntu 20.04
- vpp-csit-verify-device jobs work only with vpp ubuntu 20.04 images
- Intel FVL/CVL driver compatibility matrix - FW, DPDK, AVF
- Continuously tracked in CSIT compatibility matrix
- Reviewed and approved by FD.io CSIT and Intel team
- Spectre-BHB security vulnerability (on-hold)
-
AMD performance results review - FD.io CSIT labs vs. AMD CSIT labs, Keesang et al
- CSIT env move to Ubuntu 22.04
- Next Release CSIT-2210
- Physical Infrastructure
- Performance testing: Xeon Skx/Ckx/Icx, Arm, Atom.
- Functional driver testing: Xeon Skx, Arm Tx2.
- Updated LFN FD.io infra support documentation.
- Lab new builds:
- 3n-snr - Atom SnowRidge performance testbed onboarding status.
- Lab extension proposal
- 2022: decommission 2n-skx, 3n-skx
- 2022: add mlx 2p100gbe to icx testbeds, 2n-spr
- 2023: add spr tg, 2n-icxd? (intel), 2n-octeon10-dpu (arm), 2n-zn3 (amd)
- Virtual Infrastructure, CI/CD
- LFN FD.io CI/CD systems.
- Jenkins jobs: csit-vpp, vpp-csit, trending.
- vpp-csit jobs: vpp-csit-verify-device-{..}-tx2 (not voting), vpp-csit-verify-device-{..}-skx (voting)
- Environment, Framework
- VPP API changes' tracking.
- VPP CLI usage in CSIT.
- Functional checks, e.g. "show nat44 summary" to count established sessions.
- VPP changed output in: 34877: nat: TCP state tracking based on RFC 7857/RFC 6146 | https://gerrit.fd.io/r/c/vpp/+/34877
- CSIT test were failing until fix: 35295: fix(nat): parse new show nat44 summary output | https://gerrit.fd.io/r/c/csit/+/35295
- Functional checks, e.g. "show nat44 summary" to count established sessions.
- Trending
- Hoststack tests: Requested tests to be added are the same as CSIT Report Hoststack Iterative Job Specs
- Daily perf tests: mrr-daily test selection, daily csit-report.
- Performance trending: Dashboard, Failures.
- Trendline graphs: L2, IP4, IP6, Vhost, L2 memif, Overlay, Crypto.
- New dynamic dashboard (CSIT UTI).
- Failures, anomalies, breakages
- Current issues
- 01. ALL tests on ALL ARM testbeds are failing with VPP failed to start. CSIT-1857
- 02. all testbeds DPDK l3fwd tests have wrong configuration. CSIT-1858
- 03. 3n-icx: all NFV density-DCR memif-Chain ipsec tests failing with no traffic forwarded. CSIT-1865
- 04. 2n-clx: half of the packets lost on PDR tests (re-opened). CSIT-1864
- 05. 3n-alt: testpmd tests fail with no traffic. CSIT-1848
- 06. 3n-icx: IP4 tunnels GTPU and WIREGUARD tests failing with ~1700 packets lost. CSIT-1862
- 07. 2n-tx2, 3n-tsh: Failed to create container DUT1_CNF1. CSIT-1860
- 08. 3n-icx: All 1000Tnlsw Fixtnlip non AVF tests failing. 1518B with no traffic forwarded, IMIX with excessive packet loss. CSIT-1844
- 09. 2n-dnv: sporadic 1518B tput tests failing to establish required sessions. CSIT-1850
- 10. 3n-icx, 3n-skx: all AVF crypto tests sporadically fail. 1518B with no traffic, IMIX with excessive packet loss. CSIT-1827
- Long term issues
- 11. all testbeds: AF-XDP - NDR tests failing from time to time. CSIT-1802
- 12. 3n-tsh, 3n-alt, 2n-clx testbed (Taishan, Altra, Cascade-lake): NDR tests failing from time to time. CSIT-1804
- 13. VPP does not recognize X553/X557-AT2 10GE. VPP-2010
- 14. multicore AVF tests are failing when trying to create interface. CSIT-1782
- 15. Not all DET44 sessions have been established: 4128767 != 4128768. CSIT-1795
- 16. VPP-1995 i40e driver issue, vlan stripping for VF not working. VPP-1995
- Current issues
- Analytics, Presentation.
- Fd.io Events.
- Housekeeping.
- Maintainers, commit message template, https://www.conventionalcommits.org
