Difference between revisions of "CSIT/Meeting"
Mackonstan (Talk | contribs) |
|||
Line 31: | Line 31: | ||
== Agenda == | == Agenda == | ||
− | The next CSIT meeting is scheduled for Wednesday | + | The next CSIT meeting is scheduled for Wednesday 07-Dec 15:00-16:00 Greenwich, London time / 07:00-08:00 PST. Proposed topics: |
# Agenda bashing. | # Agenda bashing. | ||
Line 40: | Line 40: | ||
#** device: WIP updating tests with new dpdk offload flags. | #** device: WIP updating tests with new dpdk offload flags. | ||
#** perf: gtpu and ipsec policy tests. | #** perf: gtpu and ipsec policy tests. | ||
− | #*** | + | #*** gtpusw and gtpuhw results comparison - CSIT vs Intel labs |
#* Scale tests API optimization | #* Scale tests API optimization | ||
#** Moving from VAT to Async PAPI | #** Moving from VAT to Async PAPI | ||
# VPP and CSIT hot items | # VPP and CSIT hot items | ||
− | #* CSIT env move to Ubuntu 22.04 | + | #* CSIT env. move to Ubuntu 22.04 |
− | # | + | #** vpp_device testbeds still on Ubuntu 20.04 |
− | + | ||
− | + | ||
#* Intel FVL/CVL driver compatibility matrix - FW, DPDK, AVF | #* Intel FVL/CVL driver compatibility matrix - FW, DPDK, AVF | ||
− | #** | + | #** Tracked in [https://gerrit.fd.io/r/c/csit/+/36929/3/fdio.infra.ansible/roles/intel/defaults/main.yaml CSIT compatibility matrix] |
− | + | ||
#* Spectre-BHB security vulnerability (on-hold) | #* Spectre-BHB security vulnerability (on-hold) | ||
#** [https://gerrit.fd.io/r/c/csit/+/35681 docs: Add references to Spectre-BHB security vulnerability] | #** [https://gerrit.fd.io/r/c/csit/+/35681 docs: Add references to Spectre-BHB security vulnerability] | ||
Line 67: | Line 64: | ||
#** 3n-snr - Atom SnowRidge performance testbed. | #** 3n-snr - Atom SnowRidge performance testbed. | ||
#*** experimental with new TRex v3.00 DPDK ICE driver | #*** experimental with new TRex v3.00 DPDK ICE driver | ||
+ | #*** waiting for new QSFP28 pluggables to address link flapping problem | ||
#* Lab extension proposal | #* Lab extension proposal | ||
− | #** 2022: decommission 2n-skx, 3n-skx | + | #** 2022: decommission 2n-skx, 3n-skx, 2n-dnv, 3n-dnv |
− | #** 2022: add mlx | + | #** 2022: add 4 x 2n-spr; add mlx cx7 2p200ge to 2n-spr; add mlx cx6 2p100ge to 2n-icx and 3n-icx; |
#** 2023: add spr tg, 2n-icxd? (intel), 2n-octeon10-dpu (arm), 2n-zn3 (amd) | #** 2023: add spr tg, 2n-icxd? (intel), 2n-octeon10-dpu (arm), 2n-zn3 (amd) | ||
# Virtual Infrastructure, CI/CD | # Virtual Infrastructure, CI/CD | ||
Line 90: | Line 88: | ||
#** Current issues. | #** Current issues. | ||
#** Priority legend: [H] - high priority, [M] - medium priority, [L] - low priority | #** Priority legend: [H] - high priority, [M] - medium priority, [L] - low priority | ||
− | #*** 01. [H] 2n-icx: NFV density tests breaks VPP which fails to start (re-opened). | + | #*** 01. [H] 2n-aws: All tests fail to start VPP. |
− | #*** | + | #*** 02. [H] 2n-clx, 2n-icx: All tests fail to initialize interface. |
− | #*** | + | #*** 03. [H] 2n-icx: NFV density tests breaks VPP which fails to start (re-opened). |
− | #*** | + | #*** 04. [H] 2n-clx: dpdk tests failing to unbind PCI device. |
− | #*** | + | #*** 05. [M] 3n-snr: All hwasync wireguard tests failing when trying to verify device. [https://jira.fd.io/browse/CSIT-1883 CSIT-1883] |
− | #*** | + | #*** 06. [M] 1n-aws: TRex NDR PDR ALL IP4 scale and L2 scale tests failing with 50% packet loss. [https://jira.fd.io/browse/CSIT-1876 CSIT-1876] |
− | #*** | + | #*** 07. [H] 2n-clx, 2n-zn2: all RDMA tests failing with cli_inband clear runtime command. [https://jira.fd.io/browse/CSIT-1882 CSIT-1882] |
− | #*** | + | #*** 08. [M] 3n-tsh: VM tests failing to boot VM. [https://jira.fd.io/browse/CSIT-1877 CSIT-1877] |
− | #*** | + | #*** 09. [M] 3n-snr: 25GE interface between SUT and TG/TRex goes down randomly. [https://jira.fd.io/browse/CSIT-1871 CSIT-1871] |
− | #*** | + | #*** 10. [H] 2n-clx: half of the packets lost on PDR tests (re-opened). [https://jira.fd.io/browse/CSIT-1864 CSIT-1864] |
+ | #*** 11. [M] 3n-alt, 3n-snr: testpmd tests fail with no traffic. [https://jira.fd.io/browse/CSIT-1848 CSIT-1848] | ||
+ | #*** 12. [L] 2n-dnv: sporadic 1518B tput tests failing to establish required sessions. [https://jira.fd.io/browse/CSIT-1850 CSIT-1850] | ||
+ | #*** 13. [H] 3n-icx, 3n-skx: all AVF crypto tests sporadically fail. 1518B with no traffic, IMIX with excessive packet loss. [https://jira.fd.io/browse/CSIT-1827 CSIT-1827] | ||
#** Long term issues | #** Long term issues | ||
− | #*** | + | #*** 14. [L] all testbeds: AF-XDP - NDR tests failing from time to time. [https://jira.fd.io/browse/CSIT-1802 CSIT-1802] |
− | #*** | + | #*** 15. [M] 3n-tsh, 3n-alt, 2n-clx testbed (Taishan, Altra, Cascade-lake): NDR tests failing from time to time. [https://jira.fd.io/browse/CSIT-1804 CSIT-1804] |
− | #*** | + | #*** 16. [L] VPP does not recognize X553/X557-AT2 10GE. [https://jira.fd.io/browse/VPP-2010 VPP-2010] |
− | #*** | + | #*** 17. [L] multicore AVF tests are failing when trying to create interface. [https://jira.fd.io/browse/CSIT-1782 CSIT-1782] |
− | #*** | + | #*** 18. [L] Not all DET44 sessions have been established: 4128767 != 4128768. [https://jira.fd.io/browse/CSIT-1795 CSIT-1795] |
− | #*** | + | #*** 19. VPP-1995 i40e driver issue, vlan stripping for VF not working. [https://jira.fd.io/browse/VPP-1995 VPP-1995] |
# Analytics, Presentation. | # Analytics, Presentation. | ||
# Fd.io Events. | # Fd.io Events. |
Revision as of 15:42, 30 November 2022
Meeting Details
Weekly on Wednesday 15:00 Greenwich, London time.
FD.io Zoom Meeting room (passcode <remove spaces> '4 1 2 3 2 4')
If no DST in Europe and US: 07:00 PST, 10:00 EST, 15:00 UTC, 15:00 UK/GMT, 16:00 CET, 17:00 Israel Std Time, 20:30 India Std Time, 23:00 China Std Time.
If DST in Europe: 07:00 PDT, 10:00 EDT, 14:00 UTC, 15:00 UK/BST, 16:00 CEST, 17:00 Israel Summer Time, 19:30 India Std Time, 22:00 China Std Time.
If no DST in Europe and DST in US: 08:00 PDT, 11:00 EDT, 15:00 UTC, 15:00 UK/GMT, 16:00 CET, 17:00 Israel Std Time, 20:30 India Std Time, 23:00 China Std Time.
Topic: FD.io CSIT Project Meeting Join from PC, Mac, Linux, iOS or Android: https://zoom.us/my/fastdata?pwd=Z3Z0UnJyUmRIMlU3eTJLcGF6VEptQT09 Or iPhone one-tap (US Toll): +14086380968,,5301185804# or +16465588656,,5301185804# Or Telephone: Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll) +1 855 880 1246 (US Toll Free) +1 877 369 0926 (US Toll Free) Meeting ID: 530 118 5804 International numbers available: https://zoom.us/zoomconference?m=ppBOQMQTVxGYmbxNsVemC6KNo8eX2ptF
Issues connecting to the meeting? Contact: Maciek Konstantynowicz <mkonstan@cisco.com>.
- IRC
- #fdio-meeting room on libera
- More info: https://lists.fd.io/g/csit-dev/message/4345
- Web-based IRC client: https://web.libera.chat/
- #fdio-meeting room on libera
Agenda
The next CSIT meeting is scheduled for Wednesday 07-Dec 15:00-16:00 Greenwich, London time / 07:00-08:00 PST. Proposed topics:
- Agenda bashing.
- Inputs from projects
- FD.io: VPP, TSC, other.
- New or refactored tests
- E810 flow "offload" tests
- device: WIP updating tests with new dpdk offload flags.
- perf: gtpu and ipsec policy tests.
- gtpusw and gtpuhw results comparison - CSIT vs Intel labs
- Scale tests API optimization
- Moving from VAT to Async PAPI
- E810 flow "offload" tests
- VPP and CSIT hot items
- CSIT env. move to Ubuntu 22.04
- vpp_device testbeds still on Ubuntu 20.04
- Intel FVL/CVL driver compatibility matrix - FW, DPDK, AVF
- Tracked in CSIT compatibility matrix
- Spectre-BHB security vulnerability (on-hold)
- AMD performance results
review - FD.io CSIT labs vs. AMD CSIT labs, Keesang et al
- CSIT env. move to Ubuntu 22.04
- Past Release CSIT-2210
- Report
- RCA
- Next Release CSIT-2302
- Physical Infrastructure
- Performance testing: Xeon Skx/Ckx/Icx, Arm, Atom.
- Functional driver testing: Xeon Skx, Arm Tx2.
- Updated LFN FD.io infra support documentation.
- Lab new builds:
- 3n-snr - Atom SnowRidge performance testbed.
- experimental with new TRex v3.00 DPDK ICE driver
- waiting for new QSFP28 pluggables to address link flapping problem
- 3n-snr - Atom SnowRidge performance testbed.
- Lab extension proposal
- 2022: decommission 2n-skx, 3n-skx, 2n-dnv, 3n-dnv
- 2022: add 4 x 2n-spr; add mlx cx7 2p200ge to 2n-spr; add mlx cx6 2p100ge to 2n-icx and 3n-icx;
- 2023: add spr tg, 2n-icxd? (intel), 2n-octeon10-dpu (arm), 2n-zn3 (amd)
- Virtual Infrastructure, CI/CD
- LFN FD.io CI/CD systems.
- Jenkins jobs: csit-vpp, vpp-csit, trending.
- vpp-csit jobs: vpp-csit-verify-device-{..}-tx2 (now voting), vpp-csit-verify-device-{..}-skx (voting)
- Environment, Framework
- VPP API changes' tracking.
- VPP CLI usage in CSIT.
- Functional checks, e.g. "show nat44 summary" to count established sessions.
- VPP changed output in: 34877: nat: TCP state tracking based on RFC 7857/RFC 6146 | https://gerrit.fd.io/r/c/vpp/+/34877
- CSIT test were failing until fix: 35295: fix(nat): parse new show nat44 summary output | https://gerrit.fd.io/r/c/csit/+/35295
- Functional checks, e.g. "show nat44 summary" to count established sessions.
- Trending
- Hoststack tests: Requested tests to be added are the same as CSIT Report Hoststack Iterative Job Specs
- Daily perf tests: mrr-daily test selection, daily csit-report.
- Performance trending: Dashboard, Failures.
- Trendline graphs: L2, IP4, IP6, Vhost, L2 memif, Overlay, Crypto.
- New dynamic dashboard (CSIT UTI).
- Failures, anomalies, breakages
- Current issues.
- Priority legend: [H] - high priority, [M] - medium priority, [L] - low priority
- 01. [H] 2n-aws: All tests fail to start VPP.
- 02. [H] 2n-clx, 2n-icx: All tests fail to initialize interface.
- 03. [H] 2n-icx: NFV density tests breaks VPP which fails to start (re-opened).
- 04. [H] 2n-clx: dpdk tests failing to unbind PCI device.
- 05. [M] 3n-snr: All hwasync wireguard tests failing when trying to verify device. CSIT-1883
- 06. [M] 1n-aws: TRex NDR PDR ALL IP4 scale and L2 scale tests failing with 50% packet loss. CSIT-1876
- 07. [H] 2n-clx, 2n-zn2: all RDMA tests failing with cli_inband clear runtime command. CSIT-1882
- 08. [M] 3n-tsh: VM tests failing to boot VM. CSIT-1877
- 09. [M] 3n-snr: 25GE interface between SUT and TG/TRex goes down randomly. CSIT-1871
- 10. [H] 2n-clx: half of the packets lost on PDR tests (re-opened). CSIT-1864
- 11. [M] 3n-alt, 3n-snr: testpmd tests fail with no traffic. CSIT-1848
- 12. [L] 2n-dnv: sporadic 1518B tput tests failing to establish required sessions. CSIT-1850
- 13. [H] 3n-icx, 3n-skx: all AVF crypto tests sporadically fail. 1518B with no traffic, IMIX with excessive packet loss. CSIT-1827
- Long term issues
- 14. [L] all testbeds: AF-XDP - NDR tests failing from time to time. CSIT-1802
- 15. [M] 3n-tsh, 3n-alt, 2n-clx testbed (Taishan, Altra, Cascade-lake): NDR tests failing from time to time. CSIT-1804
- 16. [L] VPP does not recognize X553/X557-AT2 10GE. VPP-2010
- 17. [L] multicore AVF tests are failing when trying to create interface. CSIT-1782
- 18. [L] Not all DET44 sessions have been established: 4128767 != 4128768. CSIT-1795
- 19. VPP-1995 i40e driver issue, vlan stripping for VF not working. VPP-1995
- Analytics, Presentation.
- Fd.io Events.
- Housekeeping.
- Maintainers, commit message template, https://www.conventionalcommits.org