Difference between revisions of "CSIT/Meeting"

From fd.io
Jump to: navigation, search
(15 intermediate revisions by 2 users not shown)
Line 31: Line 31:
 
== Agenda ==
 
== Agenda ==
  
The next CSIT meeting is scheduled for Wednesday 23-Nov 15:00-16:00 Greenwich, London time / 07:00-08:00 PST. Proposed topics:
+
The next CSIT meeting is scheduled for Wednesday 01-Feb 15:00-16:00 Greenwich, London time / 07:00-08:00 PST. Proposed topics:
  
 +
# Notes: `#chair dwallacelf jlinkes vrpolak mackonstan tifrank viliamluc`
 
# Agenda bashing.
 
# Agenda bashing.
 
# Inputs from projects
 
# Inputs from projects
Line 40: Line 41:
 
#** device: WIP updating tests with new dpdk offload flags.
 
#** device: WIP updating tests with new dpdk offload flags.
 
#** perf: gtpu and ipsec policy tests.
 
#** perf: gtpu and ipsec policy tests.
#*** Trending and report for 3n-icx e810 NICs - experimental with new TRex v3.00 DPDK ICE driver
+
#*** gtpusw and gtpuhw results comparison - CSIT vs Intel labs
 
#* Scale tests API optimization
 
#* Scale tests API optimization
 
#** Moving from VAT to Async PAPI
 
#** Moving from VAT to Async PAPI
# VPP and CSIT hot items
+
# VPP and CSIT (not so hot) items
#* CSIT env move to Ubuntu 22.04
+
#* CSIT env. move to Ubuntu 22.04
#** all done apart from
+
#** vpp_device 1n-skx testbeds on Ubuntu 20.04
#*** vpp_device testbeds - to be done later
+
#** proposal to move to Ubuntu 22.04 with introduction of 1n-spr testbeds and decommissioning 1n-skx ones
#*** 2n-dnv, 3n-dnv - to be decommissioned after CSIT-2210
+
 
#* Intel FVL/CVL driver compatibility matrix - FW, DPDK, AVF
 
#* Intel FVL/CVL driver compatibility matrix - FW, DPDK, AVF
#** Continuously tracked in [https://gerrit.fd.io/r/c/csit/+/36929/3/fdio.infra.ansible/roles/intel/defaults/main.yaml CSIT compatibility matrix]
+
#** Tracked in [https://gerrit.fd.io/r/c/csit/+/36929/3/fdio.infra.ansible/roles/intel/defaults/main.yaml CSIT compatibility matrix]
#** Reviewed and approved by FD.io CSIT and Intel team
+
 
#* Spectre-BHB security vulnerability (on-hold)
 
#* Spectre-BHB security vulnerability (on-hold)
 
#** [https://gerrit.fd.io/r/c/csit/+/35681 docs: Add references to Spectre-BHB security vulnerability]
 
#** [https://gerrit.fd.io/r/c/csit/+/35681 docs: Add references to Spectre-BHB security vulnerability]
#** [https://github.com/speed47/spectre-meltdown-checker/pull/418 Waiting for updated spectre-meltdown script.]
+
#** [https://github.com/speed47/spectre-meltdown-checker/pull/418 covering CVE-2022-0001 and CVE-2022-0002 got never merged]
 +
#** spectre-meltdown-checker not maintained anymore - waiting for vendor (AMD, Arm, Intel) recommendations re what verification tool to use
 
#* AMD performance results <del>review - FD.io CSIT labs vs. AMD CSIT labs, Keesang et al</del>
 
#* AMD performance results <del>review - FD.io CSIT labs vs. AMD CSIT labs, Keesang et al</del>
 
#** [http://csit.fd.io/trending/#eNrdkssKwjAQRb-m3ZSBZGrblQsf_yExHR_Q1pBEqX69qRSmXYgiIthNQjh37kwu4_zJ0sZRNY-yZVQsIyyOZTiidJGE62IMYAO6akEKsSc0UrdZliuwZa2gQshnW5AayB_Cq9Vb5QhqazsLXHUW5dmP_JiYw5XJ8y5coCwprqiQiSc36DIchjU7q2pyxxuxMAzPXIckGEk9dvdXM6D9D4v1Q_FhbDjB2PALsd0a_MG2Penyv9v2IjacYGzvblu2jp1X1s9RIIJAQEyECLL-iKkpe5aDTEfsDg9kWyM Current state in CSIT lab.]
 
#** [http://csit.fd.io/trending/#eNrdkssKwjAQRb-m3ZSBZGrblQsf_yExHR_Q1pBEqX69qRSmXYgiIthNQjh37kwu4_zJ0sZRNY-yZVQsIyyOZTiidJGE62IMYAO6akEKsSc0UrdZliuwZa2gQshnW5AayB_Cq9Vb5QhqazsLXHUW5dmP_JiYw5XJ8y5coCwprqiQiSc36DIchjU7q2pyxxuxMAzPXIckGEk9dvdXM6D9D4v1Q_FhbDjB2PALsd0a_MG2Penyv9v2IjacYGzvblu2jp1X1s9RIIJAQEyECLL-iKkpe5aDTEfsDg9kWyM Current state in CSIT lab.]
# Next Release [https://wiki.fd.io/view/CSIT/csit2210_plan CSIT-2210]
+
# Next Release [https://wiki.fd.io/view/CSIT/csit2302_plan CSIT-2302]
#* Report
+
#* new tests
#* RCA
+
#** hoststack tests and trending - live review with vpp-dev on Thu 19-Jan.
 +
#** mlx dpdk tests and trending.
 +
#** wireguard 10k tunnels (Kai).
 +
#* csit.fd.io dashboard
 +
#** vpp telemetry.
 +
#** hoststack.
 +
#** other new tests.
 +
#* job specs
 +
#** gtpu, wireguard (Kai).
 +
#** dpdk mlx, all hoststack (Tibor, Maciek).
 
# Physical Infrastructure
 
# Physical Infrastructure
 
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Performance testing]: Xeon Skx/Ckx/Icx, [https://wiki.fd.io/view/CSIT/AArch64 Arm], Atom.
 
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Performance testing]: Xeon Skx/Ckx/Icx, [https://wiki.fd.io/view/CSIT/AArch64 Arm], Atom.
 
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Functional driver testing]: Xeon Skx, [https://wiki.fd.io/view/CSIT/AArch64 Arm] Tx2.
 
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Functional driver testing]: Xeon Skx, [https://wiki.fd.io/view/CSIT/AArch64 Arm] Tx2.
 
#* [https://wiki.fd.io/view/Infrastructure_Support Updated LFN FD.io infra support documentation].
 
#* [https://wiki.fd.io/view/Infrastructure_Support Updated LFN FD.io infra support documentation].
 +
#* new mlx cards allocation
 +
#** spr, icx and altra testbeds.
 
#* Lab new builds:
 
#* Lab new builds:
 
#** 3n-snr - Atom SnowRidge performance testbed.
 
#** 3n-snr - Atom SnowRidge performance testbed.
 
#*** experimental with new TRex v3.00 DPDK ICE driver
 
#*** experimental with new TRex v3.00 DPDK ICE driver
 +
#*** waiting for new QSFP28 pluggables to address link flapping problem
 
#* Lab extension proposal
 
#* Lab extension proposal
#** 2022: decommission 2n-skx, 3n-skx
+
#** 2022: decommission 2n-skx, 3n-skx, 2n-dnv, 3n-dnv
#** 2022: add mlx 2p100gbe to icx testbeds, 2n-spr
+
#** 2022: add 4 x 2n-spr; add mlx cx7 2p200ge to 2n-spr; add mlx cx6 2p100ge to 2n-icx and 3n-icx;
 
#** 2023: add spr tg, 2n-icxd? (intel), 2n-octeon10-dpu (arm), 2n-zn3 (amd)
 
#** 2023: add spr tg, 2n-icxd? (intel), 2n-octeon10-dpu (arm), 2n-zn3 (amd)
 
# Virtual Infrastructure, CI/CD
 
# Virtual Infrastructure, CI/CD
 +
#* vpp-dev asking to add Qemu based ‘make test’ virtual interface testing to VPP per-patch CI (on vpp-device testbeds?)
 
#* LFN FD.io CI/CD systems.
 
#* LFN FD.io CI/CD systems.
 
#* Jenkins jobs: csit-vpp, vpp-csit, trending.
 
#* Jenkins jobs: csit-vpp, vpp-csit, trending.
Line 80: Line 93:
 
#*** VPP changed output in: 34877: nat: TCP state tracking based on RFC 7857/RFC 6146 | https://gerrit.fd.io/r/c/vpp/+/34877
 
#*** VPP changed output in: 34877: nat: TCP state tracking based on RFC 7857/RFC 6146 | https://gerrit.fd.io/r/c/vpp/+/34877
 
#*** CSIT test were failing until fix: 35295: fix(nat): parse new show nat44 summary output | https://gerrit.fd.io/r/c/csit/+/35295
 
#*** CSIT test were failing until fix: 35295: fix(nat): parse new show nat44 summary output | https://gerrit.fd.io/r/c/csit/+/35295
# Trending
+
# Trending and Test Failures
 
#* Hoststack tests: Requested tests to be added are the same as [https://github.com/FDio/csit/blob/master/docs/job_specs/report_iterative/3n-skx/hoststack-00.md#hoststack CSIT Report Hoststack Iterative Job Specs]
 
#* Hoststack tests: Requested tests to be added are the same as [https://github.com/FDio/csit/blob/master/docs/job_specs/report_iterative/3n-skx/hoststack-00.md#hoststack CSIT Report Hoststack Iterative Job Specs]
#* Daily perf tests: [https://git.fd.io/csit/tree/resources/libraries/bash/function/mrr-daily.txt mrr-daily test selection], [https://lists.fd.io/g/csit-report daily csit-report].
+
#* [https://wiki.fd.io/view/CSIT/TestFailuresTracking CSIT Test Failures Summary and Status]
#* Performance trending: [https://s3-docs.fd.io/csit/master/trending/introduction/dashboard.html Dashboard], [https://s3-docs.fd.io/csit/master/trending/introduction/failures.html Failures].
+
#* [http://csit.fd.io/ CSIT Performance Dashboard]
#* Trendline graphs: [https://s3-docs.fd.io/csit/master/trending/trending/l2.html L2], [https://s3-docs.fd.io/csit/master/trending/trending/ip4.html IP4], [https://s3-docs.fd.io/csit/master/trending/trending/ip6.html IP6], [https://s3-docs.fd.io/csit/master/trending/trending/vhost.html Vhost], [https://s3-docs.fd.io/csit/master/trending/trending/container_memif.html L2 memif], [https://s3-docs.fd.io/csit/master/trending/trending/ip4_tunnels.html Overlay], [https://s3-docs.fd.io/csit/master/trending/trending/ipsec.html Crypto].
+
#** [http://csit.fd.io/trending/ Performance Trending]
#* New dynamic dashboard (CSIT UTI).
+
#** [http://csit.fd.io/report/ Per Release Performance]
#* Failures, anomalies, breakages
+
#** [http://csit.fd.io/stats/ Test Job Statistics]
#** Current issues.
+
#** [http://csit.fd.io/news/ Failures and Anomalies]
#** Priority legend: [H] - high priority, [M] - medium priority, [L] - low priority
+
#*** 01. [M] 1n-aws: TRex NDR PDR ALL IP4 scale and L2 scale tests failing with 50% packet loss. [https://jira.fd.io/browse/CSIT-1876 CSIT-1876]
+
#*** 02. [H] 2n-clx, 2n-zn2: all RDMA tests failing with cli_inband clear runtime command. [https://jira.fd.io/browse/CSIT-1882 CSIT-1882]
+
#*** 03. [M] 3n-alt, 3n-tsh: VM tests failing to boot VM. [https://jira.fd.io/browse/CSIT-1877 CSIT-1877]
+
#*** 04. [M] 3n-snr: 25Ge Interface goes down randomly. [https://jira.fd.io/browse/CSIT-1871 CSIT-1871]
+
#*** 05. [H] 2n-clx: half of the packets lost on PDR tests (re-opened). [https://jira.fd.io/browse/CSIT-1864 CSIT-1864]
+
#*** 06. [M] 3n-alt, 3n-snr: testpmd tests fail with no traffic. [https://jira.fd.io/browse/CSIT-1848 CSIT-1848]
+
#*** 07. [L] 2n-dnv: sporadic 1518B tput tests failing to establish required sessions. [https://jira.fd.io/browse/CSIT-1850 CSIT-1850]
+
#*** 08. [H] 3n-icx, 3n-skx: all AVF crypto tests sporadically fail. 1518B with no traffic, IMIX with excessive packet loss. [https://jira.fd.io/browse/CSIT-1827 CSIT-1827]
+
#** Long term issues
+
#*** 09. [L] all testbeds: AF-XDP - NDR tests failing from time to time. [https://jira.fd.io/browse/CSIT-1802 CSIT-1802]
+
#*** 10. [M] 3n-tsh, 3n-alt, 2n-clx testbed (Taishan, Altra, Cascade-lake): NDR tests failing from time to time. [https://jira.fd.io/browse/CSIT-1804 CSIT-1804]
+
#*** 11. [L] VPP does not recognize X553/X557-AT2 10GE. [https://jira.fd.io/browse/VPP-2010 VPP-2010]
+
#*** 12. [L] multicore AVF tests are failing when trying to create interface. [https://jira.fd.io/browse/CSIT-1782 CSIT-1782]
+
#*** 13. [L] Not all DET44 sessions have been established: 4128767 != 4128768. [https://jira.fd.io/browse/CSIT-1795 CSIT-1795]
+
#*** 14. VPP-1995 i40e driver issue, vlan stripping for VF not working. [https://jira.fd.io/browse/VPP-1995 VPP-1995]
+
 
# Analytics, Presentation.
 
# Analytics, Presentation.
 
# Fd.io Events.
 
# Fd.io Events.
Line 112: Line 109:
  
 
* [[CSIT/Meeting_Minutes | CSIT Meeting Minutes]]
 
* [[CSIT/Meeting_Minutes | CSIT Meeting Minutes]]
 +
* [[CSIT/Meeting_Minutes_2022 | CSIT Meeting Minutes Archive 2022]]
 +
* [[CSIT/Meeting_Minutes_2021 | CSIT Meeting Minutes Archive 2021]]
 
* [[CSIT/Meeting_Minutes_2020 | CSIT Meeting Minutes Archive 2020]]
 
* [[CSIT/Meeting_Minutes_2020 | CSIT Meeting Minutes Archive 2020]]
 
* [[CSIT/Meeting_Minutes_2019 | CSIT Meeting Minutes Archive 2019]]
 
* [[CSIT/Meeting_Minutes_2019 | CSIT Meeting Minutes Archive 2019]]

Revision as of 19:30, 25 January 2023

Meeting Details

Weekly on Wednesday 15:00 Greenwich, London time. FD.io Zoom Meeting room (passcode <remove spaces> '4 1 2 3 2 4')
If no DST in Europe and US: 07:00 PST, 10:00 EST, 15:00 UTC, 15:00 UK/GMT, 16:00 CET, 17:00 Israel Std Time, 20:30 India Std Time, 23:00 China Std Time.
If DST in Europe: 07:00 PDT, 10:00 EDT, 14:00 UTC, 15:00 UK/BST, 16:00 CEST, 17:00 Israel Summer Time, 19:30 India Std Time, 22:00 China Std Time.
If no DST in Europe and DST in US: 08:00 PDT, 11:00 EDT, 15:00 UTC, 15:00 UK/GMT, 16:00 CET, 17:00 Israel Std Time, 20:30 India Std Time, 23:00 China Std Time.

Topic: FD.io CSIT Project Meeting

Join from PC, Mac, Linux, iOS or Android: https://zoom.us/my/fastdata?pwd=Z3Z0UnJyUmRIMlU3eTJLcGF6VEptQT09

Or iPhone one-tap (US Toll):  +14086380968,,5301185804# or +16465588656,,5301185804#

Or Telephone:
    Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll)
    +1 855 880 1246 (US Toll Free)
    +1 877 369 0926 (US Toll Free)
    Meeting ID: 530 118 5804
    International numbers available: https://zoom.us/zoomconference?m=ppBOQMQTVxGYmbxNsVemC6KNo8eX2ptF

Issues connecting to the meeting? Contact: Maciek Konstantynowicz <mkonstan@cisco.com>.

Agenda

The next CSIT meeting is scheduled for Wednesday 01-Feb 15:00-16:00 Greenwich, London time / 07:00-08:00 PST. Proposed topics:

  1. Notes: `#chair dwallacelf jlinkes vrpolak mackonstan tifrank viliamluc`
  2. Agenda bashing.
  3. Inputs from projects
    • FD.io: VPP, TSC, other.
  4. New or refactored tests
    • E810 flow "offload" tests
      • device: WIP updating tests with new dpdk offload flags.
      • perf: gtpu and ipsec policy tests.
        • gtpusw and gtpuhw results comparison - CSIT vs Intel labs
    • Scale tests API optimization
      • Moving from VAT to Async PAPI
  5. VPP and CSIT (not so hot) items
  6. Next Release CSIT-2302
    • new tests
      • hoststack tests and trending - live review with vpp-dev on Thu 19-Jan.
      • mlx dpdk tests and trending.
      • wireguard 10k tunnels (Kai).
    • csit.fd.io dashboard
      • vpp telemetry.
      • hoststack.
      • other new tests.
    • job specs
      • gtpu, wireguard (Kai).
      • dpdk mlx, all hoststack (Tibor, Maciek).
  7. Physical Infrastructure
    • Performance testing: Xeon Skx/Ckx/Icx, Arm, Atom.
    • Functional driver testing: Xeon Skx, Arm Tx2.
    • Updated LFN FD.io infra support documentation.
    • new mlx cards allocation
      • spr, icx and altra testbeds.
    • Lab new builds:
      • 3n-snr - Atom SnowRidge performance testbed.
        • experimental with new TRex v3.00 DPDK ICE driver
        • waiting for new QSFP28 pluggables to address link flapping problem
    • Lab extension proposal
      • 2022: decommission 2n-skx, 3n-skx, 2n-dnv, 3n-dnv
      • 2022: add 4 x 2n-spr; add mlx cx7 2p200ge to 2n-spr; add mlx cx6 2p100ge to 2n-icx and 3n-icx;
      • 2023: add spr tg, 2n-icxd? (intel), 2n-octeon10-dpu (arm), 2n-zn3 (amd)
  8. Virtual Infrastructure, CI/CD
    • vpp-dev asking to add Qemu based ‘make test’ virtual interface testing to VPP per-patch CI (on vpp-device testbeds?)
    • LFN FD.io CI/CD systems.
    • Jenkins jobs: csit-vpp, vpp-csit, trending.
    • vpp-csit jobs: vpp-csit-verify-device-{..}-tx2 (now voting), vpp-csit-verify-device-{..}-skx (voting)
  9. Environment, Framework
  10. Trending and Test Failures
  11. Analytics, Presentation.
  12. Fd.io Events.
  13. Housekeeping.

Meeting Minutes