Difference between revisions of "CSIT/Meeting"

From fd.io
Jump to: navigation, search
(Correct AMD perf link.)
(170 intermediate revisions by 4 users not shown)
Line 31: Line 31:
 
== Agenda ==
 
== Agenda ==
  
The next CSIT meeting is scheduled for Wednesday 15-Jun 15:00-16:00 Greenwich, London time / 07:00-08:00 PST. Proposed topics:
+
The next CSIT meeting is scheduled for Wednesday 26-June 15:00-16:00 London time / 07:00-08:00 PST. Proposed topics:
  
# Agenda bashing.
+
# #startmeeting "FD.io CSIT Project Meeting"
# Inputs from projects
+
# #chair dwallacelf jlinkes Kai98 vrpolak mackonstan tifrank
#* FD.io: VPP, TSC, other.
+
# #topic Agenda bashing
#* FD.io: [https://wiki.fd.io/view/Project_Proposals/vppcfg **vppcfg** new project proposal] - readout to CSIT postponed
+
# #topic VPP update
# New or being refactored tests
+
# #topic TSC update
#* E810 flow "offload" tests
+
# #topic Other update
#** device: updating tests with new dpdk offload flags, Fan.
+
# #topic New or refactored tests
#** perf: work in progress, Fan.
+
# VPP and CSIT (not so hot) items
#*** MERGED 36120: Add gtpu flow offload test suite | https://gerrit.fd.io/r/c/csit/+/36120
+
#* #topic HW accelerator - SPR QAT2.0 - [https://csit.fd.io/trending/#eNrtVkFuwyAQfI17qVYCYupcemjqf0QYtjFqjDdAU7mvL3Gj4lwaVYl88gUkZndntKORCLH3uA24fy7kpqg2haisSUexenlM15EIVq6BQB44YzsUxHHNmT6AIfMO2g8Ue-CSrxvgGjC2lkpLAXUqZyy6ffupwuA0pPdGBQTrIigMQj7tdAed9yc28XpiMx_xgjoj1A4Z-UNQ7lAeVW750ZnRiGFC9V_Vec6bVx0G-4V52LiLXKHTfiegvtQQB5qg52VU9VgxvxlkFjN-0fMy7mKGWJJxzQwxWzLEkozbzLhnMsolGdfMKGdLRrkk4zYzcjJk_eB6342_Kll_A09FsIY trending results]
#*** OPEN 36119: Add ipsec policy test suites with flow director or rss accelerated | https://gerrit.fd.io/r/c/csit/+/36119
+
#* #topic HW accelerator - SNR QAT2.0 - [https://csit.fd.io/trending/#eNrtVkFuwyAQfI17qVYqG1Pn0kNT_yMisI1RY7wBmsp9fYlrCefQSFUin8wBJGbZWc1oJELsPG0DHV4KuSmqTYGVNWkrVq-P6Tgxw8pBcB5Q7glZ0BpRH8Gw-QDte44dCCnWOxAaKDaWS8uBtHhKK7pD86VC7zSk-50KBNZFUBRQPu91C633Zy58O3OZz3hBnBFu-oz8OU6uV55UfvA7ZUYjhQnRf2fOfd69ainYb8rNBiVyhU7aTkB9OUPseYKOUlT1UDG3EWwWI0Z0lOIORuCSiOtG4EyJwCURtxhxv0SUSyKuG1HOlIhyScQtRuREyPrBdb4dfk-y_gG2TqoC trending results]
#* Scale tests revisited
+
#* #topic HW accelerator - ICXD QAT2.0 - [https://csit.fd.io/trending/#eNrtlEFuwjAQRU8TNmgk7MQNmy6A3AOZ8UCsEmdku4Vw-pq0ksMC1KpSV3hhS_7j-V_zJIfYe9oGOr4Wal3U60LW1qStKFfzdHwwQ-nA4tmAVAeSLGgpSwTD5g3QDxx7EEosdyAQKLaWK8uBUCzSiu7YnnQYHEK63-lAYF0ETUGqlwN20Hl_9ZKbq5d5jzfGWeF2yMrdOLlee9L5wVfKrEYKE6PfZs599l53FOyFcrNxErkC02wnIt5miANP1O9R1M1Y8RcQ8gniMQj5TyCqJ4jHIKofglDNzPW-G78o1XwC3stYbg trending results]
#** Currently amount of executed scale tests is reduced for ip4, ip6, nat, ipsec.
+
#* #topic HW accelerator - SPR DSA
#** This is due to poor performance of PAPI and excessive time taken for configuring VPP.
+
#** vpp l2bd memif 1core results with-DSA vs without-DSA:
#** Work to restart to review feasible option to have this fixed, Vratko, Ole, Andrew, Dave.
+
#*** [https://csit.fd.io/trending/#eNrtVkEKwjAQfE29yEITLfXiQe0_SppstdCkcRMFfb21KImC6EkUvTTQmWUmswzE-Y6wdNjOk2yZ5MuE543qP8lkMe6PvbXADThLwNJ0jdwynLFUbkHsa5Cd8aIxSKVG3dTAMjargElAv4GWV6oSDrWQLZnhF7_QlCTQRGcZvjrLqJ2_0QyI3RwC8tBJ4AtCEQbuDAaaRxcpPrcbJmsSGl1zxDA-XDswZJ9oBMpbVX-wEXpJIS8GxnviV1p82wqulr9oDfzfggjkHxf_T7bg7WuY_lsQgdOPi_8nW_DqGrJiZDrSw8soK07Re6De 1518B 150Gbps vs 39Gbps]
# VPP and CSIT hot items
+
#*** [https://csit.fd.io/trending/#eNrtVkFuwjAQfE24oJViN2l66QGafyDH3kCk2DFrgwSvJ4TCAhJqTwgEl1jKzGrGs3NwiB3hLGD7neTTpJgmsmhM_0k-JuP-WHsP0kHwBCJN5yi9wC-R6iWodQ26c1E1Dmlm0TY1fGYVCA0YF9DKylQqoFW6JTf8kgeSMJrAEu1F5M9exKzihSIjfrFh5KYP5itCxQNX9pgWMZwp_m2XJ2tSFkOzRR7vL8247tNkSOhLzbjxZ-hvBkU5MO4RvbHq2eI_Wn6SFch3-9nxg0X_gu2_8wqyd_tPUPZg0b9g-_-7grwcuY7s8ALKyx2bMJwi 64B 15Gbps vs 18 Gbps]
#* Spectre-BHB security vulnerability
+
# [https://wiki.fd.io/view/CSIT/csit2406_plan #topic CSIT-2406 release]
#** [https://gerrit.fd.io/r/c/csit/+/35681 docs: Add references to Spectre-BHB security vulnerability]
+
# #topic Physical Infrastructure
#** Waiting for updated spectre-meltdown script: https://github.com/speed47/spectre-meltdown-checker/pull/418
+
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Performance testing]: Intel Xeon CLX/ICX/SPR, Arm TX2/TSH/ALT, Intel Atom, AMD Zen2.
#* AMD performance results review - FD.io CSIT labs vs. AMD CSIT labs, Keesang et al
+
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Functional driver testing]: Intel Xeon SKX, Arm TX2.
#** Current state in CSIT lab: http://csit.fd.io/trending/#eNrdkssKwjAQRb-m3ZSBZGrblQsf_yExHR_Q1pBEqX69qRSmXYgiIthNQjh37kwu4_zJ0sZRNY-yZVQsIyyOZTiidJGE62IMYAO6akEKsSc0UrdZliuwZa2gQshnW5AayB_Cq9Vb5QhqazsLXHUW5dmP_JiYw5XJ8y5coCwprqiQiSc36DIchjU7q2pyxxuxMAzPXIckGEk9dvdXM6D9D4v1Q_FhbDjB2PALsd0a_MG2Penyv9v2IjacYGzvblu2jp1X1s9RIIJAQEyECLL-iKkpe5aDTEfsDg9kWyM
+
# Releases [https://wiki.fd.io/view/CSIT/csit2206_plan CSIT-2206]
+
#* rc1 testing status
+
#* Report status
+
#** CSIT and VPP 22.02 known issues status check, https://lists.fd.io/g/csit-dev/message/4516
+
#* 100 GbE tests with newly fitted and calibrated MLX ConnectX5-ex and TRex v2.96
+
#** with 16 pmd threads max aggregate 2x 100 GbE STL performance: 188Mpps TX rate and 133Mpps RX rate
+
#** big thanks to Peter for the work with Hanoh to get it sorted finally
+
#* telemetry - vpp perfmon and linux bpf telemetry
+
#* CSIT UTI
+
#** http://csit.fd.io/trending/
+
#* New platforms and testbeds: Ampere Altra 3n-alt, SnowRidge (3n-snr)
+
#* MLRsearch tunings
+
#* CVL 100 GbE flow-based tests
+
# Physical Infrastructure
+
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Performance testing]: Xeon Skx/Ckx/Icx, [https://wiki.fd.io/view/CSIT/AArch64 Arm], Atom.
+
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Functional driver testing]: Xeon Skx, [https://wiki.fd.io/view/CSIT/AArch64 Arm] Tx2.
+
 
#* [https://wiki.fd.io/view/Infrastructure_Support Updated LFN FD.io infra support documentation].
 
#* [https://wiki.fd.io/view/Infrastructure_Support Updated LFN FD.io infra support documentation].
#* Lab new hardware builds:
+
#* Lab extension points
#** Perf - 17 supermicro icx servers
+
#** SuperMicro servers with Intel Xeon EMR for SUTs (8568Y+ 48c 2.3GHz 350W 300MB DSA QAT) andTGs (8580 60c 2GHz 350W 300MB)
#*** 5 servers in production: 2n-icx, 3n-icx testbeds.
+
#** Nvidia Grace-Grace single socket super-server (processors based on Arm Neoverse V2 uarch)
#*** 2 servers used for TG/TRex machines for new testbed builds (2n-alt).
+
#** Marvell Octeon10 DPU (processors based on Arm Neoverse N2 uarch)
#*** 1 server available for new build
+
#** AMD Zen-4 server(s), most likely with Genoa processors (fully fledged Zen4 cores)
#*** 9 servers finally arriving ...
+
# #topic Virtual Infrastructure, CI/CD
#** Perf - 2x Ampere Altra servers - onboarded
+
#*** [https://s3-docs.fd.io/csit/master/trending/trending/ip4-3n-alt-xl710.html 3n-alt trending data].
+
#* AMD requests to increase AMD participation level in CSIT benchmarking, Keesang et al.
+
#* 2x Atom SnowRidge servers (4RU) shipped by Intel, in transit.
+
# Virtual Infrastructure, CI/CD
+
 
#* LFN FD.io CI/CD systems.
 
#* LFN FD.io CI/CD systems.
#* Jenkins jobs: csit-vpp, vpp-csit, trending.
+
#* Jenkins jobs: csit-vpp, vpp-csit.
#* vpp-csit jobs: vpp-csit-verify-device-{..}-tx2 (not voting), vpp-csit-verify-device-{..}-skx (voting)
+
#* vpp-csit jobs: vpp-csit-verify-device-{..}-tx2, vpp-csit-verify-device-{..}-spr
# Environment, Framework
+
#** status of addressing intermittent failures not related to vpp patch code changes
#* VPP API changes' tracking.
+
# #topic Environment, Framework
#* VPP CLI usage in CSIT.
+
#* VPP API tracking.
#** Functional checks, e.g. "show nat44 summary" to count established sessions.
+
#** RSS keys.
#*** VPP changed output in: 34877: nat: TCP state tracking based on RFC 7857/RFC 6146 | https://gerrit.fd.io/r/c/vpp/+/34877
+
#** CLI without API.
#*** CSIT test were failing until fix: 35295: fix(nat): parse new show nat44 summary output | https://gerrit.fd.io/r/c/csit/+/35295
+
# #topic Trending and Test Failures
# Trending
+
#* [https://wiki.fd.io/view/CSIT/TestFailuresTracking CSIT Test Failures Tracking Wiki]
#* Hoststack tests: Requested tests to be added are the same as [https://github.com/FDio/csit/blob/master/docs/job_specs/report_iterative/3n-skx/hoststack-00.md#hoststack CSIT Report Hoststack Iterative Job Specs]
+
#* [http://csit.fd.io/ CSIT Performance Dashboard]
#* Daily perf tests: [https://git.fd.io/csit/tree/resources/libraries/bash/function/mrr-daily.txt mrr-daily test selection], [https://lists.fd.io/g/csit-report daily csit-report].
+
#** [http://csit.fd.io/trending/ Performance Trending]
#* Performance trending: [https://s3-docs.fd.io/csit/master/trending/introduction/dashboard.html Dashboard], [https://s3-docs.fd.io/csit/master/trending/introduction/failures.html Failures].
+
#** [http://csit.fd.io/report/ Per Release Performance]
#* Trendline graphs: [https://s3-docs.fd.io/csit/master/trending/trending/l2.html L2], [https://s3-docs.fd.io/csit/master/trending/trending/ip4.html IP4], [https://s3-docs.fd.io/csit/master/trending/trending/ip6.html IP6], [https://s3-docs.fd.io/csit/master/trending/trending/vhost.html Vhost], [https://s3-docs.fd.io/csit/master/trending/trending/container_memif.html L2 memif], [https://s3-docs.fd.io/csit/master/trending/trending/ip4_tunnels.html Overlay], [https://s3-docs.fd.io/csit/master/trending/trending/ipsec.html Crypto].
+
#** [http://csit.fd.io/stats/ Test Job Statistics]
#* New dynamic dashboard (CSIT UTI).
+
#** [http://csit.fd.io/news/ Failures and Anomalies]
#* Failures, anomalies, breakages
+
# #topic Analytics, Presentation.
#** port 0 is down when running traffic profile.
+
# #topic Fd.io Events
#** [https://jira.fd.io/browse/CSIT-1827 all 1518B AVF crypto tests failed with no traffic].
+
#* [https://teamup.com/ksgw6qzqcmg9zbzsfq teamup Event calendar and Zoom links]
#** [https://jira.fd.io/browse/CSIT-1802 AF-XDP - NDR tests failing from time to time].
+
# #topic Housekeeping
#** [https://jira.fd.io/browse/VPP-2010 VPP does not recognize X553/X557-AT2 10GE].
+
#* #link 41077: fix(guidelines): Apply low-controversy edits | https://gerrit.fd.io/r/c/csit/+/41077
#** [https://jira.fd.io/browse/CSIT-1782 multicore AVF tests are failing when trying to create interface].
+
#* #link 41078: feat(guidelines): Apply medium-controversy edits | https://gerrit.fd.io/r/c/csit/+/41078
#** [https://jira.fd.io/browse/CSIT-1795 Not all DET44 sessions have been established: 4128767 != 4128768].
+
#* #link 41079: feat(guidelines): Add rules governing dead code | https://gerrit.fd.io/r/c/csit/+/41079
#** [https://jira.fd.io/browse/VPP-1995 VPP-1995 i40e driver issue, vlan stripping for VF not working].
+
# #endmeeting
# Analytics, Presentation.
+
# Fd.io Events.
+
# Housekeeping.
+
#* Maintainers, commit message template, https://www.conventionalcommits.org
+
  
 
== Meeting Minutes ==
 
== Meeting Minutes ==
  
 
* [[CSIT/Meeting_Minutes | CSIT Meeting Minutes]]
 
* [[CSIT/Meeting_Minutes | CSIT Meeting Minutes]]
 +
* [[CSIT/Meeting_Minutes_2023 | CSIT Meeting Minutes Archive 2023]]
 +
* [[CSIT/Meeting_Minutes_2022 | CSIT Meeting Minutes Archive 2022]]
 +
* [[CSIT/Meeting_Minutes_2021 | CSIT Meeting Minutes Archive 2021]]
 
* [[CSIT/Meeting_Minutes_2020 | CSIT Meeting Minutes Archive 2020]]
 
* [[CSIT/Meeting_Minutes_2020 | CSIT Meeting Minutes Archive 2020]]
 
* [[CSIT/Meeting_Minutes_2019 | CSIT Meeting Minutes Archive 2019]]
 
* [[CSIT/Meeting_Minutes_2019 | CSIT Meeting Minutes Archive 2019]]

Revision as of 19:53, 20 June 2024

Meeting Details

Weekly on Wednesday 15:00 Greenwich, London time. FD.io Zoom Meeting room (passcode <remove spaces> '4 1 2 3 2 4')
If no DST in Europe and US: 07:00 PST, 10:00 EST, 15:00 UTC, 15:00 UK/GMT, 16:00 CET, 17:00 Israel Std Time, 20:30 India Std Time, 23:00 China Std Time.
If DST in Europe: 07:00 PDT, 10:00 EDT, 14:00 UTC, 15:00 UK/BST, 16:00 CEST, 17:00 Israel Summer Time, 19:30 India Std Time, 22:00 China Std Time.
If no DST in Europe and DST in US: 08:00 PDT, 11:00 EDT, 15:00 UTC, 15:00 UK/GMT, 16:00 CET, 17:00 Israel Std Time, 20:30 India Std Time, 23:00 China Std Time.

Topic: FD.io CSIT Project Meeting

Join from PC, Mac, Linux, iOS or Android: https://zoom.us/my/fastdata?pwd=Z3Z0UnJyUmRIMlU3eTJLcGF6VEptQT09

Or iPhone one-tap (US Toll):  +14086380968,,5301185804# or +16465588656,,5301185804#

Or Telephone:
    Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll)
    +1 855 880 1246 (US Toll Free)
    +1 877 369 0926 (US Toll Free)
    Meeting ID: 530 118 5804
    International numbers available: https://zoom.us/zoomconference?m=ppBOQMQTVxGYmbxNsVemC6KNo8eX2ptF

Issues connecting to the meeting? Contact: Maciek Konstantynowicz <mkonstan@cisco.com>.

Agenda

The next CSIT meeting is scheduled for Wednesday 26-June 15:00-16:00 London time / 07:00-08:00 PST. Proposed topics:

  1. #startmeeting "FD.io CSIT Project Meeting"
  2. #chair dwallacelf jlinkes Kai98 vrpolak mackonstan tifrank
  3. #topic Agenda bashing
  4. #topic VPP update
  5. #topic TSC update
  6. #topic Other update
  7. #topic New or refactored tests
  8. VPP and CSIT (not so hot) items
  9. #topic CSIT-2406 release
  10. #topic Physical Infrastructure
    • Performance testing: Intel Xeon CLX/ICX/SPR, Arm TX2/TSH/ALT, Intel Atom, AMD Zen2.
    • Functional driver testing: Intel Xeon SKX, Arm TX2.
    • Updated LFN FD.io infra support documentation.
    • Lab extension points
      • SuperMicro servers with Intel Xeon EMR for SUTs (8568Y+ 48c 2.3GHz 350W 300MB DSA QAT) andTGs (8580 60c 2GHz 350W 300MB)
      • Nvidia Grace-Grace single socket super-server (processors based on Arm Neoverse V2 uarch)
      • Marvell Octeon10 DPU (processors based on Arm Neoverse N2 uarch)
      • AMD Zen-4 server(s), most likely with Genoa processors (fully fledged Zen4 cores)
  11. #topic Virtual Infrastructure, CI/CD
    • LFN FD.io CI/CD systems.
    • Jenkins jobs: csit-vpp, vpp-csit.
    • vpp-csit jobs: vpp-csit-verify-device-{..}-tx2, vpp-csit-verify-device-{..}-spr
      • status of addressing intermittent failures not related to vpp patch code changes
  12. #topic Environment, Framework
    • VPP API tracking.
      • RSS keys.
      • CLI without API.
  13. #topic Trending and Test Failures
  14. #topic Analytics, Presentation.
  15. #topic Fd.io Events
  16. #topic Housekeeping
  17. #endmeeting

Meeting Minutes