Difference between revisions of "CSIT/Meeting"

From fd.io
Jump to: navigation, search
(Update failures status email link.)
(Agenda: Add housekeeping / json validation.)
 
(96 intermediate revisions by 4 users not shown)
Line 31: Line 31:
 
== Agenda ==
 
== Agenda ==
  
The next CSIT meeting is scheduled for Wednesday 21-June 15:00-16:00 Greenwich, London time / 07:00-08:00 PDT. Proposed topics:
+
The next CSIT meeting is scheduled for Wednesday 30-October 15:00-16:00 London time / 07:00-08:00 PST. Proposed topics:
  
# Notes: `#chair dwallacelf jlinkes vrpolak mackonstan tifrank`
+
# #startmeeting "FD.io CSIT Project Meeting"
# Agenda bashing.
+
# #chair dwallacelf Kai98 vrpolak mackonstan tifrank
# Inputs from projects
+
# #topic Agenda bashing
#* FD.io: VPP, TSC, other.
+
# #topic VPP update
# New or refactored tests
+
# #topic TSC update
#* E810 flow "offload" tests
+
# #topic Other update
#** device: updating tests with new dpdk offload flags.
+
# #topic New or refactored tests
#*** status - original patch abandoned: [DO NOT MERGE] dpdk: VPP own DPDK flags | https://gerrit.fd.io/r/c/vpp/+/35743
+
#*** currently in backlog
+
 
# VPP and CSIT (not so hot) items
 
# VPP and CSIT (not so hot) items
#* AMD performance results
+
#* #topic HW accelerator - SPR QAT2.0 - [https://csit.fd.io/trending/#eNrtVkFuwyAQfI17qVYCYupcemjqf0QYtjFqjDdAU7mvL3Gj4lwaVYl88gUkZndntKORCLH3uA24fy7kpqg2haisSUexenlM15EIVq6BQB44YzsUxHHNmT6AIfMO2g8Ue-CSrxvgGjC2lkpLAXUqZyy6ffupwuA0pPdGBQTrIigMQj7tdAed9yc28XpiMx_xgjoj1A4Z-UNQ7lAeVW750ZnRiGFC9V_Vec6bVx0G-4V52LiLXKHTfiegvtQQB5qg52VU9VgxvxlkFjN-0fMy7mKGWJJxzQwxWzLEkozbzLhnMsolGdfMKGdLRrkk4zYzcjJk_eB6342_Kll_A09FsIY trending results]
#** [https://csit.fd.io/trending/#eNrdlcEKwjAMhp9mXiSwxtadPKh7D6lb1IGbpa1j8-nthhCHCCIquENbyp_8aT4Idf5kaePouIjUKkpWESZFHrZotpyGozYGsIJLhSDieE9oRNYoNddg81JDYSTM5RZEBuQP3S2srXYEpbWdC647l_zsB5asmEPLyvNCnKAtac4I1Vjy5O7KDN_DUTurS3LFhTg0dMB6FniwJLKhv2_NnXprMkn7iHfh4Vjh4Q_gybHCkx-Ch6pvqWnqRMSg6913hvahzN-P7HNwOE5w-HVwcpzgXh1VlU6qky37n1alV5of_3c Current state in CSIT lab.]
+
#* #topic HW accelerator - SNR QAT2.0 - [https://csit.fd.io/trending/#eNrtVkFuwyAQfI17qVYqG1Pn0kNT_yMisI1RY7wBmsp9fYlrCefQSFUin8wBJGbZWc1oJELsPG0DHV4KuSmqTYGVNWkrVq-P6Tgxw8pBcB5Q7glZ0BpRH8Gw-QDte44dCCnWOxAaKDaWS8uBtHhKK7pD86VC7zSk-50KBNZFUBRQPu91C633Zy58O3OZz3hBnBFu-oz8OU6uV55UfvA7ZUYjhQnRf2fOfd69ainYb8rNBiVyhU7aTkB9OUPseYKOUlT1UDG3EWwWI0Z0lOIORuCSiOtG4EyJwCURtxhxv0SUSyKuG1HOlIhyScQtRuREyPrBdb4dfk-y_gG2TqoC trending results]
#** <del>review - FD.io CSIT labs vs. AMD CSIT labs, Keesang et al</del>
+
#* #topic HW accelerator - ICXD QAT2.0 - [https://csit.fd.io/trending/#eNrtlkFOwzAQRU8TNmgk7MSkGxa0vUfl2kNjkTiWx9Cmp8cJlZwuiECIsnEWTuQ_8Yz-k75Mofe4I2yfCrEu6nXBa6PjUpTP9_H17hyUFow6aeDigNwxXPFSgXb6FZQfXOiBCbbaA1OAoTGuMo5QsYf4BNs2R0mDVRD395IQjA0gkbh4PKgOOu_HXnwz9tJv4apxUlwzJOXLcVK99CjTD59TJjUgzRr9dOZ0zouXHZI5YzpsciJVqOjtTFTXM4TBzdSLFfV2qvgNCJ5BLIPgNwJRZRDLIKo_B2E6c8rJNDoXjfi_YJow5FxaxsBvgyGn0jKG74aS2N7Z3nfTvSl-U9MfIXgjW7psfQD6wbI- trending results]
# Previous Release [https://docs.fd.io/csit/rls2302/report/ CSIT-2302]
+
#* #topic GTPU HW - [https://csit.fd.io/trending/#eNrdVNtugzAM_Rr2MlkitJS97GEd_1GF4JVoXNw4tHRf34CmmUplj53Wl1x8fHzsoyjsO4c7xvo1SrdRto2SzJZhiVZvz2E7EsGqBWsGUHG8x4QUvqjYHKCk8hMsrXe-b1usGTbrApQB9FWI7j311WnEC80IjXNjzeR9rFn2_kpAEKrOgizLCkE71MKYdSMpHnkmd6s7yf1wukG2XyiEMJXgJnglkDLXKv5MM_R75CyfMn4zNkl_BhyG492MvSH7OMYWwOT-4Mku6j6atfd_tIu6_8zaNH9qO9dM_204c9WdwDura55CgTxdxuw0vwA7i5e4 trending currently empty as test always fails]
#* Performance RCAs
+
#* #topic HW accelerator - SPR DSA
#** [https://jira.fd.io/browse/CSIT-1902 CSIT-1902 3n-alt: Changed performance in VXLAN and IPsec tests.]
+
#** vpp l2bd memif 1core results with-DSA vs without-DSA:
#** [https://jira.fd.io/browse/VPP-2072 VPP-2072 RSS is not deterministic on Intel-E822CQ NIC.]
+
#*** [https://csit.fd.io/trending/#eNrtVkEKwjAQfE29yEITLfXiQe0_SppstdCkcRMFfb21KImC6EkUvTTQmWUmswzE-Y6wdNjOk2yZ5MuE543qP8lkMe6PvbXADThLwNJ0jdwynLFUbkHsa5Cd8aIxSKVG3dTAMjargElAv4GWV6oSDrWQLZnhF7_QlCTQRGcZvjrLqJ2_0QyI3RwC8tBJ4AtCEQbuDAaaRxcpPrcbJmsSGl1zxDA-XDswZJ9oBMpbVX-wEXpJIS8GxnviV1p82wqulr9oDfzfggjkHxf_T7bg7WuY_lsQgdOPi_8nW_DqGrJiZDrSw8soK07Re6De 1518B 150Gbps vs 39Gbps]
# Next Release [https://wiki.fd.io/view/CSIT/csit2306_plan CSIT-2306]
+
#*** [https://csit.fd.io/trending/#eNrtVkFuwjAQfE24oJViN2l66QGafyDH3kCk2DFrgwSvJ4TCAhJqTwgEl1jKzGrGs3NwiB3hLGD7neTTpJgmsmhM_0k-JuP-WHsP0kHwBCJN5yi9wC-R6iWodQ26c1E1Dmlm0TY1fGYVCA0YF9DKylQqoFW6JTf8kgeSMJrAEu1F5M9exKzihSIjfrFh5KYP5itCxQNX9pgWMZwp_m2XJ2tSFkOzRR7vL8247tNkSOhLzbjxZ-hvBkU5MO4RvbHq2eI_Wn6SFch3-9nxg0X_gu2_8wqyd_tPUPZg0b9g-_-7grwcuY7s8ALKyx2bMJwi 64B 15Gbps vs 18 Gbps]
# Physical Infrastructure
+
#** New link with NGINX+DSA trending:
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Performance testing]: Intel Xeon CLX/ICX/SPR, Arm TX2/TSH/ALT, Intel Atom, AMD Zen2.
+
#*** [https://csit.fd.io/trending/#eNrtVcFOwzAM_ZpyQZaSsKq7cGDsP6osMUu0tjGx2RhfT1cmsgkhIU2CA7skUZ7t5zw7MkvK2DJ291W9qJpFZZrox6W6e7gdty0RmAGYMmil1mhI41wr9wye_AZCYmGxbgNqBdoBSoBIM3EURAh8b6HzlLFL1sOwjsMr6NbotoZMfGAxjwcW_yJnlAWhsC_I94kUB5vRFo_P_IqBIJ-Q_TjhEuAp2x45vmGJolYFdqOeBdHunFn2dIIeRWiWk8VF4pur-F_EN78ivlGz-X9u_un9f9v_HyUw1xJc8gvq5c2Qcj_NgfHMIe1AcrQdH6_eAe05xSU RPS tests up to 35 Gbps]
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Functional driver testing]: Intel Xeon SKX, Arm TX2.
+
#** NGINX 2c tests have two-band structure and DSA is more likely to have worse performance:
 +
#*** [https://csit.fd.io/trending/#eNrtlMFqwzAMhp8mvQxB7DXktMO6vkdwba02c2JhaW3ap29aytxSGD0MRtkuttEv6RcfwiwpY8cYX6pmUbWLSrfBTUf1_Po0XRsi0AMwZdB1vUZNyo7tBo1AH8cGfGJhMfYD6hUoCygeAs3FkhchcL2B6ChjTMbBsA7DCKrTqmvAEh9t9NvRxn3KlWdRyO-K8s0kpcJkNKXka8CSIMgXbndPXBq8Z9Mjhz2WLvWqyHYiWhRlr51lRxfqmUK7PGX8NP7HQv-g2PX_1t_i17-I_w9v_b3Ym-VsSLk__fnTm33aguRgIp9DB0_Uw1k trending]
 +
#*** [https://jira.fd.io/browse/CSIT-1971 Jira CSIT-1971]
 +
# #topic CSIT-2406 release notes and VPP RCAs
 +
#* [https://csit.fd.io/cdocs/release_notes/current/ Release Report]
 +
#* [https://csit.fd.io/cdocs/release_notes/current/vpp_performance/ CSIT 24.06 - VPP Performance]
 +
# [https://wiki.fd.io/view/CSIT/csit2410_plan #topic CSIT-2410 release plan]
 +
# #topic Physical Infrastructure
 +
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Performance testing]: Intel Xeon ICX/SPR, Arm ALT/OCT, Nvidia GRS, Intel SNR/ICXD, AMD Zen2.
 +
#* [https://github.com/FDio/csit/blob/master/docs/lab/testbed_specifications.md Functional driver testing]: Intel Xeon SPR, Arm ALT.
 
#* [https://wiki.fd.io/view/Infrastructure_Support Updated LFN FD.io infra support documentation].
 
#* [https://wiki.fd.io/view/Infrastructure_Support Updated LFN FD.io infra support documentation].
#* Lab new builds in progress
+
#* Lab extension points
#** 2 x 2n-spr with mlx cx7 2p200ge and intel e810cq 2p100ge
+
#** SuperMicro servers with Intel Xeon EMR for SUTs (8568Y+ 48c 2.3GHz 350W 300MB DSA QAT) andTGs (8580 60c 2GHz 350W 300MB)
#*** 1 x spr server has been RMAed to SuperMicro, SM update ETA 03-Jun
+
#** Nvidia Grace-Grace single socket super-server (processors based on Arm Neoverse V2 uarch)
#** 1 x 3na-spr with mlx cx7 2p200ge in all slots (6 x cx7)
+
#** Marvell Octeon10 DPU (processors based on Arm Neoverse N2 uarch)
#** 1 x 3nb-spr with intel e810cq 2p100ge and intel e810xxv 4p25ge
+
#** AMD Zen-4 server(s), most likely with Genoa processors (fully fledged Zen4 cores)
#** add mlx cx6 2p100ge to 3n-alt
+
#* Lab decommission point
#** add mlx cx6 (cx7?) 2p100ge to 2n-icx and 3n-icx
+
#** Arm TX2 - approved by ARM community
#* Lab extension - waiting for tech info and quotations
+
#** Arm TSH - approved by ARM community
#** 2023 part-1: add 4 x Xeon SPR 4RU servers for 2 x 1n-spr vpp_device testbeds and 2 x TG-TRex servers
+
#** Intel Xeon CLX - approved on CSIT meeting.
#** 2023 part-2: add 2 x 3n-icxd performance testbeds
+
# #topic Virtual Infrastructure, CI/CD
#*** Each 3n-icxd with: 2 x SuperMicro SYS-110D-20C-FRAN8TP 1RU servers and 0.5 of TG-TRex server - To Be Confirmed
+
# Virtual Infrastructure, CI/CD
+
 
#* LFN FD.io CI/CD systems.
 
#* LFN FD.io CI/CD systems.
#* Jenkins jobs: csit-vpp, vpp-csit.
+
#* Jenkins -> Github Actions migration (selected jobs only)
#* vpp-csit jobs: vpp-csit-verify-device-{..}-tx2 (voting), vpp-csit-verify-device-{..}-skx (voting)
+
#* Jira -> Github Issues migration
#** reports of intermittent failures not related to vpp patch code changes
+
# #topic Environment, Framework
# Environment, Framework
+
 
#* VPP API tracking.
 
#* VPP API tracking.
#** In-progress messages.
+
#** RSS keys.
 
#** CLI without API.
 
#** CLI without API.
# Trending and Test Failures
+
#** Experimental/Production/Deprecated APIs.
#* [https://lists.fd.io/g/csit-report/message/6007 CSIT Test Failures Summary and Status email 2023-06-23]
+
# #topic Trending and Test Failures
 
#* [https://wiki.fd.io/view/CSIT/TestFailuresTracking CSIT Test Failures Tracking Wiki]
 
#* [https://wiki.fd.io/view/CSIT/TestFailuresTracking CSIT Test Failures Tracking Wiki]
 
#* [http://csit.fd.io/ CSIT Performance Dashboard]
 
#* [http://csit.fd.io/ CSIT Performance Dashboard]
Line 83: Line 87:
 
#** [http://csit.fd.io/stats/ Test Job Statistics]
 
#** [http://csit.fd.io/stats/ Test Job Statistics]
 
#** [http://csit.fd.io/news/ Failures and Anomalies]
 
#** [http://csit.fd.io/news/ Failures and Anomalies]
# Analytics, Presentation.
+
# #topic Analytics, Presentation.  
# Fd.io Events
+
# #topic Fd.io Events
#* [https://wiki.lfnetworking.org/pages/viewpage.action?pageId=82905276 LFN Developer & Testing Forum 6-8 June]
+
#* [https://teamup.com/ksgw6qzqcmg9zbzsfq teamup Event calendar and Zoom links]
#** [https://wiki.lfnetworking.org/display/LN/2023-06+-+FD.io%3A+CSIT+Performance+Dashboard FD.io CSIT Performance Dashboard talk - Thursday 8th of June 6-7am PDT / 3-4pm CEST]
+
# #topic Housekeeping
#** [https://teamup.com/ksgw6qzqcmg9zbzsfq teamup Event calendar and Zoom links]
+
#* Jira references in CSIT code. Example: 41771: feat(TrafficGenerator): Retry one negative trial | https://gerrit.fd.io/r/c/csit/+/41771
# Housekeeping.
+
#* What to do when Json export validation fails:
#* Pylint version, pylint configuration, black, line length...
+
#** [https://jira.fd.io/browse/CSIT-1970 Jira CSIT-1970]
 +
#** Possible fix: 41765: fix(export): Fail and re-export on invalid pass | https://gerrit.fd.io/r/c/csit/+/41765
 +
#* #link 41191: feat(guidelines): Add license and copyright | https://gerrit.fd.io/r/c/csit/+/41191
 +
#* #link 41077: fix(guidelines): Apply low-controversy edits | https://gerrit.fd.io/r/c/csit/+/41077
 +
#* #link 41078: feat(guidelines): Apply medium-controversy edits | https://gerrit.fd.io/r/c/csit/+/41078
 +
#* #link 41079: feat(guidelines): Add rules governing dead code | https://gerrit.fd.io/r/c/csit/+/41079
 +
# #endmeeting
  
 
== Meeting Minutes ==
 
== Meeting Minutes ==
  
 
* [[CSIT/Meeting_Minutes | CSIT Meeting Minutes]]
 
* [[CSIT/Meeting_Minutes | CSIT Meeting Minutes]]
 +
* [[CSIT/Meeting_Minutes_2023 | CSIT Meeting Minutes Archive 2023]]
 
* [[CSIT/Meeting_Minutes_2022 | CSIT Meeting Minutes Archive 2022]]
 
* [[CSIT/Meeting_Minutes_2022 | CSIT Meeting Minutes Archive 2022]]
 
* [[CSIT/Meeting_Minutes_2021 | CSIT Meeting Minutes Archive 2021]]
 
* [[CSIT/Meeting_Minutes_2021 | CSIT Meeting Minutes Archive 2021]]

Latest revision as of 12:47, 30 October 2024

Meeting Details

Weekly on Wednesday 15:00 Greenwich, London time. FD.io Zoom Meeting room (passcode <remove spaces> '4 1 2 3 2 4')
If no DST in Europe and US: 07:00 PST, 10:00 EST, 15:00 UTC, 15:00 UK/GMT, 16:00 CET, 17:00 Israel Std Time, 20:30 India Std Time, 23:00 China Std Time.
If DST in Europe: 07:00 PDT, 10:00 EDT, 14:00 UTC, 15:00 UK/BST, 16:00 CEST, 17:00 Israel Summer Time, 19:30 India Std Time, 22:00 China Std Time.
If no DST in Europe and DST in US: 08:00 PDT, 11:00 EDT, 15:00 UTC, 15:00 UK/GMT, 16:00 CET, 17:00 Israel Std Time, 20:30 India Std Time, 23:00 China Std Time.

Topic: FD.io CSIT Project Meeting

Join from PC, Mac, Linux, iOS or Android: https://zoom.us/my/fastdata?pwd=Z3Z0UnJyUmRIMlU3eTJLcGF6VEptQT09

Or iPhone one-tap (US Toll):  +14086380968,,5301185804# or +16465588656,,5301185804#

Or Telephone:
    Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll)
    +1 855 880 1246 (US Toll Free)
    +1 877 369 0926 (US Toll Free)
    Meeting ID: 530 118 5804
    International numbers available: https://zoom.us/zoomconference?m=ppBOQMQTVxGYmbxNsVemC6KNo8eX2ptF

Issues connecting to the meeting? Contact: Maciek Konstantynowicz <mkonstan@cisco.com>.

Agenda

The next CSIT meeting is scheduled for Wednesday 30-October 15:00-16:00 London time / 07:00-08:00 PST. Proposed topics:

  1. #startmeeting "FD.io CSIT Project Meeting"
  2. #chair dwallacelf Kai98 vrpolak mackonstan tifrank
  3. #topic Agenda bashing
  4. #topic VPP update
  5. #topic TSC update
  6. #topic Other update
  7. #topic New or refactored tests
  8. VPP and CSIT (not so hot) items
  9. #topic CSIT-2406 release notes and VPP RCAs
  10. #topic CSIT-2410 release plan
  11. #topic Physical Infrastructure
    • Performance testing: Intel Xeon ICX/SPR, Arm ALT/OCT, Nvidia GRS, Intel SNR/ICXD, AMD Zen2.
    • Functional driver testing: Intel Xeon SPR, Arm ALT.
    • Updated LFN FD.io infra support documentation.
    • Lab extension points
      • SuperMicro servers with Intel Xeon EMR for SUTs (8568Y+ 48c 2.3GHz 350W 300MB DSA QAT) andTGs (8580 60c 2GHz 350W 300MB)
      • Nvidia Grace-Grace single socket super-server (processors based on Arm Neoverse V2 uarch)
      • Marvell Octeon10 DPU (processors based on Arm Neoverse N2 uarch)
      • AMD Zen-4 server(s), most likely with Genoa processors (fully fledged Zen4 cores)
    • Lab decommission point
      • Arm TX2 - approved by ARM community
      • Arm TSH - approved by ARM community
      • Intel Xeon CLX - approved on CSIT meeting.
  12. #topic Virtual Infrastructure, CI/CD
    • LFN FD.io CI/CD systems.
    • Jenkins -> Github Actions migration (selected jobs only)
    • Jira -> Github Issues migration
  13. #topic Environment, Framework
    • VPP API tracking.
      • RSS keys.
      • CLI without API.
      • Experimental/Production/Deprecated APIs.
  14. #topic Trending and Test Failures
  15. #topic Analytics, Presentation.
  16. #topic Fd.io Events
  17. #topic Housekeeping
  18. #endmeeting

Meeting Minutes