Difference between revisions of "VPP/AArch64"

Revision as of 07:04, 7 June 2019

Get Involved

Meeting Details

• Regular AArch64 meeting: Tuesdays at 06:00 PT (Pacific Time) (weekly). Convert to your timezone.
  • FD.io Zoom Meeting room

IRC Channel

#fdio-arm on freenode.net

Slack

Request invitation at https://slack.fd.io/

Jira

Jira issues with ARM64 label

Presentations

• The path to Fast Data on Arm [pdf] - FD.io Mini-Summit at KC+CNC EU 2018
• Vector Packet Processing (VPP) Arm Story: Now and Beyond [youtube] - FD.io Mini-summit at KC+CNC NA 2018

Release Milestones

18.10

18.07

18.04

• CI
  • Upstream patch verification on ARMv8 machines
  • .deb packages

Machines

The FD.io lab is hosted at VEXXHOST colocation centre in Montreal Québec, Canada.

• CI build servers integrated into Jenkins

• CSIT test beds (under construction)

Note: to get lab access, create a gpg key, upload it to keyserver, have it signed by a trusted anchor in a video call (fingerprint will be needed) and then an ARM authority (Tina) needs to send an e-mail to helpdesk@fd.io with your name, e-mail, keygrip and key fingerprint

CI

Covers automated build, unit test, and packaging for various Linux distros on ARMv8 machines.

Next steps:

• make test added to verify jobs
• Clang build
• openSUSE Leap 15 | CentOS 7 | Ubuntu 18.04
• vpp-csit-verify-virl-master or equivalent CSIT functional testing

CSIT

Covers automated functional and performance integration testing on ARMv8 3-node and 2-node testbeds.

https://wiki.fd.io/view/CSIT/AArch64

Contiv-VPP

This Kubernetes network plugin uses FD.io VPP to provide network connectivity between PODs.

https://github.com/contiv/vpp

The installation guide of Contiv-VPP on Arm64 platform is

https://github.com/contiv/vpp/blob/master/docs/arm64/MANUAL_INSTALL_ARM64.md

Porting and Tuning Roadmap

• VPP Vectorization: Expanding the Neon Library for IPv4 forwarding code path - Sirshak/Lijian
• Tuning the quad loop/dual loop for small cores - Lijian
• General performance analysis and tuning of various graph nodes for IPv4 forwarding test case - Sirshak/Lijian
• Memory Ordering - Sirshak
• CSIT Performance Test - Khemendra
• CSIT Device Test - Juraj
• CSIT Path Test - Juraj

Known Issues

GCC 5.3 ICEs during FP register allocation. Please use GCC 5.4 or newer.

Activity

Recent Patches

06/04/2019

• Attendees
  • Sirshak Das
  • Honnappa Nagarahalli
  • Tina Tsou
  • Lijian Zhang
  • Jieqiang Wang
  • Stan
• General
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server: https://jira.fd.io/browse/VPP-1569
    • Patch to resolve the issue is in community review. https://gerrit.fd.io/r/#/c/18278/ - Lijian
  • Adding Taishan test bed to CSIT Status: https://gerrit.fd.io/r/#/c/16850/
    • creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status:
    • mcbin: Kernel Migration on mcbin. Status:
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • thunderx2: Status:
• FD.io lab
  • Require one ThunderX2(currently only one thunderX2 in the lab) in FD.io lab
  • ThunderX1
• VPP
  • VPP host-stack Hotspots
    • Decrease or remove ATOMIC_ACQUIRE atomics in foreach_device_and_queue
  • Investigating message queue, understand use case with svm queue, talk the ideas with Florin - ongoing - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Investigating performance degradation on Bluefield - Sirshak
      • Will resume Taishan host-stack setup - Lijian
    • VPP machiatto bin showing some unstable performance.
  • Vectorization
    • ethernet-input causes performance drop on AArch64.
      • There's performance drop issue after the ethernet-input optimization. The major reason is after the refactor, if promiscuous is enabled on NIC, all traffic from the NIC will fall into so-called slow path.
      • A vectorized patch to optimize eth_input_adv_and_flags_x4 is under internal review.
  • TAS patch - Upstreamed.
  • MAP with VPP - error is resolved. Sort of working. Record the details.
  • Investigate hyperscan plugin in VPP - Sirshak
    • DPI plugin?
  • EPIC for next quarter:
    • ethernet-input - Planned (Lijian). will implement for aarch64 128bits only
    • Message Queue - Planned (Lijian)
    • VPP svm_fifo patch performance optimization on A72 cores – Planned (Sirshak)
    • TAS patch (Sirshak)
    • MAP with VPP - Planned (Sirshak)
    • Roadmap for TCP optimization
      • Timer implementation - (Sirshak) - Indicative
      • perf analysis - Planned (Sirshak)
        • TCP state machine from weak memory model perspective

05/28/2019

• Attendees
  • Sirshak Das
  • Honnappa Nagarahalli
  • Tina
  • Lijian Zhang
  • Vijay (vijayakumar.rajamanickam@nokia.com)
• General
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server: https://jira.fd.io/browse/VPP-1569
    • Patch to resolve the issue is in community review. https://gerrit.fd.io/r/#/c/18278/ - Lijian
  • Adding Taishan test bed to CSIT Status: https://gerrit.fd.io/r/#/c/16850/
    • creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status:
    • mcbin: Kernel Migration on mcbin. Status:
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • thunderx2: Status:
• FD.io lab
  • Require one ThunderX2(currently only one thunderX2 in the lab) in FD.io lab
  • ThunderX1
• VPP
  • VPP host-stack Hotspots
    • Decrease or remove ATOMIC_ACQUIRE atomics in foreach_device_and_queue
  • Investigating message queue, understand use case with svm queue, talk the ideas with Florin - ongoing - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Investigating performance degradation on Bluefield - Sirshak
      • Will resume Taishan host-stack setup - Lijian
    • VPP machiatto bin showing some unstable performance.
  • Vectorization
    • ethernet-input causes performance drop on AArch64.
      • There's performance drop issue after the ethernet-input optimization. The major reason is after the refactor, if promiscuous is enabled on NIC, all traffic from the NIC will fall into so-called slow path.
      • A vectorized patch to optimize eth_input_adv_and_flags_x4 is under internal review.
  • TAS patch - internal Review.
  • MAP with VPP - Tried internal Patch still failing. Continuing to work on it.
  • Investigate hyperscan plugin in VPP - Sirshak
    • DPI plugin?
  • EPIC for next quarter:
    • ethernet-input - Planned (Lijian). will implement for aarch64 128bits only
    • Message Queue - Planned (Lijian)
    • VPP svm_fifo patch performance optimization on A72 cores – Planned (Sirshak)
    • TAS patch (Sirshak)
    • MAP with VPP - Planned (Sirshak)
    • Roadmap for TCP optimization
      • Timer implementation - (Sirshak) - Indicative
      • perf analysis - Planned (Sirshak)
        • TCP state machine from weak memory model perspective

05/21/2019

• Attendees
  • Sirshak Das
  • Honnappa Nagarahalli
  • Tina
  • Lijian Zhang
  • Vijay (vijayakumar.rajamanickam@nokia.com)
• General
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server: https://jira.fd.io/browse/VPP-1569
    • Patch to resolve the issue is in community review. https://gerrit.fd.io/r/#/c/18278/ - Lijian
  • Adding Taishan test bed to CSIT Status: https://gerrit.fd.io/r/#/c/16850/
    • creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status:
    • mcbin: Kernel Migration on mcbin. Status:
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • thunderx2: Status:
• FD.io lab
  • Require one ThunderX2(currently only one thunderX2 in the lab) in FD.io lab
  • ThunderX1
• VPP
  • VPP host-stack Hotspots
    • Decrease or remove ATOMIC_ACQUIRE atomics in foreach_device_and_queue
  • Investigating message queue, understand use case with svm queue, talk the ideas with Florin - ongoing - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Investigating performance degradation on Bluefield - Sirshak
      • Will resume Taishan host-stack setup - Lijian
    • VPP machiatto bin showing some unstable performance.
  • Vectorization
    • ethernet-input causes performance drop on AArch64.
      • There's performance drop issue after the ethernet-input optimization. The major reason is after the refactor, if promiscuous is enabled on NIC, all traffic from the NIC will fall into so-called slow path.
      • A vectorized patch to optimize eth_input_adv_and_flags_x4 is under internal review.
  • TAS patch - internal Review.
  • MAP with VPP - Tried internal Patch still failing. Continuing to work on it.
  • Investigate hyperscan plugin in VPP - Sirshak
    • DPI plugin?
  • EPIC for next quarter:
    • ethernet-input - Planned (Lijian). will implement for aarch64 128bits only
    • Message Queue - Planned (Lijian)
    • VPP svm_fifo patch performance optimization on A72 cores – Planned (Sirshak)
    • TAS patch (Sirshak)
    • MAP with VPP - Planned (Sirshak)
    • Roadmap for TCP optimization
      • Timer implementation - (Sirshak) - Indicative
      • perf analysis - Planned (Sirshak)
        • TCP state machine from weak memory model perspective

05/14/2019

• Attendees
  • Sirshak Das
  • Honnappa Nagarahalli
  • Tina
  • Lijian Zhang
  • Vijay (vijayakumar.rajamanickam@nokia.com)
• General
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server: https://jira.fd.io/browse/VPP-1569
    • Patch to resolve the issue is in community review. https://gerrit.fd.io/r/#/c/18278/ - Lijian
  • Adding Taishan test bed to CSIT Status: https://gerrit.fd.io/r/#/c/16850/
    • creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status:
    • mcbin: Kernel Migration on mcbin. Status:
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • thunderx2: Status:
• FD.io lab
  • Require one ThunderX2(currently only one thunderX2 in the lab) in FD.io lab
  • ThunderX1
• VPP
  • VPP host-stack Hotspots
    • Decrease or remove ATOMIC_ACQUIRE atomics in foreach_device_and_queue
  • VPP generic distro package building patch - Patch updated. Require Damjan's follow up review.
  • Investigating message queue, understand use case with svm queue, talk the ideas with Florin - ongoing - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Investigating performance degradation on Bluefield - Sirshak
      • Will resume Taishan host-stack setup - Lijian
    • VPP machiatto bin showing some unstable performance.
  • Vectorization
    • ethernet-input causes performance drop on AArch64.
      • There's performance drop issue after the ethernet-input optimization. The major reason is after the refactor, if promiscuous is enabled on NIC, all traffic from the NIC will fall into so-called slow path.
      • A vectorized patch to optimize eth_input_adv_and_flags_x4 is under internal review.
  • TAS patch - internal Review.
  • MAP with VPP - Tried internal Patch still failing. Continuing to work on it.
  • Investigate hyperscan plugin in VPP - Sirshak
    • DPI plugin?
  • EPIC for next quarter:
    • ethernet-input - Planned (Lijian). will implement for aarch64 128bits only
    • Message Queue - Planned (Lijian)
    • VPP svm_fifo patch performance optimization on A72 cores – Planned (Sirshak)
    • TAS patch (Sirshak)
    • MAP with VPP - Planned (Sirshak)
    • Roadmap for TCP optimization
      • Timer implementation - (Sirshak) - Indicative
      • perf analysis - Planned (Sirshak)
        • TCP state machine from weak memory model perspective

05/07/2019

• Attendees
  • Sirshak Das
  • Honnappa Nagarahalli
  • Tina
  • Lijian Zhang
  • Vijay (vijayakumar.rajamanickam@nokia.com)
• General
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server: https://jira.fd.io/browse/VPP-1569
    • Patch to resolve the issue is in community review. https://gerrit.fd.io/r/#/c/18278/ - Lijian
  • Adding Taishan test bed to CSIT Status: https://gerrit.fd.io/r/#/c/16850/
    • creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status:
    • mcbin: Kernel Migration on mcbin. Status:
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • thunderx2: Status:
• FD.io lab
  • Require one ThunderX2(currently only one thunderX2 in the lab) in FD.io lab
  • ThunderX1
• VPP
  • VPP host-stack Hotspots
    • Decrease or remove ATOMIC_ACQUIRE atomics in foreach_device_and_queue
    • Investigate ((xd->flags & DPDK_DEVICE_FLAG_ADMIN_UP) == 0) in dpdk_device_input.
  • VPP generic distro package building patch - Patch updated Damjan's follow up review required.
  • Investigating message queue, understand use case with svm queue, talk the ideas with Florin - ongoing - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Investigating performance degradation on Bluefield - Sirshak
      • Will resume Taishan host-stack setup - Lijian
    • VPP machiatto bin showing some unstable performance.
  • Vectorization
    • Vectorization in esp-encrypt, optimize memcpy_le. Upstreamed(https://gerrit.fd.io/r/#/c/18398/). - Lijian
    • ethernet-input causes performance drop on AArch64.
      • There's performance drop issue after the ethernet-input optimization. The major reason is after the refactor, if promiscuous is enabled on NIC, all traffic from the NIC will fall into so-called slow path.
      • A vectorized patch to optimize eth_input_adv_and_flags_x4 is under internal review.
  • TAS patch - internal Review.
  • MAP(Arm Proprietary Performance Analysis Tool) with VPP - Tried internal Patch still failing. Continuing to work on it.
  • EPIC for next quarter:
    • ethernet-input - Planned (Lijian). will implement for aarch64 128bits only
    • Message Queue - Planned (Lijian)
    • VPP svm_fifo patch performance optimization on A72 cores – Planned (Sirshak)
    • TAS patch (Sirshak)
    • MAP with VPP - Planned (Sirshak)
    • Roadmap for TCP optimization
      • Timer implementation - (Sirshak) - Indicative
      • perf analysis - Planned (Sirshak)
        • TCP state machine from weak memory model perspective

04/30/2019

• Attendees
  • Sirshak Das
  • Honnappa Nagarahalli
  • Tina
• General
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server: https://jira.fd.io/browse/VPP-1569
    • Patch to resolve the issue is in community review. https://gerrit.fd.io/r/#/c/18278/ - Lijian
  • Adding Taishan test bed to CSIT Status: https://gerrit.fd.io/r/#/c/16850/
    • creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status:
    • mcbin: Kernel Migration on mcbin. Status:
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • thunderx2: Status:
• FD.io lab
  • Require one ThunderX2(currently only one thunderX2 in the lab) in FD.io lab
  • ThunderX1
• VPP
  • VPP host-stack Hotspots
    • Decrease or remove ATOMIC_ACQUIRE atomics in foreach_device_and_queue
    • Investigate ((xd->flags & DPDK_DEVICE_FLAG_ADMIN_UP) == 0) in dpdk_device_input.
  • VPP generic distro package building patch - Patch updated Damjan's follow up review required.
  • Investigating message queue, understand use case with svm queue, talk the ideas with Florin - ongoing - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Investigating performance degradation on Bluefield - Sirshak
      • Will resume Taishan host-stack setup - Lijian
    • VPP machiatto bin showing some unstable performance.
  • Vectorization
    • Vectorization in esp-encrypt, optimize memcpy_le. Upstreamed(https://gerrit.fd.io/r/#/c/18398/). - Lijian
    • ethernet-input causes performance drop on AArch64.
      • There's performance drop issue after the ethernet-input optimization. The major reason is after the refactor, if promiscuous is enabled on NIC, all traffic from the NIC will fall into so-called slow path.
      • A vectorized patch to optimize eth_input_adv_and_flags_x4 is under internal review.
  • TAS patch - internal Review.
  • MAP(Arm Proprietary Performance Analysis Tool) with VPP - Tried internal Patch still failing. Continuing to work on it.
  • EPIC for next quarter:
    • ethernet-input - Planned (Lijian). will implement for aarch64 128bits only
    • Message Queue - Planned (Lijian)
    • VPP svm_fifo patch performance optimization on A72 cores – Planned (Sirshak)
    • TAS patch (Sirshak)
    • MAP with VPP - Planned (Sirshak)
    • Roadmap for TCP optimization
      • Timer implementation - (Sirshak) - Indicative
      • perf analysis - Planned (Sirshak)
        • TCP state machine from weak memory model perspective

04/23/2019

• Attendees
  • Sirshak Das
  • Lijian Zhang
  • Juraj Linkeš
  • Vijay
  • Nitin
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Honnappa Nagarahalli
• General
• CSIT
  • VPP Performance Test
  • List all the blockers on aarch64 in CSIT wiki page - Done - Stan or Juraj
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
    • Patch to resolve the issue is in community review. https://gerrit.fd.io/r/#/c/18278/ - Lijian
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/ - Done
    • b. merging CSIT patch. - Closing done
    • c. creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • Add license header/copy right to scripts - Sirshak/Honnappa to confirm with Andy Waffa
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
    • QSFP+ is available and working now.
      • Juraj to resend email to Mahamad about the details, including Sirshak and Tina
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • thunderx2: Status: server is set up. Management connection works. Intel NICs are well connected. Will prepare the server for VPP device testing. Now is working on containers for VPP device. Will probably be able to run VPP device tests manually this week.
• FD.io lab
  • Require one ThunderX2(currently only one thunderX2 in the lab) in FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Management connection thru QSFP+ switch is working now. Moving VPP device work to ThunderX1 blade servers.
    • Will use these four new ThunderX1 servers for CI, Genkins to replace the previous three old ThunderX1 servers.
    • These four ThunderX1 blade are not identical. The first one has two numa nodes, and other three blades have one numa node.
    • Investigate why these three blades have only one numa node - Juraj
• VPP
  • Investigate session_queue_node_fn/vlib_worker_loop.
    • Decrease or remove ATOMIC_ACQUIRE atomics in foreach_device_and_queue
    • Investigate ((xd->flags & DPDK_DEVICE_FLAG_ADMIN_UP) == 0) in dpdk_device_input
  • Rebase VPP distro package building patch; contact Damjan in slack; Talk with Damjan in vpp meeting - Lijian & Sirshak
  • Investigating message queue, understand use case with svm queue, talk the ideas with Florin - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Perf degradation is fixed. Investigating performance degradation on Bluefield - Sirshak
      • Will resume Taishan host-stack setup - Lijian
    • Octeon-Tx Status(Sirshak): Done by Malvika. Running DPDK sample apps on it now.
  • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
  • Vectorization
    • Vecterization in esp-encrypt, https://gerrit.fd.io/r/#/c/18398/ - Get improvement on ThunderX/OcteonTX/Taishan, but degradation on ThunderX2 - Lijian
  • TAS patch will be ready soon (Sirshak)
  • MAP with VPP is ongoing - Sirshak
  • EPIC for next quarter:
    • ethernet-input - Planned (Lijian). will implement for aarch64 128bits only
    • Message Queue - Planned (Lijian)
    • VPP svm_fifo patch performance optimization on A72 cores – Planned (Sirshak)
    • TAS patch (Sirshak)
    • MAP with VPP - Planned (Sirshak)
    • Roadmap for TCP optimization
      • Timer implementation - (Sirshak) - Indicative
      • perf analysis - Planned (Sirshak)
        • TCP state machine from weak memory model perspective
• Action Items - Last Week
• Action Items - Next Week

04/16/2019

• Attendees
  • Sirshak Das
  • Lijian Zhang
  • Juraj Linkeš
  • Vijay
  • Nitin
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Honnappa Nagarahalli
• General
• CSIT
  • VPP Performance Test
  • List all the blockers on aarch64 in CSIT wiki page - Done - Stan or Juraj
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
    • Patch to resolve the issue is in community review. https://gerrit.fd.io/r/#/c/18278/ - Lijian
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/ - Done
    • b. merging CSIT patch. - Closing done
    • c. creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • Add license header/copy right to scripts - Sirshak/Honnappa to confirm with Andy Waffa
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
    • QSFP+ is available and working now.
      • Juraj to resend email to Mahamad about the details, including Sirshak and Tina
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • thunderx2: Status: server is set up. Management connection works. Intel NICs are well connected. Will prepare the server for VPP device testing. Now is working on containers for VPP device. Will probably be able to run VPP device tests manually this week.
• FD.io lab
  • Require one ThunderX2(currently only one thunderX2 in the lab) in FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Management connection thru QSFP+ switch is working now. Moving VPP device work to ThunderX1 blade servers.
    • Will use these four new ThunderX1 servers for CI, Genkins to replace the previous three old ThunderX1 servers.
    • These four ThunderX1 blade are not identical. The first one has two numa nodes, and other three blades have one numa node.
    • Investigate why these three blades have only one numa node - Juraj
• VPP
  • Investigate session_queue_node_fn/vlib_worker_loop. - https://jira.arm.com/browse/ENTNET-1179 - Done
    • Will create two Jira tickets to track the findings. - Lijian
  • Rebase VPP distro package building patch; contact Damjan in slack; Talk with Damjan in vpp meeting - Lijian & Sirshak
  • Investigating message queue - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Perf degradation is fixed. Investigating performance degradation on Bluefield - Sirshak
      • Will resume Taishan host-stack setup - Lijian
    • Octeon-Tx Status(Sirshak): Done by Malvika. Running DPDK sample apps on it now.
  • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
  • Vectorization
    • Vecterization in esp-encrypt, https://gerrit.fd.io/r/#/c/18398/ - Get improvement on ThunderX/OcteonTX/Taishan, but degradation on ThunderX2 - Lijian
  • EPIC for next quarter:
    • ethernet-input - Planned (Lijian). will implement for aarch64 128bits only
    • Message Queue - Planned (Lijian)
    • VPP svm_fifo patch performance optimization on A72 cores – Planned (Sirshak)
    • TAS patch (Sirshak)
    • MAP with VPP - Planned (Sirshak)
    • Roadmap for TCP optimization
      • Timer implementation - (Sirshak) - Indicative
      • perf analysis - Planned (Sirshak)
        • TCP state machine from weak memory model perspective
• Action Items - Last Week
• Action Items - Next Week

04/09/2019

• Attendees
  • Sirshak Das
  • Lijian Zhang
  • Juraj Linkeš
  • Nitin
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Honnappa Nagarahalli
• General
• CSIT
  • VPP Performance Test
  • List all the blockers on aarch64 in CSIT wiki page - Done - Stan or Juraj
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
    • Patch to resolve the issue is in community review. https://gerrit.fd.io/r/#/c/18278/ - Lijian
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/ - Done
    • b. merging CSIT patch. - Closing done
    • c. creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • Add license header/copy right to scripts - Sirshak/Honnappa to confirm with Andy Waffa
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
    • QSFP+ is available and working now.
      • Juraj to resend email to Mahamad about the details, including Sirshak and Tina
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • thunderx2: Status: server is set up. Management connection works. Intel NICs are well connected. Will prepare the server for VPP device testing. Now is working on containers for VPP device. Will probably be able to run VPP device tests manually this week.
• FD.io lab
  • Require one ThunderX2(currently only one thunderX2 in the lab) in FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Management connection thru QSFP+ switch is working now. Moving VPP device work to ThunderX1 blade servers.
    • Will use these four new ThunderX1 servers for CI, Genkins to replace the previous three old ThunderX1 servers.
    • These four ThunderX1 blade are not identical. The first one has two numa nodes, and other three blades have one numa node.
    • Investigate why these three blades have only one numa node - Juraj
• VPP
• VPP Hoststack
  • Investigate session_queue_node_fn/vlib_worker_loop. - https://jira.arm.com/browse/ENTNET-1179 - Done
  • Rebase VPP distro package building patch; contact Damjan in slack; Talk with Damjan in vpp meeting - Lijian & Sirshak
  • Investigating message queue - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Perf degradation is fixed. Investigating performance degradation on Bluefield - Sirshak
    • Octeon-Tx Status(Sirshak): Done by Malvika. Running DPDK sample apps on it now.
  • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
  • Vectorization
    • Vecterization in esp-encrypt, https://gerrit.fd.io/r/#/c/18398/ - Get improvement on ThunderX/OcteonTX/Taishan, but degradation on ThunderX2 - Lijian
    • ethernet-input - will implement for aarch64 128bits only
    • Create vectorization specific EPIC - Lijian
• Action Items - Last Week
• Action Items - Next Week

04/02/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Nitin
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Gorka
  • Fede
  • Honnappa Nagarahalli
• General
• VPP Hoststack
  • After assigned dedicated CPU processors for VPP main/VPP worker/iperf3 server, both ThunderX2 and Taishan Server VPP hoststack give better performance compared with Linux stack.
  • Investigate session_queue_node_fn/message queue data structure. - Investigating the source code
  • Review https://gerrit.fd.io/r/#/c/18398/ - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Working on fixing VPP Path errors from svm_fifo patch. Upstreamed. Perf degradation is fixed.
    • Octeon-Tx Status(Sirshak): Done by Malvika. Running DPDK on it now.
  • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
• CSIT
  • VPP Performance Test
  • List all the blockers on aarch64 in CSIT wiki page - Stan or Juraj
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
  • Both binaries and packages built with generic option by default, and provide Makefile variable NATIVE_OPTIMIZE=Y for end user to build native optimized images.
    • Prepare email and a draft patch asking comments from community - Lijian
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/ - Done
    • b. merging CSIT patch. - Closing done
    • c. creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • Add license header/copy right to scripts - Sirshak/Honnappa to confirm with Andy Waffa
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
    • QSFP+ is available and working now.
      • Juraj to resend email to Mahamad about the details, including Sirshak and Tina
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • Confirm if Jianlin's board has the exactly same plugable switches with Juraj's boards - Lijian
    • thunderx2: Status: server is set up. Management connection works. Intel NICs are well connected. Will prepare the server for VPP device testing. Now is working on containers for VPP device. Will probably be able to run VPP device tests manually this week.
• FD.io lab
  • Require one ThunderX2(currently only one thunderX2 in the lab) in FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Management connection thru QSFP+ switch is working now. Moving VPP device work to ThunderX1 blade servers.
    • Will use these four new ThunderX1 servers for CI, Genkins to replace the previous three old ThunderX1 servers.
    • These four ThunderX1 blade are not identical. The first one has two numa nodes, and other three blades have one numa node.
    • Investigate why these three blades have only one numa node - Juraj
• VPP
  • Write description/expectation about the two NEON related patch - Lijian
  • Investigating performance degradation on CortexA72 - Sirshak
  • Message queue - Sirshak
  • Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560 - To close it.
  • Vectorization
    • ethernet-input - no progress yet
  • 128B cache line size
  • Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
• Action Items - Next Week

03/26/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Nitin
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Gorka
  • Fede
  • Honnappa Nagarahalli
• General
• VPP Hoststack
  • After assigned dedicated CPU processors for VPP main/VPP worker/iperf3 server, both ThunderX2 and Taishan Server VPP hoststack give better performance compared with Linux stack.
  • Investigate session_queue_node_fn/message queue data structure. - Investigating the source code
  • Review https://gerrit.fd.io/r/#/c/18398/ - Lijian
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Working on fixing VPP Path errors from svm_fifo patch. Upstreamed. Perf degradation is fixed.
    • Octeon-Tx Status(Sirshak): Done by Malvika. Running DPDK on it now.
  • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
  • Both binaries and packages built with generic option by default, and provide Makefile variable NATIVE_OPTIMIZE=Y for end user to build native optimized images.
    • Prepare email and a draft patch asking comments from community - Lijian
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/ - Done
    • b. merging CSIT patch. - Closing done
    • c. creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • Add license header/copy right to scripts - Sirshak/Honnappa to confirm with Andy Waffa
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
    • QSFP+ is available and working now.
      • Juraj to resend email to Mahamad about the details, including Sirshak and Tina
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • Confirm if Jianlin's board has the exactly same plugable switches with Juraj's boards - Lijian
    • thunderx2: Status: server is set up. Management connection works. Intel NICs are well connected. Will prepare the server for VPP device testing. Now is working on containers for VPP device. Will probably be able to run VPP device tests manually this week.
• FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Management connection thru QSFP+ switch is working now. Moving VPP device work to ThunderX1 blade servers.
    • Will use these four new ThunderX1 servers for CI, Genkins to replace the previous three old ThunderX1 servers.
    • These four ThunderX1 blade are not identical. The first one has two numa nodes, and other three blades have one numa node.
    • Investigate why these three blades have only one numa node - Juraj
• VPP
  • Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560 - To close it.
  • Vectorization
    • ethernet-input - no progress yet
  • 128B cache line size
  • Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
• Action Items - Next Week

03/19/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Stanislav Chlebec
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Gorka
  • Fede
  • Honnappa Nagarahalli
• General
• VPP Hoststack
  • After assigned dedicated CPU processors for VPP main/VPP worker/iperf3 server, both ThunderX2 and Taishan Server VPP hoststack give better performance compared with Linux stack.
  • vlib_worker_loop and session_queue_node_fn are two major hot-spots. - Just started
  • Enable NEON instruction in Buffer pool free function. Patch is committed.
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Working on fixing VPP Path errors from svm_fifo patch. Upstreamed, but still working on issues, e.g., performance degradation
    • Octeon-Tx Status(Sirshak): yet to try steps from gorka for usb ubuntu rootfs installation. - Done by Malvika.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
    • Prepare email and a draft patch asking comments from community - Lijian
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/ - Done
    • b. merging CSIT patch. - Closing done
    • c. creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • Add license header/copy right to scripts - Sirshak/Honnappa to confirm with Andy Waffa
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
      • Juraj to resend email to Mahamad about the details, including Sirshak and Tina
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
      • Confirm with Gorka if their mcbin can support docker. If yes, then ask them to provide image with their latest kernel/file system/dtd
    • Confirm if Jianlin's board has the exactly same plugable switches with Juraj's boards - Lijian
    • thunderx2: Status: Talk to edk about deployment strategy with 1-node. Also blocked by QSFP+ issue.
• FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Juraj setup call with LF people. Status: Done.
  • ThunderX2
    • Cables: Sent. Juraj to open another tkt for wiring the ThunderX2.
• VPP
  • Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560 - In internal review.
  • Vectorization
    • ethernet-input - no progress yet
    • buffer pools - https://jira.fd.io/browse/VPP-1560. In internal review
  • 128B cache line size
    • VPP image with 128B cache line size crashed on ThunderX2 - Cannot reproduce crash with my setup
  • Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
• Action Items - Next Week
  • Commit VPP distro making patch - Lijian
  • Plugin 25G NIC Taishan server, and connect the 25G ports to x86 25G NIC - Lijian
  • Follow Jianlin's suggestion, update Uboot and Kernel, and then sync up with Juraj - Lijian

03/12/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Stanislav Chlebec
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Gorka
  • Fede
  • Honnappa Nagarahalli
• General
  • Tina to update the meeting notice.
• VPP Hoststack
  • After assigned dedicated CPU processors for VPP main/VPP worker/iperf3 server, both ThunderX2 and Taishan Server VPP hoststack give better performance compared with Linux stack.
  • vlib_worker_loop and session_queue_node_fn are two major hot-spots. - No progress
  • Enable NEON instruction in Buffer pool free function. Patch is committed.
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Working on fixing VPP Path errors from svm_fifo patch. All test failures are resolved.
    • Octeon-Tx Status(Sirshak): yet to try steps from gorka for usb ubuntu rootfs installation. - Switched to Malvika.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
    • Prepare email and a draft patch asking comments from community - Lijian
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/ - Done
    • b. merging CSIT patch. - Closing done
    • c. creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • Add license header/copy right to scripts - Sirshak/Honnappa to confirm with Andy Waffa
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
    • Confirm if Jianlin's board has the exactly same plugable switches with Juraj's boards - Lijian
    • thunderx2: Status: Talk to edk about deployment strategy with 1-node.
• FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Juraj setup call with LF people. Status: Done.
  • ThunderX2
    • Cables: Sent. Juraj to open another tkt for wiring the ThunderX2.
• VPP
  • Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560 - In internal review.
  • Vectorization
    • ethernet-input - no progress yet
    • buffer pools - https://jira.fd.io/browse/VPP-1560. In internal review
  • 128B cache line size
    • VPP image with 128B cache line size crashed on ThunderX2
  • thunderx2 crashing - No update
  • Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
• Action Items - Next Week
  • Commit VPP distro making patch - Lijian
  • Plugin 25G NIC Taishan server, and connect the 25G ports to x86 25G NIC - Lijian
  • Follow Jianlin's suggestion, update Uboot and Kernel, and then sync up with Juraj - Lijian

03/05/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Stanislav Chlebec
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Gorka
  • Fede
  • Honnappa Nagarahalli
• General
• VPP Hoststack
  • After assigned dedicated CPU processors for VPP main/VPP worker/iperf3 server, both ThunderX2 and Taishan Server VPP hoststack give better performance compared with Linux stack.
  • vlib_worker_loop and session_queue_node_fn are two major hot-spots. - No progress
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Working on fixing VPP Path errors from svm_fifo patch. All test failures are resolved.
    • Octeon-Tx Status(Sirshak): yet to try steps from gorka for usb ubuntu rootfs installation. - Switched to Malvika.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/ - Done
    • b. merging CSIT patch. - Closing done
    • c. creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • Add license header/copy right to scripts - Sirshak/Honnappa to confirm with Andy Waffa
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
    • Confirm if Jianlin's board has the exactly same plugable switches with Juraj's boards - Lijian
    • thunderx2: Status: Talk to edk about deployment strategy with 1-node.
• FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Juraj setup call with LF people. Status: Done.
  • ThunderX2
    • Cables: Sent. Juraj to open another tkt for wiring the ThunderX2.
• VPP
  • Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560 - No progress
    • Investigate with latest VPP code on x86 server - Lijian - Send emails to vpp-dev mailor if there's problem. Will not put much effort.
  • Vectorization
    • ethernet-input
    • buffer pools
  • 128B cache line size
    • Will try this on Taishan server - Slightly performance degradation with 128 bytes cache line
  • thunderx2 crashing - No update
  • Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
• Action Items - Next Week

02/26/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Stanislav Chlebec
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Gorka
  • Fede
  • Honnappa Nagarahalli
• General
• VPP Hoststack
  • After assigned dedicated CPU processors for VPP main/VPP worker/iperf3 server, both ThunderX2 and Taishan Server VPP hoststack give better performance compared with Linux stack.
  • el0_sys hot-spot on Taishan D05 only, no plan to fix it.
  • vlib_worker_loop and session_queue_node_fn are two major hot-spots. - No progress
  • memcpy optimization
    • memcpy patch verification on taishan by khem l3 forwarding usecase- Lijian Status(khem): No updates.
    • memcpy patch consumes more clocks in OcteonTX2 - updated by Nitin.
    • Stopped working on this patch.
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Working on fixing VPP Path errors from svm_fifo patch. Test failure on SCTP, not root-caused yet.
    • Octeon-Tx Status(Sirshak): yet to try steps from gorka for usb ubuntu rootfs installation. - Switched to Marvikar
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/ - Done
    • b. merging CSIT patch. - Closing done
    • c. creating a job. - Everything is ready except the docker image
  • Target: master trending job - firstly create trending graph from daily data; then create release report(require some manual work)
  • Add license header/copy right to scripts - Sirshak/Honnappa to confirm with Andy Waffa
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559 - No update
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
      • Doesn't work, seems to be caused improper cross-building-tools. https://wiki.fd.io/view/VPP/Build_System_Deep_Dive
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
    • Confirm if Jianlin's board has the exactly same plugable switches with Juraj's boards - Lijian
    • thunderx2: Status: Talk to edk about deployment strategy with 1-node.
• FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Juraj setup call with LF people. Status: Done.
  • ThunderX2
    • Cables: Sent. Juraj to open another tkt for wiring the ThunderX2.
• VPP
  • Buffer Pools per NUMA
  • Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560
    • Investigate with latest VPP code on x86 server - Lijian - Send emails to vpp-dev mailor if there's problem. Will not put much effort.
  • Vectorization
    • ethernet-input
    • buffer pools
  • 128B cache line size
    • Will try this on Taishan server - Slightly performance degradation with 128 bytes cache line
  • Qualcomm no change iperf3
  • thunderx2 crashing - No update
  • Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
• Action Items - Next Week

02/19/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Stanislav Chlebec
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Gorka
  • Fede
  • Honnappa Nagarahalli
• General
• VPP Hoststack
  • After assigned dedicated CPU processors for VPP main/VPP worker/iperf3 server, both ThunderX2 and Taishan Server VPP hoststack give better performance compared with Linux stack.
  • memcpy optimization
    • memcpy patch verification on taishan by khem l3 forwarding usecase- Lijian Status(khem): No updates.
    • memcpy patch consumes more clocks in OcteonTX2 - updated by Nitin.
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Working on fixing VPP Path errors from svm_fifo patch.
    • Octeon-Tx Status(Sirshak): yet to try steps from gorka for usb ubuntu rootfs installation.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
  • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/
    • b. merging CSIT patch.
    • c. creating a job.
  • Target: master trending job
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
    • Confirm if Jianlin's board has the exactly same plugable switches with Juraj's boards - Lijian
    • thunderx2: Status: Talk to edk about deployment strategy with 1-node.
• FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Juraj setup call with LF people. Status: Done.
  • ThunderX2
    • Cables: Sent. Juraj to open another tkt for wiring the ThunderX2.
• VPP
  • Buffer Pools per NUMA
  • Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560
  • 1GB page taking long time Status: fixed.
    • Investigate with latest VPP code on x86 server
  • Vectorization
    • ethernet-input
    • buffer pools
    • memcpy
  • 128B cache line size
    • Will try this on Taishan server - Lijian
  • Qualcomm no change iperf3
  • thunderx2 crashing - No update
  • Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
• Action Items - Next Week

02/11/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Stanislav Chlebec
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Gorka
  • Fede
  • Honnappa Nagarahalli
• General
• VPP Hoststack
  • memcpy optimization
    • memcpy patch verification on taishan by khem l3 forwarding usecase- Lijian Status(khem): No updates.
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
    • svm_fifo: Status(Sirshak): Working on fixing VPP Path errors from svm_fifo patch.
    • Octeon-Tx Status(Sirshak): yet to try steps from gorka for usb ubuntu rootfs installation.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
• CSIT
  • VPP Performance Test
  • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible.
  • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • a. Host Config
    • b. merging CSIT patch.
    • c. creating a job.
  • Target: master trending job
  • VPP Path
    • gcc-8 compilation: Jira(Sirshak): https://jira.fd.io/browse/VPP-1559
    • cross compilation in VPP PATH. Jira(Juraj): https://jira.fd.io/browse/CTP-3
      • Status: Juraj to bring this up in CSIT call. (start with just cross-compilation)
  • VPP Device
    • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
    • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
    • thunderx2: Status: Talk to edk about deployment strategy with 1-node.
• FD.io lab
  • ThunderX1
    • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
    • Juraj setup call with LF people. Status: Done.
  • ThunderX2
    • Cables: Sent. Juraj to open another tkt for wiring the ThunderX2.
• VPP
  • Buffer Pools per NUMA
  • Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560
  • 1GB page taking long time Status: fixed.
  • Vectorization
    • ethernet-input
    • buffer pools
    • memcpy
  • 128B cache line size
  • Qualcomm no change iperf3
  • thunderx2 crashing
  • Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
• Action Items - Next Week

02/05/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Stanislav Chlebec
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Gorka
  • Fede
  • Honnappa Nagarahalli
• General
• VPP Hoststack
  • memcpy optimization
    • Check optimized memory copy version are deployed on Taishan and ThunderX2 during runtime - Lijian
    • Send memcpy patch to Khem and Fede for further verification - Lijian Status: fede: small improvement in mcbin with iperf3, khem to try them with l3 forwarding
  • iperf3 performance with Hoststack.
    • ip4_local_inline quad loop under investigation
    • Working on svm_fifo alternate version with front and back pointers synchronized instead of cursize.
  • Verifying per NUMA node buffer pool https://gerrit.fd.io/r/#/c/16638/
    • sirshak create jira id in fd.io jira. https://jira.fd.io/browse/VPP-1560
    • Hanging of VPP is actually VPP taking a lot of time to allocate 400K chunks for 1GB - Damjan has this in his todo list
    • gcc-8 compilation still fails on ARM.
      • sirshak create a jira id in fd.io jira. Status: https://jira.fd.io/browse/VPP-1559
    • Octeon-Tx failure. Status: unknown
  • Gorka is trying some optimal configs for VCL. Status: no updates.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • OcteonTx boots to buildroot with no dhclient hence an impasse. Still not clear how to use USB stick.
• CSIT
  • VPP Path
    • Sirshak to keep track of gcc-8 compilation, once clean we can switch to gcc-8. https://jira.fd.io/browse/VPP-1559
    • ARM CI results are overwritten by x86 machines. Should be a Jenkin issue. Monitor if this corner will happen again. - Juraj
    • Add cross compilation CI Juraj: https://jira.fd.io/browse/CTP-3
  • VPP Device
    • thunderx: 1-node topology on cavium thunderx. Status: no updates.
    • Kernel Migration on mcbin. Status:
    • ThunderX2:
  • VPP Performance Test
    • Stan and Khem to come up with a summary of current status and an estimate of at least upstreaming basic L2/L3 performance suites.
    • Juraj to come up with a solution for NUMA node anamoly in Taishan.
    • https://gerrit.fd.io/r/#/c/16850/ Status: Juraj has a version all ready to work. Package installation blocker.
    • Package installation error Status: Juraj to investigate logs.
• FD.io lab
  • ThunderX1 -
    • New QSFP+ switch for ThunderX1 is available now: QSFP+ to be connected SFP+ switch.
    • Juraj to setup a call with LF folks on.
  • ThunderX2 -
    • Andy still waiting cables.
    • Juraj to remind Andy of when the cable will be available.
    • Juraj to follow up on ssh connectivity to thunderx2.
• VPP
  • Vectorization
    • [Lijian] Macro benchmarking on ThunderX2/Centriq(4%)/Taishan D05(10%) is done, data is updated into Jira. Code is in internal review.
    • [Lijian] Check if setting default cache line size to 128 will degradate thru-put on Taishan/Qualcomm/ThunderX2
      • no perf diff in Qualcomm
      • vpp crashes on thunderx2
      • waiting for results on A72 (Taishan)
    • [Sirshak] on ethernet-input node, investigate vectorized buffer index, Damjan's per numa node buffer pool patch. Status: No updates
      • open fd.io jira tkt. https://jira.fd.io/browse/VPP-1560
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
• Action Items - Next Week

01/29/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Lijian Zhang
  • Stanislav Chlebec
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Garcia
  • Manuel
  • Gorka
  • Fede
  • Honnappa Nagarahalli
  • John Ddigilio
• General
  • DPDK multi-core scheduler
  • https://gerrit.fd.io/r/#/c/15084/
  • Please join slack.
  • Merge TCP optimization meeting into VPP/Aarch64 community public meeting.
• VPP Hoststack
  • TaiShan Server with Debian distro crashed with command of 'ip probe-neighbor' when doing VPP hoststack with iperf3
  • With 64 bytes packets, on ThunderX2, 10G NIC, VPP hoststack bandwidth is about 1/2 of Linux Kernel stack.
  • With 64 bytes packets, on Taishan, 10G NIC, VPP hoststack bandwidth is about 2x of Linux Kernel stack.
  • Memory copy patch gives 4% improvement on VPP hoststack on Taishan server.
  • Check optimized memory copy version are deployed on Taishan and ThunderX2 during runtime - Lijian
  • Send memcopy patch to Khem and Fede for further verification - Lijian
  • iperf3 performance with Hoststack.
    • Investigating lock-less fifo, ip4_local_forward node and memory reordering for VPP hoststack - Sirshak
  • Sirshak is trying to set up one fd.io setup for everyone debugging VPP hoststack.
  • Verifying https://gerrit.fd.io/r/#/c/16638/ - Suppose to give better performance, but VPP hang with this patch on some Arm machines.
  • Gorka is trying some optimal configs for VCL. - No Updates.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • OcteonTX is received in ARM lab. Will boot it up firstly and then start doing profiling with it.
• FD.io lab
  • ThunderX1 -
    • New Arista switch for ThunderX1 is available now. Gathering details that required by LF lab before sending the switch to CSIT lab. - Juraj - Andy will try to send the switch to CSIT this Thursday.
  • ThunderX2 -
    • Cable type is confirmed. Procurement is in the process.
    • Juraj to remind Andy of when the cable will be available.
    • Require access to these servers in FD.io lab. Anton gives the IP to access them.(ADMIN/ADMIN)
• CSIT
  • VPP Path
    • So far so good.
    • ARM CI results are overwritten by x86 machines. Should be a Jenkin issue. Monitor if this corner will happen again. - Juraj
  • VPP Device
    • thunderx: 1-node topology on cavium thunderx. Basic skeleton of docker topology done. Moving on to deploying the scripts. Juraj is able to modify, execute the scripts in Container. Things to fix is scripts for 1-link 1-node topology and interfaces binding to VPP. Is able to run successfully a traffic test.
    • Kernel Migration on mcbin. Juraj is able to build all the images, but got kernel panic. Try with the more recent uBoot version. Tried latest uBoot image, but still has the same issue.
    • Juraj to investigate further work once ThunderX2 is available.
  • VPP Performance Test
    • perftest - https://jenkins.fd.io/job/vpp-csit-verify-perf-master-2n-skx - Triggered manually now if patch is perf sensitive.
    • Working ongoing on writing scripts for Performance Jobs.
    • Development of L2 test script is under-going now.
    • Khem will get L2 work in CI firstly, and then IP4, and other test cases.
    • Stan starts to work on performance scripts with Khem. Is able to connect Taishan machines in CSIT lab.
    • The performance topology in wiki link is to update per below file.
    • https://github.com/FDio/csit/blob/master/docs/lab/Testbeds_Xeon_Skx_Arm_Atom.md
    • Stan and Khem to come up with a summary of current status and an estimate of at least upstreaming basic L2/L3 performance suites.
      • Install Ubuntu-18.04 on Huawei Taishan servers firstly, and then investigate upstreaming performance test framework to enable Aarch64
      • Taishan server works with Ubuntu 18.04, CSIT lab updated Ubuntu 18.04 in Taishan
      • Install the packages on Taishan server from cloud repository, to check if VPP can get intel NICs on Taishan - Lijian
      • https://packagecloud.io/app/fdio/master/search?q=19.01-rc0%7E642-g31fe7aa3&filter=debs&filter=debs&dist=ubuntu%2Fbionic
    • Stan installed latest CSIT scripts on packet generator server(x86 NEON) and Tainshan servers in FD.io lab.
    • https://gerrit.fd.io/r/#/c/16850/
    • Some of L2 and L3 test cases passed.
• VPP
  • Vectorization
    • [Lijian] Macro benchmarking on ThunderX2/Centriq(4%)/Taishan D05(10%) is done, data is updated into Jira. Code is in internal review.
    • [Lijian] Check if setting default cache line size to 128 will degradate thru-put on Taishan/Qualcomm/ThunderX2
    • [Sirshak] on ethernet-input node, investigate vectorized buffer index.
  • Memory Ordering
    • [Sirshak] svm_fifo lockless alternate algorithm for SPSC. - In internal review.
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. - Bootstrap script common.sh working and checking the test cases.
  • [Juraj] IP4 reassembly and GBP failures are fixed. Patches to enable them two are merged. No any test cases in blacklist for Aarch64 machine.
  • [Juraj] Kernel Migration on mcbin. Juraj is able to build all the images.
• Action Items - Next Week
  • [Sirshak] -

01/22/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Lijian Zhang
  • Stanislav Chlebec
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Garcia
  • Manuel
  • Gorka
  • Fede
  • Honnappa Nagarahalli
  • John Ddigilio
• General
  • DPDK multi-core scheduler
  • https://gerrit.fd.io/r/#/c/15084/
  • Please join slack.
  • Merge TCP optimization meeting into VPP/Aarch64 community public meeting.
• VPP Hoststack
  • TaiShan Server with Debian distro crashed with command of 'ip probe-neighbor' when doing VPP hoststack with iperf3
  • With 64 bytes packets, on ThunderX2, 10G NIC, VPP hoststack bandwidth is about 1/4 of Linux Kernel stack.
  • iperf3 performance with Hoststack.
    • Investigating lock-less fifo, ip4_local_forward node and memory reordering for VPP hoststack - Sirshak
  • Sirshak is trying to set up one fd.io setup for everyone debugging VPP hoststack.
  • Gorka is trying some optimal configs for VCL. - No Updates.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • OcteonTX is received in ARM lab. Will boot it up firstly and then start doing profiling with it.
• FD.io lab
  • ThunderX1 -
    • New Arista switch for ThunderX1 is available now. Gathering details that required by LF lab before sending the switch to CSIT lab. - Juraj - Andy will try to send the switch to CSIT this Thursday.
  • ThunderX2 -
    • Cable type is confirmed. Procurement is in the process.
    • Require access to these servers in FD.io lab.
• CSIT
  • VPP Path
    • So far so good.
    • ARM CI results are overwritten by x86 machines. Should be a Jenkin issue. Monitor if this corner will happen again. - Juraj
  • VPP Device
    • thunderx: 1-node topology on cavium thunderx. Basic skeleton of docker topology done. Moving on to deploying the scripts. Juraj is able to modify, execute the scripts in Container. Things to fix is scripts for 1-link 1-node topology and interfaces binding to VPP.
    • Kernel Migration on mcbin. Juraj is able to build all the images, but got kernel panic. Try with the more recent uBoot version.
    • Juraj to investigate further work once ThunderX2 is available.
  • VPP Performance Test
    • Working ongoing on writing scripts for Performance Jobs.
    • Development of L2 test script is under-going now.
    • Khem will get L2 work in CI firstly, and then IP4, and other test cases.
    • Stan starts to work on performance scripts with Khem. Is able to connect Taishan machines in CSIT lab.
    • The performance topology in wiki link is to update per below file.
    • https://github.com/FDio/csit/blob/master/docs/lab/Testbeds_Xeon_Skx_Arm_Atom.md
    • Stan and Khem to come up with a summary of current status and an estimate of at least upstreaming basic L2/L3 performance suites.
      • Install Ubuntu-18.04 on Huawei Taishan servers firstly, and then investigate upstreaming performance test framework to enable Aarch64
      • Lijian to verify Ubuntu-18.04 on Taishan server.
    • Stan installed latest CSIT scripts on packet generator server(x86 NEON) and Tainshan servers in FD.io lab.
    • https://gerrit.fd.io/r/#/c/16850/
    • Some of L2 and L3 test cases passed.
• VPP
  • Vectorization
    • [Lijian] Macro benchmarking on ThunderX2/Centriq(4%)/Taishan D05(10%) is done, data is updated into Jira. Code is in internal review.
    • [Sirshak] on ethernet-input node, investigate vectorized buffer index.
  • Memory Ordering
    • [Sirshak] svm_fifo lockless alternate algorithm for SPSC. - In internal review.
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. - Bootstrap script common.sh working and checking the test cases.
  • [Juraj] IP4 reassembly and GBP failures are fixed. Patches to enable them two are merged. No any test cases in blacklist for Aarch64 machine.
  • [Juraj] Kernel Migration on mcbin. Juraj is able to build all the images.
• Action Items - Next Week
  • [Sirshak] - To update patch list in VPP/Aarch64 wiki

01/15/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Lijian Zhang
  • Stanislav Chlebec
  • Khemendra Kumar
  • Tina Tsou
  • Andy Wang
  • Garcia
  • Manuel
  • Gorka
  • Fede
  • Honnappa Nagarahalli
  • John Ddigilio
• General
  • DPDK multi-core scheduler
  • https://gerrit.fd.io/r/#/c/15084/
  • Please join slack.
  • Merge TCP optimization meeting into VPP/Aarch64 community public meeting.
• VPP Hoststack
  • iperf3 performance with Hoststack.
    • Investigating lock-less fifo and memory reordering for VPP hoststack - Sirshak
  • Sirshak is trying to set up one fd.io setup for everyone debugging VPP hoststack.
  • Gorka is trying some optimal configs for VCL. - No Updates.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • OcteonTX is received in ARM lab. Will boot it up firstly and then start doing profiling with it.
• FD.io lab
  • ThunderX2 -
    • New Arista switch is available now. Gathering details that required by LF lab before sending the switch to CSIT lab. - Juraj
    • Cable type is confirmed. Procurement is in the process.
• CSIT
  • VPP Path
    • IP4 reassembly and GBP failures are fixed. Patches to enable them two are merged. No any test cases in blacklist for Aarch64 machine.
    • We have voting verify on bionic. Upload nexus disabled but merge job working. - Juraj created LF ticket for nexus upload. Both master merge job and verifying job are working fine.
    • ARM CI results are overwritten by x86 machines. Should be a Jenkin issue. Monitor if this corner will happen again. - Juraj
  • VPP Device
    • thunderx: 1-node topology on cavium thunderx. Basic skeleton of docker topology done. Moving on to deploying the scripts.
    • Kernel Migration on mcbin. Juraj is able to build all the images.
  • VPP Performance Test
    • Working ongoing on writing scripts for Performance Jobs.
    • Development of L2 test script is under-going now.
    • Khem will get L2 work in CI firstly, and then IP4, and other test cases.
    • Stan starts to work on performance scripts with Khem. Is able to connect Taishan machines in CSIT lab.
    • The performance topology in wiki link is to update per below file.
    • https://github.com/FDio/csit/blob/master/docs/lab/Testbeds_Xeon_Skx_Arm_Atom.md
    • Stan and Khem to come up with a summary of current status and an estimate of at least upstreaming basic L2/L3 performance suites.
• VPP
  • Vectorization
    • [Lijian] Macro benchmarking on ThunderX2/Centriq(4%)/Taishan D05(10%) is done, data is updated into Jira. Code is in internal review.
  • Memory Ordering
    • [Sirshak] svm_fifo lockless alternate algorithm for SPSC. - In internal review.
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. - Bootstrap script common.sh working and checking the test cases.
  • [Juraj] IP4 reassembly and GBP failures are fixed. Patches to enable them two are merged. No any test cases in blacklist for Aarch64 machine.
  • [Juraj] Kernel Migration on mcbin. Juraj is able to build all the images.
• Action Items - Next Week
  • [Sirshak] - To update patch list in VPP/Aarch64 wiki

01/08/2019

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Lijian Zhang
  • Stanislav Chlebec
  • Khemendra Kumar
• General
  • DPDK multi-core scheduler
  • https://gerrit.fd.io/r/#/c/15084/
  • Please join slack.
• VPP Hoststack
  • iperf3 performance with Hoststack.
    • Investigating lock-less fifo and memory reordering for VPP hoststack - Sirshak
  • Sirshak is trying to set up one fd.io setup for everyone debugging VPP hoststack.
  • Gorka is trying some optimal configs for VCL. - No Updates.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. - Bootstrap script common.sh working and checking the test cases.
  • [Lijian] Working on IP4 reassembly and GBP failures. - fixed. Juraj has upstreamed patched to enable these two tests.
  • [Sirshak] Kernel Migration mcbin. Juraj is working on based on Jianlin's suggestion.
  • [Andy] Getting a new Arista switch next year.
• VPP
  • Vectorization
    • [Lijian] working on vectorized memory copy - Macro benchmarking is done and data is updated to Jira.
  • Memory Ordering
    • [Sirshak] svm_fifo lockless alternate algorithm for SPSC. - In internal review.
• CSIT
  • VPP Path
• VPP Path Failures
  • • We have voting verify on bionic. Upload nexus disabled but merge job working. - Juraj created LF ticket for nexus upload. Both merge job and verifying job are working fine.
  • VPP Device
    • thunderx: 1-node topology on cavium thunderx. Basic skeleton of docker topology done. Moving on to deploying the scripts.
    • thunderx2: Juraj working with LF to get this resolved.
    • mcbin: Juraj can contact Jianlin if needed.
  • VPP Performance Test
    • Working ongoing on writing scripts for Performance Jobs.
    • Development of L2 test script is under-going now.
    • Khem will get L2 work in CI firstly, and then IP4, and other test cases.
    • Stan is starting working on VPP performance test. Khem to send email to Stan on VPP performance testing stuff.
• FD.io lab
  • New Arista switch to be proccured next year.
  • ThunderX2 - Racked. Andy is trying to buy cables compatible to Intel XL710. Juraj to confirm info required by lab people before sending out the cables.
• Action Items - Next Week

12/18/2018

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Tina Tsou
  • Stanislav Chlebec
  • Avinash
  • Khemendra
• General
  • DPDK multi-core scheduler
  • https://gerrit.fd.io/r/#/c/15084/
  • Cancelling calls on 25th of Dec and 1st of jan. Next meeting 8th Jan.
  • Please join slack.
• VPP Hoststack
  • iperf3 performance with Hoststack.
    • Investigating lock-less fifo and memory reordering for VPP hoststack - Sirshak
  • Sirshak is trying to set up one fd.io setup for everyone debugging VPP hoststack.
  • Gorka is trying some optimal configs for VCL. - No Updates.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. - Bootstrap script common.sh working.
  • [Lijian] Working on IP4 reassembly and GBP failures. - Some preliminary on gbp waiting Neale. Juraj to give access to Lijian to investigate on ThunderX.
  • [Sirshak] Kernel Migration mcbin. Status: Jianlin to work with Juraj to get fd.io mcbins up and running. Sirshak to setup a meeting.
  • [Andy] Getting a new Arista switch next year.
• VPP
  • Vectorization
    • [Lijian] working on vectorized memory copy - Still benchmarking and setting it up for internal review.
    • [Lijian] Patch for compiling issue with GCC-8.x is under community review. Status: No updtaes.
    • [Lijian] Patch for fixing StringTest failure is under community review. Status: Abandoned.
    • [Lijian] Patch for CDP failure is under community review. Status: No updates.
  • Memory Ordering
    • [Sirshak] svm_fifo lockless alternate algorithm for SPSC.
• CSIT
  • VPP Path
• VPP Path Failures
  • https://jira.fd.io/browse/VPP-1475 - IP4 random reassembly failure in master, also seen on x86
  • https://jira.fd.io/browse/VPP-1491 - GBP L3/L2 Endpoint Learning failure
    • We have voting verify on bionic. Upload nexus disabled but merge job working. Juraj to create LF ticket for nexus upload.
  • VPP Device
    • thunderx: 1-node topology on cavium thunderx. Basic skeleton of docker topology done. Moving on to deploying the scripts.
    • thunderx2: Sirshak working with LF to get this resolved.
    • mcbin: Sirshak to setup a meeting between Juraj and Jianlin.
  • VPP Performance Test
    • Working ongoing on writing scripts for Performance Jobs.
    • Development of L2 test script is under-going now.
    • Khem will get L2 work in CI firstly, and then IP4, and other test cases.
• FD.io lab
  • New Arista switch to be proccured next year.
  • ThunderX2 - Racked. IPMI Static IP configuration missing. Sirshak with LF.
• Action Items - Next Week

12/11/2018

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Tina Tsou
  • Stanislav Chlebec
• VPP Hoststack
  • iperf3 performance with Hoststack. - Sirshak has done some preliminary bench-marking, and compare kernel and VPP hoststack performance. Three case: kernel to kernel; kernel to VPP hoststack; VPP hoststack to VPP hoststack
  • ongoing perf analysis. One patch(https://gerrit.fd.io/r/#/c/16184/) is merged, and the other one is under internal review.
  • Investigating lock-less fifo and memory reordering for VPP hoststack - Sirshak
  • Sirshak is trying to set up one CSIT setup for everyone debugging VPP hoststack. Will share setup info
  • Gorka is trying some optimal configs for VCL.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. Two scripts of L2 performance suites for CI management repository are done, investigating on for CSIT repository, and three more scripts to be developed.
  • [Lijian] Working on IP4 reassembly and GBP failures
  • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan. - no progress so far. - To confirm with Jianling and Joyce.
• VPP
  • Vectorization
    • [Lijian] working on vectorized memory copy - Second priority, no update so far.
    • [Lijian] Patch for compiling issue with GCC-8.x is under community review.
    • [Lijian] Patch for fixing StringTest failure is under community review.
    • [Lijian] Patch for CDP failure is under community review.
  • Memory Ordering
    • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
• VPP Path failures
  • https://jira.fd.io/browse/VPP-1475 - IP4 random reassembly failure in master, also seen on x86
  • https://jira.fd.io/browse/VPP-1491 - GBP L3/L2 Endpoint Learning failure
• CSIT
  • VPP Path
    • Actually, everything is ready. The only thing is to get CI patch merged.
  • VPP Device
    • thunderx: 1-node topology on cavium thunderx is in place, but there are errors. Will continue investigation.
    • thunderx2: Racked. Lack of static IP. Sirshak gave a work-around to fix lacking of static IP to Anton.
    • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan. To confirm with Jianling and Joyce - Lijian
  • VPP Performance Test
    • Working ongoing on writing scripts for Performance Jobs.
    • Development of L2 test script is under-going now. Khem will get L2 work in CI firstly, and then IP4, and other test cases.
• FD.io lab
  • Arista switch is still not working. Andy and Anton are working on the exact requirement for the switch, and two possible option: Andy to replace the Arista or buy a new one.
  • ThunderX2 - Racked. Lack of IP.
• Action Items - Next Week
  • [Lijian] to continue to investigate make test failures.
  • [Andy] to work with Anton to resolve Arista problem.

12/04/2018

• Attendees
  • Sirshak Das
  • Andy Wang
  • Juraj Linkeš
  • Khemendra
  • Garcia
  • Manuel
  • Gorka
  • Fede
  • Tina Tsou
• VPP Hoststack
  • iperf3 performance with Hoststack. - Sirshak has done some preliminary bench-marking, and compare kernel and VPP hoststack performance. Three case: kernel to kernel; kernel to VPP hoststack; VPP hoststack to VPP hoststack
  • ongoing perf analysis. Two patches ongoing. One is upstreamed and the other is under internal review. Hotpots on memory copy or maybe other stuff.
  • Sirshak is trying to set up one CSIT setup for everyone debugging VPP hoststack. Will share setup info
  • Gorka is trying some optimal configs for VCL.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. Two scripts of L2 performance suites for CI management repository are done, investigating on for CSIT repository, and three more scripts to be developed.
  • [Lijian] VPP dlmalloc crash issue root-caused and fixed by maintainer. Florin Coras fixed time-out issues.
  • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan. - no progress so far. - To confirm with Jianling and Joyce.
• VPP
  • Vectorization
    • [Lijian] working on vectorized memory copy - Second priority, no update so far.
    • [Lijian] Patch for compiling issue with GCC-8.x is under internal review.
    • [Lijian] Patch for fixing StringTest failure is under internal review.
  • Memory Ordering
    • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
• CSIT
  • VPP Path
    • https://jira.fd.io/browse/VPP-1475 - IP4 random reassembly failure in master, also seen on x86
    • https://jira.fd.io/browse/VPP-1476 - L2FIB failures in master, also seen on x86 - fixed
    • https://jira.fd.io/browse/VPP-1491 - GBP L3/L2 Endpoint Learning failure
    • https://jira.fd.io/browse/VPP-1490 - Traffic doesn't work in make test, 1604 issue(pmalloc issue) - to confirmed its current status
    • https://jira.fd.io/browse/VPP-1497 - Cannot run in parallel problem - fixed
    • VPP-1476, VPP-1475, VPP-1478. These failures are seen on Debian x86 VM also.
    • Get CSIT/Aarch64 pass with partial test cases - Juraj - https://gerrit.fd.io/r/#/c/16282/
    • VPP dlmalloc crash issue root-caused and fixed by maintainer.
    • Florin Coras fixed time-out issue.
  • VPP Device
    • thunderx: 1-node topology on cavium thunderx is in place, but there are errors. Will continue investigation.
    • thunderx2: Racked. Lack of IP. To confirm with Anton.
    • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan. To confirm with Jianling and Joyce - Lijian
  • VPP Performance Test
    • Working ongoing on writing scripts for Performance Jobs.
    • Development of L2 test script is under-going now. Khem will get L2 work in CI firstly, and then IP4, and other test cases.
• FD.io lab
  • Arista switch is still not working. Andy and Anton are working on the exact requirement for the switch, and two possible option: Andy to replace the Arista or buy a new one.
  • ThunderX2 - Racked. Lack of IP.
• Action Items - Next Week
  • [Lijian] to continue to investigate make test failures.
  • [Andy] to work with Anton to resolve Arista problem.

11/27/2018

• Attendees
  • Juraj Linkeš
  • Khemendra
  • Garcia
  • Manuel
  • Gorka
  • Fede
  • Tina Tsou
• VPP Hoststack
  • iperf3 performance with Hoststack. - Sirshak has done some preliminary bench-marking, and compare kernel and VPP hoststack performance.
  • ongoing perf analysis, two patches ongoing. Hotpots on memory copy or maybe other stuff. Will share patches with community.- Sirshak
  • Sirshak is trying to set up one CSIT setup for everyone debugging VPP hoststack. Will share setup info
  • Gorka is trying some optimal configs for VCL.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • Alternate test cases.
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. Status: Working with Juraj to get scripts ready for jobs. - Need to prepare some scripts. First to understand how the script works and then add more options.
  • [Lijian] Status on VPP path failures. Status: Still debugging. Still at early study stage.
  • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan. - no progress so far.
• VPP
  • Vectorization
    • [Lijian] working on vectorized memory copy
  • Memory Ordering
    • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
• CSIT
  • VPP Path
    • 3 failures currently stalling deployment.
    • VPP-1476, VPP-1475, VPP-1478
    • These failures are seen on Debian x86 VM also.
    • Parallelization(n=32) is resulting in failures. Seems also be caused by below two patches.
    • VPP-1490, caused by https://gerrit.fd.io/r/#/c/15106/ and https://gerrit.fd.io/r/#/c/15534/.
    • VPP-1491, VPP-1497 about parallazation and GBP failure are filed.
    • Get CSIT/Aarch64 pass with partial test cases - Juraj
  • VPP Device
    • thunderx: Juraj created a LF tkt for wiring the 1-node topology on cavium thunderx.
    • thunderx2: to be racked by this Friday.
    • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan.
  • VPP Performance Test
    • Working ongoing on writing scripts for Performance Jobs.
    • L2 test is working now manually. Khem is trying to get it work in CI, and then IP4, and other test cases.
• FD.io lab
  • Arista switch is missing cable. Andy will send tracking no. for cables.
  • ThunderX2 - to be racked by this Friday.
• Action Items - Next Week
  • [Lijian] to investigate VPP-1490 issue.
  • [Andy] Andy will send tracking no. for cables.

11/20/2018

• Attendees
  • Sirshak Das
  • Andy Wang
  • Juraj Linkeš
  • Khemendra
  • Garcia
  • Manuel
  • Gorka
  • Fede
  • Tina Tsou
• VPP Hoststack
  • iperf3 performance with Hoststack. - Sirshak has done some preliminary bench-marking, and compare kernel and VPP hoststack performance.
  • ongoing perf analysis, two patches ongoing. Hotpots on memory copy or maybe other stuff. Will share patches with community.- Sirshak
  • Sirshak is trying to set up one CSIT setup for everyone debugging VPP hoststack. Will share setup info
  • Gorka is trying some optimal configs for VCL.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • Alternate test cases.
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. Status: Working with Juraj to get scripts ready for jobs. - Need to prepare some scripts. First to understand how the script works and then add more options.
  • [Lijian] Status on VPP path failures. Status: Still debugging. Still at early study stage.
  • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan. - no progress so far.
• VPP
  • Vectorization
    • [Lijian] working on vectorized memory copy
  • Memory Ordering
    • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
• CSIT
  • VPP Path
    • 3 failures currently stalling deployment.
    • VPP-1476, VPP-1475, VPP-1478
    • These failures are seen on Debian x86 VM also.
    • Parallelization(n=32) is resulting in failures. Seems also be caused by below two patches.
    • VPP-1490, caused by https://gerrit.fd.io/r/#/c/15106/ and https://gerrit.fd.io/r/#/c/15534/.
    • VPP-1491, VPP-1497 about parallazation and GBP failure are filed.
    • Get CSIT/Aarch64 pass with partial test cases - Juraj
  • VPP Device
    • thunderx: Juraj created a LF tkt for wiring the 1-node topology on cavium thunderx.
    • thunderx2: to be racked by this Friday.
    • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan.
  • VPP Performance Test
    • Working ongoing on writing scripts for Performance Jobs.
    • L2 test is working now manually. Khem is trying to get it work in CI, and then IP4, and other test cases.
• FD.io lab
  • Arista switch is missing cable. Andy will send tracking no. for cables.
  • ThunderX2 - to be racked by this Friday.
• Action Items - Next Week
  • [Lijian] to investigate VPP-1490 issue.
  • [Andy] Andy will send tracking no. for cables.

11/12/2018

• Attendees
  • Sirshak Das
  • Andy Wang
  • Juraj Linkeš
  • Khemendra
  • Garcia
  • Gorka
• VPP Hoststack
  • iperf3 performance with Hoststack. - Sirshak has done some preliminary bench-marking, and compare kernel and VPP hoststack performance.
  • ongoing perf analysis, two patches ongoing. Hotpots on memory copy or maybe other stuff. - Sirshak
  • Sirshak is trying to set up one CSIT setup for everyone debugging VPP hoststack. Will share setup info
  • Gorka is trying some optimal configs for VCL.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • Alternate test cases.
  • khem to get more information on benchmarking DMM. Khem to send the information to community if there's more.
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. Status: Working with Juraj to get scripts ready for jobs. - Need to prepare some scripts. First to understand how the script works and then add more options.
  • [Lijian] Status on VPP path failures. Status: Still debugging. Still at early study stage.
  • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan. - no progress so far.
  • [Andy] has sent out on Nov 12th. Juraj has sent the info to LF.
• VPP
  • Vectorization
    • [Lijian] Zero byte mask NEON implementation. - Merged.
    • [Lijian] ip4 lookup buffer index to buffer pointer optimizations. - Both micro and macro prove it not worth implementing vectorization here.
    • [Lijian] working on vectorized memory copy - Khem to send the vectorized memory copy done previously.
  • Memory Ordering
    • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
• CSIT
  • VPP Path
    • 3 failures currently stalling deployment.
    • VPP-1476, VPP-1475, VPP-1478
    • These failures are seen on Debian x86 VM also.
    • Parallelization(n=32) is resulting in failures. Seems also be caused by below two patches.
    • VPP-1490, caused by https://gerrit.fd.io/r/#/c/15106/ and https://gerrit.fd.io/r/#/c/15534/.
  • VPP Device
    • thunderx: Juraj created a LF tkt for wiring the 1-node topology on cavium thunderx.
    • thunderx2: no updates. Anton is figuring out where/how to put these servers.
    • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan.
  • VPP Performance Test
    • Working ongoing on writing scripts for Performance Jobs.
    • L2 test is working now manually. Khem is trying to get it work in CI, and then IP4, and other test cases.
• FD.io lab
  • Arista switch and power supply. Setup was sent out and tracking no. info was sent to LF.
  • ThunderX2 - No updates.
• Action Items - Next Week
  • [Lijian] to investigate VPP-1490 issue.

11/06/2018

• Attendees
  • Sirshak Das
  • Honnappa
  • Tina Tsou
  • Andy Wang
  • Khemendra
  • Garcia
  • Manuel
  • Fede
• VPP Hoststack
  • iperf3 perfomance with Hoststack.
  • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • Alternate test cases.
  • khem to get more information on benchmarking DMM.
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite. Status: Working with Juraj to get scripts ready for jobs.
  • [Lijian] Status on VPP path failures. Status: Still debugging.
  • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan.
  • [Andy] to send tracking no for Arista power supply. Status: PO is still being worked on internally.
• VPP
  • Vectorization
    • [Lijian] msb patch. - merged
    • [Lijian] Zero byte mask NEON implementation. - internal review completed to up-streamed soon.
    • [Lijian] ip4 lookup buffer index to buffer pointer optimizations. - internal investigations ongoing.
  • Memory Ordering
    • [Sirshak] atomic exchange acquire and release macro patch.- Merged.
    • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
• CSIT
  • VPP Path
    • 3 failures currently stalling deployment.
    • VPP-1476, VPP-1475, VPP-1478
    • These failures are seen on Debian x86 VM also.
    • Parallelization(n=32) is resulting in failures.
  • VPP Device
    • thunderx: Juraj created a LF tkt for wiring the 1-node topology on cavium thunderx.
    • thunderx2: no updates.
    • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan.
  • VPP Performance Test
    • Working ongoing on writing scripts for Performance Jobs.
• FD.io lab
  • Arista switch power supply and rack rails. Status: being worked internally
  • ThunderX2 - No updates.
• Action Items - Next Week

10/30/2018

• Attendees
  • Sirshak Das
  • Honnappa
  • Lijian Zhang
  • Tina Tsou
  • Andy Wang
  • Khemendra
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] To start with deployment of only L2 CSIT performance suite. - Discussed in CSIT meeting.
  • [Khem] to send the ip4 failure logs csit-dev, vpp-dev. - Sent csit-dev and vpp-dev.
  • [Juraj] Anton to install NICs. Juraj has sent the instructions. - Sent
• VPP
  • Vectorization
    • [Lijian] Internal review going on msb patch.
    • [Lijian] Zero byte mask neon function not consistent with x86. Working optimizing it.
    • [Lijian] ip4 lookup buffer index to buffer pointer optimization. - Still investigating.
  • Memory Ordering:
    • [Sirshak] Internal review going on atomic exchange acquire and release macro patch.
• CSIT
  • VPP Path
    • 2 failures currently stalling deployment.
    • https://jira.fd.io/browse/VPP-1476
    • https://jira.fd.io/browse/VPP-1475
    • VPP-1478 - L2FIB failures in Taishan.
    • 18.04 does not solve the problem
    • ThunderX2 - 4-5 failiures L2BD cases.
    • ThunderX1 - l2fib and juraj
    • [Lijian] to take a look.
  • VPP Device
    • Waiting for NICs to be installed on ThunderX2.
    • mcbin : Linux Kernel not able to use the data ports. Needed for scapy. [Sirshak] to take a look
    • mcbin: New Kernel is not working.
  • Performance Test
    • Discussed in CSIT meeting
    • Researching on how to create jobs
    • More things to be discussed with CSIT meeting.
• FD.io lab
  • Arista switch need additional hardware. - Andy to send tracking no.
  • ThunderX2 - Waiting on LF for NICs installing and rack installing in general.
• Action Items - Next Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] Deployment of only L2 CSIT performance suite.
  • [Lijian] Status on VPP path failures.
  • [Sirshak] Kernel Migration mcbin.
  • [Andy] to send tracking no for Arista power supply.

10/23/2018

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Lijian Zhang
  • Tina Tsou
  • Andy Wang
  • Khemendra
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] VPP performance suite. L2XC, L2BD working. IPv4 failing.
  • [Juraj and Sirshak] We need to check RC2 after 17th of october. [khem] To send the test failure logs to vpp-dev.
• VPP
  • Vectorization
    • [Lijian] Looking at shuffle and msb patches.
    • [Lijian] Sent the shuffle analysis to Nitin for feedback.
    • [Lijian] Preliminary analysis says we take more instructions hence the slow down. To reevaluate the algorithm itself.
  • Memory Ordering:
    • [Sirshak] Part 1 of the patch merged which now introduces macros. Working on part 2.
• CSIT
  • VPP Path
    • To be deployed as a part of CI after 1810 release.
  • VPP Device
    • Waiting for NICs to be installed on ThunderX2.
    • mcbins working. Juraj to start work on getting one instance of the VPP device test running.
    • Docker working musdk working. Currently facing issues with the 1-node topology.
  • Performance Test
    • L2XC, L2BD working. IPv4 failing. [Khem] to send the failure logs csit-dev, vpp-dev.
    • [Khem] To start with deployment of only L2 performance suite.
• FD.io lab
  • Arista switch need additional hardware. To be shipped in 2 weeks.
  • NICs and wires for ThunderX2 - Received. Anton to install NICs. Juraj has sent the instructions.
  • Power Cycler to be ordered by LF - Its available and working.
• Documentation
  • Lijian's patch merged.
• Action Items - Next Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] To start with deployment of only L2 performance suite.
  • [Khem] to send the failure logs csit-dev, vpp-dev.
  • [Juraj] Anton to install NICs. Juraj has sent the instructions.

10/16/2018

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Lijian Zhang
  • Tina Tsou
  • Andy Wang
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] to try VPP performance suite to see change after Vectorization and Loop unrolling patch.
  • Remaining issues in L2 and IPv4 - Sirshak to try debug. Status: With inputs from Neale issue fixed.
• VPP
  • Vectorization
    • [Lijian] Studying about Vectorization and Memory ordering.
  • Memory Ordering:
    • [Sirshak] One patch up-streamed. Relaxed memory ordering patch being reviewed internally.
• CSIT
  • VPP Path
    • Should be deployed on 25th Oct after 1810 release.
    • We need to check RC2 after 17th of october [Juraj and Sirshak].
  • VPP Device
    • Waiting for ThunderX2 NICs. Mcbin has issues with 2 VPP instances and traffic being sent.
  • Performance Test
    • No updates
• FD.io lab
  • QSFP+ switch for Cavium blades. - Recieved
  • NICs and wires for ThunderX2 - Andy to confirm that the NICs have been sent. Juraj LF tkt to be opened.
  • Power Cycler to be ordered by LF - Its available and should be operational this week.
• Documentation
  • Scott has reviewed the changes from Lijian he will merge it this week after few modifications of his own.
• Action Items - Next Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] to try VPP performance suite to see change after Vectorization and Loop unrolling patch.
  • [Juraj and Sirshak] We need to check RC2 after 17th of october.

10/09/2018

• Attendees
  • Sirshak Das
  • Maciek Konstantinowicz
  • Juraj Linkeš
  • Lijian Zhang
  • Tina Tsou
  • Andy Wang
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Juraj] to try musdk enabled kernel. - Juraj retried it worked.
  • [Khem] to try VPP performance suite - Diff in nos based on previous patches.
• VPP
  • Vectorization
    • Do perf analysis of the compiled code i.e. compare code with buffer indices to buffer pointers code with and without in quad loop.
    • Lijian to rebase the patch and try a few experiments
    • Khem Updates: No updates.
    • Memory Ordering Patch reintroduced. Broken down into smaller patches and the first patch has been upstreamed, others will be phased in gradually.
• CSIT
  • VPP Path
    • Set up publicly accessible Cavium machine for debugging purposes
    • 2 tkts resolved by Neale.
    • Remaining issues in L2 and IPv4 - Sirshak to try debug; Neale will look into it in spare cycles
  • VPP Device
    • SRIOV reservation system code exists and is being tested
  • Performance Test
    • NDR issue Status:
    • Issues in ip4. Status:
• FD.io lab
  • QSFP+ switch for Cavium blades. - Has been shipped
  • NICs and wires for ThunderX2 - Wires have been shipped; NICs will be delayed
  • Power Cycler to be ordered by LF.
• Documentation
  • Started upstreaming, no response yet
• Action Items - Next Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] to try VPP performance suite to see change after Vectorization and Loop unrolling patch.
  • Remaining issues in L2 and IPv4 - Sirshak to try debug. Status: With inputs from Neale issue fixed.

10/02/2018

• Attendees
  • Sirshak Das
  • Honnappa
  • Juraj Linkeš
  • Lijian Zhang
  • Khemendra
  • Tina Tsou
  • Andy Wang
  • Honnappa
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] VPP-1391 - VPP 'make verify' failed on Huawei Taishan server: Similar failures to cavium setup.
  • [Sirshak] - mlnx patch merged.
  • [Sirshak] to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning. - Not needed.
  • [Juraj] to try musdk enabled kernel. - failing Sirshak to debug this.
  • [Lijian] to resolve upstream comments. - Patch merged up-streamed.
  • [Khem] to try VPP performance suite with Lijian's Patch. - No need can try with master now.
  • [Khem] To try to debug traffic flow form TG to DUT with current master. - No updates.
  • [Khem] To send current status. - Sent.
• VPP
  • Vectorization
    • Understand Performance degradation.
      • msb correct version.
      • ip4_forward buffer index to buffer pointers.
  • Tuning dual/quad loop
    • Patch merged.
    • Khem Updates: No updates.
• CSIT
  • VPP Path
    • 2 categories of failures primarily. 8 tkts opened.
  • VPP Device
    • shim layer to be leaner and most of the functionality will reside in jenkins-slave.
  • Performance Test
    • L2-basic(L2XC, L2BD) PDR, MDR passing. NDR has issues but debugged.
    • Issues in ip4.
• FD.io lab
  • mcbin - Sirshak to help debug connectivity issues
  • QSFP+ switch for Cavium blades. - Andy working getting a refurbished one.
  • Power Cycler to be ordered by LF.
• Documentation
• Action Items - Next Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Juraj] to try musdk enabled kernel. - Juraj retried it worked.
  • [Khem] to try VPP performance suite - Diff in nos based on previous patches.

9/25/2018

• Attendees
  • Sirshak Das
  • Honnappa
  • Juraj Linkeš
  • Lijian Zhang
  • Khemendra
  • Tina Tsou
  • Andy Wang
  • Honnappa
• Action Items - Last Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. Khem to to measure verify and test timings.
  • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works. - Does not. Lijian suggested fix merged by damjan, Additional patch needed: under internal review.
  • [VPP performance Suite] shm issues seen sporadically. Not seeing currently.
  • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning. - Not done will do it this week.
  • Sirshak to send musdk instructions. - Done.
  • Juraj to try musdk enabled kernel and see if musdk and docker can coexist in the dirty kernel. - Trying them out.
• VPP
  • Mellanox NIC not working with VPP
    • [Sirshak] glue library not detected by VPP. Compiling static has cmake issues. - Fix done pending internal review.
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. Khem to try things suggested by Juraj.
  • Vectorization
    • Understand Performance degradation.
      • msb correct version.
      • ip4_forward buffer index to buffer pointers.
  • Tuning dual/quad loop
    • Patch upstreamed pending review.
    • Lijian to resolve upstream comments.
    • Khem to try VPP performance suite with Lijian's Patch. (affects 1 route configuration more than 10k routes.)
• CSIT
  • VPP Path
    • Current Test Cases Failure: 8
    • [Juraj] Mail sent regarding failures. Need community support regarding failures.
    • [Khem] To see if he can take up one test case failure and resolve it.
  • VPP Device
    • In case of 2 loopbacks we can use 2 physical devices.
    • Facing issues with console connection to mcbin.
  • Performance Test
    • [Khem] working on IPv4 testing failures with CSIT script. Will be starting on v4 suite. To debug at DPDK level and talk to VPP community.
    • [Khem] To try to debug traffic flow form TG to DUT with current master.
    • [Khem] To send current status.
• FD.io lab
  • mcbin - trying new kernel images to resolve connectivity issues.
  • QSFP+ switch for Cavium blades. - Waiting for reply from Anton.
• Documentation
  • Trevor to help with contiv documentation. - Trevor has made changes, Lijian has sent for comments.
• Action Items - Next Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server.
  • Sirshak - mlnx patch merged.
  • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning. - Not needed.
  • Juraj to try musdk enabled kernel. - failing Sirshak to debug this.
  • Lijian to resolve upstream comments. - Patch merged up-streamed.
  • Khem to try VPP performance suite with Lijian's Patch.
  • [Khem] To try to debug traffic flow form TG to DUT with current master.
  • [Khem] To send current status.

9/18/2018

• Attendees
  • Sirshak Das
  • Honnappa
  • Juraj Linkeš
  • Lijian Zhang
  • Tina Tsou
• Action Items - Last Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server, and requires steps on reproducing the issue from Juraj.
  • Lijian to update dual/quad loop code review per comments. - Resolved.
  • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works. - It doesnt. Send him a reminder.
  • Juraj to investigate the compiler versions on fd.io lab machines. Upgrade to latest GCC-7.3.
  • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.
  • Honnappa to confirm the if we order NIC for ThunderX1, specify if they are external NICs.
  • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning.
  • Sirshak to send musdk instructions.
• VPP
  • Mellanox NIC not working with VPP
    • [Sirshak] glue library not detected by VPP. Compiling static has cmake issues.
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - make build-release and make test work. Khem to see if make verify is still failing.
  • Vectorization
    • [Sirshak] Patches submitted. Patch widening the usage has performance issues.
  • Tuning dual/quad loop
    • [Lijian] 3%- throughput improvement (mcbin).
    • Include mcbin nos in commit message.
  • [Khem] working on IPv4 testing failures with CSIT script
• CSIT
  • CSIT-1139 - parallelize 'make verify'
    • make verify - working. Test Failure still there
    • Juraj investigating FAILED test cases in make verify.
  • CSIT VPP Device updates
    • juraj to try musdk enabled kernel and see if musdk and docker can coexist in the dirty kernel.
  • CSIT Performance Test Suite Updates
• FD.io lab
  • mcbin issue
  • QSFP+ ports for Cavium blades.
• Documentation
  • Trevor to help with contiv documentation.
• Action Items - Next Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server, and requires steps on reproducing the issue from Juraj.
  • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works. -
  • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.
  • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning.
  • Sirshak to send musdk instructions.
  • Juraj to try musdk enabled kernel and see if musdk and docker can coexist in the dirty kernel.

9/11/2018

• Attendees
  • Honnappa Nagarahalli
  • Juraj Linkeš
  • Sirshak Das
  • Lijian Zhang
  • Tina Tsou
  • Khemendra Kumar
• Action Items - Last Week
  • Khem and Sachin to verify Sirshak's vectorization patches. - Ongoing(Khem)
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test. - Continue investigation on this issue.
    • [Juraj] sends his steps to Khem to reproduce this issue.
  • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.- Code review internally
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Juraj to investigate the compiler versions on fd.io lab machines. - No update
  • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev. - Not reproducible so far, will keep observing.
• VPP
  • Mellanox NIC not working with VPP caused by libmnl.so missing in cmake
    • [Sirshak]
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - make build-release and make test work. Khem to see if make verify is still failing.
  • Vectorization
    • [Sirshak] Patches ready and sent for review. Need arm community feedback on performance implications.
    • [Khem/Nitin] verify how those patches effect
  • Tuning dual/quad loop
    • [Lijian] Dual/Quad loop code change is under internal review. Sirshak gives some comments, and Lijian will update diff accordingly.
  • [Khem] working on IPv4 testing failures with CSIT script
• CSIT
  • CSIT-1139 - parallelize 'make verify'
    • Parallazation is stable and working fine. We might see feature improvement requirement or new bugs.
    • No new requirement so far.
  • CSIT VPP Device updates
    • Two tickets on VPP FD.io done. Have to verify to make sure they are working.
    • x86 has improvement and some experiments are done. Juraj will try those experiments on ARM platforms.
  • CSIT Performance Test Suite Updates
    • Facing issues with ip4 forwarding test case.
    • shm issues seen sporadically. Khem to send an email to vpp-dev.
• FD.io lab
  • 3 LF tkts - 1 Node Topology wiring mcbin, 3-node topology wiring Mcbin, 1-node Topology wiring Cavium. - Finished
• Documentation
  • Sirshak to take a look.
• Action Items - Next Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server, and requires steps on reproducing the issue from Juraj.
  • Lijian to update dual/quad loop code review per comments
  • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works
  • Juraj to investigate the compiler versions on fd.io lab machines. Upgrade to latest GCC-8.2.0
  • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.
  • Honnappa to confirm the if we order NIC for ThunderX1, specify if they are external NICs

9/4/2018

• Attendees
  • Sirshak Das
  • Lijian Zhang
  • Tina Tsou
  • Khemendra Kumar
• Action Items - Last Week
  • Lijian to try merging it upstream - Mellanox Changes. - Resolved.
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin. - No updates.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test.
  • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.- Discuss Internally.
  • Juraj to investigate the compiler versions on fd.io lab machines. - No updates.
• VPP
  • VPP-1339 - Mellanox NIC not working with VPP. - Resolved
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - make build-release and make test work. Khem to see if make verify is still failing.
  • Vectorization
    • [Sirshak] Patches ready and sent for review. Need arm community feedback on performance implications.
  • Tuning dual/quad loop
    • [Lijian/Brian] Investigate dynamic function selection. Brian to looking at this.
• CSIT
  • CSIT-1139 - parallelize 'make verify'
    • No updates
  • CSIT VPP Device updates
    • No updates
  • CSIT Performance Test Suite Updates
    • Facing issues with ip4 forwarding test case.
    • shm issues seen sporadically. Khem to send an email to vpp-dev.
• FD.io lab
  • 3 LF tkts - 1 Node Topology wiring mcbin, 3-node topology wiring Mcbin, 1-node Topology wiring Cavium.
• Documentation
  • Sirshak to take a look.
• Action Items - Next Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server.
  • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.
  • Juraj to investigate the compiler versions on fd.io lab machines.
  • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.

8/28/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Juraj Linkes
  • Lijian Zhang
  • Tina Tsou
  • Khemendra Kumar
  • Honnappa Nagarahalli
  • Brian Brooks
• Action Items - Last Week
  • Khem to create Jira Tkt - startup-config issues (NUMA node and memory issues). Jira ID [VPP-1405]
  • Sirshak to ask Juraj to create a LF tkt for Power cycling. - Done
  • Lijian to follow up Mellanox issue. - Done. Patch Verified. To try merging it upstream.
  • Andy following up on cavium. - Done. Unavailability of resource from cavium. Box not priority right now, will take up later.
  • Khem to create Jira IDs for Jumbo frames. [CSIT-1259]In CSIT performance suite, Jumbo frames TCs failing on ARM servers
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin. - No updates, trying to resolve cmake issues.
  • Sirshak to add porting and tuning section to wiki. - Done
  • Sirshak/Juraj talk about Mellanox issue in CSIT call. - Done
• VPP
  • VPP-1339 - Mellanox NIC not working with VPP - Mellanox provided DPDK Patch ready, Lijian to try upstream it to VPP.
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test.
  • Vectorization
    • [Sirshak] Rough patch ready. Currently facing a crash due it.
  • Tuning dual/quad loop
    • Discussion ongoing with Damjan.
  • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.
  • Also to proceed with generic compilation to build for all micro architecture and do dynamic selection.
• CSIT
  • Juraj to investigate the compiler versions on fd.io lab machines.
  • CSIT-1139 - parallelize 'make verify'
    • Discussing with EdK, how to use that in jenkins job.
  • CSIT VPP Device updates
    • No problems. Trying basic package installation of container topology.
    • aarch64 vpp packages not built for 18.04 LTS, potential problem when we switch from 16.04->18.04.
  • CSIT Performance Test Suite Updates
    • No updates.
• FD.io lab
  • 3 LF tkts - 1 Node Topology wiring mcbin, 3-node topology wiring Mcbin, 1-node Topology wiring Cavium.
• Documentation
• Action Items - Next Week
  • Lijian yo try merging it upstream - Mellanox Changes.
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test.
  • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.

8/21/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Juraj Linkes
  • Lijian Zhang
  • Andy Wang
  • Tina Tsou
  • Khemendra Kumar
  • Honnappa Nagarahalli
  • Brian Brooks
• Action Items - Last Week
  • [Sirshak] Create LF RT ticket for power cycling mcbins - Not Done yet
  • [Honnappa] Add module owners list and performance analysis items to wiki page - Discussion Still going on.
  • [Lijian] Check if DPDK 18.08 helps Mellanox NIC issues. - Waiting for patch from Mellanox
  • [Sirshak] Create Jira ticket to see impact of Florin's patch : VPP-1401
  • [Sirshak] Create Jira ticket for msb : VPP-1402
  • [Khem] Try dual loop ip4_lookup_inline patch to see if it helps on A72-based D05. : Problems with Ipv4 forwarding(startup-config issues- NUMA Node and Memory issues).
  • [Brian] LTN-10 - Help resolve VPP build failure on mcbins in FD.io lab
  • [Juraj] Enable VPP Device on 1-node SoC now that SFP+ cables have arrived. : No Response from LF.
  • [Sirshak] Follow up with Cavium regarding Ubuntu installation on cavium-4. Status: Andy Following up.
  • [Khem] Create Jira ticket for CSIT failures with jumbo frames
  • [Khem] Create Jira ticket for running a subset of tests via a tag : [CSIT1250]In ARM Perf verify CI, running a subset of tests via a tag
• VPP
  • VPP-1339 - Mellanox NIC not working with VPP
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Vectorization
    • Stalled due to Mellanox NIC issues as benchmarking patches is not posible.
    • hadd and msb - Done.
    • extendto and shuffle going on.
    • Shuffle using __built_in gives same performance as vector intrinsic as at -O2 neither compile tbl instruction.
  • Tuning dual/quad loop
  • Sirshak to add Porting and Tuning Section to Wiki.
• CSIT
  • CSIT-1139 - parallelize 'make test'
    • dave barach to take a final look and merge.
  • Sirshak/Juraj to talk about having Mellanox in CSIT seeing current compatibility issues post-release.
  • CSIT VPP Device updates
    • Trying to get the 1-node topology: mcbin and cavium thunderx.
  • CSIT Perfomance Test Suite Updates
    • Current issues: NDR, PDR Jumbo frames failure but MRR passing. Memory and Numa Nodes issues in Taishan.
• FD.io lab
  • 3 LF tkts - Ubuntu Installation cavium-4, 1 Node Topology, Power Cycling mcbins(to be opened).
• Documentation
  • Documentation changes by Lijian Merged.
• Action Items - Next Week
  • Khem to create Jira Tkt - startup-config issues (NUMA node and memory issues).
  • Sirshak to ask Juraj to create a LF tkt for Power cycling.
  • Lijian to follow up Mellanox issue.
  • Andy following up on cavium.
  • Khem to create Jira IDs for Jumbo frames.
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Sirshak to add porting and tuning section to wiki.
  • Sirshak/Juraj talk about Mellanox issue in CSIT call.

8/14/2018

• Attendees
  • Juraj Linkes
  • Lijian Zhang
  • Andy Wang
  • Tina Tsou
  • Khemendra Kumar
  • Honnappa Nagarahalli
  • Brian Brooks
• FD.io lab
  • SFP+ cables shipment showing as delivered
• VPP
  • VPP-1339 - Mellanox NIC not working with VPP
    • Lijian noticed DPDK version updated to 18.08 and might help - https://gerrit.fd.io/r/#/c/14154/
    • Tina helping find someone from Mellanox to help
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan servers
    • Khem looking into this
  • No updates on crypto
  • No updates on vectorization
  • Tuning dual/quad loop
    • DaveB suggests looking at MULTIARCH macros
• CSIT
  • CSIT-1139 - parallelize 'make test'
    • Juraj updated patch with comments from Klement
  • Khem seeing failures with jumbo frames
  • Khem noticed new CSIT machines using tag to run a subset of tests
• Documentation
  • Lijian working on patch to add Arm to Architecture section and Arm-based CSIT testbeds to CSIT section
• Action Items - Next Week
  • [Sirshak] Create LF RT ticket for power cycling mcbins
  • [Honnappa] Add module owners list and performance analysis items to wiki page
  • [Lijian] Check if DPDK 18.08 helps Mellanox NIC issues
  • [Sirshak] Create Jira ticket to see impact of Florin's patch
  • [Sirshak] Create Jira ticket for msb
  • [Khem] Try dual loop ip4_lookup_inline patch to see if it helps on A72-based D05
  • [Brian] Help resolve VPP build failure on mcbins in FD.io lab
  • [Juraj] Enable VPP Device on 1-node SoC now that SFP+ cables have arrived
  • [Sirshak] Follow up with Cavium regarding Ubuntu installation on cavium-4
  • [Khem] Create Jira ticket for CSIT failures with jumbo frames
  • [Khem] Create Jira ticket for running a subset of tests via a tag

8/7/2018

• Attendees
  • Sirshak Das
  • Juraj Linkes
  • Lijian
  • Andrew Pinski
  • Andy Wang
  • Tina Tsou
  • Nitin Saxena
  • Khemendra
  • Sachin Saxena

• General Topic
• Action Items - Last Week
  • [Khem] make verify on Taishan failure Status: No Status. Khem to create a Jira Tkt.
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: [Andy] Cables to be sent today.
  • [Sirshak] Open Jira tkt look at Florin's patch. Status: To be done next week
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status: Failing in different place, like rx-error reported to Mellanox people by Lijian. [Lijian] To send the mail vpp-dev. [Honnappa] To talk to DPDK Mellanox DPDK community.
  • [Sirshak] Share Mellanox settings with nitin.
  • [Sirshak] to send email to yi and lijian for documentation. Status: Lijian has done the documentation under internal review.
  • [Honnappa/Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: [Sachin] To include Nitin suggestions and upstream.
  • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status: Sirshak to open LF Tkt
  • [Nitin] Create a Jira Tkt - ip cksum 128 bit vector support. Status: Nitin using ip incremental cksum.
  • [Sirshak] To create a LF tkt for Ubuntu 16.04 installation on cavium-4. Status: Anton tried 16.04 but it didnt work, sent mail to Cavium contact for help.
• VPP
  • [Sirshak] Vectorization
    • msb is already implemented verifying correctness and performance.
    • [Sirshak] To raise a Jira Tkt for msb changes.
    • Have communicated to ARM compiler team related to vtbl performance.
    • planning to add cvt (extend_to) and hadd(horizontal) equivalents.
  • [Brian/Sirshak] Tuning Dual or Quad loop.
    • [Khem/Sachin] Updates on the changes seen after applying Brian's Patch. Status: No Updates.
  • [Sachin] To create Jira Card, DPDK IOVA issue. (Created VPP-1377)
  • [Honnappa] Module Ownership Discussion. Status: To come back to discussion next time. Community feedback to move to more use-case based approach.
• CSIT
  • [Juraj] Parallelizing the make test(CSIT-1139) Status: Scheduling Done, Waiting for community review, got some internal comments Juraj working on it. To try this patch on jenkins sandbox.
  • [Sirshak] replying to cavium regarding Ubuntu 18.04/16.04 installation problem cavium-4. Done. Status: Following up with Cavium
  • [Khem] Performance Suite: 64B, 9000Jumbo. Jumbo Frames is failing.(khem to jira tkt: startup.conf, Frame size, NIC Card, Hugepages configuration).
  • [Khem] Have a subset of tests running with tag.
  • [Juraj/Sirshak] VPP Device SoC one node topology constraints Status: Orchestration still under discussion.
• fd.io lab
  • [Juraj] mcbin access Status: Accessible mcbin build failing, wait fro Brian for help.
  • [Sirshak] cavium blades. Status: [Sirshak] Following up with cavium
• Documentation
  • Need to update the working ARM boards in the documentation section.
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Khem] make verify on Taishan failure, Khem to create a Jira Tkt. Status:
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status:
  • [Sirshak] Open Jira tkt look at Florin's patch. Status: Not done to be done next week
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
  • [Lijian] To send the mail vpp-dev (VPP-1339) Status:
  • [Honnappa] To talk to DPDK Mellanox DPDK community. Status:
  • [Sachin] To include Nitin suggestions and upstream.(ARMv8 Crypto changes) Status:
  • [Sirshak] To Open a LF Tkt regarding power cycler remote access fro mcbin. Status:
  • [Sirshak] To raise a Jira Tkt for msb changes. Status:

7/30/2018

• Attendees
  • Sirshak Das
  • Juraj Linkes
  • Lijian
  • Andrew Pinski
  • Andy Wang
  • Tina Tsou
  • Nitin Saxena
  • Khemendra
  • Sachin Saxena

• General Topic
• Action Items - Last Week
  • [Khem] make verify on Taishan failure Status: No Status
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: [Andy] Still working internally, expecting to be done this week.
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Status: Jira Tkt VPP-1355
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status: Yet to be verified , if fixed.
  • [Sirshak] look at Florin's patch. Status: No status, [Sirshak] Open Jira tkt.
  • [Tina] to get back on New ARMv8 Crypto. Status: Bob to schedule meeting with Cavium. To be tracked by Nitin, bob, tina.
  • [Sirshak] Why Quad to Dual loop improves performance. Status: VPP-1356
  • [Sirshak] To update VPP documentation with fd.io lab devices. Status: Not yet done. [Sirshak] to send email to yi and lijian.
  • [Sirshak] VPP Vectorization Jira Tkt. Status: VPP-1357
  • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Waiting for Nitin to help on changes for Internal DPDK. External DPDK support patch done. [Sachin : created VPP-1378] To create a Jira Tkt for Internal Tkt. [Honnappa] To comment on current gerrit item to get it moving.
  • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4. Status: Sent
  • [Sirshak] Get credentails from Brian for mcbin Status: Done
  • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status: Done
• VPP
  • [Sirshak] Vectorization
    • Almost done with shuffle.
    • Will get to working with msb.
    • AARCH32 compilation to be discussed.(Shuffle Vector Intrinsic AARCH64 ARMv8 specific)
    • There are no specific requirements on aarch32 at this time.
  • [Lijian && Yi] To continue effort on analyzing IPv4 nos on available platforms with Intel and Mellanox NICs
    • [Sirshak] Why is Mellanox NIC not used in CSIT ? Performance Suite Designed for Intel and Cisco NICs.
  • [Brian/Sirshak] Tuning Dual or Quad loop.
    • [Khem/Sachin] Updates on the changes seen after applying Brian's Patch. Status: No Updates.
  • [Khem] Updates on Benchmarking on taishan. Status: Held up hardware.
  • [Nitin] Any new findings from IPv4 VPP test case. Status: Working HW offloading.
  • [Sachin] To create Jira Card, DPDK IOVA issue. (Created VPP-1377)
  • [Lijian] ipcksum - No Degradation on Qualcomm.
  • [Nitin] Create a Jira Tkt - ip cksum 128 bit vector support.
• CSIT
  • [Juraj] Parallelizing the make test(CSIT-1139) Status: All VPP instances running on same core. Tried scheduling cores. Dynamically finding available cores. Sweetspot currently: 8 containers with 96 core.
  • [Juraj] Test features listed by talking to dave.
  • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4. Done. Status: To open a new LF tkt to ask for 16.04 installation.
  • [Juraj/Sirshak] VPP Device SoC one node topology constraints Status: Orchestration still under discussion.
  • [Sirshak] to ask brian about mcbin credentials. Status: Done.
• fd.io lab
  • [Juraj] mcbin access Status: Created LF tkt.
  • [Sirshak] cavium blades. Status: [Sirshak] To create a LF tkt for Ubuntu 16.04 installation on cavium-4.
• Documentation
  • Need to update the working ARM boards in the documentation section.
    • [Lijian/Yi] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).
    • [Lijian/Yi] Add only fd.io lab devices.
    • [Sirshak] To send email with details.
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Khem] make verify on Taishan failure Status:
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: [Andy]
  • [Sirshak] Open Jira tkt look at Florin's patch. Status:
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
  • [Sirshak] to send email to yi and lijian for documentation.
  • [Honnappa/Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status:
  • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status:
  • [Nitin] Create a Jira Tkt - ip cksum 128 bit vector support.
  • [Sirshak] To create a LF tkt for Ubuntu 16.04 installation on cavium-4.

7/24/2018

• Attendees
  • Sirshak Das
  • Juraj Linkes
  • Lijian
  • Andrew Pinski
  • Andy Wang
  • Tina Tsou
  • Nitin Saxena
  • Khemendra

• General Topic
  • .
• Action Items - Last Week
  • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break. Status: Nitin, compiler does not support arm neon intrinsics. Honnappa working with compiler team: neon intrinsics is supported #defines not present. Tmp solution available. Honnappa to follow up in DPDK.
  • [Nitin/Sachin] Follow up: Add Virtual addressing support in IOVA dmap Status: patch committed by sachin merged.
  • [Khem] make verify on Taishan failure Status: No updates.
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: PO Approved. Should get going in few days.
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Status: Waiting for x86 hotspots for confirmation and will then open a ticket.
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status: Seems to be fixed but have not tried all the test cases to confirm.
  • [Sirshak] look at Florin's patch. Status: Not done yet
  • [Tina] to get back on New ARMv8 Crypto. Status: No updates. Close to complete but not upstreamed yet.
  • [Sirshak] Why Quad to Dual loop improves performance. Status: Not saturating no of outstanding prefetches. AI to raise a Jira Bug.
  • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin). Status; Not done yet.
• VPP
  • [Sirshak] vectorization patch effects
    • Made few changes no visible changes.
    • Plan to read mlnx drivers DPDK to understand how neon intrinsics accelerate the vectors.
    • Add Jira Tkt.
  • [Sirshak] Anamolies with mlx5 and VPP.
  • [Honnappa <-> Nitin] Nitin okay with ARM contacting Customer Support for help on TX2 optimal settings.
  • [Brian/Sirshak] Tuning Dual or Quad loop.
    • Visible change in A72.
    • Sirshak sent patch to Sachin and Khem to analyze if they see any improvement.
    • [Khem->Sirshak] Why moving form Quad to Dual improves performance.
  • [Lijian] x86 nos reported: 9.5 Mpps is not same as reported by Nitin Status: Could because of broadwell and skylake difference.
  • [Khem] Updates on IPv4 Benchmarking on taishan. Status: CSIT perfomance bringup on fd.io lab. 18.04 gcc 7.3 trex. Workaround done. DUT VPP crashing. Plan for running L2 test cases.
  • [Nitin] Any new findings from IPv4 VPP test case. Status: not available to discuss
• CSIT
  • [Juraj] Parallelizing the make test(CSIT-1139) Status: Sent for review, Figuring out optimal no of threads.
  • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4.
  • [Juraj/Sirshak] VPP Device SoC one node topology constraints Status: [Sirshak] Access to one of the three consoles.
  • [Sirshak] to ask brian about mcbin credentials.
  • [Adarsh] VPP Path/Device Efforts: Nested Container, trying VM inside a container facing some issues. Status: Work on hold as adarsh moved out of the project.
• fd.io lab
  • [Sirshak] Installation of TG pending. Status: Done
  • [Juraj] mcbin access Status: Two of them can be accessed the other 1 cant.
  • [Sirshak] cavium blades connected need SFP and DACs. Status: Up and running, still need SFP and DACs
• Documentation
  • Need to update the working ARM boards in the documentation section.
    • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).
    • [Sirshak] Add only fd.io lab devices.
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Khem] make verify on Taishan failure Status:
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status:
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Status: Jira Tkt VPP-1355
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
  • [Sirshak] look at Florin's patch. Status:
  • [Tina] to get back on New ARMv8 Crypto. Status:
  • [Sirshak] Why Quad to Dual loop improves performance. Status: VPP-1356
  • [Sirshak] To update VPP documenetation witrh fd.io lab devices. Status:
  • [Sirshak] VPP Vectorization Jira Tkt. Status: VPP-1357
  • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Last Status: Waiting for Nitin to help on changes for Internal DPDK. Current Status:
  • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4. Status: Sent
  • [Sirshak] Get credentails from Brian for mcbin Status: Done
  • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status: Done

7/17/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Khemendra Kumar
  • Juraj Linkes
  • Lijian

• General Topic
  • Austin Folks leaving early meeting. If needs be somebody can takeover after 1 hour (9 am CT).
• Action Items - Last Week
  • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break
  • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status: No updates.
  • [Khem] make test on Taishan timings: Status: Done. To look at why make verify.
  • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch. Status: Andy waiting for cables to reach him.
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Jira Tkt Status: Not yet done. Will do this week.
  • [Sirshak] DPDK 18.05 mlnx bug. Status: Sirshak to open Jira Tkt - VPP-1339
  • [Sirshak] look at Florin's patch. Status: Not yet done.
  • [Tina] to get back on New ARMv8 Crypto.
• VPP
  • [Sirshak] vectorization patch effects
    • Made few changes no visible change.
    • Plan to read mlnx drivers DPDK to understand how neon intrinsics accelerate the vectors.
  • [Brian/Sirshak] Tuning Dual or Quad loop.
    • Visible change in A72.
    • None in Qualcomm because of pfrm not being hotspot.
    • [Khem->Sirshak] Why moving form Quad to Dual improves performance.
    • Commmunity wide investigation needed.
  • [Lijian] x86 nos reported: 9.5 Mpps is not same as reported by Nitin Status: Investigation.
  • [Khem] Updates on IPv4 Benchmarking on taishan. Status: Stuck with pktgen.
  • [Nitin] Any new findings from IPv4 VPP test case. Status:
  • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Waiting for Nitin to help on changes for Internal DPDK.
• CSIT
  • [Juraj] Parallelizing the make test(CSIT-1139) Status: Almost done, need to work on polishing.
  • [Juraj/Sirshak] SoC devices as non voting VPP device targets. Status: [Sirshak] pending on TG credentials.
  • [Adarsh] VPP Path/Device Efforts: Nested Container, trying VM inside a container facing some issues. Status: No update, Adarsh replaced on the project; postponed
• fd.io lab
  • [Sirshak] Installation of TG pending. Status: No update from LF - Anton
  • [Sirshak] cavium blades connected need SFP and DACs. Status: Up and running, still need SFP and DACs
• Documentation
  • Need to update the working ARM boards in the documentation section.
    • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).
    • [ARM community] Waiting for feedback from Khem and other companies
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break Status:
  • [Nitin/Sachin] Follow up: Add Virtual addressing support in IOVA dmap Status:
  • [Khem] make test on Taishan failure Status:
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status:
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Status:
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
  • [Sirshak] look at Florin's patch. Status:
  • [Tina] to get back on New ARMv8 Crypto.
  • [Sirshak] Why Quad to Dual loop improves performance.
  • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).

7/10/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Khemendra Kumar
  • Tina Tsou
  • Nitin Saxena
  • Juraj Linkes
  • Brian Brooks
  • Lijian
  • Tom Herbert
• General Topic
  • Austin Folks leaving early meeting. If needs be somebody can takeover after 1 hour (9 am CT).
  • [Tom] Aarch64 rpms not building - anyone can help?
• Action Items - Last Week
  • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status: No updates.
  • [Nitin] make test on Thunderx2 timings Status: Send error report of make test.
  • [Khem] make test on Taishan timings: Status: 22 mins. Try make verify.
  • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch. Status: Done for cavium 1,2,3. Need cables for 4,5,6,7. Cables ordered
  • [Khem] to update on nested VMs on performance test cases. Status: No updates. Could be a naming problem.
  • [Sirshak] Q to Maciek: buildroot image with VPP device(within container)? Status: No updates. Check with Brian to see if buildroot works on arm.
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Reason ? Status: No updates. Sirshak to open Jira Tkt.
  • [Sirshak] DPDK 18.05 mlnx bug. Status: Asked in the community need to look at backtrace as pointed by damjan. Sirshak to open Jira Tkt.
• VPP
  • [Sirshak] vectorization patch effects. https://gerrit.fd.io/r/#/c/13229/
    • I see around 15% in qualcomm with mellanox based on some patch which is not vectorization patch need find that.
    • Do others see similar improvement in past 2 weeks.
    • [Sirshak] look at Florin's patch.
  • [Lijian] x86 nos, checking within Nitin for sync on configuration. Skylake Single Core Single Thread: Ipv4 forwarding 64B 15 Mppps.
  • [Khem] Updates on IPv4 Benchmarking on taishan. Status: No Updates
  • [Nitin] Any known comparision between AVF nos on aarch64 and DPDK nos ? On Intel its ~25% and ARM ~20%.
  • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Internal DPDK changes effort. Wait for status on New ARMv8 Crypto.
  • [Sirshak->Nitin] Thunderx2(high core count)coremask for DPDK config in VPP startup conf.
  • [Tina] to get back on New ARMv8 Crypto.
• CSIT
  • [Juraj] Parallelizing the make test(CSIT-1139) Discussion: On Plan and if anybody wants to join hands.
  • [Juraj/Sirshak] SoC devices as non voting VPP device targets. Discussion: mcbin console access will be available once TG credentials are availlable.
  • [Adarsh] VPP Path/Device Efforts: Nested Container, trying VM inside a container facing some issues.
• fd.io lab
  • [Sirshak] Taishan connected need to verify once we get TG credentials. [Khem] Checked from Taishan side ports connected to TG are up.
  • [Sirshak] mcbin connected need to verify once we get TG credentials.
  • [Sirshak] cavium blades connected need to switch the network adapters before using it for CI.
• Documentation
  • Need to update the working ARM boards in the docyumentation section.
    • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break
  • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status: No updates.
  • [Khem] make test on Taishan timings: Status:
  • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch.
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Jira Tkt Status:
  • [Sirshak] DPDK 18.05 mlnx bug. Status: Sirshak to open Jira Tkt.
  • [Sirshak] look at Florin's patch.

7/3/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Khemendra Kumar
  • Tina Tsou
  • Nitin Saxena
  • Juraj Linkes
  • Brian Brooks
  • Ed Kern
  • Song
  • Lijian
• General Topic
  • Architecture Section in Documentation.
• Action Items - Last Week
  • Khem: Ipv4 layer investigation. To Share some findings next week on parameters for CSIT Status: Done. If yes cover in VPP section.
  • Nitin Follow up: Sachin: Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Nitin to provide help on using Internal DPDK
  • Nitin Follow up: Add Virtual addressing support in IOVA dmap Status: Waiting for response from Damjan
  • Nitin make test on Thunderx2 timings :
  • Khem: status on make test failures: CSIT-1148 Status: Fixed.
  • Khem: make test on Taishan timings: Status: No status
  • Sirshak: cavium USB-Ethernet adapters to Quantta Switch. Status: Still working with LF guys
  • Khem to update on nested VMs on performance test cases. Status: No Updates
  • Sirshak & Khem: Documentation review. Status: Done. continuous effort.
  • Sirshak: Q to Maciek: buildroot image with VPP device(within container) ? Status: No updates.
• VPP
  • Sirshak: Investigate mlnx_burst_rx_vec used in case of no multi-seg but plain mlnx_tx_burst used. Movement of hotspot seen for rx. Probable reason SRIOV(VFs) used. Root cause yet to be found.
  • Sirshak: VPP DPDK 18.05 change done by damjan. mlnx drivers on Qualcomm are a problem. Urge Everyone to test respective sanity in their setup. set interface state <InerfaceName> up - stuck
  • Khem: Discuss various parameters in CSIT for IPv4 Testing.
  • Sirshak: TCP termination performance nos ?
  • Sirshak: vectorization patch effects. https://gerrit.fd.io/r/#/c/13229/
• CSIT
  • Juraj Make test bottlenecks: Updates: One plausible solution available. Parallelizing the make test(CSIT-1139)
  • Juraj to start looking at SoC devices as non voting VPP device targets.
  • Adarsh: openssl issues ? Issue still persists.
  • Adarsh: VPP Path Tasks.
  • Tkt updates:
    • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Status: To check with CSIT team for jenkins build failure. Status: No Updates. Not Priorty.
• fd.io lab
  • Sirshak: Update from LF guys
• Documentation
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status:
  • [Nitin] make test on Thunderx2 timings :
  • [Khem] make test on Taishan timings: Status:
  • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch. Status:
  • [Khem] to update on nested VMs on performance test cases. Status:
  • [Sirshak] Q to Maciek: buildroot image with VPP device(within container)? Status:
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Reason ? Status:
  • [Sirshak] DPDK 18.05 mlnx bug. Status:

6/26/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Khemendra Kumar
  • Tina Tsou
  • Nitin Saxena
  • Juraj Linkes
  • Brian Brooks
  • Ed Kern
  • Song
• General Topic
  • Introduce Song, Yi and Lijian
• Action Items - Last Week
  • Adarsh: Updates on Jira tkt for openssl issues. Updates: none
  • Adarsh: Update on topology for Kubernetes Functional Tests. Updates: Kubernetes, Docker
  • Sirshak Tuning Section - Not Done
  • Khem: Ipv4 layer investigation. CSIT: IPv4. To Share some findings next week on parameters for CSIT
  • Nitin: Send old dpdk input node patch - Done
  • Sachin: Upstreaming ARMv8 Crypto Changes with external DPDK. - Nitin to send mail
  • Add Virtual addressing support in IOVA dmamap: Updates - nitin to send mail
  • Nitin Measure make make test on Thunderx2
  • Khem: measure make and make test on Taishan (Juraj tested it it failed : https://jira.fd.io/browse/CSIT-1148)
  • Sirshak: try to switch eth-usb for regular eth ports on ThunderXs - Created a LF tkt have follow up meeting today.
• VPP
  • Discuss vec_en_rx/tx=1 parameters.
  • Discuss Vectorized rx and tx functions in mlx5 (in case of no multi-seg)
  • rxd,txd nos in VPP config.
  • mbcache any configuring done from VPP side ?
• CSIT
  • make test failures Taishan Khem/adarsh (https://jira.fd.io/browse/CSIT-1148)
  • Juraj Make test bottlenecks: Updates: Ran 4 containers (85 mins) (CSIT-1139)
  • mcbin, OD(1000/3000), cavium thunderX as one of the targets for VPP Device Test.
  • Future role of devices. Status: Existing Taishan Servers to be used for performance suite only.
  • Khem to update on nested VMs on performance test cases.
  • buildroot image with VPP device(within container) ? Sirshak to ask maciek
  • Tkt updates:
    • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Merged and Closed
    • CSIT-990 (buildroot package) Juraj Updates: Postponed
    • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Status: To check with CSIT team for jenkins build failure.
• fd.io lab
  • Sirshak to have follow up LF guys.
• Documentation
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
  • Sirshak and Khem to try doing some reviews this week.
• Action Items - Next Week
  • Khem: Ipv4 layer investigation. To Share some findings next week on parameters for CSIT
  • Nitin Follow up: Sachin: Upstreaming ARMv8 Crypto Changes with external DPDK.
  • Nitin Follow up: Add Virtual addressing support in IOVA dmap
  • Nitin make test on Thunderx2 timings :
  • Khem: status on make test failures: CSIT-1148
  • Khem: make test on Taishan timings:
  • Sirshak: cavium USB-Ethernet adapters to Quantta Switch.

• • Sirshak: try to switch eth-usb for regular eth ports on ThunderXs - Created a LF tkt have follow up meeting today.

6/19/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Khemendra Kumar
  • Tina Tsou
  • Nitin Saxena
  • Juraj Linkes
  • Brian Brooks
  • Ed Kern
  • Song
• General Topic
  • Introduce Yi ,Lijian and Song
• Action Items - Last Week
  • Brian: mcbin Status:
  • Sirshak: Follow up clang changes. Status: Merged updated wiki.
  • Khem: Update Kernel Image based on Sanil's input to move past known VM issues. Try this internally.
  • Khem: LF tkt for Taishan BIOS updates.
    • No update for the ticket
  • Adarsh: openssl updates. Status:
    • Raised Jira ticket, needs to be discussed with VPP folks
  • Adarsh: Kubernetes
    • Working with K8s folks, planning on creating topology from containers for functional tests
  • Khem: VM(s) in container, VFs for containers
  • Sirshak: Summarize tkts in the Tuning Section. Status: Not Done
  • Khem: Investigation on ipv4 layer. Status: Not Done
  • Nitin: Send old patch on dpdk_input node tuning
• VPP
  • Sachin: Upstreaming armv8 crypto changes. Status: Sachin will try to upstream a patch related to external DPDK
  • Sirshak: Vectorization - Presentation.
  • Any new findings on hotspots or optimizations. Brian: adjusting queue sizes seem to have an effect
  • https://gerrit.fd.io/r/#/c/12932/ discussion: Need to understand the usecase(s) for iommu inside VPP
• CSIT
  • Discuss current make test time bottleneck.
  • AI Nitin: measure make and make test on ThunderX
  • AI Khem: measure make and make test on Taishan
  • AI Sirshak: try to switch eth-usb for regular eth ports on Thunderxs
  • Future role of devices. Status: will be decided when we have more info (performance on different devices etc.)
  • Question to Nitin/Anyone of how to individually run one test case of the performance suite. Status: no performance testcase can run on 2-node topologies
  • Tkt updates:
    • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Sent a patch. Status: Patch is waiting to be merged
    • CSIT-990 (buildroot package) Juraj Updates: No updates
    • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Submitted. Jobs still failing, Khem to investigate. Patch related to Jumbo pkts.
• fd.io lab
  • mcbin get them up, discuss with LF. Status: Brian - No Updates
  • Cavium Blades LF ticket #56713 Status: Tina - Need to have a meeting
• Documentation
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io

• Action Items - Next Week

6/12/2018

• Attendees
  • Sirshak Das
  • Brian Brooks
  • John Bromhead
  • Sachin Saxena
  • Khemendra Kumar
  • Adarsh
  • Andy Wang
  • Tina Tsou
  • Andrew Pinski
  • Nitin Saxena
  • Natalie Samsonov

• Action Items - Last Week
  • Brian: mcbin status: Updates from Trishan LF tkt #54490. - No updates
  • Sirshak: Follow up clang changes. Sent: Follow up patch.
  • Khem: Update Kernel Image based on Sanil's input to move past known VM issues. Try this internally and then do it fd.io lab.
  • Khem: LF tkt for Taishan BIOS updates. LF #56898 Status: Not done. Will follow up.
  • Adarsh: openssl updates. Status: IPSEC SA add entry error. To open a Jira tkt tracking this.
  • Sirshak: Summarize tkts in the Tuning Section. Didnt get chance to do this week would try to complete it by next week.
  • Sirshak: Schedule a Meeting between Juraj and Khem. Done
• VPP
  • Brian: Talk on mcbin perf analysis. Nitin to send a old patch on tuning prefetch on dpdk_input node.
  • Sirshak: VPP Multi-arch optimizations Guidelines
  • Sirshak: Vectorization - Plan to present something next week. Any thoughts ?
  • Nitin: anybody willing to take up ipv4 layer ? Khem to take a look.
  • Sachin: Upstreaming armv8 crypto changes.
  • Nitin: memcpy updates ?
  • Sirshak: clang patch status
• CSIT
  • Sirshak: Explain VPP Path and VPP Device
  • Open Questions and Answers surrounding VPP Device
    • Q. Do the Intel onboard NICs support VFs via SRIOV on machiattobin boards ?
    • A.[Natalie] We support it but it’s not formally released yet. Will be formally delivered in 18.09.
    • BB - Kernel bypass uses UIO possible to do. [natalie] check support for VF for onboard NICs
    • Q. If Yes, is it a hardware level support or supported in musdk also ?
    • A.[Natalie] MUSDK is not relevant here. Intel NICs are using DPDK and ARM infrastructure directly. We support PCIE SR-IOV with both v4.4 and v4.14 kernels
    • Q. Has anybody tested containers (docker) and any container orchestration system on mcbin (e.g Docker Swarm or Kubernetes) ?
    • A.[Natalie] Yes.
    • Q. K8s or Docker Swarn ?
    • A. [Bin Arm Internal] K8s is good choice version(1.9.4). Use kubeadm to install k8s cluster.
    • Q. VM inside a container works on ARM ?
    • A. [Bin ARM Internal] Use Kata and Runv. Kata/Runv is the solution of hardware-virtualized containers.
    • Q. Container within a Container(nested) works on ARM ?
    • A.[Bin ARM Internal] ‘Docker in docker’ or ‘Docker of Docker’ can works well on Arm platform.
  • Sirshak: Explain the proposed role of Cavium Blades for functional tests.
  • Tkt updates:
    • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Sent a patch.
    • CSIT-990 (buildroot package) Juraj Updates:
    • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Submitted. Jobs failing Khem to investigate. Patch related to Jumbo pkts.
    • Sachin: To open tkt to track ARMv8 crypto.
• fd.io lab
  • mcbin Status: Brian - No Updates
  • Cavium Blades #56713 Status: Tina
• Documentation
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io

• Action Items - Next Week

• • Brian: mcbin Status:
  • Sirshak: Follow up clang changes. Status: Merged updated wiki.
  • Khem: Update Kernel Image based on Sanil's input to move past known VM issues. Try this internally.
  • Khem: LF tkt for Taishan BIOS updates.
  • Adarsh: openssl updates. Status:
  • Sirshak: Summarize tkts in the Tuning Section. Status: Not Done
  • Khem: Investigation on ipv4 layer. Status:

6/4/2018

• Attendees
  • Sirshak Das
  • Brian Brooks
  • John Bromhead
  • Sachin Saxena
  • Khemendra Kumar
  • Adarsh
  • Andy Wang
  • Tina Tsou
  • Andrew Pinski
  • Juraj Linkes
  • Nitin Saxena
  • Natalie Samsonov

• Action Items - Last Week
  • Sirshak: To create a LF tkt for mcbin - Didnt create as Brian is handling it offline. If things remain unresolved this week, will create one. - LF Tkt created #54490. [BB]Trishan to follow up over email.
  • Sirshak: Follow up on cavium-3 : Its integrated to

Status Report Ligato/Contiv