Difference between revisions of "VPP/AArch64"

From fd.io
< VPP
Jump to: navigation, search
(→‎Meeting Minutes)
(→‎Meeting Minutes)
Line 316: Line 316:
 
* General
 
* General
 
* VPP Hoststack
 
* VPP Hoststack
 +
** After assigned dedicated CPU processors for VPP main/VPP worker/iperf3 server, both ThunderX2 and Taishan Server VPP hoststack give better performance compared with Linux stack.
 
** memcpy optimization  
 
** memcpy optimization  
 
*** memcpy patch verification on taishan by khem l3 forwarding usecase- Lijian Status(khem): No updates.
 
*** memcpy patch verification on taishan by khem l3 forwarding usecase- Lijian Status(khem): No updates.
 +
*** memcpy patch consumes more clocks in OcteonTX2 - updated by Nitin.
 
** iperf3 performance with Hoststack.
 
** iperf3 performance with Hoststack.
 
*** ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
 
*** ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
Line 323: Line 325:
 
*** Octeon-Tx Status(Sirshak): yet to try steps from gorka for usb ubuntu rootfs installation.  
 
*** Octeon-Tx Status(Sirshak): yet to try steps from gorka for usb ubuntu rootfs installation.  
 
** VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
 
** VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
 +
** VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
 
* CSIT
 
* CSIT
 
** VPP Performance Test
 
** VPP Performance Test
−
** Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible.  
+
** Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
 +
** Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
 
** Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
 
** Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
−
*** a. Host Config
+
*** a. Host Config, almost done with patch https://gerrit.fd.io/r/#/c/16837/
 
*** b. merging CSIT patch.
 
*** b. merging CSIT patch.
 
*** c. creating a job.
 
*** c. creating a job.
Line 338: Line 342:
 
*** thunderx  Status: 1-node topology was rewired because of QSFP+ switch.  
 
*** thunderx  Status: 1-node topology was rewired because of QSFP+ switch.  
 
*** mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
 
*** mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
 +
*** Confirm if Jianlin's board has the exactly same plugable switches with Juraj's boards - Lijian
 
*** thunderx2: Status: Talk to edk about deployment strategy with 1-node.
 
*** thunderx2: Status: Talk to edk about deployment strategy with 1-node.
 
* FD.io lab
 
* FD.io lab
Line 349: Line 354:
 
** Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560
 
** Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560
 
** 1GB page taking long time Status: fixed.
 
** 1GB page taking long time Status: fixed.
 +
*** Investigate with latest VPP code on x86 server
 
** Vectorization
 
** Vectorization
 
*** ethernet-input
 
*** ethernet-input
Line 354: Line 360:
 
*** memcpy
 
*** memcpy
 
** 128B cache line size
 
** 128B cache line size
 +
*** Will try this on Taishan server - Lijian
 
** Qualcomm no change iperf3
 
** Qualcomm no change iperf3
−
** thunderx2 crashing
+
** thunderx2 crashing - No update
 
** Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
 
** Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
 
* Action Items - Last Week
 
* Action Items - Last Week

Revision as of 08:55, 21 February 2019

Get Involved

Meeting Details

IRC Channel

#fdio-arm on freenode.net

Slack

Request invitation at https://slack.fd.io/

Jira

Jira issues with ARM64 label

Presentations

Release Milestones

18.10

18.07

18.04

  • CI
    • Upstream patch verification on ARMv8 machines
    • .deb packages

Machines

The FD.io lab is hosted at VEXXHOST colocation centre in Montreal Québec, Canada.

Platform Role Status Hostname IP IPMI Cores RAM Ethernet Distro
SoftIron OverDrive 1000 CI build server Not Used softiron-1 10.30.51.12 N/A 4 8GB openSUSE
CI build server Not Used softiron-2 10.30.51.13 N/A 4 8GB openSUSE
CI build server Not Used softiron-3 10.30.51.14 N/A 4 8GB openSUSE
Marvell ThunderX CI build server Running in CI nomad3arm 10.30.51.38 10.30.50.38 96 128GB 3x40GbE QSFP+ / 4x10GbE SFP+ Ubuntu 16.04
CI build server Running in CI nomad4arm 10.30.51.39 10.30.50.39 96 128GB 3x40GbE QSFP+ / 4x10GbE SFP+ Ubuntu 16.04
CI build server Running in CI nomad5arm 10.30.51.40 10.30.50.40 96 128GB 3x40GbE QSFP+ / 4x10GbE SFP+ Ubuntu 16.04
CI build server Running nomad6arm 10.30.51.65 10.30.50.65 96 256GB 2xQSFP+ / USB Ethernet Ubuntu 18.04.1
VPP dev debug server Running nomad7arm 10.30.51.66 10.30.50.66 96 256GB 2xQSFP+ / USB Ethernet Ubuntu 18.04.1
CI build server Running nomad8arm 10.30.51.67 10.30.50.67 96 256GB 2xQSFP+ / USB Ethernet Ubuntu 16.04.1
VPP dev debug server Running nomad9arm 10.30.51.68 10.30.50.68 96 256GB 2xQSFP+ / USB Ethernet Ubuntu 16.04.1
Marvell ThunderX2 VPP device server Being Provisioned s27-t13-sut1 10.30.51.69 10.30.50.69 112 128GB 3x40GbE QSFP+ XL710-QDA2 Ubuntu 18.04.1
Huawei TaiShan 2280 CSIT testbed Running s17-t33-sut1 10.30.51.36 10.30.50.36 64 128GB 2x10GbE SFP+ Intel 82599 / 2x25GbE SFP28 Mellanox CX-4 Ubuntu 17.10
CSIT testbed Running s18-t33-sut2 10.30.51.37 10.30.50.37 64 128GB 2x10GbE SFP+ Intel 82599 / 2x25GbE SFP28 Mellanox CX-4 Ubuntu 17.10
Marvell MACCHIATObin CSIT testbed Running s20-t34-sut1 10.30.51.41 10.30.51.49, then connect to /dev/ttyUSB0 4 16GB 2x10GbE SFP+ Ubuntu 16.04.4
CSIT testbed Running s21-t34-sut2 10.30.51.42 10.30.51.49, then connect to /dev/ttyUSB1 4 16GB 2x10GbE SFP+ Ubuntu 16.04.5
VPP dev debug server Running fdio-mcbin3 10.30.51.43 10.30.51.49, then connect to /dev/ttyUSB2 4 16GB 2x10GbE SFP+ Ubuntu 16.04.5

Note: to get lab access, create a gpg key, upload it to keyserver, have it signed by a trusted anchor in a video call (fingerprint will be needed) and then an ARM authority (Tina) needs to send an e-mail to helpdesk@fd.io with your name, e-mail, keygrip and key fingerprint

CI

Covers automated build, unit test, and packaging for various Linux distros on ARMv8 machines.

Jenkins job Status Description
vpp-arm-verify-master-ubuntu1604 Running xxx
vpp-arm-merge-master-ubuntu1604 Running xxx
vpp-arm-verify-1804-ubuntu1604 Running xxx
vpp-arm-merge-1804-ubuntu1604 Running xxx

Next steps:

  • make test added to verify jobs
  • Clang build
  • openSUSE Leap 15 | CentOS 7 | Ubuntu 18.04
  • vpp-csit-verify-virl-master or equivalent CSIT functional testing

CSIT

Covers automated functional and performance integration testing on ARMv8 3-node and 2-node testbeds.

https://wiki.fd.io/view/CSIT/AArch64

Contiv-VPP

This Kubernetes network plugin uses FD.io VPP to provide network connectivity between PODs.

https://github.com/contiv/vpp

The installation guide of Contiv-VPP on Arm64 platform is

https://github.com/contiv/vpp/blob/master/docs/arm64/MANUAL_INSTALL_ARM64.md

Porting and Tuning Roadmap

  • VPP Vectorization: Expanding the Neon Library for IPv4 forwarding code path - Sirshak/Lijian
  • Tuning the quad loop/dual loop for small cores - Lijian
  • General performance analysis and tuning of various graph nodes for IPv4 forwarding test case - Sirshak/Lijian
  • Memory Ordering - Sirshak
  • CSIT Performance Test - Khemendra
  • CSIT Device Test - Juraj
  • CSIT Path Test - Juraj

Known Issues

GCC 5.3 ICEs during FP register allocation. Please use GCC 5.4 or newer.

Activity

Recent Patches

Use acquire/release ordering when accessing svm_fifo shared variable cursize Merged 11/29 Sirshak Das
Optimize xxx_zero_byte_mask NEON function. Merged 11/07 Lijian Zhang
Enable atomic swap and store macro with acquire and release ordering. Merged 11/03 Sirshak Das
Add and enable msb mask vector intrinsic for aarch64. Merged 10/31 Lijian Zhang
vppinfra: add atomic macros for __sync builtins Merged 10/19 Sirshak Das
vppinfra: Fix extendto_high aarch64 NEON api. Merged 10/09 Sirshak Das
Support dynamic dual/quad loop selection on aarch64 Merged 10/01 Lijian Zhang
Enable verbose output during VPP cmake compiling Merged 9/25 Lijian Zhang
dpdk_plugin: fix mlx5 build and runtime issues Merged 9/27 Sirshak Das
Add and enable u32x4_extend_to_u64x2_high for aarch64 NEON intrinsics. Merged 9/12 Sirshak Das
Add horizontal add (hadd) vector intrinsic via NEON. Merged 9/11 Sirshak Das
Add u32x4_extend_to_u64x2 for aarch64 using NEON intrinsics Merged 9/11 Sirshak Das
Replacing vtbl NEON intrinsic with rev NEON intrinsic for byte_swap. Merged 9/11 Sirshak Das
Fix array bound failure in api_sr_localsid_add_del Merged 8/30 Lijian Zhang
cmake: fix marvell plugin build Merged 8/28 Brian Brooks
fix dpdk_plugin.so load failure with DPDK 18.08 Merged 8/23 Lijian Zhang
Fix a bug in function pipe_rx Merged 8/17 Lijian Zhang
fix compiling warnings with GCC Merged 8/17 Lijian Zhang
Update AArch64 CSIT machines into FD.io VPP docs Merged 8/17 Lijian Zhang
Add support for shuffle vector intrinsic via Neon in ARM Merged 8/1 Sirshak Das
Improve cpu { coremask-% } configure option Merged 8/1 Yi He
Fix undefined symbol: fformat_append_cr in vat plugins loading Merged 7/31 Yi He
pp2: increase recycle batch size Merged 7/10 Brian Brooks
pp2: change default queue size Merged 7/26 Brian Brooks
pp2: use configured RX queue size Merged 7/10 Brian Brooks
Fix load_unaligned undefined and other possible build failures Merged 6/26 Sirshak Das
Enable PMU cycle counter for graph node cycles Sirshak Das
Fix clang compilation on aarch64: extraneous parentheses Merged 6/13 Sirshak Das
Fix clang compilation on aarch64: value size does not match register size Merged 5/30 Sirshak Das
Fix clang compilation on aarch64: sizeof operator error Merged 5/30 Sirshak Das
Fix clang compilation on aarch64: replace -pie with -fPIE for dpdk compilation Merged 5/30 Sirshak Das
dpdk: set dmamap iova address value according to eal_iova_mode Merged 5/28 Sachin Saxena
Fixes make test errors with clang compiler on aarch64 Merged 5/27 Sirshak Das
Fix broken compilation for non-numa aware platforms Merged 5/16 Sachin Saxena
build-data: Common makefile for NXP DPAA1/DPAA2 platforms Merged 5/4 Sachin Saxena
arm64: Avoid setting march to corei7 when Cross Compiling for ARM Merged 5/4 Sachin Saxena
use restrict keyword VPP-1126 Khemendra Kumar
Autotools: Autodetection of cache line size VPP-1064 Nitin Saxena
add 'is_all_zero(x)' for NEON - fix build break Merged 2/20 Adrian Oanca
u8x16_compare_byte_mask optimization Merged 2/24 Adrian Oanca
Added u8x16,u32x4,u64x2 variants of _zero_byte_mask(x) for ARM/NEON platform Merged 2/26 VPP-1129 Adrian Oanca
add CLIB_HAVE_VEC128 with NEON intrinsics Merged 02/08 VPP-1127 Gabriel Ganne
Use neutral vector code for ethernet_frame_is_tagged Merged 2/19 Damjan Marion
vhost: Added ARMV8 NEON version of function map_guest_mem() Merged 2/7 VPP-1085 Nitin Saxena
vppinfra: use __atomic_fetch_add instead of __sync_fetch_and_add builtins VPP-1114 Kevin Wang
Arm system counter cleanup Merged 1/30 VPP-1125 Brian Brooks
svm: ... on autodetected VA space size (fixup again) Merged 01/10 Gabriel Ganne
svm: calc base address on AArch64 based on autodetected VA space size (fixup) Merged 01/10 Gabriel Ganne
svm: calc base address on AArch64 based on autodetected VA space size Merged 01/09 Damjan Marion
show cpu microarchitecture Merged 01/06 Gabriel Ganne
Fix Debian Packaging on AARCH64 Merged 01/06 Nitin Saxena
more extended tests fixes Merged 12/16 Gabriel Ganne
Use crc32 wrapper Merged 12/16 VPP-1086 Gabriel Ganne
implement clib_smp_pause() for arm and aarch64 platform Merged 12/15 VPP-1066 Kevin Wang
make "test-all" target pass again (for all platforms) Merged 12/13 Gabriel Ganne
fill "show cpu" Flag list on aarch64 platforms Merged 12/06 VPP-1065 Gabriel Ganne
remove smp dead code Merged 12/06 VPP-1066 Gabriel Ganne
net/virtio: support modern device id Merged 11/28 Gabriel Ganne
use REV on aarch64 for endianness swapping Merged 11/21 VPP-1067 Gabriel Ganne
armv8 crc32 - fix macro name Merged 11/15 Gabriel Ganne
bier - fix node table declaration Merged 11/14 Gabriel Ganne
Map SVM regions at a sane offset on arm64 Merged 11/10 Brian Brooks
bfd tests fix Merged 11/07 Gabriel Ganne
debian packaging fix Merged 11/06 Gabriel Ganne
lb test fix Merged 10/31 Gabriel Ganne
conditional x86intrin.h inclusion Merged 10/25 Gabriel Ganne
fix test_lb_ip4_gre6() cleanup Merged 10/24 Gabriel Ganne
null-terminate some formatted string Merged 10/20 Gabriel Ganne
lb plugin - fix format() type mismatches Merged 10/16 Gabriel Ganne
Use AESNI=y only on x86_64 machines Merged 10/14 Brian Brooks
Improved arm64 chip detection Merged 09/11 Brian Brooks
Native arm64 build: dpdk/Makefile change Merged 08/31 Brian Brooks

Meeting Minutes

02/19/2019

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Stanislav Chlebec
    • Khemendra Kumar
    • Tina Tsou
    • Andy Wang
    • Gorka
    • Fede
    • Honnappa Nagarahalli
  • General
  • VPP Hoststack
    • After assigned dedicated CPU processors for VPP main/VPP worker/iperf3 server, both ThunderX2 and Taishan Server VPP hoststack give better performance compared with Linux stack.
    • memcpy optimization
      • memcpy patch verification on taishan by khem l3 forwarding usecase- Lijian Status(khem): No updates.
      • memcpy patch consumes more clocks in OcteonTX2 - updated by Nitin.
    • iperf3 performance with Hoststack.
      • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
      • svm_fifo: Status(Sirshak): Working on fixing VPP Path errors from svm_fifo patch.
      • Octeon-Tx Status(Sirshak): yet to try steps from gorka for usb ubuntu rootfs installation.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
    • VPP running on Arm side, x86 iperf3 client observes unstable performance rate.(Reason unknown).
  • CSIT
    • VPP Performance Test
    • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible. https://jira.fd.io/browse/VPP-1566
    • Installed VPP crashed on Taishan server, https://jira.fd.io/browse/VPP-1569
    • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
    • Target: master trending job
    • VPP Path
    • VPP Device
      • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
      • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
      • Confirm if Jianlin's board has the exactly same plugable switches with Juraj's boards - Lijian
      • thunderx2: Status: Talk to edk about deployment strategy with 1-node.
  • FD.io lab
    • ThunderX1
      • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
      • Juraj setup call with LF people. Status: Done.
    • ThunderX2
      • Cables: Sent. Juraj to open another tkt for wiring the ThunderX2.
  • VPP
    • Buffer Pools per NUMA
    • Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560
    • 1GB page taking long time Status: fixed.
      • Investigate with latest VPP code on x86 server
    • Vectorization
      • ethernet-input
      • buffer pools
      • memcpy
    • 128B cache line size
      • Will try this on Taishan server - Lijian
    • Qualcomm no change iperf3
    • thunderx2 crashing - No update
    • Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • Action Items - Next Week

02/11/2019

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Stanislav Chlebec
    • Khemendra Kumar
    • Tina Tsou
    • Andy Wang
    • Gorka
    • Fede
    • Honnappa Nagarahalli
  • General
  • VPP Hoststack
    • memcpy optimization
      • memcpy patch verification on taishan by khem l3 forwarding usecase- Lijian Status(khem): No updates.
    • iperf3 performance with Hoststack.
      • ip4_local_inline quad loop under investigation Status(Sirshak): no updates.
      • svm_fifo: Status(Sirshak): Working on fixing VPP Path errors from svm_fifo patch.
      • Octeon-Tx Status(Sirshak): yet to try steps from gorka for usb ubuntu rootfs installation.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • CSIT
    • VPP Performance Test
    • Package Installation error Status(Juraj): interfaces configured numa node 2,3 are not visible.
    • Estimates from Khem and Stan/Juraj. Status: https://gerrit.fd.io/r/#/c/16850/
      • a. Host Config
      • b. merging CSIT patch.
      • c. creating a job.
    • Target: master trending job
    • VPP Path
    • VPP Device
      • thunderx Status: 1-node topology was rewired because of QSFP+ switch.
      • mcbin: Kernel Migration on mcbin. Status: was able to update uboot but not boot the new kernel. Jialin suggested different boot parameters, juraj yet to try.
      • thunderx2: Status: Talk to edk about deployment strategy with 1-node.
  • FD.io lab
    • ThunderX1
      • QSFP+ switch for ThunderX1 Status: ONL OS to be installed on QSFP+ switch.
      • Juraj setup call with LF people. Status: Done.
    • ThunderX2
      • Cables: Sent. Juraj to open another tkt for wiring the ThunderX2.
  • VPP
    • Buffer Pools per NUMA
    • Verify effects and make NEON changes Jira: https://jira.fd.io/browse/VPP-1560
    • 1GB page taking long time Status: fixed.
    • Vectorization
      • ethernet-input
      • buffer pools
      • memcpy
    • 128B cache line size
    • Qualcomm no change iperf3
    • thunderx2 crashing
    • Taishan/A72 Status: Khem to try 128B cache line on taishan (performance difference).
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • Action Items - Next Week

02/05/2019

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Stanislav Chlebec
    • Khemendra Kumar
    • Tina Tsou
    • Andy Wang
    • Gorka
    • Fede
    • Honnappa Nagarahalli
  • General
  • VPP Hoststack
    • memcpy optimization
      • Check optimized memory copy version are deployed on Taishan and ThunderX2 during runtime - Lijian
      • Send memcpy patch to Khem and Fede for further verification - Lijian Status: fede: small improvement in mcbin with iperf3, khem to try them with l3 forwarding
    • iperf3 performance with Hoststack.
      • ip4_local_inline quad loop under investigation
      • Working on svm_fifo alternate version with front and back pointers synchronized instead of cursize.
    • Verifying per NUMA node buffer pool https://gerrit.fd.io/r/#/c/16638/
      • sirshak create jira id in fd.io jira. https://jira.fd.io/browse/VPP-1560
      • Hanging of VPP is actually VPP taking a lot of time to allocate 400K chunks for 1GB - Damjan has this in his todo list
      • gcc-8 compilation still fails on ARM.
      • Octeon-Tx failure. Status: unknown
    • Gorka is trying some optimal configs for VCL. Status: no updates.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
    • OcteonTx boots to buildroot with no dhclient hence an impasse. Still not clear how to use USB stick.
  • CSIT
    • VPP Path
    • VPP Device
      • thunderx: 1-node topology on cavium thunderx. Status: no updates.
      • Kernel Migration on mcbin. Status:
      • ThunderX2:
    • VPP Performance Test
      • Stan and Khem to come up with a summary of current status and an estimate of at least upstreaming basic L2/L3 performance suites.
      • Juraj to come up with a solution for NUMA node anamoly in Taishan.
      • https://gerrit.fd.io/r/#/c/16850/ Status: Juraj has a version all ready to work. Package installation blocker.
      • Package installation error Status: Juraj to investigate logs.
  • FD.io lab
    • ThunderX1 -
      • New QSFP+ switch for ThunderX1 is available now: QSFP+ to be connected SFP+ switch.
      • Juraj to setup a call with LF folks on.
    • ThunderX2 -
      • Andy still waiting cables.
      • Juraj to remind Andy of when the cable will be available.
      • Juraj to follow up on ssh connectivity to thunderx2.
  • VPP
    • Vectorization
      • [Lijian] Macro benchmarking on ThunderX2/Centriq(4%)/Taishan D05(10%) is done, data is updated into Jira. Code is in internal review.
      • [Lijian] Check if setting default cache line size to 128 will degradate thru-put on Taishan/Qualcomm/ThunderX2
        • no perf diff in Qualcomm
        • vpp crashes on thunderx2
        • waiting for results on A72 (Taishan)
      • [Sirshak] on ethernet-input node, investigate vectorized buffer index, Damjan's per numa node buffer pool patch. Status: No updates
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • Action Items - Next Week

01/29/2019

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Lijian Zhang
    • Stanislav Chlebec
    • Khemendra Kumar
    • Tina Tsou
    • Andy Wang
    • Garcia
    • Manuel
    • Gorka
    • Fede
    • Honnappa Nagarahalli
    • John Ddigilio
  • General
  • VPP Hoststack
    • TaiShan Server with Debian distro crashed with command of 'ip probe-neighbor' when doing VPP hoststack with iperf3
    • With 64 bytes packets, on ThunderX2, 10G NIC, VPP hoststack bandwidth is about 1/2 of Linux Kernel stack.
    • With 64 bytes packets, on Taishan, 10G NIC, VPP hoststack bandwidth is about 2x of Linux Kernel stack.
    • Memory copy patch gives 4% improvement on VPP hoststack on Taishan server.
    • Check optimized memory copy version are deployed on Taishan and ThunderX2 during runtime - Lijian
    • Send memcopy patch to Khem and Fede for further verification - Lijian
    • iperf3 performance with Hoststack.
      • Investigating lock-less fifo, ip4_local_forward node and memory reordering for VPP hoststack - Sirshak
    • Sirshak is trying to set up one fd.io setup for everyone debugging VPP hoststack.
    • Verifying https://gerrit.fd.io/r/#/c/16638/ - Suppose to give better performance, but VPP hang with this patch on some Arm machines.
    • Gorka is trying some optimal configs for VCL. - No Updates.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
    • OcteonTX is received in ARM lab. Will boot it up firstly and then start doing profiling with it.
  • FD.io lab
    • ThunderX1 -
      • New Arista switch for ThunderX1 is available now. Gathering details that required by LF lab before sending the switch to CSIT lab. - Juraj - Andy will try to send the switch to CSIT this Thursday.
    • ThunderX2 -
      • Cable type is confirmed. Procurement is in the process.
      • Juraj to remind Andy of when the cable will be available.
      • Require access to these servers in FD.io lab. Anton gives the IP to access them.(ADMIN/ADMIN)
  • CSIT
    • VPP Path
      • So far so good.
      • ARM CI results are overwritten by x86 machines. Should be a Jenkin issue. Monitor if this corner will happen again. - Juraj
    • VPP Device
      • thunderx: 1-node topology on cavium thunderx. Basic skeleton of docker topology done. Moving on to deploying the scripts. Juraj is able to modify, execute the scripts in Container. Things to fix is scripts for 1-link 1-node topology and interfaces binding to VPP. Is able to run successfully a traffic test.
      • Kernel Migration on mcbin. Juraj is able to build all the images, but got kernel panic. Try with the more recent uBoot version. Tried latest uBoot image, but still has the same issue.
      • Juraj to investigate further work once ThunderX2 is available.
    • VPP Performance Test
  • VPP
    • Vectorization
      • [Lijian] Macro benchmarking on ThunderX2/Centriq(4%)/Taishan D05(10%) is done, data is updated into Jira. Code is in internal review.
      • [Lijian] Check if setting default cache line size to 128 will degradate thru-put on Taishan/Qualcomm/ThunderX2
      • [Sirshak] on ethernet-input node, investigate vectorized buffer index.
    • Memory Ordering
      • [Sirshak] svm_fifo lockless alternate algorithm for SPSC. - In internal review.
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. - Bootstrap script common.sh working and checking the test cases.
    • [Juraj] IP4 reassembly and GBP failures are fixed. Patches to enable them two are merged. No any test cases in blacklist for Aarch64 machine.
    • [Juraj] Kernel Migration on mcbin. Juraj is able to build all the images.
  • Action Items - Next Week
    • [Sirshak] -

01/22/2019

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Lijian Zhang
    • Stanislav Chlebec
    • Khemendra Kumar
    • Tina Tsou
    • Andy Wang
    • Garcia
    • Manuel
    • Gorka
    • Fede
    • Honnappa Nagarahalli
    • John Ddigilio
  • General
  • VPP Hoststack
    • TaiShan Server with Debian distro crashed with command of 'ip probe-neighbor' when doing VPP hoststack with iperf3
    • With 64 bytes packets, on ThunderX2, 10G NIC, VPP hoststack bandwidth is about 1/4 of Linux Kernel stack.
    • iperf3 performance with Hoststack.
      • Investigating lock-less fifo, ip4_local_forward node and memory reordering for VPP hoststack - Sirshak
    • Sirshak is trying to set up one fd.io setup for everyone debugging VPP hoststack.
    • Gorka is trying some optimal configs for VCL. - No Updates.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
    • OcteonTX is received in ARM lab. Will boot it up firstly and then start doing profiling with it.
  • FD.io lab
    • ThunderX1 -
      • New Arista switch for ThunderX1 is available now. Gathering details that required by LF lab before sending the switch to CSIT lab. - Juraj - Andy will try to send the switch to CSIT this Thursday.
    • ThunderX2 -
      • Cable type is confirmed. Procurement is in the process.
      • Require access to these servers in FD.io lab.
  • CSIT
    • VPP Path
      • So far so good.
      • ARM CI results are overwritten by x86 machines. Should be a Jenkin issue. Monitor if this corner will happen again. - Juraj
    • VPP Device
      • thunderx: 1-node topology on cavium thunderx. Basic skeleton of docker topology done. Moving on to deploying the scripts. Juraj is able to modify, execute the scripts in Container. Things to fix is scripts for 1-link 1-node topology and interfaces binding to VPP.
      • Kernel Migration on mcbin. Juraj is able to build all the images, but got kernel panic. Try with the more recent uBoot version.
      • Juraj to investigate further work once ThunderX2 is available.
    • VPP Performance Test
      • Working ongoing on writing scripts for Performance Jobs.
      • Development of L2 test script is under-going now.
      • Khem will get L2 work in CI firstly, and then IP4, and other test cases.
      • Stan starts to work on performance scripts with Khem. Is able to connect Taishan machines in CSIT lab.
      • The performance topology in wiki link is to update per below file.
      • https://github.com/FDio/csit/blob/master/docs/lab/Testbeds_Xeon_Skx_Arm_Atom.md
      • Stan and Khem to come up with a summary of current status and an estimate of at least upstreaming basic L2/L3 performance suites.
        • Install Ubuntu-18.04 on Huawei Taishan servers firstly, and then investigate upstreaming performance test framework to enable Aarch64
        • Lijian to verify Ubuntu-18.04 on Taishan server.
      • Stan installed latest CSIT scripts on packet generator server(x86 NEON) and Tainshan servers in FD.io lab.
      • https://gerrit.fd.io/r/#/c/16850/
      • Some of L2 and L3 test cases passed.
  • VPP
    • Vectorization
      • [Lijian] Macro benchmarking on ThunderX2/Centriq(4%)/Taishan D05(10%) is done, data is updated into Jira. Code is in internal review.
      • [Sirshak] on ethernet-input node, investigate vectorized buffer index.
    • Memory Ordering
      • [Sirshak] svm_fifo lockless alternate algorithm for SPSC. - In internal review.
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. - Bootstrap script common.sh working and checking the test cases.
    • [Juraj] IP4 reassembly and GBP failures are fixed. Patches to enable them two are merged. No any test cases in blacklist for Aarch64 machine.
    • [Juraj] Kernel Migration on mcbin. Juraj is able to build all the images.
  • Action Items - Next Week
    • [Sirshak] - To update patch list in VPP/Aarch64 wiki

01/15/2019

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Lijian Zhang
    • Stanislav Chlebec
    • Khemendra Kumar
    • Tina Tsou
    • Andy Wang
    • Garcia
    • Manuel
    • Gorka
    • Fede
    • Honnappa Nagarahalli
    • John Ddigilio
  • General
  • VPP Hoststack
    • iperf3 performance with Hoststack.
      • Investigating lock-less fifo and memory reordering for VPP hoststack - Sirshak
    • Sirshak is trying to set up one fd.io setup for everyone debugging VPP hoststack.
    • Gorka is trying some optimal configs for VCL. - No Updates.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
    • OcteonTX is received in ARM lab. Will boot it up firstly and then start doing profiling with it.
  • FD.io lab
    • ThunderX2 -
      • New Arista switch is available now. Gathering details that required by LF lab before sending the switch to CSIT lab. - Juraj
      • Cable type is confirmed. Procurement is in the process.
  • CSIT
    • VPP Path
      • IP4 reassembly and GBP failures are fixed. Patches to enable them two are merged. No any test cases in blacklist for Aarch64 machine.
      • We have voting verify on bionic. Upload nexus disabled but merge job working. - Juraj created LF ticket for nexus upload. Both master merge job and verifying job are working fine.
      • ARM CI results are overwritten by x86 machines. Should be a Jenkin issue. Monitor if this corner will happen again. - Juraj
    • VPP Device
      • thunderx: 1-node topology on cavium thunderx. Basic skeleton of docker topology done. Moving on to deploying the scripts.
      • Kernel Migration on mcbin. Juraj is able to build all the images.
    • VPP Performance Test
      • Working ongoing on writing scripts for Performance Jobs.
      • Development of L2 test script is under-going now.
      • Khem will get L2 work in CI firstly, and then IP4, and other test cases.
      • Stan starts to work on performance scripts with Khem. Is able to connect Taishan machines in CSIT lab.
      • The performance topology in wiki link is to update per below file.
      • https://github.com/FDio/csit/blob/master/docs/lab/Testbeds_Xeon_Skx_Arm_Atom.md
      • Stan and Khem to come up with a summary of current status and an estimate of at least upstreaming basic L2/L3 performance suites.
  • VPP
    • Vectorization
      • [Lijian] Macro benchmarking on ThunderX2/Centriq(4%)/Taishan D05(10%) is done, data is updated into Jira. Code is in internal review.
    • Memory Ordering
      • [Sirshak] svm_fifo lockless alternate algorithm for SPSC. - In internal review.
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. - Bootstrap script common.sh working and checking the test cases.
    • [Juraj] IP4 reassembly and GBP failures are fixed. Patches to enable them two are merged. No any test cases in blacklist for Aarch64 machine.
    • [Juraj] Kernel Migration on mcbin. Juraj is able to build all the images.
  • Action Items - Next Week
    • [Sirshak] - To update patch list in VPP/Aarch64 wiki

01/08/2019

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Lijian Zhang
    • Stanislav Chlebec
    • Khemendra Kumar
  • General
  • VPP Hoststack
    • iperf3 performance with Hoststack.
      • Investigating lock-less fifo and memory reordering for VPP hoststack - Sirshak
    • Sirshak is trying to set up one fd.io setup for everyone debugging VPP hoststack.
    • Gorka is trying some optimal configs for VCL. - No Updates.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. - Bootstrap script common.sh working and checking the test cases.
    • [Lijian] Working on IP4 reassembly and GBP failures. - fixed. Juraj has upstreamed patched to enable these two tests.
    • [Sirshak] Kernel Migration mcbin. Juraj is working on based on Jianlin's suggestion.
    • [Andy] Getting a new Arista switch next year.
  • VPP
    • Vectorization
      • [Lijian] working on vectorized memory copy - Macro benchmarking is done and data is updated to Jira.
    • Memory Ordering
      • [Sirshak] svm_fifo lockless alternate algorithm for SPSC. - In internal review.
  • CSIT
    • VPP Path
  • VPP Path Failures
      • We have voting verify on bionic. Upload nexus disabled but merge job working. - Juraj created LF ticket for nexus upload. Both merge job and verifying job are working fine.
    • VPP Device
      • thunderx: 1-node topology on cavium thunderx. Basic skeleton of docker topology done. Moving on to deploying the scripts.
      • thunderx2: Juraj working with LF to get this resolved.
      • mcbin: Juraj can contact Jianlin if needed.
    • VPP Performance Test
      • Working ongoing on writing scripts for Performance Jobs.
      • Development of L2 test script is under-going now.
      • Khem will get L2 work in CI firstly, and then IP4, and other test cases.
      • Stan is starting working on VPP performance test. Khem to send email to Stan on VPP performance testing stuff.
  • FD.io lab
    • New Arista switch to be proccured next year.
    • ThunderX2 - Racked. Andy is trying to buy cables compatible to Intel XL710. Juraj to confirm info required by lab people before sending out the cables.
  • Action Items - Next Week

12/18/2018

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Tina Tsou
    • Stanislav Chlebec
    • Avinash
    • Khemendra
  • General
  • VPP Hoststack
    • iperf3 performance with Hoststack.
      • Investigating lock-less fifo and memory reordering for VPP hoststack - Sirshak
    • Sirshak is trying to set up one fd.io setup for everyone debugging VPP hoststack.
    • Gorka is trying some optimal configs for VCL. - No Updates.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. - Bootstrap script common.sh working.
    • [Lijian] Working on IP4 reassembly and GBP failures. - Some preliminary on gbp waiting Neale. Juraj to give access to Lijian to investigate on ThunderX.
    • [Sirshak] Kernel Migration mcbin. Status: Jianlin to work with Juraj to get fd.io mcbins up and running. Sirshak to setup a meeting.
    • [Andy] Getting a new Arista switch next year.
  • VPP
    • Vectorization
      • [Lijian] working on vectorized memory copy - Still benchmarking and setting it up for internal review.
      • [Lijian] Patch for compiling issue with GCC-8.x is under community review. Status: No updtaes.
      • [Lijian] Patch for fixing StringTest failure is under community review. Status: Abandoned.
      • [Lijian] Patch for CDP failure is under community review. Status: No updates.
    • Memory Ordering
      • [Sirshak] svm_fifo lockless alternate algorithm for SPSC.
  • CSIT
    • VPP Path
  • VPP Path Failures
    • https://jira.fd.io/browse/VPP-1475 - IP4 random reassembly failure in master, also seen on x86
    • https://jira.fd.io/browse/VPP-1491 - GBP L3/L2 Endpoint Learning failure
      • We have voting verify on bionic. Upload nexus disabled but merge job working. Juraj to create LF ticket for nexus upload.
    • VPP Device
      • thunderx: 1-node topology on cavium thunderx. Basic skeleton of docker topology done. Moving on to deploying the scripts.
      • thunderx2: Sirshak working with LF to get this resolved.
      • mcbin: Sirshak to setup a meeting between Juraj and Jianlin.
    • VPP Performance Test
      • Working ongoing on writing scripts for Performance Jobs.
      • Development of L2 test script is under-going now.
      • Khem will get L2 work in CI firstly, and then IP4, and other test cases.
  • FD.io lab
    • New Arista switch to be proccured next year.
    • ThunderX2 - Racked. IPMI Static IP configuration missing. Sirshak with LF.
  • Action Items - Next Week

12/11/2018

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Tina Tsou
    • Stanislav Chlebec
  • VPP Hoststack
    • iperf3 performance with Hoststack. - Sirshak has done some preliminary bench-marking, and compare kernel and VPP hoststack performance. Three case: kernel to kernel; kernel to VPP hoststack; VPP hoststack to VPP hoststack
    • ongoing perf analysis. One patch(https://gerrit.fd.io/r/#/c/16184/) is merged, and the other one is under internal review.
    • Investigating lock-less fifo and memory reordering for VPP hoststack - Sirshak
    • Sirshak is trying to set up one CSIT setup for everyone debugging VPP hoststack. Will share setup info
    • Gorka is trying some optimal configs for VCL.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. Two scripts of L2 performance suites for CI management repository are done, investigating on for CSIT repository, and three more scripts to be developed.
    • [Lijian] Working on IP4 reassembly and GBP failures
    • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan. - no progress so far. - To confirm with Jianling and Joyce.
  • VPP
    • Vectorization
      • [Lijian] working on vectorized memory copy - Second priority, no update so far.
      • [Lijian] Patch for compiling issue with GCC-8.x is under community review.
      • [Lijian] Patch for fixing StringTest failure is under community review.
      • [Lijian] Patch for CDP failure is under community review.
    • Memory Ordering
      • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
  • VPP Path failures
  • CSIT
    • VPP Path
      • Actually, everything is ready. The only thing is to get CI patch merged.
    • VPP Device
      • thunderx: 1-node topology on cavium thunderx is in place, but there are errors. Will continue investigation.
      • thunderx2: Racked. Lack of static IP. Sirshak gave a work-around to fix lacking of static IP to Anton.
      • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan. To confirm with Jianling and Joyce - Lijian
    • VPP Performance Test
      • Working ongoing on writing scripts for Performance Jobs.
      • Development of L2 test script is under-going now. Khem will get L2 work in CI firstly, and then IP4, and other test cases.
  • FD.io lab
    • Arista switch is still not working. Andy and Anton are working on the exact requirement for the switch, and two possible option: Andy to replace the Arista or buy a new one.
    • ThunderX2 - Racked. Lack of IP.
  • Action Items - Next Week
    • [Lijian] to continue to investigate make test failures.
    • [Andy] to work with Anton to resolve Arista problem.

12/04/2018

  • Attendees
    • Sirshak Das
    • Andy Wang
    • Juraj Linkeš
    • Khemendra
    • Garcia
    • Manuel
    • Gorka
    • Fede
    • Tina Tsou
  • VPP Hoststack
    • iperf3 performance with Hoststack. - Sirshak has done some preliminary bench-marking, and compare kernel and VPP hoststack performance. Three case: kernel to kernel; kernel to VPP hoststack; VPP hoststack to VPP hoststack
    • ongoing perf analysis. Two patches ongoing. One is upstreamed and the other is under internal review. Hotpots on memory copy or maybe other stuff.
    • Sirshak is trying to set up one CSIT setup for everyone debugging VPP hoststack. Will share setup info
    • Gorka is trying some optimal configs for VCL.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. Two scripts of L2 performance suites for CI management repository are done, investigating on for CSIT repository, and three more scripts to be developed.
    • [Lijian] VPP dlmalloc crash issue root-caused and fixed by maintainer. Florin Coras fixed time-out issues.
    • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan. - no progress so far. - To confirm with Jianling and Joyce.
  • VPP
    • Vectorization
      • [Lijian] working on vectorized memory copy - Second priority, no update so far.
      • [Lijian] Patch for compiling issue with GCC-8.x is under internal review.
      • [Lijian] Patch for fixing StringTest failure is under internal review.
    • Memory Ordering
      • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
  • CSIT
    • VPP Path
    • VPP Device
      • thunderx: 1-node topology on cavium thunderx is in place, but there are errors. Will continue investigation.
      • thunderx2: Racked. Lack of IP. To confirm with Anton.
      • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan. To confirm with Jianling and Joyce - Lijian
    • VPP Performance Test
      • Working ongoing on writing scripts for Performance Jobs.
      • Development of L2 test script is under-going now. Khem will get L2 work in CI firstly, and then IP4, and other test cases.
  • FD.io lab
    • Arista switch is still not working. Andy and Anton are working on the exact requirement for the switch, and two possible option: Andy to replace the Arista or buy a new one.
    • ThunderX2 - Racked. Lack of IP.
  • Action Items - Next Week
    • [Lijian] to continue to investigate make test failures.
    • [Andy] to work with Anton to resolve Arista problem.


11/27/2018

  • Attendees
    • Juraj Linkeš
    • Khemendra
    • Garcia
    • Manuel
    • Gorka
    • Fede
    • Tina Tsou
  • VPP Hoststack
    • iperf3 performance with Hoststack. - Sirshak has done some preliminary bench-marking, and compare kernel and VPP hoststack performance.
    • ongoing perf analysis, two patches ongoing. Hotpots on memory copy or maybe other stuff. Will share patches with community.- Sirshak
    • Sirshak is trying to set up one CSIT setup for everyone debugging VPP hoststack. Will share setup info
    • Gorka is trying some optimal configs for VCL.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
    • Alternate test cases.
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. Status: Working with Juraj to get scripts ready for jobs. - Need to prepare some scripts. First to understand how the script works and then add more options.
    • [Lijian] Status on VPP path failures. Status: Still debugging. Still at early study stage.
    • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan. - no progress so far.
  • VPP
    • Vectorization
      • [Lijian] working on vectorized memory copy
    • Memory Ordering
      • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
  • CSIT
    • VPP Path
      • 3 failures currently stalling deployment.
      • VPP-1476, VPP-1475, VPP-1478
      • These failures are seen on Debian x86 VM also.
      • Parallelization(n=32) is resulting in failures. Seems also be caused by below two patches.
      • VPP-1490, caused by https://gerrit.fd.io/r/#/c/15106/ and https://gerrit.fd.io/r/#/c/15534/.
      • VPP-1491, VPP-1497 about parallazation and GBP failure are filed.
      • Get CSIT/Aarch64 pass with partial test cases - Juraj
    • VPP Device
      • thunderx: Juraj created a LF tkt for wiring the 1-node topology on cavium thunderx.
      • thunderx2: to be racked by this Friday.
      • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan.
    • VPP Performance Test
      • Working ongoing on writing scripts for Performance Jobs.
      • L2 test is working now manually. Khem is trying to get it work in CI, and then IP4, and other test cases.
  • FD.io lab
    • Arista switch is missing cable. Andy will send tracking no. for cables.
    • ThunderX2 - to be racked by this Friday.
  • Action Items - Next Week
    • [Lijian] to investigate VPP-1490 issue.
    • [Andy] Andy will send tracking no. for cables.

11/20/2018

  • Attendees
    • Sirshak Das
    • Andy Wang
    • Juraj Linkeš
    • Khemendra
    • Garcia
    • Manuel
    • Gorka
    • Fede
    • Tina Tsou
  • VPP Hoststack
    • iperf3 performance with Hoststack. - Sirshak has done some preliminary bench-marking, and compare kernel and VPP hoststack performance.
    • ongoing perf analysis, two patches ongoing. Hotpots on memory copy or maybe other stuff. Will share patches with community.- Sirshak
    • Sirshak is trying to set up one CSIT setup for everyone debugging VPP hoststack. Will share setup info
    • Gorka is trying some optimal configs for VCL.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
    • Alternate test cases.
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. Status: Working with Juraj to get scripts ready for jobs. - Need to prepare some scripts. First to understand how the script works and then add more options.
    • [Lijian] Status on VPP path failures. Status: Still debugging. Still at early study stage.
    • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan. - no progress so far.
  • VPP
    • Vectorization
      • [Lijian] working on vectorized memory copy
    • Memory Ordering
      • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
  • CSIT
    • VPP Path
      • 3 failures currently stalling deployment.
      • VPP-1476, VPP-1475, VPP-1478
      • These failures are seen on Debian x86 VM also.
      • Parallelization(n=32) is resulting in failures. Seems also be caused by below two patches.
      • VPP-1490, caused by https://gerrit.fd.io/r/#/c/15106/ and https://gerrit.fd.io/r/#/c/15534/.
      • VPP-1491, VPP-1497 about parallazation and GBP failure are filed.
      • Get CSIT/Aarch64 pass with partial test cases - Juraj
    • VPP Device
      • thunderx: Juraj created a LF tkt for wiring the 1-node topology on cavium thunderx.
      • thunderx2: to be racked by this Friday.
      • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan.
    • VPP Performance Test
      • Working ongoing on writing scripts for Performance Jobs.
      • L2 test is working now manually. Khem is trying to get it work in CI, and then IP4, and other test cases.
  • FD.io lab
    • Arista switch is missing cable. Andy will send tracking no. for cables.
    • ThunderX2 - to be racked by this Friday.
  • Action Items - Next Week
    • [Lijian] to investigate VPP-1490 issue.
    • [Andy] Andy will send tracking no. for cables.


11/12/2018

  • Attendees
    • Sirshak Das
    • Andy Wang
    • Juraj Linkeš
    • Khemendra
    • Garcia
    • Gorka
  • VPP Hoststack
    • iperf3 performance with Hoststack. - Sirshak has done some preliminary bench-marking, and compare kernel and VPP hoststack performance.
    • ongoing perf analysis, two patches ongoing. Hotpots on memory copy or maybe other stuff. - Sirshak
    • Sirshak is trying to set up one CSIT setup for everyone debugging VPP hoststack. Will share setup info
    • Gorka is trying some optimal configs for VCL.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
    • Alternate test cases.
    • khem to get more information on benchmarking DMM. Khem to send the information to community if there's more.
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. Status: Working with Juraj to get scripts ready for jobs. - Need to prepare some scripts. First to understand how the script works and then add more options.
    • [Lijian] Status on VPP path failures. Status: Still debugging. Still at early study stage.
    • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan. - no progress so far.
    • [Andy] has sent out on Nov 12th. Juraj has sent the info to LF.
  • VPP
    • Vectorization
      • [Lijian] Zero byte mask NEON implementation. - Merged.
      • [Lijian] ip4 lookup buffer index to buffer pointer optimizations. - Both micro and macro prove it not worth implementing vectorization here.
      • [Lijian] working on vectorized memory copy - Khem to send the vectorized memory copy done previously.
    • Memory Ordering
      • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
  • CSIT
    • VPP Path
    • VPP Device
      • thunderx: Juraj created a LF tkt for wiring the 1-node topology on cavium thunderx.
      • thunderx2: no updates. Anton is figuring out where/how to put these servers.
      • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan.
    • VPP Performance Test
      • Working ongoing on writing scripts for Performance Jobs.
      • L2 test is working now manually. Khem is trying to get it work in CI, and then IP4, and other test cases.
  • FD.io lab
    • Arista switch and power supply. Setup was sent out and tracking no. info was sent to LF.
    • ThunderX2 - No updates.
  • Action Items - Next Week
    • [Lijian] to investigate VPP-1490 issue.


11/06/2018

  • Attendees
    • Sirshak Das
    • Honnappa
    • Tina Tsou
    • Andy Wang
    • Khemendra
    • Garcia
    • Manuel
    • Fede
  • VPP Hoststack
    • iperf3 perfomance with Hoststack.
    • VPP on both sides(iperf3 server and client) give a boost.(Reason unknown).
    • Alternate test cases.
    • khem to get more information on benchmarking DMM.
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite. Status: Working with Juraj to get scripts ready for jobs.
    • [Lijian] Status on VPP path failures. Status: Still debugging.
    • [Sirshak] Kernel Migration mcbin. Status: Sirshak to try inputs from garcia and damjan.
    • [Andy] to send tracking no for Arista power supply. Status: PO is still being worked on internally.
  • VPP
    • Vectorization
      • [Lijian] msb patch. - merged
      • [Lijian] Zero byte mask NEON implementation. - internal review completed to up-streamed soon.
      • [Lijian] ip4 lookup buffer index to buffer pointer optimizations. - internal investigations ongoing.
    • Memory Ordering
      • [Sirshak] atomic exchange acquire and release macro patch.- Merged.
      • [Sirshak] To start work on Arithmetic and Logic relaxed functions.
  • CSIT
    • VPP Path
      • 3 failures currently stalling deployment.
      • VPP-1476, VPP-1475, VPP-1478
      • These failures are seen on Debian x86 VM also.
      • Parallelization(n=32) is resulting in failures.
    • VPP Device
      • thunderx: Juraj created a LF tkt for wiring the 1-node topology on cavium thunderx.
      • thunderx2: no updates.
      • mcbin: Kernel issue yet to try suggestion from Garcia and Damjan.
    • VPP Performance Test
      • Working ongoing on writing scripts for Performance Jobs.
  • FD.io lab
    • Arista switch power supply and rack rails. Status: being worked internally
    • ThunderX2 - No updates.
  • Action Items - Next Week

10/30/2018

  • Attendees
    • Sirshak Das
    • Honnappa
    • Lijian Zhang
    • Tina Tsou
    • Andy Wang
    • Khemendra
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] To start with deployment of only L2 CSIT performance suite. - Discussed in CSIT meeting.
    • [Khem] to send the ip4 failure logs csit-dev, vpp-dev. - Sent csit-dev and vpp-dev.
    • [Juraj] Anton to install NICs. Juraj has sent the instructions. - Sent
  • VPP
    • Vectorization
      • [Lijian] Internal review going on msb patch.
      • [Lijian] Zero byte mask neon function not consistent with x86. Working optimizing it.
      • [Lijian] ip4 lookup buffer index to buffer pointer optimization. - Still investigating.
    • Memory Ordering:
      • [Sirshak] Internal review going on atomic exchange acquire and release macro patch.
  • CSIT
    • VPP Path
    • VPP Device
      • Waiting for NICs to be installed on ThunderX2.
      • mcbin : Linux Kernel not able to use the data ports. Needed for scapy. [Sirshak] to take a look
      • mcbin: New Kernel is not working.
    • Performance Test
      • Discussed in CSIT meeting
      • Researching on how to create jobs
      • More things to be discussed with CSIT meeting.
  • FD.io lab
    • Arista switch need additional hardware. - Andy to send tracking no.
    • ThunderX2 - Waiting on LF for NICs installing and rack installing in general.
  • Action Items - Next Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] Deployment of only L2 CSIT performance suite.
    • [Lijian] Status on VPP path failures.
    • [Sirshak] Kernel Migration mcbin.
    • [Andy] to send tracking no for Arista power supply.

10/23/2018

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Lijian Zhang
    • Tina Tsou
    • Andy Wang
    • Khemendra
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] VPP performance suite. L2XC, L2BD working. IPv4 failing.
    • [Juraj and Sirshak] We need to check RC2 after 17th of october. [khem] To send the test failure logs to vpp-dev.
  • VPP
    • Vectorization
      • [Lijian] Looking at shuffle and msb patches.
      • [Lijian] Sent the shuffle analysis to Nitin for feedback.
      • [Lijian] Preliminary analysis says we take more instructions hence the slow down. To reevaluate the algorithm itself.
    • Memory Ordering:
      • [Sirshak] Part 1 of the patch merged which now introduces macros. Working on part 2.
  • CSIT
    • VPP Path
      • To be deployed as a part of CI after 1810 release.
    • VPP Device
      • Waiting for NICs to be installed on ThunderX2.
      • mcbins working. Juraj to start work on getting one instance of the VPP device test running.
      • Docker working musdk working. Currently facing issues with the 1-node topology.
    • Performance Test
      • L2XC, L2BD working. IPv4 failing. [Khem] to send the failure logs csit-dev, vpp-dev.
      • [Khem] To start with deployment of only L2 performance suite.
  • FD.io lab
    • Arista switch need additional hardware. To be shipped in 2 weeks.
    • NICs and wires for ThunderX2 - Received. Anton to install NICs. Juraj has sent the instructions.
    • Power Cycler to be ordered by LF - Its available and working.
  • Documentation
    • Lijian's patch merged.
  • Action Items - Next Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] To start with deployment of only L2 performance suite.
    • [Khem] to send the failure logs csit-dev, vpp-dev.
    • [Juraj] Anton to install NICs. Juraj has sent the instructions.

10/16/2018

  • Attendees
    • Sirshak Das
    • Juraj Linkeš
    • Lijian Zhang
    • Tina Tsou
    • Andy Wang
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] to try VPP performance suite to see change after Vectorization and Loop unrolling patch.
    • Remaining issues in L2 and IPv4 - Sirshak to try debug. Status: With inputs from Neale issue fixed.
  • VPP
    • Vectorization
      • [Lijian] Studying about Vectorization and Memory ordering.
    • Memory Ordering:
      • [Sirshak] One patch up-streamed. Relaxed memory ordering patch being reviewed internally.
  • CSIT
    • VPP Path
      • Should be deployed on 25th Oct after 1810 release.
      • We need to check RC2 after 17th of october [Juraj and Sirshak].
    • VPP Device
      • Waiting for ThunderX2 NICs. Mcbin has issues with 2 VPP instances and traffic being sent.
    • Performance Test
      • No updates
  • FD.io lab
    • QSFP+ switch for Cavium blades. - Recieved
    • NICs and wires for ThunderX2 - Andy to confirm that the NICs have been sent. Juraj LF tkt to be opened.
    • Power Cycler to be ordered by LF - Its available and should be operational this week.
  • Documentation
    • Scott has reviewed the changes from Lijian he will merge it this week after few modifications of his own.
  • Action Items - Next Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] to try VPP performance suite to see change after Vectorization and Loop unrolling patch.
    • [Juraj and Sirshak] We need to check RC2 after 17th of october.

10/09/2018

  • Attendees
    • Sirshak Das
    • Maciek Konstantinowicz
    • Juraj Linkeš
    • Lijian Zhang
    • Tina Tsou
    • Andy Wang
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Juraj] to try musdk enabled kernel. - Juraj retried it worked.
    • [Khem] to try VPP performance suite - Diff in nos based on previous patches.
  • VPP
    • Vectorization
      • Do perf analysis of the compiled code i.e. compare code with buffer indices to buffer pointers code with and without in quad loop.
      • Lijian to rebase the patch and try a few experiments
      • Khem Updates: No updates.
      • Memory Ordering Patch reintroduced. Broken down into smaller patches and the first patch has been upstreamed, others will be phased in gradually.
  • CSIT
    • VPP Path
      • Set up publicly accessible Cavium machine for debugging purposes
      • 2 tkts resolved by Neale.
      • Remaining issues in L2 and IPv4 - Sirshak to try debug; Neale will look into it in spare cycles
    • VPP Device
      • SRIOV reservation system code exists and is being tested
    • Performance Test
      • NDR issue Status:
      • Issues in ip4. Status:
  • FD.io lab
    • QSFP+ switch for Cavium blades. - Has been shipped
    • NICs and wires for ThunderX2 - Wires have been shipped; NICs will be delayed
    • Power Cycler to be ordered by LF.
  • Documentation
    • Started upstreaming, no response yet
  • Action Items - Next Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] to try VPP performance suite to see change after Vectorization and Loop unrolling patch.
    • Remaining issues in L2 and IPv4 - Sirshak to try debug. Status: With inputs from Neale issue fixed.

10/02/2018

  • Attendees
    • Sirshak Das
    • Honnappa
    • Juraj Linkeš
    • Lijian Zhang
    • Khemendra
    • Tina Tsou
    • Andy Wang
    • Honnappa
  • Action Items - Last Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Khem] VPP-1391 - VPP 'make verify' failed on Huawei Taishan server: Similar failures to cavium setup.
    • [Sirshak] - mlnx patch merged.
    • [Sirshak] to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning. - Not needed.
    • [Juraj] to try musdk enabled kernel. - failing Sirshak to debug this.
    • [Lijian] to resolve upstream comments. - Patch merged up-streamed.
    • [Khem] to try VPP performance suite with Lijian's Patch. - No need can try with master now.
    • [Khem] To try to debug traffic flow form TG to DUT with current master. - No updates.
    • [Khem] To send current status. - Sent.
  • VPP
    • Vectorization
      • Understand Performance degradation.
        • msb correct version.
        • ip4_forward buffer index to buffer pointers.
    • Tuning dual/quad loop
      • Patch merged.
      • Khem Updates: No updates.
  • CSIT
    • VPP Path
      • 2 categories of failures primarily. 8 tkts opened.
    • VPP Device
      • shim layer to be leaner and most of the functionality will reside in jenkins-slave.
    • Performance Test
      • L2-basic(L2XC, L2BD) PDR, MDR passing. NDR has issues but debugged.
      • Issues in ip4.
  • FD.io lab
    • mcbin - Sirshak to help debug connectivity issues
    • QSFP+ switch for Cavium blades. - Andy working getting a refurbished one.
    • Power Cycler to be ordered by LF.
  • Documentation
  • Action Items - Next Week
    • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
    • [Juraj] to try musdk enabled kernel. - Juraj retried it worked.
    • [Khem] to try VPP performance suite - Diff in nos based on previous patches.

9/25/2018

  • Attendees
    • Sirshak Das
    • Honnappa
    • Juraj Linkeš
    • Lijian Zhang
    • Khemendra
    • Tina Tsou
    • Andy Wang
    • Honnappa
  • Action Items - Last Week
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
    • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. Khem to to measure verify and test timings.
    • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works. - Does not. Lijian suggested fix merged by damjan, Additional patch needed: under internal review.
    • [VPP performance Suite] shm issues seen sporadically. Not seeing currently.
    • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning. - Not done will do it this week.
    • Sirshak to send musdk instructions. - Done.
    • Juraj to try musdk enabled kernel and see if musdk and docker can coexist in the dirty kernel. - Trying them out.
  • VPP
    • Mellanox NIC not working with VPP
      • [Sirshak] glue library not detected by VPP. Compiling static has cmake issues. - Fix done pending internal review.
    • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. Khem to try things suggested by Juraj.
    • Vectorization
      • Understand Performance degradation.
        • msb correct version.
        • ip4_forward buffer index to buffer pointers.
    • Tuning dual/quad loop
      • Patch upstreamed pending review.
      • Lijian to resolve upstream comments.
      • Khem to try VPP performance suite with Lijian's Patch. (affects 1 route configuration more than 10k routes.)
  • CSIT
    • VPP Path
      • Current Test Cases Failure: 8
      • [Juraj] Mail sent regarding failures. Need community support regarding failures.
      • [Khem] To see if he can take up one test case failure and resolve it.
    • VPP Device
      • In case of 2 loopbacks we can use 2 physical devices.
      • Facing issues with console connection to mcbin.
    • Performance Test
      • [Khem] working on IPv4 testing failures with CSIT script. Will be starting on v4 suite. To debug at DPDK level and talk to VPP community.
      • [Khem] To try to debug traffic flow form TG to DUT with current master.
      • [Khem] To send current status.
  • FD.io lab
    • mcbin - trying new kernel images to resolve connectivity issues.
    • QSFP+ switch for Cavium blades. - Waiting for reply from Anton.
  • Documentation
    • Trevor to help with contiv documentation. - Trevor has made changes, Lijian has sent for comments.
  • Action Items - Next Week
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
    • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server.
    • Sirshak - mlnx patch merged.
    • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning. - Not needed.
    • Juraj to try musdk enabled kernel. - failing Sirshak to debug this.
    • Lijian to resolve upstream comments. - Patch merged up-streamed.
    • Khem to try VPP performance suite with Lijian's Patch.
    • [Khem] To try to debug traffic flow form TG to DUT with current master.
    • [Khem] To send current status.

9/18/2018

  • Attendees
    • Sirshak Das
    • Honnappa
    • Juraj Linkeš
    • Lijian Zhang
    • Tina Tsou
  • Action Items - Last Week
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
    • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server, and requires steps on reproducing the issue from Juraj.
    • Lijian to update dual/quad loop code review per comments. - Resolved.
    • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works. - It doesnt. Send him a reminder.
    • Juraj to investigate the compiler versions on fd.io lab machines. Upgrade to latest GCC-7.3.
    • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.
    • Honnappa to confirm the if we order NIC for ThunderX1, specify if they are external NICs.
    • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning.
    • Sirshak to send musdk instructions.
  • VPP
    • Mellanox NIC not working with VPP
      • [Sirshak] glue library not detected by VPP. Compiling static has cmake issues.
    • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - make build-release and make test work. Khem to see if make verify is still failing.
    • Vectorization
      • [Sirshak] Patches submitted. Patch widening the usage has performance issues.
    • Tuning dual/quad loop
      • [Lijian] 3%- throughput improvement (mcbin).
      • Include mcbin nos in commit message.
    • [Khem] working on IPv4 testing failures with CSIT script
  • CSIT
    • CSIT-1139 - parallelize 'make verify'
      • make verify - working. Test Failure still there
      • Juraj investigating FAILED test cases in make verify.
    • CSIT VPP Device updates
      • juraj to try musdk enabled kernel and see if musdk and docker can coexist in the dirty kernel.
    • CSIT Performance Test Suite Updates
  • FD.io lab
    • mcbin issue
    • QSFP+ ports for Cavium blades.
  • Documentation
    • Trevor to help with contiv documentation.
  • Action Items - Next Week
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
    • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server, and requires steps on reproducing the issue from Juraj.
    • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works. -
    • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.
    • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning.
    • Sirshak to send musdk instructions.
    • Juraj to try musdk enabled kernel and see if musdk and docker can coexist in the dirty kernel.

9/11/2018

  • Attendees
    • Honnappa Nagarahalli
    • Juraj Linkeš
    • Sirshak Das
    • Lijian Zhang
    • Tina Tsou
    • Khemendra Kumar
  • Action Items - Last Week
    • Khem and Sachin to verify Sirshak's vectorization patches. - Ongoing(Khem)
    • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test. - Continue investigation on this issue.
      • [Juraj] sends his steps to Khem to reproduce this issue.
    • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.- Code review internally
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
    • Juraj to investigate the compiler versions on fd.io lab machines. - No update
    • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev. - Not reproducible so far, will keep observing.
  • VPP
    • Mellanox NIC not working with VPP caused by libmnl.so missing in cmake
      • [Sirshak]
    • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - make build-release and make test work. Khem to see if make verify is still failing.
    • Vectorization
      • [Sirshak] Patches ready and sent for review. Need arm community feedback on performance implications.
      • [Khem/Nitin] verify how those patches effect
    • Tuning dual/quad loop
      • [Lijian] Dual/Quad loop code change is under internal review. Sirshak gives some comments, and Lijian will update diff accordingly.
    • [Khem] working on IPv4 testing failures with CSIT script
  • CSIT
    • CSIT-1139 - parallelize 'make verify'
      • Parallazation is stable and working fine. We might see feature improvement requirement or new bugs.
      • No new requirement so far.
    • CSIT VPP Device updates
      • Two tickets on VPP FD.io done. Have to verify to make sure they are working.
      • x86 has improvement and some experiments are done. Juraj will try those experiments on ARM platforms.
    • CSIT Performance Test Suite Updates
      • Facing issues with ip4 forwarding test case.
      • shm issues seen sporadically. Khem to send an email to vpp-dev.
  • FD.io lab
    • 3 LF tkts - 1 Node Topology wiring mcbin, 3-node topology wiring Mcbin, 1-node Topology wiring Cavium. - Finished
  • Documentation
    • Sirshak to take a look.
  • Action Items - Next Week
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
    • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server, and requires steps on reproducing the issue from Juraj.
    • Lijian to update dual/quad loop code review per comments
    • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works
    • Juraj to investigate the compiler versions on fd.io lab machines. Upgrade to latest GCC-8.2.0
    • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.
    • Honnappa to confirm the if we order NIC for ThunderX1, specify if they are external NICs

9/4/2018

  • Attendees
    • Sirshak Das
    • Lijian Zhang
    • Tina Tsou
    • Khemendra Kumar
  • Action Items - Last Week
    • Lijian to try merging it upstream - Mellanox Changes. - Resolved.
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin. - No updates.
    • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test.
    • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.- Discuss Internally.
    • Juraj to investigate the compiler versions on fd.io lab machines. - No updates.
  • VPP
    • VPP-1339 - Mellanox NIC not working with VPP. - Resolved
    • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - make build-release and make test work. Khem to see if make verify is still failing.
    • Vectorization
      • [Sirshak] Patches ready and sent for review. Need arm community feedback on performance implications.
    • Tuning dual/quad loop
      • [Lijian/Brian] Investigate dynamic function selection. Brian to looking at this.
  • CSIT
    • CSIT-1139 - parallelize 'make verify'
      • No updates
    • CSIT VPP Device updates
      • No updates
    • CSIT Performance Test Suite Updates
      • Facing issues with ip4 forwarding test case.
      • shm issues seen sporadically. Khem to send an email to vpp-dev.
  • FD.io lab
    • 3 LF tkts - 1 Node Topology wiring mcbin, 3-node topology wiring Mcbin, 1-node Topology wiring Cavium.
  • Documentation
    • Sirshak to take a look.
  • Action Items - Next Week
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
    • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server.
    • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.
    • Juraj to investigate the compiler versions on fd.io lab machines.
    • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.

8/28/2018

  • Attendees
    • Sirshak Das
    • Sachin Saxena
    • Juraj Linkes
    • Lijian Zhang
    • Tina Tsou
    • Khemendra Kumar
    • Honnappa Nagarahalli
    • Brian Brooks
  • Action Items - Last Week
    • Khem to create Jira Tkt - startup-config issues (NUMA node and memory issues). Jira ID [VPP-1405]
    • Sirshak to ask Juraj to create a LF tkt for Power cycling. - Done
    • Lijian to follow up Mellanox issue. - Done. Patch Verified. To try merging it upstream.
    • Andy following up on cavium. - Done. Unavailability of resource from cavium. Box not priority right now, will take up later.
    • Khem to create Jira IDs for Jumbo frames. [CSIT-1259]In CSIT performance suite, Jumbo frames TCs failing on ARM servers
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin. - No updates, trying to resolve cmake issues.
    • Sirshak to add porting and tuning section to wiki. - Done
    • Sirshak/Juraj talk about Mellanox issue in CSIT call. - Done
  • VPP
    • VPP-1339 - Mellanox NIC not working with VPP - Mellanox provided DPDK Patch ready, Lijian to try upstream it to VPP.
    • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test.
    • Vectorization
      • [Sirshak] Rough patch ready. Currently facing a crash due it.
    • Tuning dual/quad loop
      • Discussion ongoing with Damjan.
    • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.
    • Also to proceed with generic compilation to build for all micro architecture and do dynamic selection.
  • CSIT
    • Juraj to investigate the compiler versions on fd.io lab machines.
    • CSIT-1139 - parallelize 'make verify'
      • Discussing with EdK, how to use that in jenkins job.
    • CSIT VPP Device updates
      • No problems. Trying basic package installation of container topology.
      • aarch64 vpp packages not built for 18.04 LTS, potential problem when we switch from 16.04->18.04.
    • CSIT Performance Test Suite Updates
      • No updates.
  • FD.io lab
    • 3 LF tkts - 1 Node Topology wiring mcbin, 3-node topology wiring Mcbin, 1-node Topology wiring Cavium.
  • Documentation
  • Action Items - Next Week
    • Lijian yo try merging it upstream - Mellanox Changes.
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
    • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test.
    • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.

8/21/2018

  • Attendees
    • Sirshak Das
    • Sachin Saxena
    • Juraj Linkes
    • Lijian Zhang
    • Andy Wang
    • Tina Tsou
    • Khemendra Kumar
    • Honnappa Nagarahalli
    • Brian Brooks
  • Action Items - Last Week
    • [Sirshak] Create LF RT ticket for power cycling mcbins - Not Done yet
    • [Honnappa] Add module owners list and performance analysis items to wiki page - Discussion Still going on.
    • [Lijian] Check if DPDK 18.08 helps Mellanox NIC issues. - Waiting for patch from Mellanox
    • [Sirshak] Create Jira ticket to see impact of Florin's patch : VPP-1401
    • [Sirshak] Create Jira ticket for msb : VPP-1402
    • [Khem] Try dual loop ip4_lookup_inline patch to see if it helps on A72-based D05. : Problems with Ipv4 forwarding(startup-config issues- NUMA Node and Memory issues).
    • [Brian] LTN-10 - Help resolve VPP build failure on mcbins in FD.io lab
    • [Juraj] Enable VPP Device on 1-node SoC now that SFP+ cables have arrived. : No Response from LF.
    • [Sirshak] Follow up with Cavium regarding Ubuntu installation on cavium-4. Status: Andy Following up.
    • [Khem] Create Jira ticket for CSIT failures with jumbo frames
    • [Khem] Create Jira ticket for running a subset of tests via a tag : [CSIT1250]In ARM Perf verify CI, running a subset of tests via a tag
  • VPP
    • VPP-1339 - Mellanox NIC not working with VPP
    • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
    • Vectorization
      • Stalled due to Mellanox NIC issues as benchmarking patches is not posible.
      • hadd and msb - Done.
      • extendto and shuffle going on.
      • Shuffle using __built_in gives same performance as vector intrinsic as at -O2 neither compile tbl instruction.
    • Tuning dual/quad loop
    • Sirshak to add Porting and Tuning Section to Wiki.
  • CSIT
    • CSIT-1139 - parallelize 'make test'
      • dave barach to take a final look and merge.
    • Sirshak/Juraj to talk about having Mellanox in CSIT seeing current compatibility issues post-release.
    • CSIT VPP Device updates
      • Trying to get the 1-node topology: mcbin and cavium thunderx.
    • CSIT Perfomance Test Suite Updates
      • Current issues: NDR, PDR Jumbo frames failure but MRR passing. Memory and Numa Nodes issues in Taishan.
  • FD.io lab
    • 3 LF tkts - Ubuntu Installation cavium-4, 1 Node Topology, Power Cycling mcbins(to be opened).
  • Documentation
    • Documentation changes by Lijian Merged.
  • Action Items - Next Week
    • Khem to create Jira Tkt - startup-config issues (NUMA node and memory issues).
    • Sirshak to ask Juraj to create a LF tkt for Power cycling.
    • Lijian to follow up Mellanox issue.
    • Andy following up on cavium.
    • Khem to create Jira IDs for Jumbo frames.
    • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
    • Sirshak to add porting and tuning section to wiki.
    • Sirshak/Juraj talk about Mellanox issue in CSIT call.


8/14/2018

  • Attendees
    • Juraj Linkes
    • Lijian Zhang
    • Andy Wang
    • Tina Tsou
    • Khemendra Kumar
    • Honnappa Nagarahalli
    • Brian Brooks
  • FD.io lab
    • SFP+ cables shipment showing as delivered
  • VPP
    • VPP-1339 - Mellanox NIC not working with VPP
    • VPP-1391 - VPP 'make verify' failed on Huawei Taishan servers
      • Khem looking into this
    • No updates on crypto
    • No updates on vectorization
    • Tuning dual/quad loop
      • DaveB suggests looking at MULTIARCH macros
  • CSIT
    • CSIT-1139 - parallelize 'make test'
      • Juraj updated patch with comments from Klement
    • Khem seeing failures with jumbo frames
    • Khem noticed new CSIT machines using tag to run a subset of tests
  • Documentation
    • Lijian working on patch to add Arm to Architecture section and Arm-based CSIT testbeds to CSIT section
  • Action Items - Next Week
    • [Sirshak] Create LF RT ticket for power cycling mcbins
    • [Honnappa] Add module owners list and performance analysis items to wiki page
    • [Lijian] Check if DPDK 18.08 helps Mellanox NIC issues
    • [Sirshak] Create Jira ticket to see impact of Florin's patch
    • [Sirshak] Create Jira ticket for msb
    • [Khem] Try dual loop ip4_lookup_inline patch to see if it helps on A72-based D05
    • [Brian] Help resolve VPP build failure on mcbins in FD.io lab
    • [Juraj] Enable VPP Device on 1-node SoC now that SFP+ cables have arrived
    • [Sirshak] Follow up with Cavium regarding Ubuntu installation on cavium-4
    • [Khem] Create Jira ticket for CSIT failures with jumbo frames
    • [Khem] Create Jira ticket for running a subset of tests via a tag

8/7/2018

  • Attendees
    • Sirshak Das
    • Juraj Linkes
    • Lijian
    • Andrew Pinski
    • Andy Wang
    • Tina Tsou
    • Nitin Saxena
    • Khemendra
    • Sachin Saxena
  • General Topic
  • Action Items - Last Week
    • [Khem] make verify on Taishan failure Status: No Status. Khem to create a Jira Tkt.
    • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: [Andy] Cables to be sent today.
    • [Sirshak] Open Jira tkt look at Florin's patch. Status: To be done next week
    • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status: Failing in different place, like rx-error reported to Mellanox people by Lijian. [Lijian] To send the mail vpp-dev. [Honnappa] To talk to DPDK Mellanox DPDK community.
    • [Sirshak] Share Mellanox settings with nitin.
    • [Sirshak] to send email to yi and lijian for documentation. Status: Lijian has done the documentation under internal review.
    • [Honnappa/Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: [Sachin] To include Nitin suggestions and upstream.
    • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status: Sirshak to open LF Tkt
    • [Nitin] Create a Jira Tkt - ip cksum 128 bit vector support. Status: Nitin using ip incremental cksum.
    • [Sirshak] To create a LF tkt for Ubuntu 16.04 installation on cavium-4. Status: Anton tried 16.04 but it didnt work, sent mail to Cavium contact for help.
  • VPP
    • [Sirshak] Vectorization
      • msb is already implemented verifying correctness and performance.
      • [Sirshak] To raise a Jira Tkt for msb changes.
      • Have communicated to ARM compiler team related to vtbl performance.
      • planning to add cvt (extend_to) and hadd(horizontal) equivalents.
    • [Brian/Sirshak] Tuning Dual or Quad loop.
      • [Khem/Sachin] Updates on the changes seen after applying Brian's Patch. Status: No Updates.
    • [Sachin] To create Jira Card, DPDK IOVA issue. (Created VPP-1377)
    • [Honnappa] Module Ownership Discussion. Status: To come back to discussion next time. Community feedback to move to more use-case based approach.
  • CSIT
    • [Juraj] Parallelizing the make test(CSIT-1139) Status: Scheduling Done, Waiting for community review, got some internal comments Juraj working on it. To try this patch on jenkins sandbox.
    • [Sirshak] replying to cavium regarding Ubuntu 18.04/16.04 installation problem cavium-4. Done. Status: Following up with Cavium
    • [Khem] Performance Suite: 64B, 9000Jumbo. Jumbo Frames is failing.(khem to jira tkt: startup.conf, Frame size, NIC Card, Hugepages configuration).
    • [Khem] Have a subset of tests running with tag.
    • [Juraj/Sirshak] VPP Device SoC one node topology constraints Status: Orchestration still under discussion.
  • fd.io lab
    • [Juraj] mcbin access Status: Accessible mcbin build failing, wait fro Brian for help.
    • [Sirshak] cavium blades. Status: [Sirshak] Following up with cavium
  • Documentation
  • Action Items - Next Week
    • [Khem] make verify on Taishan failure, Khem to create a Jira Tkt. Status:
    • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status:
    • [Sirshak] Open Jira tkt look at Florin's patch. Status: Not done to be done next week
    • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
    • [Lijian] To send the mail vpp-dev (VPP-1339) Status:
    • [Honnappa] To talk to DPDK Mellanox DPDK community. Status:
    • [Sachin] To include Nitin suggestions and upstream.(ARMv8 Crypto changes) Status:
    • [Sirshak] To Open a LF Tkt regarding power cycler remote access fro mcbin. Status:
    • [Sirshak] To raise a Jira Tkt for msb changes. Status:

7/30/2018

  • Attendees
    • Sirshak Das
    • Juraj Linkes
    • Lijian
    • Andrew Pinski
    • Andy Wang
    • Tina Tsou
    • Nitin Saxena
    • Khemendra
    • Sachin Saxena
  • General Topic
  • Action Items - Last Week
    • [Khem] make verify on Taishan failure Status: No Status
    • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: [Andy] Still working internally, expecting to be done this week.
    • [Sirshak] mlnx tx non vector version used for no-multiseg. Status: Jira Tkt VPP-1355
    • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status: Yet to be verified , if fixed.
    • [Sirshak] look at Florin's patch. Status: No status, [Sirshak] Open Jira tkt.
    • [Tina] to get back on New ARMv8 Crypto. Status: Bob to schedule meeting with Cavium. To be tracked by Nitin, bob, tina.
    • [Sirshak] Why Quad to Dual loop improves performance. Status: VPP-1356
    • [Sirshak] To update VPP documentation with fd.io lab devices. Status: Not yet done. [Sirshak] to send email to yi and lijian.
    • [Sirshak] VPP Vectorization Jira Tkt. Status: VPP-1357
    • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Waiting for Nitin to help on changes for Internal DPDK. External DPDK support patch done. [Sachin : created VPP-1378] To create a Jira Tkt for Internal Tkt. [Honnappa] To comment on current gerrit item to get it moving.
    • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4. Status: Sent
    • [Sirshak] Get credentails from Brian for mcbin Status: Done
    • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status: Done
  • VPP
    • [Sirshak] Vectorization
      • Almost done with shuffle.
      • Will get to working with msb.
      • AARCH32 compilation to be discussed.(Shuffle Vector Intrinsic AARCH64 ARMv8 specific)
      • There are no specific requirements on aarch32 at this time.
    • [Lijian && Yi] To continue effort on analyzing IPv4 nos on available platforms with Intel and Mellanox NICs
      • [Sirshak] Why is Mellanox NIC not used in CSIT ? Performance Suite Designed for Intel and Cisco NICs.
    • [Brian/Sirshak] Tuning Dual or Quad loop.
      • [Khem/Sachin] Updates on the changes seen after applying Brian's Patch. Status: No Updates.
    • [Khem] Updates on Benchmarking on taishan. Status: Held up hardware.
    • [Nitin] Any new findings from IPv4 VPP test case. Status: Working HW offloading.
    • [Sachin] To create Jira Card, DPDK IOVA issue. (Created VPP-1377)
    • [Lijian] ipcksum - No Degradation on Qualcomm.
    • [Nitin] Create a Jira Tkt - ip cksum 128 bit vector support.
  • CSIT
    • [Juraj] Parallelizing the make test(CSIT-1139) Status: All VPP instances running on same core. Tried scheduling cores. Dynamically finding available cores. Sweetspot currently: 8 containers with 96 core.
    • [Juraj] Test features listed by talking to dave.
    • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4. Done. Status: To open a new LF tkt to ask for 16.04 installation.
    • [Juraj/Sirshak] VPP Device SoC one node topology constraints Status: Orchestration still under discussion.
    • [Sirshak] to ask brian about mcbin credentials. Status: Done.
  • fd.io lab
    • [Juraj] mcbin access Status: Created LF tkt.
    • [Sirshak] cavium blades. Status: [Sirshak] To create a LF tkt for Ubuntu 16.04 installation on cavium-4.
  • Documentation
  • Action Items - Next Week
    • [Khem] make verify on Taishan failure Status:
    • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: [Andy]
    • [Sirshak] Open Jira tkt look at Florin's patch. Status:
    • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
    • [Sirshak] to send email to yi and lijian for documentation.
    • [Honnappa/Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status:
    • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status:
    • [Nitin] Create a Jira Tkt - ip cksum 128 bit vector support.
    • [Sirshak] To create a LF tkt for Ubuntu 16.04 installation on cavium-4.

7/24/2018

  • Attendees
    • Sirshak Das
    • Juraj Linkes
    • Lijian
    • Andrew Pinski
    • Andy Wang
    • Tina Tsou
    • Nitin Saxena
    • Khemendra
  • General Topic
    • .
  • Action Items - Last Week
    • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break. Status: Nitin, compiler does not support arm neon intrinsics. Honnappa working with compiler team: neon intrinsics is supported #defines not present. Tmp solution available. Honnappa to follow up in DPDK.
    • [Nitin/Sachin] Follow up: Add Virtual addressing support in IOVA dmap Status: patch committed by sachin merged.
    • [Khem] make verify on Taishan failure Status: No updates.
    • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: PO Approved. Should get going in few days.
    • [Sirshak] mlnx tx non vector version used for no-multiseg. Status: Waiting for x86 hotspots for confirmation and will then open a ticket.
    • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status: Seems to be fixed but have not tried all the test cases to confirm.
    • [Sirshak] look at Florin's patch. Status: Not done yet
    • [Tina] to get back on New ARMv8 Crypto. Status: No updates. Close to complete but not upstreamed yet.
    • [Sirshak] Why Quad to Dual loop improves performance. Status: Not saturating no of outstanding prefetches. AI to raise a Jira Bug.
    • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin). Status; Not done yet.
  • VPP
    • [Sirshak] vectorization patch effects
      • Made few changes no visible changes.
      • Plan to read mlnx drivers DPDK to understand how neon intrinsics accelerate the vectors.
      • Add Jira Tkt.
    • [Sirshak] Anamolies with mlx5 and VPP.
    • [Honnappa <-> Nitin] Nitin okay with ARM contacting Customer Support for help on TX2 optimal settings.
    • [Brian/Sirshak] Tuning Dual or Quad loop.
      • Visible change in A72.
      • Sirshak sent patch to Sachin and Khem to analyze if they see any improvement.
      • [Khem->Sirshak] Why moving form Quad to Dual improves performance.
    • [Lijian] x86 nos reported: 9.5 Mpps is not same as reported by Nitin Status: Could because of broadwell and skylake difference.
    • [Khem] Updates on IPv4 Benchmarking on taishan. Status: CSIT perfomance bringup on fd.io lab. 18.04 gcc 7.3 trex. Workaround done. DUT VPP crashing. Plan for running L2 test cases.
    • [Nitin] Any new findings from IPv4 VPP test case. Status: not available to discuss
  • CSIT
    • [Juraj] Parallelizing the make test(CSIT-1139) Status: Sent for review, Figuring out optimal no of threads.
    • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4.
    • [Juraj/Sirshak] VPP Device SoC one node topology constraints Status: [Sirshak] Access to one of the three consoles.
    • [Sirshak] to ask brian about mcbin credentials.
    • [Adarsh] VPP Path/Device Efforts: Nested Container, trying VM inside a container facing some issues. Status: Work on hold as adarsh moved out of the project.
  • fd.io lab
    • [Sirshak] Installation of TG pending. Status: Done
    • [Juraj] mcbin access Status: Two of them can be accessed the other 1 cant.
    • [Sirshak] cavium blades connected need SFP and DACs. Status: Up and running, still need SFP and DACs
  • Documentation
  • Action Items - Next Week
    • [Khem] make verify on Taishan failure Status:
    • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status:
    • [Sirshak] mlnx tx non vector version used for no-multiseg. Status: Jira Tkt VPP-1355
    • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
    • [Sirshak] look at Florin's patch. Status:
    • [Tina] to get back on New ARMv8 Crypto. Status:
    • [Sirshak] Why Quad to Dual loop improves performance. Status: VPP-1356
    • [Sirshak] To update VPP documenetation witrh fd.io lab devices. Status:
    • [Sirshak] VPP Vectorization Jira Tkt. Status: VPP-1357
    • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Last Status: Waiting for Nitin to help on changes for Internal DPDK. Current Status:
    • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4. Status: Sent
    • [Sirshak] Get credentails from Brian for mcbin Status: Done
    • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status: Done

7/17/2018

  • Attendees
    • Sirshak Das
    • Sachin Saxena
    • Khemendra Kumar
    • Juraj Linkes
    • Lijian
  • General Topic
    • Austin Folks leaving early meeting. If needs be somebody can takeover after 1 hour (9 am CT).
  • Action Items - Last Week
    • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break
    • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status: No updates.
    • [Khem] make test on Taishan timings: Status: Done. To look at why make verify.
    • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch. Status: Andy waiting for cables to reach him.
    • [Sirshak] mlnx tx non vector version used for no-multiseg. Jira Tkt Status: Not yet done. Will do this week.
    • [Sirshak] DPDK 18.05 mlnx bug. Status: Sirshak to open Jira Tkt - VPP-1339
    • [Sirshak] look at Florin's patch. Status: Not yet done.
    • [Tina] to get back on New ARMv8 Crypto.
  • VPP
    • [Sirshak] vectorization patch effects
      • Made few changes no visible change.
      • Plan to read mlnx drivers DPDK to understand how neon intrinsics accelerate the vectors.
    • [Brian/Sirshak] Tuning Dual or Quad loop.
      • Visible change in A72.
      • None in Qualcomm because of pfrm not being hotspot.
      • [Khem->Sirshak] Why moving form Quad to Dual improves performance.
      • Commmunity wide investigation needed.
    • [Lijian] x86 nos reported: 9.5 Mpps is not same as reported by Nitin Status: Investigation.
    • [Khem] Updates on IPv4 Benchmarking on taishan. Status: Stuck with pktgen.
    • [Nitin] Any new findings from IPv4 VPP test case. Status:
    • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Waiting for Nitin to help on changes for Internal DPDK.
  • CSIT
    • [Juraj] Parallelizing the make test(CSIT-1139) Status: Almost done, need to work on polishing.
    • [Juraj/Sirshak] SoC devices as non voting VPP device targets. Status: [Sirshak] pending on TG credentials.
    • [Adarsh] VPP Path/Device Efforts: Nested Container, trying VM inside a container facing some issues. Status: No update, Adarsh replaced on the project; postponed
  • fd.io lab
    • [Sirshak] Installation of TG pending. Status: No update from LF - Anton
    • [Sirshak] cavium blades connected need SFP and DACs. Status: Up and running, still need SFP and DACs
  • Documentation
  • Action Items - Next Week
    • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break Status:
    • [Nitin/Sachin] Follow up: Add Virtual addressing support in IOVA dmap Status:
    • [Khem] make test on Taishan failure Status:
    • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status:
    • [Sirshak] mlnx tx non vector version used for no-multiseg. Status:
    • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
    • [Sirshak] look at Florin's patch. Status:
    • [Tina] to get back on New ARMv8 Crypto.
    • [Sirshak] Why Quad to Dual loop improves performance.
    • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).

7/10/2018

  • Attendees
    • Sirshak Das
    • Sachin Saxena
    • Khemendra Kumar
    • Tina Tsou
    • Nitin Saxena
    • Juraj Linkes
    • Brian Brooks
    • Lijian
    • Tom Herbert
  • General Topic
    • Austin Folks leaving early meeting. If needs be somebody can takeover after 1 hour (9 am CT).
    • [Tom] Aarch64 rpms not building - anyone can help?
  • Action Items - Last Week
    • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status: No updates.
    • [Nitin] make test on Thunderx2 timings Status: Send error report of make test.
    • [Khem] make test on Taishan timings: Status: 22 mins. Try make verify.
    • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch. Status: Done for cavium 1,2,3. Need cables for 4,5,6,7. Cables ordered
    • [Khem] to update on nested VMs on performance test cases. Status: No updates. Could be a naming problem.
    • [Sirshak] Q to Maciek: buildroot image with VPP device(within container)? Status: No updates. Check with Brian to see if buildroot works on arm.
    • [Sirshak] mlnx tx non vector version used for no-multiseg. Reason ? Status: No updates. Sirshak to open Jira Tkt.
    • [Sirshak] DPDK 18.05 mlnx bug. Status: Asked in the community need to look at backtrace as pointed by damjan. Sirshak to open Jira Tkt.
  • VPP
    • [Sirshak] vectorization patch effects. https://gerrit.fd.io/r/#/c/13229/
      • I see around 15% in qualcomm with mellanox based on some patch which is not vectorization patch need find that.
      • Do others see similar improvement in past 2 weeks.
      • [Sirshak] look at Florin's patch.
    • [Lijian] x86 nos, checking within Nitin for sync on configuration. Skylake Single Core Single Thread: Ipv4 forwarding 64B 15 Mppps.
    • [Khem] Updates on IPv4 Benchmarking on taishan. Status: No Updates
    • [Nitin] Any known comparision between AVF nos on aarch64 and DPDK nos ? On Intel its ~25% and ARM ~20%.
    • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Internal DPDK changes effort. Wait for status on New ARMv8 Crypto.
    • [Sirshak->Nitin] Thunderx2(high core count)coremask for DPDK config in VPP startup conf.
    • [Tina] to get back on New ARMv8 Crypto.
  • CSIT
    • [Juraj] Parallelizing the make test(CSIT-1139) Discussion: On Plan and if anybody wants to join hands.
    • [Juraj/Sirshak] SoC devices as non voting VPP device targets. Discussion: mcbin console access will be available once TG credentials are availlable.
    • [Adarsh] VPP Path/Device Efforts: Nested Container, trying VM inside a container facing some issues.
  • fd.io lab
    • [Sirshak] Taishan connected need to verify once we get TG credentials. [Khem] Checked from Taishan side ports connected to TG are up.
    • [Sirshak] mcbin connected need to verify once we get TG credentials.
    • [Sirshak] cavium blades connected need to switch the network adapters before using it for CI.
  • Documentation
  • Action Items - Next Week
    • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break
    • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status: No updates.
    • [Khem] make test on Taishan timings: Status:
    • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch.
    • [Sirshak] mlnx tx non vector version used for no-multiseg. Jira Tkt Status:
    • [Sirshak] DPDK 18.05 mlnx bug. Status: Sirshak to open Jira Tkt.
    • [Sirshak] look at Florin's patch.

7/3/2018

  • Attendees
    • Sirshak Das
    • Sachin Saxena
    • Khemendra Kumar
    • Tina Tsou
    • Nitin Saxena
    • Juraj Linkes
    • Brian Brooks
    • Ed Kern
    • Song
    • Lijian
  • General Topic
    • Architecture Section in Documentation.
  • Action Items - Last Week
    • Khem: Ipv4 layer investigation. To Share some findings next week on parameters for CSIT Status: Done. If yes cover in VPP section.
    • Nitin Follow up: Sachin: Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Nitin to provide help on using Internal DPDK
    • Nitin Follow up: Add Virtual addressing support in IOVA dmap Status: Waiting for response from Damjan
    • Nitin make test on Thunderx2 timings :
    • Khem: status on make test failures: CSIT-1148 Status: Fixed.
    • Khem: make test on Taishan timings: Status: No status
    • Sirshak: cavium USB-Ethernet adapters to Quantta Switch. Status: Still working with LF guys
    • Khem to update on nested VMs on performance test cases. Status: No Updates
    • Sirshak & Khem: Documentation review. Status: Done. continuous effort.
    • Sirshak: Q to Maciek: buildroot image with VPP device(within container) ? Status: No updates.
  • VPP
    • Sirshak: Investigate mlnx_burst_rx_vec used in case of no multi-seg but plain mlnx_tx_burst used. Movement of hotspot seen for rx. Probable reason SRIOV(VFs) used. Root cause yet to be found.
    • Sirshak: VPP DPDK 18.05 change done by damjan. mlnx drivers on Qualcomm are a problem. Urge Everyone to test respective sanity in their setup. set interface state <InerfaceName> up - stuck
    • Khem: Discuss various parameters in CSIT for IPv4 Testing.
    • Sirshak: TCP termination performance nos ?
    • Sirshak: vectorization patch effects. https://gerrit.fd.io/r/#/c/13229/
  • CSIT
    • Juraj Make test bottlenecks: Updates: One plausible solution available. Parallelizing the make test(CSIT-1139)
    • Juraj to start looking at SoC devices as non voting VPP device targets.
    • Adarsh: openssl issues ? Issue still persists.
    • Adarsh: VPP Path Tasks.
    • Tkt updates:
      • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Status: To check with CSIT team for jenkins build failure. Status: No Updates. Not Priorty.
  • fd.io lab
    • Sirshak: Update from LF guys
  • Documentation
  • Action Items - Next Week
    • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status:
    • [Nitin] make test on Thunderx2 timings :
    • [Khem] make test on Taishan timings: Status:
    • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch. Status:
    • [Khem] to update on nested VMs on performance test cases. Status:
    • [Sirshak] Q to Maciek: buildroot image with VPP device(within container)? Status:
    • [Sirshak] mlnx tx non vector version used for no-multiseg. Reason ? Status:
    • [Sirshak] DPDK 18.05 mlnx bug. Status:

6/26/2018

  • Attendees
    • Sirshak Das
    • Sachin Saxena
    • Khemendra Kumar
    • Tina Tsou
    • Nitin Saxena
    • Juraj Linkes
    • Brian Brooks
    • Ed Kern
    • Song
  • General Topic
    • Introduce Song, Yi and Lijian
  • Action Items - Last Week
    • Adarsh: Updates on Jira tkt for openssl issues. Updates: none
    • Adarsh: Update on topology for Kubernetes Functional Tests. Updates: Kubernetes, Docker
    • Sirshak Tuning Section - Not Done
    • Khem: Ipv4 layer investigation. CSIT: IPv4. To Share some findings next week on parameters for CSIT
    • Nitin: Send old dpdk input node patch - Done
    • Sachin: Upstreaming ARMv8 Crypto Changes with external DPDK. - Nitin to send mail
    • Add Virtual addressing support in IOVA dmamap: Updates - nitin to send mail
    • Nitin Measure make make test on Thunderx2
    • Khem: measure make and make test on Taishan (Juraj tested it it failed : https://jira.fd.io/browse/CSIT-1148)
    • Sirshak: try to switch eth-usb for regular eth ports on ThunderXs - Created a LF tkt have follow up meeting today.
  • VPP
    • Discuss vec_en_rx/tx=1 parameters.
    • Discuss Vectorized rx and tx functions in mlx5 (in case of no multi-seg)
    • rxd,txd nos in VPP config.
    • mbcache any configuring done from VPP side ?
  • CSIT
    • make test failures Taishan Khem/adarsh (https://jira.fd.io/browse/CSIT-1148)
    • Juraj Make test bottlenecks: Updates: Ran 4 containers (85 mins) (CSIT-1139)
    • mcbin, OD(1000/3000), cavium thunderX as one of the targets for VPP Device Test.
    • Future role of devices. Status: Existing Taishan Servers to be used for performance suite only.
    • Khem to update on nested VMs on performance test cases.
    • buildroot image with VPP device(within container) ? Sirshak to ask maciek
    • Tkt updates:
      • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Merged and Closed
      • CSIT-990 (buildroot package) Juraj Updates: Postponed
      • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Status: To check with CSIT team for jenkins build failure.
  • fd.io lab
    • Sirshak to have follow up LF guys.
  • Documentation
  • Action Items - Next Week
    • Khem: Ipv4 layer investigation. To Share some findings next week on parameters for CSIT
    • Nitin Follow up: Sachin: Upstreaming ARMv8 Crypto Changes with external DPDK.
    • Nitin Follow up: Add Virtual addressing support in IOVA dmap
    • Nitin make test on Thunderx2 timings :
    • Khem: status on make test failures: CSIT-1148
    • Khem: make test on Taishan timings:
    • Sirshak: cavium USB-Ethernet adapters to Quantta Switch.
    • Sirshak: try to switch eth-usb for regular eth ports on ThunderXs - Created a LF tkt have follow up meeting today.

6/19/2018

  • Attendees
    • Sirshak Das
    • Sachin Saxena
    • Khemendra Kumar
    • Tina Tsou
    • Nitin Saxena
    • Juraj Linkes
    • Brian Brooks
    • Ed Kern
    • Song
  • General Topic
    • Introduce Yi ,Lijian and Song
  • Action Items - Last Week
    • Brian: mcbin Status:
    • Sirshak: Follow up clang changes. Status: Merged updated wiki.
    • Khem: Update Kernel Image based on Sanil's input to move past known VM issues. Try this internally.
    • Khem: LF tkt for Taishan BIOS updates.
      • No update for the ticket
    • Adarsh: openssl updates. Status:
      • Raised Jira ticket, needs to be discussed with VPP folks
    • Adarsh: Kubernetes
      • Working with K8s folks, planning on creating topology from containers for functional tests
    • Khem: VM(s) in container, VFs for containers
    • Sirshak: Summarize tkts in the Tuning Section. Status: Not Done
    • Khem: Investigation on ipv4 layer. Status: Not Done
    • Nitin: Send old patch on dpdk_input node tuning
  • VPP
    • Sachin: Upstreaming armv8 crypto changes. Status: Sachin will try to upstream a patch related to external DPDK
    • Sirshak: Vectorization - Presentation.
    • Any new findings on hotspots or optimizations. Brian: adjusting queue sizes seem to have an effect
    • https://gerrit.fd.io/r/#/c/12932/ discussion: Need to understand the usecase(s) for iommu inside VPP
  • CSIT
    • Discuss current make test time bottleneck.
    • AI Nitin: measure make and make test on ThunderX
    • AI Khem: measure make and make test on Taishan
    • AI Sirshak: try to switch eth-usb for regular eth ports on Thunderxs
    • Future role of devices. Status: will be decided when we have more info (performance on different devices etc.)
    • Question to Nitin/Anyone of how to individually run one test case of the performance suite. Status: no performance testcase can run on 2-node topologies
    • Tkt updates:
      • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Sent a patch. Status: Patch is waiting to be merged
      • CSIT-990 (buildroot package) Juraj Updates: No updates
      • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Submitted. Jobs still failing, Khem to investigate. Patch related to Jumbo pkts.
  • fd.io lab
    • mcbin get them up, discuss with LF. Status: Brian - No Updates
    • Cavium Blades LF ticket #56713 Status: Tina - Need to have a meeting
  • Documentation
  • Action Items - Next Week

6/12/2018

  • Attendees
    • Sirshak Das
    • Brian Brooks
    • John Bromhead
    • Sachin Saxena
    • Khemendra Kumar
    • Adarsh
    • Andy Wang
    • Tina Tsou
    • Andrew Pinski
    • Nitin Saxena
    • Natalie Samsonov
  • Action Items - Last Week
    • Brian: mcbin status: Updates from Trishan LF tkt #54490. - No updates
    • Sirshak: Follow up clang changes. Sent: Follow up patch.
    • Khem: Update Kernel Image based on Sanil's input to move past known VM issues. Try this internally and then do it fd.io lab.
    • Khem: LF tkt for Taishan BIOS updates. LF #56898 Status: Not done. Will follow up.
    • Adarsh: openssl updates. Status: IPSEC SA add entry error. To open a Jira tkt tracking this.
    • Sirshak: Summarize tkts in the Tuning Section. Didnt get chance to do this week would try to complete it by next week.
    • Sirshak: Schedule a Meeting between Juraj and Khem. Done
  • VPP
    • Brian: Talk on mcbin perf analysis. Nitin to send a old patch on tuning prefetch on dpdk_input node.
    • Sirshak: VPP Multi-arch optimizations Guidelines
    • Sirshak: Vectorization - Plan to present something next week. Any thoughts ?
    • Nitin: anybody willing to take up ipv4 layer ? Khem to take a look.
    • Sachin: Upstreaming armv8 crypto changes.
    • Nitin: memcpy updates ?
    • Sirshak: clang patch status
  • CSIT
    • Sirshak: Explain VPP Path and VPP Device
    • Open Questions and Answers surrounding VPP Device
      • Q. Do the Intel onboard NICs support VFs via SRIOV on machiattobin boards ?
      • A.[Natalie] We support it but it’s not formally released yet. Will be formally delivered in 18.09.
      • BB - Kernel bypass uses UIO possible to do. [natalie] check support for VF for onboard NICs
      • Q. If Yes, is it a hardware level support or supported in musdk also ?
      • A.[Natalie] MUSDK is not relevant here. Intel NICs are using DPDK and ARM infrastructure directly. We support PCIE SR-IOV with both v4.4 and v4.14 kernels
      • Q. Has anybody tested containers (docker) and any container orchestration system on mcbin (e.g Docker Swarm or Kubernetes) ?
      • A.[Natalie] Yes.
      • Q. K8s or Docker Swarn ?
      • A. [Bin Arm Internal] K8s is good choice version(1.9.4). Use kubeadm to install k8s cluster.
      • Q. VM inside a container works on ARM ?
      • A. [Bin ARM Internal] Use Kata and Runv. Kata/Runv is the solution of hardware-virtualized containers.
      • Q. Container within a Container(nested) works on ARM ?
      • A.[Bin ARM Internal] ‘Docker in docker’ or ‘Docker of Docker’ can works well on Arm platform.
    • Sirshak: Explain the proposed role of Cavium Blades for functional tests.
    • Tkt updates:
      • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Sent a patch.
      • CSIT-990 (buildroot package) Juraj Updates:
      • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Submitted. Jobs failing Khem to investigate. Patch related to Jumbo pkts.
      • Sachin: To open tkt to track ARMv8 crypto.
  • fd.io lab
    • mcbin Status: Brian - No Updates
    • Cavium Blades #56713 Status: Tina
  • Documentation
  • Action Items - Next Week
    • Brian: mcbin Status:
    • Sirshak: Follow up clang changes. Status: Merged updated wiki.
    • Khem: Update Kernel Image based on Sanil's input to move past known VM issues. Try this internally.
    • Khem: LF tkt for Taishan BIOS updates.
    • Adarsh: openssl updates. Status:
    • Sirshak: Summarize tkts in the Tuning Section. Status: Not Done
    • Khem: Investigation on ipv4 layer. Status:

6/4/2018

  • Attendees
    • Sirshak Das
    • Brian Brooks
    • John Bromhead
    • Sachin Saxena
    • Khemendra Kumar
    • Adarsh
    • Andy Wang
    • Tina Tsou
    • Andrew Pinski
    • Juraj Linkes
    • Nitin Saxena
    • Natalie Samsonov
  • Action Items - Last Week
    • Sirshak: To create a LF tkt for mcbin - Didnt create as Brian is handling it offline. If things remain unresolved this week, will create one. - LF Tkt created #54490. [BB]Trishan to follow up over email.
    • Sirshak: Follow up on cavium-3 : Its integrated to arm CI job.
    • Sirshak: Upstream clang changes: Failing on Cavium TX1 host up-streamed related patch working on review comments.
    • Sirshak: Discuss with Maciek and get a signoff for moving the x86 Hosts to arm rack: Done
    • Honnappa: Provide inputs on how to proceed with comments on Marvell dpdk patch.
    • Honnappa: VPP-1284: To look at this patch to provide comments on performance implications of the fix
    • Juraj estimate moving CSIT functional tests to make test. - 1-2 months for 1 person. Others CSIT looking into this. Better estimate soon.
    • Khem: Create LF tkt for Performance Suite Topology Creation. : Created LF #56736
    • Adarsh: Create a Jira to document Automation Task. Created Jira Tkt.
    • Khem: Follow up Sanil : Known taishan vm issues. Update Kernel Image
    • Khem: LF tkt for Taishan BIOS updates. LF #56898
    • Adarsh: openssl updates. Updated openssl dpdk. VPP is now stable. Will test soon. Adarsh to close the tkt.
    • Nitin: VPP-1064 multiple cache line size patch. Nitin to raise to LF tkt to remove DPDK package from Nexus server.
  • fd.io lab
    • mcbin onboarding issue. - Comments in Action Items - Last Week.
    • new cavium boxes status - JohnB : Blade 1-4 racked. CSIT Functional.
    • Sirshak : Summarize tkts.
  • VPP
    • memcpy patch updates/closure: Abandon. Jira to be updated with more data.
    • clang compilation Sirshak: Working on getting the patch upstreamed.
    • mcbin performance analysis Brian: To talk about this next week.
    • vectorization sirshak(Problem, Plausible Solution, Volunteers): SSE2NEON
    • Sachin: upstreaming armv8 crypto changes.
    • Sirshak: Add Tuning section in Wiki
    • Sirshak: Summarize Jira Tkts
  • CSIT
    • Performance Suite Roadmap(topology, work distribution(khem, juraj)):
    • Sirshak to Schedule a Meeting between Juraj and Khem.
    • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Seen by Juraj. Seeing the issue in ipv6 suite. happens during pcie rescan.
    • CSIT-990 (buildroot package) Juraj Updates: Peter from pantheon replied Juraj still looking into it.
    • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates):
    • Sirshak : Summarize CSIT tkts
    • Sachin: To open tkt to track ARMv8 crypto.
  • Documentation
    • Special VPP installations(eg. dpaa).
    • ARMv8 crypto needs to documented.
  • Action Items - Next Week
    • Brian: mcbin status: Updates from Trishan LF tkt #54490.
    • Sirshak: Follow up clang changes.
    • Khem: Update Kernel Image based on Sanil's input to move past known VM issues.
    • Khem: LF tkt for Taishan BIOS updates. LF #56898 Status:
    • Adarsh: openssl updates.
    • Sirshak: Summarize tkts in the Tuning Section.
    • Sirshak: Schedule a Meeting between Juraj and Khem.


5/29/2018

  • Attendees
    • Sirshak Das
    • Brian Brooks
    • John Bromhead
    • Sachin Saxena
    • Khemendra Kumar
    • Adarsh
    • Andy Wang
    • Honnappa Nagarahalli
    • Tina Tsou
    • Andrew Pinski
    • Juraj Linkes
    • Nitin Saxena
  • Action Items - Last Week
    • Sirshak: To update LF RT #54919 to follow up on cavium-2 status. - Not Needed as cavium-2 is present.
    • Sirshak: Release Machine to EdK as soon as ThunderX is up. - Done
    • Sirshak: Status on new ThunderXs: Will be decided after talks with Maciek. - Yet to decide.
    • Sirshak: vm unresponsive issue. Tried again still got 27 errors for ipv4 handed over to Juraj for further investigation.
    • Sirshak: To ask about CSIT performance topology connection status. Didnt get time mostly discussing VIRL job.
    • Sirshak: to add OS version to fd.io lab machines. -Done by somebody else.
    • Sirshak: to add Porting and Tuning section. Check with Honnappa
    • Sirshak: to track arm master build failure. - Damjan has sent a fix.
    • Juraj: Access to fd.io lab. - Done.
    • Khem: to create a Jira tkt to document automation task of CSIT. - Still Working on it.
    • Khem: to reach out to Sanil(Huawei)regarding known Taishan problems with KVM. - No response from Sanil yet.
    • Khem: BIOS patch for NUMA node numbering issue. - Khem to create LF RT tkt to do this in fd.io lab.
    • Nitin: VPP-1064 Support multiple cache line sizes per architecture. - Still in discussion with Dave.
    • Adarsh: openssl updates. VPP crashing.


  • fd.io lab
    • mcbin powering on ? Sirshak to create LF tkt. Reach out to Brian offline.
    • Cavium-3 role. Make decision based on feedback Edk. Sirshak to check availability.
    • Sirshak to ask Brian to forward old LF tkt to JohnB.
  • VPP
    • ARMv8 crypto patch from Sachin related to dpdk_plugin only.
    • memcpy issue: going with memcpy and not hand crafted memcpy.
    • clang compilation: Sirshak to upstream to clang related changes add all other aarch64 leads.
    • Brian to use cache stashing result. Updates: No affects for VPP but there is improvement on musdk sample application.
    • VPP-1267(Marvell dpdk patch mcbin): How to move forward based on Damjan's comments. Still discussing. Honnappa to provide some inputs next week.
    • VPP-1276(rpm issues aarch64): Not priorty. Status: No updates.
    • VPP-1284: TLS corruption on aarch64: Status(After Sachin's suggestion): Resolved. Might have performance implications but currently only possible solution. HN to look at this Jira Card in order talk to compiler team if needs be.
  • CSIT
    • TG status in fd.io lab and internal Huawei Lab. - Sirshak to discuss with Maciek. Khem to create LF tkt.
    • CSIT-1019 (timeout of PacketVerifier.RxQueue is not working): Done.(Upstreamed Merged ?). Status: Merged.
    • CSIT-1023 (Crypto Func Tests): VPP still crashing - Adarsh
    • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Sirshak tried pinning the VMs to phy CPUs but tests still failing. Juraj to take over.
    • CSIT-990 (buildroot package) Brian Status: build issue with grub.
    • Juraj: Estimate on moving CSIT Functional tests to make test. Maciek proposal does consider all the implications of letting go VIRL especially parallelization VIRL offers.
  • Action Items - Next Week
    • Sirshak: To create a LF tkt for mcbin
    • Sirshak: Follow up on cavium-3.
    • Sirshak: Upstream clang changes.
    • Honnappa: Provide inputs on how to proceed with comments on Marvell dpdk patch.
    • Honnappa: VPP-1284: To look at this patch to provide comments on performance implications of the fix
    • Juraj estimate moving CSIT functional tests to make test.
    • Sirshak: Discuss with Maciek and get a signoff for moving the x86 Hosts to arm rack.
    • Khem: Create LF tkt for Performance Suite Topology Creation.
    • Adarsh: Create a Jira to document Automation Task
    • Khem: Follow up Sanil : Known taishan vm issues.
    • Khem: LF tkt for Taishan BIOS updates.
    • Nitin: VPP-1064 multiple cache line size patch.:
    • Adarsh: openssl updates.

5/22/2018

  • Attendees
    • Sirshak Das
    • Stanislav Chlebec
    • John Bromhead
    • Sachin Saxena
    • Khemendra Kumar
    • Andy Wang
    • Honnappa Nagarahalli
    • Tina Tsou
    • Andrew Pinski
    • John Bromhead
    • Juraj Linkes
    • rkinsell
    • Nitin Saxena
  • Action Items - Last Week
    • Sirshak: To update LF RT #54919 to follow up on cavium-2 status. - having troubles with login will sort it out today.
    • Sirshak: Release Machine to EdK as soon as ThunderX is up: cavium-1 done cavium-2 still has issues with network connectivity.
    • Sirshak: Status on new ThunderXs: Will be decided after talks with Maciek.
    • Sirshak: vm unresponsive issue: No updates didnt get time to try will try this week.
    • Sirshak: To ask about CSIT performance topology connection status. - TBD after call with Maciek.
    • Nitin: VPP-1064 (Patch rejected by dave barach) Discuss cross compilation with Sachin. (Seperate or one unified Makefile). - No Updates.
    • HN: memcpy benchmarking updates honnappa - 2 more tests to be done based on Ola's suggestion.
    • Adarsh openssl issues: Will communicate with Sachin to get this resolved. Made changes based sachin's suggestions still issues to be resolved.
    • Adarsh preparing a sheet updated with his progress on CSIT. - Added to the google sheets.


  • fd.io lab
    • cavium-2 follow up via LF #54919.
    • Talk to Macek regrading TG physical placement on rack.
    • Juraj : Needs access to fd.io lab. Tina to help Juraj with this.
    • Juraj to send email to EdW to get access to fd.io lab.'
    • Sirshak to add OS version to fd.io lab machines.
  • VPP
    • HN->Nitin: Stick with memcpy. Nitin concern SIMD unit being idle with new GCC. Feedback from arm compiler team that vector instructions dont perform as expected on many platforms. 1ns better(dpdk_input node) if using SIMD memcpy on ThunderX. Nitin to try using restricted on non-SIMD memcpy.
    • 1019: CSIT. Py-lint issues. Patch submitted. Khem to merge with Lucian's Patch.
    • 1023: Khem, Adarsh to talk to Sachin to resolve openssl issue. - Sachin suggested some config changes resulted in VPP being unstable. Still working it out.
    • 1043: No updates. Sirshak to investigate this and Khem to reach out to Sanil regarding known Taishan problems with KVM.
    • 990: Brian Updates - Sirshak to get status offline.
    • 1267: l3fwd performance tuning: Status on Marvel patch: - No Updates. Nitin to submit his modified patch with -2.
    • VPP-1276: Sachin facing issues with building rpm. - Any change in status ? No Updates. Low priorty for Sachin. Needs Help.
    • VPP-1284: TLS corruption: Dynamic linking related to Thread local storage. Logs recorded with this tkt.
    • Sirshak to add Porting and Tuning section.
    • Sirshak to track arm master build failure.
  • CSIT
    • Adarsh openssl issues:
    • Performance Testing Khem : NUMA node numbering issue. Last Update: Still working internally. Status: Internal patch for BIOS.
    • Khem: to create a Jira tkt to document automation task of CSIT.
    • Khem : trex installation- Having x86 TG internally. Any luck ?
    • Brian to use cache stashing result. Updates:
  • Action Items - Next Week
    • Sirshak: To update LF RT #54919 to follow up on cavium-2 status.
    • Sirshak: Release Machine to EdK as soon as ThunderX is up.
    • Sirshak: Status on new ThunderXs: Will be decided after talks with Maciek.
    • Sirshak: vm unresponsive issue: No updates didnt get time to try will try this week.
    • Sirshak: To ask about CSIT performance topology connection status.
    • Sirshak: to add OS version to fd.io lab machines.
    • Sirshak: to add Porting and Tuning section.
    • Sirshak: to track arm master build failure.
    • Juraj: Access to fd.io lab.
    • Nitin: VPP-1064 Support multiple cache line sizes per architecture.
    • HN: memcpy benchmarking updates honnappa - 2 more tests to be done based on Ola's suggestion.
    • Adarsh openssl updates
    • Khem: to create a Jira tkt to document automation task of CSIT.


5/15/2018

  • Attendees
    • Sirshak Das
    • Stanislav Chlebec
    • Sachin Saxena
    • Khemendra Kumar
    • Andy Wang
    • Honnappa Nagarahalli
    • Tina Tsou
    • Andrew Pinski
    • John Bromhead
    • Juraj Linkes
    • rkinsell
    • Nitin Saxena
  • Action Items - Last Week
    • Nitin: Run a VPP performance test to understand if the memcpy neon version provides any benefits. - Able to run with l3fwd test case. Gives better numbers.
    • Sirshak: Create a higher LF ticket so that it is easier for Trishan/Acton/Venessa/Mohammed to follow up on bringing up ThunderX/mcbin - Not Created yet as I think we are close to solving the issue. If its not solved after today's call will create the tkt.
    • Nitin: start email discussion with Dave to address the creation of single makefile for all ARMv8 devices. Still understanding cross compilation works. Communicating with Sachin.
  • New Joinees
    • Stanislav Chlebec - pantheon
  • fd.io lab
    • Follow up on ThunderX to getting mgmt IP - IP addresses are assigned, but are not up yet.- Have a call today to discuss this with Mohammed
    • USB to Ethernet Question: Andrew: shows up as Ethernet interface.
    • Release Machine to EdK as soon as ThunderX is up. - Sirshak to set mgmt IP and handover the machine.
    • Cavium has shipped more machines as well - Delivered a week back. Tina to follow up with Trishan: 2 Delivered. Sirshak to ask in todays meeting for status on new ThunderX.
    • See the Taishan setup for any VM issue. - Sirshak is trying to reproduce the issue. - Reproduced still debugging.
    • Khemendra : Topology is correct. Sirshak to ask about CSIT performance topology connection status.
    • Khemendra: Intel NIC to be used or Mellanox. HN: Intially use Intel later move to Mellanox.
  • VPP
    • VPP-1064 Dave Barach rejected the patch based on the solution Damjan and Nitin had decided upon following the reason that current approach breaks cross compilation. - NXP has upstreamed the DPAA2 patch, uses a separate segment makefile (dpaa.mk) for DPAA2. NXP does cross compilation most of the time. The approach could be that all platforms create a segment makefile and combine all of them into a single ARMv8 segment makefile. - Nitin Still discussing with Sachin regrading cross compilation
    • One solution suggested was creating a platform specific Makefile for ThunderX - Any Decisions - Same as above.
    • memcpy benchmarking updates honnappa - 2 more tests to be done based on Ola's suggestion. Nitin tested with restrict.
    • 1019: No update. Few rough edges to clean up.
    • 1021: Is it Closed ? Closed.
    • 1023: migrated to openssl using DPDK manual but facing failed TCs - openSSL is integrated in his local environment - VPP not stable in his environment - Updated in the ticket. Status: Aadarsh still trying to get help from community. Khem, Aadarsh to talk to Sachin regarding openssl issues.
    • 1043: No updates. Sirshak to investigate this.
    • 990: Brian Updates:
    • 1267: l3fwd performance tuning: Marvell to upstream a patch to enable dpdk on mcbin by making changes to dpdk plugin in vpp. Updates: natalie sent a email. Working on upstreaming changes to VPP for dpdk_plugin. Working on comparing musdk vs dpdk.
    • Auto-detection of memory channels: Startup conf solution decided. Updates: No updates not priorty now bug raised by Nitin.
    • Sachin facing issues with build rpm currently on 1801 will open a Jira Tkt if issues persists with 1804. Updates: Jira VPP-1276 to track this issue.
  • CSIT
    • Adarsh openssl issues: Will communicate with Sachin to get this reolved
    • Adarsh preparing a sheet updated with his progress on CSIT.
    • Performance Testing Khem : NUMA node numbering issue Updates: No updates. Still working internally.
    • Khem facing issues with trex installation on ARM hence he will try getting a x86 machine as TG. Updates: Still working on getting an x86 in internal lab.
    • brian to use cache stashing result. Updates:
  • Action Items - Next Week
    • Sirshak: To update LF RT #54919 to follow up on cavium-2 status. - having troubles with login will sort it out today.
    • Sirshak: Release Machine to EdK as soon as ThunderX is up: cavium-1 done cavium-2 still has issues with network connectivity.
    • Sirshak: Status on new ThunderXs: Will be decided after talks with Maciek.
    • Sirshak: vm unresponsive issue: No updates didnt get time to try will try this week.
    • Sirshak: To ask about CSIT performance topology connection status. - TBD after call with Maciek.
    • Nitin: VPP-1064 (Patch rejected by dave barach) Discuss cross compilation with Sachin. (Seperate or one unified Makefile).
    • HN: memcpy benchmarking updates honnappa - 2 more tests to be done based on Ola's suggestion.
    • Adarsh openssl issues: Will communicate with Sachin to get this resolved
    • Adarsh preparing a sheet updated with his progress on CSIT.


5/8/2018

  • Attendees
    • Honnappa Nagarahalli
    • Tina Tsou
    • Andrew Pinski
    • Natalie Samsonov
    • John Bromhead
    • Sachin Saxena
    • Khemendra Kumar
    • Andy Wang
    • Juraj Linkes
    • rkinsell
    • Nitin Saxena
    • Ed Kern
  • Action Items - Last Week
    • Sirshak: Follow up with Mohammed regarding ThunderX mgmt connectivity and mcbin - IP addresses allocated cavium-2 has IPMI connectivity but console still hanging. cavium-1,3 - Not able to connect to IPMI. - Create a higher LF ticket so that it is easier for Trishan/Acton/Venessa/Mohammed to follow up.
    • Sirshak to hold a call with Khem and Adarsh to understand the Vm_vhsot issue because of nested VMs - Contact established still working on analyzing the setup.
    • Sirshak to create consolidated ARM ecosystem xls to reflect CSIT effort. (Need to add the link to the excel sheet to AArch64 page) - Not Done will do it next week.
    • Honnappa: memcpy benchmarking - Micro benchmarks run on mcbin, qualcomm - vector Load/Store usually go to the LSU unit
    • Brian : CSIT-990(buildroot) - Nitin ran on mcbin, it is failing at a different place - Brian to continue next week
    • Brian to publish a pictorial representation of rx queues and tx queues in multicore case for mcbin. - Moved to next week
    • Khem to analyze make test failure in Taishan - 1804 - Tested with the latest code (make test), all test cases passing
    • ARM - For TG for deciding connectivity - MCBin and Taishan - Sirshak/Brian working on it.
    • Sirshak/Brian to recheck validity of ASLR issue. - Not Done. Next Week.
  • New Joinees
    • Yuval Caduri - from Marvell responsible for MUSDK driver - packet processor 8K chips
    • Natalie - responsible for network PMD DPDK driver
    • Dmitri Epshtein - Responsible for crypto driver expert
  • fd.io lab
    • Follow up on ThunderX to getting mgmt IP - IP addresses are assigned, but are not up yet.
    • Release Machine to EdK as soon as ThunderX is up.
    • Cavium has shipped more machines as well - Delivered a week back. Tina to follow up with Trishan.
    • See the Taishan setup for any VM issue. - Sirshak is trying to reproduce the issue.
  • VPP
    • VPP-1064 Dave Barach rejected the patch based on the solution Damjan and Nitin had decided upon following the reason that current approach breaks cross compilation. - NXP has upstreamed the DPAA2 patch, uses a separate segment makefile (dpaa.mk) for DPAA2. NXP does cross compilation most of the time. The approach could be that all platforms create a segment makefile and combine all of them into a single ARMv8 segment makefile.
    • One solution suggested was creating a platform specific Makefile for ThunderX
    • Honnappa Suggested as this not just a ThunderX issue but also Qualcomm issue hence a ARM specific Makefile would be better.(Issue 128 byte Cache Line Size)
    • Honnappa no update on memcpy benchmarking will do that next week
    • 1019: fixed in local will upstream soon - Patch has issues and some of the issues are fixed
    • 1021: Patch submitted centos env issue CSIT follow up. - This can be closed
    • 1023: migrated to openssl using DPDK manual but facing failed TCs - openSSL is integrated in his local environment - VPP not stable in his environment - Updated in the ticket.
    • 1043: No updates
    • 990: Brian to Retry on mcbin
    • 1267: l3fwd performance tuning: Marvell to upstream a patch to enable dpdk on mcbin by making changes to dpdk plugin in vpp.
    • Auto-detection of memory channels: Andrew's comment no really way to do that hence to go with making it a runtime argument via startup conf instead of being hard coded.
    • Sachin facing issues with build rpm currently on 1801 will open a Jira Tkt if issues persists with 1804.
  • CSIT
    • Adarsh stalled with failure of test cases after using openssl.
    • Performance Testing Khem : NUMA node numbering issue.
    • NUMA node no issue not seen in ThunderX. Khem to post the details of issue and the workaround on Taishan.
    • Khem facing issues with trex installation on ARM hence he will try getting a x86 machine as TG.
    • Nitin known issue with trex with arm and mellanox card.
    • Khem to try L2BD and L2XC.
    • brian to use cache stashing and see the results.
  • Action Items - Next Week
    • Nitin: Run a VPP performance test to understand if the memcpy neon version provides any benefits.
    • Sirshak: Create a higher LF ticket so that it is easier for Trishan/Acton/Venessa/Mohammed to follow up on bringing up ThunderX/mcbin
    • Nitin: start email discussion with Dave to address the creation of single makefile for all ARMv8 devices

5/1/2018

  • New Joinees
    • Natalie and Yuval from Marvell for engineering input.
  • fd.io lab
    • Follow up on ThunderX to getting mgmt IP
    • Release Machine to EdK as soon as ThunderX is up.
    • Cavium has shipped more machines as well.
    • See the Taishan setup for any VM issue.
  • VPP
    • VPP-1064 Dave Barach rejected the patch based on the solution Damjan and Nitin had decided upon following the reason that current approach breaks cross compilation.
    • One solution suggested was creating a platform specific Makefile for ThunderX
    • Honnappa Suggested as this not just a ThunderX issue but also Qualcomm issue hence a ARM specific Makefile would be better.(Issue 128 byte Cache Line Size)
    • Honnappa no update on memcpy benchmarking will do that next week
    • 1019: fixed in local will upstream soon
    • 1021: Patch submitted centos env issue CSIT follow up.
    • 1023: migrated to openssl using DPDK manual but facing failed TCs
    • 1043: No updates
    • 990: Brian to Retry on mcbin
    • 1267: l3fwd performance tuning: Marvell to upstream a patch to enable dpdk on mcbin by making changes to dpdk plugin in vpp.
    • Auto-detection of memory channels: Andrew's comment no really way to do that hence to go with making it a runtime argument via startup conf instead of being hard coded.
    • Sachin facing issues with build rpm currently on 1801 will open a Jira Tkt if issues persists with 1804.
  • CSIT
    • Adarsh stalled with failure of test cases after using openssl.
    • Performance Testing Khem : NUMA node numbering issue.
    • NUMA node no issue not seen in ThunderX. Khem to post the details of issue and the workaround on Taishan.
    • Khem facing issues with trex installation on ARM hence he will try getting a x86 machine as TG.
    • Nitin known issue with trex with arm and mellanox card.
    • Khem to try L2BD and L2XC.
    • brian to use cache stashing and see the results.
  • Action Items - Next Week
    • Sirshak: Follow up with Mohammed regarding ThunderX mgmt connectivity and mcbin.
    • Sirshak to hold a call with Khem and Adarsh to understand the Vm_vhsot issue because of nested VMs - Not done yet will do it next week.
    • Sirshak to create consolidated ARM ecosystem xls to reflect CSIT effort. - Not Done will do it next week.
    • Honnappa: memcpy benchmarking
    • Brian : CSIT-990(buildroot)
    • Brian to publish a pictorial representation of rx queues and tx queues in multicore case for mcbin. - Moved to next week
    • Khem to analyze make test failure in Taishan - 1804 - Next Week
    • ARM - For TG for deciding connectivity - MCBin and Taishan - Working on it.
    • CSIT 990 brian to try - Next Week
    • Sirshak/Brian to recheck validity of ASLR issue. - Not Done. Next Week.
  • Action Items - Last Week
    • Khem to ask mohammed, anton for power clearance for 2 new taishan. - Ok for Power Clearance
    • Sirshak to hold a call with Khem and Adarsh to understand the Vm_vhsot issue because of nested VMs - Not done yet will do it next week.
    • Sirshak and Brian to discuss on TG connectivity. - Done
    • Sirshak to create consolidated ARM ecosystem xls to reflect CSIT effort. - Not Done will do it next week.
    • Nitin: To post vlib_main 1804_rc2 issue to community. - Done
    • Sirshak : to check if vlib_main is a issue in centriq. - Done
    • Nitin: AI for creating Jira for number of memory channel identification. - Done
    • Brian to publish a pictorial representation of rx queues and tx queues in multicore case for mcbin. - Moved to next week
    • John B - 1G to USB adapters Ship to lab. - Done
    • Khem to analyze make test failure in Taishan - 1802 rc2 - Next Week
    • ARM - For TG for deciding connectivity - MCBin and Taishan - Working on it.
    • CSIT 990 brian to try - Next Week
    • Sirshak to take 1103 and 1114 - Done
    • Nitin to Create l3fwd tkt - Done
    • Brian to create a mcbin crash tkt. Next Week
    • Maen to provide contact for IO Stashing on mcbin. - Contacted Brian. Brian to provide further input.
    • Sirshak/Brian to recheck validity of ASLR issue. - Not Done. Next Week.

4/25/2018

  • Meeting Time
    • Proposed time 6-8am Tuesday PST.
    • Tina to update wiki with new meeting time.
  • FD.io lab
    • ThunderX
      • OS installed on ThunderX. Switch being sent.
      • 1 ThunderX booted.
      • Plan to use 1G to USB adapters.
      • Varun POC for Cavium.
    • Taishan
      • Its up and connected to Internet.
      • Build and make test 2 TCs failing (VCL TCs failing) - 1802 rc2 used.
      • Brian no update for TG - Meeting on it next week.
      • Khem to ask mohammed, anton for power clearance for 2 new taishan.
    • MCBin
      • Maen POC - To Contact Mohammed.
      • Maen to provide engineering contact for help to Nitin.
  • VPP
    • Round Table status on Porting tkts.
    • Nitin: vlib_main taking a lot of time on both mcbin and thunderx2
    • Sirshak to take on ARM tkts.
  • CSIT
    • Adarsh looking at IPv4 failed test cases with priorty.
    • Sirshak to hold a call with Khem and Adarsh to understand the Vm_vhsot issue because of nested VMs
    • Cavium to publish mcbin cist performance nos but low priority. Nitin faced build-root issue with this.
    • Maciek to host a kick off call.
    • Sirshak and Brian to discuss on TG connectivity.
    • Sirshak to create consolidated ARM ecosystem xls to reflect CSIT effort.
  • Performance Benchmarking
    • Nitin: To post vlib_main 1804_rc2 issue to community.
    • Nitin: vlib_main issue in mcbin and thunderx2 at different points within the function. Not a hotspot in x86.
    • Sirshak : to check if vlib_main is a issue in centriq.
    • Nitin: AI for creating Jira for number of memory channel identification.
    • AI for creating Jira for the crash on Mcbin – Brian
    • Khem to get started on CSIT performance suite this week and publish on shared xls.
    • Brian to publish a pictorial representation of rx queues and tx queues in multicore case for mcbin.
  • Action Items - Last Week
    • Sirshak to add link to xls to wiki page. - Done by somebody else.
    • Brian to raise LF RT ticket about MACCHIATObins - Done. Pinged Mohammed yet hear back from him.
    • Nitin to check 'make test' on MACCHIATObin (16GB DRAM) - Failed. Error related to Python scripts.
    • Honnappa, Khem to check Clang build on arm64. - Tried clang build on Centriq made some changes still fails. clang on x86 has errors still passes. 'make test' fails on x86. Jira Card to be created - AI(Sirshak). Khem to try.
  • Action Items
    • John B- 1G to USB adapters Ship to lab.
    • Khem to analyze make test failure in Taishan - 1802 rc2
    • ARM - For TG for deciding connectivity - MCBin and Taishan
    • CSIT 990 brian to try
    • Sirshak to take 1103 and 1114
    • Nitin to Create l3fwd tkt
    • Brian to create a mcbin crash tkt.
    • Maen to provide contact for IO Stashing on mcbin.
    • Sirshak/Brian to recheck validity of ASLR issue.
    • Sirshak to track down issues.

4/18/2018

  • FD.io lab
    • Temporarily borrow 1x ThunderX to be used for ONAP demo at OpenStack Summit (end of May)? Yes.
    • OS exists on ThunderXs; Varun will keysign with EdW; need to resolve OS netdev connectivity over 10/40GbE
    • OS exists on TaiShan2280; no connectivity to the Internet
  • VPP
    • RC2
      • 'make' passes, 'make test' fail, 'make test-all' ??? - MACCHIATObin (4GB DRAM)
      • 'make' passes, 'make test' pass, 'make test-all' fails - Centriq
      • 'make' passes, 'make test' pass, 'make test-all' fails - x86
    • Build
      • Testing Verify and Merge jobs for 18.04 master on arm64 today
      • Clang build fails on arm? 'CC=clang CXX=clang make'
  • CSIT
    • Adarsh updated CSIT status in xls
    • CSIT-1023: decided to go with OpenSSL instead of ARMv8 crypto library, in DPDK, due to number of algorithms supported
      • e.g. AES-GCM not supported by ARMv8 crypto library
    • Nitin updated CSIT-990 (buildroot) with more information
  • Action Items
    • Sirshak to add link to xls to wiki page.
    • Brian to raise LF RT ticket about MACCHIATObins
    • Nitin to check 'make test' on MACCHIATObin (16GB DRAM)
    • Honnappa, Khem to check Clang build on arm64

4/11/2018

  • Proposal to keep meeting at current time with additional overflow meeting at 8AM PST
  • FD.io lab
    • MACCHIATObins just arrived at VEXXHOST
    • Nitin working on getting IPMI login credentials to provision OS on ThunderX
    • Need to connect Skylake TG machines to Arm machines
      • ETA: 1wk
    • Khem working with Aton (LF) to provision OS on TaiShan2280
      • ETA: 1wk, Ubuntu 17.10
  • VPP
    • Brian to do more benchmarking on MACCHIATObin
    • Khem working on benchmarking clib_memcpy64_x4()
  • CSIT
    • Lucian submitted patches for CSIT-1019, CSIT-1021
    • Lucian looking for contact for ARMv8 crypto driver in DPDK for CSIT-1023
      • See CSIT-1023 for details; looks like DPDK issue?
    • Nitin to add more details to CSIT-990
  • Action Items
    • Sirshak to move JIRA tickets to xls
    • Lucian to work with Nitin/Jerin on CSIT-1023

4/4/2018

  • Propose to move the meeting +2 hours?
  • RC1 cut today
  • FD.io lab
    • Allocate 3 ThunderX for EdK to integrate into CI
      • JohnB from Cavium agreed to supply 3 more ThunderX for CSIT (will pre-install FW & OS)
    • Brian working on provisioning SSDs for MACCHIATObins
    • Khem can ping IPMI interfaces on TaiShan2280s; also needs an OS to be installed
  • VPP
    • Discussed ONS slides
    • Khem has patch for clib_memcpy64_x4() and needs help benchmarking
  • CSIT
    • Lucian found and created JIRA tickets for 3 issues while running CSIT
    • Nitin created JIRA ticket for buildroot issue
    • Khem seeing issues with VM
  • Action Items
    • Nitin/Varun to help provision Ubuntu 16.04 and firmware update on ThunderX machines

3/28/2018

  • Sachin Saxena from NXP joined the call, welcome
  • FD.io lab
    • Khemendra is having issues with Rudy's emails. Hence, not been able to access Taishan servers
    • Nitin will try to access the servers this week
    • MACCHIATObin setup under progress
    • OD1000 is added to Jenkins slave. The build is failing currently. The build can be triggered manually.
  • VPP
    • Discuss Single core, L3Fwd sample perf numbers and analysis next week
    • Sachin is working on compiling 18.01. Native compilation works fine, cross compilation is failing
    • Nitin still working on patch for cache line size
    • VPP-1126 is being used in DPDK input node. Khemendra will take a look at it this week.
    • VPP-1129 Brian/Sirshak will take a look. Looks like it can be closed.
    • VPP-1114 Patch under internal review
  • CSIT
    • Khemendra having issues with interface bring up failing intermittently. Nitin suggested to add delay.
    • Nicolas/Lucian debugging TC-07
    • Khemendra having issues with TG VM crashing randomly with Ubuntu 16.04, QEMU 2.10. Solved by moving to Ubuntu 17.10, QEMU 2.10
    • Nitin using Ubuntu 16.04 with 4.13 kernel
  • Action Items
    • Discuss Single core, L3Fwd sample perf numbers and analysis next week - Brian
    • VPP-1126 Take a look this week as it affects DPDK input node - Khemendra
    • Need more attention on solution for buildroot issue, need more information on failure CSIT-990 - Nitin
    • Create an excel sheet with the test case status - Nicolas/Lucian

3/21/2018

  • Key signing party! Thank you Ed!
  • FD.io lab
    • VEXXHOST currently working on getting another PDU because there are not enough power ports
    • Received SSDs for MACCHIATObins
  • VPP
    • Discuss high level plan for VPP on Arm
    • Nitin still working on patch for cache line size
  • CSIT
    • Need more attention on solution for buildroot issue CSIT-990
    • Nitin moving towards L2 & L3 perf test cases
    • VM crash due to buffer overflow when multiple VMs share NVRAM; resolved in Fedora27

3/14/2018

  • Key signing party! Thank you Ed!
  • FD.io lab
    • ToR switch issue resolved; confirm mgmt IP address assignment to racked Huawei/Cavium machines
    • Started provisioning MACCHIATObins; Andy ordered SSDs to go with them
  • VPP
    • No updates
  • CSIT
    • Adarsh started running CSIT on virtual topology; moved past a paramiko issue, seeing other test failures
    • Ongoing discussions on getting Adrian access to machines

3/7/2018

  • FD.io lab
    • Trishan (LF) to help follow up on progress in FD.io lab
  • VPP
    • More discussion on patch for cache line size; use MIDR register exported by proc fs
    • Decision has been made to use wrappers for atomics
    • Damjan reworked PCI handling code and added native driver for Intel AVF (XL710 i.e. Fortville)
      • Measuring 132 clocks per packet on Skylake (ip4 routing) with VLIB_FRAME_SIZE 256 (default); +1Mpps over DPDK avf/i40e PMD
    • Damjan reworked memcpy() in MEMIF; achieve 2x25GbE line rate with these changes
    • Sirshak working on getting VPP running on Qualcomm Centriq with Mellanox NIC
      • Seeing issues with external DPDK; static works but not shared; is VPP build system missing -libverbs -lmlx5 in LDFLAGS?
      • Nitin noticed DPDK 17.11 Mellanox PMD does not compile
      • Mellanox recently submitted a patch to VPP to support dynamic loading of Mellanox libraries
  • CSIT
    • Adrian does not have machines to work with in Bucharest; machine in Paris that Gabriel was using no longer available
      • AndyW to help resolve
    • Adarsh moved past VM issues; able to launch VPP in VM with virtio interface; starting to run CSIT scripts

2/28/2018

  • FD.io lab
    • Ed Kern to try containerized CI on one OD1000 in parallel with Vanessa
    • Received MACCHIATObins in Austin
  • VPP
    • Adarsh trying to run VPP in VM but getting PCI mapping issue; trying to connect to Linux bridge on host
    • Patches for build breakage were committed; arm64 build stable now
    • Brian able to reproduce low PPS numbers seen on MACCHIATObin
  • CSIT
    • Adarsh can reproduce a crash in qemu 2.10 Ubuntu 16.04; going to try Ubuntu 17.10
    • Need to partition func test cases across people

2/21/2018

  • FD.io lab
  • CSIT
    • Gabriel updated CSIT/AArch64 wiki with PASS/FAIL/OTHER list
      • OTHER - failure due to expect-like parsing of output(?)
      • FAIL - ssh timeout during PCIe rescan(?)
    • Moved past first UEFI crash; still seeing crashing on startup (Gabriel)
      • Setup new Ubuntu environment
      • Continue debugging UEFI issue on Fedora with JeremyL
    • Ubuntu is used pretty much everywhere except for additional CentOS CSIT perf
    • Nitin working on upstreaming changes to CSIT
    • Adarsh working on getting VM interfaces working
  • VPP
    • More discussion on how to handle cache line size
    • Sync'd on patches for build breakage

2/14/2018

  • FD.io lab
    • Working on getting access to LF lab in order to setup OD1000 environment
    • Check with tykeal & zxiiro on trust policy for getting others access (Brian)
    • VEXXHOST
      • Mohammed says they do not have extra rack shelf - we need to send one for 3x MACCHIATObin
      • LF RT tickets: #52434 (ThunderX), #52435 (TaiShan2280), #52436 (MACCHIATObin)
  • VPP
    • Build, unit test, deb/rpm
      • 64B/128B cache line size - working on passing this configuration to rest of build system i.e. DPDK (Nitin)
      • RPi3 32-bit
        • Some parts of patch are 32-bit related, some RPi3 related
        • If there is justification, look into maintaining a 32-bit build on ARM
    • Porting & Tuning
      • If patches need to be tested on multiple Arm chips, please use DO_NOT_MERGE and Code Review -2
      • Two NEON related patches merged, working in progress on others, Nitin testing CLASSIFY_USE_SSE
  • CSIT
    • Please open JIRA ticket with details on VM crashing on startup. DONE: CSIT-922
    • Khem working on running VPP func tests on internal setup

2/7/2018

  • LF lab
    • OD1000 - last machine was racked; Vanessa needs credentials
    • Taishan2280 - machines arrived at Vexxhost; confirm with Rudy/Mohammed
    • ThunderX - machines arrived at Vexxhost; send board details to Mohammed
    • MACCHIATObin - boards arrived in Arm SJC waiting for enclosures (Andy)
  • Build, unit test, packaging
  • VPP
    • NEON usage in vhost - sent first patch for review (Nitin)
      • Need to verify how it performs on other Arm-based machines (Brian)
      • VPP maintainers prefer to use SIMD wrappers, but it might not always be possible
        • Cavium/Arm had to rewrite algorithm for AArch64 instead of use SIMD wrappers in DPDK
    • CLIB_HAVE_VEC128 - working on it (Gabriel)
    • Discussed compiler builtins for atomics in VPP call; need to spin another patch with wrappers based on architecture (Kevin)
    • Seeing prefetch hostspots on TX2+MlnxCX4en (similar to Armada8040) (Nitin)
  • CSIT
    • libvirt crashing on VM startup (Hierofalcon) (Gabriel)
      • Need someone who can reproduce this issue (Arm TBD)
    • Huawei also seeing VM issues (Khem)
    • buildroot doesn't work on Arm (Nitin)
      • Root issue: no support in GRUB for AArch64 in buildroot (?)
        • Need someone who can reproduce this issue (Arm TBD)
      • Peter Mikus replied to Nitin on csit-dev mail list
      • Using a temporary workaround: use a different VM image (Ubuntu Cloud) instead of one produced by buildroot
        • Working on patching DPDK in VM image (Ubuntu Cloud) just like done in buildroot
  • Misc
    • OpenFlow (Nitin, Damjan)
      • Is there an OpenFlow agent for VPP, and can VPP implement OpenFlow rules/tables?
      • VPP is not flow-based like OVS is; they are different
      • Can ODL/Honeycomb be used?

1/31/2018

  • LF lab
    • OD1000 - 1 replacement being installed this week
    • Huawei & Cavium boards should arrive at colo this week; confirm with Rudy
  • Build, unit test, packaging
    • Kubeproxy/NAT failures
      • Not arch related
      • Part of extended unit tests, so does not block CI
    • `make test` passes on D03 & D05 (Ubuntu)
  • MACCHIATObin
    • Seeing hotspots in VPP graph nodes
      • L3 forwarding - ip4 rewrite node
      • L2 cross-connect
      • Try reducing quad loop to a dual loop
      • dpdk-input node highly opt for x86 (could contribute to low perf) but hotspots still in rte_mbuf_t conversion(?)
    • Some examples of runtime code selection based on uarch exist in the codebase
  • CSIT
    • Adrian Oanca join from Enea
    • Gabriel seeing VM crashing during boot; related to # interfaces assigned (6)
    • Nitin ran into issue with buildroot on arm64; see thread on csit-dev

1/24/2018

  • VPP
    • DPDK issue with non-pci network cards
    • build & test status updated
    • VPP-1127 (VEC_128 enable) under discussion. Should we enable this by default ?
    • add Nitin to review Neon commits
    • VPP-1114 currently internal review
    • VPP-1064 under rework after review by Damjan
  • CSIT
    • first 3-nodes functional tests status list
    • TODO Gabriel: share CSIT VM setup env
    • nested VM: build-root package support for ARM. Create Jira ticket for Brian.

1/17/2018

  • Tina to send calendar invite for meeting
  • FD.io lab
    • Cavium shipping
  • VPP
    • Kubeproxy tests failing
    • Khem trying to find out the PCIe address for a given netdev interface
  • CSIT
    • Gabriel setting up 3 node topo with VMs
    • Gabriel working on PASS/FAIL status
  • CSIT 17.10 report

1/10/2018

  • Meeting moved 2 hours earlier - 6AM PT / 3PM CET / 7:30PM IST / 10PM CST
  • FD.io lab
    • Cavium ThunderX shipping soon
  • VPP
  • CSIT
    • Gabriel's patch for aarch64 support in CSIT merged
    • VirtualBox not supported on Arm / Vagrant unknown
      • This is OK for upstream since automation expects VMs to already exist
  • Performance
    • Need plan for 1T; use TaiShans that were sent to lab
  • AIs
    • Brian: Follow up with Vanessa and EdW regarding 'resource issue'
    • Gabriel: Update CSIT wiki page; which tests are passing/failing?
    • Brian: Check with Vanessa how to split machines between CI jobs and CSIT jobs

1/3/2018

  • FD.io lab
    • One OD1000 sent for RMA
    • Huawei PO sent out
    • Cavium PO sent out (?)
  • VPP
    • Gabriel working on patch for "show cpu" to display MIDR as human readable
    • Nitin sent preliminary patch for vhost-user NEON impl
      • Seeing perf differences on different cores; tradeoff is single-threaded perf vs. NEON
    • Kumar built and unit test successfully on D03
    • Nitin to resume patch for supporting different cache line sizes for the same arch
  • CSIT
    • Gabriel cleaned up WIP patch; ready for review
    • Kumar starting CSIT func tests with Ubuntu VMs
      • Scripts for running on dedicated hardware need to be modified, e.g. PCIe resources
    • Kumar to send doc on testing
  • Performance
    • Kumar to start thread on performance testing
  • AIs
    • Brian: Check with Tina on shipping and open LF RT ticket once they have arrived
    • Brian: Need a way to choose either SW or NEON impl based on chip
    • Gabriel: Create list of broken CSIT tests for 2-node topology

12/20/2017 No meeting next week - Dec 27

  • FD.io lab
    • OD1000s - build only
      • 1 of 3 needs to be RMAd
      • Can these be up in time to show 'make test' passes on ARM for 18.01 release report?
    • TaiShan
      • PO in progress
    • ThunderX - build only
      • PO went out
  • VPP
    • Patches / JIRAs
      • Patch for extended test failure, but still more (new) extended test failures - Gabriel
      • Nitin to post vhost-user.c changes for NEON
        • Nitin will finish Gabriel's original NEON patch to add CLIB_HAVE_VEC_128
    • Can we share code on Github e.g. NEON perf tests?
  • CSIT
    • Leading question: How many CSIT test cases are passing/failing?
    • Environment issues preventing running through all CSIT test cases; Gabriel needs dedicated machines or more RAM
    • Cavium & Huawei will join Gabriel in CSIT replication on ARM hardware next week
      • Cavium previously ran vhost test cases manually, now moving to CSIT

12/13/2017

  • VPP
    • Quick overview of work items
    • Waiting to hear back from LF about OD1000 connectivity
      • Changes needed to ci-mgmt
  • CSIT
    • Starting to reproduce CSIT on x86 and ARM (with Gabriel's WIP patch)
      • Some issues with environment variables (perf tests on 2-node)
    • Need Nexus to support aarch64 packages
      • Need a contact for Nexus
  • Share known issues on wiki!
  • Request CSIT 'deep dive'

12/06/2017

11/29/2017

  • VPP
    • vhost-user.c - SSE4.2 only. Implement range search using NEON. (nitin)
    • OD1000 status ?
      • build only
      • can we access them ?
      • what wan we do to help in general ?
    • x86 intrinsic review
    • build VPP on ARM VM on x86
  • CSIT
    • what platforms wil lbe made available

11/22/2017

  • VPP CI
    • 3 ThunderX for Chrismas
  • CSIT
  • Next steps
    • VPP
    • CSIT
      • structure work & send email (Gabriel)
      • is xxhash vs crc32 finished ? (Gabriel)
      • ask Maciek & setup a presentation meeting with someone from CSIT (Tina)
      • find a time to reschedule this meeting before the CSIT weekly call (Brian)

11/15/2017

  • VPP upstream status
    • build && build-release OK
    • "make test" && "make test-debug" OK
    • packaging:
      • Ubuntu 16.04 OK
      • Ubuntu 17.10 ? (TBC)
      • fedora-26 OK
  • vpp continuous test
    • all task required for jenkin's "verify" job are ready
    • TODO: request gerrit hook to Dave Barachs / vpp-dev (NB & GG)
    • set up ci in fdio lab
  • CSIT
    • setting up env
    • ThunderX platforms should arrive this week
    • csit work sharing

11/8/2017

  • Unit tests
    • Tests pass except for random initialization failures
    • Need to hear back from upstream about Extended unit tests
  • Should we run plugins such as NSH SFC?
  • Hardware to lab
    • Huawei h/w stalled
    • 3x ThunderX shipping to FD.io lab
  • CSIT replication
    • Cavium replicating on ThunderX2; getting started
  • Let's track our work in Jira; Brian to migrate tasks to Jira

10/25/2017

  • Gabriel working on vpp init failure in linux_pci_init()
  • Kumar to check with GeorgeZ on Huawei boards shipped to CSIT; need to verify tests also on this environment (package versions from distro)
  • Brian to check whether anything else needs to be done besides 'make test' for upstream enablement
Retrieved from "https://wiki.fd.io/index.php?title=VPP/AArch64&oldid=9053"