Difference between revisions of "VPP/AArch64"

Revision as of 05:23, 16 October 2018 (view source) Sirshakd (Talk | contribs) (→‎Meeting Minutes) ← Older edit		Revision as of 13:19, 16 October 2018 (view source) Sirshakd (Talk | contribs) (→‎Meeting Minutes) Newer edit →
Line 299:		Line 299:
	* VPP		* VPP
	** Vectorization		** Vectorization
−	***	+	*** [Lijian] Studying about Vectorization and Memory ordering.
	** Memory Ordering:		** Memory Ordering:
	*** [Sirshak] One patch up-streamed. Relaxed memory ordering patch being reviewed internally.		*** [Sirshak] One patch up-streamed. Relaxed memory ordering patch being reviewed internally.
	* CSIT		* CSIT
	** VPP Path		** VPP Path
−	***	+	*** Should be deployed on 25th Oct after 1810 release.
		+	*** We need to check RC2 after 17th of october [Juraj and Sirshak].
	** VPP Device		** VPP Device
−	***	+	*** Waiting for ThunderX2 NICs. Mcbin has issues with 2 VPP instances and traffic being sent.
	** Performance Test		** Performance Test
		+	*** No updates
	* FD.io lab		* FD.io lab
	** QSFP+ switch for Cavium blades. - Recieved		** QSFP+ switch for Cavium blades. - Recieved
−	** NICs and wires for ThunderX2 -	+	** NICs and wires for ThunderX2 - Andy to confirm that the NICs have been sent. Juraj LF tkt to be opened.
−	** Power Cycler to be ordered by LF -	+	** Power Cycler to be ordered by LF - Its available and should be operational this week.
	* Documentation		* Documentation
−	**	+	** Scott has reviewed the changes from Lijian he will merge it this week after few modifications of his own.
	* Action Items - Next Week		* Action Items - Next Week
	**		**

---

Revision as of 13:19, 16 October 2018

Get Involved

Meeting Details

• Regular AArch64 meeting: Tuesdays at 06:00 PT (Pacific Time) (weekly). Convert to your timezone.
  • FD.io Zoom Meeting room

IRC Channel

#fdio-arm on freenode.net

Jira

Jira issues with ARM64 label

Presentations

• The path to Fast Data on Arm [pdf] - FD.io Mini-Summit at KC+CNC EU 2018

Release Milestones

18.10

18.07

18.04

• CI
  • Upstream patch verification on ARMv8 machines
  • .deb packages

Machines

The FD.io lab is hosted at VEXXHOST colocation centre in Montreal Québec, Canada.

• CI build servers integrated into Jenkins

• CSIT test beds (under construction)

Platform	Role	Status	Hostname	IP	IPMI	Cores	RAM	Ethernet	Distro
SoftIron OverDrive 1000	CI build server	Running in CI	softiron-1	10.30.51.12	N/A	4	8GB		openSUSE
	CI build server	Running in CI	softiron-2	10.30.51.13	N/A	4	8GB		openSUSE
	CI build server	Running	softiron-3	10.30.51.14	N/A	4	8GB		openSUSE
Cavium ThunderX	CI build server	Running in CI	nomad3arm	10.30.51.38	10.30.50.38	96	128GB	3x40GbE QSFP+ / 4x10GbE SFP+	Ubuntu 16.04
	CI build server	Running in CI	nomad4arm	10.30.51.39	10.30.50.39	96	128GB	3x40GbE QSFP+ / 4x10GbE SFP+	Ubuntu 16.04
	CI build server	Running in CI	nomad5arm	10.30.51.40	10.30.50.40	96	128GB	3x40GbE QSFP+ / 4x10GbE SFP+	Ubuntu 16.04
	CI build server	IP not configured	c2-n2	10.30.51.65	10.30.50.65	96		2xQSFP+ / USB Ethernet	Centos7
	CI build server	Running	fdio-cavium5	10.30.51.66	10.30.50.66	96	256GB	2xQSFP+ / USB Ethernet	Ubuntu 16.04.4
	CI build server	Running	fdio-cavium6	10.30.51.67	10.30.50.67	96	256GB	2xQSFP+ / USB Ethernet	Ubuntu 16.04.1
	CI build server	Running	fdio-cavium7	10.30.51.68	10.30.50.68	96	256GB	2xQSFP+ / USB Ethernet	Ubuntu 16.04.1
Huawei TaiShan 2280	CSIT testbed	Running	s15-t33-sut1	10.30.51.36	10.30.50.36	64	128GB	2x10GbE SFP+ Intel 82599 / 2x25GbE SFP28 Mellanox CX-4	Ubuntu 17.10
	CSIT testbed	Running	s16-t33-sut2	10.30.51.37	10.30.50.37	64	128GB	2x10GbE SFP+ Intel 82599 / 2x25GbE SFP28 Mellanox CX-4	Ubuntu 17.10
Marvell MACCHIATObin	CSIT testbed	Need TG connections	s20-t34-sut1	10.30.51.41	10.30.51.49, then connect to /dev/ttyUSB2	4	16GB	2x10GbE SFP+	Ubuntu 16.04.4
	CSIT testbed	Need TG connections	s21-t34-sut2	10.30.51.42	10.30.51.49, then connect to /dev/ttyUSB1	4	16GB	2x10GbE SFP+	Ubuntu 16.04.4
	CSIT testbed	Need Port0-Port1 connection	fdio-mcbin3	10.30.51.43	10.30.51.49, then connect to /dev/ttyUSB0	4	16GB	2x10GbE SFP+	Ubuntu 16.04.5

Note: to get lab access, open a ticket at https://rt.linuxfoundation.org/

CI

Covers automated build, unit test, and packaging for various Linux distros on ARMv8 machines.

Jenkins job	Status	Description
vpp-arm-verify-master-ubuntu1604	Running	xxx
vpp-arm-merge-master-ubuntu1604	Running	xxx
vpp-arm-verify-1804-ubuntu1604	Running	xxx
vpp-arm-merge-1804-ubuntu1604	Running	xxx

Next steps:

• make test added to verify jobs
• Clang build
• openSUSE Leap 15 | CentOS 7 | Ubuntu 18.04
• vpp-csit-verify-virl-master or equivalent CSIT functional testing

CSIT

Covers automated functional and performance integration testing on ARMv8 3-node and 2-node testbeds.

https://wiki.fd.io/view/CSIT/AArch64

Contiv-VPP

This Kubernetes network plugin uses FD.io VPP to provide network connectivity between PODs.

https://github.com/contiv/vpp

The installation guide of Contiv-VPP on Arm64 platform is

https://github.com/contiv/vpp/blob/master/docs/arm64/MANUAL_INSTALL_ARM64.md

Porting and Tuning Roadmap

• VPP Vectorization: Expanding the Neon Library for IPv4 forwarding code path - Sirshak/Lijian
• Tuning the quad loop/dual loop for small cores - Lijian
• General performance analysis and tuning of various graph nodes for IPv4 forwarding test case - Sirshak/Lijian
• Memory Ordering - Sirshak
• CSIT Performance Test - Khemendra
• CSIT Device Test - Juraj
• CSIT Path Test - Juraj

Known Issues

GCC 5.3 ICEs during FP register allocation. Please use GCC 5.4 or newer.

Activity

Recent Patches

vppinfra: Fix extendto_high aarch64 NEON api.	Merged 10/09		Sirshak Das
Support dynamic dual/quad loop selection on aarch64	Merged 10/01		Lijian Zhang
Enable verbose output during VPP cmake compiling	Merged 9/25		Lijian Zhang
dpdk_plugin: fix mlx5 build and runtime issues	Merged 9/27		Sirshak Das
Add and enable u32x4_extend_to_u64x2_high for aarch64 NEON intrinsics.	Merged 9/12		Sirshak Das
Add horizontal add (hadd) vector intrinsic via NEON.	Merged 9/11		Sirshak Das
Add u32x4_extend_to_u64x2 for aarch64 using NEON intrinsics	Merged 9/11		Sirshak Das
Replacing vtbl NEON intrinsic with rev NEON intrinsic for byte_swap.	Merged 9/11		Sirshak Das
Fix array bound failure in api_sr_localsid_add_del	Merged 8/30		Lijian Zhang
cmake: fix marvell plugin build	Merged 8/28		Brian Brooks
fix dpdk_plugin.so load failure with DPDK 18.08	Merged 8/23		Lijian Zhang
Fix a bug in function pipe_rx	Merged 8/17		Lijian Zhang
fix compiling warnings with GCC	Merged 8/17		Lijian Zhang
Update AArch64 CSIT machines into FD.io VPP docs	Merged 8/17		Lijian Zhang
Add support for shuffle vector intrinsic via Neon in ARM	Merged 8/1		Sirshak Das
Improve cpu { coremask-% } configure option	Merged 8/1		Yi He
Fix undefined symbol: fformat_append_cr in vat plugins loading	Merged 7/31		Yi He
pp2: increase recycle batch size	Merged 7/10		Brian Brooks
pp2: change default queue size	Merged 7/26		Brian Brooks
pp2: use configured RX queue size	Merged 7/10		Brian Brooks
Fix load_unaligned undefined and other possible build failures	Merged 6/26		Sirshak Das
Enable PMU cycle counter for graph node cycles			Sirshak Das
Fix clang compilation on aarch64: extraneous parentheses	Merged 6/13		Sirshak Das
Fix clang compilation on aarch64: value size does not match register size	Merged 5/30		Sirshak Das
Fix clang compilation on aarch64: sizeof operator error	Merged 5/30		Sirshak Das
Fix clang compilation on aarch64: replace -pie with -fPIE for dpdk compilation	Merged 5/30		Sirshak Das
dpdk: set dmamap iova address value according to eal_iova_mode	Merged 5/28		Sachin Saxena
Fixes make test errors with clang compiler on aarch64	Merged 5/27		Sirshak Das
Fix broken compilation for non-numa aware platforms	Merged 5/16		Sachin Saxena
build-data: Common makefile for NXP DPAA1/DPAA2 platforms	Merged 5/4		Sachin Saxena
arm64: Avoid setting march to corei7 when Cross Compiling for ARM	Merged 5/4		Sachin Saxena
use restrict keyword		VPP-1126	Khemendra Kumar
Autotools: Autodetection of cache line size		VPP-1064	Nitin Saxena
add 'is_all_zero(x)' for NEON - fix build break	Merged 2/20		Adrian Oanca
u8x16_compare_byte_mask optimization	Merged 2/24		Adrian Oanca
Added u8x16,u32x4,u64x2 variants of _zero_byte_mask(x) for ARM/NEON platform	Merged 2/26	VPP-1129	Adrian Oanca
add CLIB_HAVE_VEC128 with NEON intrinsics	Merged 02/08	VPP-1127	Gabriel Ganne
Use neutral vector code for ethernet_frame_is_tagged	Merged 2/19		Damjan Marion
vhost: Added ARMV8 NEON version of function map_guest_mem()	Merged 2/7	VPP-1085	Nitin Saxena
vppinfra: use __atomic_fetch_add instead of __sync_fetch_and_add builtins		VPP-1114	Kevin Wang
Arm system counter cleanup	Merged 1/30	VPP-1125	Brian Brooks
svm: ... on autodetected VA space size (fixup again)	Merged 01/10		Gabriel Ganne
svm: calc base address on AArch64 based on autodetected VA space size (fixup)	Merged 01/10		Gabriel Ganne
svm: calc base address on AArch64 based on autodetected VA space size	Merged 01/09		Damjan Marion
show cpu microarchitecture	Merged 01/06		Gabriel Ganne
Fix Debian Packaging on AARCH64	Merged 01/06		Nitin Saxena
more extended tests fixes	Merged 12/16		Gabriel Ganne
Use crc32 wrapper	Merged 12/16	VPP-1086	Gabriel Ganne
implement clib_smp_pause() for arm and aarch64 platform	Merged 12/15	VPP-1066	Kevin Wang
make "test-all" target pass again (for all platforms)	Merged 12/13		Gabriel Ganne
fill "show cpu" Flag list on aarch64 platforms	Merged 12/06	VPP-1065	Gabriel Ganne
remove smp dead code	Merged 12/06	VPP-1066	Gabriel Ganne
net/virtio: support modern device id	Merged 11/28		Gabriel Ganne
use REV on aarch64 for endianness swapping	Merged 11/21	VPP-1067	Gabriel Ganne
armv8 crc32 - fix macro name	Merged 11/15		Gabriel Ganne
bier - fix node table declaration	Merged 11/14		Gabriel Ganne
Map SVM regions at a sane offset on arm64	Merged 11/10		Brian Brooks
bfd tests fix	Merged 11/07		Gabriel Ganne
debian packaging fix	Merged 11/06		Gabriel Ganne
lb test fix	Merged 10/31		Gabriel Ganne
conditional x86intrin.h inclusion	Merged 10/25		Gabriel Ganne
fix test_lb_ip4_gre6() cleanup	Merged 10/24		Gabriel Ganne
null-terminate some formatted string	Merged 10/20		Gabriel Ganne
lb plugin - fix format() type mismatches	Merged 10/16		Gabriel Ganne
Use AESNI=y only on x86_64 machines	Merged 10/14		Brian Brooks
Improved arm64 chip detection	Merged 09/11		Brian Brooks
Native arm64 build: dpdk/Makefile change	Merged 08/31		Brian Brooks

Meeting Minutes

10/16/2018

• Attendees
  • Sirshak Das
  • Juraj Linkeš
  • Lijian Zhang
  • Tina Tsou
  • Andy Wang
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] to try VPP performance suite to see change after Vectorization and Loop unrolling patch.
  • Remaining issues in L2 and IPv4 - Sirshak to try debug. Status: With inputs from Neale issue fixed.
• VPP
  • Vectorization
    • [Lijian] Studying about Vectorization and Memory ordering.
  • Memory Ordering:
    • [Sirshak] One patch up-streamed. Relaxed memory ordering patch being reviewed internally.
• CSIT
  • VPP Path
    • Should be deployed on 25th Oct after 1810 release.
    • We need to check RC2 after 17th of october [Juraj and Sirshak].
  • VPP Device
    • Waiting for ThunderX2 NICs. Mcbin has issues with 2 VPP instances and traffic being sent.
  • Performance Test
    • No updates
• FD.io lab
  • QSFP+ switch for Cavium blades. - Recieved
  • NICs and wires for ThunderX2 - Andy to confirm that the NICs have been sent. Juraj LF tkt to be opened.
  • Power Cycler to be ordered by LF - Its available and should be operational this week.
• Documentation
  • Scott has reviewed the changes from Lijian he will merge it this week after few modifications of his own.
• Action Items - Next Week

10/09/2018

• Attendees
  • Sirshak Das
  • Maciek Konstantinowicz
  • Juraj Linkeš
  • Lijian Zhang
  • Tina Tsou
  • Andy Wang
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Juraj] to try musdk enabled kernel. - Juraj retried it worked.
  • [Khem] to try VPP performance suite - Diff in nos based on previous patches.
• VPP
  • Vectorization
    • Do perf analysis of the compiled code i.e. compare code with buffer indices to buffer pointers code with and without in quad loop.
    • Lijian to rebase the patch and try a few experiments
    • Khem Updates: No updates.
    • Memory Ordering Patch reintroduced. Broken down into smaller patches and the first patch has been upstreamed, others will be phased in gradually.
• CSIT
  • VPP Path
    • Set up publicly accessible Cavium machine for debugging purposes
    • 2 tkts resolved by Neale.
    • Remaining issues in L2 and IPv4 - Sirshak to try debug; Neale will look into it in spare cycles
  • VPP Device
    • SRIOV reservation system code exists and is being tested
  • Performance Test
    • NDR issue Status:
    • Issues in ip4. Status:
• FD.io lab
  • QSFP+ switch for Cavium blades. - Has been shipped
  • NICs and wires for ThunderX2 - Wires have been shipped; NICs will be delayed
  • Power Cycler to be ordered by LF.
• Documentation
  • Started upstreaming, no response yet
• Action Items - Next Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] to try VPP performance suite to see change after Vectorization and Loop unrolling patch.
  • Remaining issues in L2 and IPv4 - Sirshak to try debug. Status: With inputs from Neale issue fixed.

10/02/2018

• Attendees
  • Sirshak Das
  • Honnappa
  • Juraj Linkeš
  • Lijian Zhang
  • Khemendra
  • Tina Tsou
  • Andy Wang
  • Honnappa
• Action Items - Last Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Khem] VPP-1391 - VPP 'make verify' failed on Huawei Taishan server: Similar failures to cavium setup.
  • [Sirshak] - mlnx patch merged.
  • [Sirshak] to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning. - Not needed.
  • [Juraj] to try musdk enabled kernel. - failing Sirshak to debug this.
  • [Lijian] to resolve upstream comments. - Patch merged up-streamed.
  • [Khem] to try VPP performance suite with Lijian's Patch. - No need can try with master now.
  • [Khem] To try to debug traffic flow form TG to DUT with current master. - No updates.
  • [Khem] To send current status. - Sent.
• VPP
  • Vectorization
    • Understand Performance degradation.
      • msb correct version.
      • ip4_forward buffer index to buffer pointers.
  • Tuning dual/quad loop
    • Patch merged.
    • Khem Updates: No updates.
• CSIT
  • VPP Path
    • 2 categories of failures primarily. 8 tkts opened.
  • VPP Device
    • shim layer to be leaner and most of the functionality will reside in jenkins-slave.
  • Performance Test
    • L2-basic(L2XC, L2BD) PDR, MDR passing. NDR has issues but debugged.
    • Issues in ip4.
• FD.io lab
  • mcbin - Sirshak to help debug connectivity issues
  • QSFP+ switch for Cavium blades. - Andy working getting a refurbished one.
  • Power Cycler to be ordered by LF.
• Documentation
• Action Items - Next Week
  • [Sachin] to introduce RFC for IPsec offload support in DPDK plugin.
  • [Juraj] to try musdk enabled kernel. - Juraj retried it worked.
  • [Khem] to try VPP performance suite - Diff in nos based on previous patches.

9/25/2018

• Attendees
  • Sirshak Das
  • Honnappa
  • Juraj Linkeš
  • Lijian Zhang
  • Khemendra
  • Tina Tsou
  • Andy Wang
  • Honnappa
• Action Items - Last Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. Khem to to measure verify and test timings.
  • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works. - Does not. Lijian suggested fix merged by damjan, Additional patch needed: under internal review.
  • [VPP performance Suite] shm issues seen sporadically. Not seeing currently.
  • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning. - Not done will do it this week.
  • Sirshak to send musdk instructions. - Done.
  • Juraj to try musdk enabled kernel and see if musdk and docker can coexist in the dirty kernel. - Trying them out.
• VPP
  • Mellanox NIC not working with VPP
    • [Sirshak] glue library not detected by VPP. Compiling static has cmake issues. - Fix done pending internal review.
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. Khem to try things suggested by Juraj.
  • Vectorization
    • Understand Performance degradation.
      • msb correct version.
      • ip4_forward buffer index to buffer pointers.
  • Tuning dual/quad loop
    • Patch upstreamed pending review.
    • Lijian to resolve upstream comments.
    • Khem to try VPP performance suite with Lijian's Patch. (affects 1 route configuration more than 10k routes.)
• CSIT
  • VPP Path
    • Current Test Cases Failure: 8
    • [Juraj] Mail sent regarding failures. Need community support regarding failures.
    • [Khem] To see if he can take up one test case failure and resolve it.
  • VPP Device
    • In case of 2 loopbacks we can use 2 physical devices.
    • Facing issues with console connection to mcbin.
  • Performance Test
    • [Khem] working on IPv4 testing failures with CSIT script. Will be starting on v4 suite. To debug at DPDK level and talk to VPP community.
    • [Khem] To try to debug traffic flow form TG to DUT with current master.
    • [Khem] To send current status.
• FD.io lab
  • mcbin - trying new kernel images to resolve connectivity issues.
  • QSFP+ switch for Cavium blades. - Waiting for reply from Anton.
• Documentation
  • Trevor to help with contiv documentation. - Trevor has made changes, Lijian has sent for comments.
• Action Items - Next Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server.
  • Sirshak - mlnx patch merged.
  • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning. - Not needed.
  • Juraj to try musdk enabled kernel. - failing Sirshak to debug this.
  • Lijian to resolve upstream comments. - Patch merged up-streamed.
  • Khem to try VPP performance suite with Lijian's Patch.
  • [Khem] To try to debug traffic flow form TG to DUT with current master.
  • [Khem] To send current status.

9/18/2018

• Attendees
  • Sirshak Das
  • Honnappa
  • Juraj Linkeš
  • Lijian Zhang
  • Tina Tsou
• Action Items - Last Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server, and requires steps on reproducing the issue from Juraj.
  • Lijian to update dual/quad loop code review per comments. - Resolved.
  • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works. - It doesnt. Send him a reminder.
  • Juraj to investigate the compiler versions on fd.io lab machines. Upgrade to latest GCC-7.3.
  • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.
  • Honnappa to confirm the if we order NIC for ThunderX1, specify if they are external NICs.
  • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning.
  • Sirshak to send musdk instructions.
• VPP
  • Mellanox NIC not working with VPP
    • [Sirshak] glue library not detected by VPP. Compiling static has cmake issues.
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - make build-release and make test work. Khem to see if make verify is still failing.
  • Vectorization
    • [Sirshak] Patches submitted. Patch widening the usage has performance issues.
  • Tuning dual/quad loop
    • [Lijian] 3%- throughput improvement (mcbin).
    • Include mcbin nos in commit message.
  • [Khem] working on IPv4 testing failures with CSIT script
• CSIT
  • CSIT-1139 - parallelize 'make verify'
    • make verify - working. Test Failure still there
    • Juraj investigating FAILED test cases in make verify.
  • CSIT VPP Device updates
    • juraj to try musdk enabled kernel and see if musdk and docker can coexist in the dirty kernel.
  • CSIT Performance Test Suite Updates
• FD.io lab
  • mcbin issue
  • QSFP+ ports for Cavium blades.
• Documentation
  • Trevor to help with contiv documentation.
• Action Items - Next Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server, and requires steps on reproducing the issue from Juraj.
  • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works. -
  • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.
  • Sirshak to setup meeting with andy, tina and honnappa regarding fd.io lab purchase planning.
  • Sirshak to send musdk instructions.
  • Juraj to try musdk enabled kernel and see if musdk and docker can coexist in the dirty kernel.

9/11/2018

• Attendees
  • Honnappa Nagarahalli
  • Juraj Linkeš
  • Sirshak Das
  • Lijian Zhang
  • Tina Tsou
  • Khemendra Kumar
• Action Items - Last Week
  • Khem and Sachin to verify Sirshak's vectorization patches. - Ongoing(Khem)
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test. - Continue investigation on this issue.
    • [Juraj] sends his steps to Khem to reproduce this issue.
  • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.- Code review internally
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Juraj to investigate the compiler versions on fd.io lab machines. - No update
  • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev. - Not reproducible so far, will keep observing.
• VPP
  • Mellanox NIC not working with VPP caused by libmnl.so missing in cmake
    • [Sirshak]
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - make build-release and make test work. Khem to see if make verify is still failing.
  • Vectorization
    • [Sirshak] Patches ready and sent for review. Need arm community feedback on performance implications.
    • [Khem/Nitin] verify how those patches effect
  • Tuning dual/quad loop
    • [Lijian] Dual/Quad loop code change is under internal review. Sirshak gives some comments, and Lijian will update diff accordingly.
  • [Khem] working on IPv4 testing failures with CSIT script
• CSIT
  • CSIT-1139 - parallelize 'make verify'
    • Parallazation is stable and working fine. We might see feature improvement requirement or new bugs.
    • No new requirement so far.
  • CSIT VPP Device updates
    • Two tickets on VPP FD.io done. Have to verify to make sure they are working.
    • x86 has improvement and some experiments are done. Juraj will try those experiments on ARM platforms.
  • CSIT Performance Test Suite Updates
    • Facing issues with ip4 forwarding test case.
    • shm issues seen sporadically. Khem to send an email to vpp-dev.
• FD.io lab
  • 3 LF tkts - 1 Node Topology wiring mcbin, 3-node topology wiring Mcbin, 1-node Topology wiring Cavium. - Finished
• Documentation
  • Sirshak to take a look.
• Action Items - Next Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server, and requires steps on reproducing the issue from Juraj.
  • Lijian to update dual/quad loop code review per comments
  • Sirshak to verify if Damjan's suggestion on VPP compiling with Mellanox PMD driver works
  • Juraj to investigate the compiler versions on fd.io lab machines. Upgrade to latest GCC-8.2.0
  • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.
  • Honnappa to confirm the if we order NIC for ThunderX1, specify if they are external NICs

9/4/2018

• Attendees
  • Sirshak Das
  • Lijian Zhang
  • Tina Tsou
  • Khemendra Kumar
• Action Items - Last Week
  • Lijian to try merging it upstream - Mellanox Changes. - Resolved.
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin. - No updates.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test.
  • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.- Discuss Internally.
  • Juraj to investigate the compiler versions on fd.io lab machines. - No updates.
• VPP
  • VPP-1339 - Mellanox NIC not working with VPP. - Resolved
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - make build-release and make test work. Khem to see if make verify is still failing.
  • Vectorization
    • [Sirshak] Patches ready and sent for review. Need arm community feedback on performance implications.
  • Tuning dual/quad loop
    • [Lijian/Brian] Investigate dynamic function selection. Brian to looking at this.
• CSIT
  • CSIT-1139 - parallelize 'make verify'
    • No updates
  • CSIT VPP Device updates
    • No updates
  • CSIT Performance Test Suite Updates
    • Facing issues with ip4 forwarding test case.
    • shm issues seen sporadically. Khem to send an email to vpp-dev.
• FD.io lab
  • 3 LF tkts - 1 Node Topology wiring mcbin, 3-node topology wiring Mcbin, 1-node Topology wiring Cavium.
• Documentation
  • Sirshak to take a look.
• Action Items - Next Week
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server.
  • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.
  • Juraj to investigate the compiler versions on fd.io lab machines.
  • [VPP performance Suite] shm issues seen sporadically. Khem to send an email to vpp-dev.

8/28/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Juraj Linkes
  • Lijian Zhang
  • Tina Tsou
  • Khemendra Kumar
  • Honnappa Nagarahalli
  • Brian Brooks
• Action Items - Last Week
  • Khem to create Jira Tkt - startup-config issues (NUMA node and memory issues). Jira ID [VPP-1405]
  • Sirshak to ask Juraj to create a LF tkt for Power cycling. - Done
  • Lijian to follow up Mellanox issue. - Done. Patch Verified. To try merging it upstream.
  • Andy following up on cavium. - Done. Unavailability of resource from cavium. Box not priority right now, will take up later.
  • Khem to create Jira IDs for Jumbo frames. [CSIT-1259]In CSIT performance suite, Jumbo frames TCs failing on ARM servers
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin. - No updates, trying to resolve cmake issues.
  • Sirshak to add porting and tuning section to wiki. - Done
  • Sirshak/Juraj talk about Mellanox issue in CSIT call. - Done
• VPP
  • VPP-1339 - Mellanox NIC not working with VPP - Mellanox provided DPDK Patch ready, Lijian to try upstream it to VPP.
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test.
  • Vectorization
    • [Sirshak] Rough patch ready. Currently facing a crash due it.
  • Tuning dual/quad loop
    • Discussion ongoing with Damjan.
  • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.
  • Also to proceed with generic compilation to build for all micro architecture and do dynamic selection.
• CSIT
  • Juraj to investigate the compiler versions on fd.io lab machines.
  • CSIT-1139 - parallelize 'make verify'
    • Discussing with EdK, how to use that in jenkins job.
  • CSIT VPP Device updates
    • No problems. Trying basic package installation of container topology.
    • aarch64 vpp packages not built for 18.04 LTS, potential problem when we switch from 16.04->18.04.
  • CSIT Performance Test Suite Updates
    • No updates.
• FD.io lab
  • 3 LF tkts - 1 Node Topology wiring mcbin, 3-node topology wiring Mcbin, 1-node Topology wiring Cavium.
• Documentation
• Action Items - Next Week
  • Lijian yo try merging it upstream - Mellanox Changes.
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Khem VPP-1391 - VPP 'make verify' failed on Huawei Taishan server. - try make build-release and then make test.
  • Lijian to talk to Damjan regarding adding Architecture specific TAG in make.

8/21/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Juraj Linkes
  • Lijian Zhang
  • Andy Wang
  • Tina Tsou
  • Khemendra Kumar
  • Honnappa Nagarahalli
  • Brian Brooks
• Action Items - Last Week
  • [Sirshak] Create LF RT ticket for power cycling mcbins - Not Done yet
  • [Honnappa] Add module owners list and performance analysis items to wiki page - Discussion Still going on.
  • [Lijian] Check if DPDK 18.08 helps Mellanox NIC issues. - Waiting for patch from Mellanox
  • [Sirshak] Create Jira ticket to see impact of Florin's patch : VPP-1401
  • [Sirshak] Create Jira ticket for msb : VPP-1402
  • [Khem] Try dual loop ip4_lookup_inline patch to see if it helps on A72-based D05. : Problems with Ipv4 forwarding(startup-config issues- NUMA Node and Memory issues).
  • [Brian] LTN-10 - Help resolve VPP build failure on mcbins in FD.io lab
  • [Juraj] Enable VPP Device on 1-node SoC now that SFP+ cables have arrived. : No Response from LF.
  • [Sirshak] Follow up with Cavium regarding Ubuntu installation on cavium-4. Status: Andy Following up.
  • [Khem] Create Jira ticket for CSIT failures with jumbo frames
  • [Khem] Create Jira ticket for running a subset of tests via a tag : [CSIT1250]In ARM Perf verify CI, running a subset of tests via a tag
• VPP
  • VPP-1339 - Mellanox NIC not working with VPP
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan server
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Vectorization
    • Stalled due to Mellanox NIC issues as benchmarking patches is not posible.
    • hadd and msb - Done.
    • extendto and shuffle going on.
    • Shuffle using __built_in gives same performance as vector intrinsic as at -O2 neither compile tbl instruction.
  • Tuning dual/quad loop
  • Sirshak to add Porting and Tuning Section to Wiki.
• CSIT
  • CSIT-1139 - parallelize 'make test'
    • dave barach to take a final look and merge.
  • Sirshak/Juraj to talk about having Mellanox in CSIT seeing current compatibility issues post-release.
  • CSIT VPP Device updates
    • Trying to get the 1-node topology: mcbin and cavium thunderx.
  • CSIT Perfomance Test Suite Updates
    • Current issues: NDR, PDR Jumbo frames failure but MRR passing. Memory and Numa Nodes issues in Taishan.
• FD.io lab
  • 3 LF tkts - Ubuntu Installation cavium-4, 1 Node Topology, Power Cycling mcbins(to be opened).
• Documentation
  • Documentation changes by Lijian Merged.
• Action Items - Next Week
  • Khem to create Jira Tkt - startup-config issues (NUMA node and memory issues).
  • Sirshak to ask Juraj to create a LF tkt for Power cycling.
  • Lijian to follow up Mellanox issue.
  • Andy following up on cavium.
  • Khem to create Jira IDs for Jumbo frames.
  • Sachin to introduce RFC for IPsec offload support in DPDK plugin.
  • Sirshak to add porting and tuning section to wiki.
  • Sirshak/Juraj talk about Mellanox issue in CSIT call.

8/14/2018

• Attendees
  • Juraj Linkes
  • Lijian Zhang
  • Andy Wang
  • Tina Tsou
  • Khemendra Kumar
  • Honnappa Nagarahalli
  • Brian Brooks
• FD.io lab
  • SFP+ cables shipment showing as delivered
• VPP
  • VPP-1339 - Mellanox NIC not working with VPP
    • Lijian noticed DPDK version updated to 18.08 and might help - https://gerrit.fd.io/r/#/c/14154/
    • Tina helping find someone from Mellanox to help
  • VPP-1391 - VPP 'make verify' failed on Huawei Taishan servers
    • Khem looking into this
  • No updates on crypto
  • No updates on vectorization
  • Tuning dual/quad loop
    • DaveB suggests looking at MULTIARCH macros
• CSIT
  • CSIT-1139 - parallelize 'make test'
    • Juraj updated patch with comments from Klement
  • Khem seeing failures with jumbo frames
  • Khem noticed new CSIT machines using tag to run a subset of tests
• Documentation
  • Lijian working on patch to add Arm to Architecture section and Arm-based CSIT testbeds to CSIT section
• Action Items - Next Week
  • [Sirshak] Create LF RT ticket for power cycling mcbins
  • [Honnappa] Add module owners list and performance analysis items to wiki page
  • [Lijian] Check if DPDK 18.08 helps Mellanox NIC issues
  • [Sirshak] Create Jira ticket to see impact of Florin's patch
  • [Sirshak] Create Jira ticket for msb
  • [Khem] Try dual loop ip4_lookup_inline patch to see if it helps on A72-based D05
  • [Brian] Help resolve VPP build failure on mcbins in FD.io lab
  • [Juraj] Enable VPP Device on 1-node SoC now that SFP+ cables have arrived
  • [Sirshak] Follow up with Cavium regarding Ubuntu installation on cavium-4
  • [Khem] Create Jira ticket for CSIT failures with jumbo frames
  • [Khem] Create Jira ticket for running a subset of tests via a tag

8/7/2018

• Attendees
  • Sirshak Das
  • Juraj Linkes
  • Lijian
  • Andrew Pinski
  • Andy Wang
  • Tina Tsou
  • Nitin Saxena
  • Khemendra
  • Sachin Saxena

• General Topic
• Action Items - Last Week
  • [Khem] make verify on Taishan failure Status: No Status. Khem to create a Jira Tkt.
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: [Andy] Cables to be sent today.
  • [Sirshak] Open Jira tkt look at Florin's patch. Status: To be done next week
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status: Failing in different place, like rx-error reported to Mellanox people by Lijian. [Lijian] To send the mail vpp-dev. [Honnappa] To talk to DPDK Mellanox DPDK community.
  • [Sirshak] Share Mellanox settings with nitin.
  • [Sirshak] to send email to yi and lijian for documentation. Status: Lijian has done the documentation under internal review.
  • [Honnappa/Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: [Sachin] To include Nitin suggestions and upstream.
  • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status: Sirshak to open LF Tkt
  • [Nitin] Create a Jira Tkt - ip cksum 128 bit vector support. Status: Nitin using ip incremental cksum.
  • [Sirshak] To create a LF tkt for Ubuntu 16.04 installation on cavium-4. Status: Anton tried 16.04 but it didnt work, sent mail to Cavium contact for help.
• VPP
  • [Sirshak] Vectorization
    • msb is already implemented verifying correctness and performance.
    • [Sirshak] To raise a Jira Tkt for msb changes.
    • Have communicated to ARM compiler team related to vtbl performance.
    • planning to add cvt (extend_to) and hadd(horizontal) equivalents.
  • [Brian/Sirshak] Tuning Dual or Quad loop.
    • [Khem/Sachin] Updates on the changes seen after applying Brian's Patch. Status: No Updates.
  • [Sachin] To create Jira Card, DPDK IOVA issue. (Created VPP-1377)
  • [Honnappa] Module Ownership Discussion. Status: To come back to discussion next time. Community feedback to move to more use-case based approach.
• CSIT
  • [Juraj] Parallelizing the make test(CSIT-1139) Status: Scheduling Done, Waiting for community review, got some internal comments Juraj working on it. To try this patch on jenkins sandbox.
  • [Sirshak] replying to cavium regarding Ubuntu 18.04/16.04 installation problem cavium-4. Done. Status: Following up with Cavium
  • [Khem] Performance Suite: 64B, 9000Jumbo. Jumbo Frames is failing.(khem to jira tkt: startup.conf, Frame size, NIC Card, Hugepages configuration).
  • [Khem] Have a subset of tests running with tag.
  • [Juraj/Sirshak] VPP Device SoC one node topology constraints Status: Orchestration still under discussion.
• fd.io lab
  • [Juraj] mcbin access Status: Accessible mcbin build failing, wait fro Brian for help.
  • [Sirshak] cavium blades. Status: [Sirshak] Following up with cavium
• Documentation
  • Need to update the working ARM boards in the documentation section.
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Khem] make verify on Taishan failure, Khem to create a Jira Tkt. Status:
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status:
  • [Sirshak] Open Jira tkt look at Florin's patch. Status: Not done to be done next week
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
  • [Lijian] To send the mail vpp-dev (VPP-1339) Status:
  • [Honnappa] To talk to DPDK Mellanox DPDK community. Status:
  • [Sachin] To include Nitin suggestions and upstream.(ARMv8 Crypto changes) Status:
  • [Sirshak] To Open a LF Tkt regarding power cycler remote access fro mcbin. Status:
  • [Sirshak] To raise a Jira Tkt for msb changes. Status:

7/30/2018

• Attendees
  • Sirshak Das
  • Juraj Linkes
  • Lijian
  • Andrew Pinski
  • Andy Wang
  • Tina Tsou
  • Nitin Saxena
  • Khemendra
  • Sachin Saxena

• General Topic
• Action Items - Last Week
  • [Khem] make verify on Taishan failure Status: No Status
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: [Andy] Still working internally, expecting to be done this week.
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Status: Jira Tkt VPP-1355
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status: Yet to be verified , if fixed.
  • [Sirshak] look at Florin's patch. Status: No status, [Sirshak] Open Jira tkt.
  • [Tina] to get back on New ARMv8 Crypto. Status: Bob to schedule meeting with Cavium. To be tracked by Nitin, bob, tina.
  • [Sirshak] Why Quad to Dual loop improves performance. Status: VPP-1356
  • [Sirshak] To update VPP documentation with fd.io lab devices. Status: Not yet done. [Sirshak] to send email to yi and lijian.
  • [Sirshak] VPP Vectorization Jira Tkt. Status: VPP-1357
  • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Waiting for Nitin to help on changes for Internal DPDK. External DPDK support patch done. [Sachin : created VPP-1378] To create a Jira Tkt for Internal Tkt. [Honnappa] To comment on current gerrit item to get it moving.
  • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4. Status: Sent
  • [Sirshak] Get credentails from Brian for mcbin Status: Done
  • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status: Done
• VPP
  • [Sirshak] Vectorization
    • Almost done with shuffle.
    • Will get to working with msb.
    • AARCH32 compilation to be discussed.(Shuffle Vector Intrinsic AARCH64 ARMv8 specific)
    • There are no specific requirements on aarch32 at this time.
  • [Lijian && Yi] To continue effort on analyzing IPv4 nos on available platforms with Intel and Mellanox NICs
    • [Sirshak] Why is Mellanox NIC not used in CSIT ? Performance Suite Designed for Intel and Cisco NICs.
  • [Brian/Sirshak] Tuning Dual or Quad loop.
    • [Khem/Sachin] Updates on the changes seen after applying Brian's Patch. Status: No Updates.
  • [Khem] Updates on Benchmarking on taishan. Status: Held up hardware.
  • [Nitin] Any new findings from IPv4 VPP test case. Status: Working HW offloading.
  • [Sachin] To create Jira Card, DPDK IOVA issue. (Created VPP-1377)
  • [Lijian] ipcksum - No Degradation on Qualcomm.
  • [Nitin] Create a Jira Tkt - ip cksum 128 bit vector support.
• CSIT
  • [Juraj] Parallelizing the make test(CSIT-1139) Status: All VPP instances running on same core. Tried scheduling cores. Dynamically finding available cores. Sweetspot currently: 8 containers with 96 core.
  • [Juraj] Test features listed by talking to dave.
  • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4. Done. Status: To open a new LF tkt to ask for 16.04 installation.
  • [Juraj/Sirshak] VPP Device SoC one node topology constraints Status: Orchestration still under discussion.
  • [Sirshak] to ask brian about mcbin credentials. Status: Done.
• fd.io lab
  • [Juraj] mcbin access Status: Created LF tkt.
  • [Sirshak] cavium blades. Status: [Sirshak] To create a LF tkt for Ubuntu 16.04 installation on cavium-4.
• Documentation
  • Need to update the working ARM boards in the documentation section.
    • [Lijian/Yi] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).
    • [Lijian/Yi] Add only fd.io lab devices.
    • [Sirshak] To send email with details.
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Khem] make verify on Taishan failure Status:
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: [Andy]
  • [Sirshak] Open Jira tkt look at Florin's patch. Status:
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
  • [Sirshak] to send email to yi and lijian for documentation.
  • [Honnappa/Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status:
  • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status:
  • [Nitin] Create a Jira Tkt - ip cksum 128 bit vector support.
  • [Sirshak] To create a LF tkt for Ubuntu 16.04 installation on cavium-4.

7/24/2018

• Attendees
  • Sirshak Das
  • Juraj Linkes
  • Lijian
  • Andrew Pinski
  • Andy Wang
  • Tina Tsou
  • Nitin Saxena
  • Khemendra

• General Topic
  • .
• Action Items - Last Week
  • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break. Status: Nitin, compiler does not support arm neon intrinsics. Honnappa working with compiler team: neon intrinsics is supported #defines not present. Tmp solution available. Honnappa to follow up in DPDK.
  • [Nitin/Sachin] Follow up: Add Virtual addressing support in IOVA dmap Status: patch committed by sachin merged.
  • [Khem] make verify on Taishan failure Status: No updates.
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status: PO Approved. Should get going in few days.
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Status: Waiting for x86 hotspots for confirmation and will then open a ticket.
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status: Seems to be fixed but have not tried all the test cases to confirm.
  • [Sirshak] look at Florin's patch. Status: Not done yet
  • [Tina] to get back on New ARMv8 Crypto. Status: No updates. Close to complete but not upstreamed yet.
  • [Sirshak] Why Quad to Dual loop improves performance. Status: Not saturating no of outstanding prefetches. AI to raise a Jira Bug.
  • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin). Status; Not done yet.
• VPP
  • [Sirshak] vectorization patch effects
    • Made few changes no visible changes.
    • Plan to read mlnx drivers DPDK to understand how neon intrinsics accelerate the vectors.
    • Add Jira Tkt.
  • [Sirshak] Anamolies with mlx5 and VPP.
  • [Honnappa <-> Nitin] Nitin okay with ARM contacting Customer Support for help on TX2 optimal settings.
  • [Brian/Sirshak] Tuning Dual or Quad loop.
    • Visible change in A72.
    • Sirshak sent patch to Sachin and Khem to analyze if they see any improvement.
    • [Khem->Sirshak] Why moving form Quad to Dual improves performance.
  • [Lijian] x86 nos reported: 9.5 Mpps is not same as reported by Nitin Status: Could because of broadwell and skylake difference.
  • [Khem] Updates on IPv4 Benchmarking on taishan. Status: CSIT perfomance bringup on fd.io lab. 18.04 gcc 7.3 trex. Workaround done. DUT VPP crashing. Plan for running L2 test cases.
  • [Nitin] Any new findings from IPv4 VPP test case. Status: not available to discuss
• CSIT
  • [Juraj] Parallelizing the make test(CSIT-1139) Status: Sent for review, Figuring out optimal no of threads.
  • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4.
  • [Juraj/Sirshak] VPP Device SoC one node topology constraints Status: [Sirshak] Access to one of the three consoles.
  • [Sirshak] to ask brian about mcbin credentials.
  • [Adarsh] VPP Path/Device Efforts: Nested Container, trying VM inside a container facing some issues. Status: Work on hold as adarsh moved out of the project.
• fd.io lab
  • [Sirshak] Installation of TG pending. Status: Done
  • [Juraj] mcbin access Status: Two of them can be accessed the other 1 cant.
  • [Sirshak] cavium blades connected need SFP and DACs. Status: Up and running, still need SFP and DACs
• Documentation
  • Need to update the working ARM boards in the documentation section.
    • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).
    • [Sirshak] Add only fd.io lab devices.
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Khem] make verify on Taishan failure Status:
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status:
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Status: Jira Tkt VPP-1355
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
  • [Sirshak] look at Florin's patch. Status:
  • [Tina] to get back on New ARMv8 Crypto. Status:
  • [Sirshak] Why Quad to Dual loop improves performance. Status: VPP-1356
  • [Sirshak] To update VPP documenetation witrh fd.io lab devices. Status:
  • [Sirshak] VPP Vectorization Jira Tkt. Status: VPP-1357
  • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Last Status: Waiting for Nitin to help on changes for Internal DPDK. Current Status:
  • [Sirshak] replying to cavium regarding Ubuntu 18.04 installation problem cavium-4. Status: Sent
  • [Sirshak] Get credentails from Brian for mcbin Status: Done
  • [Sirshak] Send mail to LF for power cycler access for mcbin due to lack of IPMI interface Status: Done

7/17/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Khemendra Kumar
  • Juraj Linkes
  • Lijian

• General Topic
  • Austin Folks leaving early meeting. If needs be somebody can takeover after 1 hour (9 am CT).
• Action Items - Last Week
  • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break
  • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status: No updates.
  • [Khem] make test on Taishan timings: Status: Done. To look at why make verify.
  • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch. Status: Andy waiting for cables to reach him.
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Jira Tkt Status: Not yet done. Will do this week.
  • [Sirshak] DPDK 18.05 mlnx bug. Status: Sirshak to open Jira Tkt - VPP-1339
  • [Sirshak] look at Florin's patch. Status: Not yet done.
  • [Tina] to get back on New ARMv8 Crypto.
• VPP
  • [Sirshak] vectorization patch effects
    • Made few changes no visible change.
    • Plan to read mlnx drivers DPDK to understand how neon intrinsics accelerate the vectors.
  • [Brian/Sirshak] Tuning Dual or Quad loop.
    • Visible change in A72.
    • None in Qualcomm because of pfrm not being hotspot.
    • [Khem->Sirshak] Why moving form Quad to Dual improves performance.
    • Commmunity wide investigation needed.
  • [Lijian] x86 nos reported: 9.5 Mpps is not same as reported by Nitin Status: Investigation.
  • [Khem] Updates on IPv4 Benchmarking on taishan. Status: Stuck with pktgen.
  • [Nitin] Any new findings from IPv4 VPP test case. Status:
  • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Waiting for Nitin to help on changes for Internal DPDK.
• CSIT
  • [Juraj] Parallelizing the make test(CSIT-1139) Status: Almost done, need to work on polishing.
  • [Juraj/Sirshak] SoC devices as non voting VPP device targets. Status: [Sirshak] pending on TG credentials.
  • [Adarsh] VPP Path/Device Efforts: Nested Container, trying VM inside a container facing some issues. Status: No update, Adarsh replaced on the project; postponed
• fd.io lab
  • [Sirshak] Installation of TG pending. Status: No update from LF - Anton
  • [Sirshak] cavium blades connected need SFP and DACs. Status: Up and running, still need SFP and DACs
• Documentation
  • Need to update the working ARM boards in the documentation section.
    • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).
    • [ARM community] Waiting for feedback from Khem and other companies
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break Status:
  • [Nitin/Sachin] Follow up: Add Virtual addressing support in IOVA dmap Status:
  • [Khem] make test on Taishan failure Status:
  • [Sirshak] cavium(4,5,6,7) USB-Ethernet adapters to Quantta Switch. Status:
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Status:
  • [Sirshak] DPDK 18.05 mlnx bug(VPP-1339). Status:
  • [Sirshak] look at Florin's patch. Status:
  • [Tina] to get back on New ARMv8 Crypto.
  • [Sirshak] Why Quad to Dual loop improves performance.
  • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).

7/10/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Khemendra Kumar
  • Tina Tsou
  • Nitin Saxena
  • Juraj Linkes
  • Brian Brooks
  • Lijian
  • Tom Herbert
• General Topic
  • Austin Folks leaving early meeting. If needs be somebody can takeover after 1 hour (9 am CT).
  • [Tom] Aarch64 rpms not building - anyone can help?
• Action Items - Last Week
  • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status: No updates.
  • [Nitin] make test on Thunderx2 timings Status: Send error report of make test.
  • [Khem] make test on Taishan timings: Status: 22 mins. Try make verify.
  • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch. Status: Done for cavium 1,2,3. Need cables for 4,5,6,7. Cables ordered
  • [Khem] to update on nested VMs on performance test cases. Status: No updates. Could be a naming problem.
  • [Sirshak] Q to Maciek: buildroot image with VPP device(within container)? Status: No updates. Check with Brian to see if buildroot works on arm.
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Reason ? Status: No updates. Sirshak to open Jira Tkt.
  • [Sirshak] DPDK 18.05 mlnx bug. Status: Asked in the community need to look at backtrace as pointed by damjan. Sirshak to open Jira Tkt.
• VPP
  • [Sirshak] vectorization patch effects. https://gerrit.fd.io/r/#/c/13229/
    • I see around 15% in qualcomm with mellanox based on some patch which is not vectorization patch need find that.
    • Do others see similar improvement in past 2 weeks.
    • [Sirshak] look at Florin's patch.
  • [Lijian] x86 nos, checking within Nitin for sync on configuration. Skylake Single Core Single Thread: Ipv4 forwarding 64B 15 Mppps.
  • [Khem] Updates on IPv4 Benchmarking on taishan. Status: No Updates
  • [Nitin] Any known comparision between AVF nos on aarch64 and DPDK nos ? On Intel its ~25% and ARM ~20%.
  • [Nitin/Sachin] Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Internal DPDK changes effort. Wait for status on New ARMv8 Crypto.
  • [Sirshak->Nitin] Thunderx2(high core count)coremask for DPDK config in VPP startup conf.
  • [Tina] to get back on New ARMv8 Crypto.
• CSIT
  • [Juraj] Parallelizing the make test(CSIT-1139) Discussion: On Plan and if anybody wants to join hands.
  • [Juraj/Sirshak] SoC devices as non voting VPP device targets. Discussion: mcbin console access will be available once TG credentials are availlable.
  • [Adarsh] VPP Path/Device Efforts: Nested Container, trying VM inside a container facing some issues.
• fd.io lab
  • [Sirshak] Taishan connected need to verify once we get TG credentials. [Khem] Checked from Taishan side ports connected to TG are up.
  • [Sirshak] mcbin connected need to verify once we get TG credentials.
  • [Sirshak] cavium blades connected need to switch the network adapters before using it for CI.
• Documentation
  • Need to update the working ARM boards in the docyumentation section.
    • [Sirshak] To update Qualcomm Centriq, mcbin, Thunderx1, Thunderx2, Taishan 2280, OD 1000 and OD 3000(Check with Sachin).
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Honnappa/Nitin] Aarch64 rpms not building - DPDK Neon Build Break
  • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status: No updates.
  • [Khem] make test on Taishan timings: Status:
  • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch.
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Jira Tkt Status:
  • [Sirshak] DPDK 18.05 mlnx bug. Status: Sirshak to open Jira Tkt.
  • [Sirshak] look at Florin's patch.

7/3/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Khemendra Kumar
  • Tina Tsou
  • Nitin Saxena
  • Juraj Linkes
  • Brian Brooks
  • Ed Kern
  • Song
  • Lijian
• General Topic
  • Architecture Section in Documentation.
• Action Items - Last Week
  • Khem: Ipv4 layer investigation. To Share some findings next week on parameters for CSIT Status: Done. If yes cover in VPP section.
  • Nitin Follow up: Sachin: Upstreaming ARMv8 Crypto Changes with external DPDK. Status: Nitin to provide help on using Internal DPDK
  • Nitin Follow up: Add Virtual addressing support in IOVA dmap Status: Waiting for response from Damjan
  • Nitin make test on Thunderx2 timings :
  • Khem: status on make test failures: CSIT-1148 Status: Fixed.
  • Khem: make test on Taishan timings: Status: No status
  • Sirshak: cavium USB-Ethernet adapters to Quantta Switch. Status: Still working with LF guys
  • Khem to update on nested VMs on performance test cases. Status: No Updates
  • Sirshak & Khem: Documentation review. Status: Done. continuous effort.
  • Sirshak: Q to Maciek: buildroot image with VPP device(within container) ? Status: No updates.
• VPP
  • Sirshak: Investigate mlnx_burst_rx_vec used in case of no multi-seg but plain mlnx_tx_burst used. Movement of hotspot seen for rx. Probable reason SRIOV(VFs) used. Root cause yet to be found.
  • Sirshak: VPP DPDK 18.05 change done by damjan. mlnx drivers on Qualcomm are a problem. Urge Everyone to test respective sanity in their setup. set interface state <InerfaceName> up - stuck
  • Khem: Discuss various parameters in CSIT for IPv4 Testing.
  • Sirshak: TCP termination performance nos ?
  • Sirshak: vectorization patch effects. https://gerrit.fd.io/r/#/c/13229/
• CSIT
  • Juraj Make test bottlenecks: Updates: One plausible solution available. Parallelizing the make test(CSIT-1139)
  • Juraj to start looking at SoC devices as non voting VPP device targets.
  • Adarsh: openssl issues ? Issue still persists.
  • Adarsh: VPP Path Tasks.
  • Tkt updates:
    • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Status: To check with CSIT team for jenkins build failure. Status: No Updates. Not Priorty.
• fd.io lab
  • Sirshak: Update from LF guys
• Documentation
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
• Action Items - Next Week
  • [Nitin/Sachin]Follow up: Add Virtual addressing support in IOVA dmap Status:
  • [Nitin] make test on Thunderx2 timings :
  • [Khem] make test on Taishan timings: Status:
  • [Sirshak] cavium USB-Ethernet adapters to Quantta Switch. Status:
  • [Khem] to update on nested VMs on performance test cases. Status:
  • [Sirshak] Q to Maciek: buildroot image with VPP device(within container)? Status:
  • [Sirshak] mlnx tx non vector version used for no-multiseg. Reason ? Status:
  • [Sirshak] DPDK 18.05 mlnx bug. Status:

6/26/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Khemendra Kumar
  • Tina Tsou
  • Nitin Saxena
  • Juraj Linkes
  • Brian Brooks
  • Ed Kern
  • Song
• General Topic
  • Introduce Song, Yi and Lijian
• Action Items - Last Week
  • Adarsh: Updates on Jira tkt for openssl issues. Updates: none
  • Adarsh: Update on topology for Kubernetes Functional Tests. Updates: Kubernetes, Docker
  • Sirshak Tuning Section - Not Done
  • Khem: Ipv4 layer investigation. CSIT: IPv4. To Share some findings next week on parameters for CSIT
  • Nitin: Send old dpdk input node patch - Done
  • Sachin: Upstreaming ARMv8 Crypto Changes with external DPDK. - Nitin to send mail
  • Add Virtual addressing support in IOVA dmamap: Updates - nitin to send mail
  • Nitin Measure make make test on Thunderx2
  • Khem: measure make and make test on Taishan (Juraj tested it it failed : https://jira.fd.io/browse/CSIT-1148)
  • Sirshak: try to switch eth-usb for regular eth ports on ThunderXs - Created a LF tkt have follow up meeting today.
• VPP
  • Discuss vec_en_rx/tx=1 parameters.
  • Discuss Vectorized rx and tx functions in mlx5 (in case of no multi-seg)
  • rxd,txd nos in VPP config.
  • mbcache any configuring done from VPP side ?
• CSIT
  • make test failures Taishan Khem/adarsh (https://jira.fd.io/browse/CSIT-1148)
  • Juraj Make test bottlenecks: Updates: Ran 4 containers (85 mins) (CSIT-1139)
  • mcbin, OD(1000/3000), cavium thunderX as one of the targets for VPP Device Test.
  • Future role of devices. Status: Existing Taishan Servers to be used for performance suite only.
  • Khem to update on nested VMs on performance test cases.
  • buildroot image with VPP device(within container) ? Sirshak to ask maciek
  • Tkt updates:
    • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Merged and Closed
    • CSIT-990 (buildroot package) Juraj Updates: Postponed
    • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Status: To check with CSIT team for jenkins build failure.
• fd.io lab
  • Sirshak to have follow up LF guys.
• Documentation
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io
  • Sirshak and Khem to try doing some reviews this week.
• Action Items - Next Week
  • Khem: Ipv4 layer investigation. To Share some findings next week on parameters for CSIT
  • Nitin Follow up: Sachin: Upstreaming ARMv8 Crypto Changes with external DPDK.
  • Nitin Follow up: Add Virtual addressing support in IOVA dmap
  • Nitin make test on Thunderx2 timings :
  • Khem: status on make test failures: CSIT-1148
  • Khem: make test on Taishan timings:
  • Sirshak: cavium USB-Ethernet adapters to Quantta Switch.

• • Sirshak: try to switch eth-usb for regular eth ports on ThunderXs - Created a LF tkt have follow up meeting today.

6/19/2018

• Attendees
  • Sirshak Das
  • Sachin Saxena
  • Khemendra Kumar
  • Tina Tsou
  • Nitin Saxena
  • Juraj Linkes
  • Brian Brooks
  • Ed Kern
  • Song
• General Topic
  • Introduce Yi ,Lijian and Song
• Action Items - Last Week
  • Brian: mcbin Status:
  • Sirshak: Follow up clang changes. Status: Merged updated wiki.
  • Khem: Update Kernel Image based on Sanil's input to move past known VM issues. Try this internally.
  • Khem: LF tkt for Taishan BIOS updates.
    • No update for the ticket
  • Adarsh: openssl updates. Status:
    • Raised Jira ticket, needs to be discussed with VPP folks
  • Adarsh: Kubernetes
    • Working with K8s folks, planning on creating topology from containers for functional tests
  • Khem: VM(s) in container, VFs for containers
  • Sirshak: Summarize tkts in the Tuning Section. Status: Not Done
  • Khem: Investigation on ipv4 layer. Status: Not Done
  • Nitin: Send old patch on dpdk_input node tuning
• VPP
  • Sachin: Upstreaming armv8 crypto changes. Status: Sachin will try to upstream a patch related to external DPDK
  • Sirshak: Vectorization - Presentation.
  • Any new findings on hotspots or optimizations. Brian: adjusting queue sizes seem to have an effect
  • https://gerrit.fd.io/r/#/c/12932/ discussion: Need to understand the usecase(s) for iommu inside VPP
• CSIT
  • Discuss current make test time bottleneck.
  • AI Nitin: measure make and make test on ThunderX
  • AI Khem: measure make and make test on Taishan
  • AI Sirshak: try to switch eth-usb for regular eth ports on Thunderxs
  • Future role of devices. Status: will be decided when we have more info (performance on different devices etc.)
  • Question to Nitin/Anyone of how to individually run one test case of the performance suite. Status: no performance testcase can run on 2-node topologies
  • Tkt updates:
    • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Sent a patch. Status: Patch is waiting to be merged
    • CSIT-990 (buildroot package) Juraj Updates: No updates
    • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Submitted. Jobs still failing, Khem to investigate. Patch related to Jumbo pkts.
• fd.io lab
  • mcbin get them up, discuss with LF. Status: Brian - No Updates
  • Cavium Blades LF ticket #56713 Status: Tina - Need to have a meeting
• Documentation
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io

• Action Items - Next Week

6/12/2018

• Attendees
  • Sirshak Das
  • Brian Brooks
  • John Bromhead
  • Sachin Saxena
  • Khemendra Kumar
  • Adarsh
  • Andy Wang
  • Tina Tsou
  • Andrew Pinski
  • Nitin Saxena
  • Natalie Samsonov

• Action Items - Last Week
  • Brian: mcbin status: Updates from Trishan LF tkt #54490. - No updates
  • Sirshak: Follow up clang changes. Sent: Follow up patch.
  • Khem: Update Kernel Image based on Sanil's input to move past known VM issues. Try this internally and then do it fd.io lab.
  • Khem: LF tkt for Taishan BIOS updates. LF #56898 Status: Not done. Will follow up.
  • Adarsh: openssl updates. Status: IPSEC SA add entry error. To open a Jira tkt tracking this.
  • Sirshak: Summarize tkts in the Tuning Section. Didnt get chance to do this week would try to complete it by next week.
  • Sirshak: Schedule a Meeting between Juraj and Khem. Done
• VPP
  • Brian: Talk on mcbin perf analysis. Nitin to send a old patch on tuning prefetch on dpdk_input node.
  • Sirshak: VPP Multi-arch optimizations Guidelines
  • Sirshak: Vectorization - Plan to present something next week. Any thoughts ?
  • Nitin: anybody willing to take up ipv4 layer ? Khem to take a look.
  • Sachin: Upstreaming armv8 crypto changes.
  • Nitin: memcpy updates ?
  • Sirshak: clang patch status
• CSIT
  • Sirshak: Explain VPP Path and VPP Device
  • Open Questions and Answers surrounding VPP Device
    • Q. Do the Intel onboard NICs support VFs via SRIOV on machiattobin boards ?
    • A.[Natalie] We support it but it’s not formally released yet. Will be formally delivered in 18.09.
    • BB - Kernel bypass uses UIO possible to do. [natalie] check support for VF for onboard NICs
    • Q. If Yes, is it a hardware level support or supported in musdk also ?
    • A.[Natalie] MUSDK is not relevant here. Intel NICs are using DPDK and ARM infrastructure directly. We support PCIE SR-IOV with both v4.4 and v4.14 kernels
    • Q. Has anybody tested containers (docker) and any container orchestration system on mcbin (e.g Docker Swarm or Kubernetes) ?
    • A.[Natalie] Yes.
    • Q. K8s or Docker Swarn ?
    • A. [Bin Arm Internal] K8s is good choice version(1.9.4). Use kubeadm to install k8s cluster.
    • Q. VM inside a container works on ARM ?
    • A. [Bin ARM Internal] Use Kata and Runv. Kata/Runv is the solution of hardware-virtualized containers.
    • Q. Container within a Container(nested) works on ARM ?
    • A.[Bin ARM Internal] ‘Docker in docker’ or ‘Docker of Docker’ can works well on Arm platform.
  • Sirshak: Explain the proposed role of Cavium Blades for functional tests.
  • Tkt updates:
    • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Sent a patch.
    • CSIT-990 (buildroot package) Juraj Updates:
    • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates): Submitted. Jobs failing Khem to investigate. Patch related to Jumbo pkts.
    • Sachin: To open tkt to track ARMv8 crypto.
• fd.io lab
  • mcbin Status: Brian - No Updates
  • Cavium Blades #56713 Status: Tina
• Documentation
  • Link to Pull Request: https://github.com/fdioDocs/vpp-docs/pull/7
  • Changes Shown Here: https://github.com/fdioDocs/vpp-docs/pull/7/files
  • Docs Page: https://a-olechtchoukvpp-docs.readthedocs.io/en/latest/tasks/writingdocs/index.html
  • Subscribe to: docs@lists.fd.io

• Action Items - Next Week

• • Brian: mcbin Status:
  • Sirshak: Follow up clang changes. Status: Merged updated wiki.
  • Khem: Update Kernel Image based on Sanil's input to move past known VM issues. Try this internally.
  • Khem: LF tkt for Taishan BIOS updates.
  • Adarsh: openssl updates. Status:
  • Sirshak: Summarize tkts in the Tuning Section. Status: Not Done
  • Khem: Investigation on ipv4 layer. Status:

6/4/2018

• Attendees
  • Sirshak Das
  • Brian Brooks
  • John Bromhead
  • Sachin Saxena
  • Khemendra Kumar
  • Adarsh
  • Andy Wang
  • Tina Tsou
  • Andrew Pinski
  • Juraj Linkes
  • Nitin Saxena
  • Natalie Samsonov

• Action Items - Last Week
  • Sirshak: To create a LF tkt for mcbin - Didnt create as Brian is handling it offline. If things remain unresolved this week, will create one. - LF Tkt created #54490. [BB]Trishan to follow up over email.
  • Sirshak: Follow up on cavium-3 : Its integrated to arm CI job.
  • Sirshak: Upstream clang changes: Failing on Cavium TX1 host up-streamed related patch working on review comments.
  • Sirshak: Discuss with Maciek and get a signoff for moving the x86 Hosts to arm rack: Done
  • Honnappa: Provide inputs on how to proceed with comments on Marvell dpdk patch.
  • Honnappa: VPP-1284: To look at this patch to provide comments on performance implications of the fix
  • Juraj estimate moving CSIT functional tests to make test. - 1-2 months for 1 person. Others CSIT looking into this. Better estimate soon.
  • Khem: Create LF tkt for Performance Suite Topology Creation. : Created LF #56736
  • Adarsh: Create a Jira to document Automation Task. Created Jira Tkt.
  • Khem: Follow up Sanil : Known taishan vm issues. Update Kernel Image
  • Khem: LF tkt for Taishan BIOS updates. LF #56898
  • Adarsh: openssl updates. Updated openssl dpdk. VPP is now stable. Will test soon. Adarsh to close the tkt.
  • Nitin: VPP-1064 multiple cache line size patch. Nitin to raise to LF tkt to remove DPDK package from Nexus server.

• fd.io lab
  • mcbin onboarding issue. - Comments in Action Items - Last Week.
  • new cavium boxes status - JohnB : Blade 1-4 racked. CSIT Functional.
  • Sirshak : Summarize tkts.

• VPP

• • memcpy patch updates/closure: Abandon. Jira to be updated with more data.
  • clang compilation Sirshak: Working on getting the patch upstreamed.
  • mcbin performance analysis Brian: To talk about this next week.
  • vectorization sirshak(Problem, Plausible Solution, Volunteers): SSE2NEON
  • Sachin: upstreaming armv8 crypto changes.
  • Sirshak: Add Tuning section in Wiki
  • Sirshak: Summarize Jira Tkts

• CSIT
  • Performance Suite Roadmap(topology, work distribution(khem, juraj)):
  • Sirshak to Schedule a Meeting between Juraj and Khem.
  • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Juraj Updates: Seen by Juraj. Seeing the issue in ipv6 suite. happens during pcie rescan.
  • CSIT-990 (buildroot package) Juraj Updates: Peter from pantheon replied Juraj still looking into it.
  • CSIT-1021: Handle Scapy pcap limit Khem(brief on patch, updates):
  • Sirshak : Summarize CSIT tkts
  • Sachin: To open tkt to track ARMv8 crypto.

• Documentation
  • Special VPP installations(eg. dpaa).
  • ARMv8 crypto needs to documented.

• Action Items - Next Week
  • Brian: mcbin status: Updates from Trishan LF tkt #54490.
  • Sirshak: Follow up clang changes.
  • Khem: Update Kernel Image based on Sanil's input to move past known VM issues.
  • Khem: LF tkt for Taishan BIOS updates. LF #56898 Status:
  • Adarsh: openssl updates.
  • Sirshak: Summarize tkts in the Tuning Section.
  • Sirshak: Schedule a Meeting between Juraj and Khem.

5/29/2018

• Attendees
  • Sirshak Das
  • Brian Brooks
  • John Bromhead
  • Sachin Saxena
  • Khemendra Kumar
  • Adarsh
  • Andy Wang
  • Honnappa Nagarahalli
  • Tina Tsou
  • Andrew Pinski
  • Juraj Linkes
  • Nitin Saxena

• Action Items - Last Week
  • Sirshak: To update LF RT #54919 to follow up on cavium-2 status. - Not Needed as cavium-2 is present.
  • Sirshak: Release Machine to EdK as soon as ThunderX is up. - Done
  • Sirshak: Status on new ThunderXs: Will be decided after talks with Maciek. - Yet to decide.
  • Sirshak: vm unresponsive issue. Tried again still got 27 errors for ipv4 handed over to Juraj for further investigation.
  • Sirshak: To ask about CSIT performance topology connection status. Didnt get time mostly discussing VIRL job.
  • Sirshak: to add OS version to fd.io lab machines. -Done by somebody else.
  • Sirshak: to add Porting and Tuning section. Check with Honnappa
  • Sirshak: to track arm master build failure. - Damjan has sent a fix.
  • Juraj: Access to fd.io lab. - Done.
  • Khem: to create a Jira tkt to document automation task of CSIT. - Still Working on it.
  • Khem: to reach out to Sanil(Huawei)regarding known Taishan problems with KVM. - No response from Sanil yet.
  • Khem: BIOS patch for NUMA node numbering issue. - Khem to create LF RT tkt to do this in fd.io lab.
  • Nitin: VPP-1064 Support multiple cache line sizes per architecture. - Still in discussion with Dave.
  • Adarsh: openssl updates. VPP crashing.

• fd.io lab
  • mcbin powering on ? Sirshak to create LF tkt. Reach out to Brian offline.
  • Cavium-3 role. Make decision based on feedback Edk. Sirshak to check availability.
  • Sirshak to ask Brian to forward old LF tkt to JohnB.

• VPP

• • ARMv8 crypto patch from Sachin related to dpdk_plugin only.
  • memcpy issue: going with memcpy and not hand crafted memcpy.
  • clang compilation: Sirshak to upstream to clang related changes add all other aarch64 leads.
  • Brian to use cache stashing result. Updates: No affects for VPP but there is improvement on musdk sample application.
  • VPP-1267(Marvell dpdk patch mcbin): How to move forward based on Damjan's comments. Still discussing. Honnappa to provide some inputs next week.
  • VPP-1276(rpm issues aarch64): Not priorty. Status: No updates.
  • VPP-1284: TLS corruption on aarch64: Status(After Sachin's suggestion): Resolved. Might have performance implications but currently only possible solution. HN to look at this Jira Card in order talk to compiler team if needs be.

• CSIT
  • TG status in fd.io lab and internal Huawei Lab. - Sirshak to discuss with Maciek. Khem to create LF tkt.
  • CSIT-1019 (timeout of PacketVerifier.RxQueue is not working): Done.(Upstreamed Merged ?). Status: Merged.
  • CSIT-1023 (Crypto Func Tests): VPP still crashing - Adarsh
  • CSIT-1043 (Guest OS becomes unresponsive during CSIT): Sirshak tried pinning the VMs to phy CPUs but tests still failing. Juraj to take over.
  • CSIT-990 (buildroot package) Brian Status: build issue with grub.
  • Juraj: Estimate on moving CSIT Functional tests to make test. Maciek proposal does consider all the implications of letting go VIRL especially parallelization VIRL offers.

• Action Items - Next Week
  • Sirshak: To create a LF tkt for mcbin
  • Sirshak: Follow up on cavium-3.
  • Sirshak: Upstream clang changes.
  • Honnappa: Provide inputs on how to proceed with comments on Marvell dpdk patch.
  • Honnappa: VPP-1284: To look at this patch to provide comments on performance implications of the fix
  • Juraj estimate moving CSIT functional tests to make test.
  • Sirshak: Discuss with Maciek and get a signoff for moving the x86 Hosts to arm rack.
  • Khem: Create LF tkt for Performance Suite Topology Creation.
  • Adarsh: Create a Jira to document Automation Task
  • Khem: Follow up Sanil : Known taishan vm issues.
  • Khem: LF tkt for Taishan BIOS updates.
  • Nitin: VPP-1064 multiple cache line size patch.:
  • Adarsh: openssl updates.

5/22/2018

• Attendees
  • Sirshak Das
  • Stanislav Chlebec
  • John Bromhead
  • Sachin Saxena
  • Khemendra Kumar
  • Andy Wang
  • Honnappa Nagarahalli
  • Tina Tsou
  • Andrew Pinski
  • John Bromhead
  • Juraj Linkes
  • rkinsell
  • Nitin Saxena

• Action Items - Last Week
  • Sirshak: To update LF RT #54919 to follow up on cavium-2 status. - having troubles with login will sort it out today.
  • Sirshak: Release Machine to EdK as soon as ThunderX is up: cavium-1 done cavium-2 still has issues with network connectivity.
  • Sirshak: Status on new ThunderXs: Will be decided after talks with Maciek.
  • Sirshak: vm unresponsive issue: No updates didnt get time to try will try this week.
  • Sirshak: To ask about CSIT performance topology connection status. - TBD after call with Maciek.
  • Nitin: VPP-1064 (Patch rejected by dave barach) Discuss cross compilation with Sachin. (Seperate or one unified Makefile). - No Updates.
  • HN: memcpy benchmarking updates honnappa - 2 more tests to be done based on Ola's suggestion.
  • Adarsh openssl issues: Will communicate with Sachin to get this resolved. Made changes based sachin's suggestions still issues to be resolved.
  • Adarsh preparing a sheet updated with his progress on CSIT. - Added to the google sheets.

• fd.io lab
  • cavium-2 follow up via LF #54919.
  • Talk to Macek regrading TG physical placement on rack.
  • Juraj : Needs access to fd.io lab. Tina to help Juraj with this.
  • Juraj to send email to EdW to get access to fd.io lab.'
  • Sirshak to add OS version to fd.io lab machines.

• VPP
  • HN->Nitin: Stick with memcpy. Nitin concern SIMD unit being idle with new GCC. Feedback from arm compiler team that vector instructions dont perform as expected on many platforms. 1ns better(dpdk_input node) if using SIMD memcpy on ThunderX. Nitin to try using restricted on non-SIMD memcpy.
  • 1019: CSIT. Py-lint issues. Patch submitted. Khem to merge with Lucian's Patch.
  • 1023: Khem, Adarsh to talk to Sachin to resolve openssl issue. - Sachin suggested some config changes resulted in VPP being unstable. Still working it out.
  • 1043: No updates. Sirshak to investigate this and Khem to reach out to Sanil regarding known Taishan problems with KVM.
  • 990: Brian Updates - Sirshak to get status offline.
  • 1267: l3fwd performance tuning: Status on Marvel patch: - No Updates. Nitin to submit his modified patch with -2.
  • VPP-1276: Sachin facing issues with building rpm. - Any change in status ? No Updates. Low priorty for Sachin. Needs Help.
  • VPP-1284: TLS corruption: Dynamic linking related to Thread local storage. Logs recorded with this tkt.
  • Sirshak to add Porting and Tuning section.
  • Sirshak to track arm master build failure.
• CSIT
  • Adarsh openssl issues:
  • Performance Testing Khem : NUMA node numbering issue. Last Update: Still working internally. Status: Internal patch for BIOS.
  • Khem: to create a Jira tkt to document automation task of CSIT.
  • Khem : trex installation- Having x86 TG internally. Any luck ?
  • Brian to use cache stashing result. Updates:

• Action Items - Next Week
  • Sirshak: To update LF RT #54919 to follow up on cavium-2 status.
  • Sirshak: Release Machine to EdK as soon as ThunderX is up.
  • Sirshak: Status on new ThunderXs: Will be decided after talks with Maciek.
  • Sirshak: vm unresponsive issue: No updates didnt get time to try will try this week.
  • Sirshak: To ask about CSIT performance topology connection status.
  • Sirshak: to add OS version to fd.io lab machines.
  • Sirshak: to add Porting and Tuning section.
  • Sirshak: to track arm master build failure.
  • Juraj: Access to fd.io lab.
  • Nitin: VPP-1064 Support multiple cache line sizes per architecture.
  • HN: memcpy benchmarking updates honnappa - 2 more tests to be done based on Ola's suggestion.
  • Adarsh openssl updates
  • Khem: to create a Jira tkt to document automation task of CSIT.

5/15/2018

• Attendees
  • Sirshak Das
  • Stanislav Chlebec
  • Sachin Saxena
  • Khemendra Kumar
  • Andy Wang
  • Honnappa Nagarahalli
  • Tina Tsou
  • Andrew Pinski
  • John Bromhead
  • Juraj Linkes
  • rkinsell
  • Nitin Saxena

• Action Items - Last Week
  • Nitin: Run a VPP performance test to understand if the memcpy neon version provides any benefits. - Able to run with l3fwd test case. Gives better numbers.
  • Sirshak: Create a higher LF ticket so that it is easier for Trishan/Acton/Venessa/Mohammed to follow up on bringing up ThunderX/mcbin - Not Created yet as I think we are close to solving the issue. If its not solved after today's call will create the tkt.
  • Nitin: start email discussion with Dave to address the creation of single makefile for all ARMv8 devices. Still understanding cross compilation works. Communicating with Sachin.

• New Joinees
  • Stanislav Chlebec - pantheon

• fd.io lab
  • Follow up on ThunderX to getting mgmt IP - IP addresses are assigned, but are not up yet.- Have a call today to discuss this with Mohammed
  • USB to Ethernet Question: Andrew: shows up as Ethernet interface.
  • Release Machine to EdK as soon as ThunderX is up. - Sirshak to set mgmt IP and handover the machine.
  • Cavium has shipped more machines as well - Delivered a week back. Tina to follow up with Trishan: 2 Delivered. Sirshak to ask in todays meeting for status on new ThunderX.
  • See the Taishan setup for any VM issue. - Sirshak is trying to reproduce the issue. - Reproduced still debugging.
  • Khemendra : Topology is correct. Sirshak to ask about CSIT performance topology connection status.
  • Khemendra: Intel NIC to be used or Mellanox. HN: Intially use Intel later move to Mellanox.
• VPP
  • VPP-1064 Dave Barach rejected the patch based on the solution Damjan and Nitin had decided upon following the reason that current approach breaks cross compilation. - NXP has upstreamed the DPAA2 patch, uses a separate segment makefile (dpaa.mk) for DPAA2. NXP does cross compilation most of the time. The approach could be that all platforms create a segment makefile and combine all of them into a single ARMv8 segment makefile. - Nitin Still discussing with Sachin regrading cross compilation
  • One solution suggested was creating a platform specific Makefile for ThunderX - Any Decisions - Same as above.
  • memcpy benchmarking updates honnappa - 2 more tests to be done based on Ola's suggestion. Nitin tested with restrict.
  • 1019: No update. Few rough edges to clean up.
  • 1021: Is it Closed ? Closed.
  • 1023: migrated to openssl using DPDK manual but facing failed TCs - openSSL is integrated in his local environment - VPP not stable in his environment - Updated in the ticket. Status: Aadarsh still trying to get help from community. Khem, Aadarsh to talk to Sachin regarding openssl issues.
  • 1043: No updates. Sirshak to investigate this.
  • 990: Brian Updates:
  • 1267: l3fwd performance tuning: Marvell to upstream a patch to enable dpdk on mcbin by making changes to dpdk plugin in vpp. Updates: natalie sent a email. Working on upstreaming changes to VPP for dpdk_plugin. Working on comparing musdk vs dpdk.
  • Auto-detection of memory channels: Startup conf solution decided. Updates: No updates not priorty now bug raised by Nitin.
  • Sachin facing issues with build rpm currently on 1801 will open a Jira Tkt if issues persists with 1804. Updates: Jira VPP-1276 to track this issue.
• CSIT
  • Adarsh openssl issues: Will communicate with Sachin to get this reolved
  • Adarsh preparing a sheet updated with his progress on CSIT.
  • Performance Testing Khem : NUMA node numbering issue Updates: No updates. Still working internally.
  • Khem facing issues with trex installation on ARM hence he will try getting a x86 machine as TG. Updates: Still working on getting an x86 in internal lab.
  • brian to use cache stashing result. Updates:

• Action Items - Next Week
  • Sirshak: To update LF RT #54919 to follow up on cavium-2 status. - having troubles with login will sort it out today.
  • Sirshak: Release Machine to EdK as soon as ThunderX is up: cavium-1 done cavium-2 still has issues with network connectivity.
  • Sirshak: Status on new ThunderXs: Will be decided after talks with Maciek.
  • Sirshak: vm unresponsive issue: No updates didnt get time to try will try this week.
  • Sirshak: To ask about CSIT performance topology connection status. - TBD after call with Maciek.
  • Nitin: VPP-1064 (Patch rejected by dave barach) Discuss cross compilation with Sachin. (Seperate or one unified Makefile).
  • HN: memcpy benchmarking updates honnappa - 2 more tests to be done based on Ola's suggestion.
  • Adarsh openssl issues: Will communicate with Sachin to get this resolved
  • Adarsh preparing a sheet updated with his progress on CSIT.

5/8/2018

• Attendees
  • Honnappa Nagarahalli
  • Tina Tsou
  • Andrew Pinski
  • Natalie Samsonov
  • John Bromhead
  • Sachin Saxena
  • Khemendra Kumar
  • Andy Wang
  • Juraj Linkes
  • rkinsell
  • Nitin Saxena
  • Ed Kern

• Action Items - Last Week
  • Sirshak: Follow up with Mohammed regarding ThunderX mgmt connectivity and mcbin - IP addresses allocated cavium-2 has IPMI connectivity but console still hanging. cavium-1,3 - Not able to connect to IPMI. - Create a higher LF ticket so that it is easier for Trishan/Acton/Venessa/Mohammed to follow up.
  • Sirshak to hold a call with Khem and Adarsh to understand the Vm_vhsot issue because of nested VMs - Contact established still working on analyzing the setup.
  • Sirshak to create consolidated ARM ecosystem xls to reflect CSIT effort. (Need to add the link to the excel sheet to AArch64 page) - Not Done will do it next week.
  • Honnappa: memcpy benchmarking - Micro benchmarks run on mcbin, qualcomm - vector Load/Store usually go to the LSU unit
  • Brian : CSIT-990(buildroot) - Nitin ran on mcbin, it is failing at a different place - Brian to continue next week
  • Brian to publish a pictorial representation of rx queues and tx queues in multicore case for mcbin. - Moved to next week
  • Khem to analyze make test failure in Taishan - 1804 - Tested with the latest code (make test), all test cases passing
  • ARM - For TG for deciding connectivity - MCBin and Taishan - Sirshak/Brian working on it.
  • Sirshak/Brian to recheck validity of ASLR issue. - Not Done. Next Week.

• New Joinees
  • Yuval Caduri - from Marvell responsible for MUSDK driver - packet processor 8K chips
  • Natalie - responsible for network PMD DPDK driver
  • Dmitri Epshtein - Responsible for crypto driver expert

• fd.io lab
  • Follow up on ThunderX to getting mgmt IP - IP addresses are assigned, but are not up yet.
  • Release Machine to EdK as soon as ThunderX is up.
  • Cavium has shipped more machines as well - Delivered a week back. Tina to follow up with Trishan.
  • See the Taishan setup for any VM issue. - Sirshak is trying to reproduce the issue.
• VPP
  • VPP-1064 Dave Barach rejected the patch based on the solution Damjan and Nitin had decided upon following the reason that current approach breaks cross compilation. - NXP has upstreamed the DPAA2 patch, uses a separate segment makefile (dpaa.mk) for DPAA2. NXP does cross compilation most of the time. The approach could be that all platforms create a segment makefile and combine all of them into a single ARMv8 segment makefile.
  • One solution suggested was creating a platform specific Makefile for ThunderX
  • Honnappa Suggested as this not just a ThunderX issue but also Qualcomm issue hence a ARM specific Makefile would be better.(Issue 128 byte Cache Line Size)
  • Honnappa no update on memcpy benchmarking will do that next week
  • 1019: fixed in local will upstream soon - Patch has issues and some of the issues are fixed
  • 1021: Patch submitted centos env issue CSIT follow up. - This can be closed
  • 1023: migrated to openssl using DPDK manual but facing failed TCs - openSSL is integrated in his local environment - VPP not stable in his environment - Updated in the ticket.
  • 1043: No updates
  • 990: Brian to Retry on mcbin
  • 1267: l3fwd performance tuning: Marvell to upstream a patch to enable dpdk on mcbin by making changes to dpdk plugin in vpp.
  • Auto-detection of memory channels: Andrew's comment no really way to do that hence to go with making it a runtime argument via startup conf instead of being hard coded.
  • Sachin facing issues with build rpm currently on 1801 will open a Jira Tkt if issues persists with 1804.
• CSIT
  • Adarsh stalled with failure of test cases after using openssl.
  • Performance Testing Khem : NUMA node numbering issue.
  • NUMA node no issue not seen in ThunderX. Khem to post the details of issue and the workaround on Taishan.
  • Khem facing issues with trex installation on ARM hence he will try getting a x86 machine as TG.
  • Nitin known issue with trex with arm and mellanox card.
  • Khem to try L2BD and L2XC.
  • brian to use cache stashing and see the results.

• Action Items - Next Week
  • Nitin: Run a VPP performance test to understand if the memcpy neon version provides any benefits.
  • Sirshak: Create a higher LF ticket so that it is easier for Trishan/Acton/Venessa/Mohammed to follow up on bringing up ThunderX/mcbin
  • Nitin: start email discussion with Dave to address the creation of single makefile for all ARMv8 devices

5/1/2018

• New Joinees
  • Natalie and Yuval from Marvell for engineering input.
• fd.io lab
  • Follow up on ThunderX to getting mgmt IP
  • Release Machine to EdK as soon as ThunderX is up.
  • Cavium has shipped more machines as well.
  • See the Taishan setup for any VM issue.
• VPP
  • VPP-1064 Dave Barach rejected the patch based on the solution Damjan and Nitin had decided upon following the reason that current approach breaks cross compilation.
  • One solution suggested was creating a platform specific Makefile for ThunderX
  • Honnappa Suggested as this not just a ThunderX issue but also Qualcomm issue hence a ARM specific Makefile would be better.(Issue 128 byte Cache Line Size)
  • Honnappa no update on memcpy benchmarking will do that next week
  • 1019: fixed in local will upstream soon
  • 1021: Patch submitted centos env issue CSIT follow up.
  • 1023: migrated to openssl using DPDK manual but facing failed TCs
  • 1043: No updates
  • 990: Brian to Retry on mcbin
  • 1267: l3fwd performance tuning: Marvell to upstream a patch to enable dpdk on mcbin by making changes to dpdk plugin in vpp.
  • Auto-detection of memory channels: Andrew's comment no really way to do that hence to go with making it a runtime argument via startup conf instead of being hard coded.
  • Sachin facing issues with build rpm currently on 1801 will open a Jira Tkt if issues persists with 1804.
• CSIT
  • Adarsh stalled with failure of test cases after using openssl.
  • Performance Testing Khem : NUMA node numbering issue.
  • NUMA node no issue not seen in ThunderX. Khem to post the details of issue and the workaround on Taishan.
  • Khem facing issues with trex installation on ARM hence he will try getting a x86 machine as TG.
  • Nitin known issue with trex with arm and mellanox card.
  • Khem to try L2BD and L2XC.
  • brian to use cache stashing and see the results.

• Action Items - Next Week
  • Sirshak: Follow up with Mohammed regarding ThunderX mgmt connectivity and mcbin.
  • Sirshak to hold a call with Khem and Adarsh to understand the Vm_vhsot issue because of nested VMs - Not done yet will do it next week.
  • Sirshak to create consolidated ARM ecosystem xls to reflect CSIT effort. - Not Done will do it next week.
  • Honnappa: memcpy benchmarking
  • Brian : CSIT-990(buildroot)
  • Brian to publish a pictorial representation of rx queues and tx queues in multicore case for mcbin. - Moved to next week
  • Khem to analyze make test failure in Taishan - 1804 - Next Week
  • ARM - For TG for deciding connectivity - MCBin and Taishan - Working on it.
  • CSIT 990 brian to try - Next Week
  • Sirshak/Brian to recheck validity of ASLR issue. - Not Done. Next Week.

• Action Items - Last Week
  • Khem to ask mohammed, anton for power clearance for 2 new taishan. - Ok for Power Clearance
  • Sirshak to hold a call with Khem and Adarsh to understand the Vm_vhsot issue because of nested VMs - Not done yet will do it next week.
  • Sirshak and Brian to discuss on TG connectivity. - Done
  • Sirshak to create consolidated ARM ecosystem xls to reflect CSIT effort. - Not Done will do it next week.
  • Nitin: To post vlib_main 1804_rc2 issue to community. - Done
  • Sirshak : to check if vlib_main is a issue in centriq. - Done
  • Nitin: AI for creating Jira for number of memory channel identification. - Done
  • Brian to publish a pictorial representation of rx queues and tx queues in multicore case for mcbin. - Moved to next week
  • John B - 1G to USB adapters Ship to lab. - Done
  • Khem to analyze make test failure in Taishan - 1802 rc2 - Next Week
  • ARM - For TG for deciding connectivity - MCBin and Taishan - Working on it.
  • CSIT 990 brian to try - Next Week
  • Sirshak to take 1103 and 1114 - Done
  • Nitin to Create l3fwd tkt - Done
  • Brian to create a mcbin crash tkt. Next Week
  • Maen to provide contact for IO Stashing on mcbin. - Contacted Brian. Brian to provide further input.
  • Sirshak/Brian to recheck validity of ASLR issue. - Not Done. Next Week.

4/25/2018

• Meeting Time
  • Proposed time 6-8am Tuesday PST.
  • Tina to update wiki with new meeting time.
• FD.io lab
  • ThunderX
    • OS installed on ThunderX. Switch being sent.
    • 1 ThunderX booted.
    • Plan to use 1G to USB adapters.
    • Varun POC for Cavium.
  • Taishan
    • Its up and connected to Internet.
    • Build and make test 2 TCs failing (VCL TCs failing) - 1802 rc2 used.
    • Brian no update for TG - Meeting on it next week.
    • Khem to ask mohammed, anton for power clearance for 2 new taishan.
  • MCBin
    • Maen POC - To Contact Mohammed.
    • Maen to provide engineering contact for help to Nitin.
• VPP
  • Round Table status on Porting tkts.
  • Nitin: vlib_main taking a lot of time on both mcbin and thunderx2
  • Sirshak to take on ARM tkts.
• CSIT
  • Adarsh looking at IPv4 failed test cases with priorty.
  • Sirshak to hold a call with Khem and Adarsh to understand the Vm_vhsot issue because of nested VMs
  • Cavium to publish mcbin cist performance nos but low priority. Nitin faced build-root issue with this.
  • Maciek to host a kick off call.
  • Sirshak and Brian to discuss on TG connectivity.
  • Sirshak to create consolidated ARM ecosystem xls to reflect CSIT effort.
• Performance Benchmarking
  • Nitin: To post vlib_main 1804_rc2 issue to community.
  • Nitin: vlib_main issue in mcbin and thunderx2 at different points within the function. Not a hotspot in x86.
  • Sirshak : to check if vlib_main is a issue in centriq.
  • Nitin: AI for creating Jira for number of memory channel identification.
  • AI for creating Jira for the crash on Mcbin – Brian
  • Khem to get started on CSIT performance suite this week and publish on shared xls.
  • Brian to publish a pictorial representation of rx queues and tx queues in multicore case for mcbin.
• Action Items - Last Week
  • Sirshak to add link to xls to wiki page. - Done by somebody else.
  • Brian to raise LF RT ticket about MACCHIATObins - Done. Pinged Mohammed yet hear back from him.
  • Nitin to check 'make test' on MACCHIATObin (16GB DRAM) - Failed. Error related to Python scripts.
  • Honnappa, Khem to check Clang build on arm64. - Tried clang build on Centriq made some changes still fails. clang on x86 has errors still passes. 'make test' fails on x86. Jira Card to be created - AI(Sirshak). Khem to try.
• Action Items
  • John B- 1G to USB adapters Ship to lab.
  • Khem to analyze make test failure in Taishan - 1802 rc2
  • ARM - For TG for deciding connectivity - MCBin and Taishan
  • CSIT 990 brian to try
  • Sirshak to take 1103 and 1114
  • Nitin to Create l3fwd tkt
  • Brian to create a mcbin crash tkt.
  • Maen to provide contact for IO Stashing on mcbin.
  • Sirshak/Brian to recheck validity of ASLR issue.
  • Sirshak to track down issues.

4/18/2018

• FD.io lab
  • Temporarily borrow 1x ThunderX to be used for ONAP demo at OpenStack Summit (end of May)? Yes.
  • OS exists on ThunderXs; Varun will keysign with EdW; need to resolve OS netdev connectivity over 10/40GbE
  • OS exists on TaiShan2280; no connectivity to the Internet
• VPP
  • RC2
    • 'make' passes, 'make test' fail, 'make test-all' ??? - MACCHIATObin (4GB DRAM)
    • 'make' passes, 'make test' pass, 'make test-all' fails - Centriq
    • 'make' passes, 'make test' pass, 'make test-all' fails - x86
  • Build
    • Testing Verify and Merge jobs for 18.04 master on arm64 today
    • Clang build fails on arm? 'CC=clang CXX=clang make'
• CSIT
  • Adarsh updated CSIT status in xls
  • CSIT-1023: decided to go with OpenSSL instead of ARMv8 crypto library, in DPDK, due to number of algorithms supported
    • e.g. AES-GCM not supported by ARMv8 crypto library
  • Nitin updated CSIT-990 (buildroot) with more information
• Action Items
  • Sirshak to add link to xls to wiki page.
  • Brian to raise LF RT ticket about MACCHIATObins
  • Nitin to check 'make test' on MACCHIATObin (16GB DRAM)
  • Honnappa, Khem to check Clang build on arm64

4/11/2018

• Proposal to keep meeting at current time with additional overflow meeting at 8AM PST
• FD.io lab
  • MACCHIATObins just arrived at VEXXHOST
  • Nitin working on getting IPMI login credentials to provision OS on ThunderX
  • Need to connect Skylake TG machines to Arm machines
    • ETA: 1wk
  • Khem working with Aton (LF) to provision OS on TaiShan2280
    • ETA: 1wk, Ubuntu 17.10
• VPP
  • Brian to do more benchmarking on MACCHIATObin
  • Khem working on benchmarking clib_memcpy64_x4()
• CSIT
  • Lucian submitted patches for CSIT-1019, CSIT-1021
  • Lucian looking for contact for ARMv8 crypto driver in DPDK for CSIT-1023
    • See CSIT-1023 for details; looks like DPDK issue?
  • Nitin to add more details to CSIT-990
• Action Items
  • Sirshak to move JIRA tickets to xls
  • Lucian to work with Nitin/Jerin on CSIT-1023

4/4/2018

• Propose to move the meeting +2 hours?
• RC1 cut today
• FD.io lab
  • Allocate 3 ThunderX for EdK to integrate into CI
    • JohnB from Cavium agreed to supply 3 more ThunderX for CSIT (will pre-install FW & OS)
  • Brian working on provisioning SSDs for MACCHIATObins
  • Khem can ping IPMI interfaces on TaiShan2280s; also needs an OS to be installed
• VPP
  • Discussed ONS slides
  • Khem has patch for clib_memcpy64_x4() and needs help benchmarking
• CSIT
  • Lucian found and created JIRA tickets for 3 issues while running CSIT
  • Nitin created JIRA ticket for buildroot issue
  • Khem seeing issues with VM
• Action Items
  • Nitin/Varun to help provision Ubuntu 16.04 and firmware update on ThunderX machines

3/28/2018

• Sachin Saxena from NXP joined the call, welcome
• FD.io lab
  • Khemendra is having issues with Rudy's emails. Hence, not been able to access Taishan servers
  • Nitin will try to access the servers this week
  • MACCHIATObin setup under progress
  • OD1000 is added to Jenkins slave. The build is failing currently. The build can be triggered manually.
• VPP
  • Discuss Single core, L3Fwd sample perf numbers and analysis next week
  • Sachin is working on compiling 18.01. Native compilation works fine, cross compilation is failing
  • Nitin still working on patch for cache line size
  • VPP-1126 is being used in DPDK input node. Khemendra will take a look at it this week.
  • VPP-1129 Brian/Sirshak will take a look. Looks like it can be closed.
  • VPP-1114 Patch under internal review
• CSIT
  • Khemendra having issues with interface bring up failing intermittently. Nitin suggested to add delay.
  • Nicolas/Lucian debugging TC-07
  • Khemendra having issues with TG VM crashing randomly with Ubuntu 16.04, QEMU 2.10. Solved by moving to Ubuntu 17.10, QEMU 2.10
  • Nitin using Ubuntu 16.04 with 4.13 kernel
• Action Items
  • Discuss Single core, L3Fwd sample perf numbers and analysis next week - Brian
  • VPP-1126 Take a look this week as it affects DPDK input node - Khemendra
  • Need more attention on solution for buildroot issue, need more information on failure CSIT-990 - Nitin
  • Create an excel sheet with the test case status - Nicolas/Lucian

3/21/2018

• Key signing party! Thank you Ed!
• FD.io lab
  • VEXXHOST currently working on getting another PDU because there are not enough power ports
  • Received SSDs for MACCHIATObins
• VPP
  • Discuss high level plan for VPP on Arm
  • Nitin still working on patch for cache line size
• CSIT
  • Need more attention on solution for buildroot issue CSIT-990
  • Nitin moving towards L2 & L3 perf test cases
  • VM crash due to buffer overflow when multiple VMs share NVRAM; resolved in Fedora27

3/14/2018

• Key signing party! Thank you Ed!
• FD.io lab
  • ToR switch issue resolved; confirm mgmt IP address assignment to racked Huawei/Cavium machines
  • Started provisioning MACCHIATObins; Andy ordered SSDs to go with them
• VPP
  • No updates
• CSIT
  • Adarsh started running CSIT on virtual topology; moved past a paramiko issue, seeing other test failures
  • Ongoing discussions on getting Adrian access to machines

3/7/2018

• FD.io lab
  • Trishan (LF) to help follow up on progress in FD.io lab
• VPP
  • More discussion on patch for cache line size; use MIDR register exported by proc fs
  • Decision has been made to use wrappers for atomics
  • Damjan reworked PCI handling code and added native driver for Intel AVF (XL710 i.e. Fortville)
    • Measuring 132 clocks per packet on Skylake (ip4 routing) with VLIB_FRAME_SIZE 256 (default); +1Mpps over DPDK avf/i40e PMD
  • Damjan reworked memcpy() in MEMIF; achieve 2x25GbE line rate with these changes
  • Sirshak working on getting VPP running on Qualcomm Centriq with Mellanox NIC
    • Seeing issues with external DPDK; static works but not shared; is VPP build system missing -libverbs -lmlx5 in LDFLAGS?
    • Nitin noticed DPDK 17.11 Mellanox PMD does not compile
    • Mellanox recently submitted a patch to VPP to support dynamic loading of Mellanox libraries
• CSIT
  • Adrian does not have machines to work with in Bucharest; machine in Paris that Gabriel was using no longer available
    • AndyW to help resolve
  • Adarsh moved past VM issues; able to launch VPP in VM with virtio interface; starting to run CSIT scripts

2/28/2018

• FD.io lab
  • Ed Kern to try containerized CI on one OD1000 in parallel with Vanessa
  • Received MACCHIATObins in Austin
• VPP
  • Adarsh trying to run VPP in VM but getting PCI mapping issue; trying to connect to Linux bridge on host
  • Patches for build breakage were committed; arm64 build stable now
  • Brian able to reproduce low PPS numbers seen on MACCHIATObin
• CSIT
  • Adarsh can reproduce a crash in qemu 2.10 Ubuntu 16.04; going to try Ubuntu 17.10
  • Need to partition func test cases across people

2/21/2018

• FD.io lab
• CSIT
  • Gabriel updated CSIT/AArch64 wiki with PASS/FAIL/OTHER list
    • OTHER - failure due to expect-like parsing of output(?)
    • FAIL - ssh timeout during PCIe rescan(?)
  • Moved past first UEFI crash; still seeing crashing on startup (Gabriel)
    • Setup new Ubuntu environment
    • Continue debugging UEFI issue on Fedora with JeremyL
  • Ubuntu is used pretty much everywhere except for additional CentOS CSIT perf
  • Nitin working on upstreaming changes to CSIT
  • Adarsh working on getting VM interfaces working
• VPP
  • More discussion on how to handle cache line size
  • Sync'd on patches for build breakage

2/14/2018

• FD.io lab
  • Working on getting access to LF lab in order to setup OD1000 environment
  • Check with tykeal & zxiiro on trust policy for getting others access (Brian)
  • VEXXHOST
    • Mohammed says they do not have extra rack shelf - we need to send one for 3x MACCHIATObin
    • LF RT tickets: #52434 (ThunderX), #52435 (TaiShan2280), #52436 (MACCHIATObin)
• VPP
  • Build, unit test, deb/rpm
    • 64B/128B cache line size - working on passing this configuration to rest of build system i.e. DPDK (Nitin)
    • RPi3 32-bit
      • Some parts of patch are 32-bit related, some RPi3 related
      • If there is justification, look into maintaining a 32-bit build on ARM
  • Porting & Tuning
    • If patches need to be tested on multiple Arm chips, please use DO_NOT_MERGE and Code Review -2
    • Two NEON related patches merged, working in progress on others, Nitin testing CLASSIFY_USE_SSE
• CSIT
  • Please open JIRA ticket with details on VM crashing on startup. DONE: CSIT-922
  • Khem working on running VPP func tests on internal setup

2/7/2018

• LF lab
  • OD1000 - last machine was racked; Vanessa needs credentials
  • Taishan2280 - machines arrived at Vexxhost; confirm with Rudy/Mohammed
  • ThunderX - machines arrived at Vexxhost; send board details to Mohammed
  • MACCHIATObin - boards arrived in Arm SJC waiting for enclosures (Andy)
• Build, unit test, packaging
  • 64B/128B cache line size - working on it (Nitin)
  • Interest in ILP32 from Cavium; customer coming from MIPS32
    • BKK16-305B ILP32 Performance on AArch64
• VPP
  • NEON usage in vhost - sent first patch for review (Nitin)
    • Need to verify how it performs on other Arm-based machines (Brian)
    • VPP maintainers prefer to use SIMD wrappers, but it might not always be possible
      • Cavium/Arm had to rewrite algorithm for AArch64 instead of use SIMD wrappers in DPDK
  • CLIB_HAVE_VEC128 - working on it (Gabriel)
  • Discussed compiler builtins for atomics in VPP call; need to spin another patch with wrappers based on architecture (Kevin)
  • Seeing prefetch hostspots on TX2+MlnxCX4en (similar to Armada8040) (Nitin)
• CSIT
  • libvirt crashing on VM startup (Hierofalcon) (Gabriel)
    • Need someone who can reproduce this issue (Arm TBD)
  • Huawei also seeing VM issues (Khem)
  • buildroot doesn't work on Arm (Nitin)
    • Root issue: no support in GRUB for AArch64 in buildroot (?)
      • Need someone who can reproduce this issue (Arm TBD)
    • Peter Mikus replied to Nitin on csit-dev mail list
    • Using a temporary workaround: use a different VM image (Ubuntu Cloud) instead of one produced by buildroot
      • Working on patching DPDK in VM image (Ubuntu Cloud) just like done in buildroot
• Misc
  • OpenFlow (Nitin, Damjan)
    • Is there an OpenFlow agent for VPP, and can VPP implement OpenFlow rules/tables?
    • VPP is not flow-based like OVS is; they are different
    • Can ODL/Honeycomb be used?

1/31/2018

• LF lab
  • OD1000 - 1 replacement being installed this week
  • Huawei & Cavium boards should arrive at colo this week; confirm with Rudy
• Build, unit test, packaging
  • Kubeproxy/NAT failures
    • Not arch related
    • Part of extended unit tests, so does not block CI
  • `make test` passes on D03 & D05 (Ubuntu)
• MACCHIATObin
  • Seeing hotspots in VPP graph nodes
    • L3 forwarding - ip4 rewrite node
    • L2 cross-connect
    • Try reducing quad loop to a dual loop
    • dpdk-input node highly opt for x86 (could contribute to low perf) but hotspots still in rte_mbuf_t conversion(?)
  • Some examples of runtime code selection based on uarch exist in the codebase
• CSIT
  • Adrian Oanca join from Enea
  • Gabriel seeing VM crashing during boot; related to # interfaces assigned (6)
  • Nitin ran into issue with buildroot on arm64; see thread on csit-dev

1/24/2018

• VPP
  • DPDK issue with non-pci network cards
  • build & test status updated
  • VPP-1127 (VEC_128 enable) under discussion. Should we enable this by default ?
  • add Nitin to review Neon commits
  • VPP-1114 currently internal review
  • VPP-1064 under rework after review by Damjan
• CSIT
  • first 3-nodes functional tests status list
  • TODO Gabriel: share CSIT VM setup env
  • nested VM: build-root package support for ARM. Create Jira ticket for Brian.

1/17/2018

• Tina to send calendar invite for meeting
• FD.io lab
  • Cavium shipping
• VPP
  • Kubeproxy tests failing
  • Khem trying to find out the PCIe address for a given netdev interface
• CSIT
  • Gabriel setting up 3 node topo with VMs
  • Gabriel working on PASS/FAIL status
• CSIT 17.10 report

1/10/2018

• Meeting moved 2 hours earlier - 6AM PT / 3PM CET / 7:30PM IST / 10PM CST
• FD.io lab
  • Cavium ThunderX shipping soon
• VPP
  • Kumar to look at VPP-1126
  • Gabriel proposed https://gerrit.fd.io/r/#/c/10049/ as follow-up to Damjan's patch
• CSIT
  • Gabriel's patch for aarch64 support in CSIT merged
  • VirtualBox not supported on Arm / Vagrant unknown
    • This is OK for upstream since automation expects VMs to already exist
• Performance
  • Need plan for 1T; use TaiShans that were sent to lab
• AIs
  • Brian: Follow up with Vanessa and EdW regarding 'resource issue'
  • Gabriel: Update CSIT wiki page; which tests are passing/failing?
  • Brian: Check with Vanessa how to split machines between CI jobs and CSIT jobs

1/3/2018

• FD.io lab
  • One OD1000 sent for RMA
  • Huawei PO sent out
  • Cavium PO sent out (?)
• VPP
  • Gabriel working on patch for "show cpu" to display MIDR as human readable
  • Nitin sent preliminary patch for vhost-user NEON impl
    • Seeing perf differences on different cores; tradeoff is single-threaded perf vs. NEON
  • Kumar built and unit test successfully on D03
  • Nitin to resume patch for supporting different cache line sizes for the same arch
• CSIT
  • Gabriel cleaned up WIP patch; ready for review
  • Kumar starting CSIT func tests with Ubuntu VMs
    • Scripts for running on dedicated hardware need to be modified, e.g. PCIe resources
  • Kumar to send doc on testing
• Performance
  • Kumar to start thread on performance testing
• AIs
  • Brian: Check with Tina on shipping and open LF RT ticket once they have arrived
  • Brian: Need a way to choose either SW or NEON impl based on chip
  • Gabriel: Create list of broken CSIT tests for 2-node topology

12/20/2017 No meeting next week - Dec 27

• FD.io lab
  • OD1000s - build only
    • 1 of 3 needs to be RMAd
    • Can these be up in time to show 'make test' passes on ARM for 18.01 release report?
  • TaiShan
    • PO in progress
  • ThunderX - build only
    • PO went out
• VPP
  • Patches / JIRAs
    • Patch for extended test failure, but still more (new) extended test failures - Gabriel
    • Nitin to post vhost-user.c changes for NEON
      • Nitin will finish Gabriel's original NEON patch to add CLIB_HAVE_VEC_128
  • Can we share code on Github e.g. NEON perf tests?
• CSIT
  • Leading question: How many CSIT test cases are passing/failing?
  • Environment issues preventing running through all CSIT test cases; Gabriel needs dedicated machines or more RAM
  • Cavium & Huawei will join Gabriel in CSIT replication on ARM hardware next week
    • Cavium previously ran vhost test cases manually, now moving to CSIT

12/13/2017

• VPP
  • Quick overview of work items
  • Waiting to hear back from LF about OD1000 connectivity
    • Changes needed to ci-mgmt
• CSIT
  • Starting to reproduce CSIT on x86 and ARM (with Gabriel's WIP patch)
    • Some issues with environment variables (perf tests on 2-node)
  • Need Nexus to support aarch64 packages
    • Need a contact for Nexus
• Share known issues on wiki!
• Request CSIT 'deep dive'

12/06/2017

• Can we access the OD1000 in csit lab ?
  • currently mainly working with VMs
• added dedicated wiki page for CSIT : https://wiki.fd.io/view/CSIT/AArch64
• WIP : https://gerrit.fd.io/r/#/c/9474/

11/29/2017

• VPP
  • vhost-user.c - SSE4.2 only. Implement range search using NEON. (nitin)
  • OD1000 status ?
    • build only
    • can we access them ?
    • what wan we do to help in general ?
  • x86 intrinsic review
  • build VPP on ARM VM on x86
• CSIT
  • what platforms wil lbe made available

11/22/2017

• VPP CI
  • 3 ThunderX for Chrismas
• CSIT
  • func on VM vs perfs on HW
  • func on x86 VMs OK with 2 nodes
  • DPDK integration WIP : https://gerrit.fd.io/r/#/c/9474/
  • issues
    • how to access the lab ?
• Next steps
  • VPP
  • CSIT
    • structure work & send email (Gabriel)
    • is xxhash vs crc32 finished ? (Gabriel)
    • ask Maciek & setup a presentation meeting with someone from CSIT (Tina)
    • find a time to reschedule this meeting before the CSIT weekly call (Brian)

11/15/2017

• VPP upstream status
  • build && build-release OK
  • "make test" && "make test-debug" OK
  • packaging:
    • Ubuntu 16.04 OK
    • Ubuntu 17.10 ? (TBC)
    • fedora-26 OK
• vpp continuous test
  • all task required for jenkin's "verify" job are ready
  • TODO: request gerrit hook to Dave Barachs / vpp-dev (NB & GG)
  • set up ci in fdio lab
• CSIT
  • setting up env
  • ThunderX platforms should arrive this week
  • csit work sharing

11/8/2017

• Unit tests
  • Tests pass except for random initialization failures
  • Need to hear back from upstream about Extended unit tests
• Should we run plugins such as NSH SFC?
• Hardware to lab
  • Huawei h/w stalled
  • 3x ThunderX shipping to FD.io lab
• CSIT replication
  • Cavium replicating on ThunderX2; getting started
• Let's track our work in Jira; Brian to migrate tasks to Jira

10/25/2017

• Gabriel working on vpp init failure in linux_pci_init()
• Kumar to check with GeorgeZ on Huawei boards shipped to CSIT; need to verify tests also on this environment (package versions from distro)
• Brian to check whether anything else needs to be done besides 'make test' for upstream enablement