CSIT/VPP-16.06 Test Report Draft

From fd.io
< CSIT
Revision as of 13:49, 8 June 2016 by Mackonstan (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

FD.io CSIT Test Report for VPP-16.06

Functional tests

   per topology
       list of executed test cases and their results PASS/FAIL/ISSUE
   description of topologies
   description of each test case
       reference spec of tested functionality i.e. IETF RFC

Performance tests

   per topology
       list of executed test cases and their results
           long tests - graphs with discovered NDR and PDR rates
           short tests - list with PASS/FAIL/ISSUE
   description of topologies
   description of each test case, test case type

Configuration of DUT VPP technology stack

   compute HW
   OS
   VPP compilation settings
   VPP startup configs

Performance tests environment

   Config Data: VPP (DUT)
       NUMA Node Location of VPP Interfaces
       VPP Running Configuration
       VPP Startup Configuration
       VPP Version
       VPP Compile Parameters
       VPP Build Script used - pointer if default
   Config Data: Compute Host (DUT)
       Host BIOS Information
       Host OS Information
   Config Data: Traffic Generator - T-Rex
       TG Version
       TG settings
   Test Data: VPP (DUT)
       VPP Debug_cli Outputs at NDR
   Test Data: Compute Host (DUT)
       CPU Perf Counters at NDR - not collected today
   Test Data: Traffic Generator - T-Rex
       TG (T-Rex) Outputs During & After Test at 64B NDR
       TG (T-Rex) Outputs During & After Test at IMIX NDR
       TG (T-Rex) Outputs During & After Test at 1518 NDR
       TG (T-Rex) Outputs During & After Test at 9000 NDR

Functional tests environment

   Config Data: VPP (DUT)
       VPP Running Configuration
       VPP Startup Configuration
       VPP Version
       VPP Compile Parameters
       VPP Build Script used - pointer if default
   Config Data: VM (DUT)
       VM OS Information
   Config Data: Traffic Generator - Scapy
       TG Version
   Test Data: VPP (DUT)
       VPP Debug_cli Outputs at NDR
   Test Data: Traffic Generator - Scapy

CSIT release notes

   jira release notes
   dump of test cases from csit-verified branch
       functional
       performance