Difference between revisions of "CSIT/VPP-16.06 Test Report Draft"

From fd.io
Jump to: navigation, search
(Created page with "FD.io CSIT Test Report for VPP-16.06 ==Functional tests== per topology list of executed test cases and their results PASS/FAIL/ISSUE description of topologies...")
 
Line 1: Line 1:
 
FD.io CSIT Test Report for VPP-16.06
 
FD.io CSIT Test Report for VPP-16.06
  
==Functional tests==
+
==Functional tests description==
 
     per topology
 
     per topology
 
         list of executed test cases and their results PASS/FAIL/ISSUE
 
         list of executed test cases and their results PASS/FAIL/ISSUE
Line 8: Line 8:
 
         reference spec of tested functionality i.e. IETF RFC
 
         reference spec of tested functionality i.e. IETF RFC
  
==Performance tests==
+
==Performance tests description==
 
     per topology
 
     per topology
 
         list of executed test cases and their results
 
         list of executed test cases and their results
Line 15: Line 15:
 
     description of topologies
 
     description of topologies
 
     description of each test case, test case type
 
     description of each test case, test case type
 +
 +
==Functional tests results==
 +
 +
==Performance tests results==
  
 
==Configuration of DUT VPP technology stack==
 
==Configuration of DUT VPP technology stack==

Revision as of 14:00, 10 June 2016

FD.io CSIT Test Report for VPP-16.06

Functional tests description

   per topology
       list of executed test cases and their results PASS/FAIL/ISSUE
   description of topologies
   description of each test case
       reference spec of tested functionality i.e. IETF RFC

Performance tests description

   per topology
       list of executed test cases and their results
           long tests - graphs with discovered NDR and PDR rates
           short tests - list with PASS/FAIL/ISSUE
   description of topologies
   description of each test case, test case type

Functional tests results

Performance tests results

Configuration of DUT VPP technology stack

   compute HW
   OS
   VPP compilation settings
   VPP startup configs

Performance tests environment

   Config Data: VPP (DUT)
       NUMA Node Location of VPP Interfaces
       VPP Running Configuration
       VPP Startup Configuration
       VPP Version
       VPP Compile Parameters
       VPP Build Script used - pointer if default
   Config Data: Compute Host (DUT)
       Host BIOS Information
       Host OS Information
   Config Data: Traffic Generator - T-Rex
       TG Version
       TG settings
   Test Data: VPP (DUT)
       VPP Debug_cli Outputs at NDR
   Test Data: Compute Host (DUT)
       CPU Perf Counters at NDR - not collected today
   Test Data: Traffic Generator - T-Rex
       TG (T-Rex) Outputs During & After Test at 64B NDR
       TG (T-Rex) Outputs During & After Test at IMIX NDR
       TG (T-Rex) Outputs During & After Test at 1518 NDR
       TG (T-Rex) Outputs During & After Test at 9000 NDR

Functional tests environment

   Config Data: VPP (DUT)
       VPP Running Configuration
       VPP Startup Configuration
       VPP Version
       VPP Compile Parameters
       VPP Build Script used - pointer if default
   Config Data: VM (DUT)
       VM OS Information
   Config Data: Traffic Generator - Scapy
       TG Version
   Test Data: VPP (DUT)
       VPP Debug_cli Outputs at NDR
   Test Data: Traffic Generator - Scapy

CSIT release notes

   jira release notes
   dump of test cases from csit-verified branch
       functional
       performance