Difference between revisions of "CSIT"

From fd.io
Jump to: navigation, search
(→‎CSIT Tutorials)
m (→‎Test Reports)
 
(95 intermediate revisions by 10 users not shown)
Line 1: Line 1:
 +
 
{{Project Facts
 
{{Project Facts
 
|name=CSIT
 
|name=CSIT
Line 5: Line 6:
 
|projectLead=Maciek Konstantynowicz
 
|projectLead=Maciek Konstantynowicz
 
|committers=
 
|committers=
−
* Jan Gelety
+
* Tibor Frank
−
* Matej Klotton
+
−
* Stefan Kobza
+
−
* Carsten Koester
+
 
* Maciek Konstantynowicz
 
* Maciek Konstantynowicz
−
* Miroslav Miklus
+
* Juraj Linkes
 +
* Peter Mikus
 +
* Vratko Polak
 
* Dave Wallace
 
* Dave Wallace
 
}}
 
}}
  
−
==Description==
+
== Get Involved ==
−
CSIT (Continuous System Integration and Testing) project is focusing on:
+
−
# Development of software code for fully automated VPP code testing, functionality, performance, regression and new functions.
+
−
# Execution of CSIT test suites on VPP code running on LF FD.io virtual and physical compute environments.
+
−
# Integration with FD.io continuous integration systems (Gerrit, Jenkins and such).
+
−
# Identified existing FD.io project dependencies and interactions:
+
−
#* vpp - Vector Packet Processing.
+
−
#* honeycomb - Honeycomb Agent for management plane testing.
+
−
#* ci-management - Management repo for Jenkins Job Builder, script and management related to the Jenkins CI configuration.
+
−
 
+
−
==Get Involved==
+
 
* [[CSIT/Meeting|Weekly CSIT Meeting]].
 
* [[CSIT/Meeting|Weekly CSIT Meeting]].
 +
* [https://wiki.fd.io/view/CSIT/TWS On-demand Technical Workstream Meetings].
 
* [https://lists.fd.io/mailman/listinfo/csit-dev Join the CSIT Mailing List].
 
* [https://lists.fd.io/mailman/listinfo/csit-dev Join the CSIT Mailing List].
 
* [[IRC | Join fdio-csit IRC channel]].
 
* [[IRC | Join fdio-csit IRC channel]].
−
* [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=1&projectKey=CSIT CSIT dev work tracking]
 
  
−
==Scope==
+
== Start Here ==
−
Fd.io CSIT project scope:
+
* [[CSIT/Description | What is CSIT (Continuous System Integration and Testing)?]]
 +
* [https://csit.fd.io/cdocs/overview/csit/design/ CSIT Design]
 +
* [https://csit.fd.io/cdocs/overview/c_dash/design/ CDASH Design]
 +
* [https://jira.fd.io/secure/RapidBoard.jspa?rapidView=8 CSIT Development Tasks (Jira)]
 +
* [https://jenkins.fd.io/view/csit/ CSIT Jenkins Jobs ]
 +
* [https://csit.fd.io/cdocs/overview/csit/branching_strategy/ CSIT Branching Strategy]
 +
* [https://csit.fd.io/cdocs/infrastructure/fdio_dc_testbed_specifications/ FD.io CSIT testbeds specification]
 +
* [https://csit.fd.io/ CSIT Performance Dashboard]
 +
** [https://csit.fd.io/trending/ Performance Trending]
 +
** [https://csit.fd.io/report/ Per Release Performance]
 +
** [https://csit.fd.io/stats/ Test Job Statistics]
 +
** [https://csit.fd.io/news/ Failures and Anomalies]
 +
* [https://wiki.fd.io/view/CSIT/TestFailuresTracking CSIT Test Failures Summary and Status]
  
−
# Automated regression testing of VPP code changes
+
== Test Reports ==
−
#* Functionality of VPP data plane, network control plane, management plane against functional specifications.
+
* [https://csit.fd.io/cdocs/release_notes/current/ CSIT-2402 Test Report]
−
#* Performance of VPP data plane including non-drop-rate packet throughput and delay, against established reference benchmarks.
+
* [https://csit.fd.io/cdocs/release_notes/previous/csit_rls2310/ CSIT-2310 Test Report]
−
#* Performance of network control plane against established reference benchmarks.
+
* [https://csit.fd.io/cdocs/release_notes/previous/csit_rls2306/ CSIT-2306 Test Report]
−
#* Performance of management plane against established reference benchmarks.
+
* [https://docs.fd.io/csit/rls2302/report/ CSIT-2302 Test Report]
−
# Test case definitions driven by supported and planned VPP functionality, interfaces and performance:
+
* [https://s3-docs.fd.io/csit/rls2210/report/ CSIT-2210 Test Report]
−
#* Uni-dimensional tests: Data plane, (Network) Control plane, Management plane.
+
* [https://s3-docs.fd.io/csit/rls2206/report/ CSIT-2206 Test Report]
−
#* Multi-dimensional tests: Use case driven.
+
* [https://s3-docs.fd.io/csit/rls2202/report/ CSIT-2202 Test Report]
−
# Integration with FD.io Continuous Integration system including FD.io Gerrit and Jenkins
+
* [https://s3-docs.fd.io/csit/rls2110/report/ CSIT-2110 Test Report]
−
#* Automated test execution triggered by VPP-VERIFY jobs other VPP and CSIT project jobs.
+
* [https://s3-docs.fd.io/csit/rls2106/report/ CSIT-2106 Test Report]
−
# Integration with LF VPP test execution environment
+
* [https://s3-docs.fd.io/csit/rls2101_1/report/ CSIT-2101.1 Test Report]
−
#* Functional tests execution on LF hosted VM environment.
+
* [https://docs.fd.io/csit/rls2009/report/ CSIT-2009 Test Report]
−
#* Performance and functional tests execution on LF hosted physical compute environment.
+
* [https://docs.fd.io/csit/rls2005/report/ CSIT-2005 Test Report]
−
#* Subset of tests executed on LF hosted physical compute running VIRL (Virtual Internet Routing Lab).
+
* [https://docs.fd.io/csit/rls2001/report/ CSIT-2001 Test Report]
 +
* [https://docs.fd.io/csit/rls1908/report/ CSIT-1908 Test Report]
 +
* [https://docs.fd.io/csit/rls1904/report/ CSIT-1904 Test Report]
 +
* [https://docs.fd.io/csit/rls1901/report/ CSIT-1901 Test Report]
 +
* [https://docs.fd.io/csit/rls1810/report/ CSIT-1810 Test Report]
 +
* [https://docs.fd.io/csit/rls1804/report/ CSIT-1804 Test Report]
 +
* [https://docs.fd.io/csit/rls1801/report/ CSIT-1801 Test Report]
 +
* [https://docs.fd.io/csit/rls1710/report/ CSIT-1710 Test Report]
 +
* [https://docs.fd.io/csit/rls1707/report/ CSIT-1707 Test Report]
 +
* [https://docs.fd.io/csit/rls1704/report/ CSIT-1704 Test Report]
 +
* [https://docs.fd.io/csit/rls1701/report/ CSIT-1701 Test Report]
 +
* [https://wiki.fd.io/view/CSIT/VPP-16.09_Test_Report CSIT-1609 Test Report]
 +
* [https://wiki.fd.io/view/CSIT/VPP-16.06_Test_Report CSIT-1606 Test Report]
  
−
==CSIT Documentation==
+
== CSIT Code Documentation ==
−
*[[CSIT/Documentation]]
+
* [https://s3-docs.fd.io/csit/master/docs CSIT master Documentation]
−
**[[CSIT/Documentation#CSIT Code Structure|CSIT Code Structure]]
+
* [https://s3-docs.fd.io/csit/rls2206/docs/ CSIT-2206 Documentation]
−
**[[CSIT/Documentation#CSIT Test Code Guidelines|CSIT Test Code Guidelines]]
+
* [https://s3-docs.fd.io/csit/rls2202/docs/ CSIT-2202 Documentation]
 +
* [https://s3-docs.fd.io/csit/rls2110/docs/ CSIT-2110 Documentation]
 +
* [https://s3-docs.fd.io/csit/rls2106/docs/ CSIT-2106 Documentation]
 +
* [https://docs.fd.io/csit/rls2101/doc/ CSIT-2101 Documentation]
 +
* [https://docs.fd.io/csit/rls2009/doc/ CSIT-2009 Documentation]
 +
* [https://docs.fd.io/csit/rls2005/doc/ CSIT-2005 Documentation]
 +
* [https://docs.fd.io/csit/rls2001/doc/ CSIT-2001 Documentation]
 +
* [https://docs.fd.io/csit/rls1908/doc/ CSIT-1908 Documentation]
 +
* [https://docs.fd.io/csit/rls1904/doc/ CSIT-1904 Documentation]
 +
* [https://docs.fd.io/csit/rls1901/doc/ CSIT-1901 Documentation]
 +
* [https://docs.fd.io/csit/rls1810/doc/ CSIT-1810 Documentation]
 +
* [https://docs.fd.io/csit/rls1804/doc/ CSIT-1804 Documentation]
 +
* [https://docs.fd.io/csit/rls1801/doc/ CSIT-1801 Documentation]
 +
* [https://docs.fd.io/csit/rls1710/doc/ CSIT-1710 Documentation]
 +
* [https://docs.fd.io/csit/rls1707/doc/ CSIT-1707 Documentation]
 +
* [https://docs.fd.io/csit/rls1704/doc/ CSIT-1704 Documentation]
 +
* [https://docs.fd.io/csit/rls1701/doc/ CSIT-1701 Documentation]
 +
* [[CSIT/Documentation| CSIT 16.09/16.06 Documentation]]
  
−
==CSIT Test Plan==
+
== Training ==
−
===Functional===
+
−
* [[CSIT/FuncTestPlan|CSIT functional test plan]]
+
−
 
+
−
===Performance===
+
−
* [[CSIT/PerfTestPlan|CSIT performance test plan]]
+
−
 
+
−
===Testing Infra===
+
−
* [[CSIT/VnetInfraPlan|CSIT vNet infrastructure plan]]
+
−
 
+
−
===CSIT Jobs===
+
−
* [[CSIT/Jobs|CSIT Jenkins Jobs listing]]
+
−
 
+
−
==CSIT Performance Testbed in LF==
+
−
* [[CSIT/CSIT_LF_testbed | CSIT Performance Testbed]]
+
−
 
+
−
==CSIT Tutorials==
+
−
* [[CSIT/Tutorials/Vagrant/Virtualbox/Windows7 | Local execution of CSIT using Vagrant+Virtualbox on Windows 7]]
+
−
* [[CSIT/Tutorials/Vagrant/Virtualbox/MacOsX | Local execution of CSIT using Vagrant+Virtualbox on Mac OS X ]]
+
−
* [[CSIT/Tutorials/Vagrant/Virtualbox/Ubuntu | Local execution of CSIT using Vagrant+Virtualbox on Ubuntu ]]
+
−
 
+
−
==CSIT Materials==
+
 
* FD.io DevBoot - San Jose 4th to 7th of April 2016 -  [https://drive.google.com/file/d/0B8xKFVHWtNPAdFBKcjhLQ2NLSjA/view?usp=sharing CSIT + Performance testing]
 
* FD.io DevBoot - San Jose 4th to 7th of April 2016 -  [https://drive.google.com/file/d/0B8xKFVHWtNPAdFBKcjhLQ2NLSjA/view?usp=sharing CSIT + Performance testing]
−
 
+
* FD.io /dev/boot | June 2016 | Paris, France
−
==CSIT Project Page Content to_be_added==
+
** [https://wiki.fd.io/view/Events/Training-2016-05-Content Content and slides]
−
* Documentation
+
*** [https://drive.google.com/file/d/0B0ZT6l65-x47MXo3OU1zdl9BOG8/view Day One - 1.3 CSIT Overview]
−
** Descriptions
+
*** [https://drive.google.com/file/d/0B0ZT6l65-x47Tmx6RlBmZlVWbkU/view Day Three - 3.5 Introduction to CSIT]
−
*** CSIT code that's running: functional and performance tests.
+
** [https://wiki.fd.io/view/Events/Training-2016-05-Content Videos]
−
*** CSIT testbeds
+
*** [https://www.youtube.com/watch?v=3tIXfx5QTlw&list=PLWHpG2-3ZXXuFm0r_TmpxzUV-Rr8L7Uc-&index=5 Day One - 1.3 CSIT Overview]
−
**** Operational: physical, virtual-VIRL.
+
*** [https://www.youtube.com/watch?v=BTjSHCgRpIg&list=PLWHpG2-3ZXXuFm0r_TmpxzUV-Rr8L7Uc-&index=23 Day Three - 3.5 Introduction to CSIT]
−
**** Non-operational: virtual-VM.
+
* [[CSIT/TOIs | CSIT TOI Sessions]]
−
*** Running CSIT integration with FD.io gerrit and jenkins.
+
* [[CSIT/CSIT Developer Documentation Notes | CSIT Developer Documentation Notes]]
−
** CSIT usability manual
+
−
*** Instructions how to use CSIT to verify VPP code commits and avoid breaking it.
+
−
*** Onboarding of new VPP test cases onto CSIT system.
+
−
* CSIT work in progress
+
−
** Code in development, priorities.
+
−
** Development plan, priorities.
+
−
** FD.io jira for tracking execution against the plan, scheme proposal.
+

Latest revision as of 05:18, 13 May 2024

CSIT Facts

Project Lead: Maciek Konstantynowicz
Committers:

  • Tibor Frank
  • Maciek Konstantynowicz
  • Juraj Linkes
  • Peter Mikus
  • Vratko Polak
  • Dave Wallace

Repository: git clone https://gerrit.fd.io/r/csit
Mailing List: csit-dev@lists.fd.io
Jenkins: jenkins silo
Gerrit Patches: code patches/reviews
Bugs: CSIT bugs

Get Involved

Start Here

Test Reports

CSIT Code Documentation

Training

Retrieved from "https://wiki.fd.io/index.php?title=CSIT&oldid=12604"