...
Identified Need | Description | Driver | Dependencies | Project fit | |||
Test Suite | robot test suites executed Consumer driven/broker driven testing framework | Jenkins Job Flow | Autorelease | Trigger daily autorelease job to build all projects together from source •Code and tools for automatic system testing and continuous integration test flows across ONAP projects •Common guidelines, templates, and best practices to help project developers to write unit and system test code •Framework and tools for security testing | •Automate the building artifacts/binaries to minimize human errors and reduce engineering costs •Ensure that changes in one project will not break the functionality of other projects •Assure that the entire ONAP project/product functions correctly in the case of continual change in subprojects •Ensure consistency in unit and system testing methodology across all the ONAP projects •Capture security issues | integration/test | |
CI Builder | •Scripts and definitions for build pipelines and CI jobs in Jenkins, as well as for VM and docker images required for CI tests | •Required to support the executing of CI jobs (e.g. for Jenkins) | integration | ||||
Autorelease | •Scripts to build the artifacts/binaries (e.g. zip/targz files) that are used in the release candidates and final release from scratch | •Detect cyclical dependencies •Generate release candidates and final release •It generates dependency lists / graph automatically | integration/autorelease | ||||
Distribution | •Scripts to be used by the end user for setup and execution of the ONAP project modules •Default/sample configuration files, README files | •Ease of industry adoption of ONAP by providing scripts and other information for setup/installation/configuration | integration | ||||
Packaging | •Scripts and package definitions for deb, RPM, etc. installer packages for various Linux or other OS distributions •Sample VM or docker images | •An industry standard installer could help anyone to try out ONAP easier •Industry adaption | integration | ||||
S3P | •Test cases for performance, scalability, resilience/stress testing, longevity •Benchmarking and performance whitepapers | •Define standard S3P testing metrics •Provide and publish benchmarking results | integration | ||||
Infrastructure Specification | •Develop the specifications for the “ONAP compliant” deployment and test environment | •Assist the planning and procurement of the necessary hardware and infrastructure for setting up ONAP environments | integration | ||||
Bootstrap | •A framework to automatically install and test a set of base infrastructure components for new developer | •Reduce the barrier of entry to allow new ONAP developers to ramp up onto active development quickly •Reduce the cost to the community in responding to simple environment setup questions faced by new developers | integration | ||||
VF Compliant and Verification Testing | •Create automatic test cases and script for VF testing •Perform VF compliant testing and verification using tools provided by ONAP •Delivery the testing reports and whitepaper | •Assist define the testing metrics •Reduce adoption risks for end-users | integration | ||||
Community Integration Lab | •Scripts and definitions for setting up a POC sample deployment of use cases in lab settings •Provisioning, installation, and setup of all the telco equipment such as switches, routers, and gateways to enable end to end testing •Allow remote access to the lab environment for interoperability testing •Automatic updates of code in lab environment from future releases | •Support the needs of consistent, reproducible lab setup for demo and POC purposes •Promote easy interoperability testing with different hardware devices, SDN controllers, etc. •Automate the process of keeping the lab code up to date with the latest changes | integration | ||||
| Template | Templates for test suites | integration |
Project proposals.
Project 1:
...
- Provides all the cross-project infrastructure framework and DevOp toolchain, code and scripts, best practice guidance and benchmark, testing reports and white paper related to:
- Cross projects Continuous System Integration Testing (CSIT)
- VNF compliant and verification testing leveraging ONAP projects
- Release delivering of the ONAP project
- PoC: building and maintenance community integration labs
- Continuous Distribution (CD) to ONAP community integration labs
Other:- Identify baseline code (if any)
- Leveraging existing set up already in ONAP/ECOMP and OPEN-O
Meeting Notes:
#info helen says presents Slidedeck: System Integration and Testing
...
#question will there be docker level test? looking Looking at the docker logs?
- We have the base infrastructure for it. We do not scan the logs for strings. The robot test framework will check against the signature of the api call.
...
#question In the microsservice, the broker based testing is getting more popular.
- consumer driven, broker driven
...
#question do we test both expected and unexpected inputs?
- We should test both.
#question can we consider a consolidation of the test?
...
#question do we have a way to leverage localize test environments?
- Requires additional work with LF
#question Can we have test templates?
- That is a good suggestion
#question We need a project to address security concerns?
- The TSC needs to own that and create a committee for that
...