...
• Pair-wise testing performed by the project teams
• 72h stability test run
Need for continuous integration testing:
- Some experience is based on HPA testing on vCPE use case. vCPE use case, even though, it was tested on Amsterdam successfully, it took a while to make vCPE work on Beijing components. It could be that there was some regression. Since HPA depends on vCPE use case, it could not be tested till the end. This can be avoided if previously tested use cases are verified continuously. Automation of use case testing & continuous integration verifications are key to add new functionalities in future releases.
Lesson Learned Areas
• Communication – Wiki, Mailing Lists, IRC
...
- The LF toolchain that is currently in place, do allow to merge in master code that has not been thoroughly tested. This leads to massive disruption in the testing.
- Nexus 3 slowness. This has been impacting Integration Team tremendously as it tooks 3-4 more times just to download Docker images.
- Current 1/3 party scan security tool (Nexus IQ) do not work for Python and JavaScript packages and thus prevent the community to have an holistic view on vulnerabilities.
- For the record, it was decided that the community would not account for JavaScript in using Sonar (code coverage) in Beijing Release.
• PTL Role
• Architecture
- Need for simplifying ONAP Micro-Service architecture by leveraging best practices from Industry :
- Certificate enrollment (for Mutual TLS communication among services) in Beijing was manual, time consuming and error prone. Need automation of certificate enrollment is needed.
- Scale-out of ONAP is removed from the scope in Beijing release. Services that attempt do it has some learnings. Scale-Out/Load balancing/Circuit-breaking/DB-sync related functionality should be removed from actual micro services to sidecars/side-kicks to avoid each developer spending time and getting it right.
• Use cases:
- Increase the scope of vCPE use case in deploying multiple virtual Gateways (Multi-Customer support)
• Open Source Values
- One critical aspect of Open Source is transparency (but opposition to Silos). We still see some corporation submitting huge pile of code days prior to major milestones. This approach is preventing the whole community to collaborate effectively.
...