Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
outlinetrue

Overview

...

What is this release trying to address?

ScopePriorityCommitter LeadResources CommittedEpicDependencies
Do Not Break the BuildHighestYang XuYang Xu Marco Platania

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-849


oParent Update for Security VulnerabilityHighest

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-833


Use Case TestingHighesteveryone in integration team, see use case owners below

ONAP CI EnhancementHighest

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-834


Maintain ONAP Integration Testing InfrastructureHighest

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-835


S3P Testing EnhancementHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-836


vCPE Use Case Test AutomationHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-837


Use Case Development for vFW and ScalingHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-838


CIA ProjectHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-542

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-543

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-544

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-545



Use Cases


Use Case Test Cases

Lab

Responsible

EPIC

1vFW / vDNS

Intel / Windriver


2

vCPE Integration Test Case

Intel / Windriver


3

vCPE with TOSCA VNF Test Case

CMCC


4

5G - Real Time PM and High Volume Stream Data Collection - Integration Test Status

TLab


5

5G - PNF PnP - Integration Test Status

TLab
6

5G - Bulk PM - Test Status

Intel / Windriver


7

5G - OOF and PCI - Integration Test Cases

Intel / Windriver





8

Scale Out - Integration Test Cases and Status

Intel / Windriver


9CCVPN Integration Test CasesCMCC


10

vFW/vDNS HPA Regression and Enhancement Testing

(

Test Plan 1 in

HPA & Cloud Agnostic Intent - R3 Test Plan)

Intel / Windriver


11Change Management - Flexible Designer & OrchestratorIntel / Windriver



12Change Management - Traffic Management-Intel / Windriver



13

Change Management - 5G PNF in-place software upgrade

Intel / Windriver



14Change Management - Schedule optimizationIntel / Windriver


15

BBS (Broadband Service)
BBS Use Case Tracking (Dublin Release)

Swisscom, CMCC, Huawei, Nokia
165G Slicing (scope is not clear, need to wait for TSC requirement)AT&T, Nokia, Ericsson
17vFW on ARM (
PoC
no integration commitment, vendor will cover all tests)ARM, ENEA
18Model driven control loop designAT&T, NokiaTesting confirmed by AT&T
19K8S based cloud region supportIntel, VMWareTesting confirmed by Intel
20Distributed Analytics as a Service (Dublin Summary) - Edge AutomationVMWare, IntelTesting confirmed by Intel
21Consistent ID of a Cloud Region Windriver, AT&T, CMCCNeed to talk to Bin Yang about testing resource

Minimum Viable Product

  • CI/CD running on onapci.org
  • Automatic unit testing, CSIT testing, and end-to-end testing
  • Guidelines, frameworks, or best practice recommendations on S3P testing for ONAP project teams

...

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject="integration" and issuetype="epic" and status!=closed
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

...

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject=integration and issuetype in (story) and status!=closed
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

...

  • Cross-project Continuous System Integration Testing (CSIT)
  • End-to-End (ETE) release use cases testing with VNFs with repeatability
  • CI/CD to ONAP community integration labs
  • Reference VNFs that can be used to show how the ONAP platform handles

Release Deliverables

...

Sub-components are repositories and are consolidated in a single centralized place. Edit the Release Components name for your project in the centralized page.

...

Refering to CII Badging Security Program and Platform Maturity Requirements, fill out the table below by indicating the actual level , the targeted level for the current release and the evidences on how you plan to achieve the targeted level.

Area

Actual Level

Targeted Level for current Release

How, Evidences

Comments

ManageabilityNot Measured1, partial of 2
  • 1 – single logging system across components; instantiation in < 1 hour
  • 2 – ability to upgrade a single component; tracing across components; externalized configuration management
PerformanceNot MeasuredNot Measured
  • 0 -- none
  • 1 – baseline performance criteria identified and measured
  • 2 & 3 – performance improvement plans created & implemented
Resiliency23

Will cover geo-redundancy if lab env supports it.

All Integration team will perform platform-level testing similar to:

Beijing Release Resiliency Testing Status

  • 0 – none
  • 1 – manual failure and recovery (< 30 minutes)
  • 2 – automated detection and recovery (single site)
  • 3 – automated detection and recovery (geo redundancy)
ScalabilityNot MeasuredNote Measured
  • 0 – no ability to scale
  • 1 – single site horizontal scaling
  • 2 – geographic scaling
  • 3 – scaling across multiple ONAP instances
SecurityNot MeasuredNot Measured
  • 0 – none
  • 1 – CII Passing badge + 50% Test Coverage
  • 2 – CII Silver badge; internal communication encrypted; role-based access control and authorization for all calls
  • 3 – CII Gold
Stability22

Integration team will perform platform-level testing similar to:

Beijing Release Stability Testing Status (w/ OOM)

Beijing Release Stability Testing Status (w/ HEAT)

  • 0 – none
  • 1 – 72 hours component level soak w/random transactions
  • 2 – 72 hours platform level soak w/random transactions
  • 3 – 6 months track record of reduced defect rate
UsabilityNot MeasuredNot Measured
  • 1 – user guide; deployment documentation; API documentation
  • 2 – UI consistency; usability testing; tutorial documentation


  • API Incoming Dependencies

List the API this project is expecting from other projects.
Prior to Release Planning review, Team Leads must agreed on the date by which the API will be fully defined. The API Delivery date must not be later than the release API Freeze date.

Prior to the delivery date, it is a good practice to organize an API review with the API consumers.

...

Third Party Products mean products that are mandatory to provide services for your components. Development of new functionality in third party product may or not be expected.
List the Third Party Products (OpenStack, ODL, RabbitMQ, ElasticSearch,Crystal Reports, ...).


Name

Description

Version

Chaos MonkeyResilience Testing tool

Docker

Container platform
JenkinsCI/CD tool
JMeterPerformance Testing tool
OpenstackCloud OS
RobotTesting framework

In case there are specific dependencies  (Centos 7 vs Ubuntu 16. Etc.) list them as well.

...

The goal is to automate all the unit testing, CSIT testing, and end-to-end testing in release Casablanca. The detailed test roles and responsibilities are listed below.

Types of Testing

Dev.

(Project Team)

CSIT

(Project Team)

E2E

(Integration Team)

S3P

(Project + Integration)

Usability Testingx


Unit Testingx


Stability Testing


x
Security Testing


x
Scalability Testing


x
Regression Testingxxxx
Performance Testing


x
Integration/Pair-Wise Testing
x

Install/Uninstall Testingx


Feature/Functional Testingx


End-to-End Testing

x
ONAP Upgrade Testingx
x
  • Gaps

This section is used to document a limitation on a functionality or platform support. We are currently aware of this limitation and it will be delivered in a future Release.
List identified release gaps (if any), and its impact.

...

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject=integration and issuetype in (bug) and status!=closed
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

...

Risk identifiedMitigation PlanContingency Plan
Need additional lab resources (RAM, disk, network bandwidth, etc.)NoneNone
  • Resources

Fill out the Resources Committed to the Release centralized page.

  • Release Milestone

...