Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

DRAFT PROPOSAL FOR COMMENTS

The content of this template is expected to be fill out for M1 Release Planning Milestone.

...

titleInfo

...

Table of Contents
outlinetrue

Overview

Project NameEnter the name of the project
Target Release NameEnter the name of the release you are targeting to deliverDublin
Project Lifecycle StateEither Incubation, Core, Mature. Refer to ONAP Charter, section 3.3 Project Lifecycle for further information
Participating Company List the company participating in this release. At least 3-4 organizations, including an operator are recommended.AT&T, CMCC, China Telecom, ENEA, Ericsson, Huawei, Intel, Nokia, Orange

Scope

What is this release trying to address?

...

Describe the problem being solved by this release

Use Cases

Describe the use case this release is targeted for (better if reference to customer use case).

Minimum Viable Product

...

ScopePriorityCommitter LeadResources CommittedEpicDependencies
Do Not Break the BuildHighestYang XuYang Xu Marco Platania

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-849


oParent Update for Security VulnerabilityHighest

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-833


Use Case TestingHighesteveryone in integration team, see use case owners below

ONAP CI EnhancementHighest

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-834


Maintain ONAP Integration Testing InfrastructureHighest

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-835


S3P Testing EnhancementHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-836


vCPE Use Case Test AutomationHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-837


Use Case Development for vFW and ScalingHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-838


CIA ProjectHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-542

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-543

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-544

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-545



Use Cases


Use Case Test Cases

Lab

Responsible

EPIC

1vFW / vDNS

Intel / Windriver


2

vCPE Integration Test Case

Intel / Windriver


3

vCPE with TOSCA VNF Test Case

CMCC


4

5G - Real Time PM and High Volume Stream Data Collection - Integration Test Status

TLab


5

5G - PNF PnP - Integration Test Status

TLab
6

5G - Bulk PM - Test Status

Intel / Windriver


7

5G - OOF and PCI - Integration Test Cases

Intel / Windriver





8

Scale Out - Integration Test Cases and Status

Intel / Windriver


9CCVPN Integration Test CasesCMCC


10

vFW/vDNS HPA Regression and Enhancement Testing

(HPA & Cloud Agnostic Intent - R3 Test Plan)

Intel / Windriver


11Change Management - Flexible Designer & OrchestratorIntel / Windriver



12Change Management - Traffic Management-Intel / Windriver



13

Change Management - 5G PNF in-place software upgrade

Intel / Windriver



14Change Management - Schedule optimizationIntel / Windriver


15

BBS (Broadband Service)
BBS Use Case Tracking (Dublin Release)

Swisscom, CMCC, Huawei, Nokia
165G Slicing (scope is not clear, need to wait for TSC requirement)AT&T, Nokia, Ericsson
17vFW on ARM (no integration commitment, vendor will cover all tests)ARM, ENEA
18Model driven control loop designAT&T, NokiaTesting confirmed by AT&T
19K8S based cloud region supportIntel, VMWareTesting confirmed by Intel
20Distributed Analytics as a Service (Dublin Summary) - Edge AutomationVMWare, IntelTesting confirmed by Intel
21Consistent ID of a Cloud Region Windriver, AT&T, CMCCNeed to talk to Bin Yang about testing resource

Minimum Viable Product

  • CI/CD running on onapci.org
  • Automatic unit testing, CSIT testing, and end-to-end testing
  • Guidelines, frameworks, or best practice recommendations on S3P testing for ONAP project teams

Functionalities

List the functionalities that this release is committing to deliver by providing a link to JIRA Epics and Stories. In the JIRA Priority field, specify the priority (either High, Medium, Low). The priority will be used in case de-scoping is required. Don't assign High priority to all functionalities.

Epics

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject=sanbox "integration" and issuetype in (epic) ="epic" and status!=closed
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

Stories

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject=sanbox integration and issuetype in (story) and status!=closed
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

Longer term roadmap

Indicate at a high level the longer term roadmap. This is to put things into the big perspective.It provides all the cross-project infrastructure framework and DevOps toolchain (Continuous Integration, etc.), code and scripts, best practice guidance, benchmark and testing reports and white papers related to:

  • Cross-project Continuous System Integration Testing (CSIT)
  • End-to-End (ETE) release use cases testing with VNFs with repeatability
  • CI/CD to ONAP community integration labs
  • Reference VNFs that can be used to show how the ONAP platform handles

Release Deliverables

Indicate the outcome (Executable, Source Code, Library, API description, Tool, Documentation, Release Note...) of this release.

To fill out
Deliverable NameDeliverable DescriptionTo fill out
oParentPOM file with recommended Java library versions
RobotExecutable for integration use case testing
DemoExecutable for use case VNFs
IntegrationScripts to deploy ONAP and test use cases

Sub-Components

List all sub-components part of this release.
Activities related to sub-components must be in sync with the overall release.

Sub-components are repositories and are consolidated in a single centralized place. Edit the Release Components name for your project in the centralized page.

Architecture

High level architecture diagram

At that stage within the Release, the team is expected to provide more Architecture details describing how the functional modules are interacting.

...

Anyone reading this section should have a good understanding of all the interacting modules.

Platform Maturity

Refering to CII Badging Security Program and Platform Maturity Requirements, fill out the table below by indicating the actual level , the targeted level for the current release and the evidences on how you plan to achieve the targeted level.

Area

Actual Level

Targeted Level for current Release

How, Evidences

Comments

ManageabilityNot Measured1, partial of 2
  • 1 – single logging system across components; instantiation in < 1 hour
  • 2 – ability to upgrade a single component; tracing across components; externalized configuration management
PerformanceNot MeasuredNot Measured
  • 0 -- none
  • 1 – baseline performance criteria identified and measured
  • 2 & 3 – performance improvement plans created & implemented
Stability
  • 0 – none
  • 1 – 72 hours component level soak w/random transactions
  • 2 – 72 hours platform level soak w/random transactions
  • 3 – 6 months track record of reduced defect rate
Resiliency
Resiliency23

Will cover geo-redundancy if lab env supports it.

All Integration team will perform platform-level testing similar to:

Beijing Release Resiliency Testing Status

  • 0 – none
  • 1 – manual failure and recovery (< 30 minutes)
  • 2 – automated detection and recovery (single site)
  • 3 – automated detection and recovery (geo redundancy)
ScalabilityNot MeasuredNote Measured
  • 0 – no ability to scale
  • 1 – single site horizontal scaling
  • 2 – geographic scaling
  • 3 – scaling across multiple ONAP instances
SecurityNot MeasuredNot Measured
  • 0 – none
  • 1 – CII Passing badge + 50% Test Coverage
  • 2 – CII Silver badge; internal communication encrypted; role-based access control and authorization for all calls
  • 3 – CII Gold
Scalability
Stability22

Integration team will perform platform-level testing similar to:

Beijing Release Stability Testing Status (w/ OOM)

Beijing Release Stability Testing Status (w/ HEAT)

  • 0 –
no ability to scale
  • none
  • 1 –
single site horizontal scaling
  • 72 hours component level soak w/random transactions
  • 2 –
geographic scaling
  • 72 hours platform level soak w/random transactions
  • 3 –
scaling across multiple ONAP instancesManageability
  • 1 – single logging system across components; instantiation in < 1 hour
  • 2 – ability to upgrade a single component; tracing across components; externalized configuration management
Usability
  • 6 months track record of reduced defect rate
UsabilityNot MeasuredNot Measured
  • 1 – user guide; deployment documentation; API documentation
  • 2 – UI consistency; usability testing; tutorial documentation


  • API Incoming Dependencies

List the API this project is expecting from other projects.
Prior to Release Planning review, Team Leads must agreed on the date by which the API will be fully defined. The API Delivery date must not be later than the release API Freeze date.

Prior to the delivery date, it is a good practice to organize an API review with the API consumers.

API NameAPI DescriptionAPI Definition DateAPI Delivery dateAPI Definition link (i.e.swagger)To fill outHigh level description of the APIDate for which the API is reviewed and agreedTo fill outLink toward the detailed API description
API NameAPI DescriptionAPI Definition DateAPI Delivery dateAPI Definition link (i.e.swagger)
To fill outHigh level description of the APIDate for which the API is reviewed and agreedTo fill outLink toward the detailed API description
  • API Outgoing Dependencies

API this project is delivering to other projects.

SDC BE APISDC Backend APIM3M3
SO APISO REST APIM3M3
A&AI APIA&AI REST APIM3M3
SDNC APISDNC REST API for preloadM3M3
  • API Outgoing Dependencies

None

  • Third Party Products Dependencies

Third Party Products mean products that are mandatory to provide services for your components. Development of new functionality in third party product may or not be expected.
List the Third Party Products (OpenStack, ODL, RabbitMQ, ElasticSearch,Crystal Reports, ...).


Name

Description

Version

To fill outTo fill outTo fill out

Chaos MonkeyResilience Testing tool

Docker

Container platform
JenkinsCI/CD tool
JMeterPerformance Testing tool
OpenstackCloud OS
RobotTesting framework

In case there are specific dependencies  (Centos 7 vs Ubuntu 16. Etc.) list them as well.

  • Testing and Integration Plans

Provide a description of the testing activities (unit test, functional test, automation,...) that will be performed by the team within the scope of this release.

Describe the plan to integrate and test the release deliverables within the overall ONAP system.
Confirm that resources have been allocated to perform such activities.

The goal is to automate all the unit testing, CSIT testing, and end-to-end testing in release Casablanca. The detailed test roles and responsibilities are listed below.

Types of Testing

Dev.

(Project Team)

CSIT

(Project Team)

E2E

(Integration Team)

S3P

(Project + Integration)

Usability Testingx


Unit Testingx


Stability Testing


x
Security Testing


x
Scalability Testing


x
Regression Testingxxxx
Performance Testing


x
Integration/Pair-Wise Testing
x

Install/Uninstall Testingx


Feature/Functional Testingx


End-to-End Testing

x
ONAP Upgrade Testingx
x
  • Gaps

This section is used to document a limitation on a functionality or platform support. We are currently aware of this limitation and it will be delivered in a future Release.
List identified release gaps (if any), and its impact.

Gaps identifiedImpact
To fill outTo fill out
  • Known Defects and Issues

Provide a link toward the list of all known project bugs.

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject=sanbox integration and issuetype in (bug) and status!=closed
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

  • Risks

List the risks identified for this release along with the plan to prevent the risk to occur (mitigation) and the plan of action in the case the risk would materialized (contingency).

Risk identifiedMitigation PlanContingency Plan
To fill outTo fill outTo fill outNeed additional lab resources (RAM, disk, network bandwidth, etc.)NoneNone
  • Resources

Fill out the Resources Committed to the Release centralized page.

  • Release Milestone

The milestones are defined at the Release Level and all the supporting project agreed to comply with these dates.

  • Team Internal Milestone

This section is optional and may be used to document internal milestones within a project team or multiple project teams. For instance, in the case the team has made agreement with other team to deliver some artifacts on a certain date that are not in the release milestone, it is erecommended to provide these agreements and dates in this section.

...

DateProjectDeliverable
To fill outTo fill outTo fill out
  • Documentation, Training

  • Highlight the team contributions to the specific document related to he project (Config guide, installation guide...).
  • Highlight the team contributions to the overall Release Documentation and training asset
  • High level list of documentation, training and tutorials necessary to understand the release capabilities, configuration and operation.
  • Documentation includes items such as:
    • Installation instructions
    • Configuration instructions
    • Developer guide
    • End User guide
    • Admin guide
    • ...
Note
titleNote

The Documentation project will provide the Documentation Tool Chain to edit, configure, store and publish all Documentation asset.


Other Information

  • Vendor Neutral

If this project is coming from an existing proprietary codebase, ensure that all proprietary trademarks, logos, product names, etc. have been removed. All ONAP deliverables must comply with this rule and be agnostic of any proprietary symbols.

  • Free and Open Source Software

FOSS activities are critical to the delivery of the whole ONAP initiative. The information may not be fully available at Release Planning, however to avoid late refactoring, it is critical to accomplish this task as early as possible.
List all third party Free and Open Source Software used within the release and provide License type (BSD, MIT, Apache, GNU GPL,... ).
In the case non Apache License are found inform immediately the TSC and the Release Manager and document your reasoning on why you believe we can use a non Apache version 2 license.

...