Integration Dublin M1 Release Planning


Overview

Project Name

Enter the name of the project

Project Name

Enter the name of the project

Target Release Name

Dublin

Project Lifecycle State

Core

Participating Company 

AT&T, CMCC, China Telecom, ENEA, Ericsson, Huawei, Intel, Nokia, Orange

Scope

What is this release trying to address?

Scope

Priority

Committer Lead

Resources Committed

Epic

Dependencies

Scope

Priority

Committer Lead

Resources Committed

Epic

Dependencies

Do Not Break the Build

Highest

@Yang Xu

@Yang Xu @Marco Platania

INT-849: Don't break the buildClosed



oParent Update for Security Vulnerability

Highest

@Gary Wu

@Gary Wu

INT-833: Update oParent library versions based on SECCOM inputClosed



Use Case Testing

Highest

@Yang Xu

everyone in integration team, see use case owners below





ONAP CI Enhancement

Highest

@Gary Wu

@Gary Wu @Yang Xu

INT-834: Enhance current ONAP CI to support less stable lab environmentClosed



Maintain ONAP Integration Testing Infrastructure

Highest

@Gary Wu

@Gary Wu @Yang Xu @Marco Platania

INT-835: Provide and maintain the infrastructure for ONAP integration testClosed



S3P Testing Enhancement

High

@Gary Wu

@Gary Wu @Yang Xu

INT-836: Support Dublin S3P New FeaturesClosed



vCPE Use Case Test Automation

High

@Yang Xu

@FREEMAN, BRIAN D @Yang Xu

INT-837: Improve vCPE Use Case Test AutomationClosed



Use Case Development for vFW and Scaling

High

@Marco Platania

@Marco Platania

INT-838: Develop new features for vFW and Scaling use casesClosed



CIA Project

High

@Adolfo Perez-Duran

@Adolfo Perez-Duran @Paul-Ionut Vaduva

INT-542: Research, evaluate and publish best practices and methods for building efficient container images.Closed

INT-543: Develop and publish reference Dockerfile templates that can be re-used across projects and developers.Closed

INT-544: Enable the release of multi cpu-architecture container images.Closed

INT-545: Apply minimization best practices to enable the release of efficient container images.Closed





Use Cases



Use Case Test Cases

Lab

Responsible

EPIC



Use Case Test Cases

Lab

Responsible

EPIC

1

vFW / vDNS

Intel / Windriver

@Brian Freeman / @Marco Platania



2

vCPE Integration Test Case

Intel / Windriver

@Yang Xu / @Brian Freeman



3

vCPE with TOSCA VNF Test Case

CMCC

@Yan Yang





4

5G - Real Time PM and High Volume Stream Data Collection - Integration Test Status

TLab

@Marcin Przybysz @marekPL



5

5G - PNF PnP - Integration Test Status

TLab

@Marcin Przybysz @Krzysztof Kuzmicki



6

5G - Bulk PM - Test Status

Intel / Windriver

@Former user (Deleted) @liam burke





7

5G - OOF and PCI - Integration Test Cases

Intel / Windriver

@N.K. Shankaranarayanan









8

Scale Out - Integration Test Cases and Status

Intel / Windriver

@Scott Blandford@Marco Platania



9

CCVPN Integration Test Cases

CMCC

@Yan Yang





10

vFW/vDNS HPA Regression and Enhancement Testing

(HPA & Cloud Agnostic Intent - R3 Test Plan)

Intel / Windriver

@Itohan Ukponmwan (Deactivated)

@Eric Multanen



11

Change Management - Flexible Designer & Orchestrator

Intel / Windriver

@Ajay Mahimkar

@Elena Kuleshov

@pagarwal

Chris Rapposelli





12

Change Management - Traffic Management-

Intel / Windriver

@Lukasz Rajewski

@Ajay Mahimkar





13

Change Management - 5G PNF in-place software upgrade

Intel / Windriver

@wangyaoguang

@Ruchira Agarwal







14

Change Management - Schedule optimization

Intel / Windriver

@Ajay Mahimkar

@Jerry Flood



15

BBS (Broadband Service)
BBS Use Case Tracking (Dublin Release)

Swisscom, CMCC, Huawei, Nokia

@David Perez Caparros @dbalsige



16

5G Slicing (scope is not clear, need to wait for TSC requirement)

AT&T, Nokia, Ericsson

@Shekar Sundaramurthy



17

vFW on ARM (no integration commitment, vendor will cover all tests)

ARM, ENEA

@Paul-Ionut Vaduva



18

Model driven control loop design

AT&T, Nokia

Testing confirmed by AT&T



19

K8S based cloud region support

Intel, VMWare

Testing confirmed by Intel



20

Distributed Analytics as a Service (Dublin Summary) - Edge Automation

VMWare, Intel

Testing confirmed by Intel



21

Consistent ID of a Cloud Region 

Windriver, AT&T, CMCC

Need to talk to Bin Yang about testing resource



Minimum Viable Product

  • CI/CD running on onapci.org

  • Automatic unit testing, CSIT testing, and end-to-end testing

  • Guidelines, frameworks, or best practice recommendations on S3P testing for ONAP project teams

Functionalities

List the functionalities that this release is committing to deliver by providing a link to JIRA Epics and Stories. In the JIRA Priority field, specify the priority (either High, Medium, Low). The priority will be used in case de-scoping is required. Don't assign High priority to all functionalities.

Epics

key summary type created updated due assignee reporter priority status resolution
Loading...
Refresh



Stories

key summary type created updated due assignee reporter priority status resolution
Loading...
Refresh



Longer term roadmap

It provides all the cross-project infrastructure framework and DevOps toolchain (Continuous Integration, etc.), code and scripts, best practice guidance, benchmark and testing reports and white papers related to:

  • Cross-project Continuous System Integration Testing (CSIT)

  • End-to-End (ETE) release use cases testing with VNFs with repeatability

  • CI/CD to ONAP community integration labs

  • Reference VNFs that can be used to show how the ONAP platform handles

Release Deliverables

Indicate the outcome (Executable, Source Code, Library, API description, Tool, Documentation, Release Note...) of this release.

Deliverable Name

Deliverable Description

Deliverable Name

Deliverable Description

oParent

POM file with recommended Java library versions

Robot

Executable for integration use case testing

Demo

Executable for use case VNFs

Integration

Scripts to deploy ONAP and test use cases

Sub-Components

List all sub-components part of this release.
Activities related to sub-components must be in sync with the overall release.

Sub-components are repositories and are consolidated in a single centralized place. Edit the Release Components name for your project in the centralized page.

Architecture

High level architecture diagram

At that stage within the Release, the team is expected to provide more Architecture details describing how the functional modules are interacting.

Indicate where your project fit within the ONAP Archiecture diagram.

Block and sequence diagrams showing relation within the project as well as relation with external components are expected.

Anyone reading this section should have a good understanding of all the interacting modules.

Platform Maturity

Refering to CII Badging Security Program and Platform Maturity Requirements, fill out the table below by indicating the actual level , the targeted level for the current release and the evidences on how you plan to achieve the targeted level.

Area

Actual Level

Targeted Level for current Release

How, Evidences

Comments

Area

Actual Level

Targeted Level for current Release

How, Evidences

Comments

Manageability

Not Measured

1, partial of 2



  • 1 – single logging system across components; instantiation in < 1 hour

  • 2 – ability to upgrade a single component; tracing across components; externalized configuration management

Performance

Not Measured

Not Measured



  • 0 -- none

  • 1 – baseline performance criteria identified and measured

  • 2 & 3 – performance improvement plans created & implemented

Resiliency

2

3

Will cover geo-redundancy if lab env supports it.

All Integration team will perform platform-level testing similar to:

Beijing Release Resiliency Testing Status

  • 0 – none

  • 1 – manual failure and recovery (< 30 minutes)

  • 2 – automated detection and recovery (single site)

  • 3 – automated detection and recovery (geo redundancy)

Scalability

Not Measured

Note Measured



  • 0 – no ability to scale

  • 1 – single site horizontal scaling

  • 2 – geographic scaling

  • 3 – scaling across multiple ONAP instances

Security

Not Measured

Not Measured



  • 0 – none

  • 1 – CII Passing badge + 50% Test Coverage

  • 2 – CII Silver badge; internal communication encrypted; role-based access control and authorization for all calls

  • 3 – CII Gold

Stability

2

2

Integration team will perform platform-level testing similar to:

Beijing Release Stability Testing Status (w/ OOM)

Beijing Release Stability Testing Status (w/ HEAT)

  • 0 – none

  • 1 – 72 hours component level soak w/random transactions

  • 2 – 72 hours platform level soak w/random transactions

  • 3 – 6 months track record of reduced defect rate

Usability

Not Measured

Not Measured



  • 1 – user guide; deployment documentation; API documentation

  • 2 – UI consistency; usability testing; tutorial documentation



  • API Incoming Dependencies

List the API this project is expecting from other projects.
Prior to Release Planning review, Team Leads must agreed on the date by which the API will be fully defined. The API Delivery date must not be later than the release API Freeze date.

Prior to the delivery date, it is a good practice to organize an API review with the API consumers.

API Name

API Description

API Definition Date

API Delivery date

API Definition link (i.e.swagger)

API Name

API Description

API Definition Date

API Delivery date

API Definition link (i.e.swagger)

SDC BE API

SDC Backend API

M3

M3



SO API

SO REST API

M3

M3



A&AI API

A&AI REST API

M3

M3



SDNC API

SDNC REST API for preload

M3

M3



  • API Outgoing Dependencies

None

  • Third Party Products Dependencies

Third Party Products mean products that are mandatory to provide services for your components. Development of new functionality in third party product may or not be expected.
List the Third Party Products (OpenStack, ODL, RabbitMQ, ElasticSearch,Crystal Reports, ...).



Name

Description

Version

Name

Description

Version

Chaos Monkey

Resilience Testing tool



Docker

Container platform



Jenkins

CI/CD tool



JMeter

Performance Testing tool



Openstack

Cloud OS



Robot

Testing framework



In case there are specific dependencies  (Centos 7 vs Ubuntu 16. Etc.) list them as well.

  • TESTING AND INTEGRATION PLANS

Provide a description of the testing activities (unit test, functional test, automation,...) that will be performed by the team within the scope of this release.

Describe the plan to integrate and test the release deliverables within the overall ONAP system.
Confirm that resources have been allocated to perform such activities.

The goal is to automate all the unit testing, CSIT testing, and end-to-end testing in release Casablanca. The detailed test roles and responsibilities are listed below.

Types of Testing

Dev.

(Project Team)

CSIT

(Project Team)

E2E

(Integration Team)

S3P

(Project + Integration)

Types of Testing

Dev.

(Project Team)

CSIT

(Project Team)

E2E

(Integration Team)

S3P

(Project + Integration)

Usability Testing

x







Unit Testing

x







Stability Testing







x

Security Testing







x

Scalability Testing







x

Regression Testing

x

x

x

x

Performance Testing







x

Integration/Pair-Wise Testing



x





Install/Uninstall Testing

x







Feature/Functional Testing

x







End-to-End Testing





x



ONAP Upgrade Testing

x



x



  • GAPS

This section is used to document a limitation on a functionality or platform support. We are currently aware of this limitation and it will be delivered in a future Release.
List identified release gaps (if any), and its impact.

Gaps identified

Impact

Gaps identified

Impact

To fill out

To fill out

  • KNOWN DEFECTS AND ISSUES

Provide a link toward the list of all known project bugs.

key summary type created updated due assignee reporter priority status resolution
Loading...
Refresh

  • RISKS

List the risks identified for this release along with the plan to prevent the risk to occur (mitigation) and the plan of action in the case the risk would materialized (contingency).

Risk identified

Mitigation Plan

Contingency Plan

Risk identified

Mitigation Plan

Contingency Plan

Need additional lab resources (RAM, disk, network bandwidth, etc.)

None

None

  • RESOURCES

Fill out the Resources Committed to the Release centralized page.

  • RELEASE MILESTONE

The milestones are defined at the Release Level and all the supporting project agreed to comply with these dates.

  • TEAM INTERNAL MILESTONE

This section is optional and may be used to document internal milestones within a project team or multiple project teams. For instance, in the case the team has made agreement with other team to deliver some artifacts on a certain date that are not in the release milestone, it is erecommended to provide these agreements and dates in this section.

It is not expected to have a detailed project plan.

Date

Project

Deliverable

Date

Project

Deliverable

To fill out

To fill out

To fill out

  • DOCUMENTATION, TRAINING

  • Highlight the team contributions to the specific document related to he project (Config guide, installation guide...).

  • Highlight the team contributions to the overall Release Documentation and training asset

  • High level list of documentation, training and tutorials necessary to understand the release capabilities, configuration and operation.

  • Documentation includes items such as:

    • Installation instructions

    • Configuration instructions

    • Developer guide

    • End User guide

    • Admin guide

    • ...

Note

The Documentation project will provide the Documentation Tool Chain to edit, configure, store and publish all Documentation asset.


Other Information

  • Vendor Neutral

If this project is coming from an existing proprietary codebase, ensure that all proprietary trademarks, logos, product names, etc. have been removed. All ONAP deliverables must comply with this rule and be agnostic of any proprietary symbols.

  • Free and Open Source Software

FOSS activities are critical to the delivery of the whole ONAP initiative. The information may not be fully available at Release Planning, however to avoid late refactoring, it is critical to accomplish this task as early as possible.
List all third party Free and Open Source Software used within the release and provide License type (BSD, MIT, Apache, GNU GPL,... ).
In the case non Apache License are found inform immediately the TSC and the Release Manager and document your reasoning on why you believe we can use a non Apache version 2 license.

Each project must edit its project table available at Project FOSS.



Charter Compliance

The project team comply with the ONAP Charter.