Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

What is this release trying to address?

ScopePriorityCommitter LeadResources CommittedEpicDependencies
oParent Update for Security VulnerabilityHighest

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-833


Use Case TestingHighesteveryone in integration team, see use case owners below

ONAP CI EnhancementHighest

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-834


Maintain ONAP Integration Testing InfrastructureHighest

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-835


S3P Testing EnhancementHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-836


vCPE Use Case Test AutomationHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-837


Use Case Development for vFW and ScalingHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-838


CIA ProjectHigh

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-542

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-543

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-544

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-545



Use Cases

Minimum Viable Product

  • CI/CD running on onapci.org
  • Automatic unit testing, CSIT testing, and end-to-end testing
  • Guidelines, frameworks, or best practice recommendations on S3P testing for ONAP project teams

...

Refering to CII Badging Security Program and Platform Maturity Requirements, fill out the table below by indicating the actual level , the targeted level for the current release and the evidences on how you plan to achieve the targeted level.

Area

Actual Level

Targeted Level for current Release

How, Evidences

Comments

ManageabilityNot Measured

  • 1 – single logging system across components; instantiation in < 1 hour
  • 2 – ability to upgrade a single component; tracing across components; externalized configuration management
PerformanceNot Measured

  • 0 -- none
  • 1 – baseline performance criteria identified and measured
  • 2 & 3 – performance improvement plans created & implemented
Resiliency3

Will cover geo-redundancy if lab env supports it.

All Integration team will perform platform-level testing similar to:

Beijing Release Resiliency Testing Status

  • 0 – none
  • 1 – manual failure and recovery (< 30 minutes)
  • 2 – automated detection and recovery (single site)
  • 3 – automated detection and recovery (geo redundancy)
ScalabilityNot Measured

  • 0 – no ability to scale
  • 1 – single site horizontal scaling
  • 2 – geographic scaling
  • 3 – scaling across multiple ONAP instances
SecurityNot Measured

  • 0 – none
  • 1 – CII Passing badge + 50% Test Coverage
  • 2 – CII Silver badge; internal communication encrypted; role-based access control and authorization for all calls
  • 3 – CII Gold
Stability2

Integration team will perform platform-level testing similar to:

Beijing Release Stability Testing Status (w/ OOM)

Beijing Release Stability Testing Status (w/ HEAT)

  • 0 – none
  • 1 – 72 hours component level soak w/random transactions
  • 2 – 72 hours platform level soak w/random transactions
  • 3 – 6 months track record of reduced defect rate
UsabilityNot Measured

  • 1 – user guide; deployment documentation; API documentation
  • 2 – UI consistency; usability testing; tutorial documentation


  • API Incoming Dependencies

...

Third Party Products mean products that are mandatory to provide services for your components. Development of new functionality in third party product may or not be expected.
List the Third Party Products (OpenStack, ODL, RabbitMQ, ElasticSearch,Crystal Reports, ...).


Name

Description

Version

Chaos MonkeyResilience Testing tool

Docker

Container platform
JenkinsCI/CD tool
JMeterPerformance Testing tool
OpenstackCloud OS
RobotTesting framework

In case there are specific dependencies  (Centos 7 vs Ubuntu 16. Etc.) list them as well.

...

The goal is to automate all the unit testing, CSIT testing, and end-to-end testing in release Casablanca. The detailed test roles and responsibilities are listed below.

Types of Testing

Dev.

(Project Team)

CSIT

(Project Team)

E2E

(Integration Team)

S3P

(Project + Integration)

Usability Testingx


Unit Testingx


Stability Testing


x
Security Testing


x
Scalability Testing


x
Regression Testingxxxx
Performance Testing


x
Integration/Pair-Wise Testing
x

Install/Uninstall Testingx


Feature/Functional Testingx


End-to-End Testing

x
ONAP Upgrade Testingx
x
  • Gaps

This section is used to document a limitation on a functionality or platform support. We are currently aware of this limitation and it will be delivered in a future Release.
List identified release gaps (if any), and its impact.

...