Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

WORK IN PROGRESS - focus will be automated testing so some rows will be deleted from the table

...

#


Use Case

Functional Requirement

Nonfunctional Requirement

Test CasesLabIntegration Test Lead

Status

(remaining days of effort)

Video URL

Detailed Test Status

Quick Notes
1

vFW

Model Driven Control Loop Design 

vFW


(vDNS is part of scale out use case below #10)


Intel / Windriver


onboard -PASS

instantiate - PASS

closedloop - PASS


Status
colourGreen
titleCompleted


Retest with Policy FIX

Robot fix for automation

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyPOLICY-2109

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-1272

2Use Case: Residential Broadband vCPE (Approved)

vCPE Integration Test Case

Intel / Windriver

infra-PASS

bng - PASS

gmux - PASS

ResCust - distribute PASS

ResCust - tunnel-xconn-assign - PASS

               tunnel-xconn- create - FAIL

Closed-Loop - PENDING


Status
colourRed
titleProgressing 60%

changes to vcpe.py scripts for SSL on SDC and SDNC (manually fixed for testing)

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-2351

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-2354

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-2375

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-1265

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-2401

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySDNC-939

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySDNC-940


3vCPE with TOSCA

vCPE(tosca) with HPA - Integration test cases

Intel / Windriver

All test cases have been passed for supporting ovp tosca vnf validation and the following test is triggered by CLI in windriver lab

  1. service design - PASS
  2. service distribute -PASS
  3. NS/VNF package onboardding -PASS
  4. NS create/instantiate - PASS
  5. NS terminate/delete- PASS

Status
colourGreen
titlePASS









45G - Realtime PM and High Volume Stream Data Collection5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases

Intel / Windriver

Status
colourGreen
titlePASS

e2e scenarios passed on sb00

CSIT passed in release-daily




55G - PNF PnP

5G - PNF PnP - Integration Test Cases

Intel / Windriver

Status
colourGreen
titlePASS

e2e scenario passed on sb00



Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-2289

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-2349

6 5G - Bulk PM

5G - Bulk PM - Test Status

Intel / Windriver

SB-02

E/// lab

Status
colourGreen
titleCompleted



Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyINT-1296

75G - Configuration with NETCONF

5G - PNF Configuration via Netconf - Test Status

Intel/

Windriver

Manual test

Status
colourGreen
titleCompleted

CSITs are also passing which test this usecase for SOsim-> Blueprint-processor -> SDNC -> PNFsim. link is https://jenkins.onap.org/job/usecases-master-csit-config-over-netconf/.




Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-2349

Testing completed on windriver SB00 

with image versions

SO-bpmn : 1.5.3

Blueprint processor : 0.6.4-STAGING-latest

sdnc-image:1.7.3

prh-app-server:1.3.1

vescollector:1.4.5


8

Anchor
PNF-Onboarding
PNF-Onboarding
5G - PNF Pre-Onboarding & Onboarding


5G - Preonboarding/Onboarding - Test Status

Intel / Windriver

PNF Preonboarding (VNF SDK):

Marcin Przybysz

Krzysztof Kuzmicki

Dermot Melia

PNF Onboarding (SDC):

Andy Walshe

Preonboarding

Status
colourGreen
titlePASS

Manual test case using





95G - OOF and PCI 

5G - OOF and PCI - Integration Test Cases

Windriver





10Scale Out

Scale Out - Integration Test Cases and Status

Intel / Windriver

Retesting using the latest released images.

Manual scale out

Status
colourGreen
titleCompleted

Automated (closed-loop based) scale out: 

Status
colourYellow
titleProgressing = 95%



Automated scale out: 

Blocker on closed loop runtime: 

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyPOLICY-2156

We were still able to make progress by calling SO APIs from Postman.


Manual scale out: it works with direct call to SO APIs. There is an issue with VID that will be addressed in Frankfurt as it requires to rearchitect the current approach: 

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyVID-659


11CCVPNCCVPN Integration Test CasesCMCC

Regression test for service  creation, service change

service creation - PASS

service change  -PASS

service deletion - PASS

Status
colourGreen
titlePASS




12HPA vFW/vDNS

vFW/vDNS HPA Testing

(Test Plan 1 in

HPA & Cloud Agnostic Intent - R3 Test Plan)
Intel / Windriver

Status
colourYellow
titleProgressing >= 90%




Service instance creation fails because of error that occurs in homing. This bug is currently blocking further testing. A workaround for the SO bug has been created. See the SO bug for details.


Now seeing another blocking error in OOF, also blocking service instance creation. 

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySDC-2588

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-2378

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyOPTFRA-598

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyOPTFRA-608

13Change Management - Flexible Designer & Orchestrator

Steps:

1) Designing custom workflows with Workflow Designer

2) Distributing custom workflows to SO

3) Deploying the custom workflow in SO

4) Sending workflow metadata to VID

5) Triggering custom workflow execution from VID

6) Executing custom workflows in SO

Intel / Windriver

Status
colourYellow
titleIn progerss 85%

1) Complete

2) SDC-2541

3) Complete

4) VID-671, VID-672, VID-673

5) Complete

6) In-Progress. 9 Building Blocks successfully tested (Check, Set & Unset Maintenance Flags, Check, Set, and Unset Closed Loop Disabled Flag, Lock & Unlock vNF, and End Workflow.). PauseforManual testing in-progress.




Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySDC-2541

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyVID-671

(671 upgraded from medium 10/7)

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyVID-672

(672 upgraded from medium 10/7)

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyVID-673




14

Traffic Distribution

Change Management Dublin Extensions

Steps:

1) Instantiation of vFWDT

2) Configuration of OOF Policies for vFWDT

3) Execution of OSDF/HAS requests for data collection

4) Configuration of VNF profiles in CDT

5) Configuration of Ansible Server

6) Execution of TD workflow


Intel / Windriver

1) PASS

2) PASS

3) PASS

4) PASS

5) PASS

6) PASS

Retesting using the latest released immages.


Status
colourGreen
titleProgressing 100%

2) Possible only on Chrome Browser

Ansible 0.4.4

APPC 1.6.4

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyPORTAL-760

15Change Management - 5G PNG Software Upgrade

Change Management - 5G PNF Software Upgrade Integration Test Status

Intel / Windriver

Regression Testing

 

Status
colourYellow
titlePROGRESSING >=50%

Planned completion by  




16Change Management - Schedule Optimization
Intel / Windriver

Status
colourGreen
titleCompletd 100%

  • Manually run the ETE tests locally before merging changes. (Done)
  • Manually run the ETE test suite in Windriver SB-xx with AAF enabled when merging changes (Done)
  • The integration test team has HC test for all components, so that is automatically covered.  This is waiting on RC0 availability and an OOM change that has been in the pipeline waiting for RC0 for months
  • The ETE test suite also runs in CSIT and Sonar jobs with AAF disabled. (In progress)
  • Manually run the ETE tests in the IT Release Daily with AAF enabled.  (Waiting on RC0)


Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyOPTFRA-592

https://gerrit.onap.org/r/#/c/oom/+/96405/

17BBS Broadband Service Use Case (Dublin)BBS Use Case Tracking (Dublin Release)#TestingBBS Swisscom Lab





18VSP Compliance Check within SDC (Dublin) - Phase 1VSP Compliance Check within SDC - Integration Test PlanVodafone





19K8S based Cloud Region Support - vFW Use caseDeploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloudintel / Windriver

Status
colourRed
titleBLOCKED BY FAILURE - Progressing <90%


(Tests have passed on earlier builds of El Alto - but SO-2357 has come back and causes failure of service distribution)


Create and delete verified with fixes provided by two jira's - as noted

Closed Loop test worked.


Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-2357
 ACTUALLY IS A BUG


Following two JIRA's are required:

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyMULTICLOUD-835

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyOOM-2117





20K8S based Cloud Region Support - EdgeXFoundry Use caseDeploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes CloudIntel/ Windriver

Status
colourYellowGreen
titleProgressing >= 90%Completed


Onboarding of Edgex chart is ongoing. The tar.gz has been created for the chart.Next step is instantiation

Installation was completed and pods deployed.


Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-2357
will block progress on this.































24

ETSI Alignment

SO plugin to support SOL003 to connect to an external VNFM



Status
colourGreen
titleCompleted

new CSIT is used for automated testing


CSIT testing simulators have been implemented, and SO and SOL003 Adapter have been tested by leveraging simulators and CSIT test scripts

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySO-1638

25Improve our E2E Process Automation

Status
colourGreen
titleCompleted

OOM verify Job Deployer


Status
colourGreen
titleCompleted
  – Yuriy Malakov A. Seaudi

E2E vLB testing: 

  • Service Assign - Passed
  • VNF Assign - Passed
  • VF Module Assign - Passed
  • CDS ConfigAssign - Passed
  • Create in Openstack: Passed
  • CDS Config Deploy: Passed



Current failure status:  [closed] - JIRA  https://gerrit.onap.org/r/#/c/so/+/96621/

Fails at the SO to CDS step for config assign. 

"statusMessage": "Exception in org.onap.so.bpmn.infrastructure.flowspecific.tasks.ConfigAssignVnf.preProcessAbstractCDSProcessing java.util.LinkedHashMap cannot be cast to java.lang.String",





26S3P - Footprint Optimization (Integration with Alpine)

Status
colourBlue
titleEl Alto




27Component/memory optimization: Ongoing Assessment

Status
colourBlue
titleEl Alto




28Global optimization (e.g. shared DB) - stretch goal=shared PostgreSQL; shared MariaDB

Status
colourBlue
titleDUBLIN

aai + sdc: Cassandra

sdnc + so : MariaDB




29S3P- Geo-Redundancy

Status
colourBlue
titleNo Change




30SOL 004 (VNF Package Security)

5G - Preonboarding/Onboarding - Test Status

Ericsson, Intel / Windriver

Preonboarding

Status
colourGreen
titlePASS

Manual test case using




31xNF communication security enhancements.xNF communication security enhancements - Tests Description and Status

Status
colourBlue
titleNo Change




32Locale/Internationalization language support

Status
colourBlue
titleNo Change




33







34HPA vIPsecvIPsec HPA testingIntel / Windriver

90% done. 

Status
colourYellow
titleProgressing >= 90%



The first e2e use case has finished. Moved on to further use cases.
35Health Checks for PODSPercentage coverage of Health Checks for Running PODSIntegration



36New Installation Tests in 3 labs








Intel/Windriver 






Orange  (Rocky)
Morgan Richomme





Ericsson Lab  (Rocky)














Robot Keyword Testing








init_robotPASS






initPASS







healthPARTIAL

59*/61 Orange Lab

58*/61 E// Lab

(*SO tooling issue)

OOF-CMSO

SDNC

1 VFC sub-module (PASS in Orange; PASS in E// on retest)

CDS blueprint (PASS in Orange)







eteHelm-k8.shPARTIAL

48/49 Intel/Windriver  LabOOF-CMSO

Tweaks: M4 SDNC and remove log/pomba








healthdistPASS






instantiateVFWCLPASS






vfwclosedloop <png_ip>PASS






instantiateVFWDTPASS






distributeVCPEResCustFAIL






sdc-dcae-d







vcpe.py

init: PASS

infra: PENDING

custservice:









postinstallPASS




...