WORK IN PROGRESS - focus will be automated testing so some rows will be deleted from the table
...
| # | Use Case Functional Requirement Nonfunctional Requirement | Test Cases | Lab | Integration Test Lead | Status (remaining days of effort) | Video URL | Detailed Test Status | Quick Notes | Doc status | CI integration* | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Model Driven Control Loop Design | (vDNS is part of scale out use case below #10) | Intel / Windriver | onboard -PASS instantiate - PASS closedloop - PASS
| Retest with Policy FIX Robot fix for automation |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 2 | Use Case: Residential Broadband vCPE (Approved) | vCPE Integration Test Case | Intel / Windriver | infra-PASS bng - PASS gmux - PASS ResCust - distribute PASS ResCust - tunnel-xconn-assign - PASS tunnel-xconn- create - FAILClosed-Loop - PENDINGPASS vnf and vfmodule create PASS brg-tunnel config - PASS Traffic Flows - PASS Closed-Loop - gmux → ves → tca → policy - PASS Policy → AAI, Policy → APPC , APPC → Openstack PASS
| changes to vcpe.py scripts for SSL on SDC and SDNC (manually fixed for testing)Jira Legacy | | server |
| 3 | vCPE with TOSCA | vCPE(tosca) with HPA - Integration test cases | Intel / Windriver | All test cases have been passed for supporting ovp tosca vnf validation and the following test is triggered by CLI in windriver lab
| 4 | 5G - Realtime PM and High Volume Stream Data Collection | 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | Intel / Windriver | Marcin Przybysz marekPL
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 3 | vCPE with TOSCA | vCPE(tosca) with HPA - Integration test cases | Intel / Windriver | All test cases have been passed for supporting ovp tosca vnf validation and the following test is triggered by CLI in windriver lab
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 5 | 5G - PNF PnP | 5G - PNF PnP4 | 5G - Realtime PM and High Volume Stream Data Collection | 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | Intel / Windriver |
e2e scenario scenarios passed on sb00 |
| 6 | 5G - Bulk PM | 5G - Bulk PM - Test Status | Intel / Windriver SB-02 | https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_5g_rtpm.html#docs-realtime-pm Reviewers Minor Edit otherwise looks good. https://gerrit.onap.org/r/#/c/integration/+/97217/ | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 5 | 5G - PNF PnP | 5G - PNF PnP - Integration Test Cases | Intel / Windriver |
e2e scenario passed on sb00 | Manual test
CSITs are also passing which test this usecase for SOsim-> Blueprint-processor -> SDNC -> PNFsim. link is https://jenkins.onap.org/job/usecases-master-csit-config-over-netconf/.
| 7 | 5G - Configuration with NETCONF | 5G - PNF Configuration via Netconf - Test Status | Intel/ Windriver |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 6 | 5G - Bulk PM | 5G - Bulk PM - Test Status | Intel / Windriver SB-02 | E/// lab
|
Testing completed on windriver SB00 with image versions SO-bpmn : 1.5.3 Blueprint processor : 0.6.4-STAGING-latest sdnc-image:1.7.3 prh-app-server:1.3.1 vescollector:1.4.5 | 8 | | Anchor | | PNF-Onboarding | PNF-Onboarding | 5G - PNF Pre-Onboarding & Onboarding5G - Preonboarding/Onboarding -
|
5G - PNF Configuration via Netconf - Test Status
Intel/
Windriver
PNF Preonboarding (VNF SDK):
PNF Onboarding (SDC):
Manual test
Manual scale out: it works with direct call to SO APIs. There is an issue with VID that will be addressed in Frankfurt as it requires to rearchitect the current approach:
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
Regression test for service creation, service change
service creation - PASS
service change -PASS
service deletion - PASS
| Status | ||||
|---|---|---|---|---|
|
Manual test case using
5G - OOF and PCI - Integration Test Cases
Scale Out - Integration Test Cases and Status
Retesting using the latest released images.
Manual scale out
| Status | ||||
|---|---|---|---|---|
|
Automated (closed-loop based) scale out:
| Status | ||||
|---|---|---|---|---|
|
|
CSITs are also passing which test this usecase for SOsim-> Blueprint-processor -> SDNC -> PNFsim. link is https://jenkins.onap.org/job/usecases-master-csit-config-over-netconf/.
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
Testing completed on windriver SB00
with image versions
SO-bpmn : 1.5.3
Blueprint processor : 0.6.4-STAGING-latest
sdnc-image:1.7.3
prh-app-server:1.3.1
vescollector:1.4.5
5G - Preonboarding/Onboarding - Test Status
PNF Preonboarding (VNF SDK):
PNF Onboarding (SDC):
Preonboarding
| Status | ||||
|---|---|---|---|---|
|
vFW/vDNS HPA Testing
(Test Plan 1 in
HPA & Cloud Agnostic Intent - R3 Test Plan)| Status | ||||
|---|---|---|---|---|
|
Service instance creation fails because of error that occurs in homing. This bug is currently blocking further testing. A workaround for the SO bug has been created. See the SO bug for details.
Now seeing another blocking error in OOF, also blocking service instance creation.
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
Jira Legacy
5G - OOF and PCI - Integration Test Cases
Scale Out - Integration Test Cases and Status
Retesting using the latest released images.
Manual scale out
| Status | ||||
|---|---|---|---|---|
|
Automated (closed-loop based) scale out:
| Status | ||||
|---|---|---|---|---|
|
Manual scale out: it works with direct call to SO APIs. There is an issue with VID that will be addressed in Frankfurt as it requires to rearchitect the current approach:
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
Steps:
1) Designing custom workflows with Workflow Designer
2) Distributing custom workflows to SO
3) Deploying the custom workflow in SO
4) Sending workflow metadata to VID
5) Triggering custom workflow execution from VID
6) Executing custom workflows in SO
| Status | ||||
|---|---|---|---|---|
|
1) Complete
2) SDC-2541
3) Complete
4) VID-671, VID-672, VID-673
5) Complete
6) In-Progress. 9 Building Blocks successfully tested (Check, Set & Unset Maintenance Flags, Check, Set, and Unset Closed Loop Disabled Flag, Lock & Unlock vNF, and End Workflow.). PauseforManual testing in-progress.
|
Regression test for service creation, service change
service creation - PASS
service change -PASS
service deletion - PASS
| Status | ||||
|---|---|---|---|---|
|
vFW/vDNS HPA Testing
(Test Plan 1 in
HPA & Cloud Agnostic Intent - R3 Test Plan)| Status | ||||
|---|---|---|---|---|
|
Service instance creation fails because of error that occurs in homing. This bug is currently blocking further testing. A workaround for the SO bug has been created. See the SO bug for details.
Now seeing another blocking error in OOF, also blocking service instance creation.
D
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
(671 upgraded from medium 10/7)
| Jira Legacy | ||
|---|---|---|
|
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
(672 upgraded from medium 10/7)
|
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
Steps:
1) Instantiation of vFWDT
2) Configuration of OOF Policies for vFWDT
3) Execution of OSDF/HAS requests for data collection
4) Configuration of VNF profiles in CDT
5) Configuration of Ansible Server
6) Execution of TD workflow
1) PASS
2) PASS
3) PASS
4) PASS
5) PASS
6) PASS
Retesting using the latest released immages.
|
Steps:
1) Designing custom workflows with Workflow Designer
2) Distributing custom workflows to SO
3) Deploying the custom workflow in SO
4) Sending workflow metadata to VID
5) Triggering custom workflow execution from VID
6) Executing custom workflows in SO
| Status | |||
|---|---|---|---|
|
2) Possible only on Chrome Browser
Ansible 0.4.4
APPC 1.6.4
|
Work arounds for some functionality.
Remaining functions deferred to Frankfurt
1) Complete
2) 90% Complete
3) Complete
4) 85% Complete
5) Complete
6) 80% Complete In-Progress. 9 Building Blocks successfully tested (Check, Set & Unset Maintenance Flags, Check, Set, and Unset Closed Loop Disabled Flag, Lock & Unlock vNF, and End Workflow.). PauseforManual testing in-progress.
| Jira Legacy | |||||
|---|---|---|---|---|---|
|
|
|
| Jira Legacy |
|---|
Change Management - 5G PNF Software Upgrade Integration Test Status
Regression Testing for LCM:upgrade-pre-check/upgrade-software/upgrade-post-check/rollback（No Change in el alto）
| Status | ||||
|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
- Manually run the ETE tests locally before merging changes. (Done)
- Manually run the ETE test suite in Windriver SB-xx with AAF enabled when merging changes (Done)
- The integration test team has HC test for all components, so that is automatically covered. This is waiting on RC0 availability and an OOM change that has been in the pipeline waiting for RC0 for months
- The ETE test suite also runs in CSIT and Sonar jobs with AAF disabled. (In progress)
- Manually run the ETE tests in the IT Release Daily with AAF enabled. (Waiting on RC0)
| Status | ||||
|---|---|---|---|---|
|
(Tests have passed on earlier builds of El Alto - but SO-2357 has come back and causes failure of service distribution)
Create and delete verified with fixes provided by two jira's - as noted
Closed Loop test worked.| Jira Legacy | ||||||||
|---|---|---|---|---|---|---|---|---|
|
(671 upgraded from medium 10/7)
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
(672 upgraded from medium 10/7)
| Jira Legacy | ||||||||
|---|---|---|---|---|---|---|---|---|
|
| Jira Legacy | ||||||||
|---|---|---|---|---|---|---|---|---|
|
Onboarding of Edgex chart is ongoing. The tar.gz has been created for the chart.
Installation was completed and pods deployed.
|
| Jira Legacy | ||||||||
|---|---|---|---|---|---|---|---|---|
|
| Jira Legacy | ||||||||
|---|---|---|---|---|---|---|---|---|
|
| Jira Legacy | ||||||||
|---|---|---|---|---|---|---|---|---|
|
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
Following two JIRA's are required:
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
|
Steps:
1) Instantiation of vFWDT
2) Configuration of OOF Policies for vFWDT
3) Execution of OSDF/HAS requests for data collection
4) Configuration of VNF profiles in CDT
5) Configuration of Ansible Server
6) Execution of TD workflow
1) PASS
2) PASS
3) PASS
4) PASS
5) PASS
6) PASS
Retesting using the latest released immages.
| Status | ||||||
|---|---|---|---|---|---|---|
|
2) Possible only on Chrome Browser
Ansible 0.4.4
APPC 1.6.4
| Jira Legacy | |||||
|---|---|---|---|---|---|
|
|
ETSI Alignment
SO plugin to support SOL003 to connect to an external VNFM
|
Change Management - 5G PNF Software Upgrade Integration Test Status
Regression Testing for LCM:upgrade-pre-check/upgrade-software/upgrade-post-check/rollback（No Change in el alto）
| Status | ||||
|---|---|---|---|---|
|
new CSIT is used for automated testing
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
OOM verify Job Deployer
| Status | ||||
|---|---|---|---|---|
|
E2E vLB testing:
- Service Assign - Passed
- VNF Assign - Passed
- VF Module Assign - Passed
- CDS ConfigAssign - Passed
- Create in Openstack: Passed
- CDS Config Deploy: Passed
|
- Manually run the ETE tests locally before merging changes. (Done)
- Manually run the ETE test suite in Windriver SB-xx with AAF enabled when merging changes (Done)
- The integration test team has HC test for all components, so that is automatically covered. This is waiting on RC0 availability and an OOM change that has been in the pipeline waiting for RC0 for months
- The ETE test suite also runs in CSIT and Sonar jobs with AAF disabled. (In progress)
- Manually run the ETE tests in the IT Release Daily with AAF enabled. (Waiting on RC0)
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
Fails at the SO to CDS step for config assign.
"statusMessage": "Exception in org.onap.so.bpmn.infrastructure.flowspecific.tasks.ConfigAssignVnf.preProcessAbstractCDSProcessing java.util.LinkedHashMap cannot be cast to java.lang.String",| Status | ||||
|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
aai + sdc: Cassandra
sdnc + so : MariaDB
| Status | ||||
|---|---|---|---|---|
|
5G - Preonboarding/Onboarding - Test Status
Preonboarding
| Status | ||||
|---|---|---|---|---|
|
Manual test case using
| Status | ||||
|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
90% done.
| Status | ||||
|---|---|---|---|---|
|
59*/61 Orange Lab
58*/61 E// Lab
(*SO tooling issue)
OOF-CMSO
SDNC
1 VFC sub-module (PASS in Orange; PASS in E// on retest)
CDS blueprint (PASS in Orange)
48/49 Intel/Windriver LabOOF-CMSO
Tweaks: M4 SDNC and remove log/pomba
init: PASS
infra: PENDING
custservice:
| Status | ||||
|---|---|---|---|---|
|
Retest distribution with SO 1.5.3 (includes SO-2357 fix) passed.
Create and delete verified with fixes provided by two jira's - as noted
Closed Loop test worked.
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
Onboarding of Edgex chart is ongoing. The tar.gz has been created for the chart.
Installation was completed and pods deployed.
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
ETSI Alignment
SO plugin to support SOL003 to connect to an external VNFM
| Status | ||||
|---|---|---|---|---|
|
new CSIT is used for automated testing
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
OOM verify Job Deployer
| Status | ||||
|---|---|---|---|---|
|
E2E vLB testing:
- Service Assign - Passed
- VNF Assign - Passed
- VF Module Assign - Passed
- CDS ConfigAssign - Passed
- Create in Openstack: Passed
- CDS Config Deploy: Passed
Current failure status: [closed] - JIRA https://gerrit.onap.org/r/#/c/so/+/96621/
Fails at the SO to CDS step for config assign.
"statusMessage": "Exception in org.onap.so.bpmn.infrastructure.flowspecific.tasks.ConfigAssignVnf.preProcessAbstractCDSProcessing java.util.LinkedHashMap cannot be cast to java.lang.String",
| Status | ||||
|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
aai + sdc: Cassandra
sdnc + so : MariaDB
| Status | ||||
|---|---|---|---|---|
|
5G - Preonboarding/Onboarding - Test Status
Preonboarding
| Status | ||||
|---|---|---|---|---|
|
Manual test case using
| Status | ||||
|---|---|---|---|---|
|
| Status | ||||
|---|---|---|---|---|
|
| Status | ||||||
|---|---|---|---|---|---|---|
|
59*/61 Orange Lab
58*/61 E// Lab
(*SO tooling issue)
OOF-CMSO
SDNC
1 VFC sub-module (PASS in Orange; PASS in E// on retest)
CDS blueprint (PASS in Orange)
48/49 Intel/Windriver LabOOF-CMSO
Tweaks: M4 SDNC and remove log/pomba
init: PASS
infra: PASS
custservice:
PASS
loop: PASS
noloss: PASS
HTTP Certificate Expiry Test
(verify_cert.sh)
clamp 3/2020
dmaap 3/2020
host:aaf-service.onap Not After : Oct 11 01:09:04 2020 GMT
host:aai.onap Not After : Sep 27 19:34:54 2020 GMT
host:appc.onap Not After : Jul 15 19:49:01 2029 GMT
host:clamp-backend.onap Not After : Mar 21 16:16:58 2020 GMT
host:clamp-external.onap Not After : Mar 21 16:16:58 2020 GMT
host:clamp.onap Not After : Mar 21 16:16:58 2020 GMT
host:config-binding-service.onap Not After : Apr 10 09:58:41 2020 GMT
host:dcae-cloudify-manager.onap Not After : Apr 10 09:58:41 2020 GMT
host:deployment-handler.onap Not After : Apr 10 09:58:41 2020 GMT
host:dmaap-bc.onap Not After : Mar 22 17:37:39 2020 GMT
host:dmaap-dr-node.onap Not After : Apr 1 09:24:11 2020 GMT
host:dmaap-dr-prov.onap Not After : Apr 1 09:49:34 2020 GMT
host:msb-eag.onap Not After : Mar 15 02:08:14 2027 GMT
host:msb-iag.onap Not After : Mar 15 02:08:14 2027 GMT
host:pap.onap Not After : Aug 22 23:43:27 2020 GMT
host:portal-app.onap Not After : Apr 15 18:38:36 2020 GMT
host:sdc-be.onap Not After : Sep 9 11:33:20 2020 GMT
host:sdc-fe.onap Not After : Sep 9 11:33:20 2020 GMT
host:sdc-wfd-fe.onap Not After : Aug 18 11:38:03 2015 GMT
host:sdnc-portal.onap Not After : Apr 26 17:48:01 2020 GMT
host:sdnc.onap Not After : Apr 26 17:48:01 2020 GMT
host:vid.onap Not After : Oct 3 11:52:42 2020 GMT
| Jira Legacy | ||||||||
|---|---|---|---|---|---|---|---|---|
|
...