Color Guide
ONLY Completed items should be green.
COMPLETED
PROGRESSING >= 90%
PROGRESSING <90%
TARGET COMPLETION
# | Use CaseFunctional Requirement Nonfunctional Requirement | Test Cases | Lab | IntegrationTest Lead | RC0 Status(remaining days of effort) | RC1Status | RC2 Status | TSC Feedback (RC2) | Details | Doc status | CI integration* | Components involved | Comments |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Model Driven Control Loop Design | Testing with GRA_API in VID/SO/SDNC (vDNS is part of scale out use case below #11) | Intel / Windriver Azure | COMPLETED (need to regression on final dockers) | COMPLETED | Waiting feedback about regression on final dockers | Distribtion COMPLETED Instantiation COMPLETED Control Loop COMPLETED Work around applied for appc.properties in Jira | https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfw.html#docs-vfw minor updates Blocker: INT-1568 - Getting issue details... STATUS APPC-1876 - Getting issue details... STATUS | ? | SDC Dmaap SDNC SO AAI Policy Appc ... | |||
| 3 | vCPE with TOSCA MODELING-354 - Getting issue details... STATUS VFC-1654 - Getting issue details... STATUS USECASEUI-438 - Getting issue details... STATUS | vCPE(tosca) - Integration test cases | CMCC / Intel | COMPLETED | COMPLETED | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE_with_Tosca_VNF.html minor updates | SDC Dmaap AAI Multicloud VFC UUI Modeling ... | ||||||
| 4 | 5G - Realtime PM and High Volume Stream Data Collection | 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | Intel / Windriver | COMPLETED | COMPLETED | COMPLETED | Test Cases passed on RC0 Test status: 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5g_rtpm.html#docs-realtime-pm | Yes | DCAE | |||
| 5 | 5G - PNF PnP REQ-134 - Getting issue details... STATUS | 5G - PNF PnP - Integration Test Cases | Intel / Windriver | COMPLETED | COMPLETED | Test Cases passed on RC0 | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_5g_pnf_pnp.html#docs-5g-pnf-pnp minor updates | Already in CI gate | 16.04: Currently released image for SO-BPMN (1.6.0 form27'th of March) is not working. Image from today 16.04 is sufficient and works. v2/onap/so/bpmn-infra/manifests/1.6.0-20200416T0645 | ||||
| 6 | 5G - Bulk PM - Test Status | Ericsson Lab | james cuddy | COMPLETED | COMPLETED | CCOMPLETEDOMPLETED | DCAEGEN2-2217 - Getting issue details... STATUS | Introduced in Gate after RC1 | DCAEGEN2-2217 - Getting issue details... STATUS | ||||
| 8 | 5G - PNF Pre-Onboarding & Onboarding SOL 004 (VNF Package Security) REQ-135 - Getting issue details... STATUS | 5G - Preonboarding/Onboarding - Test Status | Intel / Windriver | PNF Preonboarding (VNF SDK): PNF Onboarding (SDC): | PROGRESSING >= 90% 15.05 | COMPLETED | image 1.5.2 that has been release on 22nd of May contains all corrections waiting to have it in OOM for Frankfurt | SOL004 option 1 need to be checked manually in VNFSDK SDC-2981 - Getting issue details... STATUS - blocks automated test cases for SOL004 in PNF Onboarding part VNFSDK-582 - Getting issue details... STATUS VNFSDK-581 - Getting issue details... STATUS | 16.04: New image has been released /onap/vnfsdk/refrepo:1.5.1
| ||||
| 9 | 5G - OOF SON: OOF (SON) in R5 El Alto, OOF (SON) in R6 Frankfurt | Integration Test | OWL / Windriver | COMPLETED | COMPLETED | Completed testing in Winlab. | Use case: https://docs.onap.org/en/dublin/submodules/integration.git/docs/docs_5G_oof_pci.html SON-Handler MS (DCAE): https://onap.readthedocs.io/en/latest/submodules/dcaegen2.git/docs/sections/services/son-handler/index.html Updates for Frankfurt submitted (INT-1466 and DCAEGEN2-2104) | Stretch goal, will take this up in next release | DCAE (SON-Handler MS), Policy, SDN-C, OOF | Use case integration test cases status can be found in below page | |||
| 10 | E2E Network Slicing | Test Status | Windriver/CMCC | COMPLETED | COMPLETED | OOF deployment failure block final testing. | Completed testing in CMCC lab. | Test is in progress. | Use case documentation submitted (INT-1468). | Stretch goal, will take this up in next release. | UUI, EXT-API, SO, OOF (Test only: SDC, A&AI, Poilcy) | OPTFRA-749 - Getting issue details... STATUS | |
| 11 | Scale Out | Scale Out - Integration Test Cases and Status | Intel / Windriver | COMPLETED | PROGRESSING Manual Scaling has completed Still need to complete Auto scaling | minor updates | APPC VID DCAE SO Policy ... | Some new platform capabilities have been developed in SO and CDS. If they can’t be used for some reason, we’ll fall back to using the current process. | |||||
| 12 | CCVPN-E LINE over OTN NNI | CCVPN Integration Test Cases | Huawei | COMPLETED MAY 12 | COMPLETED | SDNC-1184 - Getting issue details... STATUS | We have an issue in the SDNC DG (SDNC-1184), which will be fixed by May 12th. After that, the integration test will be completed. | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope | SDNC AAI OOF UUI | ||||
| 12.1 | CCVPN - MDONS | MDONS Integration Test Case | Fujitsu/Orange | MAY 15TH | COMPLETED |
SO-2967 - Getting issue details... STATUS Verified in Fujitsu Lab | Test Environment:
Current blocker: SO-2827 - Getting issue details... STATUS Fixed | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope | SO - C A&AI - C SDN-C - C UUI - C SDC - TO ExtAPI - TO | ||||
| 13 | HPA vFW/vDNS | vFW/vDNS HPA Testing(Test Plan 1 inHPA & Cloud Agnostic Intent - R3 Test Plan) | Intel / Windriver | COMPLETED MAY 22 | COMPLETED | COMPLETED (based on previous testing) | One pass has been more or less completed with workarounds the following bugs: SO-2940 - Getting issue details... STATUS OPTFRA-750 - Getting issue details... STATUS OPTFRA-756 - Getting issue details... STATUS As with line 20 below, manual workaround for the following is being used: MSB-467 - Getting issue details... STATUS Other known issues: Using patch from CLI-269 - Getting issue details... STATUS to manually use CLI updates for loading policies. Not required - as curl commands can also be used. Calling this done based on testing done with workaround/fixes for the above noted issues. | https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfwHPA.html#docs-vfw-hpa | SO SDC VID OOF Policy SDNC AAI | ||||
| 15 | Change Management Frankfurt Extensions REQ-187 - Getting issue details... STATUS REQ-191 - Getting issue details... STATUS | Steps: 1) Instantiation of vFWDT 2) Configuration of OOF Policies for vFWDT 3) Execution of OSDF/HAS requests for data collection 4) Configuration of VNF profiles in CDT 5) Configuration of Ansible Server 6) Execution of the workflow | Intel / Windriver | COMPLETED Updated 12th of May | COMPLETED Updated 14th of May | PROGRESSING <= 20% JUNE 15TH SB-00 RC2 was created on Wednesday. Thursday and Friday is holiday in Poland what blocks tests till Monday. Updated 11.06 | 1) PASS 2) BLOCKED 3) BLOCKED 4) WAITING 5) WAITING 6) WAITING RC2 20% Completed BLOCKED BY POLICY-2631 - Getting issue details... STATUS AAF-1159 - Getting issue details... STATUS | El Alto doc good: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFWDT.html#docs-vfw-traffic but major updates needed (as the use cases evolved) Major documentation change completed https://gerrit.onap.org/r/c/integration/+/102853 Minor change with policy upload change still to be updated. Documentation update completed. | No Use case will be semi-automated. All the steps can be performed with scripts but still CI scripts needs to be build. Planned for next release. | SDC AAI SO VID OOF Policy APPC | Use case will be renamed and include upgrade | ||
| 16 | PNF Software Upgrade
| Steps: 1) Execute custom PNF SW Upgrade WF from SO 2) SO send conventional LCM API to SDNC/CCSDK 3) Controller send ansible commands to AS 4) AS contact EM with ansible | Huawei | INT-1207 - Getting issue details... STATUS COMPLETED | COMPLETED | COMPLETED | Test results: Test Status of Enhancement on PNF S/W Upgrade with EM with Ansible | INT-1209 - Getting issue details... STATUS | |||||
| 18 | BBS Broadband Service Use Case (Frankfurt) | BBS Integration Test Cases (Frankfurt) | BBS Swisscom Lab | COMPLETED MAY 29 Swisscom lab is closed. SO-2955 - Getting issue details... STATUS Found a workaround for BBS APEX policy, see: POLICY-2463 - Getting issue details... STATUS | COMPLETED BBS requires the latest SDNC docker image: sdnc-image:1.8-STAGING-latest | COMPLETED | Frankfurt doc: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_BBS.html | No, planned for future releases | we need to find a solution to emulate 3rd party controllers first. Our use case relies on physical equipment and external controllers and we can only test it in the Swisscom lab at the moment. We may have a second lab with the required equipment in UNH-IOL, but it is not confirmed yet. | ||||
| 19 | VSP Compliance and Validation Check within SDC (Frankfurt) - Phase 2 | VSP Compliance Check within SDC - Integration Test Plan | Vodafone | COMPLETED | COMPLETED | https://onap-sdc.readthedocs.io/en/latest/consumedapis.html https://onap-doc.readthedocs.io/projects/onap-sdc/en/latest/externaltesting.html | No | SDC VTP | |||||
| 20 | K8S based Cloud Region Support - vFW Use case | Deploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud REQ-182 - Getting issue details... STATUS | intel / Windriver | PROGRESSING >= 90% MAY 15 | COMPLETED | COMPLETED (based on previous testing) | completed test with manual workaround for following 3 items: Known issues: MSB-467 - Getting issue details... STATUS using manual workaround to get past this for now (fixes for this have been tested and verified) MULTICLOUD-1053 - Getting issue details... STATUS has been resolved. SDC-2972 - Getting issue details... STATUS using manual workaround to get past this for now. (reported to be working now) After above are fixed, a retest can be made to verify. Calling this done based on testing done with fixes/workarounds of known issues. | ||||||
| 21 | K8S based Cloud Region Support - EdgeXFoundry Use case | Deploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud | Intel/ Windriver | PROGRESSING >= 90% MAY 15 | COMPLETED | COMPLETED (based on previous testing) | same as line #20. | ||||||
| 22 | ORAN A1 Adapter Implemented in ONAP (SDNR) | A1 Adapter Test Cases | Intel/Windriver | PROGRESSING >= 90% MAY 15TH | COMPLETED | ||||||||
| 23 | PNF Software Upgrade using direct Netconf/Yang interface with PNF | PNF Software Upgrade Using direct NETCONF/YANG interfacewithPNFTestCases | Intel | INT-1308 - Getting issue details... STATUS COMPLETED | COMPLETED | INT-1450 - Getting issue details... STATUS Documentation is updated with new use cases in Frankfurt | |||||||
| 24 | Enable PNF software version at onboarding | PNF Software Information Onboarding Test Cases | Ericsson Lab | Former user (Deleted) | INT-1307 - Getting issue details... STATUS COMPLETED | COMPLETED | |||||||
| 25 | K8s CDS Support (vFW_CDS_CNF) REQ-182 - Getting issue details... STATUS (SO and CDS Macro flow with Helm Chart) |
| Private lab + Intel/Windriver community lab | INT-1184 - Getting issue details... STATUS PROGRESSING >= 90% MAY 15TH | COMPLETED | PROGRESSING <= 40% JUNE 15TH SB-00 RC2 was created on Wednesday. Thursday and Friday is holiday in Poland what blocks tests till Monday. Updated 11.06 | Currently successfully verified with manually cherry picked changes from RC2 candidate. Waiting for RC2 to verify again. | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFW_CNF_CDS.html but needs to be updated according to latest verification status | Automation of usecase targeted for G release | 07.05: Currently usecase has been verified to work both in internal and windriver lab with workaround. Ongoing tests regarding verifying fixes provided under blocker jiras. 08.05: Removed blocker jiras that were tested for being corrected. 14.05: Updating fix brought under MSB-467 to fully cover issue, as previous patch was found incomplete | |||
| 26 | ETSI Alignment SO plugin to support SOL003 to connect to an external VNFM and ETSI package management |
| Ericsson Lab | COMPLETED Note: The ETSI-Alignment package management test is completed MAY 15TH | Its CSIT testing will be implemented in the Guilin release. For Frankfurt, the test for defined test cases is completed. | ||||||||
| 27 | Merged with record 8 | Merged with record 8 | Merged with record 8 | Merged with record 8 | Merged with record 8 | ||||||||
| 28 | xNF communication security enhancements. | xNF communication security enhancements - Tests Description and Status | COMPLETED | COMPLETED | Tes Cases passed on RC0. Test status: xNF communication security enhancements - Tests Description and Status | Yes | DCAE | ||||||
| 30 | PNF Software Upgrade
| PNF software upgrade in R6 Frankfurt | Huawei |
INT-1212
-
Getting issue details...
STATUS
COMPLETED | COMPLETED | Test results: Test Status of PNF S/W Upgrade with EM with Netconf/Yang interface | INT-1209 - Getting issue details... STATUS | ||||||
| 31 | 5G - 5G NRM Network Resource Model (Configuration Mgmt) | 5G Network Resource Model (NRM) Configuration in R6 Frankfurt | Huawei |
INT-1245
-
Getting issue details...
STATUS
COMPLETED | COMPLETED | Documentation was updated as a new use case for Frankfurt: https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5G_NRM_Configuration.html INT-1514 - Getting issue details... STATUS | |||||||
| 35 | Integration of CDS as an Actor | Integration Testing | Intel / Windriver | COMPLETED | COMPLETED | Policy - CDS integration test was successfully completed in SB01 lab for vFW use case. CLAMP - Policy integration test was successfully completed in SB01 lab for vFW use case. | Policy Framework CDS A&AI CLAMP | ||||||
| 37 | Configuration with NETCONF in Frankfurt/R6 REQ-76 - Getting issue details... STATUS REQ-140 - Getting issue details... STATUS | Detailed Steps carried out for performing E2E Testcases can be found at : E2E Integration Testing for NETCONF over TLS Configuration- Test Case | Ajay Deep Singh | COMPLETED | COMPLETED | INT-1295 - Getting issue details... STATUS | Yes | AAF-Certservice, SDNC, Netconf-Pnp-Simulator | |||||
| 38 | E2E Automation vLB w/CDS Use Case (Frankfurt) NOTE: SO is using Config Assign & Config Deploy building blocks. SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation will be a separate test case.[row below] | Steps: Design Time 1) CBA Package onboarding CDS 2) SDC VSP, VF, Service Creation and onbaording for vLB. Run Time: 1) SO send Marcro requst to SDNC GR-API 2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution 3) SO sends request to CDS for Config Assign. 4) SO sends request to Openstack for vLB Instantiation 5) SO send request to CDS for ConfigDeploy | Intel / Windriver | COMPLETED | COMPLETED | CDS, SDNC, SO, Policy, Naming MS, Netbox | |||||||
| 39 | Telstra | COMPLETED | COMPLETED | SDC-2879 - Getting issue details... STATUS | |||||||||
| 40 | REQ-267 - Getting issue details... STATUS | WinLAB | COMPLETED | COMPLETED | Completed testing in Winlab. | Integration work will be part of OOF / SON / PCI Use Case. will have the same integration status as that use case. | (Read the Docs entry in progress) being done under Integration Jira-1526 INT-1526 - Getting issue details... STATUS | SDN-C (CC-SDK) using MariaDB | Sandeep is leading the Integration & Development. | ||||
| 41 | E2E Automation vLB w/CDS Use Case (Frankfurt) SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation. | Steps: Design Time 1) CBA Package onboarding CDS 2) SDC VSP, VF, Service Creation and onbaording for vLB. Run Time: 1) SO send Marcro requst to SDNC GR-API 2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution 3) SO sends request to CDS for ControllerExecutionBB with scope of vnf and action of config-assign. 4) SO sends request to Openstack for vLB Instantiation 5) SO send request to CDS for ControllerExecutionBB with scope of vnf and action of config-deploy. | Intel / Windriver | COMPLETED | COMPLETED | CDS, SDNC, SO, Policy, Naming MS, Netbox | NOTE: in order for this use case to work out of the box. The following patches need to be merged to frankfurt release:
| ||||||
| Use cases without resources for Frankfurt | |||||||||||||
| 2 | Use Case: Residential Broadband vCPE (Approved) | vCPE Integration Test Case | Intel / Windriver | PROGRESSING <90% ??? During May 4 PTL meeting, Morgan Richomme reports that this issue may need to be de-scoped since there are no resources available for integration test. | Not restested as part of Frankfurt release | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE.html | No | ||||||
| 7 | 5G - Configuration with NETCONF | 5G - PNF Configuration via Netconf - Test Status | Intel/ Windriver | This item is duplicate. Please see line #37 for work related to this feature in R6. | Minor updates | Yes | |||||||
| 14 | Change Management - Flexible Designer & Orchestrator | Steps: 1) Designing custom workflows with Workflow Designer 2) Distributing custom workflows to SO 3) Deploying the custom workflow in SO 4) Sending workflow metadata to VID 5) Triggering custom workflow execution from VID 6) Executing custom workflows in SO | Intel / Windriver | NOT A CANDIDATE FOR FRANKFURT | Not restested as part of Frankfurt release | 1) Designing custom workflows with Workflow Designer – 100% 2) Distributing custom workflows to SO – Was 100% in Dublin Issues arose with SDC Distribution in El Alto and remain unresolved – 80% working now. However, SO does work properly with manual WF distribution and workaround notes are posted on the wiki 3) Deploying the custom workflow in SO – 100% 4) Sending workflow metadata to VID – 100% 5) Triggering custom workflow execution from VID – 100% 6) Executing custom workflows in SO – Execution mechanism 100%, Building Blocks – 60% (Had many issues with test environment & APPC blocking testing from Nov-Jan) 7) Pause for Manual Task – 100% | |||||||
| 17 | Change Management - Schedule Optimization | Intel / Windriver | NOT A CANDIDATE FOR FRANKFURT | Not restested as part of Frankfurt release | |||||||||
| 29 | HPA vIPsec | vIPsec HPA testing | Intel / Windriver | Not tested | Not restested as part of Frankfurt release | ||||||||
| Pairwise testing | |||||||||||||
| 32 | TOSCA Compliant Policy types | Pairwise Testing | Intel / Windriver | COMPLETED | COMPLETED | COMPLETED | Recommended for a GO #1 Can you please provide your tests results? #2 Any automated tests? | Testing completed via CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00. Additional testing is covered via the vFW, Scale Out, vFW CDS use cases. Automated test for vFW updated: INT-1350 - Getting issue details... STATUS No other automated tests for CLAMP as this was tested manually using CLAMP GUI. | REQ-21 - Getting issue details... STATUS | ||||
| 33 | Policy Update Notifications | Pairwise Testing | Intel / Windriver | COMPLETED | COMPLETED | COMPLETED | Recommended for a GO #1 Can you please provide your tests results? #2 Any automated tests? | Testing completed via POLICY/DCAE pairwise testing completed by RC0. No automated tests. | REQ-25 - Getting issue details... STATUS | ||||
| 34 | CLAMP Deployment of Policies to PDP Groups | Pairwise Testing | Intel / Windriver | COMPLETED | COMPLETED | COMPLETED | Recommended for a GO #1 Can you please provide your tests results? #2 Any automated tests? | Testing completed via CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00. Additional testing is covered via the vFW, Scale Out, vFW CDS use cases. No automated tests as this is done manually via the CLAMP GUI. | REQ-29 - Getting issue details... STATUS | ||||
| 36 | Component Upgrades to the new Policy Lifecycle API | Pairwise Testing | Intel / Windriver | COMPLETED | COMPLETED | COMPLETED | Recommended for a GO #1 Can you please provide your tests results? #2 Any automated tests? | Policy/CCSDK testing was successfully completed via pairwise testing in SB01 by RC0. Policy/OOF testing successfully completed by RC1 and was done in SB01. No automated tests. | REQ-162 - Getting issue details... STATUS | POLICY-2486 - Getting issue details... STATUS | |||
| Misc | |||||||||||||
Robot Keyword Testing | |||||||||||||
| init | BDF | OK | |||||||||||
| health | Integrated in gate | COMPLETED | |||||||||||
| eteHelm-k8.sh | BDF* | OK | Not integrated in gate but onap-k8s and onap-helm (not based on Robot) Integrated in Gate | ||||||||||
| healthdist | Integrated in gate | COMPLETED | |||||||||||
instantiateVFWCLGRA | BDF | OK | |||||||||||
| demo-k8s.sh -n onap vfwclosedloop <png_ip> | BDF | OK | |||||||||||
| instantiateVFWDTGRA | BDF | OK | |||||||||||
| distributeVCPE | BDF | OK | |||||||||||
| distributeVCPEResCust | |||||||||||||
| sdc-dcae-d | |||||||||||||
| vcpe.py | |||||||||||||
| postinstall | Integrated in gate | COMPLETED | |||||||||||
| 72 Hour Stability Run | onboard/instantiate | COMPLETED | |||||||||||
| closedloop | COMPLETED | ||||||||||||
HTTP Certificate Expiry Test (verify_cert.sh) | clamp 3/2020 dmaap 3/2020 | Tobe integrated in gate, raise an error in CI when 1 of the certificates is about to expire (in 2 weeks?) | |||||||||||
| 27 | Component/memory optimization: Ongoing Assessment | OOM | Addressed by OOM in Guilin | ||||||||||
| 29 | S3P- Geo-Redundancy | Integration | Not tested as part of Frankfurt release | No resources | |||||||||
| 35 | Health Checks for PODS | Percentage coverage of Health Checks for Running PODS | Integration | Hard to define...and to test | |||||||||
| 36 | New Installation Tests in 4 labs | Intel/Windriver | Integration | Reccurent activity | |||||||||
| Orange (Rocky) | Morgan Richomme | Morgan Richomme | |||||||||||
| Ericsson Lab (Rocky) | |||||||||||||
| DT | |||||||||||||
DCAEGEN2-1539 - Getting issue details... STATUS
*: CI integration: the goal is to introduce the use case in CI daily chains for Frankfurt. Ths table could be completed with a CI dashboard where the use cases will be run every day.
As it should be runnable in any lab, some constraints need to be considered:
- no proprietary VNFs
- use cases must be self-content , third party equiments may not be present in all labs.
- infrastructure setup/teardown shall be clear: the use case must be runnable from a clean ONAP installation. These resources must be cleaned at the end of the test ,
- results shall be pushed to a common DB. It is recommended ot use xtesting to run the tests (robotframework, python, bash, unit test drivers)