Dublin Release Integration Testing Status
- Yang Xu
- cl664y@att.com
- Chris Rapposelli-Manzo
Color Guide
For 2019-06-03 - ONLY Completed items should be green.
COMPLETED
PROGRESSING >= 90%
PROGRESSING <90%
| # | Use Case Functional Requirement Nonfunctional Requirement | Test Cases | Lab | Integration Test Lead | Status (remaining days of effort) | Video URL | Detailed Test Status | Quick Notes |
|---|---|---|---|---|---|---|---|---|
| 1 | Model Driven Control Loop Design | (vDNS is part of scale out use case below #10) | Intel / Windriver | COMPLETED on both SNAPSHOT and Release versions | Instantiate working for both. Closed Loop in progress vFW to VES : PASS VES to TCA : PASS TCA to Policy : Default policy needs to be changed : targetType: VM Policy to APPC: PASS with SNAPSHOT APPC to vPNG: PASS with SNAPSHOT. vFW: PASS. Waiting to regression test release containers INT-1078 - Getting issue details... STATUS DCAEGEN2-1510 - Getting issue details... STATUS POLICY-1685 - Getting issue details... STATUS POLICY-1778 - Getting issue details... STATUS POLICY-1780 - Getting issue details... STATUS APPC-1604 - Getting issue details... STATUS APPC-1610 - Getting issue details... STATUS | |||
| 2 | Use Case: Residential Broadband vCPE (Approved) | vCPE Integration Test Case | Intel / Windriver | COMPLETED | vCPE (Heat) - Dublin Test Status | Done VNF onboarding, service design for infra and rescust, model distribution, infra and customer services instantiation Closed loop tests have done VNF event generation, vescollector, DCAE(TCA), Policy and APPC SO-1927 - Getting issue details... STATUS SO-1922 - Getting issue details... STATUS APPC-1614 - Getting issue details... STATUS SO-1906 - Getting issue details... STATUS SDC-2299 - Getting issue details... STATUS SO-1861 - Getting issue details... STATUS SO-1873 - Getting issue details... STATUS AAI-2406 - Getting issue details... STATUS PORTAL-571 - Getting issue details... STATUS | ||
| 3 | vCPE with TOSCA | vCPE(tosca) with HPA - Integration test cases | Intel / Windriver | DESCOPED (60% TEST COMPLETION) | VFC-1397 - Getting issue details... STATUS VFC-1399 - Getting issue details... STATUS VFC-1402 - Getting issue details... STATUS VFC-1406 - Getting issue details... STATUS PORTAL-593 - Getting issue details... STATUS MULTICLOUD-657 - Getting issue details... STATUS | |||
| 4 | 5G - Realtime PM and High Volume Stream Data Collection | 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | Intel / Windriver | COMPLETED | 5G - Real Time PM and High Volume Stream Data Collection - Test Status Dublin | |||
| 5 | 5G - PNF PnP | 5G - PNF PnP - Integration Test Cases | Intel / Windriver | 20.05.2019 COMPLETED ON STAGING 03.06.2019 COMPLETED ON RELEASE (SB02) | Dublin Release Integration Testing Status | There is no possibility to distribute model for PNF due SDNC issues (lack of one table in SDNC db)
SDNC-756
-
Getting issue details...
STATUS
and
SDNC-757
-
Getting issue details...
STATUS
. Failed on Release lab WindRiver SB02 bug SDNC-756 - Getting issue details... STATUS reopened | ||
| 6 | 5G - Bulk PM | 5G - Bulk PM - Test Status | Intel / Windriver SB-02 | COMPLETED | ||||
| 7 | 5G - Configuration with NETCONF | 5G - PNF Configuration via Netconf - Test Status | Intel/ Windriver | COMPLETED ON ERICSSON LAB COMPLETED ON SB-02 | This test is in continuity of PNF PnP test case which is at no. 5. Completed this test in Ericsson Local Lab with PnP PNF on-boarding. Starting to test it in Windriver Lab. Few Issues impacting this test are: SO-1857 - Getting issue details... STATUS Root cause of the exception is handled in jira, CCSDK-1354 - Getting issue details... STATUS SO-1856 - Getting issue details... STATUS SO-1855 - Getting issue details... STATUS SDNC-759 - Getting issue details... STATUS Due to this issue SDNC-756 not able to deploy service using VID, using a WA to do that stated in the below bug. SDNC-769 - Getting issue details... STATUS Unable to distribute the service. SDNC-756 - Getting issue details... STATUS CCSDK-1318 - Getting issue details... STATUS Existing Blueprints failing due to a bug in CDS Config Deploy CCSDK-1384 - Getting issue details... STATUS | |||
| 8 | 5G - Preonboarding/Onboarding - Test Status | Intel / Windriver | PNF Preonboarding (VNF SDK): PNF Onboarding (SDC): | PNF Onboarding (SDC) COMPLETED PNF Preonboarding (VNF SDK): COMPLETED - ONE BUG REPORTED FOR ELALTO logged medium level bug | 5G - PNF E2E Pre-Onboarding & Onboarding Integration Test Status | Successfully completed PNF Onboarding testing in Ericsson and WindRiver labs. Manually applied workaround to db for SDNC-756 - Getting issue details... STATUS in WindRiver lab. Very old images used for VNFSDK and CLI in ONAP DUBLIN: CLI-168 - Getting issue details... STATUS VNFSDK-407 - Getting issue details... STATUS Instruction in read the docks fro offline VTP platform setup is not correct VNFSDK-408 - Getting issue details... STATUS Preonborading bugs for validation rules found by Dermot Melia VNFSDK-412 - Getting issue details... STATUS VNFSDK-410 - Getting issue details... STATUS VNFSDK-411 - Getting issue details... STATUS VNFSDK-414 - Getting issue details... STATUS VNFSDK-418 - Getting issue details... STATUS | ||
| 9 | 5G - OOF and PCI | 5G - OOF and PCI - Integration Test Cases | Windriver | COMPLETED. - 2 known issues (Medium): CCSDK-1399 and CCSDK-1400 | Integration Testing | Integration testing in Windriver lab. IT#017 test case will be performed again as soon as CCSDK-1399 and CCSDK-1400 are delivered DCAEGEN2-1529 - Getting issue details... STATUS OPTFRA-505 - Getting issue details... STATUS OPTFRA-508 - Getting issue details... STATUS 1 test case involving SDN-R could not be completed (IT#017). The following Jiras were raised related to this test case, and the code fixes are delivered. CCSDK-1364 - Getting issue details... STATUS SDNC-772 - Getting issue details... STATUS The DMaaP listener docker with the code fix is not yet deployed in SB-00 where the testing is done. The code, fix however, is already merged on to Dublin and Master branches. So, once the latest docker is deployed, we will continue and complete the test case either at Windriver.
| ||
| 10 | Scale Out | Scale Out - Integration Test Cases and Status | Intel / Windriver | 100% COMPLETED | Scale Out with manual trigger has been tested by directly calling SO instead of using VID | |||
| 11 | CCVPN | CCVPN Integration Test Cases | CMCC | 100% COMPLETED Dublin Scope to be reviewed in alignment with what it is currently certified REDEFINED to match the scope of completed testing - Former user (Deleted) | CCVPN Test Status | SDC-2284 - Getting issue details... STATUS SDC-2286 - Getting issue details... STATUS OOM-1843 - Getting issue details... STATUS VFC-1375 - Getting issue details... STATUS SDNC-764 - Getting issue details... STATUS SDNC-753 - Getting issue details... STATUS POLICY-1774 - Getting issue details... STATUS The CMCC lab had a relocation plan at the beginning of this year. But for special reasons, the plan is now ahead of schedule. this week all equipment has to be powered off. For this particular reason, we can't continue our tests. so we plan to test the remaining test cases in the next release, | ||
| 12 | HPA vFW/vDNS | vFW/vDNS HPA Testing(Test Plan 1 inHPA & Cloud Agnostic Intent - R3 Test Plan) | Intel / Windriver | 100% COMPLETED | vFW/vDNS with HPA Integration Test Status (Dublin) | SO-1871 - Getting issue details... STATUS OPTFRA-499 - Getting issue details... STATUS - Both SO1-871 and OPTFRA-499 refer to change from http to https on OOF API side. Found workaround, a fix has been submitted for the second issue and is currently being tested. OPTFRA-506 - Getting issue details... STATUS - Done OPTFRA-511 - Getting issue details... STATUS - We can work around 511 and have reduced to medium, removed integration tag. SO-1939 - Getting issue details... STATUS - Done need to remove oof_directives from the user_directives parameter | ||
| 13 | Change Management - Flexible Designer & Orchestrator | Steps: 1) Designing custom workflows with Workflow Designer 2) Distributing custom workflows to SO 3) Deploying the custom workflow in SO 4) Sending workflow metadata to VID 5) Triggering custom workflow execution from VID 6) Executing custom workflows in SO | Intel / Windriver | COMPLETED | SDC build discrepancy where Workflow Designer does not work in ONAP env. but does in SDC local env. SO-1911 - Getting issue details... STATUS SO-1942 - Getting issue details... STATUS SO-1923 - Getting issue details... STATUS SO-1925 - Getting issue details... STATUS Distribution of BPMN from SDC to SO is now resolved!!! We now have an issue on auto deploy of activity specs to SDC - SO-1996 (the specs get created, but SDC returns 201 instead of 200 specified in the Wiki, SO made a change to accept 201 too), it is merged and is in today's daily build (6/6/19) Testing complete on the user-defined workflow with setting/unsetting in-maint flag. Testing for in-place software upgrade would be done in El Alto | |||
| 14 | Steps: 1) Creating VNF profile using CDT 2) Designing custom workflows with Workflow Designer 3) Distributing custom workflows to SO 4) Deploying the custom workflow in SO 5) Sending workflow metadata to VID 6) Triggering custom workflow execution from VID 7) Executing custom workflows in SO | Intel / Windriver | COMPLETED | OPTFRA-483 - Getting issue details... STATUS OPTFRA-492 - Getting issue details... STATUS OPTFRA-494 - Getting issue details... STATUS OPTFRA-498 - Getting issue details... STATUS APPC-1576 - Getting issue details... STATUS APPC-1604 - Getting issue details... STATUS APPC-1611 - Getting issue details... STATUS APPC-1612 - Getting issue details... STATUS APPC-1613 - Getting issue details... STATUS SDC-2287 - Getting issue details... STATUS POLICY-1766 - Getting issue details... STATUS CCSDK-1371 - Getting issue details... STATUS
Note: SO workflow cannot be build with WorkFlow designer - we need it for workflow development. It is taken decision to move building workflow in SO/WorkFlow designer in El Alto and to build DT workflow in Dublin outside of SO - with REST APIs of OOF, APPC and AAI. As a consequence we built use case workflow in Python | ||||
| 15 | Change Management - 5G PNG Software Upgrade | Change Management - 5G PNF Software Upgrade Integration Test Status | Intel / Windriver | COMPLETED | Completed this test in Huawei Local Lab. | |||
| 16 | Change Management - Schedule Optimization | Intel / Windriver | COMPLETED | Completed!! | ||||
| 17 | BBS Broadband Service Use Case (Dublin) | BBS Use Case Tracking (Dublin Release)#Testing | BBS Swisscom Lab | COMPLETED: - Phase 1: Service creation and activation + Nomadic ONT (Test cases #[A-D]) COMPLETED - Phase 2 (moved to El Alto): E2E Service Termination (Test cases #[E]). Jira SO-1994 Note: POLICY-1835 and POLICY-1831 should be included in Dublin | BBS Integration Test Cases | DCAEGEN2-1496 - Getting issue details... STATUSDCAEGEN2-1500 - Getting issue details... STATUSDCAEGEN2-1499 - Getting issue details... STATUS INT-1075 - Getting issue details... STATUS SO-1578 - Getting issue details... STATUS SO-1910 - Getting issue details... STATUS SO-1913 - Getting issue details... STATUS SO-1928 - Getting issue details... STATUS SO-1930 - Getting issue details... STATUS SO-1931 - Getting issue details... STATUS SO-1933 - Getting issue details... STATUS https://gerrit.onap.org/r/#/c/87497/ https://gerrit.onap.org/r/#/c/so/+/88935/ SDNC-783 - Getting issue details... STATUS SDNC-784 - Getting issue details... STATUS DCAEGEN2-1596 - Getting issue details... STATUS SO-1993 - Getting issue details... STATUS POLICY-1831 - Getting issue details... STATUS POLICY-1835 - Getting issue details... STATUS SDNC-791 - Getting issue details... STATUS
EXTAPI-248 - Getting issue details... STATUS EXTAPI-249 - Getting issue details... STATUS DCAEGEN2-1611 - Getting issue details... STATUS | ||
| 18 | VSP Compliance Check within SDC (Dublin) - Phase 1 | VSP Compliance Check within SDC - Integration Test Plan | Vodafone | COMPLETED | ||||
| 19 | K8S based Cloud Region Support - vFW Use case | Deploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud | intel / Windriver | COMPLETED | MULTICLOUD-655 - Getting issue details... STATUS Work around is found for R4. Actual fix will be made in R5. | |||
| 20 | K8S based Cloud Region Support - EdgeXFoundry Use case | Deploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud | Intel/ Windriver | COMPLETED | MULTICLOUD-645 - Getting issue details... STATUS SO-1907 - Getting issue details... STATUS MULTICLOUD-650 - Getting issue details... STATUS | |||
| 21 | 5G: Network Slicing Modeling | Amdocs | Borislav Glozman | N/A | No integration testing is expected. A potential model of network slice was presented using SDC features. | |||
| 22 | Consistent ID of a Cloud Region | Windriver | Bin Yang | Use Case Tracking in Dublin Release | VID-482 - Getting issue details... STATUS MULTICLOUD-656 - Getting issue details... STATUS MULTICLOUD-651 - Getting issue details... STATUS
SO-1904 - Getting issue details... STATUS SO-1995 - Getting issue details... STATUS Creating VF Moduel failed with GR-API and selecting CloudRegion3(CloudOwner3) (other than the default one): I am not sure which project (VID/SO/SDNC) should take care of this issue, sent email to discuss email list and wait for response Details can be found: Deploy vLB to Multiple Cloud Regions | |||
| 23 | Modularity | COMPLETE | ||||||
| 24 | ETSI Alignment SO plugin to support SOL003 to connect to an external VNFM | COMPLETE Create+instantiation is completed Note: Termination+Deletion is almost but has a minor issue, it will be done in El Alto | Due to lack of SDC SOL004 VNF support in Dublin, automated CSIT testing has been deferred to El Alto under SO-1899 - Getting issue details... STATUS In Dublin, manual-based (sending REST requests) test has been done for SO/VNFM Adapter to test VNFM Adapter functionalities. Currently, VNFM Adapter API function testing with VNFM Simulator is completed, and the team is working on the SO workflows (which invoking VNFM Adapter) testing. VNF creation+ instantiation testing is 100% Terminate+Delete integration testing will be done in El Alto Dublin test cases, SO VNFM Adapter Test Case | |||||
| 25 | Improve our E2E Process Automation | COMPLETE | VIDEO URL: E2E Automation vDNS w/ CDS Use Case - ONAP-03-Run Time- Video Demo for vDNS CDS Dublin | E2E Automation Testing Status with CDS | Dublin Highest Bugs: SO-1985 - Getting issue details... STATUS SO-1882 - Getting issue details... STATUS – Requires retest. SO-1870 - Getting issue details... STATUS CCSDK-1344 - Getting issue details... STATUS -Fix to be submitted 5/23. SO-1892 - Getting issue details... STATUS - Steve S recommend to update the reference data to include "*" for serviceType. Patch needs to be updated.
SDNC-756
-
Getting issue details...
STATUS
SO-1889
-
Getting issue details...
STATUS
| |||
| 26 | S3P - Footprint Optimization (Integration with Alpine) | N/A | No specific tests. Default containers used in OOM are optimized. | |||||
| 27 | Component/memory optimization: Ongoing Assessment | N/A | ||||||
| 28 | Global optimization (e.g. shared DB) - stretch goal=shared PostgreSQL; shared MariaDB | COMPLETE AAI - PASS SDC - PASS SO - PASS SDNC - PASS | Integration testing underway to validate. | AAI and SDC using Shared Cassandra delivered. SO and SDNC using Shared Mariadb-Galera delivered. PASS if application installs and functions on shared datastores. | ||||
| 29 | S3P- Geo-Redundancy | COMPLETED | Basically the update is both OOF and Portal are successfully using MUSIC in Dublin (E2E testing has no MUSIC-related issue now) and their code exercise MUSIC geo-redundancy across the US more or less every day in production. | |||||
| 30 | SOL 004 (VNF Package Security) | 5G - Preonboarding/Onboarding - Test Status | Ericsson, Intel / Windriver | SDC: COMPLETED
logged medium level bug | 5G - PNF E2E Pre-Onboarding & Onboarding Integration Test Status | Note: SOL004 test cases are an integral part of the 5G PNF pre-onboarding/onboarding test cases. For both SDC and VNF SDK following applies: VNF SDK: VNFSDK-414 - Getting issue details... STATUS delivered Another bug has been found: VNFSDK-418 - Getting issue details... STATUS | ||
| 31 | xNF communication security enhancements. | xNF communication security enhancements - Tests Description and Status | COMPLETED | xNF communication security enhancements - Tests Description and Status | DCAEGEN2-1523 - Getting issue details... STATUS DCAEGEN2-1539 - Getting issue details... STATUS DCAEGEN2-1440 - Getting issue details... STATUS DCAEGEN2-1541 - Getting issue details... STATUS | |||
| 32 | Locale/Internationalization language support | Tao Shen | COMPLETED | PORTAL-565 - Getting issue details... STATUS | ||||
| 33 | Angular 6 Upgrade of ONAP Portal and SDK | Portal R4 Dublin Functional Test Cases (includes Angular 6 upgrade tests) | Intel / Windriver | COMPLETED | Angular 6 Upgrade tests are run locally by the test lead (Sireesh Chintamani (Deactivated) ) on the portal/sdk screens after pairwise testing is passed on SDK - Portal Pair Wise Testing for Dublin Release | PORTAL-272 - Getting issue details... STATUS | ||
| 34 | HPA vIPsec | vIPsec HPA testing | Intel / Windriver | ruoyu.ying | COMPLETED | Need double check for last step on vf module creation | ||
| 35 | Health Checks for PODS | Percentage coverage of Health Checks for Running PODS | Integration | Reporting only for Dublin N/A | 55% Yes 22% No 23% Still being researched | |||
20190523 update - RKE 0.2.1 is now processor independent (no amd64 images - supporting arm nowDCAEGEN2-1539 - Getting issue details... STATUS