2: El Alto Release Integration Testing Status

2: El Alto Release Integration Testing Status

WORK IN PROGRESS - focus will be automated testing so some rows will be deleted from the table

Color Guide

For 2019-08-01 - ONLY Completed items should be green. 

Completed

Progressing >= 90%

Progressing <90%

#

 

Use Case

Functional Requirement

Nonfunctional Requirement

Test Cases

Lab

Integration Test Lead

Status

(remaining days of effort)

Video URL

Detailed Test Status

Quick Notes

Doc status

CI integration*

 

#

 

Use Case

Functional Requirement

Nonfunctional Requirement

Test Cases

Lab

Integration Test Lead

Status

(remaining days of effort)

Video URL

Detailed Test Status

Quick Notes

Doc status

CI integration*

 

1

vFW

Model Driven Control Loop Design 

vFW

 

(vDNS is part of scale out use case below #10)

 

Intel / Windriver

@Brian Freeman / @Marco Platania

 

onboard -PASS

instantiate - PASS

closedloop - PASS

 

Completed

 

Retest with Policy FIX

Robot fix for automation

https://lf-onap.atlassian.net/browse/POLICY-2109

https://lf-onap.atlassian.net/browse/INT-1272

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_vfw.html#docs-vfw

 

Reviewers:

@Morgan Richomme @Bartek Grzybowski

 

 

2

Use Case: Residential Broadband vCPE (Approved)

vCPE Integration Test Case

Intel / Windriver

@Brian Freeman

@Bartek Grzybowski

infra-PASS

bng - PASS

gmux - PASS

ResCust - distribute PASS

ResCust - tunnel-xconn-assign - PASS

               tunnel-xconn- create - PASS

               vnf and vfmodule  create PASS

             brg-tunnel config  - PASS

             Traffic Flows - PASS

Closed-Loop - gmux → ves → tca → policy - PASS

   Policy → AAI, Policy → APPC , APPC →  Openstack PASS

 

COMPLETED

 

vcpe.py tooling issues

 

Looks like

Error messages back from APPC despite successful restart of VM

 

 

https://lf-onap.atlassian.net/browse/SO-2351

https://lf-onap.atlassian.net/browse/SO-2354

https://lf-onap.atlassian.net/browse/SO-2375

https://lf-onap.atlassian.net/browse/INT-1265

https://lf-onap.atlassian.net/browse/SO-2401

https://lf-onap.atlassian.net/browse/SDNC-939

https://lf-onap.atlassian.net/browse/SDNC-940

https://lf-onap.atlassian.net/browse/INT-1323

https://lf-onap.atlassian.net/browse/INT-1324

 

 

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_vCPE.html#docs-vcpe

 

Reviewers:

@Haibin Huang (Deactivated) @Marcin Przybysz

 

3

vCPE with TOSCA

vCPE(tosca) with HPA - Integration test cases

Intel / Windriver

@Haibin Huang (Deactivated)

@Yan Yang

 

All test cases have been passed for supporting ovp tosca vnf validation and the following test is triggered by CLI in windriver lab

  1. service design - PASS

  2. service distribute -PASS

  3. NS/VNF package onboardding -PASS

  4. NS create/instantiate - PASS

  5. NS terminate/delete- PASS

PASS

 

 

 

 

 

 

 

 

 

 

4

5G - Realtime PM and High Volume Stream Data Collection

5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases

Intel / Windriver

@Marcin Przybysz @marekPL

PASS

e2e scenarios passed on sb00

CSIT passed in release-daily

 

 

 

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_5g_rtpm.html#docs-realtime-pm

 

Reviewers

@FREEMAN, BRIAN D  @Rahul Tyagi

Minor Edit otherwise looks good.

https://gerrit.onap.org/r/#/c/integration/+/97217/

 

 

5

5G - PNF PnP

5G - PNF PnP - Integration Test Cases

Intel / Windriver

@Marcin Przybysz @Krzysztof Kuzmicki

PASS

e2e scenario passed on sb00

 

 

https://lf-onap.atlassian.net/browse/SO-2289

https://lf-onap.atlassian.net/browse/SO-2349

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_5g_pnf_pnp.html#docs-5g-pnf-pnp

 

Reviewers

@Marco Platania @Former user (Deleted)

 

6

 5G - Bulk PM

5G - Bulk PM - Test Status

Intel / Windriver

SB-02

@Former user (Deleted) @liam burke

 

E/// lab

Completed

 

 

https://lf-onap.atlassian.net/browse/INT-1296

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_5G_Bulk_PM.html#docs-5g-bulk-pm

Reviewers

@Marek Kukulski @Eric Moore

 

7

5G - Configuration with NETCONF

5G - PNF Configuration via Netconf - Test Status

Intel/

Windriver

@Rahul Tyagi

@Eric Moore

@Raj Gumma

Manual test

Completed

CSITs are also passing which test this usecase for SOsim-> Blueprint-processor -> SDNC -> PNFsim. link is https://jenkins.onap.org/job/usecases-master-csit-config-over-netconf/.

 

 

 

https://lf-onap.atlassian.net/browse/SO-2349

Testing completed on windriver SB00 

with image versions

SO-bpmn : 1.5.3

Blueprint processor : 0.6.4-STAGING-latest

sdnc-image:1.7.3

prh-app-server:1.3.1

vescollector:1.4.5

 

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_5G_Configuration_over_NETCONF.html#docs-5g-configuration-over-netconf

 

Reviewers

@Krzysztof Kuzmicki @Swaminathan Seetharaman

 

8

5G - PNF Pre-Onboarding & Onboarding

 

5G - Preonboarding/Onboarding - Test Status

Intel / Windriver

PNF Preonboarding (VNF SDK):

@Marcin Przybysz

@Krzysztof Kuzmicki

@Dermot Melia

PNF Onboarding (SDC):

@Andy Walshe

Preonboarding PASS

Manual test case using

PNF-POB-OB-3  (5G - PNF E2E Pre-Onboarding & Onboarding Integration Test Cases)

 

 

 

 

 

 

9

5G - OOF and PCI 

5G - OOF and PCI - Integration Test Cases

Windriver

@Swaminathan Seetharaman

@krishna moorthy

 

 

 

 

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_5G_oof_pci.html#docs-5g-oof-pci

 

Reviewers

@liam burke @Dermot Melia

 

10

Scale Out

Scale Out - Integration Test Cases and Status

Intel / Windriver

@Scott Blandford, @Marco Platania

Retesting using the latest released images.

Manual scale out

Completed

Automated (closed-loop based) scale out: 

Completed

 

 

Manual scale out: it works with direct call to SO APIs. There is an issue with VID that will be addressed in Frankfurt as it requires to rearchitect the current approach: https://lf-onap.atlassian.net/browse/VID-659

 

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_scaleout.html#docs-scaleout

 

Reviewers

@Eric Multanen (Deactivated) @Lukasz Rajewski

 

11

CCVPN

CCVPN Integration Test Cases

CMCC

@Yan Yang

Regression test for service  creation, service change

service creation - PASS

service change  -PASS

service deletion - PASS

PASS

 

 

 

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn


Reviewers

@Andy Walshe @Itohan Ukponmwan (Deactivated)

 

12

HPA vFW/vDNS

vFW/vDNS HPA Testing

(Test Plan 1 in

HPA & Cloud Agnostic Intent - R3 Test Plan)

Intel / Windriver

@Itohan Ukponmwan (Deactivated)

@Eric Multanen (Deactivated)

Completed

 

 

 

Service instance creation fails because of error that occurs in homing. This bug is currently blocking further testing. A workaround for the SO bug has been created. See the SO bug for details.

 

Now seeing another blocking error in OOF, also blocking service instance creation. 

 

D

https://lf-onap.atlassian.net/browse/SDC-2588

https://lf-onap.atlassian.net/browse/SO-2378

https://lf-onap.atlassian.net/browse/OPTFRA-598

https://lf-onap.atlassian.net/browse/OPTFRA-608

 

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_vfwHPA.html#docs-vfw-hpa

 

Reviewers

@Scott Blandford @Ajay Mahimkar

 

 

13

Change Management - Flexible Designer & Orchestrator

Steps:

1) Designing custom workflows with Workflow Designer

2) Distributing custom workflows to SO

3) Deploying the custom workflow in SO

4) Sending workflow metadata to VID

5) Triggering custom workflow execution from VID

6) Executing custom workflows in SO

Intel / Windriver

@Ajay Mahimkar

@Elena Kuleshov

@Chris Rapposelli-Manzo

El Alto Test Complete

Work arounds for some functionality.

Remaining functions deferred to Frankfurt

 

1) Complete

2) 90% Complete

3) Complete

4) 85% Complete

5) Complete

6) 80% Complete In-Progress. 9 Building Blocks successfully tested (Check, Set & Unset Maintenance Flags, Check, Set, and Unset Closed Loop Disabled Flag, Lock & Unlock vNF, and End Workflow.). PauseforManual testing in-progress.

 

 

 

https://lf-onap.atlassian.net/browse/SDC-2541

https://lf-onap.atlassian.net/browse/VID-671

(671 upgraded from medium 10/7)

https://lf-onap.atlassian.net/browse/VID-672

(672 upgraded from medium 10/7)

https://lf-onap.atlassian.net/browse/SO-2403https://lf-onap.atlassian.net/browse/SO-2434https://lf-onap.atlassian.net/browse/SO-2433https://lf-onap.atlassian.net/browse/SO-2441https://lf-onap.atlassian.net/browse/VID-675

https://lf-onap.atlassian.net/browse/SO-2482

 

 

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_CM_flexible_designer_orchestrator.html#docs-cm-flexible-designer-orchestrator

 

Reviewers

@Morgan Richomme@Yan Yang

 

14

Traffic Distribution

Change Management Dublin Extensions

Steps:

1) Instantiation of vFWDT

2) Configuration of OOF Policies for vFWDT

3) Execution of OSDF/HAS requests for data collection

4) Configuration of VNF profiles in CDT

5) Configuration of Ansible Server

6) Execution of TD workflow

 

Intel / Windriver

@Lukasz Rajewski

 

1) PASS

2) PASS

3) PASS

4) PASS

5) PASS

6) PASS

Retesting using the latest released immages.

 

Progressing 100%

 

2) Possible only on Chrome Browser

Ansible 0.4.4

APPC 1.6.4

https://lf-onap.atlassian.net/browse/PORTAL-760

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_vFWDT.html#docs-vfw-traffic

 

Reviewers

@Ruchira Agarwal @Elena Kuleshov

 

15

Change Management - 5G PNG Software Upgrade

Change Management - 5G PNF Software Upgrade Integration Test Status

Intel / Windriver

@wangyaoguang

@Ruchira Agarwal

 

Regression Testing for LCM:upgrade-pre-check/upgrade-software/upgrade-post-check/rollback(No Change in el alto)

Completd 100%  @Enbo Wang @wangyaoguang

 

 

 

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_5G_PNF_Software_Upgrade.html#docs-5g-pnf-software-upgrade

 

Reviewers

@Jerry Flood @Chris Rapposelli-Manzo

 

16

Change Management - Schedule Optimization

 

Intel / Windriver

@Ajay Mahimkar

@Jerry Flood

Completd 100%

  • Manually run the ETE tests locally before merging changes. (Done)

  • Manually run the ETE test suite in Windriver SB-xx with AAF enabled when merging changes (Done)

  • The integration test team has HC test for all components, so that is automatically covered.  This is waiting on RC0 availability and an OOM change that has been in the pipeline waiting for RC0 for months

  • The ETE test suite also runs in CSIT and Sonar jobs with AAF disabled. (In progress)

  • Manually run the ETE tests in the IT Release Daily with AAF enabled.  (Waiting on RC0)

 

 

https://lf-onap.atlassian.net/browse/OPTFRA-592

https://gerrit.onap.org/r/#/c/oom/+/96405/

https://docs.onap.org/en/elalto/submodules/integration.git/docs/docs_CM_schedule_optimizer.html#docs-cm-schedule-optimizer

 

Reviewers

@David Perez Caparros @krishna moorthy

 

17

BBS Broadband Service Use Case (Dublin)

BBS Use Case Tracking (Dublin Release)#Testing

BBS Swisscom Lab

@David Perez Caparros