Z-ARCHIVE: El Alto Early Drop Integration Testing Status



Early Drop testing will focus on automated testing via robot and other test scripts. We will not have 100% coverage but should have enough sanity testing to confirm the changes for El Alto have not  created  breakage.

El Alto Early Drop was cancelled due to schedule issues that stemmed from the environment , self-release process and CLA changes that impacted the delivery teams.

Focus will be on the El Alto Release.



Color Guide

For 2019-08-01 - ONLY Completed items should be green. 

Completed

Progressing >= 90%

Progressing <90%

#



Use Case

Functional Requirement

Nonfunctional Requirement

Test Cases

Lab

Integration Test Lead

Status

(remaining days of effort)

Video URL

Detailed Test Status

Quick Notes

#



Use Case

Functional Requirement

Nonfunctional Requirement

Test Cases

Lab

Integration Test Lead

Status

(remaining days of effort)

Video URL

Detailed Test Status

Quick Notes

1

vFW

Model Driven Control Loop Design 

vFW



(vDNS is part of scale out use case below #10)



Intel / Windriver

@Brian Freeman / @Marco Platania

Onboard - PASS

Instantiate - PASS (dublin SO)

closedloop - pending APPC/AAF patch







https://lf-onap.atlassian.net/browse/DMAAP-1272

https://lf-onap.atlassian.net/browse/SO-2229

https://lf-onap.atlassian.net/browse/SO-2228

https://lf-onap.atlassian.net/browse/SDNC-855

https://lf-onap.atlassian.net/browse/OOM-2060

AAF-942: APPC is not able to get perm with AAF 2.1.15Closed



2

Use Case: Residential Broadband vCPE (Approved)

vCPE Integration Test Case

Intel / Windriver

@Brian Freeman

Onboard & Instantiate

Infra - PASS

vBNG - PASS

vGMUX -PASS

vBRG - PASS

RestCustService - PASS

Closed Loop:

Pending





Dublin SO

vcpe.py infra succeeds

distributevCPEResCust

AAI-2582: vcpe_res_cust model distribution failsClosed

3

vCPE with TOSCA

vCPE(tosca) with HPA - Integration test cases

Intel / Windriver

@Haibin Huang

@Yan Yang



Unlikely



















4

5G - Realtime PM and High Volume Stream Data Collection

5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases

Intel / Windriver

@Marcin Przybysz @marekPL

Planned

(hv-ves ete script)







5

5G - PNF PnP

5G - PNF PnP - Integration Test Cases

Intel / Windriver

@Marcin Przybysz @Krzysztof Kuzmicki

Planned

Heat and Tosca







6

 5G - Bulk PM

5G - Bulk PM - Test Status

Intel / Windriver

SB-02

@Former user (Deleted)



CSIT - Automated Test - PASS





https://jenkins.onap.org/view/CSIT/job/usecases-master-csit-5G-bulkpm/

7

5G - Configuration with NETCONF

5G - PNF Configuration via Netconf - Test Status

Intel/

Windriver

@Rahul Tyagi

@Eric Moore

@Raj Gumma



Planned

Will run automation test for configuration-via-netconf after changing image versions of El-Alto release

With PnP+Conf-over-Netconf manual testing is planned











8

5G - PNF Pre-Onboarding & Onboarding



5G - Preonboarding/Onboarding - Test Status

Intel / Windriver

PNF Preonboarding (VNF SDK):

@Marcin Przybysz

@Krzysztof Kuzmicki

@Dermot Melia

PNF Onboarding (SDC):

@Andy Walshe

Planned









9

5G - OOF and PCI 

5G - OOF and PCI - Integration Test Cases

Windriver

@Swaminathan Seetharaman

@krishna moorthy

N/A





No automation done yet, and not planned for El Alto. We will be doing some manual tests.

10

Scale Out

Scale Out - Integration Test Cases and Status (vLB)

Intel / Windriver

@Scott Blandford, @Marco Platania

Scale out with manual trigger and preload works.

Planned test for closed-loop-based scale out



Progress: 50%

Closed-loop-based scale out test waiting for:

SDNC-872: SDNC not handling CSAR packages with Policy modelsClosed

CDS installation procedure to be completed

CLAMP to onboard new GUI (not a blocker)



11

CCVPN

CCVPN Integration Test Cases

CMCC

@Yan Yang

Hardware required not known if in ED testing scope









12

HPA vFW/vDNS

vFW/vDNS HPA Testing

(Test Plan 1 in

HPA & Cloud Agnostic Intent - R3 Test Plan)

Intel / Windriver

@Itohan Ukponmwan (Deactivated)

@Eric Multanen

Planned







13

Change Management - Flexible Designer & Orchestrator

Steps:

1) Designing custom workflows with Workflow Designer

2) Distributing custom workflows to SO

3) Deploying the custom workflow in SO

4) Sending workflow metadata to VID

5) Triggering custom workflow execution from VID

6) Executing custom workflows in SO

Intel / Windriver

@Ajay Mahimkar

@Elena Kuleshov

@pagarwal

@Chris Rapposelli-Manzo



Most likely







14

Traffic Distribution

Change Management Dublin Extensions

Steps:

1) Creating VNF profile using CDT

2) Designing custom workflows with Workflow Designer

3) Distributing custom workflows to SO

4) Deploying the custom workflow in SO

5) Sending workflow metadata to VID

6) Triggering custom workflow execution from VID

7) Executing custom workflows in SO

Intel / Windriver

@Lukasz Rajewski

@Michal Chabiera

@Tomek Osiński

@Ajay Mahimkar

@Elena Kuleshov

Brian to follow Lukasz

Onboard - PASS

Instantiate - PASS (Dublin SO)

ClosedLoop - Pending APPC / AAF Patch











15

Change Management - 5G PNG Software Upgrade

Change Management - 5G PNF Software Upgrade Integration Test Status

Intel / Windriver

@wangyaoguang

@Ruchira Agarwal



unlikely







16

Change Management - Schedule Optimization



Intel / Windriver

@Ajay Mahimkar

@Jerry Flood

unlikely







17

BBS Broadband Service Use Case (Dublin)

BBS Use Case Tracking (Dublin Release)#Testing

BBS Swisscom Lab

@David Perez Caparros @dbalsige

Requires Swisscom Lab







18

VSP Compliance Check within SDC (Dublin) - Phase 1

VSP Compliance Check within SDC - Integration Test Plan

Vodafone

@Prabhu Balan









19

K8S based Cloud Region Support - vFW Use case

Deploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud

intel / Windriver

@Akhila Kishore (Deactivated)

@Former user (Deleted)











20

K8S based Cloud Region Support - EdgeXFoundry Use case

Deploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud

Intel/ Windriver

@Akhila Kishore (Deactivated)

@Kiran













21

5G: Network Slicing Modeling



Amdocs

@Borislav Glozman









25

Improve our E2E Process Automation





@Eric Debeau

@Alexis de Talhouët

@A. Seaudi

@Yuriy Malakov

@Marco Platania

Planned

Abdel with automated robot







30

SOL 004 (VNF Package Security)

Ericsson, Intel / Windriver

@Samuli Kuusela

Possibly with PNF pre-onboarding







31

xNF communication security enhancements.

xNF communication security enhancements - Tests Description and Status



@Marcin Przybysz

Planned to add CSIT







34

HPA vIPsec

vIPsec HPA testing

Intel / Windriver

@ruoyu.ying

Planned







35

Health Checks for PODS

Percentage coverage of Health Checks for Running PODS

Integration

@FREEMAN, BRIAN D , @Sylvain Desbureaux









36

New Installation Tests in 3 labs



















Intel/Windriver





Planned











Orange





Planned











Ericsson Lab



Andrew Fenner

Planned











OWL ?





Brian to to talk to Tracy









Robot Keyword Testing



















init_robot





PASS











init





PASS











health





PASS





See below





eteHelm-k8.sh





46/49 PASS - release





Basic APPC Health Check | FAIL |

Basic CLAMP Health Check | FAIL |

Basic OOF-CMSO Health Check | FAIL |









healthdist





PASS (dublin SO)











instantiateVFWCL





PASS (dublin SO)











instantiateVFWDT





PASS (dublin SO)











distributeVCPEResCust





PASS











sdc-dcae-d





PASS











vcpe.py





init : PASS

infra: PASS

brg:

customer:

loop:













8/14/2019

SB-00 - oom-staging for testing 43/49 working. up to SDC model onboarding healthdist stage.

            cassandra config issue for SDC - re-deploying SDC ; Cassandra tuning for windriver with multiple clients ?

integration-staging-daily - day of testing

integration-release-daily  - day of testing



SB01/SB02 - shutdown for resources



Performance Infrastructure Tests (ORange) ?

          Can we run them in Windriver once a week  (weekend - a long suite of tests) - requires admin access

                    Openstack ?

                    Kuebernetes ? - smoke test ; full test

        1. Get an account with admin access dedicated to this function/small team

        2.  vSwitch tests ?

3. OPNFV testing package

a. FUNCTest

        b. shaker, vmtp, full templest , rally

c. vnf testing   to confirm openstack heat engine / infrastructure

d. Demo  ? next week 8/21 ?







Labs for Testing



Integration Team:

Integration-release-daily: this should be main lab for automated script testing

Integration-staging-daily: for patch testing in advance of updates to release-daily

Integration-SB00 - Main staging and our current most stable environement - hope to move work to SB04 by end of week.

Integration-SB04 - Main release testing for El Alto ED that needs to stay for a days for trouble shooting etc.

Orange to focus on oom:master release branch to push hard on getting that ready , now that everything planned has a release image in nexus3



Project Teams

Integration-Design (Available) :   SDC model onboarding and distribution

Integration-Instantiation (In Progress) :   VID instantiate to VNF deployed - DEFERRED

Integration-ClosedLoop (Available) :  VNF already instantiated. DCAE, Policy, AAI, APPC,SDNC  flows