--- Frankfurt Release Test Scope ---

5G Bulk PM "Control Plane"

Bulk PM "Control plane” in ONAP will manage PM

Support enabling configuration of PM jobs/subscriptions on xNFs
PM consumers can conveniently define PM subscriptions on (sub)network-level, thereby configuring PM on a set (small or large) of xNF instances in a single subscription. Different consumers to manage their own subscriptions, independently of each other.

Configuration aspects of the PMSH mS:

The PMSH mS is mainly configured via the configuration policy in CLAMP. The actual PM subscription is configured this way.
Post-deployment reconfiguration of the subscription/mS is also being considered, via different means (e.g. CLAMP or some new types of events on DMaaP). This can be reconfiguration of xNF filter or reconfiguration of the actual PM subscription (e.g. list of measurements).
PMSH probably also needs some additional basic configuration, e.g. which MR to connect to, which MR topics to listen and publish to.

Deployment:

Test environment requirements for the test cases:

xNF simulator for test cases: SFTP / FTPes capable server.
xNF is registered with ONAP:
- E.g. xNF able to produce data files and send VES fileReady events,
- E.g. xNF emulator able to produce 'fileReady' notification events including updated events, or a series or predefined VES events at periodic intervals.
- Sample data files for collection. E.g. 3gpp PM file(s)
DMaaP Message Router.
DCAE PMSH.
CLAMP
SDNC
A&AI
POLICY

JIRA / Confluence Link:

REQ-129 - Getting issue details... STATUS
5G Bulk PM in Frankfurt/R6

High Level End-to-End integration Testcases

#	Testcases	Status
Bulkpm_CL_01	Ensure an ONAP user can create an inactive PM Subscription for specified PNF through CLAMP GUI.	DEFERRED TO GUILIN
Bulkpm_CL_02	Ensure an ONAP can user create an active PM Subscription for specified PNF through CLAMP GUI.	DEFERRED TO GUILIN
Bulkpm_CL_03	Ensure a Network Function's PM Configuration is available on the Network Function Instance After an ONAP user activates an Inactive subscription.	PASS
Bulkpm_CL_04	Ensure a Network Function's PM Configuration is available on the Network Function Instance After an ONAP user creates an active subscription.	PASS
Bulkpm_CL_05	Ensure a subscription config is removed from a network function after an ONAP user deactivates a PM subscription.	PASS
Bulkpm_CL_06	Ensure an existing network function's PM configuration is applied for newly added PNF instances in ONAP if it matches NF filter criteria.	PASS
Bulkpm_CL_07	Ensure an un-deploy PM Subscription control loop removes corresponding network functions subscription from the node.	PASS
Bulkpm_CL_08	Ensure that removal of PNF from ONAP (A&AI), trigger the automatic removal of xNF from all the subscriptions it is currently included in.	PASS
Bulkpm_CL_09	Ensure that when a subscription filter matches multiple network functions of different NFType, multiple CBAs will be executed.	TODO
*	Ensure an ONAP can user create an active PM Subscription for specified VNF through CLAMP GUI.	STRETCH GOAL
*	Ensure that removal of VNF from ONAP (A&AI), trigger the automatic removal of xNF from all the subscriptions it is currently included in.	STRETCH GOAL
*	Ensure an ONAP can user create an inactive PM Subscription for specified VNF through CLAMP GUI.	STRETCH GOAL
*	Ensure an existing network function's PM configuration is applied for newly added VNF instances in ONAP if it matches NF filter criteria.	STRETCH GOAL
*	Ensure that ONAP user is able to modify PM Subscription configuration (e.g. add/remove PM counters, change granularity period, file location, etc) only when it is in inactive state)	STRETCH GOAL
*	Ensure that ONAP user is able to modify NF Filter in PM Subscription.	STRETCH GOAL

Bulk PM "Control Plane" E2E Sunny Day Scenario Sequence Diagram

Update Filter(Filter modification)

Update Filter(A&AI Event Processing)

Modify Measurement Parameters

Detailed Description End-to-End Feature Integration Testcases :

Test Case ID

Bulkpm_CL_01

Test Case Name Ensure an ONAP user can create an inactive PM Subscription for specified PNF through CLAMP GUI.

Description This test verify that once inactive pm subscription is deployed through CLAMP GUI, it is present in PMSH config in consul.

Release Frankfurt

Pre-conditions ONAP with SDNC,SDC,DMAAP,CLAM should be installed. PMSH Control Loop service exist in SDC.

Testing Steps

Steps Expected Result

Create PM Subscription with administrativeState": "LOCKED" in CLAMP and Deploy Control Loop.

Sample inactive configuration:

          {
            "subscriptionName": "B1000",
            "administrativeState": "LOCKED",
            "fileBasedGP": 15,
            "fileLocation": "c://PM",
            "measurementGroups": [
              {
                "measurementGroup": {
                  "measurementTypes": [
                    {
                      "measurementType": "attTCHSeizures"
                    },
                    {
                      "measurementType": "succTCHSeizures"
                    }
                  ],
                  "managedObjectDNsBasic": [
                    {
                      "DN": "RncFunction=RF-1,UtranCell=Gbg-998"
                    },
                    {
                      "DN": "RncFunction=RF-1,UtranCell=Gbg-500"
                    },
                    {
                      "DN": "RncFunction=RF-1,UtranCell=Gbg-100"
                    }
                  ]
                }
              }
            ]
          }

Bulk-pm Control Loop will be deployed. Following artifact will be created as a part of CL
1. PMSH service.
2. Monitory Policy distribution.

Confirm PM subscription is present in consul configuration of PMSH service.

Subscription info is present in consul config of PMSH.

Conclusion (Pass /Fail) Deferred to Guilin release

Automation ( Yes - link / No)

Testing Lab

///

Test Case ID

Bulkpm_CL_02

Test Case Name Ensure an ONAP can user create an active PM Subscription for specified PNF through CLAMP GUI.

Description This test verify that once inactive pm subscription is deployed through CLAMP GUI, it is present in PMSH config in consul.

Release Frankfurt

Pre-conditions ONAP with SDNC,SDC,DMAAP,CLAM should be installed. PMSH Control Loop service exist in SDC.

Testing Steps

Steps Expected Result

Create PM Subscription with administrativeState": "UNLOCKED" in CLAMP and Deploy Control Loop.

Sample inactive configuration:

          {
            "subscriptionName": "B1000",
            "administrativeState": "UNLOCKED",
            "fileBasedGP": 15,
            "fileLocation": "c://PM",
            "measurementGroups": [
              {
                "measurementGroup": {
                  "measurementTypes": [
                    {
                      "measurementType": "attTCHSeizures"
                    },
                    {
                      "measurementType": "succTCHSeizures"
                    }
                  ],
                  "managedObjectDNsBasic": [
                    {
                      "DN": "RncFunction=RF-1,UtranCell=Gbg-998"
                    },
                    {
                      "DN": "RncFunction=RF-1,UtranCell=Gbg-500"
                    },
                    {
                      "DN": "RncFunction=RF-1,UtranCell=Gbg-100"
                    }
                  ]
                }
              }
            ]
          }

Bulk-pm Control Loop will be deployed. Following artifact will be created as a part of CL
1. PMSH service.
2. Monitory Policy distribution.

Confirm an active PM subscription is present in consul configuration for PMSH service.

An active PM subscription info is present in consul config of PMSH.

Conclusion (Pass /Fail) Deferred to Guilin release

Automation ( Yes - link / No)

Testing Lab

///

Test Case ID

Bulkpm_CL_03

Test Case Name

Ensure a Network Function's PM Configuration is available on the Network Function Instance After an ONAP user activates an Inactive subscription.

Description

This test verify that onap user able to activate an existing inactive subscription.

Release

Frankfurt

Pre-conditions

Bulkpm_CL_01.

Testing Steps

Steps

Expected Result

User send PM subscription activation REST request to Policy fwk.

Policy will update PMSH PM subscription config in consul.

Confirm an active PM subscription is present in consul configuration for PMSH service and Network function instance has an active subscription.

Newly created PM subscription is present on network function instance ( pnf ) and pnf is generating PM files accordingly.

Conclusion (Pass /Fail)

Pass

Automation ( Yes - link / No)

No

Testing Lab

///

Test Case ID

Bulkpm_CL_04

Test Case Name Ensure a Network Function's PM Configuration is available on the Network Function Instance After an ONAP user creates an active subscription.

Description This test verify that once active pm subscription is deployed through CLAMP GUI, a network function's PM configuration is available on the Network Function Instance.

Release Frankfurt

Pre-conditions Bulkpm_CL_02.

Testing Steps

Steps Expected Result

Create PM Subscription with administrativeState": "UNLOCKED" in CLAMP and Deploy Control Loop.

Sample inactive configuration:

          {
            "subscriptionName": "B1000",
            "administrativeState": "UNLOCKED",
            "fileBasedGP": 15,
            "fileLocation": "c://PM",
            "measurementGroups": [
              {
                "measurementGroup": {
                  "measurementTypes": [
                    {
                      "measurementType": "attTCHSeizures"
                    },
                    {
                      "measurementType": "succTCHSeizures"
                    }
                  ],
                  "managedObjectDNsBasic": [
                    {
                      "DN": "RncFunction=RF-1,UtranCell=Gbg-998"
                    },
                    {
                      "DN": "RncFunction=RF-1,UtranCell=Gbg-500"
                    },
                    {
                      "DN": "RncFunction=RF-1,UtranCell=Gbg-100"
                    }
                  ]
                }
              }
            ]
          }

Bulk-pm Control Loop will be deployed. Following artifact will be created as a part of CL
1. PMSH service.
2. Monitory Policy distribution.

Confirm creation of PM subscription on network function instance.

Newly created PM subscription is present on network function instance ( pnf ) and pnf is generting

PM files accordingly.

Conclusion (Pass /Fail) Pass

Automation ( Yes - link / No) No

Testing Lab

///

Test Case ID

Bulkpm_CL_05

Test Case Name

Ensure a pm subscription is removed from a network function after an ONAP user deactivates a PM subscription.

Description

This test verify that once user send pm subscription deactivate request to policy fwk, PM subscription is deleted from network function.

Release

Frankfurt

Pre-conditions

Bulkpm_CL_03 or Bulkpm_CL_04

Testing Steps

Steps	Expected Result
User send PM subscription deactivation REST request to Policy fwk.	Policy will update PMSH PM subscription config in consul.
Confirm a inactive PM subscription is present in consul configuration for PMSH service and Network function instance has deleted corresponding pm subscription.	Network function (pnf ) deletes corresponding PM subscription.

Conclusion (Pass /Fail)

Pass

Automation ( Yes - link / No)

No

Testing Lab

///

Test Case ID

Bulkpm_CL_06

Test Case Name

Ensure an existing network function's PM configuration is applied for newly added PNF instances in ONAP if it matches NF filter criteria.

Description

This test verify that a PM subsumption is applied to newly added network function if it matches NF filter criteria.

Release

Frankfurt/Guilin

Pre-conditions

PM Subscription is active for NF criteria.

Testing Steps

Steps	Expected Result
Register a new network function (pnf) in ONAP.	Network function is added successfully to ONAP and it is available in A&AI.
Confirm that if newly added network function matches NF Filter criteria in PMSH then corresponding PM Subscription is applied to network function.	PM Subscription is created in network function.

Conclusion (Pass /Fail)

Pass

Automation ( Yes - link / No)

No

Testing Lab

///

Test Case ID

Bulkpm_CL_07

Test Case Name

Ensure an un-deploy PM Subscription control loop removes corresponding network functions subscription from the node.

Description

This test verify that when user un-deploy the PM subscription control loop , it also remove corresponding network function pm subscription.

Release

Frankfurt

Pre-conditions

Bulkpm_CL_01

Testing Steps

Steps	Expected Result
Un-deploy existing PM subscription control loop.	PM subscription control loop deployment is gone and also associated pmsh service and policy distribution also deleted.
Confirm network function doesn't have corresponding PM subscription.	Corresponding PM subscription is not present in Network function ( pnf )

Conclusion (Pass /Fail)

Pass

Automation ( Yes - link / No)

No

Testing Lab

///

Test Case ID

Bulkpm_CL_08

Test Case Name

Ensure that removal of PNF from ONAP (A&AI), trigger the automatic removal of network function from all the subscriptions it is currently included in.

Description

This test verify that if user remove pnf from ONAP ( A&AI) , then PM subscription control loop will automatically deactivate pm subscription for corresponding network function.

Release

Frankfurt

Pre-conditions

Bulkpm_CL_03 or Bulkpm_CL_04

Testing Steps

Steps	Expected Result
Remove network function (pnf) from the ONAP ( A&AI)	Network function ( pnf ) is removed from A&AI.
Confirm that PM subscription control loop deactivate subscription for corresponding network function (pnf).	Network function doesn't have corresponding PM subscription.

Conclusion (Pass /Fail)

Pass

Automation ( Yes - link / No)

No

Testing Lab

///

Test Case ID

Bulkpm_CL_09

Test Case Name

Ensure that when a subscription filter matches multiple network functions of different NFType, multiple CBAs will be executed.

Description

This test verifies that if multiple network functions need to have a subscription applied, that the correct CBA is executed for the corresponding NFType.

Guilin

Pre-conditions

Bulkpm_CL_02

Testing Steps

Steps	Expected Result
Add 2 network functions to ONAP that are of different NFType	Network function ( pnf ) is added to A&AI.
Create subscription with filter that will match both NFs	Both NFs have subscription applied

Conclusion (Pass /Fail)

Pass

Automation ( Yes - link / No)

No

Testing Lab

///