Function Test Environment

Introduction

Function test is conducted to verify the functionality of the ONAP A1 Policy functions and other Non-RT RIC as well as the individual components.

A test engine and a number of test script is used as a foundation for the test environment. 

The test environment uses docker images both the Non-RT RIC components as well as for the the needed simulators (from OSC). The test scripts support execution both in docker and kubernetes environment.

The basic idea of function test is to run the ONAP A1 Policy functions, test the exposed interfaces, and verify their behaviour using simulators. The test engine and the test scripts controls the behaviour of the simulators but also use the exposed interfaces for test and monitoring. 

The test scripts are designed in a way so that the same script can be used for testing of the functionality in the master branch as well as previous release(s).

The majority of the test scripts test one or several aspects of the functionality but there is also test scripts for stability tests over longer period of time (currently 3 days max intensity test).

Test scripts/Test cases

The below table is a list of test cases. All scripts beginning with the letters "FTC" (Function Test Case) are considered test scripts to test functionality. The remaining test scripts are primarily used for demo purposes.

Test case

Policy

Slogan

Test case

Policy

Slogan

FTC1 

Policy

Sanity test, create service and then create, update and delete a policy using http/https and A1PMS REST with/without SDNC controller

FTC1_A1PMS_ADAPTER

Policy

Sanity test, create service and then create,update and delete a policy with A1PMS adapter using http/https and A1PMS REST with/without SDNC controller

FTC10  

Policy

Basic use case, register service, create/update policy, delete policy, de-register service using both STD and OSC interface while mixing REST

FTC100  

Policy

Full a1pms API walkthrough using a1pms REST and with/without SDNC A1 Controller

FTC110  

Policy

Testing of service registration timeouts and keepalive

FTC150  

Policy

Sample tests of the SDNC A1 controller restconf API using http/https (no a1pms)

FTC300 

Policy

Resync 10000 policies using OSC and STD interface

FTC310 

Policy

Resync of RIC via changes in the pushed config

FTC350 

Policy

Change supported policy types and reconfigure rics

FTC800  

Policy

Create 10000 policies in sequence using http/https and a1pms REST with/without SDNC controller

FTC805

Policy

A1PMS Create 10000 policies and restart, test polices persistency

FTC810

Policy

Repeatedly create and delete policies in each RICs for 24h (or configured number of days). Via a1pms REST and with SDNC using http or https

FTC850

Policy

Create/delete policies in parallel over a number of rics using a number of child process

FTC900

Policy

Preparation for test of the Control Panel and the Health Check app - populating a number of ric simulators with types and instances

PM_DEMO

Policy

Preparation demo setup  - populating a number of ric simulators with types and instances

ONAP_UC

Policy

ONAP Use case REQ-626

Note: All test scripts and the associated test environment setup for ONAP is currently jointly managed in the this repo, see subdir "test/auto.test".  New tests are added frequently so make sure to check out the repo.