Integration Testing
...
Pair-wise testing
S.No. | Test case ID | Components | Test case | Impacted APIStatus | Status |
---|---|---|---|---|---|
5 | PCI-Handler MS, OOF | Request for PCI optimization for network region. PCI-Handler MS invokes OOF for pre-defined workflow for PCI Optimization via REST API.This call includes data for the cell and the network reqion involved. | Ensure that PCI-Handler-MS applies configuration policies, processes configuration changes in steps 4a,4b, and sends a message to OO (Pre-requisite is step 2 is tested) | <API details> | Not tested |
6 | OOF, Policy | Fetch PCI optimization policies OOF fetches policies that specify how OOF will execute PCI optimization in response to PCI request for optimization | Ensure that OOF can fetch optimization policies from Policy, and applies it to invoke the appropriate solver module | <Policy API details> | Not tested |
7 | OOF, SDN-C | Fetch Config data for cells in the region. OOF fetches data for cells in network region from SDN-C | Ensure that OOF can query SDN-C to get required data (e.g. cellids, nbr_list, pci, lat/lon) from SDN-C Config DB | <Config DB API details> | Not tested | 9 | PCI-Handler MS, Policy | Recommended PCI configuration. PCI-Handler-MS provides PCI recommendation to Policy | Ensure that PCI-Handler-MS sends a message to Policy with recommendation for new PCI values for set of cells, along with reason for oprimization computation (RAN config change) | Not tested | 10 | Policy, SDN-C | PCI Configuration decisions Policy sends message to SDN-C with instruction for configuration changes | Ensure that Policy applies operational policies to PCI change recommendation, and if appropriate, sends a message to SDN-C with instruction to change PCI value to set of cells | Not tested |
Pair-wise testing
Test case ID | Components | Test case | Status | |||
---|---|---|---|---|---|---|
POLICY_OOF_PAIRWISE_001 | Policy, OOF | (Initial) Configuration of OOF | Not tested | |||
POLICY_PCIMS_PAIRWISE_001 | Policy, PCI-MS | (Initial) Configuration of PCI-MS | Not tested | |||
1. | POLICY_OOF_PAIRWISE_001 | Policy, OOF | (Initial) Configuration of OOF | Not tested | ||
2. | POLICY_PCIMS_PAIRWISE_001 | Policy, PCI-MS | (Initial) Configuration of PCI-MS | Not tested | ||
3. | SDNR_RAN_PAIRWISE_001 | SDN-R, RAN (Sim) | Connecting SDN-R with RAN (Sim) (netconf servers) | Not tested | ||
4. | SDNR_RAN_PAIRWISE_002 | SDN-R, RAN (Sim) | Receiving neighbor list change notification from RAN | Not tested | ||
5. | SDNR_PCIMS_PAIRWISE_001 | SDN-R, PCI-MS | Handle neighbor list change notification from SDN-R | Not tested | ||
6. | SDNR_PCIMS_PAIRWISE_002 | SDN-R, PCI-MS | Config DB API access (for getNbrList) | Not tested | ||
7. | OOF_PCIMS_PAIRWISE_001 | OOF, PCI-MS | Request for PCI optimization | Not tested | ||
8. | OOF_SDNR_PAIRWISE_001 | OOF, SDN-R | Config DB API access (for getNbrList) | Not tested | ||
9. | OOF_PCIMS_PAIRWISE_002 | OOF, PCI-MS | PCI optimization result | Not tested | ||
10. | SDNR_PCIMS_PAIRWISE_003 | SDN-R, PCI-MS | Config DB API access (for pnfName) | Not tested | ||
11. | POLICY_PCIMS_PAIRWISE_002 | Policy, PCI-MS | Sending DMaaP message by PCI-MS to Policy | Not tested | ||
12. | POLICY_SDNR_PAIRWISE_001 | Policy, SDN-R | Invoking control loop in Policy | Not tested | ||
13. | SDNR_RAN_PAIRWISE_003 | SDN-R, RAN (Sim) | Connecting SDN-R with RAN (Sim) (netconf servers)Send netconf message(s) to RAN-Sim with the PCI changes | Not tested | ||
14. | SDNR_RAN_PAIRWISE_ | 002004 | SDN-R, RAN (Sim) | Receiving neighbor list change notification from RANSuccessful update of PCI values | Not tested | SDNR_PCIMS
Test Case ID |
| SDN-R, PCI-MS | Handle neighbor list change notification from SDN-R | Not tested | |
SDNR_PCIMS_PAIRWISE_002 | SDN-R, PCI-MS | Config DB API access (for getNbrList) | Not tested | ||
| |||||
Test Case Name | Configuration of OOF | , PCI-MSRequest for PCI optimization | Not tested | ||
OOF_SDNR_PAIRWISE_001 | OOF, SDN-R | Config DB API access (for getNbrList) | Not tested | ||
OOF_PCIMS_PAIRWISE_002 | OOF, PCI-MS | PCI optimization result | Not tested | ||
SDNR_PCIMS_PAIRWISE_003 | SDN-R, PCI-MS | Config DB API access (for pnfName) | Not tested | ||
POLICY_PCIMS_PAIRWISE_002 | Policy, PCI-MS | Sending DMaaP message by PCI-MS to Policy | Not tested | ||
POLICY_SDNR_PAIRWISE_001 | Policy, SDN-R | Invoking control loop in Policy | Not tested | Test Case ID | |
Anchor | POLICY_OOF_PAIRWISE_001 | POLICY_OOF||||
---|---|---|---|---|---|
Description | Test if the OOF is onboarded and configuration policies are fetched and loaded correctly (Step 1c of flow) | ||||
Release | Casablanca | ||||
Pre-conditions | (a) Policy module is onboarded. (b) Config policies related to OOF are provisioned properly in Policy module. | ||||
Testing Steps |
| ||||
Conclusion (Pass /Fail) | |||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
| ||||||
Test Case Name | Configuration of OOFPCI-MS | ||||||
Description | Test if the OOF PCI-MS is onboarded and configuration policies are fetched and loaded correctly (Step 1c 1b of flow) | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) Policy module is onboarded. (b) Config policies related to OOF PCI-MS are provisioned properly in Policy module. | ||||||
Testing Steps |
| ||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
| ||||||
Test Case Name | Configuration of PCI-MS Connecting SDN-R with RAN (netconf servers) | ||||||
DescriptionTest | if the PCI-MS is onboarded and configuration policies are fetched and loaded correctly (Step 1b of flow)Establish connection between SDN-R and RAN | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) Policy module is onboarded.SDN-R is up and running (b) Config policies related to PCI-MS are provisioned properly in Policy module. | Testing Steps | RAN initialization file is available | ||||
Testing Steps | Conclusion (Pass /Fail) | ||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine | Test Case ID | |||||
Anchor | SDNR_RAN_PAIRWISE_002 | SDNR_RAN_PAIRWISE_002 | SDNR_RAN_PAIRWISE_002|||||
---|---|---|---|---|---|---|---|
Test Case Name | Receiving neighbor list change notification from RAN | ||||||
Description | Receive a neighbor list change notification from RAN and act upon it by sending a DMaaP notification to PCI-MS (after storing relevant info in Config DB). | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) SDN-R is up and running (b) RAN is connected to SDN-R (c) GUI shows RAN topology view properly, GUI is able to show the details of a particular cell (PCI, neighbor list, CellId). | ||||||
Testing Steps |
| Conclusion (Pass /Fail) | |||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine | Test Case ID | |||||
Anchor | SDNR_PCIMS_PAIRWISE_001 | SDNR_PCIMS_PAIRWISE_001 | SDNR_PCIMS_PAIRWISE_001|||||
Test Case Name | Handle neighbor list change notification from SDN-RDescription | Handle neighbor list change notification from SDN-R and form a cell cluster.
| Conclusion (Pass /Fail) | ||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine | Test Case ID | |||||
Anchor | SDNR_RAN_PAIRWISE_001 | SDNR_RAN_PAIRWISE_001 | SDNR_RAN_PAIRWISE_001|||||
Test Case Name | Connecting SDN-R with RAN (netconf servers) | ||||||
Description | Establish connection between SDN-R and RAN | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) SDN-R is up and running (b) RAN initialization file is available | Testing Steps | |||||
Steps | Expected Result | ||||||
|
| ||||||
| |||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
| ||||||
Test Case Name | Receiving neighbor list change notification from RAN | ||||||
Description | Receive a neighbor list change notification from RAN and act upon it by sending a DMaaP notification to PCI-MS (after storing relevant info in Config DB). | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) SDN-R is up and running (b) RAN is connected to SDN-R (c) GUI shows RAN topology view properly, GUI is able to show the details of a particular cell (PCI, neighbor list, CellId). | ||||||
Testing Steps |
| ||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
| ||||||
Test Case Name | Handle neighbor list change notification from SDN-R | ||||||
Description | Handle neighbor list change notification from SDN-R and form a cell cluster. | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) PCI-MS has fetched the config policies successfully from the Policy module. (b) SDNR_RAN_PAIRWISE_002 has been completed, and neighbor list change notification has been received by SDN-R. | ||||||
Testing Steps |
| ||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
| ||||||
Test Case Name | Config DB API access | ||||||
Description | Test the working of Config DB APIs | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) PCI-MS has fetched the config policies successfully from the Policy module. (b) SDNR_RAN_PAIRWISE_002 has been completed, and neighbor list change notification has been received by SDN-R.(SDN-R) Config DB should be populated with the details of the cells in the network using the RAN initialization file. (c) SDNR_PCIMS_PAIRWISE_001 has been completed (if not, write some stub code in PCI-MS to do the ConfigDB query after initialization). | ||||||
Testing Steps |
| ||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
| ||||||
Test Case Name | Config DB API access | Description | Test the working of Config DB APIsRequest for PCI optimization | ||||
Description | Request for PCI optimization algorithm to be executed by OOF to address PCI collision/confusion | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) PCI-MS has fetched the config policies successfully from the Policy module. (b) (SDN-R) Config DB should be populated with the details of the cells in the network using the RAN initialization file. (c) SDNR_PCIMS_PAIRWISE_001 002 has been completed (if not, write some stub code otherwise some dummy code for REST API call to OOF to be written in PCI-MS to do the ConfigDB query after initialization). | ||||||
Testing Steps |
| Conclusion (Pass /Fail) | |||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine | Test Case ID | |||||
Anchor | OOF_PCIMS_PAIRWISE_001 | OOF_PCIMS_PAIRWISE_001 | OOF_PCI_PAIRWISE_001|||||
---|---|---|---|---|---|---|---|
Test Case Name | Request for PCI optimization | ||||||
Description | Request for PCI optimization algorithm to be executed by OOF to address PCI collision/confusion | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) PCI-MS has fetched the config policies successfully from the Policy module. (b) (SDN-R) Config DB should be populated with the details of the cells in the network. (c) SDNR_PCIMS_PAIRWISE_002 has been completed (otherwise some dummy code for REST API call to OOF to be written in PCI-MS). | ||||||
Testing Steps |
| ||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
| ||||||
Test Case Name | Config DB API access by OOF | ||||||
Description | Accessing Config DB APIs by OOF for PCI optimization algorithm execution | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) OOF has fetched the config policies successfully from the Policy module. (b) OOF_PCIMS_PAIRWISE_001 has been completed successfully (otherwise some dummy code for REST API call to Config DB to be written in OOF). | ||||||
Testing Steps |
| ||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
| ||||||
Test Case NameConfig DB API access | PCI optimization result reported by OOF to PCI-MS | ||||||
DescriptionAccessing Config DB APIs | PCI optimization result sent by OOF for PCI optimization algorithm executionto PCI-MS via REST call. | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) OOF has fetched the config policies successfully from the Policy module. (b) (SDN-R) Config DB should be populated with the details of the cells in the network. (c) OOF_PCIMS_PAIRWISE_001 has been completed successfully (otherwise some dummy code for REST API call to Config DB PCI-MS to be written in OOF). | ||||||
Testing Steps |
| ||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
| ||||||
Test Case Name | PCI optimization result reported by OOF to PCI-MS | Description | PCI optimization result sent by OOF to PCI-MS via REST call. Config DB API access | ||||
Description | Test the working of Config DB APIs (getPnfName) | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) OOF PCI-MS has fetched the config policies successfully from the Policy module. (b) (SDN-R) Config DB should be populated with the details of the cells in the network using the RAN initialization file. (c) OOF_PCIMS_PAIRWISE_001 002 has been completed (otherwise some dummy code for REST API call to if not, write some stub code in PCI-MS to be written in OOFdo the ConfigDB query). | ||||||
Testing Steps |
| ||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
|
|
|
|
|
POLICY_PCIMS_PAIRWISE_ |
002 |
Test Case Name |
Sending DMaaP message to Policy module with the PCI changes. |
Description |
Sending of DMaaP message (Topic: DCAE_EVENT_OUTPUT) by PCI-MS to Policy with the PCI changes | |
Release | Casablanca |
Pre-conditions | (a) PCI-MS has fetched the config policies successfully from the Policy module. (b) (SDN-R) Config DB should be populated with the details of the cells in the network using the RAN initialization file. (c) |
SDNR_PCIMS_PAIRWISE_ |
003 has been completed (if not, write some stub code in PCI-MS to |
send the |
DMaaP message). | |||
Testing Steps |
|
- For the list of cells (whose PCI values should be changed) received from OOF in the PCI-optimization result, PCI-MS does a query to the configDB using the getPnfName for obtaining the PNF names for those cells whose PNF names are not available in its local DB.
| ||
Conclusion (Pass /Fail) | ||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
|
|
|
|
|
SDNR_PAIRWISE_ |
001 |
Test Case Name |
Invoking the control loop in Policy | |
Description | Invoking the control loop and sending DMaaP message to |
SDN-R with the PCI changes. |
Description
Release
Casablanca
Pre-conditions
Release | Casablanca |
Pre-conditions | (a) Control Loop Policy is successfully loaded and configured in Policy module. (b) |
SDN-R |
is initialized, configured and connected to the RAN-Sim (netconf servers). (c) |
POLICY_PCIMS_PAIRWISE_ |
002 has been completed |
. | |||
Testing Steps |
|
|
|
|
| |
Conclusion (Pass /Fail) | |
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Test Case ID |
| ||||||
Test Case Name Invoking the control loop in Policy | Description | Invoking the control loop and sending DMaaP message to SDN-R with the PCI changes.Sending message(s) to RAN-Sim to update PCI values | |||||
Description | SDN-R sending netconf (edit-config) message(s) to RAN-Sim to update the PCI values | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) PCI-MS has fetched the config policies successfully from the Policy moduleSDN-R is initialized, configured and connected to the RAN-Sim (netconf servers). (b) (SDN-R) Config DB should be populated with the details of the cells in the network using the RAN initialization file.(c) SDNR_PCIMS_PAIRWISE_003 has been completed (if not, write some stub code in PCI-MS to send the DMaaP message)RAN-Sim is initialized and configured properly. (c) POLICY_SDNR_PAIRWISE_001 has been completed. (d) SDNR_RAN_PAIRWISE_002 has been completed. | ||||||
Testing Steps |
| ||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker MachineM |
Test Case ID |
| ||||||
Test Case Name | Acknowledgement of successful update of PCI values. | ||||||
Description | RAN-Sim sending success response to netconf (edit-config) message(s) to SDN-R. | ||||||
Release | Casablanca | ||||||
Pre-conditions | (a) SDN-R is initialized, configured and connected to the RAN-Sim (netconf servers). (b) RAN-Sim is initialized and configured properly. (d) SDNR_RAN_PAIRWISE_003 has been completed. | ||||||
Testing Steps |
| ||||||
Conclusion (Pass /Fail) | |||||||
Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker M |
Integration Testing
Use case Step | Component(s) | Functionality | Test case | Impacted API | Status |
---|---|---|---|---|---|
5 | PCI-Handler MS, OOF | Request for PCI optimization for network region. PCI-Handler MS invokes OOF for pre-defined workflow for PCI Optimization via REST API.This call includes data for the cell and the network reqion involved. | Ensure that PCI-Handler-MS applies configuration policies, processes configuration changes in steps 4a,4b, and sends a message to OO (Pre-requisite is step 2 is tested) | <API details> | Not tested |
6 | OOF, Policy | Fetch PCI optimization policies OOF fetches policies that specify how OOF will execute PCI optimization in response to PCI request for optimization | Ensure that OOF can fetch optimization policies from Policy, and applies it to invoke the appropriate solver module | <Policy API details> | Not tested |
7 | OOF, SDN-C | Fetch Config data for cells in the region. OOF fetches data for cells in network region from SDN-C | Ensure that OOF can query SDN-C to get required data (e.g. cellids, nbr_list, pci, lat/lon) from SDN-C Config DB | <Config DB API details> | Not tested |
9 | PCI-Handler MS, Policy | Recommended PCI configuration. PCI-Handler-MS provides PCI recommendation to Policy | Ensure that PCI-Handler-MS sends a message to Policy with recommendation for new PCI values for set of cells, along with reason for oprimization computation (RAN config change) | Not tested | |
10 | Policy, SDN-C | PCI Configuration decisions Policy sends message to SDN-C with instruction for configuration changes | Ensure that Policy applies operational policies to PCI change recommendation, and if appropriate, sends a message to SDN-C with instruction to change PCI value to set of cells | Not tested | |