Category: External System Registration
V00001: WindRiver OpenStack VIM Registration
...
Test Case Id | V00006 |
Test Case Name | Vendors' EMSs Registration |
Description | Register all VNF vendors' EMSs |
Release | Amsterdam |
Preconditions | - All VNF vendor's EMS have been installed and configured
|
Testing Steps | - Register all vendors' EMSs using ONAP ESR GUI with the needed information (IP, port, authentication information, etc)
|
Expected Results | - All EMSs are registered successfully with ONAP
- All EMSs information is stored correctly in ONAP
|
Actual Results |
|
Conclusion (Pass/Fail) |
|
Testing Lab | CMCC OpenLab |
Tester Name |
|
Category: VNF Onboarding and Service Creation
V00007: VoLTE VNFs Onboarding
...
V00010: WAN Service Creation (need update - WAN service only has properties, but keep overlay and underlay services seperate?)
Test Case Id | V00010 |
Test Case Name | WAN Service Creation |
Description | This test creates WAN service using SDC |
Release | Amsterdam |
Preconditions | - All PNFs (PE, DC gateway) resources have been defined in SDC
- All required network connection types (VLAN, BGP MPLS L3VPN, VXLAN, etc) are defined in SDC
|
Testing Steps | - In SDC create a new WAN service
- In service composition, pull in 2 PE routers, namely PE1 and PE2
- In service composition, pull in 2 data center gateways, namely DC GW1 and DC GW2
- Create underlay network as following:
- DC GW1 → PE1 as vlan
- DC GW2 → PE2 as vlan
- PE1 → PE2 as BGP MPLS L3VPN
- Create overlay network DC GW1 → DC GW2 as VXLAN
|
Expected Results | - Underlay WAN network created successfully
- Overlay WAN network created successfully
|
Actual Results |
|
Conclusion (Pass/Fail) |
|
Testing Lab | CMCC OpenLab |
Testing Date |
|
Tester Name |
|
...
Test Case Id | V00012 |
Test Case Name | Closed loop configuration |
Description | This test uses CLAMP to configure closed loop for VoLTE. There are 4 configurations: - Provisional rules for Policy
- Correlation rules for Holmes
- Holmes microservice Blueprint for DCAE
- VES configuration?
|
Release | Amsterdam |
Preconditions | - DCAE template has been imported (R1 SDC doesn't support DCAE template design)
- Holmes blueprint has been imported
- Holmes correlation rules have been defined
|
Testing Steps | - In CLAMP, choose VNF SPGW and events (VNF Fault and VM Fault) to monitor
- Bring up CLAMP configuration policy GUI and copy Holmes correlation rules in it
- Bring up CLAMP provisional policy GUI and define healing provisional policy
- Save the configuration
|
Expected Results | - Closed loop template and blueprint for Holmes are distributed to DCAE
- Configuration policy has been distributed to DCAE
- Provisional policy has been distributed to Policy engine
|
Actual Results |
|
Conclusion (Pass/Fail) |
|
Testing Lab | CMCC OpenLab |
Testing Date |
|
Tester Name |
|
Category: Service Instantiation and Monitoring
V00013: VoLTE Service Instantiation
Test Case Id | V00013 |
Test Case Name | VoLTE Service Instantiation |
Description | This test covers the whole VoLTE service instantiation process |
Release | Amsterdam |
Preconditions | - VoLTE service has been created, V00011 has passed
- Closed loop has been configured, V00012 has passed
- PEs have been configured and integrated with corresponding SDN WAN controller
- DC GWs have been configured and integrated with corresponding SDN local controller
|
Testing Steps | - ONAP user uses Usecase UI GUI to start VoLTE service instantiation
- Usecase UI will guide the user to deploy each of vEPC VNFs. User needs to choose data center location for each VNF and fill in input parameters defined in TOSCA template
- Usecase UI will guide the user to deploy each of vIMS VNFs. User needs to choose data center location for each VNF and fill in input parameters defined in TOSCA template
- Usecase UI will guide the user to deploy WAN service. User needs to input necessary PEs and DC GWs info, fill in WAN underlay and overlay parameters
|
Expected Results | - vEPC service is instantiated successfully, including all vEPC VNFs and VLs
- vIMS service is instantiated successfully, including all vIMS VNFs and VLs
- WAN service is instantiated successfully, including underlay and overlay networks
- Holmes analytics container is brought up correctly by DCAE
|
Actual Results |
|
Conclusion (Pass/Fail) |
|
Testing Lab | CMCC OpenLab |
Testing Date |
|
Tester Name |
|
V00014: System Performance and Alarm Monitoring
Test Case Id | V00014 |
Test Case Name | System Performance and Alarm Monitoring |
Description | This test uses Usecase UI GUI to monitor system performance and event |
Release | Amsterdam |
Preconditions | - VoLTE service has been instantiated
- Closed loop for VoLTE has been configured and started
|
Testing Steps | - ONAP user uses Usecase UI GUI to check system performance, such as CPU, memory and disk usage
- ONAP user views the VNF alarms collected by ONAP
|
Expected Results | - System performance (including system CPU, memory and disk usage) is shown on ONAP Usecase UI GUI
- VNF alarms, specified in CLAMP for the closed loop, are shown in Usecase UI GUI
|
Actual Results |
|
Conclusion (Pass/Fail) |
|
Testing Lab | CMCC OpenLab |
Testing Date |
|
Tester Name |
|
Category: Closed Loop
V00015: VoLTE Auto-healing
Test Case Id | V00014V00015 |
Test Case Name | VoLTE Auto-healing |
Description | This test covers the closed loop with alarm correlation and auto-healing |
Release | Amsterdam |
Preconditions | - VoLTE service has been instantiated
- VoLTE closed loop has been configured and started
- SPGW VNF supports event generation
- VNF guest OS supports event generation
- MultiVIM supports event collection from guest OS and event forwarding
|
Testing Steps | - Use Robot test script to shutdown standby MPU VM inside SPGW VNF
|
Expected Results | - EMS collects standby MPU offline event from SPGW VNF and sends the event to VFC
- MultiVIM doesn't receive heartbeat event from standby MPU guest OS for a period of time and triggers alarm which is sent to DCAE VES collector
- Holmes receives MPU offline events
- Holmes receives MPU guest OS heartbeat missing events
- Holmes does correlation of the two types of events and generate one signature event and sends it to Policy
- Policy triggers provisional policy and healing action is sent to VFC
- VFC uses SVNFM driver to heal standby MPU VM
- Standby MPU is healed
- Clear event is sent from SPGW VNF about standby MPU back online
- Heartbeat from standby MPU VM is received by MultiVIM and clear event is sent by MultiVIM about heartbeat recovery
- Holmes does the event correlation and sends Clear signature event to Policy
- Policy stops the healing action
|
Actual Results |
|
Conclusion (Pass/Fail) |
|
Testing Lab | CMCC OpenLab |
Testing Date |
|
Tester Name |
...
Category: Service Termination
V00016: VoLTE Service Termination
Test Case Id | V00015V00016 |
Test Case Name | VoLTE Service Termination |
Description | This test covers VoLTE service termination process |
Release | Amsterdam |
Preconditions | - VoLTE service has been created
- Closed loop has been configured and started
- PEs have been configured and integrated with corresponding SDN WAN controller
- DC GWs have been configured and integrated with corresponding SDN local controller
|
Testing Steps | - ONAP user uses Usecase UI GUI to remove VoLTE service
|
Expected Results | - Closed loop is stopped
- vEPC service is removed successfully, including all vEPC VNFs and VLs
- vIMS service is removed successfully, including all vIMS VNFs and VLs
- WAN service is removed successfully, including underlay and overlay networks
- Holmes analytics container is removed by DCAE
- Closed loop related artifacts (including DCAE template, configurational policy and provisional policy, DG, workflows) are removed from ONAP
|
Actual Results |
|
Conclusion (Pass/Fail) |
|
Testing Lab | CMCC OpenLab |
Testing Date |
|
Tester Name |
|
...