Warning |
---|
Test update in progress for Guilin release and SO building block flow |
Gliffy | ||||
---|---|---|---|---|
|
Table of Contents |
---|
Link to specification:
5G - PNF Plug and Play
PNF PNP message flow diagram
Rainy day scenario - PNF is sending registration request to ONAP where required AAI entry is not present:
Gliffy | ||||
---|---|---|---|---|
|
Sunny day scenario - PNF is sending registration request to ONAP where required AAI entry is prepared by SO workflow:
Gliffy | ||||
---|---|---|---|---|
|
PNF PNP deployment diagram
Gliffy | ||||
---|---|---|---|---|
|
PNF PNP hardware requirements
- ONAP - standard ONAP instance located in Wind River lab
- 4 Virtual machines dedicated for PNF Simulator:
- 2 VCPU
- 8 GB of RAM
- 32 GB of HDD
PNF PNP test cases
High-Level descriptions
...
Verification if PNF resource registration is done properly when correct AAI record (based on correlationID) is present before first InventoryQuery is done by PRH.
Verification if AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on pnfRegistration message contents.
...
Verification if PNF resource registration is done properly when correct AAI entry is created after first InventoryQuery is done by PRH.
Verification if AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on pnfRegistration message contents.
...
Verification if PRH drops the PnfRegistration request when no AAI entry exists for the correlationID.
AAI entries shall not be created by PRH.
...
PNF registration accepted when AAI entry is created using AAI API (without SO instantiation)
...
Verification if PNF resource registration is done properly when correct AAI record (based on correlationID) is present - created using AAI API
Verification if AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on correlationID.
Detailed descriptions
...
Create and distribute service which contains PNF based on imported VSP
...
Verification if in VID is present PNF enabled service.
Test case covers following steps from message flow in 5G - PNF Plug and Play:
- STEP 1 RESOURCE DEFINITION
- STEP 2 SERVICE DEFINITION
- STEP 3 ARTIFACTS DISTRIBUTION
...
Robot init sucesfully executed. In intsalation server followin script shoulkd be sucesfully ececuted. ~/oom/kubernetes/robot/demo-k8s.sh onap init
Code Block | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
ubuntu@onap-5915-rke-node:~$ ~/oom/kubernetes/robot/demo-k8s.sh onap init
Number of parameters:
2
KEY:
init
++ kubectl --namespace onap get pods
++ sed 's/ .*//'
++ grep robot
+ POD=dev-robot-6d67844b64-pgbx5
++ dirname ./demo-k8s.sh
+ DIR=.
+ SCRIPTDIR=scripts/demoscript
+ ETEHOME=/var/opt/ONAP
+ '[' ']'
++ kubectl --namespace onap exec dev-robot-6d67844b64-pgbx5 -- bash -c 'ls -1q /share/logs/ | wc -l'
+ export GLOBAL_BUILD_NUMBER=0
+ GLOBAL_BUILD_NUMBER=0
++ printf %04d 0
+ OUTPUT_FOLDER=0000_demo_init
+ DISPLAY_NUM=90
+ VARIABLEFILES='-V /share/config/robot_properties.py'
+ kubectl --namespace onap exec dev-robot-6d67844b64-pgbx5 -- /var/opt/ONAP/runTags.sh -V /share/config/robot_properties.py -d /share/logs/0000_demo_init -i InitDemo --display 90
Starting Xvfb on display :90 with res 1280x1024x24
Executing robot tests at log level TRACE
==============================================================================
Testsuites
==============================================================================
Testsuites.Demo :: Executes the VNF Orchestration Test cases including setu...
==============================================================================
Initialize Customer And Models | PASS |
------------------------------------------------------------------------------
Initialize SO Openstack Identity For V3 | PASS |
------------------------------------------------------------------------------
Testsuites.Demo :: Executes the VNF Orchestration Test cases inclu... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Testsuites | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Output: /share/logs/0000_demo_init/output.xml
Log: /share/logs/0000_demo_init/log.html
Report: /share/logs/0000_demo_init/report.html
|
...
- Login to ONAP portal as a designer user
- Navigate to SDC application
- Navigate to ONBOARD tab
Click on CREATE NEW VLM
Fill all mandatory parameters
Add License Key Group and fill all mandatory parameters
Add Entitlement Pool and fill all mandatory parameters
Add Feature Group fill all mandatory parameters and add already created Entitlement Pool and License Key Group
Add License Agreement fill mandatory parameters and add already created Feature Group
- Press Submit button and next COMMIT & SUBMIT button
- Navigate to ONBOARD tab
Click on CREATE NEW VSP
Fill all mandatory parameters:
- select Vendor defined in already created VLM
- Name will be used in next steps
- in ONBOARDING PROCEDURE select Network Package
- Click on warning under License Agreement
- Fill Licensing Version, License Agreement and Feature Groups from already created VLM
- Click on Overview from left menu and press SELECT FILE button.
- Select attached pNF.csar file from your PC
- Press Submit button and next COMMIT & SUBMIT button
- Navigate to Home tab
- Click on IMPORT button and select IMPORT VSP
- Select previously created VSP and press IMPORT VSP button
- In newly opened window yoiu can moduify PNF name.
- Next click Create and Certify button
- Next press Certify button. Put comment message in Certification confirmation pop-up and press OK button
- Navigate to SDC tab / HOME menu
- Click on ADD + button and select Add Service
- In HOME > Create new service > General page fill all mandatory fields (change service type from default a'lacarte to macro) and press Create button in right top corner
- Go to Composition in left menu
- In search box find crated PNF using its name
- Drag ad drop it to main view
- Next click Certify button
- Next Press Distribute button in left top corner
- Press Monitor button in left top corner and verify distribution status, use refresh button
- Re-login as a a demo user
- VID Navigate to application
- From left menu select Browse SDC Service Models
...
- User is logged in
- SDC application is open
- ONBOARD CATALOG is visible
- New License Model window is present
- All mandatory parameters are fulfilled
- License Key Group is added
- Entitlement Pool is added
- Feature Group is added
- License Agreement is added
- VLM is submitted sucesfully
- VLM is visible
New Software Product window is present
All mandatory parameters are fulfilled
- Licensing Version, License Agreement and Feature Groups and warning is not present
- Licensing Version, License Agreement and Feature Groups are defined
- Select file window is opened
- File is selected
- File is sucesfully uploaded and VSP is submited
- Home tab is opened
- Import VSP window is presnet with list of dubmited VSPs
- Previously create VSP is imported as VSP and Create window is opened
- All modifications are present
- PNF is successfully Certified
- SDC application is open
- Page HOME > Create new service > General with fields that must be filled out is open
- Create/Update saved successfully message is present in left top corner
- Composition main view is open
- PNF is visible
- PNF is added to service
- Service is Cerified and ready for Distribution
- Distribute Distribute successfully message is present in left top corner
- Monitor main view is opened with information about distribution. Thesr should not be any errors.
- User is re-logged
- VID application is open
- In Browse SDC Service Models main view is present entry about newly created service - it can take couple of minutes ~ 15 minutes
...
Waiting for PNFReady
...
Verification if PNF PnP functionality within SO is waiting for PNFReady to be published by PRH.
Test case covers following steps from message flow in 5G - PNF Plug and Play:
- STEP 16 – SERVICE INSTANTIATION
- STEP 18 – RESOURCE LEVEL FLOW STEP 20 – PNF A&AI ENTRY MISSING
- STEP 21 – SUBSCRIBE
- STEP 22 – RESOURCE LEVEL FLOW (RLF) TERMINATES
...
- Created PNF and Service using Test Case T01 (Create and distribute service which contains PNF based on imported VSP )
...
- Login to ONAP portal as a demo user
- Navigate to VID application
- Navigate to Browse SDC Service Models in left menu
- Deploy distributed SDC Service Model for PNF
- Fill all mandatory parameters. To "PNF (Correlation) ID" field put correlationId that will be setup in PNF simulator. Press "Confirm" button.
- Close " In Progress" pop-up window
- Login to so-so-bpmn-infra pod via rancher console:
kubectl exec -it dev-so-so-bpmn-infra-7584f4f887-p9tmn -n onap /bin/sh
open debug.log
vi logs/bpmn/debug.log - Verify AAI entry created by SO service using command:
curl -X GET -k -H "accept: application/json" -H "Real-Time: true" -H "Content-Type: application/json" -H "X-FromAppId: dcae-curl" -H "x-transactionId: 9998" "https://AAI:AAI@<kubernetes noed ip address>:<aai service port>/aai/v11/network/pnfs/pnf/<correlationID>"
...
- User is logged in
- VID application is open
- Distributed SDC Service Model for PNF is present
- Create Service Instance -- Macro pop-up is present
- All fields are filled. Pop-up window " In Progress" is visible
- Window is closed. Service is still not instantiated. Is not visible in " Search for Existing Service Instances" left menu
- In debug.log should be present following message:
o.o.s.b.i.pnf.dmaap.PnfEventReadyDmaapClient - registering for pnf ready dmaap event for correlation id: <correlationId> Command should return JSON with empty value for IPv4 and IPv6 address
{"pnf-name":"<correlationID>"","pnf-id":"testtest","in-maint":true,"resource-version":"1541720264047"}
...
Correct entry is present in AAI. Entry contains pnf-name equal to correlationID.
SO service is waiting for PNFReady to be published by PRH
...
PNF registration accepting when AAI entry created in advance
...
Verification if PNF resource registration is done properly when correct AAI record (based on correlationID) is present before first InventoryQuery is done by PRH.
Verification if AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on correlationID.
Test case covers following steps from message flow in 5G - PNF Plug and Play:
- STEP 26 PNF SENDS PNF REGISTRATION
- STEP 26A pnfREGISTRATION EVENT ONTO DMAAP
- STEP 26B pnfREGISTRATION EVENT RETRIEVED BY PRH
- STEP 27 PRH DOES INVENTORY QUERY
- STEP 29 INVENTORY QUERY
- STEP 30 UPDATE PNF ENTRY
- STEP 31 PNF READY EVENT
- STEP 34 UPDATE PNF WORKFLOW
- STEP 43 INFORM OSS
...
- Created PNF and Service using Test Case T01 (Create and distribute service which contains PNF)
- Instantiated service for PNF using Test Case T02 (Waiting for PNFReady)
- Up and running PnP PNF Simualtor according to https://wiki.onap.org/display/DW/PnP+PNF+Simulator
...
- Verify AAI entry created by SO service using command:
curl -X GET -k -H "accept: application/json" -H "Real-Time: true" -H "Content-Type: application/json" -H "X-FromAppId: dcae-curl" -H "x-transactionId: 9998" "https://AAI:AAI@<kubernetes noed ip address>:<aai service port>/aai/v11/network/pnfs/pnf/<correlationID>" - Login to virtual machine with simulator
- In config.json file :
- fill value for sourceName key - use correlationId value used during service instantiation in prerequisite no. 3
- fill pnfOamIpv4Address, pnfOamIpv6Address with some value
- Run script
./simulator.sh start-dev
in order to start simulator - Run script
./simulator.sh run simulator
in order to start sending registration request messages - Once again verify AAI entry created by SO service using command:
curl -X GET -k -H "accept: application/json" -H "Real-Time: true" -H "Content-Type: application/json" -H "X-FromAppId: dcae-curl" -H "x-transactionId: 9998" "https://AAI:AAI@<kubernetes noed ip address>:<aai service port>/aai/v11/network/pnfs/pnf/<correlationID>" - Verify if SO service has reacted on PNFReady message from PRH and has ended
...
- Command should return JSON with empty value for IPv4 and IPv6 address
- User is logged in
- config.json file is updated accordingly
- PnP PNF simulator sends registration request
- Command should return JSON with IPv4 and IPv6 address filled accordingly with inputs from simulator's config.json
- Instantiated SO service has been ended. Verification can be done:
- VID,
Service is instantiated. It is visible in Search for Existing Service Instances menu - SO-BPMN pod in /app/logs/bpmn/debug.log should be present following message:
o.o.s.b.i.pnf.dmaap.PnfEventReadyDmaapClient - pnf ready event got from dmaap for correlationId: <correlationId>
- VID,
...
PNF registration is accepted and AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on correlationID. SO service is instantieted.
...
PNF registration accepted when AAI entry created with delay
...
Verification if PNF resource registration is done properly when correct AAI entry is created after first InventoryQuery is done by PRH.
Verification if AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on pnfRegistration message contents.
Test case covers following steps from message flow in 5G - PNF Plug and Play:
- STEP 26 PNF SENDS PNF REGISTRATION
- STEP 26A pnfREGISTRATION EVENT ONTO DMAAP
- STEP 26B pnfREGISTRATION EVENT RETRIEVED BY PRH
- STEP 27 PRH DOES INVENTORY QUERY
- STEP 28 PNF SENDS PNF REGISTRATION
- STEP 29 INVENTORY QUERY
- STEP 30 UPDATE PNF ENTRY
- STEP 31 PNF READY EVENT
- STEP 34 UPDATE PNF WORKFLOW
- STEP 43 INFORM OSS
...
- Created PNF and Service using Test Case T01 (Create and distribute service which contains PNF)
- Up and running PnP PNF Simualtor according to https://wiki.onap.org/display/DW/PnP+PNF+Simulator
...
- Verify AAI entry created by SO service using command:
curl -X GET -k -H "accept: application/json" -H "Real-Time: true" -H "Content-Type: application/json" -H "X-FromAppId: dcae-curl" -H "x-transactionId: 9998" "https://AAI:AAI@<kubernetes noed ip address>:<aai service port>/aai/v11/network/pnfs/pnf/<correlationID>" - Login to virtual machine with simulator
- In config.json file :
- fill value for sourceName key - use correlationId value that will be used during service instantiation in step no. 7
- fill pnfOamIpv4Address, pnfOamIpv6Address with some value
- set testDuration (amount of registration requests) to value that allows incinerate SO service during period of time when messages are send to ONAP
- set messageInterval interval with which messages are send to ONAP
- Run script
./simulator.sh run simulator
in order to start sending registration request messages - Download PRH logs and check that registration requests has been rejected.
- Instantiated service for PNF using Test Case T02 (Waiting for PNFReady) - use corelationID from step no. 3
- Once again verify AAI entry created by SO service using command:
curl -X GET -k -H "accept: application/json" -H "Real-Time: true" -H "Content-Type: application/json" -H "X-FromAppId: dcae-curl" -H "x-transactionId: 9998" "https://AAI:AAI@<kubernetes noed ip address>:<aai service port>/aai/v11/network/pnfs/pnf/<correlationID>" - Verify if SO service has reacted on PNFReady message from PRH and has ended
...
Warning |
---|
Test update in progress for Guilin release and SO building block flow |
Gliffy | ||||
---|---|---|---|---|
|
Table of Contents |
---|
Link to specification:
5G - PNF Plug and Play
PNF PNP message flow diagram
Rainy day scenario - PNF is sending registration request to ONAP where required AAI entry is not present:
Gliffy | ||||
---|---|---|---|---|
|
Sunny day scenario - PNF is sending registration request to ONAP where required AAI entry is prepared by SO workflow:
Gliffy | ||||
---|---|---|---|---|
|
PNF PNP deployment diagram
Gliffy | ||||
---|---|---|---|---|
|
PNF PNP hardware requirements
- ONAP - standard ONAP instance located in Wind River lab
- 4 Virtual machines dedicated for PNF Simulator:
- 2 VCPU
- 8 GB of RAM
- 32 GB of HDD
PNF PNP test cases
High-Level descriptions
Id. | Test Case Name | Test Case Description |
---|---|---|
T01 | Create and distribute service which contains PNF based on imported VSP | Verification if in VID is present PNF enabled service. |
T02 | PNF registration accepting when AAI entry created in advance | Verification if PNF resource registration is done properly when correct AAI record (based on correlationID) is present before first InventoryQuery is done by PRH. Verification if AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on pnfRegistration message contents. |
T03 | Delete pnf service and pnf resource | |
T04 | Delete pnf service instance and reasign pnf resource to another service instance | |
T05 | PNF registration rejected | Verification if PRH drops the PnfRegistration request when no AAI entry exists for the correlationID. |
T06 | PNF registration accepted when AAI entry is created using AAI API (without SO instantiation) | Verification if PNF resource registration is done properly when correct AAI record (based on correlationID) is present - created using AAI API |
Detailed descriptions
Anchor | ||||
---|---|---|---|---|
|
Test Case ID | T01 | ||||||||||||
Test Case Name | Create and distribute service which contains PNF based on imported VSP | ||||||||||||
Description | Verification if in VID is present PNF enabled service. | ||||||||||||
Release | Frankfurt/Guilin | ||||||||||||
Preconditions |
| ||||||||||||
Testing Steps | Step | Expected Result | |||||||||||
|
| ||||||||||||
Actual Results | In VID is present enabled PNF service. | ||||||||||||
Conclusion (Pass/Fail) | |||||||||||||
Testing Lab | |||||||||||||
Tester Name | Krzysztof Kuzmicki |
Anchor | ||||
---|---|---|---|---|
|
Test Case ID | T02 | ||
Test Case Name | PNF registration accepting when AAI entry created in advance | ||
Description | Verification if PNF resource registration is done properly when correct AAI record (based on correlationID) is present before first InventoryQuery is done by PRH. Test case covers following steps from message flow in 5G - PNF Plug and Play: Whole test case can be also executed using postman collection PNF_service_instantiation_v2.postman_collection.json. In order to execute it successfully there is need to set two variables in collection variables:
Also whole test case including T01 is automated in robot/xtesting robot smoke image - | ||
Release | Frankfurt/Guilin | ||
Preconditions |
| ||
Testing Steps | Step | Expected Result | |
|
|
PNF registration is accepted and AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on correlationID even AAI entry has been created after first InventoryQuery is done by PRH. SO service is instantieted.
PNF registration rejected
Verification if PRH drops the PnfRegistration request when no AAI entry exists for the correlationID.
AAI entries shall not be created by PRH.
Test case covers following steps from message flow in 5G - PNF Plug and Play:
- STEP 26 PNF SENDS PNF REGISTRATION
- STEP 26A pnfREGISTRATION EVENT ONTO DMAAP
- STEP 26B pnfREGISTRATION EVENT RETRIEVED BY PRH
- STEP 27 PRH DOES INVENTORY QUERY
- STEP 28 PNF SENDS PNF REGISTRATION
- STEP 29 INVENTORY QUERY
- Up and running PnP PNF Simualtor according to https://wiki.onap.org/display/DW/PnP+PNF+Simulator
- Verify AAI entry created by SO service using command:
curl -X GET -k -H "accept: application/json" -H "Real-Time: true" -H "Content-Type: application/json" -H "X-FromAppId: dcae-curl" -H "x-transactionId: 9998" "https://AAI:AAI@<kubernetes noed ip address>:<aai service port>/aai/v11/network/pnfs/pnf/<correlationID>" - Login to virtual machine with simulator
- In config.json file :
- fill value for sourceName
- fill pnfOamIpv4Address, pnfOamIpv6Address with some value
- Run script
./simulator.sh run simulator
in order to start sending registration request messages - Download PRH logs and check that registration requests has been rejected.
- Once again verify AAI entry created by SO service using command:
curl -X GET -k -H "accept: application/json" -H "Real-Time: true" -H "Content-Type: application/json" -H "X-FromAppId: dcae-curl" -H "x-transactionId: 9998" "https://AAI:AAI@<kubernetes noed ip address>:<aai service port>/aai/v11/network/pnfs/pnf/<correlationID>"
"org.onap.dcaegen2.services.prh.exceptions.AAINotFoundException: Incorrect response code for continuation of tasks workflow"
PNF registration is rejected and AAI entries has not be created.
Parallel PNF PnP flows
Four parallel PNF PnP flows are hibernated, PNFRegistration event is received in ONAP, proper PNF PnP enabled workflow instance is re-hydrated.
Test case covers following steps from message flow in 5G - PNF Plug and Play:
| ||
Actual Results | PNF registration is accepted and AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on correlationID. SO service is instantieted. | |
Conclusion (Pass/Fail) | ||
Testing Lab | ||
Tester Name | Krzysztof Kuzmicki |
Anchor | ||||
---|---|---|---|---|
|
Test Case ID | T03 | |
Test Case Name | Delete pnf service and pnf resource | |
Description | ||
Release | Guilin | |
Preconditions | ||
Testing Steps | Step | Expected Result |
Actual Results | ||
Conclusion (Pass/Fail) | ||
Testing Lab | ||
Tester Name | Krzysztof Kuzmicki |
Anchor | ||||
---|---|---|---|---|
|
Test Case ID | T04 | |
Test Case Name | Delete pnf service instance and reassign pnf resource to another service instance | |
Description | ||
Release | Guilin | |
Preconditions | ||
Testing Steps | Step | Expected Result |
Actual Results | ||
Conclusion (Pass/Fail) | ||
Testing Lab | ||
Tester Name | Krzysztof Kuzmicki |
Test Case ID | T05 | |
Test Case Name | PNF registration rejected | |
Description | Verification if PRH drops the PnfRegistration request when no AAI entry exists for the correlationID. Test case covers following steps from message flow in 5G - PNF Plug and Play: | |
Release | Casablanca | |
Preconditions |
|
|
|
Testing Steps | Step | Expected |
Result |
|
|
|
|
|
|
- Command should return JSONs with empty value for IPv4 and IPv6 address
- User is logged in
- config.json file is updated accordingly
- PnP PNF simulator sends registration request
- Command should return JSONs with IPv4 and IPv6 address filled accordingly with inputs from simulator's config.json for 3 PNFs
For PNF which don't have working simulator command should return once again JSONs with empty value for IPv4 and IPv6 address - Instantiated SO service has been ended for 3 PNFs. Verification can be done:
- VID,
Service is instantiated. It is visible in Search for Existing Service Instances menu
PNF resource is assigned to Service - SO-BPMN pod in /app/logs/bpmn/debug.log should be present following message:
o.o.s.b.i.pnf.dmaap.PnfEventReadyDmaapClient - pnf ready event got from dmaap for correlationId: <correlationId>
- VID,
PNF registration is accepted and AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on correlationID exept PNF which don't have working simulator.
SO service are intatntieted for PNF except PNF which don't have working simulator. For this PNF service is in progress state
|
| |
Actual Results | PNF registration is rejected and AAI entries has not be created. | |
Conclusion (Pass/Fail) | ||
Testing Lab | ||
Tester Name | Krzysztof Kuzmicki |
Test Case ID | T07T06 | |
Test Case Name | PNF registration accepted when AAI entry is created using AAI API (without SO instantiation) | |
Description | Verification if PNF resource registration is done properly when correct AAI record (based on correlationID) is present - created using AAI API Test case covers following steps from message flow in 5G - PNF Plug and Play: | |
Release | Casablanca | |
Preconditions |
| |
Testing Steps | Step | Expected Result |
|
| |
Actual Results | PNF registration is accepted and AAI entries: ipaddress-v4-oam and ipaddress-v6-oam are updated correctly based on correlationID | |
Conclusion (Pass/Fail) | ||
Testing Lab | ||
Tester Name | Krzysztof Kuzmicki |
...