...
Triggered by merges in policy/distribution
https://gerrit.onap.org/r/gitweb?p=integrationpolicy/csitdocker.git;a=blob;f=testscsit/policydistribution/distributiontests/distribution-test.robot;h=2b1c6d64eb6eebf878e8795b9db0704e26bf5e5f64a77e0696309f43540b5a588608dca40a8e36d6;hb=refs/heads/master
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab |
|---|---|---|---|---|---|
1 | Perform healthcheck of the component | Policy distribution docker image is available | API – healthcheck Method - GET Endpoint: https://<host>:6969/policy/distribution/v1/healthcheck | The component should return health status as “true” | CSIT - DONE External Lab |
| 2 | Query component for statistics | Policy distribution docker image is available | API - statistics Method - GET Endpoint: https://<host>:6969/policy/distribution/v1/statistics | The component should return the current statistics of the component. | CSIT - DONE |
| 3 | InvokeDistributionUsingFile And RunEventOnApexEngine |
Triggered by merges in policy/pap
https://gerrit.onap.org/r/gitweb?p=integrationpolicy/csitdocker.git;a=blob;f=testscsit/policypap/paptests/pap-test.robot;h=67a578281ba8032a5926fbed5baf28890d1a427eda0908d667969d2aae7dbf1d87204e744e94553b;hb=refs/heads/master
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Perform all component Healthcheck | PAP docker image is available | API - component healthcheck METHOD - GET Endpoint: https://<host>:6969/policy/pap/v1/components/healthcheck | CSIT - 200 but only the pap should return "healthy" since not all the components are running. TESTSUITE: 200 and all components should return "healthy" | CSIT - TBD Testsuite -
| ||||||||
| 1 | Perform healthcheck | PAP docker image is available | API – healthcheck Method - GET Endpoint: https://<host>:6969/policy/pap/v1/healthcheck | The component should return health status as “true” | CSIT - DONE External Lab - DONE | ||||||||
| 2 | Query component for statistics | PAP docker image is available | API - statistics Method - GET Endpoint: https://<host>:6969/policy/pap/v1/statistics | The component should return the current statistics of the component. | CSIT - DONE External Lab | ||||||||
| 3 | Query pdp group information | PAP docker image is available | API - pdps Method - GET Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should return the list of PDP groups and subgroups together with the policies that are deployed on each PDP group and subgroup. | CSIT - DONE | ||||||||
| 4 | Create PDP group & subgroup | PAP docker image is available | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should create the relevant PDP group & subgroup in the database and return with operation success message/code. | CSIT - DONE | ||||||||
| 5 | Create a Policy | API docker image is available | API – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | The Policy API should return code 201 and message "A new policy has been successfully created." | CSIT | ||||||||
| 6 | Deploy policy to PDP group & subgroup | PAP docker image is available API docker image is available DMaaP simulator docker image is needed; a PDP can be simulated using curl | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should map the relevant policies with the corresponding PDP group & subgroup in database. Deploy the policy in relevant PDP and return with operation success message/code. | CSIT | ||||||||
| 7 | UnDeploy policy to PDP group & subgroup | PAP docker image is available API docker image is available NOTE: PDP's not needed for this test in Dublin. | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | Based on test #5 - undeploy those policies | CSIT - DONE |
...
Triggered by merges in policy/drools-pdp
https://gerrit.onap.org/r/gitweb?p=integrationpolicy/csitdocker.git;a=blob;f=testscsit/policy/drools-pdp/tests/drools-pdp-test.robot;h=cf4d3ceac87dde285d997a3885ebb49bc4f16cb9d819a80864198ec2ff2ae8bd6e042bc627a82c31;hb=refs/heads/master
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
|---|---|---|---|---|---|
| 1 | Alive | Verify that a PDP-D with no applications comes alive | API – telemetry Method - GET Endpoint: https://<host>:9696/policy/pdpd/v1/engine | Verify alive field | CSIT-DONE |
...
Triggered by merges in policy/drools-applications
https://gerrit.onap.org/r/gitweb?p=integrationpolicy/csitdocker.git;a=blob;f=testscsit/policy/drools-applications/tests/drools-applications-test.robot;h=c3586cfa9d54daf6829cba3dc27bc81b56e8d24d627ae1b0c18fc58eea2163ec342e8ebab7e93ed2;hb=refs/heads/master
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
|---|---|---|---|---|---|
| 1 | Alive | Verify that the PDP-D + Control Loop Apps come alive | API – telemetry Method - GET Endpoint: https://<host>:9696/policy/pdp/engine | Verify alive field is set to 'true' | CSIT - DONE |
| 2 | Healthcheck | Verify that the PDP-D + Control Loop Apps passes healthchecks | API – telemetry Method - GET Endpoint: https://<host>:6969/healthcheck | Verify that the healthy field at the root object is set to 'true' | CSIT - DONE |
| 3 | Frankfurt | Verify that the PDP-D + Control Loop Apps - Frankfurt controller has been successfully brought up | API – telemetry Method - GET Endpoint: https://<host>:6969/policy/pdp/engine/controllers/frankfurt/drools/facts | Verify that a 200 OK is received indicating that there is a drools session associated with this controller that has been successfully instantiated. | CSIT - DONE |
| 4 | vFW | Verify vFW use case. Simulators should be installed. |
| Verify vFirewall completes successfully | CSIT |
| 5 | vDNS | Verify Scale out use case. Simulators should be installed. |
| Verify scale out completes successfully | CSIT |
| 6 | vCPE | Verify vCPE use case. Simulators should be installed. |
| Verify vCPE completes successfully | CSIT |
Triggered by merges in policy/xacml-pdp
https://gerrit.onap.org/r/gitweb?p=integrationpolicy/csitdocker.git;a=blob;f=tests/policycsit/xacml-pdp/tests/xacml-pdp-test.robot;h=0305af8e9fd2ba91d5711680f3be28efb829b37ee19e00423ace8ae6eb8ab79fb86493ed440547cd;hb=refs/heads/master
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab |
|---|---|---|---|---|---|
| 1 | Health Check | Xacml-PDP docker image available | API – healthcheck Method - GET Endpoint: http://<host>:6969/policy/pdpx/v1/healthcheck | The component should return health status as “true” Status code 200 | CSIT External Lab |
| 2 | Statistics | Xacml-PDP docker image available | API – statistics Method - GET Endpoint: http://<host>:6969/policy/pdpx/v1/statistics | The Xacml PDP should return statistics report consisting of 0 policies loaded and 0 decisions Status code 200 | CSIT |
| 3 | ExecuteXacmlPolicy | ||||
| 3a | CreateNewMonitorPolicy | API docker image available | API – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | The Policy API should return code 201 and message "A new policy has been successfully created." | CSIT |
| 3b | DeployMonitorPolicy | Xacml-PDP and PAP docker images available Policy created on the PAP | API – deployPolicy Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/deployPolicy | Successfully deploy a policy to the XACML PDP Statistics should increment policy count Status code 201 | CSIT |
| 3c | GetAbbreviatedDecisionResult | Xacml-PDP docker image available Test Case 4 success | API – decision Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/decision?abbrev=true | The Xacml PDP should return a Decision object containing the decision and abbreviated policy results Status code 200 | CSIT |
| 3c | GetAbbreviatedDecisionResult | Xacml-PDP docker image available Test Case 4 success | API – decision Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/decision?abbrev=true | The Xacml PDP should return a Decision object containing the decision and abbreviated policy results Status code 200 | CSIT/External Lab (stretch) |
| 3d | GetDecision | Xacml-PDP docker image available Test Case 5 success | API – decision Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/decision | The Xacml PDP should return a Decision object containing the decision Status code 200 | CSIT/External Lab (stretch) |
...
Triggered by merges in policy/apex-pdp
https://gerrit.onap.org/r/gitweb?p=integrationpolicy/csitdocker.git;a=blob;f=testscsit/policy/apex-pdp/tests/apex-pdp-test.robot;h=9956731d585a7d0ef7157a8c73c41e9888e70cdbe538e6faa8288594669c68583bef3f4e6c6c3e32;hb=refs/heads/master
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
|---|---|---|---|---|---|
1 | Perform healthcheck of the component | Apex PDP docker image is available | API – healthcheck Method - GET Endpoint: https://<host>:6969/policy/apex-pdp/v1/healthcheck | The component should return health status as “true” Status code 200 | CSIT - DONE External Lab |
| 2 | ExecuteApexPolicy | ||||
| 2a | CreateOperationalPolicyType | API docker image available | API – policytypes Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 | CSIT - DONE External Lab |
| 2b | CreateNewOperationalPolicy | API docker image available | API – policytypes/onap.policies.controlloop.operational.Apex/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.controlloop.operational.Apex/versions/1.0.0/policies | 200 | CSIT - DONE External Lab |
| 2c | DeployOperationalPolicy | APEX-PDP and PAP docker images available DMaaP Simulator available. Policy created | API – pdps/deployments/batch Method - POST Endpoint: http://<host>:6969/policy/pap/v1/pdps/deployments/batch | 200 | CSIT - DONE External Lab |
| 2d | RunEventOnApexEngine | APEX-PDP docker image available 2c succeeds | API – /apex/FirstConsumer/EventIn Method - POST Endpoint: http://<APEX_IP>:23324/apex/FirstConsumer/EventIn | 200 | CSIT - DONE External Lab |
| 3 | Query component for statistics | Apex PDP docker image is available | API - statistics Method - GET Endpoint: https://<host>:6969/policy/apex-pdp/v1/statistics | The component should return the current statistics of the component. | CSIT (Stretch) |
Triggered by merges in policy/api
https://gerrit.onap.org/r/gitweb?p=integrationpolicy/csitdocker.git;a=blob;f=testscsit/policyapi/apitests/api-test.robot;h=76c1bdc6fd5096d2cb3d65300494dd5abd872c2b2123b1e58f86cfe5e0786afc9bda6d2e1c53677f;hb=refs/heads/master
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT External Labs |
|---|---|---|---|---|---|
1 | Healthcheck Perform healthcheck for policy design API service |
| API – healthcheck Method - GET Endpoint: http://<host>:6969/policy/api/v1/healthcheck | 200 | CSIT External Lab |
| 2 | Statistics Retrieve statistics of policy design API invocation |
| API – statistics Method - GET Endpoint: http://<host>:6969/policy/api/v1/statistics | 200 | CSIT External Lab |
| 3 | RetrievePolicyTypes Retrieve pre-loaded generic policy types |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 - all preloaded policy types | CSIT |
| 4 | CreateTCAPolicyTypeV1 |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 406 - policy type v1 is already preloaded | CSIT |
| 5 | CreateTCAPolicyTypeV2 |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 - v2 created | CSIT |
| 6 | RetrieveMonitoringPolicyTypes |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 - both v1 and v2 retrieved | CSIT |
| 7 | CreateNewMonitoringPolicyV1 Create a new TCA policy type for DCAE TCA microservice |
| API – policytypes Method - POST Endpoint: http://<host>:6969/ /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | 200 | CSIT |
| 8 | SimpleCreateNewMonitoringPolicyV1 Trying to create an existing policy with any change and same version should cause error. |
| /policy/api/v1/policies | 406 - must supply new version | CSIT |
| 9 | SimpleCreateNewMonitoringPolicyV2 Create a new Monitoring TCA policiy version 2 using simple endpoint | /policy/api/v1/policies | 200 - v2 created | CSIT | |
| 10 | RetrievePoliciesOfType Retrieve Monitoring related policy types |
| API – policytypes/onap.policies.Monitoring Method - GET Endpoint: http://<host>:6969/ /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | 200 - contains both v1 and v2 | CSIT |
| 11, 12 | DeleteSpecificPolicyV1 Delete the Monitoring Policy Version 1 of the TCA Policy Type |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/1.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT |
| 13, 14 | DeleteSpecificPolicyV2 Delete the Monitoring Policy Version 2 of the TCA Policy Type |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/2.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT |
| 15, 16 | DeleteSpecificPolicyTypeV1 |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT |
| 17, 18 | DeleteSpecificPolicyTypeV2 |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/2.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT |
...
The following pairwise activities will be performed:
| Project Name | Status | Notes |
| CSDK → POLICY | ||
| CLAMP → POLICY | ||
DCAE → POLICY | ||
| Health Check | ||
| OOF → POLICY | ||
| POLICY→ A&AI | ||
| POLICY→ AAF |
| POLICY→ SO | ||
| POLICY→ CDS | ||
| POLICY→ DCAE |
Stability and Performance Testing
| Jira Legacy | ||||||||
|---|---|---|---|---|---|---|---|---|
|
Results will be documented in the corresponding readthedocs section: Running stability and performance tests
...