Policy R9 Istanbul CSIT/External Lab Functional Test Cases

Owned by James Hahn
Last updated: Oct 13, 2021 by Sirisha Manchikanti
5 min read

CSIT and Testsuite Tests

Triggered by merges in policy/distribution

https://github.com/onap/policy-docker/blob/master/csit/distribution/tests/distribution-test.robot

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Lab

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Lab

1

Perform healthcheck of the component

Policy distribution docker image is available

API – healthcheck

Method - GET

Endpoint: https://<host>:6969/policy/distribution/v1/healthcheck

The component should return health status as “true”

CSIT

External Lab

2

Query component for statistics

Policy distribution docker image is available

API - statistics

Method - GET

Endpoint: https://<host>:6969/policy/distribution/v1/statistics

The component should return the current statistics of the component.

CSIT

3

InvokeDistributionUsingFile And RunEventOnApexEngine









Triggered by merges in policy/pap

https://github.com/onap/policy-docker/blob/master/csit/pap/tests/pap-test.robot

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Lab

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Lab

1

Perform all component Healthcheck

PAP docker image is available

API - component healthcheck

METHOD - GET

Endpoint: https://<host>:6969/policy/pap/v1/components/healthcheck


CSIT - 200 but only the pap should return "healthy" since not all the components are running.

TESTSUITE: 200 and all components should return "healthy"

CSIT

1

Perform healthcheck 

PAP docker image is available

API – healthcheck

Method - GET

Endpoint: https://<host>:6969/policy/pap/v1/healthcheck

The component should return health status as “true”

CSIT

External Lab

2

Query component for statistics

PAP docker image is available

API - statistics

Method - GET

Endpoint: https://<host>:6969/policy/pap/v1/statistics

The component should return the current statistics of the component.

CSIT

External Lab

3

Query pdp group information

PAP docker image is available

API - pdps

Method - GET

Endpoint: https:{url}:{port}/policy/pap/v1/pdps

The component should return the list of PDP groups and subgroups together with the policies that are deployed on each PDP group and subgroup.

CSIT

4

Create PDP group & subgroup

PAP docker image is available

API - pdps

Method - POST

Endpoint: https:{url}:{port}/policy/pap/v1/pdps

The component should create the relevant PDP group & subgroup in the database and return with operation success message/code.

CSIT

5

Create a Policy

API docker image is available

API – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies

Method - POST

Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies

The Policy API should return code 201 and message "A new policy has been successfully created."

CSIT

6

Deploy policy to PDP group & subgroup

PAP docker image is available

API docker image is available

DMaaP simulator docker image is needed; a PDP can be simulated using curl



API - pdps

Method - POST

Endpoint: https:{url}:{port}/policy/pap/v1/pdps

The component should map the relevant policies with the corresponding PDP group & subgroup in database. Deploy the policy in relevant PDP and return with operation success message/code.

CSIT

7

UnDeploy policy to PDP group & subgroup

PAP docker image is available

API docker image is available

NOTE: PDP's not needed for this test in Dublin.

API - pdps

Method - POST

Endpoint: https:{url}:{port}/policy/pap/v1/pdps

Based on test #5 - undeploy those policies

CSIT



Triggered by merges in policy/drools-pdp

https://github.com/onap/policy-docker/blob/master/csit/drools-pdp/tests/drools-pdp-test.robot

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Labs

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Labs

1

Alive

Verify that a PDP-D with no applications comes alive

API – telemetry

Method - GET

Endpoint: https://<host>:9696/policy/pdpd/v1/engine

Verify alive field

CSIT



Triggered by merges in policy/drools-applications

https://github.com/onap/policy-docker/blob/master/csit/drools-applications/tests/drools-applications-test.robot

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Labs

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Labs

1

Alive

Verify that the PDP-D + Control Loop Apps come alive

API – telemetry

Method - GET

Endpoint: https://<host>:9696/policy/pdp/engine

Verify alive field is set to 'true'

CSIT

2

Healthcheck

Verify that the PDP-D + Control Loop Apps passes healthchecks

API – telemetry

Method - GET

Endpoint: https://<host>:6969/healthcheck

Verify that the healthy field at the root object is set to 'true'

CSIT

3

Frankfurt

Verify that the PDP-D + Control Loop Apps - Frankfurt controller has been successfully brought up

API – telemetry

Method - GET

Endpoint: https://<host>:6969/policy/pdp/engine/controllers/frankfurt/drools/facts

Verify that a 200 OK is received indicating that there is a drools session associated with this controller that has been successfully instantiated.

CSIT

4

vFW

Verify vFW use case.

Simulators should be installed.

  1. Add vFW Operational Policy

  2. Inject ONSET

  3. Trace the vFW use case across the complete sequence of messages

Verify vFirewall completes successfully

CSIT

5

vDNS

Verify Scale out use case.

Simulators should be installed.

  1. Add vDNS Operational Policy

  2. Inject ONSET

  3. Trace the vDNS use case across complete sequence of messages

Verify scale out completes successfully

CSIT

6

vCPE

Verify vCPE use case.

Simulators should be installed.

  1. Add vCPE Operational Policy

  2. Inject ONSET

  3. Trace the vCPE use case across the complete sequence of messages

Verify vCPE completes successfully

CSIT

Triggered by merges in policy/xacml-pdp

https://github.com/onap/policy-docker/blob/master/csit/xacml-pdp/tests/xacml-pdp-test.robot

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Lab

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Lab

1

Health Check

Xacml-PDP docker image available

API – healthcheck

Method - GET

Endpoint: http://<host>:6969/policy/pdpx/v1/healthcheck

The component should return health status as “true”

Status code 200

CSIT

External Lab

2

Statistics

Xacml-PDP docker image available

API – statistics

Method - GET

Endpoint: http://<host>:6969/policy/pdpx/v1/statistics

The Xacml PDP should return statistics report consisting of 0 policies loaded and 0 decisions

Status code 200



CSIT

3

ExecuteXacmlPolicy









3a

CreateNewMonitorPolicy

API docker image available

API – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies

Method - POST

Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies

The Policy API should return code 201 and message "A new policy has been successfully created."

CSIT

3b

DeployMonitorPolicy

Xacml-PDP and PAP docker images available

Policy created on the PAP

API – deployPolicy

Method - POST

Endpoint: http://<host>:6969/policy/pdpx/v1/deployPolicy

Successfully deploy a policy to the XACML PDP

Statistics should increment policy count

Status code 201

CSIT

3c

GetAbbreviatedDecisionResult

Xacml-PDP docker image available

Test Case 4 success

API – decision

Method - POST

Endpoint: http://<host>:6969/policy/pdpx/v1/decision?abbrev=true

The Xacml PDP should return a Decision object containing the decision and abbreviated policy results

Status code 200

CSIT

3c

GetAbbreviatedDecisionResult

Xacml-PDP docker image available

Test Case 4 success

API – decision

Method - POST

Endpoint: http://<host>:6969/policy/pdpx/v1/decision?abbrev=true

The Xacml PDP should return a Decision object containing the decision and abbreviated policy results

Status code 200

CSIT/External Lab (stretch)

3d

GetDecision

Xacml-PDP docker image available

Test Case 5 success

API – decision

Method - POST

Endpoint: http://<host>:6969/policy/pdpx/v1/decision

The Xacml PDP should return a Decision object containing the decision

Status code 200

CSIT/External Lab (stretch)



Triggered by merges in policy/apex-pdp

https://github.com/onap/policy-docker/blob/master/csit/apex-pdp/tests/apex-pdp-test.robot

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Labs

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT/External Labs

1

Perform healthcheck of the component



Apex PDP docker image is available

API – healthcheck

Method - GET

Endpoint: https://<host>:6969/policy/apex-pdp/v1/healthcheck

The component should return health status as “true”

Status code 200

CSIT

External Lab

2

ExecuteApexPolicy









2a

CreateOperationalPolicyType

API docker image available

API – policytypes

Method - POST

Endpoint: http://<host>:6969/policy/api/v1/policytypes

200

CSIT

External Lab

2b

CreateNewOperationalPolicy

API docker image available

API – policytypes/onap.policies.controlloop.operational.Apex/versions/1.0.0/policies

Method - POST

Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.controlloop.operational.Apex/versions/1.0.0/policies

200

CSIT

External Lab

2c

DeployOperationalPolicy

APEX-PDP and PAP docker images available

DMaaP Simulator available.

Policy created 

API – pdps/deployments/batch

Method - POST

Endpoint: http://<host>:6969/policy/pap/v1/pdps/deployments/batch

200

CSIT

External Lab

2d

RunEventOnApexEngine

APEX-PDP docker image available

2c succeeds

API – /apex/FirstConsumer/EventIn

Method - POST

Endpoint: http://<APEX_IP>:23324/apex/FirstConsumer/EventIn

200

CSIT

External Lab



3

Query component for statistics

Apex PDP docker image is available

API - statistics

Method - GET

Endpoint: https://<host>:6969/policy/apex-pdp/v1/statistics

The component should return the current statistics of the component.

CSIT

Triggered by merges in policy/api

https://github.com/onap/policy-docker/blob/master/csit/api/tests/api-test.robot



Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT External Labs

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT External Labs

1

Healthcheck

Perform healthcheck for policy design API service



  • Policy API docker image available

API – healthcheck

Method - GET

Endpoint: http://<host>:6969/policy/api/v1/healthcheck

200

CSIT

External Lab

2

Statistics

Retrieve statistics of policy design API invocation

  • Policy API docker image available

API – statistics

Method - GET

Endpoint: http://<host>:6969/policy/api/v1/statistics

200

CSIT

External Lab

3

RetrievePolicyTypes

Retrieve pre-loaded generic policy types

  • Policy API docker image available

API – policytypes

Method - GET

Endpoint: http://<host>:6969/policy/api/v1/policytypes

200 - all preloaded policy types

CSIT

4

CreateTCAPolicyTypeV1

  • Policy API docker image available

API – policytypes

Method - GET

Endpoint: http://<host>:6969/policy/api/v1/policytypes

406 - policy type v1 is already preloaded

CSIT

5

CreateTCAPolicyTypeV2

  • Policy API docker image available

API – policytypes

Method - GET

Endpoint: http://<host>:6969/policy/api/v1/policytypes

200 - v2 created

CSIT

6

RetrieveMonitoringPolicyTypes

  • Policy API docker image available

API – policytypes

Method - GET

Endpoint: http://<host>:6969/policy/api/v1/policytypes

200 - both v1 and v2 retrieved

CSIT

7

CreateNewMonitoringPolicyV1

Create a new TCA policy type for DCAE TCA microservice

  • Policy API docker image available

  • DCAE TCA ms policy type is not created yet

API – policytypes

Method - POST

Endpoint: http://<host>:6969/

/policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies

200

CSIT

8

SimpleCreateNewMonitoringPolicyV1

Trying to create an existing policy with any change and same version should cause error.

  • Policy API docker image available

  • DCAE TCA ms policy type v1 is created

/policy/api/v1/policies

406 - must supply new version

CSIT

9

SimpleCreateNewMonitoringPolicyV2

Create a new Monitoring TCA policiy version 2 using simple endpoint



/policy/api/v1/policies

200 - v2 created

CSIT

10

RetrievePoliciesOfType

Retrieve Monitoring related policy types

  • Policy API docker image available

  • DCAE TCA ms policy type v1 and v2 are created

API – policytypes/onap.policies.Monitoring

Method - GET

Endpoint: http://<host>:6969/

/policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies

200 - contains both v1 and v2

CSIT

11, 12

DeleteSpecificPolicyV1

Delete the Monitoring Policy Version 1 of the TCA Policy Type

  • Policy API docker image available

  • DCAE TCA ms policy type v1 and v2 are created

/policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/1.0.0

200 - delete successful

404 - not found on 2nd delete attempt

CSIT

13, 14

DeleteSpecificPolicyV2

Delete the Monitoring Policy Version 2 of the TCA Policy Type

  • Policy API docker image available

  • DCAE TCA ms policy type v2 is created

/policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/2.0.0

200 - delete successful

404 - not found on 2nd delete attempt

CSIT

15, 16

DeleteSpecificPolicyTypeV1

  • Policy API docker image available

  • DCAE TCA ms policy type v1 is created

/policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0

200 - delete successful

404 - not found on 2nd delete attempt

CSIT

17, 18

DeleteSpecificPolicyTypeV2

  • Policy API docker image available

  • DCAE TCA ms policy type v2 is created

/policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/2.0.0

200 - delete successful

404 - not found on 2nd delete attempt

CSIT

Triggered by merges in policy/clamp

https://github.com/onap/policy-docker/blob/master/csit/clamp/tests/policy-clamp-test.robot

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT External Labs

Test Case Id

Description

Pre-conditions

Test Steps

Expected Results

CSIT External Labs

1

Commission control loop



Controlloop-runtime docker image is available, mariadb is up

API – commission

Method - POST

Endpoint: https://<host>:6969/onap/controlloop/v2/commission

Commissioning is success

Status code 200

CSIT

    2

Instantiate control loop

Controlloop-runtime, mariadb, participants and dmaap docker images are up

API – instantiation

Method - POST

Endpoint: http://<host>:6969/onap/controlloop/v2/instantiation

200

CSIT

    3

Passivate control loop

Controlloop-runtime, mariadb, participants and dmaap docker images are up

API – instantiation/command

Method - POST

Endpoint: http://<host>:6969/onap/controlloop/v2/instantiation/command

200

CSIT



    4

Runs Policy Participant Query New Policies

Controlloop-runtime, mariadb, participants, policy-api and dmaap docker images are up

Policy created 

API – /policy/api/v1/policies

Method - GET

Endpoint: http://<host>:6969/policy/api/v1/policies

200

CSIT



    5

Runs Policy Participant Query New Policy Types

Controlloop-runtime, mariadb, participants, policy-api and dmaap docker images are up

Policy Types created

API – /policy/api/v1/policytypes

Method - GET

Endpoint: http://<host>:6969/policy/api/v1/policytypes

200

CSIT





   6

ControlLoop State Change to RUNNING.

Controlloop-runtime, mariadb, participants and dmaap docker images are up

API - /onap/controlloop/v2/instantiation/command

Method - POST

Endpoint: https://<host>:6969/onap/controlloop/v2/instantiation/command

200

CSIT

   7

Get Instantiated ControlLoops

Controlloop-runtime, mariadb, participants and dmaap docker images are up

API – /onap/controlloop/v2/instantiation

Method - GET

Endpoint: http://<host>:6969/onap/controlloop/v2/instantiation

200

CSIT

Smoke Testing

The following smoke tests will be performed:

POLICY-3614: Smoke Testing of the Snapshot Images for IstanbulClosed

Results will be documented in the corresponding readthedocs section: Running the smoke tests

Pairwise Testing

The following pairwise activities will be performed:

POLICY-3661: Pairwise testing of policy frameworkClosed

Results will be documented in the corresponding readthedocs section: Running the pairwise tests

Stability and Performance Testing

POLICY-3385: Run the Stability and Performance Tests for all policy componentsClosed

Results will be documented in the corresponding readthedocs section: Running the stability and performance tests