Versions Compared

Old Version 24

changes.mady.by.user Krzysztof Kuzmicki

Saved on

compared with

New Version 25

changes.mady.by.user Krzysztof Kuzmicki

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

...

Test Case ID
PNF-POB-OB-3 
Test Case NameTest Pre-Onboarding of Vendor Supplied Package in (offline) VNF Test Platform installed according to  https://docs.onap.org/en/latest/submodules/vnfsdk/model.git/docs/files/vnf-test-platform.html
DescriptionTaking a pre-formed sample csar package mimicking a vendor supplied PNF csar which will contain relevant artefacts verify this package against the VNF-SDK API
ReleaseDublin
Preconditions

Sample csar package mimicking vendor csar agreed and available

Testing Steps


StepExpected Result

Install VNF Testing platform (VTP) on Linux machine with Ubuntu 18.04 according to instruction. https://docs.onap.org/en/latest/submodules/vnfsdk/model.git/docs/files/vnf-test-platform.html

export NEXUS_DOCKER_REPO=nexus3.onap.org:10001

docker login $NEXUS_DOCKER_REPO -u docker -p docker

export REFREPO_TAG=1.3.0

export POSTGRES_TAG=latest

export MTU=1450

wget https://raw.githubusercontent.com/onap/vnfsdk-refrepo/master/vnfmarket-be/deployment/install/docker-compose.yml

docker-compose up -d

run docker ps and following entries would be reported:

root@oclip-2:~# docker ps

 CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 

246141724b02 nexus3.onap.org:10001/onap/vnfsdk/refrepo:1.3.0 "/service/docker-e..." 2 days ago Up 2 days 0.0.0.0:8000->8000/tcp, 0.0.0.0:8702-8703->8702-8703/tcp, 0.0.0.0:50051->50051/tcp refrepo 

20bfa4ba1734 nexus3.onap.org:10001/onap/vnfsdk/refrepo/postgres:latest "docker-entrypoint..." 2 days ago Up 2 days 0.0.0.0:5432->5432/tcp postgres root@oclip-2:~#

REST Endpoint for VTP validation (from local docker compose)
http://<local_docker_host>:8702/onapapi/vnfsdk-marketplace/v1/vtp/executions?requestId=<some_request_id>
REST Endpoint for VTP validation (from ONAP instance)
http://<one_of_ONAP_k8s_hosts>:30297/onapapi/vnfsdk-marketplace/v1/vtp/executions?requestId=<some_request_id>

VTP is up and running.

Endpoint for validation API is available

Open postman application and load VTP_postman_collection.json for VTP validationPostman is available and collection is loaded

Fill parameters in postman:

  • in "file" choose csar/zip file to be validated
  • in "execution" in parameters  put name of file that will be validated "csar": "file://noETSI-Entry-Manifest or ETSI-Entry-Change-Log.csar",
  • in Headers put following value: Content-Type application/x-www-form-urlencoded
  • update host end REST endpoint according to VTP from local docker compose or VTP from ONAP instance


Validation doesn't find violations in valid_all.csar package
Prepare request and validate csar package valid_all.csarValidation doesn't find violations in valid_all.csar package
Prepare request and validate  zip  package valid_all.zipValidation doesn't find violations in valid_all.zip package
Prepare request and validate zip package signed with CMS signed-package-valid-signature.zipvalidations should not find any violations
Prepare request and validate zip package signed with CMS signed-package-invalid-signature.zipvalidation should find violations


Conclusion (Pass/Fail)
Testing LabONAP Lab/standalone linux machine

Automated Test Cases

Test case has bee automated using robot framework. Test Cases are available in robot pod in ONAP system.

In order to execute the run following command at RKE node:

ubuntu@onap-rke-node:~$ oom/kubernetes/robot/ete-k8s.sh onap vnfsdk execscript

Test case definition in testsuite repo

https://gerrit.onap.org/r/gitweb?p=testsuite.git;a=blob;f=robot/testsuites/vnfsdk_validation.robot;h=12e3df3a4325a842cc1b57653f99aa421f03fc97;hb=497430e121685613c450c4f210b1583ea1bb80f3

Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding allMandatoryEntriesDefinedInTOSCAMeta
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/allMandatoryEntriesDefinedInTOSCAMeta Imports it as csar VSP package to SDC and comapres with list of expected errors. Runs VNFSDK validation and comapres with list of expected errors. Expected failed requirements from VNFSDK [u'r146092', u'r816745', u'r01123'] Expected errors from SDC Onboarding [u'Manifest contains invalid line: 7: #The manifest file shall include a list of all files contained in or referenced from the VNF package with their location']


Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding non_mano_artifact_sets_is_mandatory
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/non_mano_artifact_sets_is_mandatory Imports it as csar VSP package to SDC and comapres with list of expected errors. Runs VNFSDK validation and comapres with list of expected errors. Expected failed requirements from VNFSDK [u'r146092', u'r01123'] Expected errors from SDC Onboarding [u'Manifest contains invalid line: 7: #The manifest file shall include a list of all files contained in or referenced from the VNF package with their location']


Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding no_pnfd_release_date_time_error
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/no_pnfd_release_date_time_error Imports it as csar VSP package to SDC and comapres with list of expected errors. Runs VNFSDK validation and comapres with list of expected errors. Expected failed requirements from VNFSDK [u'r57019', u'r01123', u'r816745'] Expected errors from SDC Onboarding [u"Invalid Manifest metadata entry: '#The manifest file shall include a list of all files contained in or referenced from the VNF package with their location'.;\nAt line 6: '#The manifest file shall include a list of all files contained in or referenced from the VNF package with their location'."]


Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding noETSI-Entry-ManifestOrETSI-Entry-Change-Log
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/noETSI-Entry-ManifestOrETSI-Entry-Change-Log Imports it as csar VSP package to SDC and comapres with list of expected errors. Runs VNFSDK validation and comapres with list of expected errors. Expected failed requirements from VNFSDK [u'r293901', u'r01123', u'r130206'] Expected errors from SDC Onboarding [u'Manifest contains invalid line: 7: #The manifest file shall include a list of all files contained in or referenced from the VNF package with their location', u'Manifest contains invalid line: 7: #The manifest file shall include a list of all files contained in or referenced from the VNF package with their location']


Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding PNFD_missing
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/PNFD_missing Imports it as csar VSP package to SDC and comapres with list of expected errors. Runs VNFSDK validation and comapres with list of expected errors. Expected failed requirements from VNFSDK [u'SOL004', u'r10087', u'r87234', u'r35854', u'r15837', u'r17852', u'r293901', u'r146092', u'r57019', u'r787965', u'r972082', u'r01123', u'r130206', u'r816745'] Expected errors from SDC Onboarding [u'TOSCA.meta file in TOSCA-metadata directory missing entry Created-By']


Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding test_SDC_and_VNFSDK_API, integrity_check CMS_with_cert
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/test_SDC_and_VNFSDK_API Imports it as csar VSP package to SDC and expects success. Runs VNFSDK validation and and expects success.


Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding test_SDC_and_VNFSDK_API, integrity_check CMS_without_cert
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/test_SDC_and_VNFSDK_API Imports it as csar VSP package to SDC and expects success. Runs VNFSDK validation and and expects success.


Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding test_SDC_and_VNFSDK_API, secured csar - CMS only - sdc valid certificate, integrity_check CMS_without_cert
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/test_SDC_and_VNFSDK_API Next sign with certificate that is imported to SDC onabarding POD using CMS only method (CMS file signs csar, zip contains only csar and cms files ) Imports it as zip VSP package to SDC and expects success. Runs VNFSDK validation and and expects success.


Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding test_SDC_and_VNFSDK_API, secured csar - CMS and CERT - sdc valid certificate, integrity_check CMS_with_cert
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/test_SDC_and_VNFSDK_API Next sign with certificate that is imported to SDC onabarding POD using CMS and CERT method (CMS file signs csar, zip contains csar, certificate and cms files ) Imports it as zip VSP package to SDC and expects success. Runs VNFSDK validation and and expects success.


Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding test_SDC_and_VNFSDK_API, secured csar - CMS only - sdc invalid certificate, integrity_check CMS_without_cert
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/test_SDC_and_VNFSDK_API Next sign with certificate that is not imported to SDC onabarding POD using CMS only method (CMS file signs csar, zip contains only csar and cms files ) Imports it as zip VSP package to SDC and expects error due to issues with certificate validation. Runs VNFSDK validation and and expects success.


Full Name:
Testsuites.Vnfsdk Validation.Validate Onboarding test_SDC_and_VNFSDK_API, secured csar - CMS and CERT - sdc invalid certificate, integrity_check CMS_with_cert
Documentation:

This test case creates TOSCA csar software package for PNF, based on /var/opt/ONAP/demo/tosca/vnfsdk/test_SDC_and_VNFSDK_API Next sign with certificate that is not imported to SDC onabarding POD using CMS and CERT method (CMS file signs csar, zip contains csar, certificate and cms files ) Imports it as zip VSP package to SDC and expects error due to issues with certificate validation. Runs VNFSDK validation and and expects success