AAI R2 Beijing - Integration Test Plans

This page will track our test plans for S3P functionality (if applicable). When successful, we will update the Release Planning wiki on our status: Beijing Release Platform Maturity



Platform Maturity Integration Testing

Area

Actual Level

Targeted Level for current Release

How, Evidences

Comments

Area

Actual Level

Targeted Level for current Release

How, Evidences

Comments

Performance

0

1

AAI has not done performance testing in OOM environment, yet, plans to implement in TLAB.

AAI-1145: Measure baseline AAI performance in TLABClosed

HEAT based test results



  • 0 -- none

  • 1 – baseline performance criteria identified and measured

  • 2 & 3 – performance improvement plans created & implemented

Stability

1

1

CSIT tests showsthe stability of the components - https://jenkins.onap.org/view/CSIT/job/aai-master-verify-csit-resources/

https://jenkins.onap.org/view/CSIT/job/aai-master-verify-csit-traversal/

Heat and OOM deployments have the instances running for more than 72 hours - https://jenkins.onap.org/view/External%20Labs/

  • 0 – none

  • 1 – 72 hours component level soak w/random transactions

  • 2 – 72 hours platform level soak w/random transactions

  • 3 – 6 months track record of reduced defect rate

Resiliency

1

2

Integrated with OOM which allows for automated detection and recovery in a single site.

root@rancher:~# kubectl -n onap get pods | grep aai dev-aai-7c4898f44f-qf4xh 1/1 Running 6 2h dev-aai-babel-789f9d97bd-77d7r 2/2 Running 0 2h dev-aai-cassandra-0 1/1 Running 0 2h dev-aai-cassandra-1 1/1 Running 0 2h dev-aai-cassandra-2 1/1 Running 0 2h dev-aai-champ-58bfcdc445-p9nph 1/1 Running 0 2h dev-aai-data-router-6f9ff67d68-plf4m 1/1 Running 0 2h dev-aai-elasticsearch-548b68c46f-j9b9g 1/1 Running 0 2h dev-aai-gizmo-796b95f5c5-gct2m 2/2 Running 0 2h dev-aai-hbase-868f949597-s8l7p 1/1 Running 0 2h dev-aai-modelloader-84b77ffb54-pxzss 2/2 Running 0 2h dev-aai-resources-894667dd8-rkprw 2/2 Running 0 2h dev-aai-search-data-6cbc65f459-mphxf 2/2 Running 0 2h dev-aai-sparky-be-576bbb99fd-j972w 2/2 Running 0 2h dev-aai-traversal-9bffcd7b6-fdr7t 2/2 Running 0 2h
  • 0 – none

  • 1 – manual failure and recovery (< 30 minutes)

  • 2 – automated detection and recovery (single site)

  • 3 – automated detection and recovery (geo redundancy)

Security

0

1

CII Badging:

AAI Core:

AAI ESR:

Sparky-fe:

AAI UI:

Model loader:

>50% Test Coverage:



  • 0 – none

  • 1 – CII Passing badge + 50% Test Coverage

  • 2 – CII Silver badge; internal communication encrypted; role-based access control and authorization for all calls

  • 3 – CII Gold

Scalability

0

1

Integrated with OOM:

AAI-539: Set up Cassandra docker images in 3 node clusterClosed

AAI-15: OOM IntegrationClosed

  • 0 – no ability to scale

  • 1 – single site horizontal scaling

  • 2 – geographic scaling

  • 3 – scaling across multiple ONAP instances

Manageability

1

1

Logging with EELF and filebeat in OOM, AAI can be instantiated in < 1 hr

root@rancher:~# kubectl -n onap get pods | grep aai dev-aai-7c4898f44f-qf4xh 1/1 Running 6 2h dev-aai-babel-789f9d97bd-77d7r 2/2 Running 0 2h dev-aai-cassandra-0 1/1 Running 0 2h dev-aai-cassandra-1 1/1 Running 0 2h dev-aai-cassandra-2 1/1 Running 0 2h dev-aai-champ-58bfcdc445-p9nph 1/1 Running 0 2h dev-aai-data-router-6f9ff67d68-plf4m 1/1 Running 0 2h dev-aai-elasticsearch-548b68c46f-j9b9g 1/1 Running 0 2h dev-aai-gizmo-796b95f5c5-gct2m 2/2 Running 0 2h dev-aai-hbase-868f949597-s8l7p 1/1 Running 0 2h dev-aai-modelloader-84b77ffb54-pxzss 2/2 Running 0 2h dev-aai-resources-894667dd8-rkprw 2/2 Running 0 2h dev-aai-search-data-6cbc65f459-mphxf 2/2 Running 0 2h dev-aai-sparky-be-576bbb99fd-j972w 2/2 Running 0 2h dev-aai-traversal-9bffcd7b6-fdr7t 2/2 Running 0 2h
  • 1 – single logging system across components; instantiation in < 1 hour

  • 2 –abilityto upgrade a single component; tracing across components; externalized configuration management

Usability

1

1

AAI Docs at readthedocs

Active and Available Inventory Project



  • 1 – user guide; deployment documentation; API documentation

  • 2 – UI consistency; usability testing; tutorial documentation