Beijing-RC2-s3p

Beijing Release Platform Maturity



S3P/Maturity Area

Committed Beijing Level

Test

Result

S3P/Maturity Area

Committed Beijing Level

Test

Result

Performance

Level 1



baseline performance criteria identified and measured

Perf Test is executed and measured the response time for random beijing CLIs.

Here is the reports

cli-s3p-day-1.txt

cli-s3p-day-2.txt

cli-s3p-day-3.txt

NOTE: Both Perf and stability tests are conducted simultaneously.

Stability

Level 1 -



72    hour    component    level    soak    w/random    

transactions



For 72 hours, ONAP CLI is soaked with random beijing CLI with different kind of samples.

OCLIP is stable and does not break in between.

Here is the report:

cli-s3p-day-1.txt

cli-s3p-day-2.txt

cli-s3p-day-3.txt

NOTE: Both Perf and stability tests are conducted simultaneously.

Resiliency

Level 1    



manual failure and recovery (< 30 minutes)

As part of testing, OCLIP was crashing due to some jline jar issues and is fixed now.

No crash occurred during the test

It can be started with in a minute manually.

Security

Level 1



 CII    Passing    badge    +    50%    test    coverage

CII passing

73.4 % coverage

Scalability

Level 1



single    site    horizontal    scaling



CLI is tested in a ONAP OOM and Heat based deployment on a given site.

NOTE: stand-alone deployment would help to install multiple instances of CLI.

And currently it scales across multiple versions of the product, ONAP amsterdam and

beijing. 250+ CLIs from single installation.

Manageability

Level 1

single    logging    system    across    components;    instantiation    in    

<    1    hour

Installation by docker/zip (takes less than a minute)

Logging for troubleshooting in place



Usability

Level 2

user    guide;    deployment documentation;    API    

documentation;    adherence    to    coding    guidelines

http://onap.readthedocs.io/en/latest/submodules/cli.git/docs/

tutorial