References:
...
https://gerrit.onap.org/r/c/cps/+/129829/5//COMMIT_MSG
| Test Environment | API | Commit id | Total number of registered cm handles | Total time taken | Actual time (Cm-hadnles)/sec) | Estimated time (Cm-hadnles/ms) | Comments |
| Ericsson Testing cluster (with Model adapter that is implementation of dmi-plugin) | ModuleSyncWatchdog (Cm Handle moves ADVISED->READY) | 1410509e33142c0c79ff0e111c63abc47f5936d3 | 1458 | 69,98,400 ms | ~ 0.2 cm handle / 1000 ms | 20 cm handle / 1000 ms | |
| Cm handle Registration | 22,78,125 ms | ~ 0.64 cm handle / 1000 ms | 30 cm handle / 1000 ms | ||||
| ModuleSyncWatchdog (Cm Handle moves ADVISED->READY) | c3596fe3a85381668598c75a1ffee4bf973a8518 | 1458 | 6,00,000 ms | ~ 2.43 cm handle / 1000 ms | 20 cm handle / 1000 ms | ||
| Cm handle Registration | 70,000 ms | ~ 20.82 cm handle / 1000 ms | 30 cm handle / 1000 ms | ||||
| ModuleSyncWatchdog (Cm Handle moves ADVISED->READY) | 6e97bc6ee9f1cb2722aafc42325918e98da5cff2 | 1458 | 5,40,000 ms | ~ 2.7 cm handle / 1000 ms | 20 cm handle / 1000 ms | ||
| Cm handle Registration | 88,000 ms | ~16.57 cm handle / 1000 ms | 30 cm handle / 1000 ms | ||||
| ModuleSyncWatchdog (Cm Handle moves ADVISED->READY) | e482e74e2dab8455d0642829005c03212936b73d (with modules-sync-watchdog.async-executor.parallelism-level:10 ) | 1458 | Unable to capture performance result as Module adapter is not able to handle concurrent requests(Csaba is working on fix) | ||||
| Cm handle Registration | |||||||
| Local Development Machine with CSIT docker deployment (with dmi-plugin that is implemented by CPS team) | |||||||
| ModuleSyncWatchdog (Cm Handle moves ADVISED->READY) | e482e74e2dab8455d0642829005c03212936b73d (with modules-sync-watchdog.async-executor.parallelism-level:10 ) | 1458 | 2,40,000 ms | ~ 6.075 cm handle / 1000 ms | 20 cm handle / 1000 ms | ||
| Cm handle Registration | 30,000 ms | ~ 48.6 cm handle / 1000 ms | 30 cm handle / 1000 ms |
Configurations:
| # | Configuration | Description |
|---|---|---|
| 1 | Number of CPS Instance | 1 |
| 2 | Total number of threads to send each batch (Register cm handle) | 4 |
| 3 | Batch size | 100 |
| 4 | To register 1458 cm handles | Used to send 15 batchs (100 cm handles in each batch) |
...
| # | Data Sync | Enabled ? |
|---|---|---|
| 1 | data-sync: cache: enabled: | false |
Scenario 1: If there is no cm handle into Advised state
...
Scenario 2: If we started registering 1458 with configuration mentioned above :
| # | Operations | Average Time elapsed (in ~ ms) | |||
|---|---|---|---|---|---|
| 1 | To save cm handle state with id | Batch #.Iteration # | Time elapsed (in ~ ms) | ||
| 1.1 | 293 | ||||
| 1.2 | 84 | ||||
| 2.1 | 14 | ||||
| 2.2 | 8 | ||||
| Average Time elapsed per cm handle (in ~ ms) | 53 | ||||
| 2 | To synchronize, create schema set and anchor with id | Batch #.Iteration # | Time elapsed (in ~ ms) | ||
| 1.1 | 38393 | ||||
| 1.2 | 599 | ||||
| 2.1 | 237 | ||||
| 2.2 | 122 | ||||
| Average Time elapsed per cm handle (in ~ ms) | 0.483 | ||||
| 3 | Delete schema set If exists with id | Batch #.Iteration # | Time elapsed (in ~ ms) | ||
| 1.1 | 17 | ||||
| 1.2 | 2 | ||||
| 2.1 | 2 | ||||
| 2.2 | 2 | ||||
| Average Time elapsed per cm handle (in ~ ms) | 11.5 | ||||
| 4 | Get cm handle state with id | Batch #.Iteration # | Time elapsed (in ~ ms) | ||
| 1.1 | 83 | ||||
| 1.2 | 7 | ||||
| 2.1 | 10 | ||||
| 2.2 | 12 | ||||
| Average Time elapsed per cm handle (in ~ ms) | 56 | ||||
| 5 | To get yang models | Batch # | Batch Size | Time elapsed (in ~ ms) | Time elapsed per cm handle (in ~ ms) |
| 1 | 601 | 63107 | 105.00 | ||
| 2 | 857 | 37337 | 43.56 | ||
| Average Time elapsed per iteration (in ~ ms) | 74.28 | ||||
| 6 | To shuffle cm handles | Batch # | Batch Size | Time elapsed (in ~ ms) | |
| 1 | 601 | 0 | |||
| 2 | 857 | 0 | |||
| Average Time elapsed per iteration (in ~ ms) | 0 | ||||
| 7 | Get / fetch cm handles by state ADVISED | Batch # | Batch Size | Time elapsed (in ~ ms) | Time elapsed per cm handle (in ~ ms) |
| 1 | 601 | 19404 | 32.28 | ||
| 2 | 857 | 3485 | 4.06 | ||
| Average Time elapsed per iteration (in ~ ms) | 18.17 | ||||
| # | Operation | Time |
|---|---|---|
| 1 | Registration of 1458 cm handles started | 04:41:00 |
| 2 | 1st ADVISED cm handle with B031D6DDF9AA4CA484727B7A497AB27D | 2022-07-15T04:40:49.307+0000 |
| 3 | 1458th ADVISED cm handle with BFAB827B9CC652EE60DD2545D55EF0CA | 2022-07-15T04:41:58.018+0000 |
| 4 | 1st READY cm handle with 47C5F63DFF44436A6C56AC684B5E48C7 | 2022-07-15T04:40:49.307+0000 |
| 5 | 1458th READY cm handle with BFAB827B9CC652EE60DD2545D55EF0CA | 2022-07-15T04:41:58.018+0000 |
Average time to make all 1458 cm handles from ADVICED to READY state is: ~ 10 minutes
...