Table of Contents |
---|
Jira Legacy | ||||||||
---|---|---|---|---|---|---|---|---|
|
...
- NCMP REST Interface will follow/be inspired by RESTConf interface for easy acceptance of and transition to this interface
- Will follow ONAP's RESTful API Design Specification
- The interface will include the concept of data-stores inspired by Network Management Datastore Architecture (NMDA) and as used in RESTConf
- The application should be able to easily switch between 'pass-through' and other datastores (also identical rest endpoint and responses)
References
Follow principles/patterns of RESTCONF RFC-8040 https://datatracker.ietf.org/doc/html/rfc8040
Follow principles/patterns of yang-patch RFC-8072 https://datatracker.ietf.org/doc/html/rfc8040
Follow principles/patterns of RESTCONF NMDA RFC-8527 https://datatracker.ietf.org/doc/html/rfc8527
...
It is proposed that reported characteristics will be used as a baseline for NCMP when agreed and sign-off.
Operation | Total CM-handles registered | Concurrent requests/parallel | DMI Delay | Rest response size | Performance | Observed Rate (rate not measured) | Expected duration | Sign-Off | |
---|---|---|---|---|---|---|---|---|---|
1 | Registration of 100 CM-handles | 20k Nodes | 1 (requests are sequential) | 100 ms to get module references | N/A | 1.6 ops/second | TBD | TDB | |
2 | De-registration of 100 CM-handles | 20k Nodes | 1 (requests are sequential) | N/A | N/A | ||||
3 | CM-handle search without filter | 20k Nodes | 5 | N/A | TBD e.g. 10MB | Within 15 sec | 5 ops/minute | 1 minute / operation | TDB |
4 | CM-handle ID search without filter | 20k Nodes | 5 | N/A | TBD e.g. 1MB | Within 2 sec | 7.1 ops/minute | 42 seconds / operation | TDB |
5 | Synchronous single CM-handle pass-through read | 20k Nodes | 20 | TDB e.g. 5 KB | 25 op/sec | 50 ops/second | TBD | TDB | |
6 | Synchronous single CM-handle response time read | 20k Nodes | 20 | N/A | within 1 sec | ||||
7 | Synchronous single CM-handle pass-through write | 20k Nodes | 20 | N/A | N/A | 13 ops/sec | 13 ops/second | TBD | TDB |
8 | Synchronous single CM-handle response time write | 20k Nodes | 20 | N/A | Within 2 sec |
Note
- This is for mixed TCs
- Single KPIs will be monitored in NCMP owned pipeline with our performance every day(2 hrs interval) - Performance
- New BATCH KPI - TBD
- Organise a call to walk through the code and TCs with ETH//. Want to see the code of the Test Cases. Csaba Szabó to walkthrough TCs with CPS team
- Check Registration & de-reg agree with them //
Open Questions
- Concurrent which number are we agreeing to test, 10 parallel op. according to the input load, the average response time as mentioned in comment is 20 parallel op
- DMI delay - We need feed back from ETH on this
- Better to have R, W use cases separated as in the FS for both throughput and response time or should we merge this on NCMP
- Check Registration - Kolawole Adebisi-Adeolokun Refer to Michelle's email
- Check DE-Registration if that was ever agreedRegistration if this was ever agreed
Ongoing Discussion
- Share Test cases per KPI with CPS. AP @Csaba Szabó X to walkthrough TCs with Toine & Daniel(CPS)
- Functional Specification document.
- Confluence: Configuration Handling Functional Specification.
i. Current content shows mixed testcases, all TCs happening in parallel. AP @Csaba Kocsis Clarify what is being run in parallel and update table accordingly.
ii. AP @Csaba Kocsis update UseCase_0005_IdSearch_NoFilter & UseCase_0008_Search_NoFilter to merge the Input Load column to show total of 5 parallel requests.
iii. AP @Csaba Kocsis Notify Product Engineering (Dagda) about the change.
- AP , @Csaba Kocsis , @Toine Siebelink, @Kolawole Adeolokun: Review the FS and identify if additional information is required. ONGOING
i. 23rd April: FS reviewed and 2 comments added by Toine.
- Question about FS and Stability test strategy – what is expected to be supported in parallel or what is expected to be tested in series? How is that decided? AP Michelle & @Csaba Kocsis
- Can FS to be updated to define single / individual workload. Where can it be tested? AP @Kieran Mccarthy A, @Csaba Kocsis, @Toine Siebelink
Synchronous single cm-handle pass-through (read) requests
...
Expand | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
...
Expand | ||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
...