References

https://lf-onap.atlassian.net/browse/CPS-2626

Test Steps & Test Data

Create CM Handles
Running these tests for 15 min:
1. Passthrough Read & Write with CMHandle and AlternateID
2. CM Handle & CM Handle ID Search with filters
  1. Module
  2. Property
  3. Cps Path
  4. Trust Level
3. CM Handle & CM Handle ID Search without filters
4. Legacy Batch Read Operation
Delete CM Handles

Test Environment

Test Environment

Test Environment
Nordix Server	xerces-cps-hw [Jenkins]
CPUs	Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
Operating System	Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-126-generic x86_64)
Memory	251.0 GiB
Commit	140173: Fix for intermittent failures of module sync tests
Job	onap-cps-performance-test-k6 [Jenkins]
Docker Compose Deployment	docker-compose version `v2.29.2` application (CPS) instance - 2 or 3 depending test postgres instance - 1 #WorkerThread - 1 ( The AsyncTaskExecutor and the thread pool removed for ModuleSyncTask. Thus, there is only one thread running at a time )

Test Results

	input batch size	watchdog timer	#CPS instances CPU and Memory	avg cm-handles/second : registration	avg cm-handles/second : deregistration	comments

	input batch size	watchdog timer	#CPS instances CPU and Memory	avg cm-handles/second : registration	avg cm-handles/second : deregistration	comments
1	100	5 sec	2 instances 3 CPU 3G memory	88	120	Average of build numbers: 5929, 5930, 5931
2	500	5 sec		86	191	Average of build numbers: 5932, 5933
3	2,000	5 sec		90	211	Average of build numbers randomly picked from the range: 5934-5951
4	3,000	5 sec		87	200	Build numbers: 5955, 5956, 5957 All CM-handle and CM-handle ID searches failed
5	5,000	5 sec		0	0	Build numbers: 5952, 5953, 5954 All the builds stop working after 20 min. Reminder: Setup timeout is 20 min.
6	100	60 sec		65	130	The build number: 5958, 5959
7	100	10 sec		84	124	Average of build numbers randomly picked from the range: 5960-5976
8	100	1 sec		86	120	Average of build numbers: 5977, 5978, 5979
9	100	5 sec	3 CPS instances with 3 CPU 3G memory	80	136	Build: 5983 failed because of an intermittent infra issue. Average of build numbers: 5984, 5985
10	1,000	5 sec		95	191	Average of build numbers: 5980, 5981, 582
11	2,000	5 sec		94	199	Average of build numbers: 6002, 6003, 6005 6004 failed.
12	1,000	5 sec	3 CPS instances 2 CPU 2G memory	86	188	Average of build numbers: 6026, 6027, 6028
13	2,000	5 sec	3 CPS instances 2 CPU 2G memory	102	190	Average of build numbers: 6006, 6007, 6008

	Input batch size: 100 3 CPS instances 2 CPUs 2G Ram	Build Numbers

	Input batch size: 100 3 CPS instances 2 CPUs 2G Ram	Build Numbers
1		#6123	#6124	#6125	#6126	#6127
2	Registration of CM-handles (CM-handles/second)	84	84	84	85	88
3	De-registration of CM-handles (CM-handles/second)	121	112	119	116	125
4	CM-handle ID search with No filter (milliseconds)	1562	1442	1551	1500	1483
5	CM-handle ID search with Module filter (milliseconds)	342	283	319	293	292
6	CM-handle ID search with Property filter (milliseconds)	3310	3185	3234	3184	3219
7	CM-handle ID search with Cps Path filter (milliseconds)	3239	3233	3439	3344	3242
8	CM-handle ID search with Trust Level filter (milliseconds)	28528	26688	28448	30219	28228
9	CM-handle search with No filter (milliseconds)	16448	13905	14471	13933	13658
10	CM-handle search with Module filter (milliseconds)	18516	17943	18874	17911	18500
11	CM-handle search with Property filter (milliseconds)	20828	20075	21770	19407	22606
12	CM-handle search with Cps Path filter (milliseconds)	21141	21558	22464	23377	21925
13	CM-handle search with Trust Level filter (milliseconds)	43094	39689	44092	46152	44222
14	NCMP overhead for Synchronous single CM-handle pass-through read (milliseconds)	84	56	73	65	78
15	NCMP overhead for Synchronous single CM-handle pass-through read with alternate id (milliseconds)	176	135	151	147	174
16	NCMP overhead for Synchronous single CM-handle pass-through write (milliseconds)	102	82	92	83	92
17	NCMP overhead for Synchronous single CM-handle pass-through write with alternate id (milliseconds)	173	144	161	151	159
18	Legacy batch read operation (events/second)	120	118	114	116	116

	Input batch size: 1000 3 CPS instances 2 CPUs 2G Ram	Build Numbers ( Notes: the builds #6151 and #6153 failed! )

	Input batch size: 1000 3 CPS instances 2 CPUs 2G Ram	Build Numbers ( Notes: the builds #6151 and #6153 failed! )
1		#6147	#6148	#6149	#6150	#6152
2	Registration of CM-handles (CM-handles/second)	82	88	86	84	79
3	De-registration of CM-handles (CM-handles/second)	201	212	200	197	197
4	CM-handle ID search with No filter (milliseconds)	1468	1456	1570	1475	1412
5	CM-handle ID search with Module filter (milliseconds)	288	316	315	283	280
6	CM-handle ID search with Property filter (milliseconds)	3190	3162	3216	3290	3163
7	CM-handle ID search with Cps Path filter (milliseconds)	3189	3222	3401	3102	3420
8	CM-handle ID search with Trust Level filter (milliseconds)	27464	27070	28391	26836	29164
9	CM-handle search with No filter (milliseconds)	13947	13664	15715	13995	14144
10	CM-handle search with Module filter (milliseconds)	17046	16953	17883	17278	17836
11	CM-handle search with Property filter (milliseconds)	20124	20111	22445	20378	21651
12	CM-handle search with Cps Path filter (milliseconds)	22043	19349	23813	21569	18749
13	CM-handle search with Trust Level filter (milliseconds)	44766	40834	43506	43911	43323
14	NCMP overhead for Synchronous single CM-handle pass-through read (milliseconds)	63	78	75	76	58
15	NCMP overhead for Synchronous single CM-handle pass-through read with alternate id (milliseconds)	154	161	164	168	153
16	NCMP overhead for Synchronous single CM-handle pass-through write (milliseconds)	78	97	95	91	76
17	NCMP overhead for Synchronous single CM-handle pass-through write with alternate id (milliseconds)	149	175	167	162	149
18	Legacy batch read operation (events/second)	117	118	114	116	121

	Input batch size: 2000 3 CPS instances 2 CPUs 2G Ram	Build Numbers ( in progress )

	Input batch size: 2000 3 CPS instances 2 CPUs 2G Ram	Build Numbers ( in progress )
1		#	#	#	#	#
2	Registration of CM-handles (CM-handles/second)
3	De-registration of CM-handles (CM-handles/second)
4	CM-handle ID search with No filter (milliseconds)
5	CM-handle ID search with Module filter (milliseconds)
6	CM-handle ID search with Property filter (milliseconds)
7	CM-handle ID search with Cps Path filter (milliseconds)
8	CM-handle ID search with Trust Level filter (milliseconds)
9	CM-handle search with No filter (milliseconds)
10	CM-handle search with Module filter (milliseconds)
11	CM-handle search with Property filter (milliseconds)
12	CM-handle search with Cps Path filter (milliseconds)
13	CM-handle search with Trust Level filter (milliseconds)
14	NCMP overhead for Synchronous single CM-handle pass-through read (milliseconds)
15	NCMP overhead for Synchronous single CM-handle pass-through read with alternate id (milliseconds)
16	NCMP overhead for Synchronous single CM-handle pass-through write (milliseconds)
17	NCMP overhead for Synchronous single CM-handle pass-through write with alternate id (milliseconds)
18	Legacy batch read operation (events/second)

ONAP Wiki

NCMP CM Handle Create & Delete Test Results

Analytics

References

Test Steps & Test Data

Test Environment

Test Results

Related content