/
NCMP CM Handle Create & Delete Test Results

NCMP CM Handle Create & Delete Test Results

Owned by Halil Cakal
Last updated: Mar 05, 2025
3 min read

References

CPS-2626: Optimize registration parameters (testing)Closed

Test Steps & Test Data

  1. Create CM Handles

  2. Running these tests for 15 min:

    1. Passthrough Read & Write with CMHandle and AlternateID

    2. CM Handle & CM Handle ID Search with filters

      1. Module

      2. Property

      3. Cps Path

      4. Trust Level

    3. CM Handle & CM Handle ID Search without filters

    4. Legacy Batch Read Operation

  3. Delete CM Handles

Test Environment

Test Environment

Test Environment

Nordix Server

https://jenkins.nordix.org/label/xerces-cps-hw/

CPUs

Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz

Operating System

Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-126-generic x86_64)

Memory

251.0 GiB

Commit

140173: Fix for intermittent failures of module sync tests

Job

https://jenkins.nordix.org/job/onap-cps-performance-test-k6/

Docker Compose Deployment

docker-compose version v2.29.2

application (CPS) instance - 2 or 3 depending test

postgres instance - 1

#WorkerThread - 1 ( The AsyncTaskExecutor and the thread pool removed for ModuleSyncTask. Thus, there is only one thread running at a time )

Test Results for only Registration & Deregistration APIs

input batch size

watchdog timer

#CPS instances
CPU and Memory

avg cm-handles/second : registration

avg cm-handles/second : deregistration

comments

input batch size

watchdog timer

#CPS instances
CPU and Memory

avg cm-handles/second : registration

avg cm-handles/second : deregistration

comments

1

100

5 sec

  • 2 instances

    • 3 CPU

    • 3G memory

88

120

Average of build numbers: 5929, 5930, 5931

2

500

5 sec

86

191

Average of build numbers: 5932, 5933

3

2,000

5 sec

90

211

Average of build numbers randomly picked from the range: 5934-5951

4

3,000

5 sec

87

200

Build numbers: 5955, 5956, 5957
All CM-handle and CM-handle ID searches failed

5

5,000

5 sec

0

0

Build numbers: 5952, 5953, 5954
All the builds stop working after 20 min. Reminder: Setup timeout is 20 min.

6

100

60 sec

65

130

The build number: 5958, 5959

7

100

10 sec

84

124

Average of build numbers randomly picked from the range: 5960-5976

8

100

1 sec

86

120

Average of build numbers: 5977, 5978, 5979

9

100

5 sec

  • 3 CPS instances with

    • 3 CPU

    • 3G memory

80

136

Build: 5983 failed because of an intermittent infra issue.
Average of build numbers: 5984, 5985

10

1,000

5 sec

95

191

Average of build numbers: 5980, 5981, 582

11

2,000

5 sec

94

199

Average of build numbers: 6002, 6003, 6005
6004 failed.

12

1,000

5 sec

  • 3 CPS instances

    • 2 CPU

    • 2G memory

86

188

Average of build numbers: 6026, 6027, 6028

13

2,000

5 sec

102

190

Average of build numbers: 6006, 6007, 6008

 

 

Test Results for all NCMP APIs

The commit used in this test:

Commit: 140281: retry before stopping in docker-compose | https://gerrit.onap.org/r/c/cps/+/140281

I attached the spreadsheet with details including particular test cases with results in this jira:

CPS-2626: Optimize registration parameters (testing)Closed

 

 

  • 2 CPS instances

    • 3 CPU

    • 3G memory

  • Input Batch Size

    • 100

  • Internal Batch Size

    • 100

  • 2 CPS instances

    • 3 CPU

    • 3G memory

  • Input Batch Size

    • 2,000

  • Internal Batch Size

    • 300

  • 3 CPS instances

    • 2 CPU

    • 2G memory

  • Input Batch Size

    • 100

  • Internal Batch Size

    • 100

  • 3 CPS instances

    • 2 CPU

    • 2G memory

  • Input Batch Size

    • 2,000

  • Internal Batch Size

    • 100

  • 3 CPS instances

    • 2 CPU

    • 2G memory

  • Input Batch Size

    • 2,000

  • Internal Batch Size

    • 300

  • 3 CPS instances

    • 3 CPU

    • 3G memory

  • Input Batch Size

    • 2,000

  • Internal Batch Size

    • 300

1

Registration of CM-handles (CM-handles/second)

87

99

91

104

114

118

2

De-registration of CM-handles (CM-handles/second)

120

229

126

197

212

215

3a

CM-handle ID search with No filter (ms)

969

961

1,129

1,169

1,160

838

3b

CM-handle ID search with Module filter

236

234

248

249

253

220

3c

CM-handle ID search with Property filter

2,115

2,154

2,519

2,470

2,560

1,875

3d

CM-handle ID search with Cps Path filter

2,171

2,198

2,550

2,513

2,569

1,917

3e

CM-handle ID search with Trust Level filter

10,824

10,633

24,555

24,570

24,830

11,185

4a

CM-handle search with No filter

7,993

8,162

10,123

10,191

10,101

7,025

4b

CM-handle search with Module filter

10,011

10,288

12,621

12,764

12,598

8,928

4c

CM-handle search with Property filter

11,686

11,777

15,156

15,207

15,311

10,600

4d

CM-handle search with Cps Path filter

12,327

12,407

15,240

15,524

15,613

10,628

4e

CM-handle search with Trust Level filter

21,181

21,211

36,201

36,145

37,137

20,412

5a

overhead pass-through read (ms)

34

34

37

37

39

21

5b

overhead pass-through read alternate id

88

89

100

102

99

70

6a

overhead pass-through write

40

40

49

49

50

25

6b

overhead pass-through write alternate id

89

89

99

103

101

69

7

Legacy batch read operation (events/second)

120

120

118

117

116

115

 

Related content