DMaaP Data Router Performance Test Results

Owned by Emmett Cox
Last updated: Nov 08, 2018
1 min read

Metric 1: measure latency for different files sizes- 1 mb, 10mb, 100mb

Explanation: Latency metric is required to :

  • A. ensure what the performance of data router is like in its typical use case.

  • B. to help measure other metrics and uncover bottlenecks.

Results Summary Report:

Label

#Times Published

to Node: Average time

to Node: Min time

to Node: Max time

Error

to Node: Throughput/Minute

to subscriber: average time

to subscriber: min time

to subscriber: max time

to subscriber: throughput/minute

Notes

Label

#Times Published

to Node: Average time

to Node: Min time

to Node: Max time

Error

to Node: Throughput/Minute

to subscriber: average time

to subscriber: min time

to subscriber: max time

to subscriber: throughput/minute

Notes

publish 0.5MB file

100

0.220

0.207

0.235



~300

3.029

0.222

5.766

20~

data router seems to work very well under volume: will investigate further

Publish 1MB file

100

0.209

0.200

0.232

0%

~300

3.115

0.389

5.92

~20



Publish 10MB file

100

0.313

0.288

0.372

0%

~180

3.24

0.592

6.54

~20



Publish 100MB file

100

1.17

1.035

5.12 (1.74)

0%

~51

4.31

1.149

7.80

~15



Publish 1GB file

100

10.25

9.126

13.360

0%

~6

65.35

20.590

246.561

~9 every 10 mins

when tested on a different environment with more ram, timing is much more consistent, and transfer typically takes between 20-30 secs



Metric 2: N number of feeds in Parallel

Results Summary Report:

Label

#Times Published

to Node: Average time

to Node: Min time

to Node: Max time

to Node: Throughput/Minute

to subscriber: average time

to subscriber: min time

to subscriber: max time

to subscriber: throughput/minute

Notes

Label

#Times Published

to Node: Average time

to Node: Min time

to Node: Max time

to Node: Throughput/Minute

to subscriber: average time

to subscriber: min time

to subscriber: max time

to subscriber: throughput/minute

Notes

Publish 0.5mb file to 2 feeds

100

.258

0.222

0.311



3.06

0.597

6.208





Publish 0.5mb file to 10 feeds

100

.260

0.209

1.081



3.13

0.628

6.98





Publish 1mb file to 2 feeds

100

.268

0.230

0.365



3.14

0.718

6.78





Publish 1mb file to 5 feeds

100

.277

0.234

0.487



3.17

0.746

6.91





Publish 1mb file to 10 feeds

100

.292

0.243

1.044



3.20

0.856

7.91





Publish 10mb file to 2 feeds

100

.420

0.367

0.607



3.38

0.810

6.54





Publish 10mb file to 5 feeds

100

0.511

0.402

0.773



3.497

0.885

6.60





Publish 10mb file to 10 feeds

100

1.77

1.103

5.583



5.29

1.198

5.29





Publish 100mb file to 2 feeds

100

1.88

1.693

2.104



4.94

1.700

7.95





Publish 100mb file to 5 feeds

100

1.97

1.703

5.583



5.29

1.981

13.19





Publish 100mb file to 10 feeds

100

2.405

1.905

10.444



5.88

2.312

20.648







Metric 3: N number of subscribers for performance

Label

#Times Published

to Node: Average time

to Node: Min time

to Node: Max time

to Node: Throughput/Minute

to subscriber: average time

to subscriber: min time

to subscriber: max time

to subscriber: throughput/minute

Notes

Label

#Times Published

to Node: Average time

to Node: Min time

to Node: Max time

to Node: Throughput/Minute

to subscriber: average time

to subscriber: min time

to subscriber: max time

to subscriber: throughput/minute

Notes

Publish 0.5mb file to 10 subs

100

0.236

0.220

0.271

3000~

3.05

0.101

5.9

~200



Publish 10mb file to 5 subs

100

.370

0.327

0.447



3.3

6.88

0.677





Publish 10mb file to 10 subs

100

.375

.334

.475



3.527

6.84

0.717





Publish 100mb file to 2 subs

100

1.236

1.113

1.464



4.453

1.456

7.93





Publish 100mb file to 5 subs

100

1.28

1.168

1.463



5.878

1.581

11.567





Publish 100mb file to 10 subs

100

1.3193

1.226

1.496



9.363

15.671

2.763