Metric 1: measure latency for different files sizes- 1 mb, 10mb, 100mb
Explanation: Latency metric is required to :
- A. ensure what the performance of data router is like in its typical use case.
- B. to help measure other metrics and uncover bottlenecks.
Results Summary Report:
Label | #Times Published | to Node: Average time | to Node: Min time | to Node: Max time | Error | to Node: Throughput/Minute | to subscriber: average time | to subscriber: min time | to subscriber: max time | to subscriber: throughput/minute | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|
Label | #Times Published | to Node: Average time | to Node: Min time | to Node: Max time | Error | to Node: Throughput/Minute | to subscriber: average time | to subscriber: min time | to subscriber: max time | to subscriber: throughput/minute | Notes |
| publish 0.5MB file | 100 | 0.220 | 0.207 | 0.235 | ~300 | 3.029 | 0.222 | 5.766 | 20~ | data router seems to work very well under volume: will investigate further | |
| Publish 1MB file | 100 | 0.209 | 0.200 | 0.232 | 0% | ~300 | 3.115 | 0.389 | 5.92 | ~20 | |
| Publish 10MB file | 100 | 0.313 | 0.288 | 0.372 | 0% | ~180 | 3.24 | 0.592 | 6.54 | ~20 | |
| Publish 100MB file | 100 | 1.17 | 1.035 | 5.12 (1.74) | 0% | ~51 | 4.31 | 1.149 | 7.80 | ~15 | |
| Publish 1GB file | 100 | 10.25 | 9.126 | 13.360 | 0% | ~6 | 65.35 | 20.590 | 246.561 | ~9 every 10 mins | when tested on a different environment with more ram, timing is much more consistent, and transfer typically takes between 20-30 secs |
Metric 2: N number of feeds in Parallel
Results Summary Report:
Label | #Times Published | to Node: Average time | to Node: Min time | to Node: Max time | to Node: Throughput/Minute | to subscriber: average time | to subscriber: min time | to subscriber: max time | to subscriber: throughput/minute | Notes |
|---|---|---|---|---|---|---|---|---|---|---|
| Publish 0.5mb file to 2 feeds | 100 | .258 | 0.222 | 0.311 | 3.06 | 0.597 | 6.208 | |||
| Publish 0.5mb file to 5 feeds | ||||||||||
| Publish 0.5mb file to 10 feeds | 100 | .260 | 0.209 | 1.081 | 3.13 | 0.628 | 6.98 | |||
| Publish 1mb file to 2 feeds | 100 | .268 | 0.230 | 0.365 | 3.14 | 0.718 | 6.78 | |||
| Publish 1mb file to 5 feeds | 100 | .277 | 0.234 | 0.487 | 3.17 | 0.746 | 6.91 | |||
| Publish 1mb file to 10 feeds | 100 | .292 | 0.243 | 1.044 | 3.20 | 0.856 | 7.91 | |||
| Publish 10mb file to 2 feeds | 100 | .420 | 0.367 | 0.607 | 3.38 | 0.810 | 6.54 | |||
| Publish 10mb file to 5 feeds | 100 | 0.511 | 0.402 | 0.773 | 3.497 | 0.885 | 6.60 | |||
Publish 10mb file to 10 feeds | 100 | 1.77 | 1.103 | 5.583 | 5.29 | 1.198 | 5.29 | |||
| Publish 100mb file to 2 feeds | 100 | 1.88 | 1.693 | 2.104 | 4.94 | 1.700 | 7.95 | |||
| Publish 100mb file to 5 feeds | 100 | 1.97 | 1.703 | 5.583 | 5.29 | 1.981 | 13.19 | |||
| Publish 100mb file to 10 feeds | 100 | 2.405 | 1.905 | 10.444 | 5.88 | 2.312 | 20.648 |
Metric 3: N number of subscribers for performance
Label | #Times Published | to Node: Average time | to Node: Min time | to Node: Max time | to Node: Throughput/Minute | to subscriber: average time | to subscriber: min time | to subscriber: max time | to subscriber: throughput/minute | Notes |
|---|---|---|---|---|---|---|---|---|---|---|
| Publish 0.5mb file to 2 subs | 100 | |||||||||
| Publish 0.5mb file to 5 subs | ||||||||||
| Publish 0.5mb file to 10 subs | 100 | 0.236 | 0.220 | 0.271 | 3000~ | 3.05 | 0.101 | 5.9 | ~200 | |
| Publish 1mb file to 2 subs | 100 | .2445 | 0.224 | 0.279 | 3.013 | 0.243 | 5.86 | |||
| Publish 1mb file to 5 subs | ||||||||||
| Publish 1mb file to 5 subs | ||||||||||
| Publish 10mb file to 2 subs | ||||||||||
| Publish 10mb file to 5 subs | 100 | .370 | 0.327 | 0.447 | 3.3 | 6.88 | 0.677 | |||
Publish 10mb file to 10 subs | 100 | .375 | .334 | .475 | 3.527 | 6.84 | 0.717 | |||
| Publish 100mb file to 2 subs | 100 | 1.236 | 1.113 | 1.464 | 4.453 | 1.456 | 7.93 | |||
| Publish 100mb file to 5 subs | 100 | 1.28 | 1.168 | 1.463 | 5.878 | 1.581 | 11.567 | |||
| Publish 100mb file to 10 subs | 100 | 1.3193 | 1.226 | 1.496 | 9.363 | 15.671 | 2.763 |