Page Comparison

Agree on endurance performance KPI

The aim of the study is to early detection of bugs similar to

Thus, we should spot the specific function/s currently used in k6 to be improved. These function/s will be used in the Endurance test suit.

Actions:

1. Daniel Hanrahan and Lee Anjella Macabuhay can shed light on this item since they were resolving the bug.

2. After identifying the test function/s, what can we functionally do to improve them?
   The reproduction of the bug includes two more data operations that are not available in the current k6 suit:

   1. Passthrough-write (PATCH)

   2. Passthrough (DELETE) / Delete Resource Data

3. Regarding parallelism, how many VUs should be assigned to these tests?
   The suggested number of VUs with 'constant-vus' executor:

   1. Passthrough-read (READ): 4

   2. Passthrough-write (POST): 4

   3. Passthrough-write (PATCH) : 4

   4. Passthrough (DELETE) / Delete Resource Data: 4

CPS need to run all the test cases according to FS not according to what was tested in cps-2430 (Seeing they ran test that was outside of FS). Less focus on the KPI for this endurance run. Kolawole Adebisi-Adeolokun Halil Cakal

Agree on the test environment

Blocked by

1. if a new test server can be provided, then no need to have a secondary docker-compose deployment descriptor (port and container name changes)

2. if no new server can be provided, then a secondary docker-compose deployment descriptor will be necessary

   1. There will be 3 different pipelines will be running on the physical test server:

      1. CPS performance tests (groovy-based)

      2. NCMP performance tests (k6-based)

      3. NCMP Endurance tests (k6-based, long-running)

3. Team Kraken could set up test envi for us

1. No parallelism. A conversation with Kraken to discuss option #3 Halil Cakal

2. The discussion was made with Team Kraken and decided to have two docker-compose deployments on the test server. Daniel Hanrahan Halil Cakal Toine Siebelink 29 Oct 2024

   1. The PoC has been done on Nordix.
      PoC using two docker-compose using an environment file

3. The number of available executors should be sufficient to run a possible three jobs on the physical performance test server. Daniel Hanrahan Toine Siebelink Kolawole Adebisi-Adeolokun Halil Cakal 14 Nov 2024

Visualization of memory trend

The most convenient way to represent the memory usage trend in a GUI is Grafana.

1. Grafana

2. GNUPlot (3pp library current in the use of k6 and Groovy test Visualization)

   1. If Gnuplot is to visualize memory usage, which parameters, logs, or output should be input?

   2. Issue #4 (external access) will no longer be valid. Since Jenkin’s HTML publisher can do it.

Agreed to use Grafana majorly because it allows storage for longer periods sticking with our A/C Kolawole Adebisi-Adeolokun Halil Cakal

The same decision was made by Daniel Hanrahan and Halil Cakal during the daily stand-up. 25 Nov 2024

Note: A PoC for the GNUPlot option has been made, please see the relevant Jira ticket details. Daniel Hanrahan Halil Cakal Toine Siebelink 29 Oct 2024

Grafana access externally (If Grafana is selected at #3 then this issue should be discussed, otherwise ignore)

1. Make local GUI link accessible externally

2. Give server access to the CPS team

Team Kraken support is needed either way.

Since Grafana is the preferred option, access issues shall be discussed with team Kraken Halil Cakal (consider Jenkins plug-in option as well)7

• Discussed with Team Kraken and will revisit this option after having a secondary docker-compose deployment and their pipelines. Daniel Hanrahan Halil Cakal Toine Siebelink 29 Oct 2024

Permanent storage (DB) for Grafana (If Grafana is selected at #3 then this issue should be discussed, otherwise, ignore)

Investigate the solution strategy for the storage e.g. a permanent service 7/24 running …

Halil Cakal to investigate how to tune the volume

Add new test profile ‘Endurance’

Add new Jenkins job to run endurance test

Add Grafana support to visualize memory usage pattern

Two docker-compose deployments simultaneously

Agree and Define new ‘Suite’ (js)