Beijing Specific Tests
Test No. | Category (Stability, Resiliency, ConfigScaleOut, Scalability) | Description | Status (Not Started, In-Progress, Pass, Fail) | Notes |
---|---|---|---|---|
1 | Stability | Execute Restart Test for 72 hour period | ||
2 | Stability | Execute Rebuild Test for 72 hour period | ||
3 | Stability | Execute Start Test for 72 hour period | ||
4 | Stability | Execute Stop Test for 72 hour period | ||
5 | Stability (Heat) | Execute 72 hour test with steady stream of Restarts, Rebuilds, Start, and Stop actions in an Heat deploy DCAE environment | Pass | |
6 | Stability (OOM) | Execute 72 hour test with steady stream of Restarts, Rebuilds, Start, and Stop actions in an OOM clustered DCAE environment | In-Progress | |
7 | Resiliency | Verify that loss of one MYSQL slave instance does not impact DB availability. | ||
8 | Resiliency | Verify that loss of one APPC controller instance does not impact application availability | . | |
9 | Scalability | Scale (up or down) MySQL dynamically. | ||
10 | Scalability | Scale (up or down) APPC controller dynamically. | ||
11 | ConfigScaleOut | |||
12 | CDT connect to APPC runtime | |||
Regression Tests
TC No. | Action | Heat | OOM | LCM API Provider | APPC Provider | Via DGOrchestrator | Direct to OpenStack | Thru MultiVIM | Query AAI | NetConf | Via DMaaP | Status | Notes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | ModifyConfig | Yes | Yes* | N/A | Yes | Yes | Pass | vFW/pgsteam change regression use case | |||||
2 | Healthcheck | Yes | Yes | Need jar containing simulator with a service running in order to test. | |||||||||
3 | Restart | Yes | Yes* | Yes | Yes | Yes | Yes | Yes | Pass | ||||
4 | Restart | Yes | Yes | Yes | Yes | Yes | Pass | This test is using the Generic_Restart DG designed to allow for VIM. | |||||
5 | Restart | Yes | Yes* | Yes | Yes | No | No | Pass | |||||
6 | Restart | Yes* | Yes | Yes | Pass | ||||||||
7 | Stop | Yes | Yes* | Yes | Yes | Yes | Yes | Yes | Pass | ||||
8 | Start | Yes | Yes* | Yes | Yes | Yes | Yes | Yes | Pass | ||||
9 | Rebuild | Yes | Yes* | Yes | Yes | Yes | Yes | Yes | Pass | ||||
10 | Rebuild | Yes | Yes* | Yes | Yes | No | Pass | 2018-04-26 14:04:12,445 | INFO | p1257028015-1480 | eelf | 401 - appc-common - 1.3.0.SNAPSHOT - - | APPC0120I Rebuild '1' finished with status SUCCESS. Reason: Success | |||||
11 | Snapshot | Yes | Yes* | Yes | Yes | No | No | Partial | Snapshot created successfully but the image verification failed due to APPC-869. | ||||
*For OOM - APPC MySQL sql_mode differs from the standard OOM MySQL deployment due to restrictions when sql_mode has "only_full_group_by" enabled. APPC-878 |