Beijing Specific Tests
Test No. | Category (Stability, Resiliency, ConfigScaleOut, Scalability) | Description | Status (Not Started, In-Progress, Pass, Fail) | Notes |
|---|---|---|---|---|
| 1 | Stability | Execute Restart Test for 72 hour period | Pass | Tested against Amsterdam code due to defect APPC-658 which prevents DMaaP messages from being received or sent. Test results and notes can be found at: ONAP APPC 72 Hour Stability Test Results |
| 2 | Stability | Execute Rebuild Test for 72 hour period | Pass | Tested against Amsterdam code due to defect APPC-658 which prevents DMaaP messages from being received or sent. Test results and notes can be found at: ONAP APPC 72 Hour Stability Test Results |
| 3 | Stability | Execute Start Test for 72 hour period | Pass | Tested against Amsterdam code due to defect APPC-658 which prevents DMaaP messages from being received or sent. Test results and notes can be found at: ONAP APPC 72 Hour Stability Test Results |
| 4 | Stability | Execute Stop Test for 72 hour period | Pass | Tested against Amsterdam code due to defect APPC-658 which prevents DMaaP messages from being received or sent. Test results and notes can be found at: ONAP APPC 72 Hour Stability Test Results |
| 5 | Resiliency | Verify that loss of one MYSQL slave instance does not impact DB availability. | Pass (on Carbon ODL) Pass (on Nitrogen ODL) | Since MariaDB and Galera support is not being introduced in this release, this test involves terminating the one MySQL instance and verifying that Kubernetes brings the instance back up successfully. |
| 6 | Resiliency | Verify that loss of one APPC controller instance does not impact application availability | Pass (on Carbon ODL) Pass (on Nitrogen ODL) | Loss of one APPC controller instance does not impact application availability. |
| 7 | Scalability | Scale (up or down) MySQL dynamically. | Fail | Dynamic scaling for the database is scheduled to be supported with the introduction of MariaDB and Galera in a future release. |
| 8 | Scalability | Scale (up or down) APPC controller dynamically. | Pass (on Carbon ODL) Testing in Progress (on Nitrogen ODL) | The APPC controller can be dynamically scaled, preserving the correct ODL configuration. |
| 9 | ConfigScaleOut | |||
Regression Tests
TC No. | Action | Heat | OOM | LCM API Provider | APPC Provider | Via DGOrchestrator | Direct to OpenStack | Thru MultiVIM | Query AAI | NetConf | Via DMaaP | Status | Notes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ModifyConfig | N/A | vFW | |||||||||||
| Healthcheck | Yes | Yes | Need jar containing simulator with a service running in order to test. | ||||||||||
| Restart | Yes | Yes* | Yes | Yes | Yes | Yes | Yes | Pass | |||||
| Restart | Yes | Yes | Yes | Yes | Yes | This test is using the Generic_Restart DG designed to allow for VIM. | |||||||
| Restart | Yes | Yes* | Yes | Yes | No | No | Pass | ||||||
| Restart | Yes* | Yes | Yes | Pass | |||||||||
| Stop | Yes | Yes* | Yes | Yes | Yes | Yes | Yes | Pass | |||||
| Start | Yes | Yes* | Yes | Yes | Yes | Yes | Yes | Pass | |||||
| Rebuild | Yes | Yes* | Yes | Yes | Yes | Yes | Yes | Pass | |||||
| Rebuild | Yes | Yes* | Yes | Yes | No | Pass | 2018-04-26 14:04:12,445 | INFO | p1257028015-1480 | eelf | 401 - appc-common - 1.3.0.SNAPSHOT - - | APPC0120I Rebuild '1' finished with status SUCCESS. Reason: Success | ||||||
| Snapshot | Yes | Yes** | Yes | Yes | No | No | Partial | Snapshot created successfully but the image verification failed due to APPC-869. | |||||
| *For OOM - APPC MySQL sql_mode differs from the standard OOM MySQL deployment due to restrictions when sql_mode has "only_full_group_by" enabled. APPC-878 |