APPC Casablanca Testing Scope and Status
- Lathishbabu Ganesan
- Joss Armstrong
Casablanca Specific Tests
Test No. | Category (Stability, Resiliency, Scalability) | Description | Status (Not Started, In-Progress, Pass, Fail) | Notes |
|---|---|---|---|---|
1 | Stability | Execute Restart Test for 72 hour period | PASS Single instance of restart test executed successfully from JMX - 5/11 All tests executed successfully 16:50GMT 6/11 72 hour Stability test started 16:52GMT Stability test abandoned due to DMaaP errors from JMX Edited JMX to use randomised consumerGroup in DMaaP call to fix DMaaP errors and restarted test at 11:55pm. Test succeeding for first 20 minutes and VMs being start stop rebuild restart succesfully Test ongoing at 7:30AM GMT 11/9 - still logging successes in JTL file and successfully carrying out start/stop/restart/rebuild operations on VMs as confirmed from Windriver OpenStack GUI. Test ongoing at 5:00PM GMT 11/9 Test completed at 11:56pm GMT 11/9    | 
|
2 | Stability | Execute Rebuild Test for 72 hour period | PASS Test started 11/10 01:10GMT nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_run72hr_01:10GMT_11_10.jtl >/dev/null 2>&1 &
|
|
3 | Stability | Execute Start Test for 72 hour period | PASS Test started 19:54GMT 11/28 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_11_28_19_54.jtl >/dev/null 2>&1 & Tests running successfully 10:00GMT 11/29 Tests running successfully 18:00GMT 11/29 Tests running successfully 08:00GMT 11/30 Tests running successfully 18:00GMT 11/30 Tests running successfully 11:00GMT 12/1 Test completed successfully 19:54GMT 12/1
| |
4 | Stability | Execute Stop Test for 72 hour period | PASS Test started 21:00GMT 12/1 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_12_01_21_00.jtl >/dev/null 2>&1 & Tests running successfully 14:00GMT 12/2 Tests running successfully 08:00GMT 12/3 Tests running successfully towards 1/3 of VMs 08:00GMT 12/4 Tests running successfully towards 1/3 of VMs 18:00GMT 12/4 Tests completed successfully towards 1/3 of VMs 21:00GMT 12/4
| |
Regression Tests
TC No. | Action | Heat | OOM | LCM API Provider | Query AAI | NetConf | Via DMaaP | Status | Notes |
|---|---|---|---|---|---|---|---|---|---|
1 | Healthcheck | Yes | Yes | Yes | Yes | NA | Yes | Passed |
|
2 | Config Modify | Yes | Yes | Yes | Yes | Yes | Yes | Passed |
|
3 | Restart | Yes | Yes | Yes | Yes | NA | Yes | Passed |
|
4 | Rebuild | Yes | Yes | Yes | Yes | NA | Yes | Passed |
|
5 | Stop | Yes | Yes | Yes | Yes | NA | Yes | Passed |
|
6 | Start | Yes | Yes | Yes | Yes | NA | Yes | Passed |
|
7 | Reboot | Yes | Yes | Yes | Yes | NA | Yes | Passed | Fixed APPC-1226 |
Postman Collection for Regression Testing
Refer Testing with Postman page to work in postman
Use Regression Test Scripts & Windriver Environment to test all the above test cases.