...
| Pod Deleted | Start Time (PST) | Recovery Time (MM:SS) | Pass / Fail | Logs | Notes | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | dep-config-binding-service-596688f976-tdrpz | 05:29:55 | 02:08 | PASS | ||||||||||
| 2 | dep-dcae-datafile-collector-65df56bc6b-4cj5p | 05:35:36 | 01:14 | PASS | ||||||||||
| 3 | dep-dcae-hv-ves-collector-9df8d946-nz85f | 05:39:33 | 00:45 | PASS | ||||||||||
| 4 | dep-dcae-prh-6bfbb97fdc-n2pvb | 05:43:18 | 01:09 | PASS | ||||||||||
| 5 | dep-dcae-snmptrap-collector-58bbcb6644-g9tkw | 05:47:10 | 02:36 | PASS | ||||||||||
| 6 | dep-dcae-tca-analytics-7dbddb9697-d2h8m | 05:51:14 | 03:11 | PASS | ||||||||||
| 7 | dep-dcae-ves-collector-749996c5cb-5lf6g | 05:57:39 | 01:35 | PASS | ||||||||||
| 8 | dep-deployment-handler-69dd5c4d56-5w4vc | 06:01:12 | 06:47 | PASS | ||||||||||
| 9 | dep-holmes-engine-mgmt-7bdd595854-m7d4v | 06:10:27 | 01:03 | PASS | ||||||||||
| 10 | dep-holmes-rule-mgmt-b99586579-znrhl | 06:13:14 | 01:03 | PASS | ||||||||||
| 11 | dep-inventory-9585c9d6-9jtxv | 06:16:15 | 01:14 | PASS | ||||||||||
| 12 | dep-policy-handler-775c84f5d4-tf27n | 06:19:12 | 02:37 | PASS | ||||||||||
| 13 | dep-pstg-write-f67b57947-7fmzq | 06:24:17 | 01:42 | PASS | ||||||||||
| 14 | dep-service-change-handler-b8cf87787-dzwcq | 06:28:12 | 01:35 | PASS | ||||||||||
| 15 | dev-aai-aai-64dd9545fc-tlj5s | 06:31:15 | 01:04 | PASS | ||||||||||
| 16 | dev-aai-aai-babel-7cb986869d-4qfxs | 06:34:17 | 01:36 | PASS | ||||||||||
| 17 | dev-aai-aai-cassandra-0 | 06:37:37 | 01:14 | PASS | ||||||||||
| 18 | dev-aai-aai-champ-6b6d4779d8-9drmz | 06:40:35 | 04:14 | PASS | ||||||||||
| 19 | dev-aai-aai-data-router-6b4776bfc4-8hb4k | 06:46:18 | 09:01 | PASS | ||||||||||
| 20 | dev-aai-aai-elasticsearch-669f4664c-wcclz | 06:57:17 | 01:13 | PASS | ||||||||||
| 21 | dev-aai-aai-gizmo-9df94f898-dg79k | 07:01:14 | 04:50 | PASS | ||||||||||
| 22 | dev-aai-aai-graphadmin-5d6d4d86dc-6shv6 | 07:08:18 | 02:50 | PASS | ||||||||||
| 23 | dev-aai-aai-modelloader-54f7444dcd-qnftb | 07:14:22 | 01:06 | PASS | ||||||||||
| 24 | dev-aai-aai-resources-8579748958-wwf5m | 07:16:26 | 03:14 | PASS | ||||||||||
| 25 | dev-aai-aai-search-data-695b878655-tff7s | 07:22:08 | 01:06 | PASS | ||||||||||
| 26 | dev-aai-aai-sparky-be-9bcc99756-ztfcg | 07:26:14 | 17:05 | PASS | ||||||||||
| 27 | dev-aai-aai-spike-59c6db6574-v6dfj | 07:46:19 | 03:51 | PASS | ||||||||||
| 28 | dev-aai-aai-traversal-7f5669d56-55rnr | 07:51:39 | 01:41 | PASS | ||||||||||
| 29 | dev-appc-appc-0 | 07:56:18 | 58:38 | FAIL | APPC took 75 minutes to recover. The testing was done against a single node APPC due to
| |||||||||
| 30 | dev-appc-appc-ansible-server-c4678946c-qncqx | 08:55:11 | 32:10 | PASS | ||||||||||
| 31 | dev-appc-appc-cdt-868f9896b-82mlj | 09:31:39 | 00:40 | PASS | ||||||||||
| 32 | dev-appc-appc-db-0 | 09:35:17 | 01:41 | PASS | ||||||||||
| 33 | dev-appc-appc-dgbuilder-5d5cbfdd45-q7nbv | 09:39:26 | 02:39 | PASS | ||||||||||
| 34 | dev-dcaegen2-dcae-bootstrap-7c5c8d7d76-ng999 | 09:45:20 | 01:08 | PASS | ||||||||||
| 35 | dev-dcaegen2-dcae-cloudify-manager-67b576dd66-86kzx | 09:49:12 | 01:46 | PASS | ||||||||||
| 36 | dev-dcaegen2-dcae-db-0 | 09:53:12 | 03:10 | PASS | ||||||||||
| 37 | dev-dcaegen2-dcae-healthcheck-65c6548689-r6qbq | 09:59:07 | 02:09 | PASS | ||||||||||
| 38 | dev-dcaegen2-dcae-pgpool-78fbd864cd-hhzcv | 10:04:15 | 01:05 | PASS | ||||||||||
| 39 | dev-dcaegen2-dcae-pgpool-78fbd864cd-k8lgx | 10:06:34 | 02:46 | PASS | ||||||||||
| 40 | dev-dcaegen2-dcae-redis-0 | 10:11:32 | 02:17 | PASS | ||||||||||
| 41 | dev-dcaegen2-dcae-redis-3 | 10:16:34 | 01:35 | PASS | ||||||||||
| 42 | dev-dcaegen2-dcae-redis-4 | 10:21:09 | 01:43 | PASS | ||||||||||
| 43 | dev-dcaegen2-dcae-redis-5 | 10:25:36 | 01:35 | PASS | ||||||||||
| 44 | dev-dmaap-dbc-pg-0 | 10:30:41 | 02:07 | PASS | ||||||||||
| 45 | dev-dmaap-dbc-pgpool-7b748d5894-7sfcw | 10:35:32 | 01:04 | PASS | ||||||||||
| 46 | dev-dmaap-dbc-pgpool-7b748d5894-ngxxj | 10:38:34 | 00:44 | PASS | ||||||||||
| 47 | dev-dmaap-dmaap-bus-controller-765495b674-642jf | 10:41:34 | 01:03 | PASS | ||||||||||
| 48 | dev-dmaap-dmaap-dr-db-56b956df8d-rwffp | 10:45:05 | 01:13 | PASS | ||||||||||
| 49 | dev-dmaap-dmaap-dr-node-64864d5cc-r8ck8 | 10:49:18 | 01:10 | PASS | ||||||||||
| 50 | dev-dmaap-dmaap-dr-prov-69bd7c6665-676cf | 10:51:27 | 01:03 | PASS | ||||||||||
| 51 | dev-dmaap-message-router-647bbfc54d-h588k | 10:55:14 | 03:08 | PASS | ||||||||||
| 52 | dev-dmaap-message-router-kafka-6f54ccf867-5mkbg | 11:01:37 | 02:43 | PASS | ||||||||||
| 53 | dev-dmaap-message-router-zookeeper-847656487f-mngbc | 11:07:34 | 01:45 | FAIL | After dmaap-message-router-zookeeper was deleted, vFWCL continued to fail until dmaap-message-router was subsequently restarted manually. Logged
| |||||||||
| 54 | dev-policy-brmsgw-78db5d4db4-n6b9j | 17:15:06 | 02:15 | PASS | ||||||||||
| 55 | dev-policy-drools-0 | 17:20:05 | 02:17 | PASS | ||||||||||
| 56 | dev-policy-nexus-7d5f84d8b6-xzmwd | 17:28:28 | 02:15 | PASS | ||||||||||
| 57 | dev-policy-pap-9cb89bf74-5cfmt | 17:33:14 | 02:39 | PASS | ||||||||||
| 58 | dev-policy-pdp-0 | 17:39:23 | 01:38 | PASS | ||||||||||
| 59 | dev-policy-policy-apex-pdp-0 | 17:44:00 | 02:48 | PASS | ||||||||||
| 60 | dev-policy-policydb-74d46689cb-fmrc6 | 17:55:16 | 02:44 | PASS | ||||||||||
| 61 | dev-policy-policy-distribution-75b76b55f7-drknk | 17:50:01 | 03:15 | PASS |
Closed Loop
Requirement
Area | Priority | Min. Level | Stretch Goal | Level Descriptions (Abbreviated) |
Resiliency | High | Level 2 – run-time projects | Level 3 – run-time projects | •1 – manual failure and recovery (< 30 minutes) |