Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The APPC 72 Hour Stability Test was kicked off at 10:30 pm ET on Thursday March 22, 2018.  The APPC environment reamined up and processed requests during the entire test period without crashing.

Environment

...

  • The test was executed for 72 hours with the APPC environment remaining up and successfully processing transactions during that time.
  • The results from the test are logged in the APPC-LCM-Action-V1.jtl file on the Test Client Server
  • The APPC application logs logged the results on the APPC side:
    • karaf.log
    • Service Logic logs (DG logs)
  • Notes/Observations:
    • The performance monitor collecting statistics for the APPC VM CPU, Memory etc... crashed during the test.  A cronjob will be created going forward to check for the existance of the client running on APPC and will restart the process if it is down.  This is not APPC code but is part of the JMeter Performance monitoring plugin.


Code Block
titleSample Stop Request:

...

From :
Code Block
from the
JTL
Log
1521776330123,18013,Stop Transaction Controller,,"Number of samples in transaction : 4, number of failing samples : 3",Stability-Test-VM2 LCM  Group 2-1,,false,,2231,2180,1,3,18013,90014,3
1521776438150,3,Submit request via DMaaP,200,OK,Stability-Test-VM2 LCM  Group 2-1,text,true,,332,1223,1,3,3,0,0

...

From :
Code Block
titleSample Restart
from the
JTL
Log
1521947136559,18013,Restart Transaction Controller,,"Number of samples in transaction : 4, number of failing samples : 3",Stability-Test-VM1 LCM                                                                                        Group 1-1,,false,,2238,2192,1,3,18013,9019,1
1521947163591,5,Submit request via DMaaP,200,OK,Stability-Test-VM1 LCM  Group 1-1,text,true,,333,1232,1,3,5,0,0

Code Block
titleSample Rebuild

...

From the JTL Log:
Code Block
from the JTL Log
1521947085508,18014,Rebuild Transaction Controller,,"Number of samples in transaction : 4, number of failing samples : 3",Stability-Test-VM3 LCM                                                                                        Group 3-1,,false,,2238,2192,1,3,18014,9024,0
1521947112546,3,Submit request via DMaaP,200,OK,Stability-Test-VM3 LCM  Group 3-1,text,true,,333,1232,1,3,3,0,1
1521947115550,6003,SYNC(accepted/rejectd) response via DMaaP,429,429,Stability-Test-VM3 LCM  Group 3-1,text,false,,635,320,1,3,6003,0,0

...

Screenshot for Rebuild (Shows a Stop, Rebuild and Start command in the karaf.log):


:
Code Block
titleFrom
the
karaf.log
Rebuild
(Shows
Stop,
Rebuild
and
Start)
2018-03-25 17:29:37,335 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 15 * Sending client request on thread appc-dispatcher-11923
15 > POST http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14/action
15 > Accept: application/json
15 > Content-Type: application/json
15 > X-Auth-Token: 631eac03151d4b5d82bc8a70866194cf
{
  "os-stop" : { }
}

2018-03-25 17:29:37,395 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 11 * Sending client request on thread appc-dispatcher-11918
11 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
11 > Accept: application/json
11 > X-Auth-Token: b965f1a53a834a679374e9a08daae178

2018-03-25 17:29:37,633 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 15 * Client response received on thread appc-dispatcher-11923
15 < 202
15 < Content-Length: 0
15 < Content-Type: application/json
15 < Date: Sun, 25 Mar 2018 17:29:44 GMT
15 < Openstack-Api-Version: compute 2.1
15 < Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version
15 < X-Compute-Request-Id: req-7badb1d4-2eb2-4990-b55c-4831a96a81f9
15 < X-Openstack-Nova-Api-Version: 2.1

2018-03-25 17:29:37,639 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 16 * Sending client request on thread appc-dispatcher-11923
16 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
16 > Accept: application/json
16 > X-Auth-Token: 631eac03151d4b5d82bc8a70866194cf

2018-03-25 17:29:37,817 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 11 * Client response received on thread appc-dispatcher-11918
11 < 200
11 < Content-Length: 2764
11 < Content-Type: application/json
11 < Date: Sun, 25 Mar 2018 17:29:44 GMT
11 < X-Compute-Request-Id: req-ad6c8dd7-25dd-44b3-b992-16a73b920290
{"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": "powering-off", "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:40:2a", "version": 4, "addr": "10.10.5.18", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:8f:9f:e9", "version": 4, "addr": "10.12.6.130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "10.0.0.18", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "bookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "71a5076a-c63b-418e-8027-05965db747c4", "mtu": 1500, "mac_address": "fa:16:3e:bf:40:2a", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2018-03-25T17:29:27.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "ACTIVE", "updated": "2018-03-25T17:29:44Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}

2018-03-25 17:29:37,989 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 16 * Client response received on thread appc-dispatcher-11923
16 < 200
16 < Content-Length: 2764
16 < Content-Type: application/json
16 < Date: Sun, 25 Mar 2018 17:29:44 GMT
16 < X-Compute-Request-Id: req-9c4e58ac-be24-4ca0-a68c-55383da61bee
{"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": "powering-off", "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:40:2a", "version": 4, "addr": "10.10.5.18", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:8f:9f:e9", "version": 4, "addr": "10.12.6.130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "10.0.0.18", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "bookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "71a5076a-c63b-418e-8027-05965db747c4", "mtu": 1500, "mac_address": "fa:16:3e:bf:40:2a", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2018-03-25T17:29:27.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "ACTIVE", "updated": "2018-03-25T17:29:44Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}

2018-03-25 17:30:38,827 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 20 * Sending client request on thread appc-dispatcher-11923
20 > POST http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14/action
20 > Accept: application/json
20 > Content-Type: application/json
20 > X-Auth-Token: 631eac03151d4b5d82bc8a70866194cf
{
  "rebuild" : {
    "imageRef" : "6e219e86-cd94-4989-9119-def29aa10b12"
  }
}

2018-03-25 17:30:38,950 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 14 * Client response received on thread appc-dispatcher-11918
14 < 200
14 < Content-Length: 2741
14 < Content-Type: application/json
14 < Date: Sun, 25 Mar 2018 17:30:45 GMT
14 < X-Compute-Request-Id: req-dde535a4-f2be-499b-863c-b387398fa93f
{"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": null, "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:40:2a", "version": 4, "addr": "10.10.5.18", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:8f:9f:e9", "version": 4, "addr": "10.12.6.130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "10.0.0.18", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "bookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "71a5076a-c63b-418e-8027-05965db747c4", "mtu": 1500, "mac_address": "fa:16:3e:bf:40:2a", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "stopped", "OS-SRV-USG:launched_at": "2018-03-25T17:29:27.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "OS-EXT-STS:power_state": 4, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "SHUTOFF", "updated": "2018-03-25T17:30:45Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}



2018-03-25 17:33:31,823 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 30 * Sending client request on thread appc-dispatcher-11923
30 > POST http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14/action
30 > Accept: application/json
30 > Content-Type: application/json
30 > X-Auth-Token: 631eac03151d4b5d82bc8a70866194cf
{
  "os-start" : { }
}

2018-03-25 17:33:32,148 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 30 * Client response received on thread appc-dispatcher-11923
30 < 202
30 < Content-Length: 0
30 < Content-Type: application/json
30 < Date: Sun, 25 Mar 2018 17:33:39 GMT
30 < Openstack-Api-Version: compute 2.1
30 < Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version
30 < X-Compute-Request-Id: req-9b360b35-f66f-4268-8376-32bade996697
30 < X-Openstack-Nova-Api-Version: 2.1

2018-03-25 17:33:32,157 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 31 * Sending client request on thread appc-dispatcher-11923
31 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
31 > Accept: application/json
31 > X-Auth-Token: 631eac03151d4b5d82bc8a70866194cf

2018-03-25 17:33:32,335 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 31 * Client response received on thread appc-dispatcher-11923
31 < 200
31 < Content-Length: 2750
31 < Content-Type: application/json
31 < Date: Sun, 25 Mar 2018 17:33:39 GMT
31 < X-Compute-Request-Id: req-4393f331-f909-43c5-94a4-9243d9016fee
{"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": "powering-on", "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:40:2a", "version": 4, "addr": "10.10.5.18", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:8f:9f:e9", "version": 4, "addr": "10.12.6.130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "10.0.0.18", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "bookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "71a5076a-c63b-418e-8027-05965db747c4", "mtu": 1500, "mac_address": "fa:16:3e:bf:40:2a", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "stopped", "OS-SRV-USG:launched_at": "2018-03-25T17:33:34.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "OS-EXT-STS:power_state": 4, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "SHUTOFF", "updated": "2018-03-25T17:33:38Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}

2018-03-25 17:33:33,475 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 37 * Sending client request on thread appc-dispatcher-11932
37 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
37 > Accept: application/json
37 > X-Auth-Token: dc7cadaefa1d4d45ae175f4f08d628fd

2018-03-25 17:33:33,745 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 37 * Client response received on thread appc-dispatcher-11932
37 < 200
37 < Content-Length: 2750
37 < Content-Type: application/json
37 < Date: Sun, 25 Mar 2018 17:33:40 GMT
37 < X-Compute-Request-Id: req-50a0c64d-01b9-4b5d-9d27-6e3bee0be25e
{"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": "powering-on", "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:40:2a", "version": 4, "addr": "10.10.5.18", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:8f:9f:e9", "version": 4, "addr": "10.12.6.130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "10.0.0.18", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "bookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "71a5076a-c63b-418e-8027-05965db747c4", "mtu": 1500, "mac_address": "fa:16:3e:bf:40:2a", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "stopped", "OS-SRV-USG:launched_at": "2018-03-25T17:33:34.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "OS-EXT-STS:power_state": 4, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "SHUTOFF", "updated": "2018-03-25T17:33:38Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}

2018-03-25 17:33:34,101 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 26 * Sending client request on thread appc-dispatcher-11926
26 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
26 > Accept: application/json
26 > X-Auth-Token: 75c55c147b37433a8c4bfef4f18e115c

2018-03-25 17:33:34,273 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 26 * Client response received on thread appc-dispatcher-11926
26 < 200
26 < Content-Length: 2754
26 < Content-Type: application/json
26 < Date: Sun, 25 Mar 2018 17:33:41 GMT
26 < X-Compute-Request-Id: req-57316655-8d0d-43bc-83e7-47485a51afdd
{"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": null, "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:40:2a", "version": 4, "addr": "10.10.5.18", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:8f:9f:e9", "version": 4, "addr": "10.12.6.130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "10.0.0.18", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "bookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "71a5076a-c63b-418e-8027-05965db747c4", "mtu": 1500, "mac_address": "fa:16:3e:bf:40:2a", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2018-03-25T17:33:34.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "ACTIVE", "updated": "2018-03-25T17:33:40Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}

2018-03-25 17:33:34,273 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | Server status: RUNNING
2018-03-25 17:33:35,583 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 223 * Sending client request on thread appc-dispatcher-11891
223 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
223 > Accept: application/json

...