Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The APPC 72 Hour Stability Test was kicked off at 10:30 pm ET on Thursday March 22, 2018.  The APPC environment reamined up and processed requests during the entire test period without crashing.

Environment

  • WindRiver Lab, APPC Project
  • The test was kicked off via cron set to run for 72 hours.  
  • Command to
    • Due to a defect that is blocking sending and receiving DMaaP messages in the Beijing code the Amsterdam release code was used during the APPC 72 Hour Stability test.
    • The Final Completion notification for each transaction is not returned to create a final completion result for this test.  The final completion will be integrated and tested with the Beijing code once defect APPC-658 is corrected.

    Test Execution: 

      • APPC Amsterdam:   10.12.5.43
      • Test Client VM:   10.12.5.54
      • A&AI:  10.12.5.114
      • DMaaP MR:   10.12.5.5

    Test Execution: 

    • The test was kicked off via cron set to run for 72 hours. 
    • The fully automated "closed-lopp" type test wherein Athe test is kicked off and waits for the transaction completion to be received before sending another request will be enabled in the testing once APPC-658 is resolved.
    • Command to execute the test:  ./jmeter.sh -n -t ../APPC-LCM-Action-V1.jmx -l ../APPC-LCM-Action-V1.jtl' > /dev/null 2>&1 &

    ...

    • The test was executed for 72 hours with the APPC environment remaining up and successfully processing transactions during that time.
    • The results from the test are logged in the APPC-LCM-Action-V1.jtl file on the Test Client Server
    • The APPC application logs logged the results on the APPC side:
      • karaf.log
      • Service Logic logs (DG logs)
    • Sample Stop Request:
    Code Block
    From the JTL Log:
    1521776330123,18013,Stop Transaction Controller,,"Number of samples in transaction : 4, number of failing samples : 3",Stability-Test-VM2 LCM  Group 2-1,,false,,2231,2180,1,3,18013,90014,3
    1521776438150,3,Submit request via DMaaP,200,OK,Stability-Test-VM2 LCM  Group 2-1,text,true,,332,1223,1,3,3,0,0

    Image Removed

    ...

    • Notes/Observations:
      • The performance monitor collecting statistics for the APPC VM CPU, Memory etc... crashed during the test.  A cronjob will be created going forward to check for the existance of the client running on APPC and will restart the process if it is down.  This is not APPC code but is part of the JMeter Performance monitoring plugin.


    Code Block
    titleSample Stop Request: from the JTL Log
    1521776330123,18013,Stop Transaction Controller,,"Number of samples in transaction : 4, number of failing samples : 3",Stability-Test-VM2 LCM  Group 2-1,,false,,2231,2180,1,3,18013,90014,3
    1521776438150,3,Submit request via DMaaP,200,OK,Stability-Test-VM2 LCM  Group 2-1,text,true,,332,1223,1,3,3,0,0


    Image Added

    Code Block
    titleVM STOP from the karaf.log
    2018-03-26 10:38:11,304 | INFO  | dispatcher-13420 | Keystone                         | 401 - appc-iaas-adapter - 1.2.0 | 5293 * Sending client request on thread appc-dispatcher-13420
    5293 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847
    5293 > Accept: application/json
    5293 > X-Auth-Token: 2dab36c8a9fb417a907cb7e05202008f
    
    2018-03-26 10:38:11,736 | INFO  | dispatcher-13420 | Keystone                         | 401 - appc-iaas-adapter - 1.2.0 | 5293 * Client response received on thread appc-dispatcher-13420
    5293 < 200
    5293 < Content-Length: 2590
    5293 < Content-Type: application/json
    5293 < Date: Mon, 26 Mar 2018 10:38:19 GMT
    5293 < X-Compute-Request-Id: req-84bb3a4f-9188-40cd-8091-ffb287fc7477
    {"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": null, "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:90:23:92", "version": 4, "addr": "10.10.5.14", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:35:03:47", "version": 4, "addr": "10.12.5.143", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:91:85:1d", "version": 4, "addr": "10.0.0.13", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847", "rel": "bookmark"}], "image": {"id": "f9166f14-c428-4080-895e-308f998f587e", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/f9166f14-c428-4080-895e-308f998f587e", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "ca84a4cb-f6cb-4fb4-a493-2924e6bed4a6", "mtu": 1500, "mac_address": "fa:16:3e:90:23:92", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "d7f388c7-97cf-459e-9081-1d08783c9557", "mtu": 1500, "mac_address": "fa:16:3e:35:03:47", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "ea4d9c9e-e480-4e3c-9137-34441f28bc60", "mtu": 1500, "mac_address": "fa:16:3e:91:85:1d", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2018-03-14T14:59:52.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "c0d9b8c7-9534-4a22-b464-d6aa2c930847", "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "AUTO", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "ACTIVE", "updated": "2018-03-26T10:37:51Z", "hostId": "f51e1768f5a01d1f7dd48a7124a9b3ebc10e57449ef3650c71566402", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM2", "created": "2018-02-13T17:29:33Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
    
    2018-03-26 10:38:11,743 | INFO  | dispatcher-13420 | Keystone                         | 401 - appc-iaas-adapter - 1.2.0 | 5294 * Sending client request on thread appc-dispatcher-13420
    5294 > POST http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847/action
    5294 > Accept: application/json
    5294 > Content-Type: application/json
    5294 > X-Auth-Token: 2dab36c8a9fb417a907cb7e05202008f
    {
      "os-stop" : { }
    }
    
    2018-03-26 10:38:12,022 | INFO  | dispatcher-13420 | Keystone                         | 401 - appc-iaas-adapter - 1.2.0 | 5294 * Client response received on thread appc-dispatcher-13420
    5294 < 202
    5294 < Content-Length: 0
    5294 < Content-Type: application/json
    5294 < Date: Mon, 26 Mar 2018 10:38:20 GMT
    5294 < Openstack-Api-Version: compute 2.1
    5294 < Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version
    5294 < X-Compute-Request-Id: req-b5317e37-1620-4089-8333-4bd05ca6f71a
    5294 < X-Openstack-Nova-Api-Version: 2.1
    
    2018-03-26 10:38:12,028 | INFO  | dispatcher-13420 | Keystone                         | 401 - appc-iaas-adapter - 1.2.0 | 5295 * Sending client request on thread appc-dispatcher-13420
    5295 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847
    5295 > Accept: application/json
    5295 > X-Auth-Token: 2dab36c8a9fb417a907cb7e05202008f
    
    2018-03-26 10:38:32,540 | INFO  | dispatcher-13420 | Keystone                         | 401 - appc-iaas-adapter - 1.2.0 | 5296 * Client response received on thread appc-dispatcher-13420
    5296 < 200
    5296 < Content-Length: 2577
    5296 < Content-Type: application/json
    5296 < Date: Mon, 26 Mar 2018 10:38:40 GMT
    5296 < X-Compute-Request-Id: req-a155b129-0c50-4b22-9db4-81633298052e
    {"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": null, "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:90:23:92", "version": 4, "addr": "10.10.5.14", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:35:03:47", "version": 4, "addr": "10.12.5.143", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:91:85:1d", "version": 4, "addr": "10.0.0.13", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847", "rel": "bookmark"}], "image": {"id": "f9166f14-c428-4080-895e-308f998f587e", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/f9166f14-c428-4080-895e-308f998f587e", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "ca84a4cb-f6cb-4fb4-a493-2924e6bed4a6", "mtu": 1500, "mac_address": "fa:16:3e:90:23:92", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "d7f388c7-97cf-459e-9081-1d08783c9557", "mtu": 1500, "mac_address": "fa:16:3e:35:03:47", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "ea4d9c9e-e480-4e3c-9137-34441f28bc60", "mtu": 1500, "mac_address": "fa:16:3e:91:85:1d", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "stopped", "OS-SRV-USG:launched_at": "2018-03-14T14:59:52.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "c0d9b8c7-9534-4a22-b464-d6aa2c930847", "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "AUTO", "accessIPv4": "", "accessIPv6": "", "OS-EXT-STS:power_state": 4, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "SHUTOFF", "updated": "2018-03-26T10:38:22Z", "hostId": "f51e1768f5a01d1f7dd48a7124a9b3ebc10e57449ef3650c71566402", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM2", "created": "2018-02-13T17:29:33Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
    
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | SvcLogicServiceImpl              | 295 - org.onap.ccsdk.sli.core.sli-provider - 0.1.2 | About to execute node # 2 (switch)
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | SvcLogicServiceImpl              | 295 - org.onap.ccsdk.sli.core.sli-provider - 0.1.2 | About to execute node # 3 (block)
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  STOP_STATUS -- SUCCESS
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  VNFCTYPE --
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  input.payload -- {"vm-id":"http://10.12.25.2:8774/v2.1/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847", "identity-url": "http://10.12.25.2:5000/v2.0","skip-hypervisor-check":"true"}
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  vnf-name -- Stability-Test-VM2
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  action-identifier -- vserver-id
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  vnf-host-ip-address --
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  success-message -- APPC0136I Operation StopServer succeed for http://10.12.25.2:8774/v2.1/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  request-action -- Stop
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  vnf-id -- Stability-Test-VM2
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  tmp.vnfInfo.vnf.vm-count -- 0
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  tmp.vnfInfo.status -- success
    Code Block
    titleSample Restart from the JTL Log
    1521947136559,18013,Restart Transaction Controller,,"Number of samples in transaction : 4, number of failing samples : 3",Stability-Test-VM1 LCM                                                                                        Group 1-1,,false,,2238,2192,1,3,18013,9019,1
    1521947163591,5,Submit request via DMaaP,200,OK,Stability-Test-VM1 LCM  Group 1-1,text,true,,333,1232,1,3,5,0,0

    Image Added

    Code Block
    titleSample Rebuild from the JTL Log
    1521947085508,18014,Rebuild Transaction Controller,,"Number of samples in transaction : 4, number of failing samples : 3",Stability-Test-VM3 LCM                                                                                        Group 3-1,,false,,2238,2192,1,3,18014,9024,0
    1521947112546,3,Submit request via DMaaP,200,OK,Stability-Test-VM3 LCM  Group 3-1,text,true,,333,1232,1,3,3,0,1
    1521947115550,6003,SYNC(accepted/rejectd) response via DMaaP,429,429,Stability-Test-VM3 LCM  Group 3-1,text,false,,635,320,1,3,6003,0,0


    Screenshot for Rebuild (Shows a Stop, Rebuild and Start command in the karaf.log):

    Image Added


    Code Block
    titleFrom the karaf.log Rebuild (Shows Stop, Rebuild and Start)
    2018-03-25 17:29:37,335 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 15 * Sending client request on thread appc-dispatcher-11923
    15 > POST http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14/action
    15 > Accept: application/json
    15 > Content-Type: application/json
    15 > X-Auth-Token: 631eac03151d4b5d82bc8a70866194cf
    {
      "os-stop" : { }
    }
    
    2018-03-25 17:29:37,395 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 11 * Sending client request on thread appc-dispatcher-11918
    11 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
    11 > Accept: application/json
    11 > X-Auth-Token: b965f1a53a834a679374e9a08daae178
    
    2018-03-25 17:29:37,633 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 15 * Client response received on thread appc-dispatcher-11923
    15 < 202
    15 < Content-Length: 0
    15 < Content-Type: application/json
    15 < Date: Sun, 25 Mar 2018 17:29:44 GMT
    15 < Openstack-Api-Version: compute 2.1
    15 < Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version
    15 < X-Compute-Request-Id: req-7badb1d4-2eb2-4990-b55c-4831a96a81f9
    15 < X-Openstack-Nova-Api-Version: 2.1
    
    2018-03-25 17:29:37,639 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 16 * Sending client request on thread appc-dispatcher-11923
    16 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
    16 > Accept: application/json
    16 > X-Auth-Token: 631eac03151d4b5d82bc8a70866194cf
    
    2018-03-25 17:29:37,817 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 11 * Client response received on thread appc-dispatcher-11918
    11 < 200
    11 < Content-Length: 2764
    11 < Content-Type: application/json
    11 < Date: Sun, 25 Mar 2018 17:29:44 GMT
    11 < X-Compute-Request-Id: req-ad6c8dd7-25dd-44b3-b992-16a73b920290
    {"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": "powering-off", "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:40:2a", "version": 4, "addr": "10.10.5.18", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:8f:9f:e9", "version": 4, "addr": "10.12.6.130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "10.0.0.18", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "bookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "71a5076a-c63b-418e-8027-05965db747c4", "mtu": 1500, "mac_address": "fa:16:3e:bf:40:2a", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2018-03-25T17:29:27.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "ACTIVE", "updated": "2018-03-25T17:29:44Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
    
    2018-03-25 17:29:37,989 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 16 * Client response received on thread appc-dispatcher-11923
    16 < 200
    16 < Content-Length: 2764
    16 < Content-Type: application/json
    16 < Date: Sun, 25 Mar 2018 17:29:44 GMT
    16 < X-Compute-Request-Id: req-9c4e58ac-be24-4ca0-a68c-55383da61bee
    {"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": "powering-off", "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:40:2a", "version": 4, "addr": "10.10.5.18", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:8f:9f:e9", "version": 4, "addr": "10.12.6.130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "10.0.0.18", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "bookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "71a5076a-c63b-418e-8027-05965db747c4", "mtu": 1500, "mac_address": "fa:16:3e:bf:40:2a", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2018-03-25T17:29:27.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "ACTIVE", "updated": "2018-03-25T17:29:44Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
    
    2018-03-25 17:30:38,827 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 20 * Sending client request on thread appc-dispatcher-11923
    20 > POST http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14/action
    20 > Accept: application/json
    20 > Content-Type: application/json
    20 > X-Auth-Token: 631eac03151d4b5d82bc8a70866194cf
    {
      "rebuild" : {
        "imageRef" : "6e219e86-cd94-4989-9119-def29aa10b12"
      }
    }
    
    2018-03-25 17:30:38,950 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 14 * Client response received on thread appc-dispatcher-11918
    14 < 200
    14 < Content-Length: 2741
    14 < Content-Type: application/json
    14 < Date: Sun, 25 Mar 2018 17:30:45 GMT
    14 < X-Compute-Request-Id: req-dde535a4-f2be-499b-863c-b387398fa93f
    {"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": null, "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:40:2a", "version": 4, "addr": "10.10.5.18", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:8f:9f:e9", "version": 4, "addr": "10.12.6.130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "10.0.0.18", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "bookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "71a5076a-c63b-418e-8027-05965db747c4", "mtu": 1500, "mac_address": "fa:16:3e:bf:40:2a", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "stopped", "OS-SRV-USG:launched_at": "2018-03-25T17:29:27.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "OS-EXT-STS:power_state": 4, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "SHUTOFF", "updated": "2018-03-25T17:30:45Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
    
    
    
    2018-03-25 17:33:31,823 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 30 * Sending client request on thread appc-dispatcher-11923
    30 > POST http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14/action
    30 > Accept: application/json
    30 > Content-Type: application/json
    529330 < Date: Mon, 26 Mar 2018 10:38:19 GMT
    5293 < X-Compute-Request-Id: req-84bb3a4f-9188-40cd-8091-ffb287fc7477
    {"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": null, "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:90:23:92", "version": 4, "addr": "10.10.5.14", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:35:03:47", "version": 4, "addr": "10.12.5.143", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:91:85:1d", "version": 4, "addr": "10.0.0.13", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847", "rel": "bookmark"}], "image": {"id": "f9166f14-c428-4080-895e-308f998f587e", "links": [{"href": "> X-Auth-Token: 631eac03151d4b5d82bc8a70866194cf
    {
      "os-start" : { }
    }
    
    2018-03-25 17:33:32,148 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 30 * Client response received on thread appc-dispatcher-11923
    30 < 202
    30 < Content-Length: 0
    30 < Content-Type: application/json
    30 < Date: Sun, 25 Mar 2018 17:33:39 GMT
    30 < Openstack-Api-Version: compute 2.1
    30 < Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version
    30 < X-Compute-Request-Id: req-9b360b35-f66f-4268-8376-32bade996697
    30 < X-Openstack-Nova-Api-Version: 2.1
    
    2018-03-25 17:33:32,157 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 31 * Sending client request on thread appc-dispatcher-11923
    31 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/images/f9166f14-c428-4080-895e-308f998f587e", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "ca84a4cb-f6cb-4fb4-a493-2924e6bed4a6", "mtu": 1500, "mac_address": "fa:16:3e:90:23:92", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "d7f388c7-97cf-459e-9081-1d08783c9557", "mtu": 1500, "mac_address": "fa:16:3e:35:03:47", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "ea4d9c9e-e480-4e3c-9137-34441f28bc60", "mtu": 1500, "mac_address/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
    31 > Accept: application/json
    31 > X-Auth-Token: 631eac03151d4b5d82bc8a70866194cf
    
    2018-03-25 17:33:32,335 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 31 * Client response received on thread appc-dispatcher-11923
    31 < 200
    31 < Content-Length: 2750
    31 < Content-Type: application/json
    31 < Date: Sun, 25 Mar 2018 17:33:39 GMT
    31 < X-Compute-Request-Id: req-4393f331-f909-43c5-94a4-9243d9016fee
    {"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": "powering-on", "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:91bf:8540:1d2a", "vif_pci_addressversion": ""}}]4, "wrs-sg:server_groupaddr": "10.10.5.18", "OS-EXT-STSIPS:vm_statetype": "activefixed"}], "external": [{"OS-EXT-SRVIPS-USGMAC:launchedmac_ataddr": "2018-03-14T14:59:52.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6fa:16:3e:8f:9f:e9", "linksversion": [{"href4, "addr": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e66.130", "relOS-EXT-IPS:type": "bookmarkfixed"}]}, "idoam_onap_LH2Z": [{"c0d9b8c7OS-9534EXT-4a22-b464-d6aa2c930847", "user_idIPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "6a87d2aa015c4fc5b6a6f08a9a15b00610.0.0.18", "OS-DCFEXT-IPS:diskConfigtype": "AUTOfixed"}]}, "accessIPv4links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "accessIPv6rel": "self"}, {"progresshref": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone"http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "novabookmark"}], "metadataimage": {}, "statusid": "ACTIVE6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"updatedhref": "2018-03-26T10:37:51Zhttp://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "hostIdrel": "f51e1768f5a01d1f7dd48a7124a9b3ebc10e57449ef3650c71566402bookmark"}]}, "OS-SRV-USG:terminated_atwrs-if:nics": [{"nic1": null, "wrs-res:pci_devices{"vif_model": "virtio", "wrs-res:vcpusnetwork": [1"appc-multicloud-integration", 1, 1], "key_name"port_id": "onap_key_NhWI71a5076a-c63b-418e-8027-05965db747c4", "namemtu": "Stability-Test-VM2"1500, "createdmac_address": "2018-02-13T17:29:33Zfa:16:3e:bf:40:2a", "tenantvif_pci_idaddress": "cf142fb96ce24770946c0f7117c0aeb3"}}, "os-extended-volumes:volumes_attached{"nic2": {"vif_model": []"virtio", "config_drivenetwork": "external"}}
    
    2018-03-26 10:38:11,743 | INFO  | dispatcher-13420 | Keystone                         | 401 - appc-iaas-adapter - 1.2.0 | 5294 * Sending client request on thread appc-dispatcher-13420
    5294 > POST http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847/action
    5294 > Accept: application/json
    5294 > Content-Type: application/json
    5294 > X-Auth-Token: 2dab36c8a9fb417a907cb7e05202008f
    {
      "os-stop" : { }
    }
    
    2018-03-26 10:38:12,022 | INFO  | dispatcher-13420 | Keystone                         | 401 - appc-iaas-adapter - 1.2.0 | 5294 * Client response received on thread appc-dispatcher-13420
    5294 < 202
    5294 < Content-Length: 0
    5294 < Content-Type: application/json
    5294 < Date: Mon, 26 Mar 2018 10:38:20 GMT
    5294 < Openstack-Api-Version: compute 2.1
    5294 < Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version
    5294 < X-Compute-Request-Id: req-b5317e37-1620-4089-8333-4bd05ca6f71a
    5294 < X-Openstack-Nova-Api-Version: 2.1
    
    2018-03-26 10:38:12,028 | INFO  | dispatcher-13420 | Keystone                         | 401 - appc-iaas-adapter - 1.2.0 | 5295, "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "stopped", "OS-SRV-USG:launched_at": "2018-03-25T17:33:34.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "OS-EXT-STS:power_state": 4, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "SHUTOFF", "updated": "2018-03-25T17:33:38Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
    
    2018-03-25 17:33:33,475 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 37 * Sending client request on thread appc-dispatcher-1342011932
    529537 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c73b3d77e0-9534a79d-4a224c10-b464bfac-d6aa2c9308471b3914af1a14
    529537 > Accept: application/json
    529537 > X-Auth-Token: 2dab36c8a9fb417a907cb7e05202008fdc7cadaefa1d4d45ae175f4f08d628fd
    
    2018-03-2625 1017:3833:3233,540745 | INFO  | dispatcher-13420 | Keystone                         | 401 - appc-iaas-adapter - 1.2.0 | 5296SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 37 * Client response received on thread appc-dispatcher-1342011932
    529637 < 200
    529637 < Content-Length: 25772750
    529637 < Content-Type: application/json
    529637 < Date: MonSun, 2625 Mar 2018 1017:3833:40 GMT
    529637 < X-Compute-Request-Id: req-a155b12950a0c64d-0c5001b9-4b224b5d-9db49d27-81633298052e6e3bee0be25e
    {"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": null"powering-on", "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:90bf:2340:922a", "version": 4, "addr": "10.10.5.1418", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:358f:039f:47e9", "version": 4, "addr": "10.12.56.143130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:91bf:853f:1dc8", "version": 4, "addr": "10.0.0.1318", "OS-EXT-IPS:type": "fixed"}]}, "links": [links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c73b3d77e0-9534a79d-4a224c10-b464bfac-d6aa2c9308471b3914af1a14", "rel": "selfbookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/serversimages/c0d9b8c76e219e86-9534cd94-4a224989-b4649119-d6aa2c930847def29aa10b12", "rel": "bookmark"}], "image": {"}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "f9166f1471a5076a-c428c63b-4080418e-895e8027-308f998f587e05965db747c4", "linksmtu": 1500, [{"hrefmac_address": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/f9166f14-c428-4080-895e-308f998f587efa:16:3e:bf:40:2a", "relvif_pci_address": "bookmark"}]}, "wrs-if:nics": [{"nic1nic2": {"vif_model": "virtio", "network": "appc-multicloud-integrationexternal", "port_id": "ca84a4cb42ebb59c-f6cbd574-4fb44107-a493b632-2924e6bed4a65bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:908f:239f:92e9", "vif_pci_address": ""}}, {"nic2nic3": {"vif_model": "virtio", "network": "externaloam_onap_LH2Z", "port_id": "d7f388c70d3055c6-97cfe834-459e48ae-9081a6bf-1d08783c9557931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:35bf:033f:47c8", "vif_pci_address": ""}}], {"nic3"wrs-sg:server_group": "", {"vif_model"OS-EXT-STS:vm_state": "virtiostopped", "networkOS-SRV-USG:launched_at": "oam_onap_LH2Z2018-03-25T17:33:34.000000", "port_"flavor": {"id": "ea4d9c9e1a0d1e0a-e4809e6d-4e3c4dfc-9137a0d8-34441f28bc6073aa2ef794e6", "mtu": 1500, "mac_addresslinks": [{"href": "fa:16:3e:91:85:1dhttp://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "vif_pci_addressrel": "bookmark"}]}], "wrs-sg:server_groupid": "", "OS-EXT-STS:vm_state": "stopped", "OS-SRV-USG:launched_at": "2018-03-14T14:59:52.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/flavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "c0d9b8c7-9534-4a22-b464-d6aa2c930847"3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "AUTOMANUAL", "accessIPv4": "", "accessIPv6": "", "OS-EXT-STS:power_state": 4, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "SHUTOFF", "updated": "2018-03-26T1025T17:3833:22Z38Z", "hostId": "f51e1768f5a01d1f7dd48a7124a9b3ebc10e57449ef3650c71566402f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM2VM3", "created": "2018-0203-13T1709T19:2925:33Z02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
    
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | SvcLogicServiceImpl              | 295 - org.onap.ccsdk.sli.core.sli-provider - 0.1.2 | About to execute node # 2 (switch)drive": ""}}
    
    2018-03-2625 1017:3833:3234,541101 | INFO  | dispatcher-13420 | SvcLogicServiceImpl              | 295 - org.onap.ccsdk.sli.core.sli-provider - 0.1.2 | About to execute node # 3 (block)
    2018-03-26 10:38:32,541SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 26 * Sending client request on thread appc-dispatcher-11926
    26 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
    26 > Accept: application/json
    26 > X-Auth-Token: 75c55c147b37433a8c4bfef4f18e115c
    
    2018-03-25 17:33:34,273 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  STOP_STATUS -- SUCCESS
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  VNFCTYPE --
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  input.payload -- {"vm-id":"http://10.12.25.2:8774/v2.1/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847", "identity-url": "http://10.12.25.2:5000/v2.0","skip-hypervisor-check":"true"}
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  vnf-name -- Stability-Test-VM2
    2018-03-26 10:38:32,541 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  action-identifier -- vserver-id
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  vnf-host-ip-address --
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  success-message -- APPC0136I Operation StopServer succeed for SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 26 * Client response received on thread appc-dispatcher-11926
    26 < 200
    26 < Content-Length: 2754
    26 < Content-Type: application/json
    26 < Date: Sun, 25 Mar 2018 17:33:41 GMT
    26 < X-Compute-Request-Id: req-57316655-8d0d-43bc-83e7-47485a51afdd
    {"server": {"wrs-res:topology": "node:0,  2048MB, pgsize:2M, vcpus:0, pol:sha", "OS-EXT-STS:task_state": null, "addresses": {"appc-multicloud-integration": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:40:2a", "version": 4, "addr": "10.10.5.18", "OS-EXT-IPS:type": "fixed"}], "external": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:8f:9f:e9", "version": 4, "addr": "10.12.6.130", "OS-EXT-IPS:type": "fixed"}], "oam_onap_LH2Z": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:bf:3f:c8", "version": 4, "addr": "10.0.0.18", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "self"}, {"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "rel": "bookmark"}], "image": {"id": "6e219e86-cd94-4989-9119-def29aa10b12", "links": [{"href": "http://10.12.25.2:8774/cf142fb96ce24770946c0f7117c0aeb3/images/6e219e86-cd94-4989-9119-def29aa10b12", "rel": "bookmark"}]}, "wrs-if:nics": [{"nic1": {"vif_model": "virtio", "network": "appc-multicloud-integration", "port_id": "71a5076a-c63b-418e-8027-05965db747c4", "mtu": 1500, "mac_address": "fa:16:3e:bf:40:2a", "vif_pci_address": ""}}, {"nic2": {"vif_model": "virtio", "network": "external", "port_id": "42ebb59c-d574-4107-b632-5bc9274e8b0a", "mtu": 1500, "mac_address": "fa:16:3e:8f:9f:e9", "vif_pci_address": ""}}, {"nic3": {"vif_model": "virtio", "network": "oam_onap_LH2Z", "port_id": "0d3055c6-e834-48ae-a6bf-931baf25372b", "mtu": 1500, "mac_address": "fa:16:3e:bf:3f:c8", "vif_pci_address": ""}}], "wrs-sg:server_group": "", "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2018-03-25T17:33:34.000000", "flavor": {"id": "1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "links": [{"href": "http://10.12.25.2:8774/v2.1/cf142fb96ce24770946c0f7117c0aeb3/servers/c0d9b8c7-9534-4a22-b464-d6aa2c930847
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  request-action -- Stop
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  vnf-id -- Stability-Test-VM2
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  tmp.vnfInfo.vnf.vm-count -- 0
    2018-03-26 10:38:32,542 | INFO  | dispatcher-13420 | GraphExecutor                    | 360 - appc-common - 1.2.0 | NEW KEY =  tmp.vnfInfo.status -- successflavors/1a0d1e0a-9e6d-4dfc-a0d8-73aa2ef794e6", "rel": "bookmark"}]}, "id": "3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "security_groups": [{"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}, {"name": "default"}, {"name": "onap_sg_LH2Z"}], "user_id": "6a87d2aa015c4fc5b6a6f08a9a15b006", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "ACTIVE", "updated": "2018-03-25T17:33:40Z", "hostId": "f4e6d273b6d51bcadb5ee951da8f3ee46f60d68f13a98f4d292afb29", "OS-SRV-USG:terminated_at": null, "wrs-res:pci_devices": "", "wrs-res:vcpus": [1, 1, 1], "key_name": "onap_key_NhWI", "name": "Stability-Test-VM3", "created": "2018-03-09T19:25:02Z", "tenant_id": "cf142fb96ce24770946c0f7117c0aeb3", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
    
    2018-03-25 17:33:34,273 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | Server status: RUNNING
    2018-03-25 17:33:35,583 | INFO  | SvcLogicGraph [module=APPC, rpc=RebuildVM, mode=sync, version=2.0.0] | 223 * Sending client request on thread appc-dispatcher-11891
    223 > GET http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14
    223 > Accept: application/json